Adaptive Spaced Education Improves Learning Efficiency: A Randomized Controlled Trial

Effectiveness of spaced education pedagogy in enhancing Nurses' knowledge on emotional resilience-A quasi-experimental trial

INTRODUCTION

Building resilience among nurses has been postulated as one of the key strategies to support nurses and retain them in the profession. This study aimed to evaluate the effectiveness, of spaced education pedagogy in enhancing Nurses' knowledge on emotional resilience. Secondary objectives include evaluation of the usability and acceptability of delivery of the training via a mobile application in one's own mobile device.

DESIGN

A quasi-experimental study with single group pre-test and post-test trial was conducted.

METHODS

Full-time registered nurses working in an acute care hospital were invited to participate from June 2021 to June 2022. The group used the mobile application daily for 1 month. Pre-test measurement includes socio-demographic data and baseline resilience level before the intervention. Post-test measurement includes resilience level, usability and acceptability of mobile-assisted cognitive-behavioral therapy measured upon completion of the training. The mobile application enabled the delivery of resilience educational content in small quantities through a repeating manner, with a concurrent evaluation of learner's understanding.

RESULTS

When compared to their baseline (mean = 24.38, SD = 5.50), participants reported significant increase in the Connor-Davison Resilience Scale score (mean = 26.33, SD = 5.57) (t = -4.40, p < 0.001). Upon 1 month usage of the mobile application, a higher percentage of the participants reported intermediate to high level of resilience (57.4%), as compared to prior usage (54.7%). Respondents reported knowledge of most useful strategies for their daily lives including: (i) managing negative emotions (54.1%); (ii) psychoeducation about mental health and the risks of burnout (44.7%); (iii) achieving work and life balance (43.5%); and (iv) depiction of workplace scenarios to demonstrate what can be and cannot be controlled during times of change (43.5%). Participants reported usability of the mobile application with a mean SUS score 70.5 (SD = 13.0), which was considered "acceptable." Overall, 82.3% of the participants found the mobile application appealing, 64.7% reported they were likely to use the mobile application in the future and 72.9% would recommend it to other nurses.

CONCLUSION

The mobile application provided nurses with the availability and convenience to access resilience building learning content integrated with the spaced education pedagogy.

CLINICAL RELEVANCE

The use of mobile-assisted cognitive behavioral training can aid in increasing nurses' resilience level. Nurses provided acceptable usability ratings and satisfactory acceptance of receiving training via the mobile application, showing promising opportunities in the improvement of overall well-being.

Learning Theories Versus Practice: How Do Internal Medicine Residents Study for Licensing Examinations?

OBJECTIVE

 The ability to recall relevant medical knowledge within clinical contexts is a critical aspect of effective and efficient patient diagnosis and management. The ever-growing and changing body of medical literature requires learners to develop effective life-long learning techniques. Learners can more successfully build their fund of knowledge and ability to retrieve it by using evidence-based learning strategies. Our objective was to evaluate the study habits of internal medicine (IM) residents at an academic institution to understand if they apply key learning strategies for the American Board of Internal Medicine (ABIM) exam preparation. We also briefly review various learning strategies that can be applied to IM residency curricula.

METHODS

A web-based survey consisting of 16 multiple-response questions on study habits was filled out by the IM residents in 2019 at Tufts Medical Center.

RESULTS

Of the 75 residents invited to participate in the study, 69 responded (response rate = 92%). Of the responders, n=25 (36.2%) were post-graduate year (PGY)-1, n=20 (29.0%) were PGY-2, and n=24 (34.8%) were PGY-3 residents. More than half the residents (n=40, 58%) had Step 2 Clinical Knowledge (CK) scores > 250. Residents self-reported applying spaced learning (67%), interleaving (64%), retrieval (64%), and elaboration practices (46%) for exam preparation. There was a significant association between the Step 2 CK score and elaboration (p=0.017) technique but not with spaced learning, interleaving, or retrieval. The majority of residents felt not at all prepared (n=42, 60.9%) for the ABIM exam.

CONCLUSIONS

Despite two years of clinical training, 33% of the third-year residents felt inadequately prepared for the board certification exam. Incorporating evidence-based learning strategies into their daily curriculum may help them better prepare for the ABIM exam.

A mixed method analysis of student satisfaction with active learning techniques in an online graduate anatomy course: Consideration of demographics and previous course enrollment

Online learning has become an essential part of mainstream higher education. With increasing enrollments in online anatomy courses, a better understanding of effective teaching techniques for the online learning environment is critical. Active learning has previously shown many benefits in face-to-face anatomy courses, including increases in student satisfaction. Currently, no research has measured student satisfaction with active learning techniques implemented in an online graduate anatomy course. This study compares student satisfaction across four different active learning techniques (jigsaw, team-learning module, concept mapping, and question constructing), with consideration of demographics and previous enrollment in anatomy and/or online courses. Survey questions consisted of Likert-style, multiple-choice, ranking, and open-ended questions that asked students to indicate their level of satisfaction with the active learning techniques. One hundred seventy Medical Science master's students completed the online anatomy course and all seven surveys. Results showed that students were significantly more satisfied with question constructing and jigsaw than with concept mapping and team-learning module. Additionally, historically excluded groups (underrepresented racial minorities) were generally more satisfied with active learning than non-minority groups. Age, gender, and previous experience with anatomy did not influence the level of satisfaction. However, students with a higher-grade point average (GPA), those with only a bachelor's degree, and those with no previous online course experience were more satisfied with active learning than students who had a lower GPA, those holding a graduate/professional degree, and those with previous online course experience. Cumulatively, these findings support the beneficial use of active learning in online anatomy courses.

Pilot study to explore the use of mobile spaced learning as a digital learning platform when teaching symptom management to undergraduate nursing students: SPLENdidS study

Background

The management of patients’ holistic symptom needs are often complex and challenging. The education needs of undergraduate nursing students must be optimally addressed to have a significant positive impact on patient care. Mobile spaced learning has been recognised as a form of online education which can provide a novel approach to delivering effective evidence based healthcare education to undergraduate students.

Objective

The objective of this pilot study was to explore the experiences of undergraduate nursing students in a university setting, of using mobile spaced learning as a digital platform for symptom management education.

Method

This pilot study used a mixed methods approach. Online spaced learning material, which utilised both case based scenarios and multiple choice questions, was delivered to first year undergraduate nursing students over a period of 2 weeks. Participants were then invited to participate in an online survey related to the usability of mobile spaced learning. A focus group was conducted to further explore the participants’ views.

Result

Findings conveyed that students viewed mobile spaced learning as an acceptable platform that enhanced both their learning and their ability to transfer knowledge into clinical practice.

Conclusion

Implementation of a digital spaced learning intervention would be acceptable to undergraduate nursing students learning about holistic symptom management. Further research is needed to explore the feasibility of implementing this intervention within the undergraduate nursing curriculum, and also to explore the impact on long-term knowledge retention.

Virtual Reality as a Learning Tool for Trainees in Unicompartmental Knee Arthroplasty: A Randomized Controlled Trial

INTRODUCTION

The efficacy of virtual reality (VR) as a teaching augment for arthroplasty has not been well examined for unfamiliar multistep procedures such as unicompartmental knee arthroplasty (UKA). This study sought to determine whether VR improves surgical competence over traditional procedural preparation when performing a UKA.

METHODS

Twenty-two orthopaedic surgery trainees were randomized to two surgical preparation cohorts: (1) "Guide" group (control) with access to manufacture's technique guide and surgical video and (2) "VR" group with access to an immersive commercially available VR learning module. Surgical performance of UKA on a SawBone model was assessed through time and the Objective Structured Assessment of Technical Skills (OSATS) validated rating system.

RESULTS

Participants were equally distributed among all training levels and previous exposure to UKA. No difference in mean surgical times was observed between Guide and VR groups (Guide = 42.4 minutes versus VR = 43.0 minutes; P = 0.9) or mean total OSATS (Guide = 15.7 versus VR = 14.2; P = 0.59). Most trainees felt VR would be a useful tool for resident education (77%) and would use VR for case preparation if available (86.4%).

CONCLUSION

In a randomized controlled trial of trainees at a single, large academic center performing a complex, multistep, unfamiliar procedure (UKA), VR training demonstrated equivalent surgical competence compared with the use of traditional technique guides, as measured by surgical time and OSATS scores. Most of the trainees found the VR technology beneficial. This study suggests that VR technology may be considered as an adjunct to traditional surgical preparation/training methods.

Evidence of the Spacing Effect and Influences on Perceptions of Learning and Science Curricula

The conventional science curricula generally favour educational practices that yield high scores on immediate examination, though it may not accurately predict students’ long-term academic achievement. In view of the pre-exam cramming phenomenon, this article shows the evidence of spacing effect in science education and probes into its theoretical mechanisms, effectiveness in experimental settings, and current applications in science learning. In brief, spacing works by repeatedly presenting the learning material across various temporal intervals. This paper suggests that spacing could significantly result in greater memory strength by alleviating multiple neurocognitive and behavioural properties of learning that are hampered by cramming. Together with the analysis of its relevance in science education, the spacing effect may further provide leverages for promoting long-term conceptual understanding and reflective skill development. However, there are many reasons that students and teachers may not be aware of or fully appreciate its benefits. Finally, this article discusses systemic barriers to why spaced repetition is underutilized in science curricula.

Enhanced Learning and Retention of Medical Knowledge Using the Mobile Flash card Application Anki

INTRODUCTION

As medical schools condense the basic science phase of undergraduate medical education, it has become increasingly important to identify methods and tools that facilitate learning, mastery, and application of medical knowledge. One increasingly popular tool that promotes engagement with content is Anki, a web-based flash card system. Using Anki, medical students can access pre-made flash cards specifically tailored to prepare students for the United States Medical Licensing Exam (USMLE) Step 1 exam. The objective of this study was to identify Anki use and its association to USMLE Step 1 performance.

METHODS

In March 2020, medical students in years 2, 3, and 4 who had completed USMLE Step 1 were administered a survey to measure Anki usage. The survey was locally developed and was reviewed by survey experts on campus. Survey responses were paired with USMLE Step 1 results for analyses. Descriptive and inferential statistics were used for analysis.

RESULTS

Anki usage was associated with higher USMLE Step 1 scores. Additionally, amongst those who used Anki, those with more consistent use had higher USMLE Step 1 scores and higher perceived levels of knowledge retention.

CONCLUSIONS

This research suggests that Anki is an effective educational tool that should be recommended to medical students alongside other evidenced-based study tools, such as the popular question bank USMLE World. Future research should attempt to identify a relationship between Anki usage and future clinical performance to demonstrate the implications that Anki has on clinical skills.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-021-01386-9.

NephroTalk Multimodal Conservative Care Curriculum for Nephrology Fellows

Conservative care, a comprehensive treatment path for advanced kidney disease most suitable for individuals unlikely to benefit from dialysis, is underutilized in the United States. One reason is an absence of robust education about this approach and how to discuss it with potential candidates. To address this need, we developed a multimodal conservative care curriculum for nephrology fellows. This curriculum consists of four online modules that address essential concepts and communication skills related to conservative care. It is followed by an in-person, interactive, "flipped classroom" session facilitated by designated nephrology educators at participating Accreditation Council for Graduate Medical Education nephrology training programs. Curriculum effect was assessed using surveys completed by participating fellows immediately before and following the curriculum and for participating nephrology educators following flipped classroom teaching; 148 nephrology trainees from 19 programs participated, with 108 completing both pre- and postcurriculum surveys. Mean self-reported preparedness (measured on a five-point Likert scale) increased significantly for all ten concepts taught in the curriculum. The mean correct score on eight knowledge questions increased from 69% to 82% following the curriculum (P<0.001). Fellows rated the curriculum highly and reported that they plan to practice skills learned. For the 19 nephrology program educators, the mean perceived preparedness to teach all curriculum domains increased after, compared with before, facilitating the flipped classroom, reaching significance for seven of the ten concepts measured. Data suggest that fellows' participation in a multimodal curriculum increased knowledge and preparation for fundamental conservative care concepts and communication skills. Fellows rated the curriculum highly. Educator participation appears to have increased preparedness for teaching the curriculum concepts, making it likely that future education in conservative care will become more widespread. Herein, we describe the curriculum content, which we have made publicly available in order to encourage broader implementation, and its effect on participating fellows and the nephrology educators who facilitated it.

Remote Medical Education: Adapting Kern's Curriculum Design to Tele-teaching

COVID-19 has necessitated a rapid shift to the remote delivery of medical education. We present a timely collection of tips, techniques, and strategies for the facilitation of remote teaching sessions and modification of curriculum design, assessment, and evaluation. We step through Kern's six-step curriculum design, recommending to (1) consider session necessity and a variety of teaching models; (2) inform your session with surveys and polls; (3) keep session endpoints consistent; (4) make the most of technology and translate in-person strategies to virtual forms; (5) engage with individual learners and eliminate distractions; and (6) consider online methods of assessment and evaluation methods.

Fall prevention education for people with multiple sclerosis: a randomized clinical trial

BACKGROUND

Online spaced education (OSE) is a method recognized for promoting long-term knowledge retention, changing behaviors and improving outcomes for students and healthcare professionals. However, there is little evidence about its impacts on patient education.

OBJECTIVES

The aim of this research was to compare knowledge retention using educational brochure and OSE on individuals with multiple sclerosis (MS) and to verify the impact of educational methods on fall outcome.

METHODS

Individuals with MS (n = 230) were randomly assigned to two types of patient education-educational brochure (control) and OSE (intervention). During 12 weeks, the intervention group received multiple-choice tests on fall prevention. Knowledge retention, behavior change and fall incidence were assessed before intervention and after 3 and 6 months. The participants' satisfaction with the education method was also evaluated.

RESULTS

Knowledge retention was similar between groups, and behavior change was observed in both groups. There was a significant reduction in fall rate in the intervention group, from 0.60 to 0.27 at 6 months (P < 0.001). Participants' satisfaction achieved an average of 8.75, with no differences between groups.

CONCLUSION

Individuals demonstrated significant improvement in fall rate outcome in both groups with no significant difference. In regard to test scores and satisfaction, results were similar between groups.

Spaced Education With ABSITE Quest Resulting in Improved American Board of Surgery In-Training Examination Performance

OBJECTIVE

The American Board of Surgery In-Training Examination (ABSITE) is an annual exam taken by general surgery residents as a cognitive assessment of the knowledge gained throughout each year of training. Several question banks are available for ABSITE preparation. However, ABSITE Quest (AQ) utilizes a method called spaced education which has been demonstrated to help with retaining information longer and improve exam performance. This study hypothesizes that using this method will help residents improve their ABSITE performance.

DESIGN

Retrospective survey data was collected from residents who participated in AQ, including postgraduate year (PGY) level, as well as 2019 and 2020 ABSITE percentiles. AQ user data was used to match respondent's total number of questions completed and daily engagement level to the survey data. Paired, single-tailed student's t test was used to evaluate the significance of ABSITE percentile change between 2019 and 2020 among AQ users.

SETTING

ChristianaCare, Newark, DE, United States. Nonclinical.

PARTICIPANTS

All ABSITE Quest users were surveyed (n = 390), of which 104 responded. 21 responses were from PGY1 residents and were excluded, resulting in a total of 83 responses.

RESULTS

The mean percentile difference of AQ users from 2019 to 2020 was +15.8 (p < 0.00001). When categorizing by the total number of questions completed, high users demonstrated a mean percentile difference of +15.3 (p = 0.00002), average users had a difference of +19.1 (p = 0.00029), and low users showed a percentile difference of +1.2 (p = 0.45244). When categorizing by daily engagement level, high users demonstrated a mean percentile difference of +17.9 (p < 0.00001), low users had a mean percentile difference of +15.3 (p = 0.00124), and minimal users showed a mean percentile change of -5.7.

CONCLUSIONS

The use of the spaced education method with ABSITE Quest, especially in users with a greater number of questions completed and high levels of daily engagement, correlated with a significant improvement on ABSITE performance.

Spaced Repetition Learning as a Tool for Orthopedic Surgical Education: A Prospective Cohort Study on a Training Examination

OBJECTIVE

Most surgical residents will learn written information via passive, massed exposure of material. Spaced repetition learning is an alternative, more effective, and efficient method to this more traditional method of teaching. We hypothesized that this method in the lead up to an Orthopedic basic sciences examination for postgraduate trainees would provide an effective solution for time-poor surgical trainees.

DESIGN

Twelve participants were prospectively enrolled in the study and provided informed consent and then were sent a pooled set of 1400 practice questions in a flashcard format using the spaced repetition learning program Anki. Study habits were tracked via the program and recorded the evening prior to the examination taking place. The final examination scores were then recorded and tabulated. All data were anonymized. Pearson correlation coefficient and p values were calculated for time spent and number of cards reviewed using the program.

SETTING

Australian Orthopedic Surgical trainees prepared for basic science examination.

PARTICIPANTS

All trainees eligible to sit the examination were approached for participation. Twelve participants started and all completed the study.

RESULTS

There was a strong correlation (R = 0.86, p < 0.001) between time spent and hence number of flashcards reviewed using the Anki program and final examination scores.

CONCLUSIONS

Results from this study support our hypothesis that spaced repetition learning using a flashcard format is an effective study strategy for learning material for Orthopedic examinations. This method of learning can be applied to other areas of surgery such as clinical examination or procedural skills.

Use of an Adaptive e-Learning Platform as a Formative Assessment Tool in the Cardiovascular System Course Component of an MBBS Programme

BACKGROUND

Technology-enhanced learning includes the adaptive e-learning platform, a data-driven method with computer algorithms, providing customised learning enhancing critical thinking of individual learners. "Firecracker" - an online adaptive e-learning platform, and assessment software, promotes critical thinking, helps prepare students for courses and high-stakes examinations, and evaluates progress relative to co-learners. The objectives of this study were to determine the usage rates of Firecracker, examine the performance of Firecracker formative quizzes, identify the correlation between Firecracker use and performance with that of performance at summative course assessments, and assess students' satisfaction with Firecracker usage.

METHODS

Study participants were Year-2 MBBS (Bachelor of Medicine, Bachelor of Surgery) students (n=91) of the Faculty of Medical Sciences, The University of the West Indies, Cave Hill Campus, Barbados. The Firecracker Administrator uploaded quizzes covering basic science content in the Cardiovascular System course. Access, usage, and performance on Firecracker formative quizzes were retrieved from the Firecracker dashboard. A questionnaire sought the views of study participants.

RESULTS

Seven sets of quizzes were administered over nine weeks, with weekly student completion rates ranging from 53% to 73%. Mean quiz scores ranged from 52% to 72%. Students completing >4 quiz sessions compared to those completing ≤4 demonstrated significantly better performance in Firecracker quizzes (P<0.01), final examinations (P<0.01) and in-course assessment plus final examination (P<0.05) scores. Correlations between overall Firecracker performance and in-course assessment marks (P<0.05); between total overall Firecracker performance and final examination (P<0.01); and overall Firecracker performance and total course marks (P<0.01) were all significant. Most students (70%) were happy using Firecracker and felt it complemented coursework (78%) and prepared them for course exams (58%) (P<0.01).

CONCLUSION

Overall, Firecracker was perceived very positively and welcomed by the students. Students were satisfied with the Firecracker as a formative assessment tool, and its use correlated with improved performance in the course examinations.

An Evidence-Based Guide for Medical Students: How to Optimize the Use of Expanded-Retrieval Platforms

Recommendations have been made for improving medical education based on the available evidence regarding learning. Traditional learning methods in medical education (e.g. reading from textbooks) do not ensure long-term retention. However, expanded-retrieval studying methods have been shown to improve studying efficiency. Using evidence-based practices to optimize an expanded-retrieval platform has the potential to greatly benefit knowledge acquisition and retention for medical students. This literature review was conducted to identify the best practices of expanded-retrieval platforms.

Themes within learning that promote knowledge gain and retention include presentation of related categorical information, schema formation, dual-coding, concrete examples, elaboration, changes in text appearance, and interleaving. Presentation of related categorical material together may mitigate retrieval-induced forgetting (RIF). Spaced retrieval helps to reinforce schema formation by solidifying the framework the individual students form when learning the material. Dual-coding improves learning by creating more neural pathways. Multiple concrete examples can be compared by students to see their respective differences, highlighting the true underlying principle. Variation in text appearance is most useful during the initial, short-term inter-study intervals. Interleaving is a theme where different topics are combined in the same study session and is unpopular with students but shown to be successful. Students’ subjective competency ratings of new material are largely inaccurate. More in-depth processing and learning methods that give off a sense of lower competency are actually associated with improved long-term retention.

Expanded-retrieval platforms should utilize these evidence-based components of learning to increase knowledge gain and retention within all fields of medical education.

Does Virtual Reality Improve Procedural Completion and Accuracy in an Intramedullary Tibial Nail Procedure? A Randomized Control Trial

BACKGROUND

Artificial reality technologies are currently being explored as potential options to improve surgical education. Previous studies have primarily examined the efficacy of artificial reality in laparoscopic procedures, but to our knowledge, none have been performed in orthopaedically relevant procedures such as intramedullary tibial nailing, which calls for more versatile large-scale movements.

QUESTIONS/PURPOSES

Does a virtual reality simulator with or without a standard technique guide result in (1) a higher proportion of participants who completed the insertion of an intramedullary tibial nail in a synthetic bones model and (2) greater procedural accuracy than does training with a technique guide alone?

METHODS

Twenty-five first- and second-year medical students without prior exposure to intramedullary tibial nail insertion were recruited. Participants were randomly assigned to the technique guide control group (n = 8), the virtual reality group (n = 8), or the virtual reality and technique guide group (n = 9). The technique guide was adapted from a commercially available technique guide, which participants in the assigned groups could use to prepare as much as desired. The virtual reality simulation was based on the same procedure, and we used a commercially available virtual reality simulator that we purchased for this task. Participants in the virtual reality experimental groups completed the simulation on three separate sessions, at a set interval of 3 to 4 days apart. After 10 to 14 days of preparation, all participants attempted to insert an intramedullary nail into an intact, compact bone-model tibia that lacked surrounding soft tissue. Participants were given written hints if requested, but no other assistance was given. A procedure was considered complete if the nail and screw were properly placed. Procedural accuracy was defined as the number of incorrect steps normalized out of the 16 possible performed. After the procedure, one orthopaedic surgeon assessed a blinded video of the participant performing it so the assessor could not recognize the individual or that individual's gender. Additionally, the assessor was unaware of which group each participant had been randomized to during the evaluation.

RESULTS

A higher proportion of participants in the virtual reality group (6 of 8) and the virtual reality and technique guide group (7 of 9) completed the intramedullary nail than did participants in the technique guide group (2 of 8; p = 0.01). There was no difference in completion between the virtual reality groups (p = 0.89). Participants in the virtual reality and virtual reality and technique guide had fewer normalized incorrect steps than did participants in the technique guide group (3.2 ± 0.1 of 16 and 3.1 ± 0.1 of 16 versus 5.7 ± 0.2 of 16, respectively; p = 0.02 for comparisons of virtual reality groups to technique guide, p = 0.63 between the virtual reality group).

CONCLUSIONS

Virtual reality increased both procedural accuracy and the completion proportion compared with a technique guide in medical students. Based on our findings, virtual reality may help residents learn the procedural workflow and movements required to perform surgical procedures. Future studies should examine how and when exactly the technology can be applied to residencies and its impact on residents.

LEVEL OF EVIDENCE

Level I, therapeutic study.

Effectiveness of an adaptive eLearning intervention on dental students' learning in comparison to traditional instruction

There is a great deal of excitement in higher education about the value of adaptive learning to personalize learning paths according to students' individual needs. The authors explored the impact of an Adaptive Learning Platform (ALP) on learning, by comparing learning effectiveness between dental students who used the ALP in a blended learning environment formatively and summatively compared with students who did not use the ALP (i.e., face-to-face), as measured by students' performance on the final exam in a single review preparatory course during the academic years 2013-2018. Paired t-tests showed significant improvement in post-test scores across different course instructional modalities (P < 0.01). The learning gain was greater for students who studied using the ALP summatively (t = 26.20) than those who used it formatively or studied using a face-to-face format (t = 13.10 and 14.13, respectively). Controlling for pre-test scores, analysis of covariance tests indicate that: (1) intervention groups (formative and summative ALP) scored significantly higher than the traditional group (B = 9.34 points, P < 0.01, for summative ALP group) and (B = 4.47 points, P < 0.05, for formative ALP group), and (2) summative ALP group scored significantly higher than formative ALP group (B = 4.84 points, P < 0.05). This study provides empirical evidence that an adaptive learning intervention can have a significant impact on student learning performance. The success of any adaptive learning system relies mainly on sound instructional design. Technology will continue to grow at an overwhelming pace; the cautionary note the authors highlight is that conceptions of pedagogy, complemented by technology, must guide the development of adaptive learning systems.

Conceptualising spaced learning in health professions education: A scoping review

OBJECTIVES

To investigate the definitions and applications of 'spaced learning' and to propose future directions for advancing its study and practice in health professions education.

METHOD

The authors searched five online databases for articles published on spaced learning in health professions education prior to February 2018. Two researchers independently screened articles for eligibility with set inclusion criteria. They extracted and analysed key data using both quantitative and qualitative methods.

RESULTS

Of the 2972 records retrieved, 120 articles were included in the review. More than 90% of these articles were published in the last 10 years. The definition of spaced learning varied widely and was often not theoretically grounded. Spaced learning was applied in distinct contexts, including online learning, simulation training and classroom settings. There was a large variety of spacing formats, ranging from dispersion of information or practice on a single day, to intervals lasting several months. Generally, spaced learning was implemented in practice or testing phases and rarely during teaching.

CONCLUSIONS

Spaced learning is infrequently and poorly defined in the health professions education literature. We propose a comprehensive definition of spaced learning and emphasise that detailed descriptions of spacing formats are needed in future research to facilitate the operationalisation of spaced learning research and practice in health professions education.

Adaptive instruction and learner interactivity in online learning: a randomized trial

The purpose of this study was to evaluate two online instructional design features, namely adaptation to learner prior knowledge and use of questions to enhance interactivity in online portrayals of physician-patient encounters, in the context of instructing surgical specialists to deliver perioperative tobacco interventions. An online learning module on perioperative tobacco control was developed, in formats incorporating permutations of adaptive/non-adaptive and high/low interactivity (i.e., 2 × 2 factorial design). Participants (a national sample of US anesthesiology residents) were randomly assigned to module format. Primary outcomes included tobacco knowledge, time to complete the module, and self-efficacy in delivering tobacco interventions. One hundred fourteen residents completed the module, which required a median of 60 min (interquartile range 49, 138). The difference in post-module tobacco knowledge score was similar for adaptive and non-adaptive formats [mean difference 0.3 of 10 possible (95% CI - 0.3, 1.0), p = 0.25] but time was shorter for the adaptive format [- 7 min (95% CI - 14, 0), p = 0.01] and knowledge efficiency (knowledge score divided by time) was higher [0.08 units (95% 0.03, 0.14), p = 0.004]. The level of interactivity had no significant effect on self-efficacy [- 0.1 on a 5-point scale (95% CI - 0.3, 0.1), p = 0.50] in delivering tobacco interventions (both outcomes using 5-point scales). Adapting online instruction to learners' prior knowledge appears to improve the efficiency of learning; adaptation should be implemented when feasible. Adding features that encourage learner interaction in an online course does not necessarily improve learning outcomes.

Evaluation of Longitudinal Assessment for Use in Maintenance of Certification

OBJECTIVE

The aim of the study was to evaluate a longitudinal assessment program for physical medicine and rehabilitation (LA-PM&R) as a replacement for the American Board of Physical Medicine and Rehabilitation maintenance of certification examination.

DESIGN

In this quality improvement study, randomly selected American Board of Physical Medicine and Rehabilitation diplomates were invited to participate in the LA-PM&R. Participants' maintenance of certification scaled scores were compared with LA-PM&R nonparticipants. We examined the association between LA-PM&R scores and maintenance of certification scaled scores and performance on clone items placed on both examinations.

RESULTS

There were 2222 American Board of Physical Medicine and Rehabilitation diplomates eligible to take the maintenance of certification examination from February 2018 to February 2019. Invitations were sent to 1050 randomly selected diplomates, of whom 448 initially agreed. Three hundred eighteen individuals completed more than two quarters of LA-PM&R participation and took the maintenance of certification examination. Two hundred sixty-six diplomates took the maintenance of certification examination in the same period who did not participate in LA-PM&R. The LA-PM&R group scored higher on the maintenance of certification examination than the control group (P < 0.05). Performance on the two examinations were highly correlated, r = .50, P < 0.0001. On clone items, LA-PM&R participants had 74% correct on the LA-PM&R but 86% correct on the maintenance of certification examination (P < 0.01).

CONCLUSIONS

The LA-PM&R program leads to better learning and retention of information than the 10-yr maintenance of certification examination.

Effectiveness of the spaced education pedagogy for clinicians' continuing professional development: a systematic review

CONTEXT

Ensuring clinical practice reflects current evidence is challenging given the rapid proliferation of new knowledge. Changing entrenched clinical behaviours and facilitating the adoption of best practice evidence requires a range of strategies, including affordable, scalable and effective continuing professional development (CPD). Yet, identifying the CPD delivery method most likely to effectively change and improve patient outcomes is difficult given the variability in the evidence for different learning approaches. Although there is moderate level evidence for outreach education, audit and feedback, and face-to-face or online learning, little is known about the capacity of spaced education to change ineffective clinical practice(s). Spaced education harnesses the power of spacing, repetition and testing learning content to increase topic-specific knowledge. Although spaced education is widely used in undergraduate and postgraduate medical programmes, its effectiveness as a CPD delivery method that improves patient outcomes is less certain.

AIM

To determine the effectiveness of the spaced education CPD programmes to change targeted clinical knowledge and practice(s) to improve patient outcomes.

METHOD

A systematic review, appraising the spaced education CPD evidence generated from searching six specialist medical and psychosocial databases. Studies published in English peer-reviewed journals from 1 January, 2000 to 31 August, 2018 were eligible for inclusion. A modified Kirkpatrick four levels of evaluation framework assisted with appraising the effect of spaced education CPD interventions on clinicians and patients.

RESULTS

Of the 2396 studies identified, 17 met the inclusion criteria, involving 2701 practising clinicians from multiple disciplines and specialties. Five randomised controlled trials generated level II evidence, with the remaining 12 studies generating lower levels of evidence. The majority of studies (n = 14) involved the delivery of online spaced education. All studies were evaluated using the modified Kirkpatrick four levels of evaluation framework with: 10 studies demonstrating significant increases in participants' knowledge; seven studies reporting significant changes in clinician behaviour; four studies showing significant increases in clinician confidence; and three studies identifying significant and sustained increases in participants' clinical skills. Only two studies reported positive improvements in patient outcomes.

CONCLUSION

Spaced education via an online platform offers a scalable CPD format that can increase clinical knowledge and change practice. However, further adequately powered randomised controlled trials are required to confirm that spaced education CPD can impact positively on patients' reported outcomes.

Twelve tips for medical students to establish a collaborative flashcard project

Medical students employ various study strategies to master large amounts of information during their medical education. Digital flashcards are an interactive, self-directed study stool that may improve knowledge retention by combining the principles of active recall and spaced-repetition. They may be studied during and beyond undergraduate medical education. However, making flashcards can be an onerous task. In this article, we describe twelve tips on how to establish and maintain a collaborative digital flashcard project based on the undergraduate medical curriculum.

A phase III wait-listed randomised controlled trial of novel targeted inter-professional clinical education intervention to improve cancer patients' reported pain outcomes (The Cancer Pain Assessment (CPAS) Trial): study protocol

Background

Variations in care models contribute to cancer pain being under-recognised and under-treated in half of all patients with cancer. International and national cancer pain management guidelines are achievable with minimal investment but require practice changes. While much of the cancer pain research over the preceding decades has focused on management interventions, little attention has been given to achieving better adherence to recommended cancer pain guideline screening and assessment practices. This trial aims to reduce unrelieved cancer pain by improving cancer and palliative doctors’ and nurses’ (‘clinicians’) pain assessment capabilities through a targeted inter-professional clinical education intervention delivered to participants’ mobile devices (‘mHealth’).

Methods

A wait-listed, randomised control trial design. Cancer and/or palliative care physicians and nurses employed at one of the six participating sites across Australia will be eligible to participate in this trial and, on enrolment, will be allocated to the active or wait-listed arm. Participants allocated to the active arm will be invited to complete the mHealth cancer pain assessment intervention. In this trial, mHealth is defined as medical or public health practice supported by mobile devices (i.e. phones, patient monitoring devices, personal digital assistants and other wireless devices). This mHealth intervention integrates three evidence-based elements, namely: the COM-B theoretical framework; spaced learning pedagogy; and audit and feedback. This intervention will be delivered via the QStream online platform to participants’ mobile devices over four weeks. The trial will determine if a tailored mHealth intervention, targeting clinicians’ cancer pain assessment capabilities, is effective in reducing self-reported cancer pain scores, as measured by a Numerical Rating Scale (NRS).

Discussion

If this mHealth intervention is found to be effective, in addition to improving cancer pain assessment practices, it will provide a readily transferable evidence-based framework that could readily be applied to other evidence practice gaps and a scalable intervention that could be administered simultaneously to multiple clinicians across diverse geographical locations. Moreover, if found to be cost-effective, it will help transform clinical continuing professional development. In summary, this mHealth intervention will provide health services with an opportunity to offer an evidence-based, pedagogically robust, cost-effective, scalable training alternative.

Trial registration

Australian New Zealand Clinical Trials Registry (ANZCTR), ACTRN12618001103257. Registered on 3 July 2018.

Electronic supplementary material

The online version of this article (10.1186/s13063-018-3152-z) contains supplementary material, which is available to authorized users.

Utility of intermittent online quizzes as an early warning for residents at risk of failing the pediatric board certification examination

BACKGROUND

Traditionally, quizzes have been applied as a tool for summative assessment, though literature suggests their use as a formative assessment can improve motivation and content retention. With this premise, we implemented a series of intermittent, online quizzes known as the Board Examination Simulation Exercise (BESE). We sought to demonstrate an association between BESE participation and scores and performance on the American Board of Pediatrics (ABP) Certifying Examination (CE).

METHODS

Residents were assigned online quizzes on a single topic at 2 week intervals that consisted of 20 multiple choice questions written by the study authors. This analysis includes graduates of 3 Pediatric and Internal Medicine-Pediatrics residency programs.

RESULTS

Data were available for 329 residents. The overall BESE score weakly correlated with ABP CE score (n = 287; r = 0.39, p < 0.0001). ABP CE pass rates increased from 2009 to 2016 at all programs combined (p = 0.0001). A composite BESE score ≤ 11 had sensitivity of 54% and specificity of 80% for predicting ABP CE failure on the first attempt. There was no difference in ABP CE failure rates or scores by number of completed quizzes.

CONCLUSION

Intermittent online quizzes implemented at three pediatric residency programs were associated with overall increasing ABP CE pass rates. BESE increased program emphasis on board preparation. Residents with lower BESE scores more often failed ABP CE. Though additional data are needed, BESE is a promising tool for pediatric resident learning and board preparation. It may also aid in earlier identification of residents at higher risk of failing the ABP CE and facilitate targeted interventions.

Reducing Redundant Anaerobic Therapy Through Spaced Education and Antimicrobial Stewardship Interventions

BACKGROUND

Decreasing the use of redundant anaerobic therapy is a key target for antimicrobial stewardship. Education techniques that optimize knowledge retention could be an important component of reducing these regimens.

METHODS

We implemented a quality improvement project that incorporated spaced education to reduce the use of redundant anaerobic therapy. The initial interventions (November through December 2015) included education in a hospital-wide newsletter and review of redundant anaerobic regimens by the antimicrobial stewardship program. A spaced education module was then developed with the gastroenterology (GI) service, which had a relatively high rate of redundant anaerobic therapy use. Ten questions with teaching points were delivered to GI physicians at spaced intervals over 2 to 4 weeks (February through March 2016). Knowledge scores were compared at initial and final question presentation using generalized estimating equations. Interrupted time-series analysis was used to compare the rates of redundant-metronidazole-days per 1000 patient-days among patients in the patients admitted to the GI service and those in the non-GI group before and after the intervention.

RESULTS

Of 66 GI physicians, 56 (85%) participated in the spaced education activity. After the intervention, their knowledge scores on all the questions improved, and their mean knowledge score increased from 57% to 86% (P < .001). Nearly all (91%) of the participants were very or generally satisfied with the activity. In the GI group, the rate of redundant-metronidazole-days decreased from 26.2 to 13.0 per 1000 patient-days (relative risk [RR], 0.45 [95% confidence interval (CI), 0.27-0.73]; P = .001). This rate in the non-GI group also decreased from 5.47 to 2.18 per 1000 patient-days (RR, 0.47 [95% CI, 0.36-0.60]; P < .001) after our interventions.

CONCLUSIONS

Spaced education is an effective approach for teaching antimicrobial stewardship topics. Focused provider education was associated with a sustained reduction in the use of redundant anaerobic therapy.

Pediatric Case Exposure During Emergency Medicine Residency

OBJECTIVE

While emergency medicine (EM) physicians treat the majority of pediatric EM (PEM) patients in the United States, little is known about their PEM experience during training. The primary objective was to characterize the pediatric case exposure and compare to established EM residency training curricula among EM residents across five U.S. residency programs.

METHODS

We performed a multicenter medical record review of all pediatric patients (aged < 18 years) seen by the 2015 graduating resident physicians at five U.S. EM training programs. Resident-level counts of pediatric patients were measured and specific counts were classified by the 2016 Model of Clinical Practice of Emergency Medicine (MCP) and Pediatric Emergency Care Applied Research Network (PECARN) diagnostic categories. We assessed variability between residents and between programs.

RESULTS

A total of 36,845 children were managed by 68 residents across all programs. The median age was 6 years. The median number of patients per resident was 660 with an interquartile range of 336. The most common PECARN diagnostic categories were trauma, gastrointestinal, and respiratory disease. Thirty-two core MCP diagnoses (43% of MCP list) were not seen by at least 50% of the residents. We found statistically significant variability between programs in both PECARN diagnostic categories (p < 0.01) and MCP diagnoses (p < 0.01).

CONCLUSION

There is considerable variation in the number of pediatric patients and the diagnostic case volume seen by EM residents. The relationship between this case variability and competence upon graduation is unknown; further investigation is warranted to better inform program-specific curricula and to guide training requirements in EM.

Mobile app technology is associated with improved otolaryngology resident in-service performance

OBJECTIVE

Otolaryngology residents face time-management challenges between clinical duties and self-directed learning. Mobile devices provide a new medium for education that could aid with educational efficiency. The objective of this study was to investigate whether spaced repetition mobile app use of an otolaryngology question bank was associated with improving factual knowledge as measured by in-service exam performance.

METHODS

For approximately 6 months prior to the 2016 in-service examination, 12 otolaryngology residents at a single institution were provided access to a spaced-repetition app with a preloaded licensed otolaryngology review question bank. The number of questions answered, as well as the time spent on the app, were electronically tracked. The associations of app usage on in-service results were analyzed using an autoregressive model adjusted for prior historical Otolaryngology Trainee Examination performance and postgraduate year.

RESULTS

Eleven residents used the mobile app and were included in the analysis for an average of 304 minutes (range: 3 to 1,020) and reviewed on average 679 questions (range: 6 to 1,934). Controlling for residency year and prior performance, app usage was associated with an improvement by 2.92 percentage points (pp) (95% confidence interval [CI]: 0.14, 5.70) on overall in-service score. Allergy and pediatric subsection scores improved by 11.3 pp (95% CI: 3.8, 18.8) and 15.2 pp. (95% CI: 8.9, 21.5), respectively. Increased app use was associated with a score improvement by 0.008 pp per minute of use (95% CI: 0.004, 0.012).

CONCLUSION

Use of mobile spaced-repetition technology can aid resident factual knowledge retention measured by improved in-service exam performance.

LEVEL OF EVIDENCE

4 Laryngoscope, 129:E15-E20, 2019.

Avoiding Surgical Skill Decay: A Systematic Review on the Spacing of Training Sessions

OBJECTIVE

Spreading training sessions over time instead of training in just 1 session leads to an improvement of long-term retention for factual knowledge. However, it is not clear whether this would also apply to surgical skills. Thus, we performed a systematic review to find out whether spacing training sessions would also improve long-term retention of surgical skills.

DESIGN

We searched the Medline, PsycINFO, Embase, Eric, and Web of Science online databases. We only included articles that were randomized trials with a sample of medical trainees acquiring surgical motor skills in which the spacing effect was reported. The quality and bias of the articles were assessed using the Cochrane Collaboration's risk of bias assessment tool.

RESULTS

With respect to the spacing effect, 1955 articles were retrieved. After removing duplicates and articles that did not meet the inclusion criteria, 11 articles remained. The overall quality of the experiments was "moderate." Trainees in the spaced condition scored higher in a retention test than students in the massed condition.

CONCLUSIONS

Our systematic review showed evidence that spacing training sessions improves long-term surgical skills retention when compared to massed practice. However, the optimal gap between the re-study sessions is unclear.

E-learning for health professionals

BACKGROUND

The use of e-learning, defined as any educational intervention mediated electronically via the Internet, has steadily increased among health professionals worldwide. Several studies have attempted to measure the effects of e-learning in medical practice, which has often been associated with large positive effects when compared to no intervention and with small positive effects when compared with traditional learning (without access to e-learning). However, results are not conclusive.

OBJECTIVES

To assess the effects of e-learning programmes versus traditional learning in licensed health professionals for improving patient outcomes or health professionals' behaviours, skills and knowledge.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, five other databases and three trial registers up to July 2016, without any restrictions based on language or status of publication. We examined the reference lists of the included studies and other relevant reviews. If necessary, we contacted the study authors to collect additional information on studies.

SELECTION CRITERIA

Randomised trials assessing the effectiveness of e-learning versus traditional learning for health professionals. We excluded non-randomised trials and trials involving undergraduate health professionals.

DATA COLLECTION AND ANALYSIS

Two authors independently selected studies, extracted data and assessed risk of bias. We graded the certainty of evidence for each outcome using the GRADE approach and standardised the outcome effects using relative risks (risk ratio (RR) or odds ratio (OR)) or standardised mean difference (SMD) when possible.

MAIN RESULTS

We included 16 randomised trials involving 5679 licensed health professionals (4759 mixed health professionals, 587 nurses, 300 doctors and 33 childcare health consultants).When compared with traditional learning at 12-month follow-up, low-certainty evidence suggests that e-learning may make little or no difference for the following patient outcomes: the proportion of patients with low-density lipoprotein (LDL) cholesterol of less than 100 mg/dL (adjusted difference 4.0%, 95% confidence interval (CI) -0.3 to 7.9, N = 6399 patients, 1 study) and the proportion with glycated haemoglobin level of less than 8% (adjusted difference 4.6%, 95% CI -1.5 to 9.8, 3114 patients, 1 study). At 3- to 12-month follow-up, low-certainty evidence indicates that e-learning may make little or no difference on the following behaviours in health professionals: screening for dyslipidaemia (OR 0.90, 95% CI 0.77 to 1.06, 6027 patients, 2 studies) and treatment for dyslipidaemia (OR 1.15, 95% CI 0.89 to 1.48, 5491 patients, 2 studies). It is uncertain whether e-learning improves or reduces health professionals' skills (2912 health professionals; 6 studies; very low-certainty evidence), and it may make little or no difference in health professionals' knowledge (3236 participants; 11 studies; low-certainty evidence).Due to the paucity of studies and data, we were unable to explore differences in effects across different subgroups. Owing to poor reporting, we were unable to collect sufficient information to complete a meaningful 'Risk of bias' assessment for most of the quality criteria. We evaluated the risk of bias as unclear for most studies, but we classified the largest trial as being at low risk of bias. Missing data represented a potential source of bias in several studies.

AUTHORS' CONCLUSIONS

When compared to traditional learning, e-learning may make little or no difference in patient outcomes or health professionals' behaviours, skills or knowledge. Even if e-learning could be more successful than traditional learning in particular medical education settings, general claims of it as inherently more effective than traditional learning may be misleading.

Intermittent but not sustained moderate hypoxia elicits long-term facilitation of hypoglossal motor output

Phrenic long-term facilitation (pLTF) is a form of serotonin-dependent respiratory motor plasticity induced by moderate acute intermittent hypoxia (AIH), but not by moderate acute sustained hypoxia (ASH) of similar cumulative duration. Thus, moderate AIH-induced pLTF is sensitive to the pattern of hypoxia. On the other hand, pLTF induced by severe AIH protocols is neither pattern sensitive nor serotonin dependent (it converts to an adenosine-dependent mechanism). Although moderate AIH also induces hypoglossal LTF (hLTF), no data are available concerning its sensitivity/insensitivity to the pattern of hypoxia. Since hLTF following moderate hypoxia is serotonin-dependent, we hypothesized that hLTF is pattern-sensitive, similar to serotonin-dependent pLTF. Integrated hypoglossal nerve activity was recorded in urethane-anesthetized, vagotomized, paralyzed, and ventilated rats exposed to isocapnic AIH (3, 5min episodes of 11% O₂) or ASH (a single 25min episode of 11% O₂). Similar to previous studies of pLTF, hypoglossal motor output was elevated for more than 1h following AIH (50±20%, p<0.01), but not ASH (-6±9%, p>0.05). Frequency LTF was not observed following either hypoxic exposure. Thus, in agreement with our hypothesis, hypoglossal LTF following moderate AIH is pattern-sensitive, similar to phrenic LTF.

A Randomized Educational Interventional Trial of Spaced Education During a Pediatric Rotation

OBJECTIVE

Spacing of educational material over time has been shown to improve learning efficiency and long-term knowledge retention. We evaluated the impact of adding a spaced education curriculum to a month-long pediatric rotation.

METHODS

This was a randomized controlled educational intervention trial of residents on a rotation in a pediatric emergency department. Participants were randomized to the standard curriculum or the standard curriculum with integrated spaced education. The intervention used an automated platform to electronically deliver questions to user e-mail or mobile devices and provided instant feedback. Our primary outcome was proportion of correctly answered questions following the rotation. Our secondary outcomes included test performance at 3 months, change in clinical confidence, and satisfaction with the spaced learning. Learner opinion of the platform was assessed by postrotation survey.

RESULTS

Of 194 eligible trainees, 122 were enrolled and randomized. A total of 107 of the enrolled residents (88%) completed the immediate postrotation assessment, 48 of whom received spaced education. Sixty residents completed the 3-month follow-up. There were no differences between the control and intervention groups in baseline knowledge. The intervention group performed better than the control group on the postrotation assessment (mean difference = 5.4%, 95% confidence interval = 0.1-10.7) when controlled for didactic attendance and clinical exposure. Change in confidence did not differ between groups. Eighty-seven percent of spaced education learners would participate in a similar model in the future.

CONCLUSION

Spaced education during a pediatric emergency medicine rotation is an effective adjunct to a standard curriculum. Participants showed improvement on postrotation knowledge performance and enjoyed this educational approach.

Factors Influencing Physicians' Selection of Continuous Professional Development Activities: A Cross-Specialty National Survey

INTRODUCTION

We sought to understand what influences physicians' decisions about participation in continuous professional development (CPD) activities, and how often physicians engage in specific CPD activities.

METHODS

From September 2015 to April 2016, we administered a survey to 4648 randomly sampled licensed US physicians. Survey items addressed perceived barriers to CPD, factors that might influence participation in four prototypical CPD activities (reading an article, or completing a local activity, online course, or far-away course), and frequency of CPD engagement.

RESULTS

Nine hundred eighty-eight (21.6%) physicians responded. The most important barriers were time (mean [SD] 3.5 [1.3], 1 = not important, 5 = extremely important) and cost (2.9 [1.3]). In prioritizing factors influencing participation in four prototypical CPD activities, topical relevance consistently had the highest average rank. Quality of content and time to complete the activity were also frequently selected. Over the past 3 years, most physicians reported having participated in patient-focused learning and self-directed learning on a weekly basis; quality improvement and local continuing medical education (CME) activities several times per year; online learning, on-site courses, and national board-related activities a few times per year; and interprofessional learning less than once per year. Physicians believed that they ought to engage more often in all of these activities except board-related activities. They would like CME credit for these activities much more often than currently obtained.

DISCUSSION

The reasons physicians select a given CPD activity vary by activity, but invariably include topic and quality of content. Physicians want CME credit for the CPD activities they are already doing.

Spaced learning using emails to integrate psychiatry into general medical curriculum: Keep psychiatry in mind

OBJECTIVES

Traditionally, medical students on clinical rotations receive instruction on principles of mental health only during the psychiatry clerkship. We used emails to insert teaching of psychiatric concepts beyond the psychiatry clerkship into other rotations using the method of spaced learning, the delivery of brief morsels of information repeated over time intervals. We predicted that the intervention would improve attitudes and confidence towards the integration of psychiatry and knowledge retention.

METHODS

We developed and distributed a series of emails relating key psychiatric concepts targeted to the other core clerkships.

RESULTS

In a cluster-randomized trial over one academic year (intervention group n = 71, control group n = 61), scores on the Attitudes and Confidence in the Integration of Psychiatry scale and on the knowledge quiz did not differ significantly. Students who actively engaged with the emails demonstrated significantly higher scores on the knowledge test. Email users valued the timing, format of delivery and application of psychiatric principles outside the psychiatric setting. Participants recommended simplifying the format and previewing the benefits of spaced learning to increase utilization.

CONCLUSION

Delivering spaced learning through emails, within a curriculum designed to foster engagement, may provide an efficient means of addressing the widely-recognized but elusive goal of integrating teaching across medical disciplines.

An Online Learning Module to Increase Self-Efficacy and Involvement in Care for Patients With Advanced Lung Cancer: Research Protocol

Background

Improving patient care for individuals with lung cancer is a priority due to the increasing burden of the disease globally. One way this can be done is by improving patient self-management capabilities through increasing their self-efficacy. This can improve positive outcomes for patients with chronic conditions and increase their ability to manage the challenges of such illnesses. Unfortunately, patients with chronic conditions often struggle to travel far from home to engage with patient education events, a common means of improving self-efficacy. The development of more accessible tools for improving patient self-efficacy is required to increase quality of life for patients with chronic conditions.

Objective

To evaluate the feasibility of delivering symptom identification and management information to patients with advanced lung cancer using an online program.

Methods

This article describes a pre-post test study to evaluate a Qstream online learning platform to improve patient self-efficacy for managing advanced lung cancer symptoms. Undertaking this program should increase participant knowledge about the side-effects they may experience as a result of their treatment and in turn increase help-seeking behavior and self-efficacy for the participant cohort. Quantitative data collected by the Qstream platform on the completion rates of participants will be used as a tool to evaluate the intervention. Additionally, validated scales will be used to collect data on patient self-efficacy. Qualitative data will also be collected via an exit survey and thematic content analysis of semi-structured interviews.

Results

The research is in the preliminary stages but thus far a protocol has been approved in support of the project. Additionally, advisory committee members have been identified and initial meetings have been undertaken.

Conclusions

Development of new approaches for increasing patient understanding of their care is important to ensure high quality care continues to be delivered in the clinical setting.

Nephrologists as Educators: Clarifying Roles, Seizing Opportunities

Nephrologists play an important role in providing medical education in a variety of settings, including the medical school classroom, nephrology consult service, outpatient clinic, and dialysis unit. Therefore, nephrologists interact with a variety of learners. In this article the current state of published literature in medical education in nephrology is reviewed. Eight attending roles are identified of the nephrologist as a medical educator in the academic settings: inpatient internal medicine service, nephrology inpatient consult service, inpatient ESRD service, outpatient nephrology clinic, kidney transplantation, dialysis unit, classroom teacher, and research mentor. Defining each of these distinct settings could help to promote positive faculty development and encourage more rigorous education scholarship in nephrology.

Review of Simulation in Pediatrics: The Evolution of a Revolution

Recent changes in medical education have highlighted the importance of experiential learning. Simulation is one model that has gained significant attention in the last decade and has been widely adopted as a training and assessment tool in medical education. Pediatric simulation has been utilized to teach various skills including resuscitation and trauma management, procedural skills, and team training. It is also a valuable tool for health care educators, as it allows learners to achieve competence without putting patients at risk. Recent literature demonstrates increased retention of knowledge and skills after simulation-based training. Further research is required to improve current simulation curriculums, develop validated assessment tools, and to demonstrate improved clinical outcomes after simulation-based training. We conducted an online search of original and review articles related to simulation and pediatric medical education and provide an overview of the role and utility of simulation in pediatrics. Key PointsSimulation in pediatrics has been widely accepted and adapted as a training and assessment tool in medical education.Simulation in pediatrics has been utilized to teach various skills including resuscitation and trauma management, procedural skills, and team training.Further research is required to improve current simulation curriculums, to develop validated assessment tools, and to demonstrate improved clinical outcomes after simulation-based training.

The value of online learning and MRI: finding a niche for expensive technologies

BACKGROUND

The benefits of online learning come at a price. How can we optimize the overall value?

AIMS

Critically appraise the value of online learning.

METHODS

Narrative review.

RESULTS

Several prevalent myths overinflate the value of online learning. These include that online learning is cheap and easy (it is usually more expensive), that it is more efficient (efficiency depends on the instructional design, not the modality), that it will transform education (fundamental learning principles have not changed), and that the Net Generation expects it (there is no evidence of pent-up demand). However, online learning does add real value by enhancing flexibility, control and analytics. Costs may also go down if disruptive innovations (e.g. low-cost, low-tech, but instructionally sound "good enough" online learning) supplant technically superior but more expensive online learning products. Cost-lowering strategies include focusing on core principles of learning rather than technologies, using easy-to-learn authoring tools, repurposing content (organizing and sequencing existing resources rather than creating new content) and using course templates.

CONCLUSIONS

Online learning represents just one tool in an educator's toolbox, as does the MRI for clinicians. We need to use the right tool(s) for the right learner at the right dose, time and route.

Impact of a novel online learning module on specialist palliative care nurses' pain assessment competencies and patients' reports of pain: Results from a quasi-experimental pilot study

BACKGROUND

Pain is a complex multidimensional phenomenon moderated by consumer, provider and health system factors. Effective pain management cuts across professional boundaries, with failure to screen and assess contributing to the burden of unrelieved pain.

AIM

To test the impact of an online pain assessment learning module on specialist palliative care nurses' pain assessment competencies, and to determine whether this education impacted positively on palliative care patients' reported pain ratings.

DESIGN

A quasi-experimental pain assessment education pilot study utilising 'Qstream^©', an online methodology to deliver 11 case-based pain assessment learning scenarios, developed by an interdisciplinary expert panel and delivered to participants' work emails over a 28-day period in mid-2012. The 'Self-Perceived Pain Assessment Competencies' survey and chart audit data, including patient-reported pain intensity ratings, were collected pre-intervention (T1) and post-intervention (T2) and analysed using inferential statistics to determine key outcomes.

SETTING/PARTICIPANTS

Nurses working at two Australian inpatient specialist palliative care services in 2012.

RESULTS

The results reported conform to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Guidelines. Participants who completed the education intervention ( n = 34) increased their pain assessment knowledge, assessment tool knowledge and confidence to undertake a pain assessment ( p < 0.001). Participants were more likely to document pain intensity scores in patients' medical records than non-participants (95% confidence interval = 7.3%-22.7%, p = 0.021). There was also a significant reduction in the mean patient-reported pain ratings between the admission and audit date at post-test of 1.5 (95% confidence interval = 0.7-2.3) units in pain score.

CONCLUSION

This pilot confers confidence of the education interventions capacity to improve specialist palliative care nurses' pain assessment practices and to reduce patient-rated pain intensity scores.

Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction

BACKGROUND

Health systems worldwide are facing shortages in health professional workforce. Several studies have demonstrated the direct correlation between the availability of health workers, coverage of health services, and population health outcomes. To address this shortage, online eLearning is increasingly being adopted in health professionals' education. To inform policy-making, in online eLearning, we need to determine its effectiveness.

METHODS

We performed a systematic review of the effectiveness of online eLearning through a comprehensive search of the major databases for randomised controlled trials that compared online eLearning to traditional learning or alternative learning methods. The search period was from January 2000 to August 2013. We included articles which primarily focused on students' knowledge, skills, satisfaction and attitudes toward eLearning and cost-effectiveness and adverse effects as secondary outcomes. Two reviewers independently extracted data from the included studies. Due to significant heterogeneity among the included studies, we presented our results as a narrative synthesis.

FINDINGS

Fifty-nine studies, including 6750 students enrolled in medicine, dentistry, nursing, physical therapy and pharmacy studies, met the inclusion criteria. Twelve of the 50 studies testing knowledge gains found significantly higher gains in the online eLearning intervention groups compared to traditional learning, whereas 27 did not detect significant differences or found mixed results. Eleven studies did not test for differences. Six studies detected significantly higher skill gains in the online eLearning intervention groups, whilst 3 other studies testing skill gains did not detect differences between groups and 1 study showed mixed results. Twelve studies tested students' attitudes, of which 8 studies showed no differences in attitudes or preferences for online eLearning. Students' satisfaction was measured in 29 studies, 4 studies showed higher satisfaction for online eLearning and 20 studies showed no difference in satisfaction between online eLearning and traditional learning. Risk of bias was high for several of the included studies.

CONCLUSION

The current evidence base suggests that online eLearning is equivalent, possibly superior to traditional learning. These findings present a potential incentive for policy makers to cautiously encourage its adoption, while respecting the heterogeneity among the studies.

Patient Education, Coaching, and Self-Management for Cancer Pain

Purpose

Multiple systematic reviews and meta-analyses have identified the effectiveness of patient education in improving cancer pain management. However, the mechanisms by which patient education improves pain outcomes are uncertain, as are the optimal delivery, content, timing, frequency, and duration. This review provides best-bet recommendations based on available evidence to guide service managers and clinicians in developing a patient education program.

Methods

We used patient-centered care, self-management, coaching, and a behavior change wheel as lenses through which to consider the evidence for elements of patient education most likely to be effective within the context of other strategies for overcoming barriers to cancer pain assessment and management.

Results

The evidence suggests that optimal strategies include those that are patient-centered and tailored to individual needs, are embedded within health professional–patient communication and therapeutic relationships, empower patients to self-manage and coordinate their care, and are routinely integrated into standard cancer care. An approach that integrates patient education with processes and systems to ensure implementation of key standards for pain assessment and management and education of health professionals has been shown to be most effective.

Conclusion

Patient education is effective in reducing cancer pain and should be standard practice in all settings. For optimal results, patient education should be integrated with other strategies for implementing evidence-based, person-centered care and overcoming barriers at the levels of patient, provider, and health system.

Spaced scenario demonstrations improve knowledge and confidence in pediatric acute illness management

OBJECTIVES

Nationally accredited simulation courses such as advance pediatric life support and pediatric advance life support are recommended for health care professionals (HCPs) at two yearly intervals as a minimum requirement, despite literature evidence suggesting rapid decline in knowledge shortly after course completion. The objective of this study was to evaluate an observation-based, educational intervention program aimed at improving previously acquired knowledge and confidence in managing critical illnesses.

METHODS

A prospective cohort longitudinal study was conducted over a 6-month period. Participants were assessed with a knowledge based questionnaire immediately prior to and after observing 12 fortnightly critical illness scenario demonstrations (CISDs). The outcome measure was performance on questionnaires. Regression analysis was used to adjust for potential confounders. Questionnaire practice effect was evaluated on 30 independent HCPs not exposed to the CISDs.

RESULTS

Fifty-four HCPs (40 doctors and 14 nurses) participated in the study. All participants had previously attended nationally accredited simulation courses with a mean time since last attendance of 1.8 ± 0.4 years. The median number of attendances at CISD was 6 (2-12). The mean questionnaire scores at baseline (17.2/25) were significantly lower than the mean post intervention questionnaire scores (20.3/25), p = 0.003. The HCPs self-rated confidence in managing CISD was 6.5 times higher at the end of the program in the intervention group (p = 0.002) than at baseline. There was no practice effect for questionnaires demonstrated in the independent sample.

CONCLUSION

The educational intervention program significantly improved the knowledge and confidence of the participants in managing pediatric critical illnesses. The CISD program provides an inexpensive, practical, and time effective method of facilitating knowledge acquisition and retention. Despite the distinctively different approach, this study has shown the effectiveness of the participant being an observer to enhance pediatric resuscitation skills.

The effect of a daily quiz (TOPday) on self-confidence, enthusiasm, and test results for biomechanics

Many students in Biomedical Sciences have difficulty understanding biomechanics. In a second-year course, biomechanics is taught in the first week and examined at the end of the fourth week. Knowledge is retained longer if the subject material is repeated. However, how does one encourage students to repeat the subject matter? For this study, we developed 'two opportunities to practice per day (TOPday)', consisting of multiple-choice questions on biomechanics with immediate feedback, which were sent via e-mail. We investigated the effect of TOPday on self-confidence, enthusiasm, and test results for biomechanics. All second-year students (n = 95) received a TOPday of biomechanics on every regular course day with increasing difficulty during the course. At the end of the course, a non-anonymous questionnaire was conducted. The students were asked how many TOPday questions they completed (0-6 questions [group A]; 7-18 questions [group B]; 19-24 questions [group C]). Other questions included the appreciation for TOPday, and increase (no/yes) in self-confidence and enthusiasm for biomechanics. Seventy-eight students participated in the examination and completed the questionnaire. The appreciation for TOPday in group A (n = 14), B (n = 23) and C (n = 41) was 7.0 (95 % CI 6.5-7.5), 7.4 (95 % CI 7.0-7.8), and 7.9 (95 % CI 7.6-8.1), respectively (p < 0.01 between A and C). Of the students who actively participated (B and C), 91 and 80 % reported an increase in their self-confidence and enthusiasm, respectively, for biomechanics due to TOPday. In addition, they had a higher test result for biomechanics (p < 0.01) compared with those who did not actively participate (A). In conclusion, the teaching method 'TOPday' seems an effective way to encourage students to repeat the subject material, with the extra advantage that students are stimulated to keep on practising for the examination. The appreciation was high and there was a positive association between active participation, on the one hand, and self-confidence, enthusiasm, and test results for biomechanics on the other.

An online spaced-education game to teach and assess medical students: a multi-institutional prospective trial

PURPOSE

To investigate whether a spaced-education (SE) game can be an effective means of teaching core content to medical students and a reliable and valid method of assessing their knowledge.

METHOD

This nine-month trial (2008-2009) enrolled students from three U.S. medical schools. The SE game consisted of 100 validated multiple-choice questions-explanations in preclinical/clinical domains. Students were e-mailed two questions daily. Adaptive game mechanics re-sent questions in three or six weeks if answered, respectively, incorrectly or correctly. Questions expired if not answered on time (appointment dynamic). Students retired questions by answering each correctly twice consecutively (progression dynamic). Posting of relative performance fostered competition. Main outcome measures were baseline and completion scores.

RESULTS

Seven-hundred thirty-one students enrolled. Median baseline score was 53% (interquartile range [IQR] 16) and varied significantly by year (P<.001, dmax=2.08), school (P<.001, dmax=0.75), and gender (P<.001, d=0.38). Median completion score was 93% (IQR 12) and varied significantly by year (P=.001, dmax=1.12), school (P<.001, dmax=0.34), and age (P=.019, dmax=0.43). Scores did not differ significantly between years 3 and 4. Seventy percent of enrollees (513/731) requested to participate in future SE games.

CONCLUSIONS

An SE game is an effective and well-accepted means of teaching core content and a reliable and valid method to assess student knowledge. SE games may be valuable tools to identify and remediate students who could benefit from additional educational support.

Impact of online education on intern behaviour around joint commission national patient safety goals: a randomised trial

PURPOSE

To compare the effectiveness of two types of online learning methodologies for improving the patient-safety behaviours mandated in the Joint Commission National Patient Safety Goals (NPSG).

METHODS

This randomised controlled trial was conducted in 2010 at Massachusetts General Hospital and Brigham and Women's Hospital (BWH) in Boston USA. Incoming interns were randomised to either receive an online Spaced Education (SE) programme consisting of cases and questions that reinforce over time, or a programme consisting of an online slide show followed by a quiz (SQ). The outcome measures included NPSG-knowledge improvement, NPSG-compliant behaviours in a simulation scenario, self-reported confidence in safety and quality, programme acceptability and programme relevance.

RESULTS

Both online learning programmes improved knowledge retention. On four out of seven survey items measuring satisfaction and self-reported confidence, the proportion of SE interns responding positively was significantly higher (p<0.05) than the fraction of SQ interns. SE interns demonstrated a mean 4.79 (36.6%) NPSG-compliant behaviours (out of 13 total), while SQ interns completed a mean 4.17 (32.0%) (p=0.09). Among those in surgical fields, SE interns demonstrated a mean 5.67 (43.6%) NPSG-compliant behaviours, while SQ interns completed a mean 2.33 (17.9%) (p=0.015). Focus group data indicates that SE was more contextually relevant than SQ, and significantly more engaging.

CONCLUSION

While both online methodologies improved knowledge surrounding the NPSG, SE was more contextually relevant to trainees and was engaging. SE impacted more significantly on both self-reported confidence and the behaviour of surgical residents in a simulated scenario.

Spaced education activates students in a theoretical radiological science course: a pilot study

BACKGROUND

The present study aimed at determining if the addition of spaced education to traditional face-to-face lectures increased the time students kept busy with the learning content of a theoretical radiological science course.

METHODS

The study comprised two groups of 21 third-year dental students. The students were randomly assigned to a "traditional group" and a "spaced education group". Both groups followed a traditional face-to-face course. The intervention in the spaced education group was performed in way that these students received e-mails with a delay of 14 days to each face-to-face lecture. These e-mails contained multiple choice questions on the learning content of the lectures. The students returned their answers to the questions also by e-mail. On return they received an additional e-mail that included the correct answers and additional explanatory material.All students of both groups documented the time they worked on the learning content of the different lectures before a multiple choice exam was held after the completion of the course. All students of both groups completed the TRIL questionnaire (Trierer Inventar zur Lehrevaluation) for the evaluation of courses at university after the completion of the course. The results for the time invested in the learning content and the results of the questionnaire for the two groups were compared using the Mann-Whitney-U test.

RESULTS

The spaced education group spent significantly more time (216.2 ± 123.9 min) on keeping busy with the learning content compared to the traditional group (58.4 ± 94.8 min, p < .0005). The spaced education group rated the didactics of the course significantly better than the traditional group (p = .034). The students of the spaced education group also felt that their needs were fulfilled significantly better compared to the traditional group as far as communication with the teacher was concerned (p = .022).

CONCLUSIONS

Adding spaced education to a face-to-face theoretical radiological science course activates students in a way that they spend significantly more time on keeping busy with the learning content.