Efficacy of adaptive e-learning for health professionals and students: a systematic review and meta-analysis

Physiotherapy students' academic performance and satisfaction after following a chest physiotherapy course in hybrid mode: a case-control study

Hybrid e-learning offered flexibility for students who could not attend in-person classes during the COVID-19 pandemic, but its effectiveness in teaching chest physiotherapy remains to be determined. This retrospective case-control study assessed physiotherapy students' academic performance and satisfaction with a hybrid classroom approach adopted during the COVID-19 pandemic for teaching airway clearance techniques. Physiotherapy students participated in a 'Critical area and airway clearance techniques' seminar in person or remotely. The evaluation included a multiple-choice quiz (0-20 points) for theoretical knowledge, a checklist (0-10 points) for practical skills, and a total score (0-30 points). Satisfaction was measured using a 5-point Likert scale. Quartile regression tests calculated median differences, 95% confidence intervals (CIs), and Cohen's d effect sizes for each assessment component. The analysis included 41 students (54% men, mean age: 23 ± 2.1). The face-to-face group outperformed the remote group in total scores (median difference: 6 [95% CI 2.89; 9.10], effect size: 1.48 [0.72; 2.23]) and practical skills (median difference: 4 [2.31; 5.68], effect size: 2.05 [1.35; 2.76]). However, there was no conclusive difference in theoretical knowledge (median difference: 2 [-0.24; 4.24], effect size: 0.61 [-0.07; 1.29]). Student satisfaction was similar. Physiotherapy students attending the 'Critical area and airway clearance techniques' seminar remotely achieved lower scores than their in-person counterparts, highlighting the potential limitations of hybrid teaching for this subject. The mean scores indicated that this method allowed students to acquire the necessary knowledge during the COVID-19 pandemic.

Effects of implementation strategies on nursing practice and patient outcomes: a comprehensive systematic review and meta-analysis

BACKGROUND

Implementation strategies targeting individual healthcare professionals and teams, such as audit and feedback, educational meetings, opinion leaders, and reminders, have demonstrated potential in promoting evidence-based nursing practice. This systematic review examined the effects of the 19 Cochrane Effective Practice and Organization Care (EPOC) healthcare professional-level implementation strategies on nursing practice and patient outcomes.

METHODS

A systematic review was conducted following the Cochrane Handbook, with six databases searched up to February 2023 for randomized studies and non-randomized controlled studies evaluating the effects of EPOC implementation strategies on nursing practice. Study selection and data extraction were performed in Covidence. Random-effects meta-analyses were conducted in RevMan, while studies not eligible for meta-analysis were synthesized narratively based on the direction of effects. The quality of evidence was assessed using GRADE.

RESULTS

Out of 21,571 unique records, 204 studies (152 randomized, 52 controlled, non-randomized) enrolling 36,544 nurses and 340,320 patients were included. Common strategies (> 10% of studies) were educational meetings, educational materials, guidelines, reminders, audit and feedback, tailored interventions, educational outreach, and opinion leaders. Implementation strategies as a whole improved clinical practice outcomes compared to no active intervention, despite high heterogeneity. Group and individual education, patient-mediated interventions, reminders, tailored interventions and opinion leaders had statistically significant effects on clinical practice outcomes. Individual education improved nurses' attitude, knowledge, perceived control, and skills, while group education also influenced perceived social norms. Although meta-analyses indicate a small, non-statistically significant effect of multifaceted versus single strategies on clinical practice, the narrative synthesis of non-meta-analyzed studies shows favorable outcomes in all studies comparing multifaceted versus single strategies. Group and individual education, as well as tailored interventions, had statistically significant effects on patient outcomes.

CONCLUSIONS

Multiple types of implementation strategies may enhance evidence-based nursing practice, though effects vary due to strategy complexity, contextual factors, and variability in outcome measurement. Some evidence suggests that multifaceted strategies are more effective than single component strategies. Effects on patient outcomes are modest. Healthcare organizations and implementation practitioners may consider employing multifaceted, tailored strategies to address local barriers, expand the use of underutilized strategies, and assess the long-term impact of strategies on nursing practice and patient outcomes.

TRIAL REGISTRATION

PROSPERO CRD42019130446.

Training approaches for the dissemination of clinical guidelines for NSSI: a quasi-experimental trial

BACKGROUND

Non-suicidal self-injury (NSSI) is of high clinical relevance due to its high prevalence and negative long-term implications. In 2016, the German consensus-based clinical guidelines for diagnostic, assessment and treatment of NSSI in childhood and adolescence were published. However, research indicates that clinical guidelines are often poorly implemented in clinical practice. One crucial part of this process is the training of healthcare professionals to transfer knowledge and capacities to bring guideline recommendations into clinical practice.

METHODS

The effect of three different dissemination strategies (printed educational material, e-learning, and blended-learning) on the NSSI guidelines´ recommendations was examined among 671 physicians and psychotherapists via an online-survey. The quasi-experimental study included three measurement points (before the training, after the training, 3-month follow-up) and mixed effects models were used to test for changes in knowledge, competences and attitudes toward NSSI and treatment. Moreover, the transfer of gained competences to practical work and user satisfaction were reviewed.

RESULTS

With all three training formats, the intended changes of the outcome variables could be observed. Hereby, the printed educational material condition showed the lowest improvement in the scores for the 'negative attitudes toward NSSI and those who self-injure'. The training effect remained stable throughout the follow-up measurement. The highest application rate of acquired intervention techniques in clinical practice was reported for the blended-learning condition. For all three training strategies, user satisfaction was high and evaluation of training quality was positive, with printed educational material receiving the lowest and blended-learning the highest evaluations.

CONCLUSIONS

In summary, all three training formats were perceived to be of high quality and seem to be suited to cover the needs of a heterogeneous group of physicians and psychotherapists. The choice of training method could be driven by considering which training goals are desired to be achieved and by the benefit-cost ratio allowing for tailored training approaches.

How Are Alternative Clinical Placements Performed Compared to Traditional Clinical Placements During the COVID-19 Pandemic? Sought Through a Systematic Review and Meta-Analysis

Clinical placement is the essential method of learning in health professions education, but it has been the most disrupted by the COVID-19 pandemic. Institutions of higher education resorted to alternative learning such as telehealth, simulations, and blended-learning for clinical placement to ensure that educational activities continue without delay. However, this raises questions about student competency and necessitates making up for missed in-person hours. A thorough investigation of the effectiveness of alternative clinical placement learning is required. A systematic searching was conducted on ten electronic databases, and the quality of the included articles was assessed using the Medical Education Research Study Quality Instrument (MERSQI). A meta-analysis was conducted by pooling studies with examination mark outcomes. Twenty-four articles were included in the systematic review and nine were included in the meta-analysis. The average MERSQI score for included studies is 11.15. Outcomes on student performance favor alternative placement, whereas perceived-based outcomes have mixed results and are slightly prone to traditional clinical placement. Meta-analysis indicates that alternative learning is either more effective than traditional clinical placement or at least on par with it. There is a discrepancy between perceived outcome and performance assessment regarding the utility of alternative learning to conventional clinical placement. Nonetheless, objective measurement outcomes and the meta-analysis support alternative learning as a reliable learning strategy for clinical education. Alternative learning for clinical placement experience can be improved further by adding more synchronous sessions, and implementing various learning methods, learning activities based on strong instructional design, and at least a short real-setting attachment.

Learning Outcomes of e-Learning in Psychotherapy Training and Comparison With Conventional Training Methods: Systematic Review

BACKGROUND

Mental disorders pose a major public health problem in most western countries. The demand for services for common mental health disorders has been on the rise despite the widespread accessibility of medication. Especially, the supply and demand for evidence-based psychotherapy do not align. Large-scale increase of modern psychotherapy is difficult with current methods of training which are often expensive, time consuming, and dependent on a small number of top-level professionals as trainers. E-learning has been proposed to enhance psychotherapy training accessibility, quality, and scalability.

OBJECTIVE

This systematic review aims to provide an overview of the current evidence regarding e-learning in psychotherapy training. In particular, the review examines the usability, acceptability, and learning outcomes associated with e-learning. Learning outcomes are assessed in different modalities including trainee experiences, knowledge acquisition, skill acquisition, and application of trained content in daily practice. Furthermore, the equivalence of web-based training and conventional training methods is evaluated.

METHODS

Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a search from Ovid, MEDLINE, PsycINFO, and Scopus databases between 2008 and June 2022 was conducted. Inclusion criteria required studies to describe e-learning systems for psychotherapy training and assess acceptability, feasibility, or learning outcomes. The risk of bias was evaluated for both randomized and nonrandomized studies. Learning outcomes were categorized using the Kirkpatrick model. Effect sizes comparing e-learning and traditional methods were calculated.

RESULTS

The search yielded 3380 publications, of which 34 fulfilled the inclusion criteria. Positive learning outcomes are generally associated with various e-learning programs in psychotherapy training including trainee satisfaction, knowledge, and skill acquisition, and in application of trained content in clinical practice. Learning outcomes generally show equivalence between e-learning and conventional training methods. The overall effect size, indicating this disparity, was 0.01, suggesting no significant difference. This literature displays a high level of heterogeneity in e-learning solutions and assessment methods.

CONCLUSIONS

e-Learning seems to have good potential to enhance psychotherapy training by increasing access, scalability, and cost-effectiveness while maintaining quality in terms of learning outcomes. Results are congruent with findings related to e-learning in health education in general where e-learning as a pedagogy is linked to an opportunity to carry out learner-centric practices. Recommendations for conducting psychotherapy training programs in blended settings supported by activating learning methods are presented. However, due to the heterogeneity and limitations in the existing literature, further research is necessary to replicate these findings and to establish global standards for e-learning, as well as for the assessment of training outcomes in psychotherapy education. Research is especially needed on the effects of training on patient outcomes and optimal ways to combine e-learning and conventional training methods in blended learning settings.

The Paradoxes of Digital Tools in Hospitals: Qualitative Interview Study

BACKGROUND

Digital tools are progressively reshaping the daily work of health care professionals (HCPs) in hospitals. While this transformation holds substantial promise, it leads to frustrating experiences, raising concerns about negative impacts on clinicians' well-being.

OBJECTIVE

The goal of this study was to comprehensively explore the lived experiences of HCPs navigating digital tools throughout their daily routines.

METHODS

Qualitative in-depth interviews with 52 HCPs representing 24 medical specialties across 14 hospitals in Switzerland were performed.

RESULTS

Inductive thematic analysis revealed 4 main themes: digital tool use, workflow and processes, HCPs' experience of care delivery, and digital transformation and management of change. Within these themes, 6 intriguing paradoxes emerged, and we hypothesized that these paradoxes might partly explain the persistence of the challenges facing hospital digitalization: the promise of efficiency and the reality of inefficiency, the shift from face to face to interface, juggling frustration and dedication, the illusion of information access and trust, the complexity and intersection of workflows and care paths, and the opportunities and challenges of shadow IT.

CONCLUSIONS

Our study highlights the central importance of acknowledging and considering the experiences of HCPs to support the transformation of health care technology and to avoid or mitigate any potential negative experiences that might arise from digitalization. The viewpoints of HCPs add relevant insights into long-standing informatics problems in health care and may suggest new strategies to follow when tackling future challenges.

Validation of the motivated strategies for learning questionnaire and instructional materials motivation survey

PURPOSE

To validate the Motivated Strategies for Learning Questionnaire (MSLQ), which measures learner motivations; and the Instructional Materials Motivation Survey (IMMS), which measures the motivational properties of educational activities.

METHODS

Participants (333 pharmacists, physicians, and advanced practice providers) completed the MSLQ, IMMS, Congruence-Personalization Questionnaire (CPQ), and a knowledge test immediately following an online learning module (April 2021). We randomly divided data for split-sample analysis using confirmatory factor analysis (CFA), exploratory factor analysis (EFA), and the multitrait-multimethod matrix.

RESULTS

Cronbach alpha was ≥0.70 for most domains. CFA using sample 1 demonstrated suboptimal fit for both instruments, including 3 negatively-worded IMMS items with particularly low loadings. Revised IMMS (RIMMS) scores (which omit negatively-worded items) demonstrated better fit. Guided by EFA, we identified a novel 3-domain, 11-item 'MSLQ-Short Form-Revised' (MSLQ-SFR, with domains: Interest, Self-efficacy, and Attribution) and the 4-domain, 12-item RIMMS as the best models. CFA using sample 2 confirmed good fit. Correlations among MSLQ-SFR, RIMMS, and CPQ scores aligned with predictions; correlations with knowledge scores were small.

CONCLUSIONS

Original MSLQ and IMMS scores show poor model fit, with negatively-worded items notably divergent. Revised, shorter models-the MSLQ-SFR and RIMMS-show satisfactory model fit (internal structure) and relations with other variables.

An e-Learning Course to Train General Practitioners in Planetary Health: Pilot Intervention Study

BACKGROUND

According to the World Health Organization, climate and ecological emergencies are already major threats to human health. Unabated climate change will cause 3.4 million deaths per year by the end of the century, and health-related deaths in the population aged ≥65 years will increase by 1540%. Planetary health (PH) is based on the understanding that human health and human civilization depend on flourishing natural systems and the wise stewardship of those natural systems. Health care systems collectively produce global emissions equivalent to those of the fifth largest country on earth, and they should take steps to reduce their environmental impact. Primary care in France accounts for 23% of greenhouse gas emissions in the health care sector. General practitioners (GPs) have an important role in PH. The course offers first-year GP residents of the Montpellier-Nîmes Faculty of Medicine a blended-learning course on environmental health. An e-learning module on PH, lasting 30 to 45 minutes, has been introduced in this course.

OBJECTIVE

The objective of this study was to assess the impact of the e-learning module on participants' knowledge and behavior change.

METHODS

This was a before-and-after study. The module consisted of 3 parts: introduction, degradation of ecosystems and health (based on the Intergovernmental Panel on Climate Change report and planetary limits), and ecoresponsibility (based on the Shift Project report on the impact of the health care system on the environment). The questionnaire used Likert scales to self-assess 10 points of knowledge and 5 points of PH-related behavior.

RESULTS

A total of 95 participants completed the pre- and posttest questionnaires (response rate 55%). The mean scores for participants' pretest knowledge and behaviors were 3.88/5 (SD 0.362) and 3.45/5 (SD 0.705), respectively. There was no statistically significant variation in the results according to age or gender. The pretest mean score of participants who had already taken PH training was statistically better than those who had not taken the PH training before this course (mean 4.05, SD 0.16 vs mean 3.71, SD 0.374; P<.001).

CONCLUSIONS

The PH module of the Primary Care Environment and Health course significantly improved self-assessment knowledge scores and positively modified PH behaviors among GP residents. Further work is needed to study whether these self-declared behaviors are translated into practice.

Training Family Medicine Residents in Dermoscopy Using an e-Learning Course: Pilot Interventional Study

BACKGROUND

Skin cancers are the most common group of cancers diagnosed worldwide. Aging and sun exposure increase their risk. The decline in the number of dermatologists is pushing the issue of dermatological screening back onto family doctors. Dermoscopy is an easy-to-use tool that increases the sensitivity of melanoma diagnosis by 60% to 90%, but its use is limited due to lack of training. The characteristics of "ideal" dermoscopy training have yet to be established. We created a Moodle (Moodle HQ)-based e-learning course to train family medicine residents in dermoscopy.

OBJECTIVE

This study aimed to evaluate the evolution of dermoscopy knowledge among family doctors immediately and 1 and 3 months after e-learning training.

METHODS

We conducted a prospective interventional study between April and November 2020 to evaluate an educational program intended for family medicine residents at the University of Montpellier-Nîmes, France. They were asked to complete an e-learning course consisting of 2 modules, with an assessment quiz repeated at 1 (M1) and 3 months (M3). The course was based on a 2-step algorithm, a method of dermoscopic analysis of pigmented skin lesions that is internationally accepted. The objectives of modules 1 and 2 were to differentiate melanocytic lesions from nonmelanocytic lesions and to precisely identify skin lesions by looking for dermoscopic morphological criteria specific to each lesion. Each module consisted of 15 questions with immediate feedback after each question.

RESULTS

In total, 134 residents were included, and 66.4% (n=89) and 47% (n=63) of trainees fully participated in the evaluation of module 1 and module 2, respectively. This study showed a significant score improvement 3 months after the training course in 92.1% (n=82) of participants for module 1 and 87.3% (n=55) of participants for module 2 (P<.001). The majority of the participants expressed satisfaction (n=48, 90.6%) with the training course, and 96.3% (n=51) planned to use a dermatoscope in their future practice. Regarding final scores, the only variable that was statistically significant was the resident's initial scores (P=.003) for module 1. No measured variable was found to be associated with retention (midtraining or final evaluation) for module 2. Residents who had completed at least 1 dermatology rotation during medical school had significantly higher initial scores in module 1 at M0 (P=.03). Residents who reported having completed at least 1 dermatology rotation during their family medicine training had a statistically significant higher score at M1 for module 1 and M3 for module 2 (P=.01 and P=.001).

CONCLUSIONS

The integration of an e-learning training course in dermoscopy into the curriculum of FM residents results in a significant improvement in their diagnosis skills and meets their expectations. Developing a program combining an e-learning course and face-to-face training for residents is likely to result in more frequent and effective dermoscopy use by family doctors.

[How much digitization do ENT curricula need? : Opportunities and limits from the perspective of students and teachers]

BACKGROUND

Digitalization has long been an integral part of students' everyday lives and increasingly also of their medical training. It seems to be an unwritten law that "digital natives" want as much digitalization as possible. This study aims to shed more light on how students in the clinical phase of medical studies perceive the increasing digitalization of teaching and what they need for good education.

MATERIALS AND METHODS

This study analyzed two surveys that were conducted using an online questionnaire. On the one hand, students in the 5th-9th semesters of the medical faculty at the University of Hamburg (n = 282) were surveyed (survey 1). Another survey addressed all employees of ENT clinics in Germany (n = 175; survey 2).

RESULTS

A total of 76 students took part in survey 1 and 123 lecturers in survey 2. The results show that both students and lecturers do not want face-to-face teaching to be completely replaced by digital formats. A total of 72.7% of students reject the possibility of teaching practical skills through digital formats. The majority of students surveyed stated that offline formats improve their concentration (61.1%), participation probability (63.9%), and motivation to learn (76.6%). In contrast, 40.2% of lecturers see digitalization as a way to reduce the workload without any relevant loss in teaching quality.

CONCLUSION

Digital teaching formats have a negative impact on the medical education of the students surveyed. Interaction and physical presence are needed to increase the motivation to learn. This leads to the first conclusion that students are critical of the increasing digitalization of medical studies.

Usefulness of pedagogical design features of a digital educational resource into nursing home placement: a qualitative study of nurse educators' experiences

BACKGROUND

The rapid advancement of technology-enhanced learning opportunities has resulted in requests of applying improved pedagogical design features of digital educational resources into nursing education. Digital educational resources refers to technology-mediated learning approaches. Efficient integration of digital educational resources into nursing education, and particularly into clinical placement, creates considerable challenges. The successful use of digital educational resources requires thoughtful integration of technological and pedagogical design features. Thus, we have designed and developed a digital educational resource, digiQUALinPRAX, by emphasizing pedagogical design features. The nurse educators' experiences of the usefulness of this digital educational resource is vital for securing improved quality in placement studies.

AIM

To obtain an in-depth understanding of the usefulness of the pedagogical design features of a digital educational resource, digiQUALinPRAX, in supporting nurse educators' educational role in nursing home placements in the first year of nursing education.

METHODS

An explorative and descriptive qualitative research design was used. Individual semi-structured interviews were conducted with six nurse educators working in first year of a Bachelor's of Nursing programme after using the digital educational resource, digiQUALinPRAX, during an eight-week clinical placement period in nursing homes in April 2022.

RESULTS

Two main categories were identified: (1) supporting supervision and assessment of student nurses and (2) supporting interactions and partnerships between stakeholders.

CONCLUSION

The pedagogical design features of the digiQUALinPRAX resource provided nurse educators with valuable pedagogical knowledge in terms of supervision and assessment of student nurses, as well as simplified and supported interaction and partnership between stakeholders.

Implementing adaptive e-learning for newborn care in Tanzania: an observational study of provider engagement and knowledge gains

INTRODUCTION

To improve healthcare provider knowledge of Tanzanian newborn care guidelines, we developed adaptive Essential and Sick Newborn Care (aESNC), an adaptive e-learning environment. The objectives of this study were to (1) assess implementation success with use of in-person support and nudging strategy and (2) describe baseline provider knowledge and metacognition.

METHODS

6-month observational study at one zonal hospital and three health centres in Mwanza, Tanzania. To assess implementation success, we used the Reach, Efficacy, Adoption, Implementation and Maintenance framework and to describe baseline provider knowledge and metacognition we used Howell's conscious-competence model. Additionally, we explored provider characteristics associated with initial learning completion or persistent activity.

RESULTS

aESNC reached 85% (195/231) of providers: 75 medical, 53 nursing and 21 clinical officers; 110 (56%) were at the zonal hospital and 85 (44%) at health centres. Median clinical experience was 4 years (IQR 1-9) and 45 (23%) had previous in-service training for both newborn essential and sick newborn care. Efficacy was 42% (SD ±17%). Providers averaged 78% (SD ±31%) completion of initial learning and 7% (SD ±11%) of refresher assignments. 130 (67%) providers had ≥1 episode of inactivity >30 day, no episodes were due to lack of internet access. Baseline conscious-competence was 53% (IQR: 38%-63%), unconscious-incompetence 32% (IQR: 23%-42%), conscious-incompetence 7% (IQR: 2%-15%), and unconscious-competence 2% (IQR: 0%-3%). Higher baseline conscious-competence (OR 31.6 (95% CI 5.8 to 183.5)) and being a nursing officer (aOR: 5.6 (95% CI 1.8 to 18.1)), compared with medical officer, were associated with initial learning completion or persistent activity.

CONCLUSION

aESNC reach was high in a population of frontline providers across diverse levels of care in Tanzania. Use of in-person support and nudging increased reach, initial learning and refresher assignment completion, but refresher assignment completion remains low. Providers were often unaware of knowledge gaps, and lower baseline knowledge may decrease initial learning completion or activity. Further study to identify barriers to adaptive e-learning normalisation is needed.

What works in radiology education for medical students: a systematic review and meta-analysis

BACKGROUND

Medical imaging related knowledge and skills are widely used in clinical practice. However, radiology teaching methods and resultant knowledge among medical students and junior doctors is variable. A systematic review and meta-analysis was performed to compare the impact of different components of radiology teaching methods (active versus passive teaching, eLearning versus traditional face-to-face teaching) on radiology knowledge / skills of medical students.

METHODS

PubMed and Scopus databases were searched for articles published in English over a 15-year period ending in June 2021 quantitatively comparing the effectiveness of undergraduate medical radiology education programs regarding acquisition of knowledge and/or skills. Study quality was appraised by the Medical Education Research Study Quality Instrument (MERSQI) scoring and analyses performed to assess for risk of bias. A random effects meta-analysis was performed to pool weighted effect sizes across studies and I2 statistics quantified heterogeneity. A meta-regression analysis was performed to assess for sources of heterogeneity.

RESULTS

From 3,052 articles, 40 articles involving 6,242 medical students met inclusion criteria. Median MERSQI score of the included articles was 13 out of 18 possible with moderate degree of heterogeneity (I2 = 93.42%). Thematic analysis suggests trends toward synergisms between radiology and anatomy teaching, active learning producing superior knowledge gains compared with passive learning and eLearning producing equivalent learning gains to face-to-face teaching. No significant differences were detected in the effectiveness of methods of radiology education. However, when considered with the thematic analysis, eLearning is at least equivalent to traditional face-to-face teaching and could be synergistic.

CONCLUSIONS

Studies of educational interventions are inherently heterogeneous and contextual, typically tailored to specific groups of students. Thus, we could not draw definitive conclusion about effectiveness of the various radiology education interventions based on the currently available data. Better standardisation in the design and implementation of radiology educational interventions and design of radiology education research are needed to understand aspects of educational design and delivery that are optimal for learning.

TRIAL REGISTRATION

Prospero registration number CRD42022298607.

E-learning module for cytopathology education based on virtual microscopy

INTRODUCTION

In cytopathology education, Virtual Microscopy e-learning modules (VM-eLM) have achieved remarkable results in the improvement and personalization of learning. However, it remains to be determined whether these modules can significantly contribute to improving the accuracy of cytological diagnosis. The aim of this work was to create a VM-eLM for gynecologic cytopathology education designed to improve screening and interpretation skills in two groups of cytologists: experienced and nonexperienced.

MATERIALS AND METHODS

The module was designed in Moodle with both Whole Slide Images and Static Images taken from Papanicolaou smears that were diagnosed as: negative for intraepithelial lesion, low-grade squamous intraepithelial lesion, high-grade squamous intraepithelial lesion, squamous cell carcinoma, or adenocarcinoma. We assessed the effectiveness of the module using 1) clinical quality indicators to measure skill development and 2) a user survey.

RESULTS

After training, participants significantly improved their cytological screening skills, decreasing their false negative diagnosis by 78% in the non-experienced group and eliminating them entirely in the experienced group. Nonexperienced participants also significantly increased their recognition of low-grade squamous intraepithelial lesion and high-grade squamous intraepithelial lesion by 31% and 50%, respectively. Participants positively evaluated the module, highlighting its novelty, the possibility to train remotely, the immediate feedback and the quality of the Whole Slide Images.

CONCLUSIONS

We designed, implemented and tested a VM-eLM for Gynecologic Cytopathology Education that improved cytological screening skills for both non-experienced and experienced cytologists, also increasing the diagnostic accuracy of preinvasive lesions by less experienced cytologists. The module was positively evaluated by participants, who perceived an improvement in their interpretive skills.

Gamified versus non-gamified online educational modules for teaching clinical laboratory medicine to first-year medical students at a large allopathic medical school in the United States

BACKGROUND

Medical educators seek innovative ways to engage learners efficiently and effectively. Gamification has been explored as one way to accomplish this feat; however, questions remain about which contexts gamification would be most useful. Time constraints and student interest present major barriers for teaching laboratory medicine to students. This study aims to compare two versions of an interactive online module, one gamified and one not, for teaching laboratory medicine concepts to pre-clinical medical students.

METHODS

First-year medical students reviewed either a gamified or non-gamified version of an interactive online module in preparation for an in-person flipped classroom session on Laboratory Medicine. Learning theory guided the design of the modules and both contained identical content, objectives, and structure. The "gamified" module included the additional elements of personalization, progress meters, points, badges, and story/role play. After reviewing the module, students completed an anonymous knowledge check and optional survey.

RESULTS

One hundred seventy-one students completed the post module knowledge check as assigned (82 gamified, 89 non-gamified). Knowledge check scores were higher for the students who reviewed the gamified module (p < 0.02), corresponding to an effect size of 0.4 for the gamified module. Eighty-one students completed optional post-module surveys (46 gamified, 35 non-gamified). Instructional efficiency was calculated using task difficulty questions and knowledge check scores, and the resulting instructional efficiency was higher for the gamified module. There was no significant difference in the student-reported time required to complete the modules. Additionally, both versions of the module were well received and led to positive ratings related to motivation and confidence. Finally, examination of open-ended survey results suggested that the addition of game elements added value to the gamified module and enhanced engagement and enjoyment.

CONCLUSIONS

In this setting, the addition of gamification to an interactive online module enhanced learning outcome, instructional efficiency, student engagement and enjoyment. These results should inspire further exploration of gamification for teaching Laboratory Medicine concepts to pre-clinical medical students.

The effect of e-learning on point-of-care ultrasound education in novices

BACKGROUND

Current studies assessed the learning efficacy of e-learning in ultrasound (US) training using questionnaires, or simulation in well-controlled conditions. This study investigates the effect of e-learning on the clinical US performance of the first postgraduate year (PGY-1) residents.

METHODS

In this prospective observational study, we enrolled PGY-1 and second postgraduate year (PGY-2) residents. The e-learning was introduced on the first day and each PGY-1 was authorized to access the e-learning platform. The point-of-care ultrasound (PoCUS) curriculum for the focused assessment of sonography for trauma (FAST) was conducted on the 7^th day for PGY-1 and the objective structured clinical examination (OSCE) followed. The PGY-2 received bedside one-to-one random learning before the study and did not have the authorization to access the e-learning. The FAST examinations performed by the PGY-1 and PGY-2 were collected on the 30th day. The clinical FAST performance was assessed by the instructor not involved in the curriculum and blinded to the use of e-learning, including numbers, image quality, and diagnostic accuracy between PGY-1 e-learning users, non-users, and the PGY-2.

RESULTS

One hundred and seventy PGY-1 with 736 FAST examinations and 53 PGY-2 residents with 134 examinations were included. Seventy PGY-1 used e-learning with a median time spent of 13.2 mins (IQR, 6.5-21.1 mins) at the first access. The PGY-2 had more PoCUS experience than the PGY-1, however, the 70 e-learning users performed more FAST examinations than the PGY-2 (median [IQR], 4 [2-6] vs. 2 [1-3], p = 0.0004) and had better image quality than the PGY-2 (3 [3-3.2] vs. 3 [2.7-3], p = 0.044). There were no significant differences in the diagnostic accuracy between the PGY-1 and PGY-2.

CONCLUSIONS

E-learning has a positive effect on US learning. The PGY-1 users had comparable performance with the PGY-2 and even better image acquisition although the PGY-2 had more PoCUS experience.

TRIAL REGISTRATION

NCT03738033 at ClinicalTrials.gov.

Artificial Intelligence Revolutionizing the Field of Medical Education

Medical education has ventured into a new arena of computer-assisted teaching powered by artificial intelligence (AI). In medical institutions, AI can serve as an intelligent tool facilitating the decision-making process effectively. AI can enhance teaching by assisting in developing new strategies for educators. Similarly, students also benefit from intelligent systems playing the role of competent teachers. Thus, AI-integrated medical education paves new opportunities for advanced teaching and learning experiences and improved outcomes. On the other hand, optical mark recognition and automated scoring are ways AI can also transform into a real-time assessor and evaluator in medical education. This review summarizes the AI tools and their application in medical teaching or learning, assessment, and administrative support. This article can aid medical institutes in planning and implementing AI according to the needs of the educators.

e-Learning Evaluation Framework and Tools for Global Health and Public Health Education: Protocol for a Scoping Review

BACKGROUND

There has been a significant increase in the use of e-learning for global and public health education recently, especially following the COVID-19 pandemic. e-Learning holds the potential to offer equal opportunities, overcoming barriers like physical limitations and training costs. However, its effectiveness remains debated, with institutions unprepared for the sudden shift during the pandemic. To effectively evaluate the outcomes of e-learning, a standardized and rigorous approach is necessary. However, the existing literature on this subject often lacks standardized assessment tools and theoretical foundations, leading to ambiguity in the evaluation process. Consequently, it becomes imperative to identify a clear theoretical foundation and practical approach for evaluating global and public health e-learning outcomes.

OBJECTIVE

This protocol for a scoping review aims to map the state of e-learning evaluation in global and public health education to determine the existing theoretical evaluation frameworks, methods, tools, and domains and the gaps in research and practice.

METHODS

The scoping review will be conducted following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. The initial search was performed in PubMed, Education Resource Information Center, Web of Science, and Scopus to identify peer-reviewed articles that report on the use of evaluation and assessment for e-learning training. The search strings combined the concepts of e-learning, public health, and health science education, along with evaluation and frameworks. After the initial search, a screening process will be carried out to determine the relevance of the identified studies to the research question. Data related to the characteristics of the included studies, the characteristics of the e-learning technology used in the studies, and the study outcomes will be extracted from the eligible articles. The extracted data will then undergo a structured, descriptive, quantitative, and qualitative content analysis to synthesize the information from the selected studies.

RESULTS

 Initial database searches yielded a total of 980 results. Duplicates have been removed, and title and abstract screening of the 805 remaining extracted articles are underway. Quantitative and qualitative findings from the reviewed articles will be presented to answer the study objective.

CONCLUSIONS

This scoping review will provide global and public health educators with a comprehensive overview of the current state of e-learning evaluation. By identifying existing e-learning frameworks and tools, the findings will offer valuable guidance for further advancements in global and public health e-learning evaluation. The study will also enable the creation of a comprehensive, evidence-based e-learning evaluation framework and tools, which will improve the quality and accountability of global health and public health education. Ultimately, this will contribute to better health outcomes.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/49955.

Pedagogical impact of integration of musculoskeletal anatomy blended learning on physiotherapy education

Background

In physiotherapy education, blended learning is recognized to be more effective compared to traditional teaching. The aim of this study was to assess the consequences of a musculoskeletal anatomy blended learning program on skills developed by students.

Methods

We conducted an observational retrospective monocentric study in a French physiotherapy school named "X." Ninety-two first-year students in the 2017-18 baseline group (students with traditional face-to-face learning), and ninety-eight first-year students and ninety-five second-year students in the 2018-19 and 2019-20 blended learning experimental groups was included. A success rate of the anatomy final written exam, defined by the percentage of students scoring 50% or above, was analyzed between 2017 and 2020. We also evaluated the pedagogical value of musculoskeletal e-learning and its usefulness for preparing the student for their anatomy final written exam at «X».

Results

We observed an improvement in the success rate of the anatomy final written exam between the 2017-18 baseline group, 2018-19 and 2019-2020 experimental groups during first (Kruskal-Wallis = 74.06, df = 2, p < 0.001) and second semester (Kruskal-Wallis = 173.6, df = 2, p < 0.001). We obtained a data survey and questionnaire response rate of 74% (n = 89/120) for the 2018-19 and 62% (n = 72/116) for the 2019-20 experimental groups. Concerning questionnaire response, they were no significant statistical difference between 2018-19 and 2019-20 experimental groups.

Conclusion

Blended learning could improve student success rate of the anatomy final written exam and learning of professional physiotherapy skills.

'Hold the course(s)!' - a qualitative interview study of the impact of pandemic-triggered contact restrictions on online instruction in community-based family medicine teaching

The COVID-19 pandemic has been identified as a catalyst for the digitalization of medical education. Less is known about the specific impact of the pandemic on decentralized, community-based education, such as in General Practitioner practices. The aim of this study is to understand the impact of the digital transformation process, triggered by the COVID-19 pandemic. As, family medicine courses involve both university-based and community-based teaching, this study focuses the mode and quality of instruction and instructors in family medicine teaching. A qualitative interview study was conducted. The participants (N = 12) of a multi-perspective Quality Circle in family medicine teaching were interviewed twice: first, in 2019, about digitalization in family medicine teaching in Tübingen, Germany, not yet aware of the global changes and local transformation that would take place shortly thereafter. Second, in a follow-up interview in 2020 about the transition process and digitalization following the impact of contact restrictions during the pandemic. Grounded Theory was used as a qualitative research approach to analyze the complex processes surrounding this transformation. By analyzing the interviews with various stakeholders of community and university-based teaching, a model for the digital transformation process of family medicine teaching at the University of Tübingen in response to an external stimulus (the pandemic) was developed. It involves six chronological steps: "The calm before the storm," "The storm hits," "All hands on deck," "Adrift," "Reset course," and "The silver lining." This model seeks to understand the process of digital transformation and its impact on the teaching institution (medical faculty of the University of Tübingen, Institute for General Practice and Interprofessional Health Care) and instructors from an integrated perspective and thereby critically revisits prior concepts and opinions on the digitalization of medical teaching. Insights gained are presented as key messages.

Feasibility of an Adaptive E-Learning Environment to Improve Provider Proficiency in Essential and Sick Newborn Care in Mwanza, Tanzania

Introduction

To improve healthcare provider knowledge of Tanzanian newborn care guidelines, we developed adaptive Essential and Sick Newborn Care (aESNC), an adaptive e-learning environment (AEE). The objectives of this study were to 1) assess implementation success with use of in-person support and nudging strategy and 2) describe baseline provider knowledge and metacognition.

Methods

6-month observational study at 1 zonal hospital and 3 health centers in Mwanza, Tanzania. To assess implementation success, we used the RE-AIM framework and to describe baseline provider knowledge and metacognition we used Howell's conscious-competence model. Additionally, we explored provider characteristics associated with initial learning completion or persistent activity.

Results

aESNC reached 85% (195/231) of providers: 75 medical, 53 nursing, and 21 clinical officers; 110 (56%) were at the zonal hospital and 85 (44%) at health centers. Median clinical experience was 4 years [IQR 1,9] and 45 (23%) had previous in-service training for both newborn essential and sick newborn care. Efficacy was 42% (SD±17%). Providers averaged 78% (SD±31%) completion of initial learning and 7%(SD±11%) of refresher assignments. 130 (67%) providers had ≥1 episode of inactivity >30 day, no episodes were due to lack of internet access. Baseline conscious-competence was 53% [IQR:38-63%], unconscious-incompetence 32% [IQR:23-42%], conscious-incompetence 7% [IQR:2-15%], and unconscious-competence 2% [IQR:0-3%]. Higher baseline conscious-competence (OR 31.6 [95%CI:5.8, 183.5) and being a nursing officer (aOR: 5.6 [95%CI:1.8, 18.1]), compared to medical officer) were associated with initial learning completion or persistent activity.

Conclusion

aESNC reach was high in a population of frontline providers across diverse levels of care in Tanzania. Use of in-person support and nudging increased reach, initial learning, and refresher assignment completion, but refresher assignment completion remains low. Providers were often unaware of knowledge gaps, and lower baseline knowledge may decrease initial learning completion or activity. Further study to identify barriers to adaptive e-learning normalization is needed.

Unravelling the skillset of point-of-care ultrasound: a systematic review

BACKGROUND

The increasing number of physicians that are trained in point-of-care ultrasound (POCUS) warrants critical evaluation and improvement of current training methods. Performing POCUS is a complex task and it is unknown which (neuro)cognitive mechanisms are most important in competence development of this skill. This systematic review was conducted to identify determinants of POCUS competence development that can be used to optimize POCUS training.

METHODS

PubMed, Web of Science, Cochrane Library, Emcare, PsycINFO and ERIC databases were searched for studies measuring ultrasound (US) skills and aptitude. The papers were divided into three categories: "Relevant knowledge", "Psychomotor ability" and 'Visuospatial ability'. The 'Relevant knowledge' category was further subdivided in 'image interpretation', 'technical aspects' and 'general cognitive abilities'. Visuospatial ability was subdivided in visuospatial subcategories based on the Cattell-Horn-Carroll (CHC) Model of Intelligence v2.2, which includes visuospatial manipulation and visuospatial perception. Post-hoc, a meta-analysis was performed to calculate pooled correlations.

RESULTS

26 papers were selected for inclusion in the review. 15 reported on relevant knowledge with a pooled coefficient of determination of 0.26. Four papers reported on psychomotor abilities, one reported a significant relationship with POCUS competence. 13 papers reported on visuospatial abilities, the pooled coefficient of determination was 0.16.

CONCLUSION

There was a lot of heterogeneity in methods to assess possible determinants of POCUS competence and POCUS competence acquisition. This makes it difficult to draw strong conclusions on which determinants should be part of a framework to improve POCUS education. However, we identified two determinants of POCUS competence development: relevant knowledge and visuospatial ability. The content of relevant knowledge could not be retrieved in more depth. For visuospatial ability we used the CHC model as theoretical framework to analyze this skill. We could not point out psychomotor ability as a determinant of POCUS competence.

Evidence for continuing professional development standards for regulated health practitioners in Australia: a systematic review

BACKGROUND

Health practitioner regulators throughout the world use continuing professional development (CPD) standards to ensure that registrants maintain, improve and broaden their knowledge, expertise and competence. As the CPD standard for most regulated health professions in Australia are currently under review, it is timely that an appraisal of the evidence be undertaken.

METHODS

A systematic review was conducted using major databases (including MEDLINE, EMBASE, PsycInfo, and CINAHL), search engines and grey literature for evidence published between 2015 and April 2022. Publications included in the review were assessed against the relevant CASP checklist for quantitative studies and the McMaster University checklist for qualitative studies.

RESULTS

The search yielded 87 abstracts of which 37 full-text articles met the inclusion criteria. The evidence showed that mandatory CPD requirements are a strong motivational factor for their completion and improves practitioners' knowledge and behaviour. CPD that is more interactive is most effective and e-learning is as effective as face-to-face CPD. There is no direct evidence to suggest the optimal quantity of CPD, although there was some evidence that complex or infrequently used skills deteriorate between 4 months to a year after training, depending on the task.

CONCLUSIONS

CPD is most effective when it is interactive, uses a variety of methods and is delivered in a sequence involving multiple exposures over a period of time that is focused on outcomes considered important by practitioners. Although there is no optimal quantity of CPD, there is evidence that complex skills may require more frequent CPD.

Development and Design of E_MOTIV: A Theory-Based Adaptive E-Learning Program to Support Nurses' Provision of Brief Behavior Change Counseling

Brief counseling, when provided by adequately trained nurses, can motivate and support patient health behavior change. However, numerous barriers can impede nurses' capability and motivation to provide brief counseling. Theory-based interventions, as well as information and communication technologies, can support evidence-based practice by addressing these barriers. The purpose of this study was to document the development process of the E_MOTIV asynchronous, theory-based, adaptive e-learning program aimed at supporting nurses' provision of brief counseling for smoking cessation, healthy eating, and medication adherence. Development followed French's stepwise theory- and evidence-based approach: (1) identifying who needs to do what, differently, that is, provision of brief counseling in acute care settings by nurses; (2) identifying determinants of the provision of brief counseling; (3) identifying which intervention components and mode(s) of delivery could address determinants; and (4) developing and evaluating the program. The resulting E_MOTIV program, guided by the Theory of Planned Behavior, Cognitive Load Theory, and the concept of engagement, is unique in its adaptive functionality-personalizing program content and sequence to each learners' beliefs, motivation, and learning preferences. E_MOTIV is one of the first adaptive e-learning programs developed to support nurses' practice, and this study offers key insights for future work in the field.

Evaluating remote facilitation intensity for multi-national translation of nurse-initiated stroke protocols (QASC Australasia): a protocol for a cluster randomised controlled trial

BACKGROUND

Facilitated implementation of nurse-initiated protocols to manage fever, hyperglycaemia (sugar) and swallowing difficulties (FeSS Protocols) in 19 Australian stroke units resulted in reduced death and dependency for stroke patients. However, a significant gap remains in translating this evidence-based care bundle protocol into standard practice in Australia and New Zealand. Facilitation is a key component for increasing implementation. However, its contribution to evidence translation initiatives requires further investigation. We aim to evaluate two levels of intensity of external remote facilitation as part of a multifaceted intervention to improve FeSS Protocol uptake and quality of care for patients with stroke in Australian and New Zealand acute care hospitals.

METHODS

A three-arm cluster randomised controlled trial with a process evaluation and economic evaluation. Australian and New Zealand hospitals with a stroke unit or service will be recruited and randomised in blocks of five to one of the three study arms-high- or low-intensity external remote facilitation or a no facilitation control group-in a 2:2:1 ratio. The multicomponent implementation strategy will incorporate implementation science frameworks (Theoretical Domains Framework, Capability, Opportunity, Motivation - Behaviour Model and the Consolidated Framework for Implementation Research) and include an online education package, audit and feedback reports, local clinical champions, barrier and enabler assessments, action plans, reminders and external remote facilitation. The primary outcome is implementation effectiveness using a composite measure comprising six monitoring and treatment elements of the FeSS Protocols. Secondary outcome measures are as follows: composite outcome of adherence to each of the combined monitoring and treatment elements for (i) fever (n=5); (ii) hyperglycaemia (n=6); and (iii) swallowing protocols (n=7); adherence to the individual elements that make up each of these protocols; comparison for composite outcomes between (i) metropolitan and rural/remote hospitals; and (ii) stroke units and stroke services. A process evaluation will examine contextual factors influencing intervention uptake. An economic evaluation will describe cost differences relative to each intervention and study outcomes.

DISCUSSION

We will generate new evidence on the most effective facilitation intensity to support implementation of nurse-initiated stroke protocols nationwide, reducing geographical barriers for those in rural and remote areas.

TRIAL REGISTRATION

ACTRN12622000028707. Registered 14 January, 2022.

Development of pediatric acute care education (PACE): An adaptive electronic learning (e-learning) environment for healthcare providers in Tanzania

Globally, inadequate healthcare provider (HCP) proficiency with evidence-based guidelines contributes to millions of newborn, infant, and child deaths each year. HCP guideline proficiency would improve patient outcomes. Conventional (in person) HCP in-service education is limited in 4 ways: reach, scalability, adaptability, and the ability to contextualize. Adaptive e-learning environments (AEE), a subdomain of e-learning, incorporate artificial intelligence technology to create a unique cognitive model of each HCP to improve education effectiveness. AEEs that use existing internet access and personal mobile devices may overcome limits of conventional education. This paper provides an overview of the development of our AEE HCP in-service education, Pediatric Acute Care Education (PACE). PACE uses an innovative approach to address HCPs' proficiency in evidence-based guidelines for care of newborns, infants, and children. PACE is novel in 2 ways: 1) its patient-centric approach using clinical audit data or frontline provider input to determine content and 2) its ability to incorporate refresher learning over time to solidify knowledge gains. We describe PACE's integration into the Pediatric Association of Tanzania's (PAT) Clinical Learning Network (CLN), a multifaceted intervention to improve facility-based care along a single referral chain. Using principles of co-design, stakeholder meetings modified PACE's characteristics and optimized integration with CLN. We plan to use three-phase, mixed-methods, implementation process. Phase I will examine the feasibility of PACE and refine its components and protocol. Lessons gained from this initial phase will guide the design of Phase II proof of concept studies which will generate insights into the appropriate empirical framework for (Phase III) implementation at scale to examine effectiveness.

E-Learning versus Face-to-Face Methodology for Learning Antimicrobial Resistance and Prescription Practice in a Tertiary Hospital of a Middle-Income Country

Background: Antimicrobial resistance is a growing health problem worldwide. One strategy to face this problem in a reasonable way is training health personnel for the rational use of antimicrobials. There are some difficulties associated with medical staff to receiving training with E-learning education, but there is a lack of studies and insufficient evidence of the effectiveness of this method compared to face-to-face learning. Methods: An educational intervention on antimicrobial resistance (AMR) and antimicrobial prescription practice (APP) was designed and implemented using two approaches: face-to-face and E-learning among physicians of the intensive care unit (ICU) and internal medicine ward (IMW) at Eugenio Espejo Hospital in Quito. Modalities of interventions were compared to propose a strategy of continuous professional development (CPD) for all hospital staff. An interventional study was proposed using a quasi-experimental approach that included 91 physicians, of which 49 belong to the IMW and 42 to the ICU. All of them received training on AMR—half in a face-to-face mode and the other half in an asynchronous E-learning mode. They then all participated on APP training but with switched groups; those who previously participated in the face-to-face experience participated in an E-learning module and vice-versa. We evaluated self-perception about basic knowledge, attitudes and referred practices towards AMR and APP before and after the intervention. A review of medical records was conducted before and after training by checking antimicrobial prescriptions for all patients in the ICU and IMW with bacteremia, urinary tract infection (UTI), pneumonia, and skin and soft tissue infection. The study received IRB clearance, and we used SPSS for statistical analysis. Results: No statistically significant difference was observed between the E-learning and the face-to-face methodology for AMR and APP. Both methodologies improved knowledge, attitudes and referred practices. In the case of E-learning, there was a self-perception of improved attitudes (p < 0.05) and practices (p < 0.001) for both AMR and APP. In face-to-face, there was a perception of improvement only in attitudes (p < 0.001) for APP. In clinical practice, the use of antimicrobials significantly improved in all domains after training, including empirical and targeted treatment of bacteremia and pneumonia (p < 0.001) and targeted treatment of UTI (p < 0.05). For the empirical treatment of pneumonia, the mean number of antibiotics was reduced from 1.87 before to 1.05 after the intervention (p = 0.003), whereas in the targeted management of bacteremia, the number of antibiotics was reduced from 2.19 to 1.53 (p = 0.010). Conclusions: There was no statistically significant difference between the effect of E-learning and face-to-face strategy in terms of teaching AMR and APP. Adequate self-reported attitudes and practices in E-learning exceed those of the face-to-face approach. The empiric and targeted use of antimicrobials improved in all reviewed cases, and we observed an overall decrease in antibiotic use. Satisfaction with training was high for both methods, and participants valued the flexibility and accessibility of E-learning.

Can web-based implementation interventions improve physician early diagnosis of cerebral palsy? Protocol for a 3-arm parallel superiority randomised controlled trial and cost-consequence analysis comparing adaptive and non-adaptive virtual patient instructional designs with control to evaluate effectiveness on physician behaviour, diagnostic skills and patient outcomes

INTRODUCTION

Cerebral palsy (CP) is the most common childhood physical disability. Accurate diagnosis before 6 months is possible using predictive tools and decision-making skills. Yet diagnosis is typically made at 12-24 months of age, hindering access to early interventions that improve functional outcomes. Change in practice is required for physicians in key diagnostic behaviours. This study aims to close the identified research-practice gap and increase accurate CP diagnosis before 6 months of age through tailored web-based implementation interventions. This trial will determine whether adaptive e-learning using virtual patients, targeting CP diagnostic behaviours and clinical decision-making skills, effectively changes physician behaviour and practice compared with non-adaptive e-learning instructional design or control.

METHODS AND ANALYSIS

This study is a 3-arm parallel superiority randomised controlled trial of two tailored e-learning interventions developed to expedite physician CP diagnosis. The trial will compare adaptive (arm 1) and non-adaptive (arm 2) instructional designs with waitlist control (arm 3) to evaluate change in physician behaviour, skills and diagnostic practice. A sample size of 275 paediatric physicians enables detection of small magnitude effects (0.2) of primary outcomes between intervention comparators with 90% power (α=0.05), allowing for 30% attrition. Barrier analysis, Delphi survey, Behaviour Change Wheel and learning theory frameworks guided the intervention designs. Adaptive and non-adaptive video and navigation sequences utilising virtual patients and clinical practice guideline content were developed, integrating formative key features assessment targeting clinical decision-making skills relative to CP diagnosis.Physician outcomes will be evaluated based on postintervention key feature examination scores plus preintervention/postintervention behavioural intentions and practice measures. Associations with CP population registers will evaluate real-world diagnostic patient outcomes. Intervention costs will be reported in a cost-consequence analysis from funders' and societal perspectives.

ETHICS AND DISSEMINATION

Ethics approved from The University of Sydney (Project number 2021/386). Results will be disseminated through peer-reviewed journals and scientific conferences.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry: ACTRN 12622000184774.

Motivational Design for Web-Based Instruction in Health Professions Education: Protocol for a Systematic Review and Directed Content Analysis

BACKGROUND

Web-based instruction plays an essential role in health professions education (HPE) by facilitating learners' interactions with educational content, teachers, peers, and patients when they would not be feasible in person. Within the unsupervised settings where web-based instruction is often delivered, learners must effectively self-regulate their learning to be successful. Effective self-regulation places heavy demands on learners' motivation, so effective web-based instruction must be designed to instigate and maintain learners' motivation to learn. Models of motivational design integrate theories of motivation with design strategies intended to create the conditions for motivated engagement. Teachers can use such models to develop their procedural and conceptual knowledge in ways that help them design motivating instruction in messy real-world contexts. Studies such as randomized controlled trials (RCTs) and other quasi-experimental designs that compare different motivational design strategies play a critical role in advancing models of motivational design. Synthesizing the evidence from those studies can identify effective strategies and help teachers and researchers understand the mechanisms governing why strategies work, for whom, and under what circumstances.

OBJECTIVE

The planned review aims to analyze how studies comparing motivational design strategies for web-based instruction in HPE support and advance models of motivational design by (1) controlling for established risks to internal validity, (2) leveraging authentic educational contexts to afford ecological validity, (3) drawing on established theories of motivation, (4) investigating a wide breadth of motivational constructs, and (5) analyzing mediators and moderators of strategy effects.

METHODS

The planned review will use database searching, registry searching, and hand searching to identify studies comparing motivational design strategies for web-based instruction, delivered to learners in HPE. Studies will be considered from 1990 onward. Two team members will independently screen studies and extract data from the included studies. During extraction, we will record information on the design characteristics of the studies, the theories of motivation they are informed by, the motivational constructs they target, and the mediators and moderators they consider.

RESULTS

We have executed our database and registry searches and have begun screening titles and abstracts.

CONCLUSIONS

By appraising the characteristics of studies that have focused on the motivational design of web-based instruction in HPE, the planned review will produce recommendations that will ensure impactful programs of future research in this crucial educational space.

TRIAL REGISTRATION

PROSPERO CRD42022359521; https://tinyurl.com/57chuzf6.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/42681.

Theories informing technology enhanced learning in nursing and midwifery education: A systematic review and typological classification

BACKGROUND

Learning is a complex process involving internal cognitive processes and external stimuli from curricula, pedagogical strategies, and the learning environment. Theories are used extensively in higher education to understand the intricacies of adult learning and improve student outcomes. Nursing and midwifery education uses a range of technology enhanced learning (e-learning) approaches, some of which are underpinned by theoretical frameworks.

OBJECTIVE

Synthesise literature on theories that inform technology enhanced learning in nursing and midwifery education.

DESIGN

A systematic review.

DATA SOURCE

CINAHL, ERIC, MEDLINE and PubMed were searched for relevant studies (2000-2021). Reference lists of related literature reviews were hand searched.

REVIEW METHODS

Title and abstract, followed by full texts were screened by two reviewers independently using predefined eligibility criteria. Quality appraisal was not undertaken. Data were extracted and Merriam and Bierema's typology of adult learning theories used to categorise theories in each study.

RESULTS

Thirty-three studies were included, incorporating twenty-nine distinct learning theories from the behaviourist, cognitivist, constructivist, and social cognitivist domains, with constructivist being the most widely used. Kolb's Experiential Learning Theory and Driscoll's Constructivist Learning Theory were the most commonly reported theories. The population of learners were mainly undergraduate nursing students who used a range of online, mobile, blended or computerised learning, virtual reality, or digital forms of simulation, primarily in university settings. Theories were employed to inform the technology enhanced learning intervention or to help explain how these could improve student learning.

CONCLUSION

This review highlighted a range of theories, particularly constructivist approaches, that underpin research on technology enhanced learning in nursing education, by informing or explaining how these digital interventions support learning. More rigorous research that examines the myriad of theoretical frameworks and their effectiveness in informing and explaining technology enhanced learning is needed to justify this approach to pedagogical nursing research and practice.

Does the Internet Bring People Closer Together or Further Apart? The Impact of Internet Usage on Interpersonal Communications

The complementarity interference (CI) model suggests that the Internet may either inhibit or facilitate interpersonal communications. This paper empirically examines the impact of Internet usage on interpersonal interactions, using a micro dataset from China to answer whether the Internet brings people closer together or further apart. The empirical results demonstrate, first, that Internet usage significantly increases both the time and frequency of people’s communications with their family and friends, rather than causing them to feel more disconnected and isolated. Holding other factors constant, for each one-standard-deviation increase in Internet usage, weekly communications with family members increases by an average of 102.150 min, while there is an average increase of 54.838 min in interactions with friends. These findings as to its positive effects are robust when using other regression models and interpersonal contact measures, as well as the instrumental variable method. Second, Internet usage also contributes to decreased loneliness; it exerts this effect primarily by improving people’s interactions with their family members. However, communications with friends do not significantly mediate such impacts. Third, the positive role of Internet usage on communications is more prominent for people with more frequent online socialization and self-presentation, better online skills, younger age, higher educational level, and who are living in urban areas. In addition, the beneficial effects of Internet usage are larger for communications with family members in the case of migrants. Therefore, in the context of the rapid development of information technology, the network infrastructure should be improved to make better use of the Internet to facilitate interpersonal communications and promote people’s wellness.

Aprendizajes de estudiantes del área de salud en tiempos de covid-19: una revisión integrativa

Objetivo: caracterizar la producción científica relacionada con los aprendizajes de los estudiantes de salud en tiempos de pandemia por COVID-19. Metodología: revisión integrativa por medio de la búsqueda y análisis de literatura en nueve bases de datos científicas de acceso libre. Se incluyeron cuarenta artículos de investigación teniendo en cuenta los Descriptores en Ciencias de la Salud (DeCs) para su búsqueda, no se limitó el periodo de publicación al tratarse de un tema emergente. La investigación se realizó entre diciembre de 2020 y marzo de 2021. Resultados: se identifica la tendencia a estudiar el tema en el nivel de pregrado y específicamente, en la profesión de medicina. El abordaje metodológico con enfoque cuantitativo se presentó más en Asia. Las tendencias temáticas fueron: 1) percepción de los estudiantes en relación con el entorno de aprendizaje en línea y 2) factores para un entorno de aprendizaje. Conclusión: parece haber un acuerdo en la necesidad de un aprendizaje significativo en la educación virtual, sin embargo, todavía se discute cómo y para qué hacerlo.

Digitale Hochschullehre im ersten COVID-19-Semester. Ergebnisse einer Befragung von Lehrenden in Public Health, Medizin und Pflege

Hintergrund

Die COVID-19(„coronavirus disease 2019“)-Pandemie hat die Ad-hoc-Digitalisierung an Hochschulen vorangetrieben. Zugleich stand die digitale Hochschullehre vor der Herausforderung der Ausgestaltung der Lehre im Zusammenhang mit den vorbestehenden Ressourcen, der digitalen und didaktischen Kompetenzen sowie der zur Verfügung stehenden technischen Infrastruktur.

Ziel der Arbeit/Fragestellung

Das Ziel der Umfrage war die Einschätzung der digitalen Lehre, die die Präsenzlehre infolge der COVID-19-Pandemie zum großen Teil bzw. gänzlich ersetzt hat, aus der Perspektive der Lehrenden in Public Health, Medizin und Pflege.

Material und Methode

Die Querschnitterhebung fand online von Juni bis August 2020 statt und die Daten wurden über www.soscisurvey.de erhoben. Die schriftliche Befragung wurde unter Mitgliedern der Deutschen Gesellschaft für Public Health (DGPH) und des Ausschusses Digitalisierung der Gesellschaft für medizinische Ausbildung (GMA) und der Sektionen Bildung und Beratung der Deutschen Gesellschaft für Pflegewissenschaft (DGP) sowie der Arbeitsgruppe Lehre der Deutschen Gesellschaft für Medizinische Soziologie (DGMS) durchgeführt (n = 100).

Ergebnisse

Bei der Nutzung der digitalen Technologien in den Veranstaltungen rangieren auf der obersten Stelle Präsentationstools, gefolgt von Lernmanagementsystemen, Videoangeboten sowie digitalen Texten. Die Teilnehmenden geben hinsichtlich der Nutzung unterschiedliche (Konferenz‑)Tools an. Das Erstellen von Lehrvideos bejahen 53 % der Befragten, Abstimmungstools) werden bis > 50 % als unbekannt genannt. Als Herausforderungen werden digitale Infrastruktur der Hochschulen, fehlende didaktische Beratung/Unterstützung sowie rechtliche Fragen (Nutzungsrechte, Datenschutz) angegeben.

Schlussfolgerung

Neue Technologie werden vorwiegend für Wissenserwerb, Wissensvermittlung genutzt, selten zur Aktivierung von Studierenden und zur Gestaltung kollaborativer Lehr- und Lernarrangements sowie Neugestaltung von Lernaufgaben und Lernprozessen (individualisiertes Lernen). Welche der aktuell erprobten digitalen Lehr- und Lernformate zukünftig in der Hochschullehre zunehmend eingesetzt werden, hängt von vielen Faktoren ab, u. a. von digitaler Kompetenz sowie der Bereitschaft der Lehrenden und Lernenden die digitale Lernkultur mitzugestalten.

Zusatzmaterial online

Zusätzliche Informationen sind in der Online-Version dieses Artikels (10.1007/s11553-022-00937-1) enthalten.

E-Learning and Blended-Learning Program in Wound Care for Undergraduate Nursing Students

BACKGROUND

Due to an increasing number of undergraduate students in a Bachelor of Nursing Science program, the existing teaching modalities in wound care were shifted into blended- and e-learning units. The aim is to present the development and implementation of a blended- and e-learning wound care curriculum in an actual nursing program.

METHOD

The development of the blended- and e-learning units is based on literature reviews and expert discussions. The process was guided by the learning outcomes defined by the European Wound Management Association. The implementation was planned for 3 years.

RESULTS

All 14 learning units were developed and implemented using 12 blended and two e-learning units. Flipped classrooms using asynchronous e-learnings and workshops with clinical wound care specialists were used for blended learning.

CONCLUSION

Blended and e-learning are valuable modalities to provide flexibility and deliver learning units based on the latest evidence. The effectiveness of this curriculum needs to be investigated. [J Nurs Educ. 2022;61(1):53-57.].

E-learning use in the review of neonatal resuscitation program in physicians: a scoping review

OBJECTIVE

To determine if e-learning interventions are efficient to review Neonatal Resuscitation Program (NRP) and to prevent performance deterioration in neonatal resuscitation of already-certified healthcare professionals.

STUDY DESIGN

In this scoping review, we searched for manuscripts published until June 2020 in five databases. We included all studies on e-learning use for NRP review in already-certified healthcare providers.

RESULTS

Among 593 abstracts retrieved, 38 full-text articles were assessed for eligibility. Five studies were included. Four studies evaluated the effectiveness of e-learning interventions immediately or months after their completion by providers. These interventions did not consistently enhance their NRP knowledge and their performance. One study showed that a growth mindset can influence positively neonatal resuscitation performance after an e-learning simulation.

CONCLUSION

There is not enough evidence to conclude that e-learning interventions can prevent neonatal resuscitation knowledge and performance decay in already-certified providers. More research is needed on the use of e-learning simulation-based scenarios to improve NRP retention.

A theory-based adaptive E-learning program aimed at increasing intentions to provide brief behavior change counseling: Randomized controlled trial

BACKGROUND

Unhealthy behaviors are significant contributors to non-communicable diseases. Nurses can support patient health behavior change by providing brief behavior change counseling. However, training programs in brief counseling are generally not personalized, or adapted, to the barriers and theoretical determinants of its provision in clinical practice.

OBJECTIVE

This study aimed to evaluate the effectiveness of the E_MOTIV_A theory-based adaptive e-learning program on nurses' and nursing students' intentions to provide brief counseling for smoking, unhealthy eating habits and medication nonadherence.

DESIGN AND METHODS

A randomized controlled trial was conducted with nurses and nursing students in Canada. Experimental group participants were allocated to the E_MOTIV_A theory-based adaptive e-learning program. Control group participants were allocated to the E_MOTIV_B knowledge-based standardized e-learning program. E_MOTIV_A was designed to influence the constructs of the Theory of Planned Behavior (e.g., attitude, subjective norms) in relation to brief counseling. Outcomes were improvement in intention to provide brief counseling, improvement in other Theory of Planned Behavior variables, as well as cognitive load and engagement related to e-learning.

RESULTS

A total of 102 participants were randomized to the experimental (n = 51) and control (n = 51) groups. End of study questionnaires were completed by 27 experimental group and 38 control group participants. Analyses indicated no significant differences between groups in the change of scores for intention to provide brief counseling. However, while not significant, the change of score was greater in the experimental group (10.22 ± 3.34 versus 9.04 ± 2.80; p = 0.787). Scores in both groups improved significantly for attitude, subjective norms, perceived behavioral control, behavioral beliefs, and control beliefs. However, there were no statistically significant differences between groups for these variables as well as for cognitive load and engagement.

CONCLUSIONS

Both e-learning programs had a similar positive effect on nurses' and nursing students' intentions to provide brief counseling and on Theory of Planned Behavior variables.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN32603572; http://www.isrctn.com/ISRCTN32603572.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/18894; https://doi.org/10.2196/18894.

A Meta-Analysis of the Effect of Paper Versus Digital Reading on Reading Comprehension in Health Professional Education

Objective. Despite a rise in the use of digital education in health professional education (HPE), little is known about the comparative effectiveness of paper-based reading and its digital alternative on reading comprehension. The objectives of this study were to identify, appraise, and synthesize the evidence regarding the effect of how media is read on reading comprehension in the context of HPE.Methods. Observational, quasi-experimental, and experimental studies published before April 16, 2021, were included if they compared the effectiveness of paper-based vs digital-based reading on reading comprehension among HPE students, trainees, and residents. Random-effects meta-analyses were performed using standardized mean differences.Results. From a pool of 2,208 references, we identified and included 10 controlled studies that had collectively enrolled 817 participants. Meta-analyses revealed a slight but nonsignificant advantage to students reading paper-based HPE texts rather than digital text (standardized mean difference, -0.08; 95% CI -0.28 to 0.12). Subgroup analyses revealed that students reading HPE-related texts had better reading comprehension when reading text on paper rather than digitally (SMD =  -0.36; 95% CI -0.69 to -0.03). Heterogeneity was low in all analyses. The quality of evidence was low because of risks of bias across studies.Summary. Current evidence suggests little to no difference in students' comprehension when reading HPE texts on paper vs digitally. However, we observed effects favoring reading paper-based texts when texts relevant to the students' professional discipline were considered. Rigorous studies are needed to confirm this finding and to evaluate new means of boosting reading comprehension among students in HPE programs.

Effects of a Brief E-Learning Resource on Sexual Attitudes and Beliefs of Healthcare Professionals Working in Prostate Cancer Care: A Pilot Study

Sexual issues and treatment side effects are not routinely discussed with men receiving treatment for prostate cancer, and support to address these concerns is not consistent across settings. This study evaluates a brief e-learning resource designed to improve sexual wellbeing support and examine its effects on healthcare professionals' sexual attitudes and beliefs. Healthcare professionals (n = 44) completed an online questionnaire at baseline which included a modified 12-item sexual attitudes and beliefs survey (SABS). Follow-up questionnaires were completed immediately after the e-learning and at 4 weeks. Data were analysed using one-way, repeat measures ANOVAs to assess change in attitudes and beliefs over time. Significant improvements were observed at follow-up for a number of survey statements including 'knowledge and understanding', 'confidence in discussing sexual wellbeing' and the extent to which participants felt 'equipped with the language to initiate conversations'. The resource was seen as concise, relevant to practice and as providing useful information on potential side effects of treatment. In brief, e-learning has potential to address barriers to sexual wellbeing communication and promote delivery of support for prostate cancer survivors. Practical methods and resources should be included with these interventions to support implementation of learning and long-term changes in clinical behaviour.

Impact of the COVID-19 pandemic on teaching and learning in health professional education: a mixed methods study protocol

BACKGROUND

Due to the complex nature of healthcare professionals' roles and responsibilities, the education of this workforce is multifaceted and challenging. It relies on various sources of learning from teachers, peers, patients and may focus on Work Integrated Learning (WIL). The COVID-19 pandemic has impacted many of these learning opportunities especially those in large groups or involving in person interaction with peers and patients. Much of the curriculum has been adapted to an online format, the long-term consequence of which is yet to be recognized. The changed format is likely to impact learning pedagogy effecting both students and teachers. This requires a systematic approach to evaluation of online teaching and learning adaptation, in comparison to the previous format, where, in person education may have been the focus.

METHODS

The proposed study is a broad based evaluation of health professional education in a major Australian University. The protocol describes a mixed methods convergent design to evaluate the impact of online education on students and teachers in health professional courses including Medicine, Nursing, Allied Health and Biomedical Science. A framework, developed at the university, using Contribution Analysis (CA), will guide the evaluation. Quantitative data relating to student performance, student evaluation of units, quantity of teaching activities and resource utilization will be collected and subjected to relevant statistical analysis. Data will be collected through surveys (500 students and 100 teachers), focus groups (10 groups of students) and interviews of students and teachers (50 students beyond graduation and 25 teachers, for long term follow up to 12 months). Application of CA will be used to answer the key research questions on the short term and long-term impact of online education on teaching and learning approaches.

DISCUSSION

The protocol describes the study, which will be widely implemented over the various courses in Health Professional Education and Biomedical Science. It will evaluate how students and teachers engage with the online delivery of the curriculum, student performance, and resources used to implement these changes. It also aims to evaluate longitudinal outcome of student learning attributes and impact on graduate outcomes, which is poorly reported in educational literature.

Learning Outcomes of Digital Learning Interventions in Higher Education: A Scoping Review

Implementing digital technologies has become a policy priority worldwide among all types of education. The COVID-19 pandemic has further accelerated educational institutions' efforts to reorganize their teaching and introduce new digital learning technologies. Although using digital technologies in higher education, including nursing, is considered a modern and innovative way of teaching and learning, uncertainty exists concerning these technologies' actual usefulness in achieving positive learning outcomes. The aim of this scoping review was to examine the current evidence related to the effects of using digital technologies on learning outcomes in higher education. The authors searched five electronic databases for relevant studies and used a scoping review method to analyze and synthesize the evidence. Eighty-six articles from six disciplines met the selection criteria. As a key finding, the outcomes of the interventions were mainly positive. Increased professional knowledge, skills, and attitudes reflect the advancement of professional competence. Academic, collaborative, and study skills, in turn, contribute to general competence development. Our findings suggest that digital technology has the potential to improve learning in various disciplines.

Remote training for combat medics during the COVID-19 era: lessons learnt for future crises?

BACKGROUND

In response to COVID-19, the UK government ordered strict social distancing measures. The UK Armed Forces followed these to protect the force and ensure readiness to respond to various tasking requests. Clinical training has adapted to ensure geographically dispersed medical personnel are trained while social distancing is maintained. This study aimed to evaluate remote training for Combat Medical Technicians, Medical Assistants and Royal Air Force Medics (CMTs/MAs/RAFMs) during the COVID-19 pandemic and the views of trainers on how this should be delivered now and in the future.

METHODS

A mixed quantitative and qualitative survey study was conducted to determine the experiences of a sample of Defence Medical Services personnel with remote training during the COVID-19 pandemic. Medical and nursing officers involved in teaching CMTs/MAs/RAFMs were eligible to participate.

RESULTS

There were 52 survey respondents. 78% delivered remote training to CMTs/MAs/RAFMs, predominantly using teleconferencing and small-group webinars. 70% of respondents report CMTs/MAs/RAFMs received more training during the COVID-19 pandemic than before. 94% of respondents felt webinar-based remote training should continue after COVID-19. The perceived benefits of webinar-based training included reduced travel time, more training continuity and greater clinical development of learners.

CONCLUSIONS

The challenge of continuing education of medical personnel while maintaining readiness for deployment and adhering to the Government's social distancing measures was perceived to have been met within our study sample. This suggests that such an approach, along with clear training objectives and teleconferencing, may enable personnel to deliver high-quality training in an innovative and secure way.

Effectiveness of blended learning in pharmacy education: A systematic review and meta-analysis

Background & objective

Though blended learning (BL), is widely adopted in higher education, evaluating effectiveness of BL is difficult because the components of BL can be extremely heterogeneous. Purpose of this study was to evaluate the effectiveness of BL in improving knowledge and skill in pharmacy education.

Methods

PubMed/MEDLINE, Scopus and the Cochrane Library were searched to identify published literature. The retrieved studies from databases were screened for its title and abstracts followed by the full-text in accordance with the pre-defined inclusion and exclusion criteria. Methodological quality was appraised by modified Ottawa scale. Random effect model used for statistical modelling.

Key findings

A total of 26 studies were included for systematic review. Out of which 20 studies with 4525 participants for meta-analysis which employed traditional teaching in control group. Results showed a statistically significant positive effect size on knowledge (standardized mean difference [SMD]: 1.35, 95% confidence interval [CI]: 0.91 to 1.78, p<0.00001) and skill (SMD: 0.68; 95% CI: 0.19 to 1.16; p = 0.006) using a random effect model. Subgroup analysis of cohort studies showed, studies from developed countries had a larger effect size (SMD: 1.54, 95% CI: 1.01 to 2.06), than studies from developing countries(SMD: 0.44, 95% CI: 0.23 to 0.65, studies with MCQ pattern as outcome assessment had larger effect size (SMD: 2.81, 95% CI: 1.76 to 3.85) than non-MCQs (SMD 0.53, 95% CI 0.33 to 0.74), and BL with case studies (SMD 2.72, 95% CI 1.86–3.59) showed better effect size than non-case-based studies (SMD: 0.22, CI: 0.02 to 0.41).

Conclusion

BL is associated with better academic performance and achievement than didactic teaching in pharmacy education.

Impact of COVID-19 pandemic on dental education: online experience and practice expectations among dental students at the University of Jordan

BACKGROUND

The quarantine associated with the COVID-19 pandemic forced dental schools to suspend their clinical training and to shift to distant learning methods. The aim of this study is to investigate the impact of quarantine on the self-perceived preparedness of dental graduates and to explore the efficacy of online education from students' perspectives.

METHODS

The questionnaire distributed to dental students comprised of two main sections. The first part covered the online education experience, and the second part measured the level of self-perceived preparedness for a range of cognitive, communication and professional skills.

RESULTS

The survey yielded a response rate of 72%. The majority of students (77%) agreed that they missed educational experiences as a result of the lockdown. More than half of them felt less motivated to follow-up with distant e-learning and believed that online assessment is not a good method for evaluation. A high percentage of the students (66%) thought that online group discussions had a positive value while 67% preferred online lectures compared to theatre lectures. Majority of students particularly 5th year (78.7%) (p < 0.001) stated that the quarantine increased their collaboration with their colleagues. According to 87% of students, the experience most negatively affected was their clinical training. In general, students showed satisfactory self-perceived preparedness related to a range of attributes and professional skills.

CONCLUSIONS

The data showed that students partially appreciated the online system, whereas they did not consider it a substitute for face to face clinical practice. The overall self-perceived preparedness level was promising; however students had reservations regarding independent practice following graduation.

Anesthesiologists' airway management expertise: Identifying subjective and objective knowledge gaps

BACKGROUND

Failure in airway management continues to cause preventable patient harm, and the recommended continuing education is challenged by anesthesiologists' unknown knowledge gaps. This study aimed to identify anesthesiologists' subjective and objective knowledge gaps as well as areas where anesthesiologists are incorrect and unaware.

METHODS

An adaptive E-learning program with 103 questions on adult airway management was used for subjective and objective assessment of anesthesiologists' knowledge. All anesthesiologists in the Capital Region of Denmark were invited to participate.

RESULTS

The response rate was 67% (191/285). For preoperative planning, participants stated low confidence (subjective assessment) regarding predictors of difficult airway management in particular (69.1%-79.1%). Test scores (objective assessment) were lowest for obstructive sleep apnea as a predictor of difficult airway management (28.8% correct), with participants being incorrect and unaware in 33.5% of the answers. For optimization of basic techniques, the lowest confidence ratings related to patient positioning and prediction of difficulties (57.4%-83.2%), which agreed with the lowest test scores. Concerning advanced techniques, videolaryngoscopy prompted the lowest confidence (72.4%-85.9%), while emergency cricothyrotomy resulted in the lowest test scores (47.4%-67.8%). Subjective and objective assessments correlated and lower confidence was associated with lower test scores: preoperative planning [r = -.58, P < .001], optimization of basic techniques [r = -.58, P = .002], and advanced techniques [r = -.71, P < .001].

CONCLUSION

We identified knowledge gaps in important areas of adult airway management with differing findings from the subjective and objective assessments. This underlines the importance of objective assessment to guide continuing education.

Use of an Adaptive e-Learning Platform as a Formative Assessment Tool in the Cardiovascular System Course Component of an MBBS Programme

BACKGROUND

Technology-enhanced learning includes the adaptive e-learning platform, a data-driven method with computer algorithms, providing customised learning enhancing critical thinking of individual learners. "Firecracker" - an online adaptive e-learning platform, and assessment software, promotes critical thinking, helps prepare students for courses and high-stakes examinations, and evaluates progress relative to co-learners. The objectives of this study were to determine the usage rates of Firecracker, examine the performance of Firecracker formative quizzes, identify the correlation between Firecracker use and performance with that of performance at summative course assessments, and assess students' satisfaction with Firecracker usage.

METHODS

Study participants were Year-2 MBBS (Bachelor of Medicine, Bachelor of Surgery) students (n=91) of the Faculty of Medical Sciences, The University of the West Indies, Cave Hill Campus, Barbados. The Firecracker Administrator uploaded quizzes covering basic science content in the Cardiovascular System course. Access, usage, and performance on Firecracker formative quizzes were retrieved from the Firecracker dashboard. A questionnaire sought the views of study participants.

RESULTS

Seven sets of quizzes were administered over nine weeks, with weekly student completion rates ranging from 53% to 73%. Mean quiz scores ranged from 52% to 72%. Students completing >4 quiz sessions compared to those completing ≤4 demonstrated significantly better performance in Firecracker quizzes (P<0.01), final examinations (P<0.01) and in-course assessment plus final examination (P<0.05) scores. Correlations between overall Firecracker performance and in-course assessment marks (P<0.05); between total overall Firecracker performance and final examination (P<0.01); and overall Firecracker performance and total course marks (P<0.01) were all significant. Most students (70%) were happy using Firecracker and felt it complemented coursework (78%) and prepared them for course exams (58%) (P<0.01).

CONCLUSION

Overall, Firecracker was perceived very positively and welcomed by the students. Students were satisfied with the Firecracker as a formative assessment tool, and its use correlated with improved performance in the course examinations.