Exploring the Cost of eLearning in Health Professions Education: Scoping Review

E-learning in transfusion medicine: An exploratory qualitative assessment

BACKGROUND AND OBJECTIVES

E-learning programmes are increasingly offered in transfusion medicine (TM) education. The aim of this study was to explore facilitators and barriers to TM e-learning programmes, including assessment of learning outcomes and measures of effectiveness.

MATERIALS AND METHODS

Participants selected from a prior survey and representing a diverse number of international e-learning programmes were invited to participate. A mixed methodology was employed, combining a survey and individual semi-structured one-on-one interviews. Interview data were analysed inductively to explore programme development, evaluation, and facilitators and barriers to implementation.

RESULTS

Fourteen participants representing 13 institutions participated in the survey and 10 were interviewed. The e-learning programmes have been in use for a variable duration between 5 and 16 years. Funding sources varied, including government and institutional support. Learner assessment methods varied and encompassed multiple-choice-questions (n = 12), direct observation (n = 4) and competency assessment (n = 4). Most regional and national blood collection agencies rely on user feedback and short-term learning assessments to evaluate their programmes. Only one respondent indicated an attempt to correlate e-learning with clinical practices. Factors that facilitated programme implementation included support from management and external audits to ensure compliance with regulatory educational and training requirements. Barriers to programme implementation included the allocation of staff time for in-house development, enforcing compliance, keeping educational content up-to-date and gaining access to outcome data for educational providers.

CONCLUSION

There is evidence of considerable diversity in the evaluation of e-learning programmes. Further work is needed to understand the ultimate impact of TM e-learning on transfusion practices and patient outcomes.

Cost identification in health professions education: A scoping review

BACKGROUND

Resource scarcity in health professions education (HPE) demands rigorous consideration of costs. Yet, thus far, we have been unable to completely and consistently identify the costs of HPE. To address this knowledge gap and enable use of economic evidence in decision making, a detailed overview of all existing costs and approaches to cost identification in HPE is needed.

OBJECTIVES

This review summarises the diversity of costs, cost perspectives and cost identification methods used in economic research of HPE to answer the following questions: which educational topics, costs, cost perspectives and cost identification methods are being investigated in HPE literature?

METHODS

This investigation followed the Joanna Briggs Institute guidelines for scoping reviews. PubMed, ERIC, CINAHL and PsycINFO were iteratively searched for English language publications between 2012 and 2022 that reported costs of HPE. Data was extracted for study characteristics, educational context and economic methodology.

RESULTS

A total of 136 articles of original research on the costs of educating all major licence healthcare professionals were included. A diffuse interest in costs is reflected in publications from 93 distinct journals and by the diversity of educational topics and cost types explored. However, the majority of investigations failed to define the cost perspective (86, 63%) and cost identification methods (117, 86%) and did not demonstrate common reporting structure or cost terminology, all of which contribute to persistent inconsistencies in cost identification.

CONCLUSION

The source of disharmonious cost identification in HPE is fuelled by diverse interests and divergent concepts of costs and costing methodology. Left in its current state, disharmonious cost identification will continue to limit transparency, comparison and synthesis of evidence, hamper objectivity in implementation and policy decisions and impede the efficient and sustainable allocation of resources. A research agenda must be developed, prioritised, and validated by the broader community to develop a theoretical framework for HPE cost research, define stakeholders, elicit values and preferences and chart a path toward harmonised costing.

Can you teach a hands-on skill online? A scoping review of e-learning for point-of-care ultrasound in medical education

Background

There is an increasing need and interest in teaching point-of-care ultrasound (POCUS) online. The objective of this study was to systematically review the literature regarding e-learning as a method for teaching POCUS in medical education, to assess the benefits and limitations of various styles of e-learning for POCUS, and to identify gaps in the literature that could help guide future research in this field.

Methods

A literature search was conducted on three databases including MEDLINE (Ovid), EMBASE and Cochrane Central Register of Controlled Clinical Trials on October 12, 2021, retrieving a total of 1630 studies. 31 studies met the inclusion and exclusion criteria. These studies were separated into different styles of e-learning and learner outcomes were analyzed based on Kirkpatrick's hierarchy.

Results

The studies were categorized into three styles of e-learning: a) blended learning b) online-only (asynchronous or synchronous) and c) use of handheld machines or telesonography. POCUS knowledge and image interpretation were successfully taught online, however online-only learning for image acquisition was not as consistently effective. Blended learning and telesonography were beneficial for learning image acquisition skills. Generally, novice learners benefited most from e-learning.

Conclusion

E-learning for POCUS is gaining in popularity in recent years. POCUS is a complex technical skill, and depending on the individual task being taught, different styles of e-learning may be more successful. These findings can inform future POCUS educational programs.

Identifying costs in health professions education: a scoping review protocol

INTRODUCTION

Profound changes in the healthcare sector and the growing, global shortage of healthcare workers are driving the demand to update and scale-up health professions education (HPE). At the same time, educational institutions are faced with increasing resource scarcity and decisions of where and how to allocate resources must be made conscious of costs. However, costs are known to be inaccurately and incompletely identified in HPE research. Therefore, to improve rigour in cost evidence and enable its use in decision-making, it is necessary to have a better understanding of the costs, stakeholders and cost identification methods being used in HPE research. This protocol has been developed to outline the rationale and methods for a scoping review of the literature intended to map the current state of cost and cost identification evidence in HPE.

METHODS AND ANALYSIS

This protocol is developed in accordance with the Joanna Briggs Institute Manual for Evidence Synthesis. PubMed, ERIC, CINAHL and PsycInfo will be scoped for all types of English language publications from 2012 to 2022 that investigate costs associated with the education of health professionals. Two independent reviewers will assess publications for eligibility. Data will be extracted on the educational topic and context, the costs, cost types, perspectives and methods of cost identification as represented in the literature.

ETHICS AND DISSEMINATION

No human participants are involved in this scoping review. All evidence for this study are sourced from public databases; therefore, ethical approval was not required. Final results will be disseminated through peer-reviewed publications and presented at conferences.

TRIAL REGISTRATION NUMBER

A preliminary version of this protocol was prospectively registered on Open Science Framework (OSF) on 13 June 2022 and is available at https://doi.org/10.17605/OSF.IO/ET4XB.

Evaluation of a continuing professional development strategy on COVID-19 for 10 000 health workers in Ghana: a two-pronged approach

BACKGROUND

COVID-19 has created unprecedented challenges for health systems worldwide. Since the confirmation of the first COVID-19 case in Ghana in March 2020 Ghanian health workers have reported fear, stress, and low perceived preparedness to respond to COVID-19, with those who had not received adequate training at highest risk. Accordingly, the Paediatric Nursing Education Partnership COVID-19 Response project designed, implemented, and evaluated four open-access continuing professional development courses related to the pandemic, delivered through a two-pronged approach: e-learning and in-person.

METHODS

This manuscript presents an evaluation of the project's implementation and outcomes using data for a subset of Ghanaian health workers (n = 9966) who have taken the courses. Two questions were answered: first, the extent to which the design and implementation of this two-pronged strategy was successful and, second, outcomes associated with strengthening the capacity of health workers to respond to COVID-19. The methodology involved quantitative and qualitative survey data analysis and ongoing stakeholder consultation to interpret the results.

RESULTS

Judged against the success criteria (reach, relevance, and efficiency) the implementation of the strategy was successful. The e-learning component reached 9250 health workers in 6 months. The in-person component took considerably more resources than e-learning but provided hands-on learning to 716 health workers who were more likely to experience barriers to accessing e-learning due to challenges around internet connectivity, or institutional capacity to offer training. After taking the courses, health workers' capacities (addressing misinformation, supporting individuals experiencing effects of the virus, recommending the vaccine, course-specific knowledge, and comfort with e-learning) improved. The effect size, however, varied depending on the course and the variable measured. Overall, participants were satisfied with the courses and found them relevant to their well-being and profession. An area for improvement was refining the content-to-delivery time ratio of the in-person course. Unstable internet connectivity and the high upfront cost of data to access and complete the course online were identified as barriers to e-learning.

CONCLUSIONS

A two-pronged delivery approach leveraged distinct strengths of respective e-learning and in-person strategies to contribute to a successful continuing professional development initiative in the context of COVID-19.

Can web-based implementation interventions improve physician early diagnosis of cerebral palsy? Protocol for a 3-arm parallel superiority randomised controlled trial and cost-consequence analysis comparing adaptive and non-adaptive virtual patient instructional designs with control to evaluate effectiveness on physician behaviour, diagnostic skills and patient outcomes

INTRODUCTION

Cerebral palsy (CP) is the most common childhood physical disability. Accurate diagnosis before 6 months is possible using predictive tools and decision-making skills. Yet diagnosis is typically made at 12-24 months of age, hindering access to early interventions that improve functional outcomes. Change in practice is required for physicians in key diagnostic behaviours. This study aims to close the identified research-practice gap and increase accurate CP diagnosis before 6 months of age through tailored web-based implementation interventions. This trial will determine whether adaptive e-learning using virtual patients, targeting CP diagnostic behaviours and clinical decision-making skills, effectively changes physician behaviour and practice compared with non-adaptive e-learning instructional design or control.

METHODS AND ANALYSIS

This study is a 3-arm parallel superiority randomised controlled trial of two tailored e-learning interventions developed to expedite physician CP diagnosis. The trial will compare adaptive (arm 1) and non-adaptive (arm 2) instructional designs with waitlist control (arm 3) to evaluate change in physician behaviour, skills and diagnostic practice. A sample size of 275 paediatric physicians enables detection of small magnitude effects (0.2) of primary outcomes between intervention comparators with 90% power (α=0.05), allowing for 30% attrition. Barrier analysis, Delphi survey, Behaviour Change Wheel and learning theory frameworks guided the intervention designs. Adaptive and non-adaptive video and navigation sequences utilising virtual patients and clinical practice guideline content were developed, integrating formative key features assessment targeting clinical decision-making skills relative to CP diagnosis.Physician outcomes will be evaluated based on postintervention key feature examination scores plus preintervention/postintervention behavioural intentions and practice measures. Associations with CP population registers will evaluate real-world diagnostic patient outcomes. Intervention costs will be reported in a cost-consequence analysis from funders' and societal perspectives.

ETHICS AND DISSEMINATION

Ethics approved from The University of Sydney (Project number 2021/386). Results will be disseminated through peer-reviewed journals and scientific conferences.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry: ACTRN 12622000184774.

How does Identity Theory contribute to the Continuance Use of E-learning: The mediating role of Inertia and moderating role of computer Self-efficacy

Despite e-learning's rapid growth and significant benefits, especially during the COVID-19 pandemic, retaining students in this educational environment is a critical challenge in the post-corona era. Therefore, our research was conducted to explore how we can promote the continuance use of e-learning (CUEL) platforms. More specifically, this study examines how identity, inertia, and computer self-efficacy affect CUEL. Data were collected from 384 users and provided support for the model. The results indicated that social identity, relational identity, and inertia are critical determinants of CUEL. Furthermore, inertia mediates the relation between social identity and CUEL. In addition, we found that computer self-efficacy moderates the relation of inertia and relational identity with CUEL, but its moderating effect on the influence of social identity and CUEL is not supported. Finally, the theoretical and practical implications of this study are discussed.

Digital adaptation of teaching disaster and deployment medicine under COVID-19 conditions: a comparative evaluation over 5 years

BACKGROUND

The COVID-19 pandemic has not only brought many aspects of disaster medicine into everyday awareness but also led to a massive change in medical teaching due to the necessity of contact restrictions. This study aimed to evaluate student acceptance of a curricular elective module on disaster and deployment medicine over a 5-year period and to present content adjustments due to COVID-19 restrictions.

METHODS

Since 2016, 8 semesters of the curricular elective module took place in face-to-face teaching (pre-COVID-19 group). From the summer semester of 2020 to the summer semester of 2021, 3 semesters took place as online and hybrid courses (mid-COVID-19 group). Student attitudes and knowledge gains were measured using pretests, posttests, and final evaluations. These data were statistically compared across years, and new forms of teaching under COVID-19 conditions were examined in more detail.

RESULTS

A total of 189 students participated in the module from the summer semester of 2016 through the summer semester of 2021 (pre-COVID-19: n = 138; mid-COVID-19: n = 51). There was a high level of satisfaction with the module across all semesters, with no significant differences between the groups. There was also no significant difference between the two cohorts in terms of knowledge gain, which was always significant (p < 0.05). COVID-19 adaptations included online seminars using Microsoft Teams or Zoom, the interactive live-streaming of practical training components, and digital simulation games.

CONCLUSION

The high level of satisfaction and knowledge gained during the module did not change even under a digital redesign of the content offered. The curricular elective module was consistently evaluated positively by the students, and the adaptation to online teaching was well accepted. Experiences with digital forms of teaching should also be used after the COVID-19 pandemic to create digitally supported blended learning concepts in the field of deployment and disaster medicine and thus further promote the expansion of teaching in this important medical field.