Massive open online courses (MOOCs) for continuing medical education - why and how?

Postgraduate Fellowships, Distant Continuing Education, and Funding in Neurosurgical Education

Neurosurgical education and training are the essential tenets for the development of a sustainable workforce. However, opportunities for training are limited in most parts of the world due to socioeconomic constraints and an inadequate workforce. This global deficit has triggered a huge drive to expand training opportunities. Although training programs are increasing numerically, most of these programs focus on basic residency training with no opportunities for fellowships and continuing education. Herein, we use the Foundation of International Education in Neurological Surgery as a global success model to elucidate on the role of fellowships, distant continuing education, and funding in neurosurgery.

Impact of Facilitation on Cognitive Flow in a Novel Diabetes Management Rehearsal Game for Health Professions Education: Mixed Methods, Open-Label, Superiority Randomized Controlled Trial

BACKGROUND

Though the prevalence of diabetes is set to increase, most serious game solutions typically target patient self-management and education. Few games target health care professions education, and even fewer consider the factors that may increase their efficacies. The impact of facilitation, a prominent feature of health professions education, is examined in the context of a rehearsal-based diabetes management serious game.

OBJECTIVE

In this mixed methods, open-label, superiority randomized controlled trial, we compare student performance, attitudes, and perceptions of a rehearsal-based diabetes management game for health care professionals.

METHODS

Student participants were randomized into 2 groups to play a diabetes management game. The control group played the game alone, and the intervention group played the same game alongside a facilitator tasked to moderate overall challenge levels and address queries. Both groups were administered the Flow Short Scale, a 13-item measure rated on a 7-point Likert scale ranging from 1 ("not at all") to 7 ("very much") immediately after the game. Students were then invited to voluntary focus group discussions to elicit their attitudes and perceptions of the game. Findings were subject to between-group comparisons and inductive thematic analysis respectively.

RESULTS

A total of 48 (26 control, 22 intervention) clinical-year undergraduates from the Lee Kong Chian School of Medicine in Singapore participated in this study, with 18 continuing to the focus group discussions. Flow Short Scale results indicated the superiority of the intervention group for overall flow (t46=-2.17, P=.04) and the absorption subdomain (t46=-2.6, P=.01). Qualitative results indicated students viewed facilitation as helpful and appropriate, and were able to identify improvable elements of the game's theoretical foundations and overall design.

CONCLUSIONS

While serious games are efficacious means of rehearsing previously learned knowledge, facilitation allows for their efficiency to be greatly increased. Such increases are likely crucial in the coming years with the increased digitization of health care professions education and the prevalence of diabetes.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05637749; https://www.clinicaltrials.gov/study/NCT05637749.

Health Care Workers' Motivations for Enrolling in Massive Open Online Courses During a Public Health Emergency: Descriptive Analysis

Background

Massive open online courses (MOOCs) are increasingly used to educate health care workers during public health emergencies. In early 2020, the World Health Organization (WHO) developed a series of MOOCs for COVID-19, introducing the disease and strategies to control its outbreak, with 6 courses specifically targeting health care workers as learners. In 2020, Stanford University also launched a MOOC designed to deliver accurate and timely education on COVID-19, equipping health care workers across the globe to provide health care safely and effectively to patients with the novel infectious disease. Although the use of MOOCs for just-in-time training has expanded during the pandemic, evidence is limited regarding the factors motivating health care workers to enroll in and complete courses, particularly in low-income countries (LICs) and lower-middle-income countries (LMICs).

Objective

This study seeks to gain insights on the characteristics and motivations of learners turning to MOOCs for just-in-time training, to provide evidence that can better inform MOOC design to meet the needs of health care workers. We examine data from learners in 1 Stanford University and 6 WHO COVID-19 courses to identify (1) the characteristics of health care workers completing the courses and (2) the factors motivating them to enroll.

Methods

We analyze (1) course registration data of the 49,098 health care workers who completed the 7 focal courses and (2) survey responses from 6272 course completers. The survey asked respondents to rank their motivations for enrollment and share feedback about their learning experience. We use descriptive statistics to compare responses by health care profession and by World Bank country income classification.

Results

Health care workers completed the focal courses from all regions of the world, with nearly one-third (14,159/49,098, 28.84%) practicing in LICs and LMICs. Survey data revealed a diverse range of professional roles among the learners, including physicians (2171/6272, 34.61%); nurses (1599/6272, 25.49%); and other health care professionals such as allied health professionals, community health workers, paramedics, and pharmacists (2502/6272, 39.89%). Across all health care professions, the primary motivation to enroll was for personal learning to improve clinical practice. Continuing education credit was also an important motivator, particularly for nonphysicians and learners in LICs and LMICs. Course cost (3423/6272, 54.58%) and certification (4238/6272, 67.57%) were also important to a majority of learners.

Conclusions

Our results demonstrate that a diverse range of health care professionals accessed MOOCs for just-in-time training during a public health emergency. Although all health care workers were motivated to improve their clinical practice, different factors were influential across professions and locations. These factors should be considered in MOOC design to meet the needs of health care workers, particularly those in lower-resource settings where alternative avenues for training may be limited.

Redefining the Role of Medical Affairs Professionals as Innovators and Leaders in Industry-Led Medical Education

Medical affairs professionals are pivotal players at the intersection of medical innovation and practice in the pharmaceutical industry. They are uniquely positioned to translate complex medical knowledge into actionable insights for internal and external stakeholders. Industry-led continuing medical education (CME) programs, guided by these professionals, hold the potential to markedly improve clinicians' application of evidence-based medicine (EBM) in clinical settings, thereby elevating patient care outcomes. However, current CME techniques often overlook the integration of diverse disciplines such as educational theories, cognitive psychology, information mastery, and implementation science, which are important for effective real-time decision-making in patient care. This gap in integrating implementation science is vital, as it is key in ensuring that medical innovations are not just developed but also effectively implemented and efficiently utilized in clinical settings. In this opinion article, we aim to highlight the crucial yet often underrecognized role of medical affairs professionals in shaping robust and practical CME programs within the industry. We explore emerging trends and approaches in medical education and CME based on the principles of adult education. Additionally, we explore how medical affairs professionals can effectively drive the adoption of EBM in clinical practice. This exploration aims to provide insights into enhancing CME programs, with medical affairs professionals at the forefront of innovation and leadership in bridging gaps in clinical practice.

Massive open online courses (MOOCs) in genomic variant interpretation: An innovative education strategy for the growing genetic counselor workforce

The growth in genomic testing in healthcare requires a highly trained specialist workforce to ensure evidence based clinical germline variant interpretation. Genetic counselors form a core part of the clinical genomics multidisciplinary team (MDT) and represent a growing workforce participating in variant interpretation from data analysis to the patient consultation. Standardized, high-quality variant interpretation training for Genetic Counselors has historically been ad hoc and variable, with existing programs lacking capacity to reach the entire workforce. To address the requirement for scalable variant interpretation training for genomics healthcare professionals (HCPs), two Massive Open Online Courses (MOOCs) were developed. We analyzed the data from 17 Genetic counselors, as part of an evaluation cohort completing the first run of these MOOCs. Overall genetic counselors enjoyed the courses, felt they were clinically relevant and would recommend them to colleagues. Common challenges amongst the genetic counseling workforces included utilizing relevant databases and finding time in the workday to complete training. These findings suggest MOOCs could be an acceptable option to ensure a consistent and transferrable high standard of training, complimentary to existing curricula. They also hold the potential to facilitate large-scale education to update the genetic counseling workforce when changes in variant interpretation guidance occur.

Cognitive load theory in action: e-learning modules improve performance in simulation-based education. A pilot study

PURPOSE

Learners participating in simulation-based education may experience cognitive overload with potential detrimental effects to learning and performance. Multiple strategies have been proposed to mitigate this detrimental response. However, these strategies have not fully considered the potential benefits of using online platforms, such as accessibility, cost-effectiveness, efficiency, and scalability. Addressing this gap in the literature, preparatory online modules were developed by applying concepts from cognitive load theory and simulation-based education. This study assessed whether using preparatory online modules to deliver weekly pre-briefing content could impact cognitive load and performance. The participants were first-year postgraduate medical trainees participating in a simulation-based resuscitation curriculum.

METHODS

Fifty-three trainees were allocated to receive preparatory online modules (online modules group, n = 27) or not (control group, n = 26) during the course component of a simulation-based resuscitation curriculum. Then, these trainees participated in a simulation-based objective structured clinical examination (OSCE). Sources of cognitive load (intrinsic, extraneous, and germane) were measured using a modified cognitive load questionnaire. Performance was assessed using the Ottawa Surgical Competency Operating Room Evaluation. Data were analyzed with descriptive statistics, and principal component analysis.

RESULTS

During the course component, the online modules group was found to have higher intrinsic and germane cognitive load, and lower extraneous cognitive load compared to the control group. During the OSCE, the online modules group scored significantly higher in performance scores (p = 0.0077, d = 0.39, 95% confidence interval = 0.10;0.68) compared to the control group. Principal component analysis supported the results obtained with the modified cognitive load questionnaire.

CONCLUSION

Trainees using preparatory online modules during the course component of a simulation-based resuscitation curriculum experienced cognitive load changes consistent with cognitive optimization. This may have contributed to their superior performance in the subsequent OSCE. Future research should explore the long-term impacts of online preparatory training and consider potential barriers to implementation in diverse healthcare environments.

Journey from an Enabler to a Strategic Leader: Integration of the Medical Affairs Function in ESG Initiatives and Values

Like most private enterprises, the pharmaceutical industry has deeply rooted environmental, social, and governance (ESG) matters that challenge its long-term sustainability. Overcoming these external challenges requires collaborative and proactive steps as well as procedures guiding the adoption of ESG principles by all internal stakeholders. Environmental challenges such as climate change, and in addition the changes in society, have resulted in the need for governance addressing and coordinating efforts. The core function of medical affairs (MA) is connecting with stakeholders within a company and also between the company and external stakeholders. In this article, we describe the involvement of MA in several aspects of ESG, as a contributor, partner, and implementer. MA has a significant opportunity to emerge as a leading function involved in ESG strategies and their tactical implementation. Although the involvement of MA in the environment pillar of ESG is less, the function can implement changes relating to the conduct of meetings, clinical studies, and the digitalization of medical education via virtual platforms. Due to its patient centricity, MA is tasked to address social determinants of health to improve patients' outcomes. As a linking function within a company and with its external stakeholders, MA can provide proactive input in policy generation and enable effective governance by adherence to standards of accountability, ethics, and compliance, as well as transparency. Championing ESG is a collective responsibility that transcends any single department. It mandates a company-wide commitment. MA represents an essential pivot point in catalyzing the integration of ESG principles within industry, contributing to a healthcare ecosystem that is not merely more sustainable and ethical but also more conducive to patient health and public well-being.

Hearing Loss in Children: Critical Medical Education Delivered as Massive Open Online Course (MOOC)

Purpose

Although early identification of pediatric hearing loss is crucial, a formal online training course has not been freely accessible to a global audience. In response, we created a novel course for health professionals worldwide.

Method

Course development occurred from February 2019 to May 2020. Seventeen multidisciplinary experts provided video lectures and demonstrations, including a tour of ear anatomy, operating footage of cochlear implant insertion, and demonstrations of children undergoing hearing testing. Content also included steps for interpreting audiograms, an overview of early screening programs, interviews with Deaf/Hard of Hearing children, and an introduction to public health/educational infrastructure. The course was hosted on Coursera and launched on May 4, 2020.

Results

The course was approved for 11.5 Continuing Medical Education (CME) and American Board of Pediatrics Maintenance of Certification (MOC)-Part 2 credits and spanned five modules comprised of 50 video learning segments: 1) Ear Anatomy, 2) Hearing Loss and Assessments, 3) Hearing Loss Diagnosis and Impact on Speech and Language Development, 4) Interventions for Hearing Loss, 5) Pediatric Vestibular System and Balance. Since its launch, 6,556 learners have enrolled and 1,540 have fully completed the course; Fifty percent were 25-34 years old, 62% were female, and 43% were from Asia. Average rating was 4.9/5 (n=180 reviews).

Conclusions

We created a freely accessible course for a global audience that provides a broad overview of pediatric hearing loss. Our multidisciplinary approach addresses an educational gap and can serve as a model for developing other online courses.

The effects of job characteristics on physicians' orientation toward lifelong learning

With the rapidly growing body of medical knowledge, physicians must engage in lifelong learning. Physicians' orientation toward lifelong learning is of crucial importance. This study aimed to explore the effects of job characteristics on physicians' lifelong learning. A multicenter study collecting data from physicians from three medical centers in Taiwan was performed. A total of 321 physicians were surveyed with the Chinese version of the Job Content Questionnaire (C-JCQ) and the revised Jefferson Scale of Physician Lifelong Learning (JeffSPLL) to assess their job characteristics (i.e., job demands, job control, social support) and orientation toward lifelong learning. Exploratory factor analysis was employed to validate both questionnaires. Hierarchical regression was utilized to explore the relationship of job characteristics and predictors with physicians' lifelong learning. The results revealed that job demands (β = 0.10), job control (β = 0.19), social support from supervisors (β = 0.16), the interaction of job demands × job control (β =  - 0.11) and the interaction of job demands × social support from colleagues (β = 0.13) were significantly (p < .05, p < .001) related to lifelong learning. Moreover, physicians in the active group (high demand, high control) possessed a stronger orientation toward lifelong learning (mean = 3.57) than those in the low-strain group (mean = 3.42), high-strain group (mean = 3.39) and passive group (mean = 3.20). In conclusion, examining physicians' job demands, job control and social support helps us to understand their orientation toward lifelong learning and may provide insight to improve educational strategies.

Impact on Knowledge, Competence, and Performance of a Faculty-Led Web-Based Educational Activity for Type 2 Diabetes and Obesity: Questionnaire Study Among Health Care Professionals and Analysis of Anonymized Patient Records

BACKGROUND

Strategies for managing type 2 diabetes (T2D) and obesity are evolving with the introduction of targeted therapies, including incretin-based dual agonists and growing knowledge of the importance of multidisciplinary care. Accessible, effective continuing medical education (CME) activities are required to ensure that health care professionals (HCPs) understand and can implement the most recent data to optimize patient outcomes.

OBJECTIVE

We aimed to measure changes in knowledge, competence, and self-reported performance and quantitatively evaluate changes in performance using anonymized patient data following participation in a web-based educational activity. The faculty-led CME-accredited activity was based on incretin-based dual agonists and patient education on T2D and obesity. The remaining educational gaps in this field were also identified.

METHODS

A CME-accredited, web-based, multidisciplinary (touchMDT) educational activity titled "The future for glycemic control and weight loss in T2D and obesity: Incretin-based dual-agonists and optimizing patient education" was developed. HCP knowledge, competence, and performance were assessed before and after the activity against Moore's expanded outcomes framework (levels 1-5), using self-reported questionnaires and by analyzing anonymized patient record data.

RESULTS

For evaluating knowledge and competence (50 respondents before and 50 learners after the activity), the mean number of correctly answered questions was significantly higher post activity (median 5.0, IQR 4.0-6.0 to 6.0, IQR 5.0-7.0; mean 4.98, SD 1.22 to 5.78, SD 1.13; P<.001). Modest, nonsignificant improvements in self-reported performance (N=50 respondents preactivity; N=50 learners postactivity) from before to after the activity were observed (median 4.0, IQR 3.25-4.0 to 4.0, IQR 4.0-4.0; mean 3.64, SD 0.69 to 3.76, SD 0.48; P=.32). PPatient data analysis indicated that patients were being treated more intensively postactivity: before the activity, the most commonly used treatment regimens were metformin monotherapy (13/50, 26%) and dual therapy with metformin plus injectable glucagon-like peptide-1 (GLP-1) receptor agonist (RA; 11/50, 22%); post activity, this changed to dual therapy with metformin plus injectable GLP-1 RA (12/50, 24%) and triple therapy with metformin plus injectable GLP-1 RA plus sodium-glucose cotransporter-2 inhibitor (SGLT2i; 10/50, 20%). In addition, there was an increased number of referrals to a combination of specialists (physicians referred 27%, 8/30 of patients to ≥2 specialists before the activity and 36%, 10/28 to ≥2 specialists post activity). The remaining educational gaps included understanding the biology and psychology of obesity, efficacy and safety data for incretin-based dual agonists, and the role of the diabetes educator or diabetes care and education specialist in managing T2D and obesity.

CONCLUSIONS

This short, web-based CME activity on the management of T2D and obesity led to improvements in HCP knowledge, competence, and performance. Several remaining unmet needs were identified, which can be used to inform the content of future educational activities in this disease area.

Addressing educational gaps through multidisciplinary team education in eosinophilic oesophagitis management

Once considered a rare disease, eosinophilic oesophagitis (EoE) is becoming increasingly prevalent, yet many healthcare professionals (HCPs) remain unfamiliar with the underlying pathophysiology and optimal management approaches. For this study, we developed a faculty-led, online, continuing medical education activity on EoE. The effectiveness of this activity was evaluated according to Moore's framework, with changes in knowledge and competence (Moore's Levels 3 and 4) assessed for a cohort of gastroenterologists, dietitians, allergists and immunologists (N = 300), using questionnaires completed before and after participation. Changes in HCP confidence in treating EoE were also reported and remaining educational gaps were identified. The activity was viewed by a global audience of 5,330 participants within 6 months, and significant improvements in knowledge and competence were reported following participation in the activity across all specialities, regions and experience (mean [standard deviation] score pre- versus post-activity: 4.32 [1.38] versus 5.46 [0.82]; p < 0.001). Confidence in treating EoE also increased from pre- to post-activity, with the proportion of participants reporting that they felt moderately or extremely confident increasing from 53% to 82%. Several educational unmet needs were identified, which can be used to inform the design of future educational activities in EoE.

On the advantages and disadvantages of virtual continuing medical education: a scoping review

Introduction

With the COVID-19 pandemic, most continuing medical education activities became virtual (VCME). The authors conducted a scoping review to synthesize the advantages and disadvantages of VCME to establish the impact of this approach on inequities that physicians face along the intersections of gender, race, and location of practice.

Methods

Guided by the methodological framework of Arksey and O'Malley, the search included six databases and was limited to studies published between January 1991 to April 2021. Eligible studies included those related to accredited/non-accredited post-certification medical education, conferences, or meetings in a virtual setting focused on physicians. Numeric and inductive thematic analyses were performed.

Results

282 studies were included in the review. Salient advantages identified were convenience, favourable learning formats, collaboration opportunities, effectiveness at improving knowledge and clinical practices, and cost-effectiveness. Prominent disadvantages included technological barriers, poor design, cost, lack of sufficient technological skill, and time. Analysis of the studies showed that VCME was most common in the general/family practice specialty, in suburban settings, and held by countries in the Global North. A minority of studies reported on gender (35%) and race (4%).

Discussion

Most studies report advantages of VCME, but disadvantages and barriers exist that are contextual to the location of practice and medical subspecialty. VCME events are largely organized by Global North countries with suboptimized accessibility for Global South attendees. A lack of reported data on gender and race reveals a limited understanding of how VCME affects vulnerable populations, prompting potential future considerations as it evolves.

Barriers and facilitators to the uptake of the Concussion Awareness Training Tool as continuing medical education in primary care

Aim

Continuing medical education (CME) informs physicians on current research. The Concussion Awareness Training Tool (CATT) provides education on concussion diagnosis and treatment. The aims of this study were to explore physician CME practices and preferences, understand barriers and facilitators to implementing the CATT as CME, and provide recommendations.

Materials & methods

Physicians in British Columbia, Canada participated in an online survey and telephone interview. Descriptive analysis of quantitative data, and text-based data analysis were undertaken to identify themes.

Results

Barriers included lack of time and awareness of the resource. Facilitators were its ease of use, accessibility, conciseness and comprehensiveness.

Conclusion

The perceptions of barriers and facilitators reported by physicians are important to understand and better promote the use of the CATT.

Effectiveness of a course on family health in the knowledge of doctors of the Mais Médicos program

OBJECTIVE

The aim of this study was to analyze the effectiveness of the distance education course in family health in the knowledge of physicians from the Mais Médicos program.

METHOD

This is a quantitative, quasi-experimental study, without a pretest and posttest control group, carried out from August 2019 to September 2021. In all modules, physicians responded to a pretest and posttest to verify their knowledge of the subject.

RESULTS

There was a statistically significant difference in all modules with higher average scores in the posttests; the modules with the greatest emphasis are child health care: growth and development; approach to cancer in primary health care; and family health strategy and territorialization.

CONCLUSION

The effectiveness of the distance education course was verified, as evidenced by the significant improvement of knowledge in all the modules studied.

Learning Design Strategies in MOOCs for Physicians' Training: A Scoping Review

In recent years, there has been an increased implementation of massive open online courses (MOOCs). This teaching model plays a pivotal role in online education because it can provide high-quality learning resources to numerous students with great feasibility, shaping training courses according to their different learning requirements. Although the widespread adoption of MOOCs in medical education has led to numerous benefits for undergraduate and graduate doctors, their role remains unclear, suggesting the need to analyze the key factors of such a learning method in this field. To achieve this aim, a scoping review, in line with the PRISMA method for qualitative synthesis, was performed by considering studies published from 2016 to 2021, written in English, and including the physician population. Through this literature analysis, the following main areas of interest came to light: (1) pedagogical approaches, (2) MOOC structure-related variables, (3) participant-related variables, and (4) MOOCs vs. traditional courses. The review provides valuable evidence on factors underlying MOOCs effectiveness, which might be helpful for academic and healthcare organizations in designing effective training courses for physicians.

The Educational Impact of Web-Based, Faculty-Led Continuing Medical Education Programs in Type 2 Diabetes: A Survey Study to Analyze Changes in Knowledge, Competence, and Performance of Health Care Professionals

BACKGROUND

The treatment landscape for type 2 diabetes (T2D) is continually evolving; therefore, ongoing education of health care professionals (HCPs) is essential. There is growing interest in measuring the impact of educational activities, such as through use of the Moore framework; however, data on the benefits of continuing medical education (CME) in the management of T2D remain limited.

OBJECTIVE

This study aimed to evaluate HCP satisfaction; measure improvements in knowledge, competence, and performance following short, case-based, multidisciplinary web-based CME activities; and identify the remaining educational gaps.

METHODS

Two faculty-led, CME-accredited, web-based educational activities on T2D and obesity, touchIN CONVERSATION and touch MultiDisciplinary Team, were developed and made available on a free-to-access medical education website. Each activity comprised 3 videos lasting 10 to 15 minutes, which addressed learning objectives developed based on a review of published literature and faculty feedback. Participant satisfaction (Moore level 2) was evaluated using a postactivity questionnaire. For both activities, changes in knowledge and competence (Moore levels 3 and 4) were assessed using questionnaires completed by representative HCPs before or after participation in the activities. A second set of HCPs completed a questionnaire before and after engaging in activities that assessed changes in self-reported performance (Moore level 5).

RESULTS

Each activity was viewed by approximately 6000 participants within 6 months. The participants expressed high levels of satisfaction (>80%) with both activities. Statistically significant improvements from baseline in knowledge and competence were reported following participation in touchIN CONVERSATION (mean score, SD before vs after activity: 4.36, 1.40 vs 5.42, 1.37; P<.001), with the proportion of learners answering at least six of 7 questions correctly, increasing from 22% (11/50) to 60% (30/50). A nonsignificant improvement in knowledge and competence was observed following participation in touch MultiDisciplinary Team (mean score, SD 4.36, 1.24 vs 4.58, 1.07; P=.35); however, baseline knowledge and competence were relatively high, where 80% of the respondents (40/50) answered at least four of 6 questions correctly. A significant improvement in HCP self-reported performance was observed in a combined analysis of both activities (mean score, SD 2.65, 1.32 vs 3.15, 1.26; P=.03), with the proportion of learners selecting the answer representing the best clinical option for all 4 questions increasing from 32% (11/34) to 59% (20/34) after the activity. Several unmet educational needs were self-reported or identified from the analysis of incorrectly answered questions, including setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

CONCLUSIONS

Short, case-based, web-based CME activities designed for HCPs to fit their clinical schedules achieved improvements in knowledge, competence, and self-reported performance in T2D management. Ongoing educational needs identified included setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

Costs and Cost-Effectiveness of mCME Version 2.0: An SMS-Based Continuing Medical Education Program for HIV Clinicians in Vietnam

This cost analysis found that a mobile phone-based continuing medical education (mCME) intervention, involving daily text messages with links to relevant materials, for HIV clinicians in northern Vietnam was relatively low-cost and cost-effective, particularly for future nationwide models. Such mobile approaches to CME are worthy of attention in resource-constrained settings.

Background:

The Mobile Continuing Medical Education (mCME) 2.0 project was a randomized controlled trial that found that a 6-month text message-based CME intervention improved both the use of online medical training resources and medical knowledge among a cadre of HIV clinicians in Vietnam. This companion study analyzed intervention costs and cost-effectiveness.

Methods:

We conducted (1) a financial analysis based on costs incurred during the trial’s planning and implementation; (2) an economic analysis to consider resource utilization; and (3) cost-effectiveness analyses to estimate cost inputs relative to impact: increase in self-study (measured by visits to online courses) and increase in knowledge (measured by exam score improvement) (in 2016 US$). Finally, we estimated the economic cost of a 9-month national program and a 10-year scaled-up model (in 2021 US$).

Results:

The total financial cost of the intervention was US$49,552; the main cost drivers were personnel time (71.4%) and technology inputs (14.9%). The total economic cost was estimated at US$92,212, with the same key cost inputs (representing 77.7% and 8.0%, respectively, of total costs). The financial cost per 10% increase in accessing online courses was US$923, while the cost of improving knowledge, measured by a 10% improvement in mean exam score across the study population, was US$32,057 (US$605 per intervention clinician). The comparable total economic cost of each improvement, respectively, was US$1,770 and US$61,452 (US$1,159 per intervention clinician). A future 9-month national program was estimated to cost US$37,403, while the full 10-year scaled-up program was estimated at US$196,446.

Conclusions:

This analysis indicates that leveraging mobile technology could be a feasible way to provide distance learning to health professions across Vietnam at a relatively low cost. Given the need for practical ways to expand CME in resource-constrained regions of the world, this approach warrants further study and possible adoption.

Digital Transformation in Medical Affairs Sparked by the Pandemic: Insights and Learnings from COVID-19 Era and Beyond

A number of developments, including increasing regulatory and compliance scrutiny, increased transparency expectations, an increasingly vocal patient, patient centricity and greater requirements for real-world evidence, have driven the growth and importance of medical affairs as a trusted, science-driven partner over the past decade. The healthcare environment is shifting towards a digital, data-driven and payor-focused model. Likewise, medical affairs as a function within the pharmaceutical industry has become more "patient-centric" with strategic engagements embracing payers and patients apart from clinicians. The pandemic has impacted the healthcare industry as well as the function of medical affairs in numerous ways and has brought new challenges and demands to tackle. There is indeed a silver lining due to intense digital transformation within this crisis. The emerging digital innovation and new technologies in healthcare, medical education and virtual communications are likely to stay and advance further. In this review, we discuss how the digital transformation sparked by the pandemic has impacted the medical affairs function in pharmaceuticals and provide further insights and learnings from the COVID-19 era and beyond. Based on the learning and insights, digital innovation in three key strategic imperatives of medical affairs-HCP engagement, external partnerships and data generation will enable medical affairs to become future-fit as a strategic leadership function.

A scoping review of the use of e-learning and e-consultation for healthcare workers in low- and middle-income countries and their potential complementarity

OBJECTIVE

Although the provision of e-learning (EL) training for healthcare workers (HCWs) and provider-to-HCW e-consultation (EC) is considered useful for health outcomes, research on their joint use is limited. This scoping review aimed to create an overview of what is currently known in the literature about the use and implementation of EC and EL by HCWs in LMICs and to answer the question of whether there is evidence of complementarity.

MATERIALS AND METHODS

Scientific databases were searched and peer-reviewed papers were reviewed systematically according to predefined inclusion/exclusion criteria. Data were extracted including the study focus (EC/EL), year of publication, geographical location, target population, target disease(s) under study, type(s) of study outcomes, and article type.

RESULTS

A total of 3051 articles were retrieved and screened for eligibility, of which 96 were kept for analysis. Of these, only 3 addressed both EL and EC; 54 studies addressed EL; and 39 addressed EC. Most studies looked at gain in knowledge/skills usability, efficiency, competence, and satisfaction of HCW, or barriers/challenges to implementation. Descriptive studies focused on the application of EL or EC for targeting specific health conditions. Factors contributing to the success of EC or EL networks were institutional anchoring, multiple partnership, and capacity building of local experts.

CONCLUSIONS

Our review found an important gap in the literature in relation to the complementary role of EL and EC for HCWs in LMICs evidenced by outcome measures. There is an important role for national and international academic institutions, learned medical societies, and networks to support regional experts in providing EL and EC for added value that will help the clinical performance of HCWs and improve health outcomes.

Low-cost peer-taught virtual research workshops for medical students in Pakistan: a creative, scalable, and sustainable solution for student research

BACKGROUND

Pakistan has not been a major contributor to medical research, mainly because of the lack of learning opportunities to medical students. With the increase in online learning systems during COVID-19, research related skills can be taught to medical students via low-cost peer taught virtual research workshops.

AIM OF THE STUDY

To assess the effectiveness of a comprehensive low-cost peer-taught virtual research workshops amongst medical students in Pakistan.

METHODS

This quasi-experimental study assessed the effectiveness of five virtual research workshops (RWs) in improving core research skills. RWs for medical students from across Pakistan were conducted over Zoom by medical students (peer-teachers) at the Aga Khan University, Pakistan, with minimal associated costs. The content of the workshops included types of research, ethical approval and research protocols, data collection and analysis, manuscript writing, and improving networking skills for research. Improvement was assessed via pre-and post-quizzes for each RW, self-efficacy scores across 16 domains, and feedback forms. Minimum criteria for completion of the RW series was attending at least 4/5 RWs and filling the post-RW series feedback form. A 6-month post-RW series follow-up survey was also emailed to the participants.

RESULTS

Four hundred medical students from 36 (/117; 30.8%) different medical colleges in Pakistan were enrolled in the RWs. However, only 307/400 (76.75%) medical students met the minimum requirement for completion of the RW series. 56.4% of the participants belonged to the pre-clinical years while the rest were currently to clinical years. The cohort demonstrated significant improvement in pre-and post-quiz scores for all 5 RWs (p <  0.001) with the greatest improvement in Data Collection and Analysis (+ 34.65%), and in self-efficacy scores across all domains (p <  0.001). 166/307 (54.1%) participants responded to the 6 months post-RWs follow-up survey. Compared to pre-RWs, Research involvement increased from 40.4 to 62.8% (p <  0.001) while proportion of participants with peer-reviewed publications increased from 8.4 to 15.8% (p = 0.043).

CONCLUSION

Virtual RWs allow for a wide outreach while effectively improving research-related knowledge and skills, with minimal associated costs. In lower-middle-income countries, virtual RWs are a creative and cost-effective use of web-based technologies to facilitate medical students to contribute to the local and global healthcare research community.

Implementation and evaluation of an online anatomy, radiology and contouring bootcamp for radiation therapists

BACKGROUND

As new treatments and technologies have been introduced in radiation oncology, the clinical roles of radiation therapists (RTs) have expanded. However, there are few formal learning opportunities for RTs. An online, anatomy, radiology and contouring bootcamp (ARC Bootcamp) originally designed for medical residents was identified as a prospective educational tool for RTs. The purpose of this study was to evaluate an RT edition of the ARC Bootcamp on knowledge, contouring, and confidence, as well as to identify areas for future modification.

METHODS

Fifty licensed RTs were enrolled in an eight-week, multidisciplinary, online RT ARC Bootcamp. Contouring practice was available throughout the course using an online contouring platform. Outcomes were evaluated using a pre-course and post-course multiple-choice quiz (MCQ), contouring evaluation and qualitative self-efficacy and satisfaction survey.

RESULTS

Of the fifty enrolled RTs, 30 completed the course, and 26 completed at least one of the post-tests. Nineteen contouring dice similarity coefficient (DSC) scores were available for paired pre- and post-course analysis. RTs demonstrated a statistically significant increase in mean DSC scoring pooled across all contouring structures (mean ± SD improvement: 0.09 ± 0.18 on a scale from 0 to 1, p=0.020). For individual contouring structures, 3/15 reached significance in contouring improvement. MCQ scores were available for 26 participants and increased after RT ARC Bootcamp participation with a mean ± SD pre-test score of 18.6 ± 4.2 (46.5%); on a 40-point scale vs. post-test score of 24.5 ± 4.3 (61.4%) (p < 0.001). RT confidence in contouring, anatomy knowledge and radiographic identification improved after course completion (p < 0.001). Feedback from RTs recommended more contouring instruction, less in-depth anatomy review and more time to complete the course.

CONCLUSIONS

The RT ARC Bootcamp was an effective tool for improving anatomy and radiographic knowledge among RTs. The course demonstrated improvements in contouring and overall confidence. However, only approximately half of the enrolled RTs completed the course, limiting statistical power. Future modifications will aim to increase relevance to RTs and improve completion rates.

Supporting newly graduated medical doctors in managing COVID-19: An evaluation of a Massive Open Online Course in a limited-resource setting

Introduction

Newly graduated medical doctors in their internships are positioned to strengthen the front line in combating COVID-19. We developed a Massive Open Online Course (MOOC) to equip them with adequate knowledge for COVID-19 management. This paper aims to analyze the MOOC and evaluate participant satisfaction and increase in knowledge after completing the course.

Methods

An observational study was conducted. Quantitative data were obtained from questionnaires and pre- and post-tests. Responses to open-ended questions of the questionnaires were collected. Analysis using the Quality Reference Framework was also completed.

Results

The MOOC consisted of fundamental knowledge of COVID-19 (Part A) and further enrichment (Part B), and the content was written in the Indonesian language. A total of 3,424 and 2,462 participants completed the course in August and November 2020, respectively. Most participants agreed that the platform was easy to navigate, the design was interesting, and the content was aligned with their needs. Pre- and post-test scores in Part A’s subjects increased significantly. Factors contributing to and inhibiting usability and areas for improvement were further highlighted.

Discussion

The use of a specific quality framework facilitated a comprehensive evaluation of the MOOC’s strengths, weaknesses, and areas for future improvements. The participants’ satisfaction and pre- and post-test results showed that the current MOOC holds great potential benefit for continuing education for medical interns joining the frontliners during the pandemic. Future implementation should consider increasing the quality of learning resources, scaling up the platform and its technical supports, and enhancing organizational supports.

Attracting and retaining physicians in less attractive specialties: the role of continuing medical education

BACKGROUND

Less attractive specialties in medicine are struggling to recruit and retain physicians. When properly organized and delivered, continuing medical education (CME) activities that include short courses, coaching in the workplace, and communities of practice might offer a solution to this problem. This position paper discusses how educationalists can create CME activities based on the self-determination theory that increase physicians' intrinsic motivation to work in these specialties.

MAIN CONTENT

The authors propose a set of guidelines for the design of CME activities that offer physicians meaningful training experiences within the limits of the available resources and support. First, to increase physicians' sense of professional relatedness, educationalists must conduct a learner needs assessment, evaluate CME's long-term outcomes in work-based settings, create social learning networks, and involve stakeholders in every step of the CME design and implementation process. Moreover, providing accessible, practical training formats and giving informative performance feedback that authentically connects to learners' working life situation increases physicians' competence and autonomy, so that they can confidently and independently manage the situations in their practice contexts. For each guideline, application methods and instruments are proposed, making use of relevant literature and connecting to the self-determination theory.

CONCLUSIONS

By reducing feelings of professional isolation and reinforcing feelings of competence and autonomy in physicians, CME activities show promise as a strategy to recruit and retain physicians in less attractive specialties.

Massive open online courses for nurses' and healthcare professionals' continuous education: a scoping review

AIM

To map the main characteristics of massive open online courses, and their effectiveness, facilitators and barriers in continuing education among nurses and other healthcare professionals.

BACKGROUND

Online continuous education attracted new attention among educators and managers with regard to how to best design, implement it and evaluate its effectiveness.

INTRODUCTION

No studies to date have mapped the state of research on massive open online courses and the facilitators promoting their effectiveness in continuing education.

METHODS

A scoping review performed in 2020 by following the Preferred Reporting Items for Systematic reviews and Meta-analysis extension-Scoping Reviews. Electronic databases were searched for primary and secondary studies, written in English. Identified barriers/facilitators were categorized using a content analysis.

RESULTS

Of the 1149 studies, 31 were included, and the majority had an explorative research design. Massive open online courses documented to date are characterized by their (a) developers' countries and providers, mainly the United Stated and universities, respectively; (b) variety of teaching methods and contents, including infectious diseases; (c) using both qualitative and quantitative assessment methods; and (d) multidisciplinary target audience ranging from 40 to 83 000 participants, including nurses. Facilitators of and barriers to effectiveness depend on their pedagogical background, appropriate course design, delivery and implementation as well as on the learners' profile.

DISCUSSION

Studies available to date are mainly based on experiential projects. A variety of strategies promoting massive online courses' effectiveness have emerged.

CONCLUSION

Some public health issues may benefit from massive education, as a unique system promoting a quick and effective continuous education.

IMPLICATIONS FOR NURSING/HEALTH/SOCIAL POLICY

Clinical nurses, nurse managers and educators should consider available evidence on massive online courses' when making decisions on which strategy to use to maintain competencies. Moreover, as a public health tool, massive online courses should be derived from a strong cooperation between political, scientific and professional bodies.

A model six-month workshop for developing systematic review protocols at teaching hospitals: action research and scholarly productivity

BACKGROUND

Research engagement contributes to the improvement of patient care. A systematic review is a suitable first scholarly activity because it entails summarization of publicly available data and usually requires neither rigorous ethical review nor research funding.

METHODS

This study aimed to develop a model workshop for healthcare staff to acquire skills in creating systematic review protocols based on their own clinical questions at teaching hospitals. We used an action research method to create a model workshop at four hospitals in Japan from April 2015 to March 2017. To improve the program, we solicited reflections using participant questionnaires for each lecture and examined the quality of homework submitted by participants after each lecture. We administered a revised final version of the workshop at five hospitals from April 2016 to March 2017. We evaluated the participants' scholarly productivity related to these workshops. The observation period was a minimum of 2 years following the workshops.

RESULTS

Most participants had never developed a formal clinical research protocol and voluntarily participated in the workshop. The action research was developed and implemented at nine teaching hospitals in Japan, including one university hospital. The study developed a model nine-step workshop curriculum: 1) Research question development, 2) Search strategy development, 3) Search strategy brush-up, 4) Exclusion and inclusion criteria development, 5) Risk of bias assessment planning, 6) Meta-analysis planning, 7) Subgroup and sensitivity analysis planning, 8) Planning the presentation of results, and 9) Presentation protocols. A total of 233 participants, including medical doctors and other health professionals, produced 414 research questions. Seventy-nine participants (34%) completed the workshop, and 47 review teams accomplished systematic review protocols. The participants published 13 peer-reviewed articles as a result of the workshop.

CONCLUSIONS

We developed a structured scholarly productive model workshop for healthcare staff working at hospitals. We found healthcare staff with clinical subspecialties were able to develop an unexpectedly high number of research questions through this workshop. Medical teachers at hospitals with prior systematic review experience could teach how to develop systematic review protocols using this model. Further research is needed to increase the academic productivity of such workshops.

TRIAL REGISTRATION

UMIN (https://www.umin.ac.jp/ctr/), UMIN000017107 (4/15/2015), UMIN000025580 (1/10/2017).

Towards a "Net" generation of Pathologists: the pathCast online remote learning platform

In recent years, digital and communication technology has been changing the way to spread knowledge in Medicine. In the field of Pathology, several remote learning resources have been made available through multiple social media platforms (Facebook, Twitter and others), YouTube channels and dedicated Websites, with a growing number of freely available lectures or tutorials, broadcasted live and/or archived for on-demand viewing. All these internet-based resources enable the pursuit of a flexible, independent, self-motivated and self-directed way of learning that fits perfectly with the increasing limitations of time, space and speed of modern day learners.

These resources have played a significant role in filling the void of conventional education during the ongoing Covid-19 pandemic. Moreover, with their widespread diffusion throughout communities of Pathologists from all over the world they help to reduce the educational gap between resource-rich and resource-poor countries, having the potential to become standardized knowledge-sharing platforms and to be incorporated into curricula at any level.

pathCast is one of the most robust and reliable open-access online remote learning platforms for pathologists, which live-streams lectures across the world. In the present paper we describe its structure, its acceptance by the global community of pathologists, what innovation elements has introduced regarding methodologies for education and its powerful and positive impact for residency training and continuing life-long education of practicing pathologists. A comprehensive list of the pathCast lectures with the respective links is also provided along with a brief discussion on other freely accessible online educational resources for pathologists.

Online educational curriculum in pediatric epilepsy: A pilot study

ABSTRACT

Recent projections suggest that increasing numbers of nurse practitioners (NPs) and physician assistants (PAs) will be needed to meet the increasing need for pediatric neurology expertise. This pilot study assessed feasibility and preliminary effectiveness of an online curriculum designed to impact knowledge, skills, attitudes, and behaviors of NPs/PAs treating patients with pediatric epilepsy. Ten-session online curriculum was developed using previous experience and published recommendations to improve knowledge, electroencephalogram (EEG) skills, attitudes, and behaviors related to treating patients with pediatric epilepsy. Participants were NPs and PAs recruited from regional pediatric neurology practices. Three successive 10-week courses were provided. Attendance and completion were used to assess feasibility. Knowledge, EEG skills, attitudes, and behaviors were evaluated using pretest versus posttest questionnaires and compared analytically using a paired t-test and McNemar test. Twenty-nine NPs/PAs started the course, with typical attendance ∼85%. Twenty-two participants (76%) completed the course. Completers showed significant improvements in medication knowledge (premedication: mean = 74.6, SD = 16.4; postmedication: mean: 88.3, SD = 14.0; p = .001), EEG skills (premedication: mean = 44.8, SD = 24.4; postmedication: mean: 77.3, SD = 19.8; p < .001), and several measures of attitude and behavior. This pilot study shows feasibility and potential educational benefit of a 10-hour online course on pediatric epilepsy and may provide a convenient and effective option for continuing education for hard-to-reach students.

Massive open online course for Brazilian healthcare providers working with substance use disorders: curriculum design

BACKGROUND

Interpersonal and technical skills are required for the care of people living with substance use disorders. Considering the applicability and usability of online courses as continuing professional education initiatives, this study aimed to describe the content design process of an introductory-level healthcare-centered Massive Open Online Course (MOOC).

METHODS

The content of the course was informed through needs assessment, by using three sources: (a) narrative literature review, (b) Delphi health experts panel consensus, and (c) focus groups conducted with people living with substance use disorders. The data from the empirical research phases were analyzed through qualitative Thematic Analysis.

RESULTS

The product of this research project is the introductory-level Massive Open Online Course "Healthcare: Developing Relational Skills for the Assistance of People Living with Substance Use Disorders" which approaches health communication and empathetic relational professional skills as a means of reducing stigmatization of people living with substance use disorders.

CONCLUSIONS

Diverse strategies for designing distance education initiatives have to consider different views on the subject being approached in such courses. The product presented in this paper has the potential to be an educational tool for topics traditionally not addressed in Brazilian continuing education and can be used as a model to the design of online courses directed to the development of work-related skills for the healthcare professions.

Systemic Solutions for Addressing Non-Communicable Diseases in Low- and Middle-Income Countries

Non-communicable diseases (NCDs) have been on the rise in low- and middle-income countries (LMICs) over the last few decades and represent a significant healthcare concern. Over 85% of "premature" deaths worldwide due to NCDs occur in the LMICs. NCDs are an economic burden on these countries, increasing their healthcare expenditure. However, targeting NCDs in LMICs is challenging due to evolving health systems and an emphasis on acute illness. The major issues include limitations with universal health coverage, regulations, funding, distribution and availability of the healthcare workforce, and availability of health data. Experts from across the health sector in LMICs formed a Think Tank to understand and examine the issues, and to offer potential opportunities that may address the rising burden of NCDs in these countries. This review presents the evidence and posits pragmatic solutions to combat NCDs.

Available videoconferencing freeware and medical education

BACKGROUND

Traditionally medical education involves classroom teaching, small group discussions and bed-side clinics. These have become difficult to conduct in times of the COVID-19 pandemic. Video-conferencing software and apps provide pragmatic alternatives for medical education in this scenario. However, the apps are not designed specifically for medical education. In this background, we aimed to review available video-conferencing freeware (platforms/apps) for their suitability in imparting post-graduate medical education.

METHODOLOGY

Software and apps were searched on Android and iOS platforms. Freeware were selected based on pre-defined criteria. They were evaluated for features supporting post-graduate medical education like participant numbers, time limit, user comfort and security features.

RESULTS

Our search yielded 118 video conferencing software and apps. Of these, 07 free apps met the initial inclusion and exclusion criteria. 'Say Namaste' was included post-hoc. Most apps allowed adequate numbers of participants and were comfortable for users. Only two apps had end-to-end encryption.

CONCLUSION

Video-conferencing freeware can serve as a viable alternative for some aspects of medical teaching. Provision of certain additional features would make these apps more effective for post-graduate medical education.