The effectiveness of E-learning in continuing medical education for tuberculosis health workers: a quasi-experiment from China

BACKGROUND

Given the context of rapid technological change and COIVD-19 pandemics, E-learning may provide a unique opportunity for addressing the challenges in traditional face-to-face continuing medical education (CME). However, the effectiveness of E-learning in CME interventions remains unclear. This study aims to evaluate whether E-learning training program can improve TB health personnel's knowledge and behaviour in China.

METHODS

This study used a convergent mixed method research design to evaluate the impact of E-learning programs for tuberculosis (TB) health workers in terms of knowledge improvement and behaviour change during the China-Gates TB Project (add the time span). Quantitative data was collected by staff surveys (baseline n = 555; final n = 757) and management information systems to measure the demographic characteristics, training participation, and TB knowledge. Difference-in-difference (DID) and multiple linear regression models were employed to capture the effectiveness of knowledge improvement. Qualitative data was collected by interviews (n = 30) and focus group discussions (n = 44) with managers, teachers, and learners to explore their learning experience.

RESULTS

Synchronous E-learning improved the knowledge of TB clinicians (average treatment effect, ATE: 7.3 scores/100, P = 0.026). Asynchronous E-learning has a significant impact on knowledge among primary care workers (ATE: 10.9/100, P < 0.001), but not in clinicians or public health physicians. Traditional face-to-face training has no significant impact on all medical staff. Most of the learners (57.3%) agreed that they could apply what they learned to their practice. Qualitative data revealed that high quality content is the key facilitator of the behaviour change, while of learning content difficulty, relevancy, and hardware constraints are key barriers.

CONCLUSIONS

The effectiveness of E-learning in CME varies across different types of training formats, organizational environment, and target audience. Although clinicians and primary care workers improved their knowledge by E-learning activities, public health physicians didn't benefit from the interventions.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific

INTRODUCTION

Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established.

METHODS

Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters.

RESULTS

The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability.

CONCLUSIONS

The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

Radiation Oncologists' Views on Breast Radiation Therapy Guidelines: Utilizing an Online Q&A Platform to Assess Current Views on Whole-Breast Irradiation Therapy

INTRODUCTION

Poor adherence to the 2011 American Society for Radiation Oncology (ASTRO) evidence-based guideline on whole-breast irradiation (WBI) has been reported. We utilized theMednet to assess the views of the updated 2018 guideline among radiation oncologists (ROs).

METHODS

We identified 11 questions asked by community ROs on theMednet, a web-based platform, between October 27, 2014 and May 2, 2017 that were updated in the 2018 guideline. New answers provided by senior authors of the 2018 guideline, cited guidelines, and polls to survey ROs were disseminated in 3 theMednet's newsletters between March 16, 2018 and May 1, 2018. Any question with less than 60% consensus was resubmitted on October 9, 2019 and assessed on February 13, 2020.

RESULTS

A total of 792 ROs responded to the initial surveys. In each survey, the answer choice(s) that received the majority of the votes aligned with the 2018 guideline. The strongest consensus was for the use of hypofractionated (HF)-WBI regardless of histology (97%), followed by HF-WBI boost dose (92%), molecular subtype (90%), grade (88%), and concurrent use of trastuzumab (87%). The least consensus was for age at which HF-WBI should be offered with 53% of respondents, specifically 73% of academic ROs versus 47% of community ROs (P = .001), agreeing with the guideline. The re-submitted survey 19 months later showed 77% of 287 new respondents now agreed with the guideline regarding age.

CONCLUSION

The majority of ROs concur with the 2018 WBI guideline in theMednet surveys, with better agreement among academic ROs than community ROs for certain components of the guideline. Further research into the different practice patterns may optimize patient care.

Use of eHealth for HIV Medical Education: a Narrative Review

PURPOSE OF REVIEW

The complexity of HIV care and its expanding clinical workforce has created a need for new distance learning models to deliver medical education. We conducted a narrative review to assess the acceptability and effectiveness of recent eHealth HIV education interventions supporting HIV healthcare providers.

RECENT FINDINGS

Evidence from 24 articles revealed that synchronous (real time), asynchronous (any time), and hybrid (combination) models of eHealth education are feasible and acceptable. Only two interventions (one asynchronous, one hybrid) of 19 included in the review utilized a randomized controlled design. Some studies showed improvement in confidence and perceived quality of case management, but few studies were designed to demonstrate impact. Successful eHealth education interventions require a thorough understanding of the target community's capacity and needs. Both synchronous and asynchronous strategies appear acceptable and potentially effective, but more studies are needed to assess impact on knowledge and practices to determine the most effective delivery models.

[Impact of training on Motivational Interviewing (MI) for Family Physicians: Design and assessment of a Training Program (MOTIVA)]

Objetivo

Desarrollar un programa de formación en Entrevista Motivacional (EM) para Médicos de Familia y evaluar el impacto.

Diseño

Ensayo clínico multicéntrico a doble ciego y aleatorizado, con 2 ramas (experimental (GE) y control (GC)) de Médicos de Familia, con un seguimiento de 12 meses.

Emplazamiento

32 Centros de Atención Primaria.

Descripción de la muestra

54 médicos (GC = 28, GE = 26).

Intervenciones

Programa de formación MOTIVA en EM con un curso presencial inicial (16 h), seguido de actividades en línea durante 12 meses y reuniones presenciales (entrevistas basadas en problemas con feedback de expertos).

Medidas principales

las habilidades comunicativas en EM se evaluaron en base a videograbaciones (VG) con la escala EVEM 2.0, por parejas de revisores. Se analizaron 236 VG con pacientes estandarizados y 96 VG con pacientes reales.

Resultados

Los resultados promedio en la escala EVEM (hasta 56 puntos) al inicio del estudio fueron GE = 21,27 (IC 95% 15,8-26,7) y GC = 20,23 (IC95% 16,4-23,9) sin diferencias entre ambos grupos (p = 0,79). Después del curso, la puntuación GE aumentó en 13,89 puntos (P <0,001), promedio 35,16 (IC 95% 29,8-40,6). Las VG de pacientes reales en GE durante el periodo de 12 meses mantiene sus habilidades en EM con un promedio de 36,9 puntos (IC 95% 30,3-43,6) versus GC 15,9 puntos (IC 95% 9,8-22,0). Una vez finalizado el Programa de Formación MOTIVA, el GE mantiene las habilidades adquiridas: GE promedio final = 37.6 (IC 95% 33.2-41.1) versus GC = 24,3 (IC95% 19,0-29,2) (p <0,001).

Conclusiones

El Programa de Formación MOTIVA mejora significativamente las habilidades de entrevista motivacional, mejorando después de un curso presencial y actividades secuenciales de mantenimiento. La eficacia del programa ha sido probada en el tercer y cuarto escalón de la Pirámide de Miller.

A Novel Low-Cost Exoscopy Station for Training Neurosurgeons and Neurosurgery Trainees

BACKGROUND

The loss of stereopsis and the need for markedly enhanced hand-eye coordination are obstacles to overcome when performing exoscopic procedures, but both should improve with training. Our objectives were to describe an exoscopy training station and to compare time and performance of a given microsurgical technique among neurosurgery residents and junior neurosurgeons.

METHODS

We designed a low-cost exoscopy training station featuring a notebook computer, a webcam, and a light-emitting diode source. Surgeons and surgical trainees with no experience in exoscopy were enrolled and divided into 2 groups (trainees and controls). Performance and time in suture placement were evaluated by a skilled observer in both groups at baseline and 3 days later. Between evaluations, trainees completed an exoscopy training module.

RESULTS

There were 22 participants divided equally into 2 groups. At baseline, trainees had a greater percentage of proper sutures than controls (58% vs. 35%), but they were also slower (32 minutes vs. 25 minutes). On final evaluation, not only were trainees approximately 14 minutes faster than at baseline (P = 0,03), but also their successful suture rate had increased by 18% (final rate 76%, P = 0.02). Moreover, controls were faster compared with baseline by 6 minutes (P = 0.003), but their percentage of successful sutures did not increase (final rate 38%, P = 0.49). The change from baseline to final evaluation favored trainees for both outcomes (P = 0.03 and P = 0.02).

CONCLUSIONS

Using the exoscopy training station, the trainees were able to improve their time and performance of exoscopy compared with the controls.

Process evaluation of E-learning in continuing medical education: evidence from the China-Gates Foundation Tuberculosis Control Program

Background

E-learning is a growing phenomenon which provides a unique opportunity to address the challenges in continuing medical education (CME). The China-Gates Foundation Tuberculosis (TB) Control Program implemented online training for TB health workers in three provinces of China. We aim to evaluate the implementation of E-learning CME programs, analyse the barriers and facilitators during the implementation process, and to provide policy recommendations.

Methods

Routine monitoring data were collected through the project office from December 2017 to June 2019. In-depth interviews, focus group discussion with project management personnel, teachers, and trainees (n = 78), and staff survey (baseline n = 555, final n = 757) were conducted in selected pilot areas at the provincial, municipal, and county/district levels in the three project provinces (Zhejiang, Jilin, and Ningxia). Descriptive analysis of quantitative data summarized the participation, registration, and certification rates for training activities. Thematic approach was used for qualitative data analysis.

Results

By the end of June 2019, the national and provincial remote training platforms had organized 98 synchronous learning activities, with an average of 173.2 people [standard deviation (SD) = 49.8] per online training session, 163.3 people (SD = 41.2) per online case discussion. In the pilot area, 64.5% of TB health workforce registered the asynchronous learning platform, and 50.1% obtained their professional certifications. Participants agreed that E-learning CME was more economical, has better content as well as more flexible work schedules. However, the project still faced challenges in terms of unmet learning needs, disorganized governance, insufficient hardware and software, unsupported environment, and lack of incentive mechanisms.

Conclusions

Our results suggested that it’s feasible to conduct large scale E-learning CME activities in the three project provinces of China. Training content and format are key facilitators of the program implementation, while the matching of training supply and demand, organizational coordination, internet technology, motivations, and sustainability are key barriers.

Utility and perceptions about web-based academics among physicians during COVID-19 pandemic

Introduction:

Coronaviral disease-19 is the global challenge for medical fraternity and public health sector. Need of social distancing has compelled physicians and surgeons to continue medical education through virtual mode like webinar.

Objective:

To study the perceptions, practice and preferences of medical residents and professionals about webinar-based teaching.

Methods:

An internet-based google-sheet questionnaire was circulated via email and social media for opining different facts about webinar-based teaching. Responses were analysed further to find the facts and preferences.

Results:

Our study showed that majority of participants found webinars as a useful and sustainable mode of teaching however some of them felt it as an overdone action resulting in unnecessary stress.

Conclusion:

Teaching through virtual mode (e.g. webinar) is definitely a valuable tool for medical education especially during the need of social distancing. Its frequency, quantity, and quality should be monitored properly for the optimum outcome.

Challenges in multiple sclerosis care: Results from an international mixed-methods study

BACKGROUND

Disease-modifying treatment (DMT) selection for people with multiple sclerosis (MS) is challenging. Neurologists and advanced practice nurses (APNs) in MS care may be facing knowledge and confidence gaps when screening patients to initiate or switch between DMTs, assessing the safety of new DMTs and monitoring for adverse events. Healthcare providers are required to demonstrate enhanced patient communication skills, to share treatment decisions and assess treatment adherence. To better inform educational interventions, there is a need to better understand these challenges and uncover their causalities. We undertook an international study across seven countries to identify challenges for neurologists and APNs that may impact DMT choices and optimum care for people with MS (pwMS).

METHODS

This mixed methods study involved two concurrent data collection phases, a qualitative phase with semi-structured interviews and a quantitative phase using an online survey. Neurologists (n=333) and APNs (n=135) were recruited from Canada, France, Germany, Italy, Spain, United Kingdom and the United States. All participants had to have a minimum of two years' experience in the care of pwMS and be currently active in clinical practice.

RESULTS

A triangulated analysis of qualitative and quantitative data identified multiple challenges. For APNs, these mainly related to diagnosing MS, integrating new agents in their practice, sequential DMT selection, treatment monitoring and providing personalized care. Specifically, two-thirds of APNs reported no or basic knowledge of the 2017 McDonald criteria and over half reported a knowledge gap of new DMTs available (51%) and a skill gap when integrating them into practice (58%). APNs expressed a knowledge gap of treatment sequencing (46%) and a skill gap in making decisions about sequencing (62%). Forty-four percent of APNs reported a gap in their skills of integrating patient's goals into treatment recommendations. For neurologists, the main challenges included managing side effects, aligning care to their patient's personal goals and quality of life (QoL). Specifically, over a third of neurologists reported no or basic knowledge of the characteristics of treatment failure (35%), and 32% reported no or basic skills identifying treatment failure. Skills needed to integrate patient's individual goals into treatment recommendations were reported as none or low by 39% of neurologists. In addition, there were significant differences according to years of practice in the majority (9 out of 14) of confidence items with respect to discussing specific MS-related topics with patients. Significant differences between countries were also identified.

CONCLUSION

The complexity of diagnosing MS and the variety of available DMTs for pwMS lead to uncertainties, even among specialized healthcare professionals. These should be addressed through focused education and training to optimize care for pwMS.

Epistaxis first-aid management: a needs assessment among healthcare providers

Purpose

To perform a needs assessment of epistaxis first-aid measures practiced by family physicians and Emergency Department (ED) staff in London, Ontario, Canada.

Methods

Paper-based multiple-choice questionnaires were distributed to participants. Participant recruitment was conducted in two parts: 1) 28 Emergency Medicine (EM) attending physicians, 21 resident physicians training in the ED, and 26 ED nurses were surveyed while on duty in the ED; 2) 27 family physicians providing walk-in or urgent care and attending a continuing medical education (CME) event were also surveyed. Respondents were asked to identify where to apply compression to the nose and how patients should be positioned during acute epistaxis.

Results

Regarding where to apply compression, 19% of family physicians, 43% of EM physicians, 24% of residents, and 8% of ED nurses responded correctly. Regarding positioning, all groups responded similarly with 54–62% responding correctly. Twenty-one percent of emergency physicians, 19% of residents, 11% of family physicians, and 4% of nurses responded correctly to both questions.

Conclusions

Most family physicians, EM attending physicians, ED nurses, and residents could not correctly identify basic first-aid measures for acute epistaxis. This study identifies an area where knowledge is lacking and the potential for improvement in patient management and education.

Grapical Abstract

Toward competency based continuing professional development for practicing surgeons

BACKGROUND

There has been a recent call for formal competency assessments of practicing physicians and surgeons to form a framework of competency based continuing professional development (CBCPD).

METHODS

An email questionnaire was conducted regarding CBCPD. Responses were further used to inform development of semi-structured interviews.

RESULTS

There were 58 questionnaire respondents (42%). There was moderate support for assessment of surgeons' technical skills (50.9%) or decision making (56.6%). Support was highest for a mechanism to flag surgeons in need of a focused competence assessment (83.0%). Eight surgeons participated in interviews. Interviews identified a range of benefits of CBCPD but also several challenges to implementation, including the need for fair, data-driven assessments, taking into account patient outcomes.

CONCLUSIONS

Through listening to surgeon concerns and recommendations for implementation strategies, this study's findings may support development of an effective CBCPD strategy with the potential to be embraced by surgeons and foster an environment of improved safety and performance.

Non-oncologist Physician Knowledge of Radiation Therapy at an Urban Community Hospital

Radiation therapy (RT) is a crucial part of cancer care, but previous work suggests that many non-radiation oncologist physicians are uncomfortable referring for RT. To evaluate training and understanding of RT, the authors sent invitations to complete an online questionnaire to all physicians at a community hospital in Bronx, NY, which asked about oncology training and self-rated and objective knowledge of RT. Out of 247 invited participants, 87 responded (35%). Among responders, 19 were attending physicians (22%) and 66 (76%) were residents. Seventy-two percent of respondents reported caring for > 5 cancer patients in the past month, but 54% reported never referring patients for RT. Sixty-nine percent of respondents stated they received no radiation oncology training in medical school, and 36% reported no general oncology training. Approximately half believed themselves to be "somewhat knowledgeable" about RT indications (48%), benefits (53%), and side effects (55%). Objective assessment mean score was 6.2/12 (median 7) for all respondents; Respondents with internal medicine specialization scored higher than others (mean 7.7 vs 3.5; p < 0.01). Scores did not differ between attending and resident physicians, resident post-graduate levels, or receiving oncology training in medical school. The factors most commonly cited as affecting RT referral decisions were type of cancer, patient wishes, family wishes, poor functional status, and life expectancy. Many physicians are unaware of RT effectiveness or indications, which may affect referral patterns. Previous oncology training was not associated with higher knowledge scores.

Simulation educators in clinical work: the manager's perspective

PURPOSE

Information is scarce on healthcare managers' understanding of simulation educators' impact on clinical work. Therefore, the aim of this study was to explore healthcare managers' perceptions of the significance of clinically active simulation educators for the organisation.

DESIGN/METHODOLOGY/APPROACH

Healthcare managers were invited to be interviewed in a semi-structured manner. Inductive thematic analysis was used to identify and analyse patterns of notions describing the managers' perceptions of simulation educators' impact as co-workers on their healthcare organisations.

FINDINGS

The identified relevant themes for the healthcare unit were: (1) value for the manager, (2) value for the community and (3) boundaries. Simulation educators were perceived to be valuable gatekeepers of evidence-based knowledge and partners in leadership for educational issues. Their most prominent value for the community was establishing a reflective climate, facilitating open communication and thereby improving the efficacy of teamwork. Local tradition, economy, logistics and staffing of the unit during simulation training were suggested to have possible negative impacts on simulation educators' work.

PRACTICAL IMPLICATIONS

The findings might have implications for the implementation and support of simulation training programs.

SOCIAL IMPLICATIONS

Healthcare managers appreciated both the personal value of simulation educators and the effect of their work for their own unit. Local values were prioritised versus global. Simulation training was valued as an educational tool for continual professional development, although during the interviews, the managers did not indicate the importance of employment of pedagogically competent and experienced staff.

ORIGINALITY/VALUE

The study provided new insights about how simulation educators as team members affect clinical practice.

Developing a Web-Based Congress: The 2020 International Web-Based Neurosurgery Congress Method

BACKGROUND

Continuing medical education and continuing professional development have been affected by the ongoing 2019 novel coronavirus disease (COVID-19) pandemic. Therefore, we developed the 2020 International Web-Based Neurosurgery Congress (2020 IWBNC), which became the first successful virtual neurosurgical congress. The aim of this article was to describe the experience designing and organizing a web congress by the 2020 IWBNC method.

METHODS

The 2020 IWBNC was organized by the Center for Research and Training in Neurosurgery (Centro de Investigación y Entrenamiento en Neurocirugía [CIEN]) in a record time of 4 weeks. Eight committees were created and assigned a specific task. The event followed a strict protocol based on the double-room method, which consisted of 2 virtual rooms (A and B) hosted from 4 different physical locations to avoid lecture overlapping and connection drops. Quality and impact were measured by a videoconferencing platform and social media parameters as well as an audience perception survey.

RESULTS

High quality was achieved in academic standards, worldwide assistance, schedule adherence, and security. The 2020 IWBNC hosted 25 internationally renowned speakers and offered 30 top-of-the-line multidisciplinary conferences. There were 3096 participants from 125 countries, and 22,266 live-stream views were registered. No technical or cybersecurity-related issues occurred.

CONCLUSIONS

Web-based academic meetings will continue to be a helpful educational tool for continuing medical education and continuing professional development. The 2020 IWBNC double-room method represents an alternative design that may be replicated by the academic community planning web congresses and similar events.

Making it stick: use of active learning strategies in continuing medical education

BACKGROUND

Despite the known benefits of active learning (AL), the predominate educational format in higher education is the lecture. The reasons for slow adaptation of AL in medical education are not well understood. The purpose of this survey was to determine knowledge, usage, attitudes, and barriers to AL use in academic Continuing Medical Education (CME).

METHOD

A 20-item questionnaire was developed and sent with a link to an online questionnaire to the Society of Academic Continuing Medical Education (SACME) listserv of ~ 350 professionals representing academic medical centers, teaching hospitals, and medical specialty societies in the United States (U.S.) and Canada. Responses were collected with SurveyMonkey® from October-November, 2019. Data were analyzed using SPSS®.

RESULTS

Responses from 146 SACME members in 91 CME units yielded a ~ 42% survey response rate. Many respondents reported their self-perceived knowledge of AL as high. Advanced training (e.g., certificate, Master of Education degree) was positively correlated with AL knowledge. AL methods were reportedly used in half of the CME activities in the majority (80%) of institutions. Higher levels of self-perceived knowledge were correlated with an increased percentage of AL-related CME activities. Commonly perceived barriers to use of AL were presenters' lack of familiarity and a need for more time-consuming preparation.

CONCLUSIONS

More efforts are needed to increase innovation and incorporate evidence-based AL strategies in medical education, especially to foster learner engagement, critical thinking, and problem-solving ability.

Continuing Medical Education and Continuing Professional Development in the Republic of Armenia: The Evolution of Legislative and Regulatory Frameworks Post Transition

The collapse of the Soviet Union in 1991 left many ex-republics in a financial and administrative crisis for the ensuing two decades. Previously centralised processes like recertification of doctors and healthcare workers and continuing medical education fell by the wayside. Continuing medical education and continuing professional development in Armenia have evolved through multiple phases from Soviet, to immediate, mid and late-transitional post-Soviet periods, to current modernising efforts. This manuscript describes the phases of evolution of continuing medical education chronologically and details the legislative and regulatory framework surrounding each stage of development. Armenia is currently implementing a credit system of continuing medical education with the aim to introduce and adopt new and efficient approaches in this field. Continuing education credits fall into three categories: didactic or theoretical knowledge, practical skills and self-education/self-development. To recertify, professionals must collect credits from all three groups with specified minimum amounts according to their degrees. Armenia’s guiding principle is to harmonise the continuing medical education and professional development model with internationally accepted criteria in order to contribute to the international mobility of healthcare workers and to provide for true on-going professional development and knowledge that will benefit our doctors, nurses and above all our patients.

Chinese physician perceptions regarding industry support of continuing medical education programs: a cross-sectional survey

Background: Industry funding in continuing medical education has been extensively studied in the USA. Although continuing medical education is also a requirement for Chinese physicians, little is known about Chinese physician perceptions of industry support in continuing medical education.Objective: We aim to determine perceptions regarding industry support for CME among Chinese physicians at a large CME course, examine potential associations between Chinese physicians' perceptions and their demographic characteristics, and compare Chinese and US physicians' perceptions of industry support for CME.Design: We performed a cross-sectional survey of physicians at a nephrology continuing medical education conference in China. All participants received a previously published, anonymous survey consisting of 4 items, with questions asked in English and Mandarin Chinese. Responses were compared with those of a previous cohort in the USA.Results: The response rate was 24% (128/541). Most respondents were nephrologists (112/126, 89%), women (91/128, 71%), and aged 20 to 40 years (79/127, 62%). Most respondents preferred industry-supported continuing medical education (84/123, 68%) or had no preference (33/123, 27%). More clinicians than clinical researchers supported industry offsetting costs (76.9% vs 58.3%; P = .03). Almost half of participants (58/125, 46%) stated that industry-supported continuing medical education was biased in support of industry. Compared with US physicians, Chinese physicians were more likely to believe, or had no opinion, that industry-supported courses were biased (67.2% vs 47.0%; P < .001).Conclusions: Chinese continuing medical education participants preferred industry-sponsored continuing medical education and were strongly in favor of industry offsetting costs, but almost half believed that such education was biased in favor of supporting companies. Concern for bias was higher among Chinese than US physicians. Given participants' concerns, further study examining industry bias in Chinese continuing medical education is recommended.Abbreviations: CME: Continuing medical education; US: USA.

Development and randomized controlled trial evaluation of E-learning trainings for professionals

BACKGROUND

Child maltreatment and consequently child protection are highly relevant and current issues in our society. Medical institutions are widely regarded as places of healing, care and support. But they also hold risk factors to promote child maltreatment. Efforts have to be taken in order to offer help to victims by medical institutions and to reduce risk factors for child maltreatment. Therefore, health professionals in the field of child protection must be trained and sensitized for these two purposes. The Department of Child and Adolescent Psychiatry / Psychotherapy at the University Hospital of Ulm in Germany is developing E-Learning courses directed to health professionals in order to create flexible advanced training courses for dealing with child abuse, and to increase competences in child protection. Due to their specific role in (institutional) child protection, three courses and their evaluation will be presented in this article. The aim of the studies is to examine if those online-courses are increasing knowledge and skills in child protection and how satisfied participants are with course quality.

METHODS

Randomised Controlled Trials (RCT) were conducted with one wait-list control group and one group participating in the course (= intervention group). The RCTs took place from October 2016 to March 2017 for two courses, and from May 2017 to September 2017 for the other course. Data were analysed with mixed design ANOVA. For evaluation of user satisfaction, descriptive statistics are reported.

RESULTS

For all three courses, knowledge and practical capacities on the topic of the intervention group raised significantly in comparison to the values of the control group. Furthermore, participants of the course for managers felt better prepared to meet their responsibilities in regard to institutional child protection and came up with ideas on how to implement safeguarding standards in their institution. Overall, participants were very satisfied with the structure and the content of the courses.

CONCLUSIONS

The article shows that the online-courses are an effective and well-accepted approach to train professionals in topics regarding (institutional) child protection by contributing to the participants´ abilities to create medical facilities into a place of competence and protection.

Effect of Pause Procedures on Participant Reflection and Commitment-to-Change in Continuing Medical Education

Problem: Conferences are the most common form of continuing medical education (CME), but their effect on clinician practice is inconsistent. Reflection is a critical step in the process of practice change among clinicians and may lead to improved outcomes following conference-based CME. However, reflection requires time to process newly-learned material. Adequate time for reflection may be noticeably absent during many conference presentations. Intervention: The pause procedure is a 90-second 'pause' during a 30-minute presentation so learners can review and discuss content. The goal of the pause procedure is to stimulate learners' active engagement with newly learned material which will, in turn, promote learner reflection. Context: Fifty-six presentations at two hospital medicine CME conferences were assigned to the pause procedure or control. Study outcomes provided by conference participants were validated reflection scores and commitment-to-change (CTC) statements for each presentation. A post-hoc survey of the intervention group was conducted to assess presenters' experiences with the pause procedure. Impact: A total of 527 conference participants completed presentation evaluations (response rate 72.7%). Presentations incorporating the pause procedure failed to lead higher participant reflection scores (percentage 'top box' score; intervention: 39.2% vs. control: 41.7%, p = 0.40) or participant CTC rates (median [IQR]; intervention: 4.64 [3.04, 10.57] vs. control: 8.16 [5.28, 17.12], p = 0.13) than control presentations. However, the majority of presenters (16 out of 17 survey respondents) had never before used the intervention and little active engagement among learners was noted during the pause procedure. Lessons Learned: Adding the pause procedure to CME presentations did not lead to greater reflection or CTC among clinician learners. However, presenters had limited experience with the intervention, which may have reduced their fidelity to the educational principles of the pause procedure. Faculty development may be necessary when planning a new educational intervention that is to be implemented by conference presenters.

Continuing professional education for general practitioners on chronic obstructive pulmonary disease: feasibility of a blended learning approach in Bangladesh

Background

Continuing medical education (CME) is essential to developing and maintaining high quality primary care. Traditionally, CME is delivered face-to-face, but due to geographical distances, and pressure of work in Bangladesh, general practitioners (GPs) are unable to relocate for several days to attend training. Using chronic obstructive pulmonary disease (COPD) as an exemplar, we aimed to assess the feasibility of blended learning (combination of face-to-face and online) for GPs, and explore trainees’ and trainers’ perspectives towards the blended learning approach.

Methods

We used a mixed-methods design. We trained 49 GPs in two groups via blended (n = 25) and traditional face-to-face approach (n = 24) and assessed their post-course knowledge and skills. The COPD Physician Practice Assessment Questionnaire (COPD-PPAQ) was administered before and one-month post-course. Verbatim transcriptions of focus group discussions with 18 course attendees and interviews with three course trainers were translated into English and analysed thematically.

Results

Forty GPs completed the course (Blended: 19; Traditional: 21). The knowledge and skills post course, and the improvement in self-reported adherence to COPD guidelines was similar in both groups. Most participants preferred blended learning as it was more convenient than taking time out of their busy work life, and for many the online learning optimised the benefits of the subsequent face-to-face sessions. Suggested improvements included online interactivity with tutors, improved user friendliness of the e-learning platform, and timing face-to-face classes over weekends to avoid time-out of practice.

Conclusions

Quality improvement requires a multifaceted approach, but adequate knowledge and skills are core components. Blended learning is feasible and, with a few caveats, is an acceptable option to GPs in Bangladesh. This is timely, given that online learning with limited face-to-face contact is likely to become the norm in the on-going COVID-19 pandemic.

A national educational campaign to raise awareness of child physical abuse among health care professionals

Education is necessary to improve child physical abuse detection and management. A few studies have described national child abuse training programs, but none has measured changes in knowledge among participants. A collaboration of child abuse experts from the USA, an academic pediatric department, and a non-governmental organization in child protection aimed at (a) training hospital physicians in a train-the-trainer course for the detection and management of child physical abuse and (b) conducting workshops and measuring attendance and gain of knowledge of participants. A train-the-trainer and a national curriculum were created. A 78-item and a 20-item knowledge questionnaire were used pre and post the train-the-trainer course and all workshops, respectively. Nineteen physicians from all pediatric departments of the seven medical schools in Greece attended the course. Eight workshops in seven cities took place with a total attendance of 1220 health care professionals. Gain of knowledge was demonstrated for participants in the train-the-trainer course (p = 0.0015) and local workshops (p < 0.001).Conclusion: We successfully engaged physicians from all medical schools in Greece and conducted a train-the-trainer module and eight workshops in major cities that improved the participants' knowledge in child physical abuse. This approach may help address physician deficiencies in emerging areas of child abuse clinical practice. What is Known: • Education is necessary to improve child physical abuse detection and management. • Although national training programs have been described, none has measured participants' changes in knowledge. What is New: • A collaboration of child abuse experts, all medical schools in Greece, and a non-governmental organization resulted in a national educational campaign in child physical abuse and gains in knowledge for participants. • This approach may help address deficiencies in emerging areas of clinical practice.

Health professionals learning qualitative research in their workplace: a focused ethnography

BACKGROUND

The interest for qualitative research methodology has expanded beyond theoretical academic research on medical education, gathering interest from all healthcare professionals. Qualitative research has potentials in exploring the social, emotional, psychological aspects of care and in broadening professionals' scientific competencies. Nonetheless, qualitative research has still not been embraced within formal and academic curricula for future professionals, preventing newer generations from appreciating the value of its epistemological and methodological aspects and from using it in the development and implementation of clinical research. The purpose of this study was to comprehend the attitudes of health professionals learning and conducting qualitative studies within a practical training program developed in their workplace.

METHODS

The present work consisted of a focused ethnography, including 14 professionals during their one-year attendance training on qualitative research methodology. Strategies used for collecting data included participant observations, field notes, semi-structured interviews, and a focus group. All the data were analyzed consistently with ethnographic indications.

RESULTS

Analyses allowed us to evidence the educational, motivational, group-related and organizational factors influencing the attitudes and skill acquisition of healthcare professionals learning and conducting qualitative research within a practical training program developed in their workplace. Prior educational background was perceived as a sort of barrier. Nonetheless, the training boosted a change in attitude both in terms of appreciation of the research approach and trainees' emotional involvement with research participants. Doing a qualitative study in a multidisciplinary team raised in-group dynamics that hindered bringing the studies to conclusion. Trainees repeatedly lamented the difficulty in managing time to devote to research-related activities and questioned the feasibility of adopting this methodology for conducting research in their workplace.

CONCLUSIONS

Continual education training on the methodological aspects and practical implications of qualitative research may foster a renewed attitude towards one's professional education, while making inter-professional relationship issues emerge. Nonetheless, broadening the perspectives of professionals on their clinical practice by means of learning qualitative methodology may have an evident quality improvement return. Strategies for future qualitative research methodology hands-on training addressed to health professionals in continuing education are proposed.

The Technological Impact of COVID-19 on the Future of Education and Health Care Delivery

BACKGROUND

The unexpected COVID-19 crisis has disrupted medical education and patient care in unprecedented ways. Despite the challenges, the health-care system and patients have been both creative and resilient in finding robust "temporary" solutions to these challenges. It is not clear if some of these COVID-era transitional steps will be preserved in the future of medical education and telemedicine.

OBJECTIVES

The goal of this commentary is to address the sometimes substantial changes in medical education, continuing medical education (CME) activities, residency and fellowship programs, specialty society meetings, and telemedicine, and to consider the value of some of these profound shifts to "business as usual" in the health-care sector.

METHODS

This is a commentary is based on the limited available literature, online information, and the front-line experiences of the authors.

RESULTS

COVID-19 has clearly changed residency and fellowship programs by limiting the amount of hands-on time physicians could spend with patients. Accreditation Council for Graduate Medicine Education has endorsed certain policy changes to promote greater flexibility in programs but still rigorously upholds specific standards. Technological interventions such as telemedicine visits with patients, virtual meetings with colleagues, and online interviews have been introduced, and many trainees are "techno-omnivores" who are comfortable using a variety of technology platforms and techniques. Webinars and e-learning are gaining traction now, and their use, practicality, and cost-effectiveness may make them important in the post-COVID era. CME activities have migrated increasingly to virtual events and online programs, a trend that may also continue due to its practicality and cost-effectiveness. While many medical meetings of specialty societies have been postponed or cancelled altogether, technology allows for virtual meetings that may offer versatility and time-saving opportunities for busy clinicians. It may be that future medical meetings embrace a hybrid approach of blending digital with face-to-face experience. Telemedicine was already in place prior to the COVID-19 crisis but barriers are rapidly coming down to its widespread use and patients seem to embrace this, even as health-care systems navigate the complicated issues of cybersecurity and patient privacy. Regulatory guidance may be needed to develop safe, secure, and patient-friendly telehealth applications. Telemedicine has affected the prescribing of controlled substances in which online counseling, informed consent, and follow-up must be done in a virtual setting. For example, pill counts can be done in a video call and patients can still get questions answered about their pain therapy, although it is likely that after the crisis, prescribing controlled substances may revert to face-to-face visits.

LIMITATIONS

The health-care system finds itself in a very fluid situation at the time this was written and changes are still occurring and being assessed.

CONCLUSIONS

Many of the technological changes imposed so abruptly on the health-care system by the COVID-19 pandemic may be positive and it may be beneficial that some of these transitions be preserved or modified as we move forward. Clinicians must be objective in assessing these changes and retaining those changes that clearly improve health-care education and patient care as we enter the COVID era.

Evaluating Effectiveness of Online Learning Modules in Pediatric Environmental Health Education

OBJECTIVE

Content and training about pediatric environmental health are lacking in healthcare professionals' education. In an initiative to improve pediatric environmental health education, the Pediatric Environmental Health Specialty Unit (PEHSU) program offers free, interactive, web-based ("eLearning") modules on environmental health topics. The aim of this study is to determine the effectiveness of PEHSU eLearning modules in increasing knowledge about pediatric and reproductive environmental health.

METHODS

This is a retrospective analysis of 994 users who had completed at least one of the 12 PEHSU eLearning modules and its associated pre-test and post-test scores between March 2016 and November 2018. Users who completed modules between March 2016 and April 2018 received a 6-month follow-up survey to assess the impact of the knowledge gained on their clinical practice.

RESULTS

A wide range of clinical professionals and nonclinical professionals utilized and completed the PEHSU eLearning modules. For all users, post-test scores were significantly higher than pre-test scores, with an increase of 30.55% ± 22.37 (paired t-test, p < 0.0001), after completion of eLearning modules.

CONCLUSION

PEHSU eLearning modules are effective at increasing environmental health knowledge of clinical and nonclinical professionals. Further studies are needed to determine long-term knowledge retention and clinical impact.