A randomized trial of two e-learning strategies for teaching substance abuse management skills to physicians

The CKD-DETECT V2.0 study: A randomised controlled trial evaluating the effectiveness of an infographic poster compared with an e-learning program on general practice nurses' knowledge and learning efficiency about chronic kidney disease risk factors and best practice screening procedures

AIMS AND OBJECTIVES

To evaluate: (a) the effectiveness of an infographic poster compared with an e-learning program on general practice nurses' knowledge about chronic kidney disease risk factors and best practice screening procedures and (b) the effectiveness of an infographic poster compared with an e-learning program on general practice nurses' learning time and learning efficiency.

BACKGROUND

The screening and early detection of chronic kidney disease is essential in reducing its burden on the health system and those affected by it. General practice nurses are well-positioned to assist in its early detection.

DESIGN

Parallel-group, single-blinded, pre-post interventional randomised control design.

METHOD

This study was reported in accordance with the Consolidated Standards of Reporting Trials (CONSORT). Participants were registered or enrolled nurses working in general practice settings across Australia. The intervention group (n = 173) received an infographic poster about chronic kidney disease risk factors and best practice screening procedures, whereas the control group (n = 170) received an interactive e-learning program. Data were collected using an 8-item pre-post knowledge evaluation instrument. Time spent learning were collected through a self-reported log and a login/logout method.

RESULTS

The overall intervention effect demonstrated no statistical significance in knowledge scores from the baseline scores between the intervention and control group. The intervention group demonstrated higher learning efficiency in comparison to the control group.

CONCLUSION

The study demonstrated an infographic poster is as effective as an e-learning program on improving knowledge scores. However, in comparison to an e-learning program, an infographic poster is a more efficient way of learning.

RELEVANCE TO CLINICAL PRACTICE

Infographic posters can be an efficient educational modality to enhance healthcare professionals' knowledge and could be used as public health campaigns in clinical settings to educate the community.

Internet-Based Learning for Professionals in Addiction Psychiatry: A Scoping Review

BACKGROUND AND AIM

Distance learning techniques are gaining popularity as the internet today is a faster and more convenient source of spreading exhaustive information. We aim at conducting a scoping review on the utility of internet-based learning in addiction psychiatry.

METHODS

We performed a systematic search of databases such as Google Scholar, PubMed, and Cochrane using the following keywords: Distance education, substance related disorder, teaching, internet, along with the MeSH terms ("Internet" AND "Teaching" AND "Substance Related Disorders") OR ("Distance Education" AND "Substance Related Disorders"). The reference lists of articles were searched for other relevant literature.

RESULTS

A total of 34 studies were included. Most of the courses offered online were on specific therapies, for example, training on motivational interviewing, twelve-step facilitation, cognitive behavioral therapy, alcohol screening, and brief intervention. They were based on various aspects of distance learning such as the acquisition of knowledge or skills, feasibility, level of satisfaction of the trainees/students, the cost-effectiveness of the techniques, and the type of trainees who have access to the course. The majority of the studies showed positive findings in terms of the parameter being studied. However, the level of satisfaction among the students is questionable.

CONCLUSION

Internet-based teaching programs provide a good alternative to traditional educational methods in terms of effectiveness, feasibility, and acquisition of knowledge and skills. We emphasize the use of internet-based training in addiction psychiatry reinforced by actual practical experiences.

Speech-Language Pathology and Audiology in South Africa: Clinical Training and Service in the Era of COVID-19

INTRODUCTION AND PURPOSE

The novel coronavirus (COVID-19) presented new and unanticipated challenges to the provision of clinical services, from student training to the care of patients with speech-language and hearing (SLH) disorders. Prompt changes in information and communication technologies (ICT), were required to ensure that clinical training continued to meet the Health Professions Council of South Africa's regulations and patients received effective clinical care. The purpose of this study was to investigate online clinical training and supervision to inform current and future training and clinical care provision in SLH professions.

METHODOLOGY

A scoping review was conducted using the Arksey and O'Malley (2005) framework. The electronic bibliographic databases Science Direct, PubMed, Scopus, MEDLINE, and ProQuest were searched to identify publications about online clinical training and supervision and their impact on clinical service during COVID-19. Selection and analysis were performed by three independent reviewers using pretested forms.

RESULTS AND CONCLUSIONS

The findings revealed important benefits of teletraining and telepractice with potential application to South African clinical training and service provision. Five themes emerged: (1) practice produces favorable outcomes, (2) appreciation for hybrid models of training and service delivery, (3) cost effectiveness is a "big win" (4) internationalization of remote clinical training and service provision, and (5) comparable modality outcomes. These findings may have significant implications for teletraining and telepractice in low-and-middle income countries (LMICs) in the COVID-19 era and beyond, wherein demand versus capacity challenges (e.g., in human resources) persist. Current findings highlight the need for SLH training programmes to foster a hybrid clinical training model. Few studies were conducted in LMICs, indicating a gap in such research.

A systematic review of stigma interventions for providers who treat patients with substance use disorders

BACKGROUND

Stigma surrounding substance use disorders (SUDs) is a frequently cited barrier to treatment engagement. Research consistently demonstrates that healthcare professionals' attitudes towards patients with addiction problems are often negative and may adversely impact service delivery. The current study presents a systematic review of stigma interventions for providers who treat patients with SUDs, in order to evaluate the quality of existing studies and potential for implementation in clinical settings.

METHODS

This systematic literature review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Databases included PubMed, APA PsycInfo and the Cochrane Database of Systematic Reviews. Of the 1462 records identified between 2011 and 2019, 15 studies were eligible for inclusion. A narrative synthesis of stigma interventions summarized the change in stigmatizing attitudes held by providers.

RESULTS

Studies included heterogeneous and culturally diverse samples of providers (N = 1324), who varied by age, location, discipline, and experience, with the exception of primarily female providers (75%). Results delineated six types of provider stigma interventions with components including online education, in-person education, in-person contact with consumers in recovery, or some combination of these elements. The highest quality studies incorporated motivational interviewing or communication training interventions, and many interventions combined either in-person mentorship or contact with individuals in recovery. Positive effects on provider attitudes occurred at several levels of educational and consumer contact interventions. Interventions with consumer contact demonstrated long-term maintenance of attitudinal shifts. Despite significant methodological limitations and low-quality assessment ratings, several studies utilized real-world providers and patients, as well as practical, innovative, brief, and potentially cost-effective interventions, particularly in locations with limited technological resources.

CONCLUSIONS

Research on provider stigma interventions increased in recent years, indicating greater worldwide attention to the negative impact of stigma. While educational interventions alone can be helpful in attitudinal change, contact with individuals in recovery from SUDs is a vital component of provider stigma interventions, particularly for lasting effects. This review highlights the importance of including implementation outcomes, such as sustainability and cost-effectiveness, in the study of stigma interventions for providers of addiction treatment.

INteractive Virtual Expert-Led Skills Training: A Multi-Modal Curriculum for Medical Trainees

Background: Internationally, pediatric depression and suicide are significant issues. Additionally, in the context of the COVID-19 pandemic, pediatric mental health needs are rising astronomically. In light of Child & Adolescent Psychiatrist (CAP) subspecialist shortages in the United States (US), there is an increasing call for primary care physicians in Family Medicine and Pediatrics to address an increasingly broad variety of patient needs. Here we report on the development and preliminary evaluation of medical student and resident perceptions on the "INteractive Virtual Expert-led Skills Training" (INVEST) medical education curriculum, a virtual synchronous CAP curriculum employing active learning strategies, including expert-led discussion and video modeling, and discussion designed to meet those priorities. Methods: In a standardized 60-min training format, our curriculum leverages audience response system polling, video modeling of key clinical skills, and interactive discussion with an expert subspecialist, over a virtual video conferencing platform. The primary educational strategy relies on use of video modeling to demonstrate best practice with CAP led group discussion to solidify and explain important concepts. Five waves of medical students and residents (N = 149) participated in the INVEST curriculum and completed pre- and post-training surveys regarding knowledge and comfort in the management of pediatric patients with depression and suicidality. Results: Trainee participants reported significant positive gains in perceived likelihood of encountering pediatric suicidality as well as knowledge/comfort with depression screening and suicidality assessment in a primary care setting. Across some competency areas, there was an effect of medical learner level. Learners at lower levels generally reported the highest benefit. Medical students reported significant increases in their comfort interpreting and discussing positive depression screens and evidenced the greatest relative benefit in comfort with discussing suicidality. Conclusion: To our knowledge, INVEST is the first fully virtual, multimodal curriculum led by expert CAP subspecialists. Our findings suggest that INVEST shows promise for equipping medical learners with baseline knowledge for caring for patients with pediatric depression and suicidality. This synchronous, virtually delivered curriculum allows for critical training delivered to diverse medical learners regardless of geographic location, a particular benefit during the current COVID-19 pandemic.

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Background

Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education.

Objective

The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction.

Methods

We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models.

Results

A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI −0.17 to 0.39, I²=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I²=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence.

Conclusions

Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.

E-learning for health professionals

BACKGROUND

The use of e-learning, defined as any educational intervention mediated electronically via the Internet, has steadily increased among health professionals worldwide. Several studies have attempted to measure the effects of e-learning in medical practice, which has often been associated with large positive effects when compared to no intervention and with small positive effects when compared with traditional learning (without access to e-learning). However, results are not conclusive.

OBJECTIVES

To assess the effects of e-learning programmes versus traditional learning in licensed health professionals for improving patient outcomes or health professionals' behaviours, skills and knowledge.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, five other databases and three trial registers up to July 2016, without any restrictions based on language or status of publication. We examined the reference lists of the included studies and other relevant reviews. If necessary, we contacted the study authors to collect additional information on studies.

SELECTION CRITERIA

Randomised trials assessing the effectiveness of e-learning versus traditional learning for health professionals. We excluded non-randomised trials and trials involving undergraduate health professionals.

DATA COLLECTION AND ANALYSIS

Two authors independently selected studies, extracted data and assessed risk of bias. We graded the certainty of evidence for each outcome using the GRADE approach and standardised the outcome effects using relative risks (risk ratio (RR) or odds ratio (OR)) or standardised mean difference (SMD) when possible.

MAIN RESULTS

We included 16 randomised trials involving 5679 licensed health professionals (4759 mixed health professionals, 587 nurses, 300 doctors and 33 childcare health consultants).When compared with traditional learning at 12-month follow-up, low-certainty evidence suggests that e-learning may make little or no difference for the following patient outcomes: the proportion of patients with low-density lipoprotein (LDL) cholesterol of less than 100 mg/dL (adjusted difference 4.0%, 95% confidence interval (CI) -0.3 to 7.9, N = 6399 patients, 1 study) and the proportion with glycated haemoglobin level of less than 8% (adjusted difference 4.6%, 95% CI -1.5 to 9.8, 3114 patients, 1 study). At 3- to 12-month follow-up, low-certainty evidence indicates that e-learning may make little or no difference on the following behaviours in health professionals: screening for dyslipidaemia (OR 0.90, 95% CI 0.77 to 1.06, 6027 patients, 2 studies) and treatment for dyslipidaemia (OR 1.15, 95% CI 0.89 to 1.48, 5491 patients, 2 studies). It is uncertain whether e-learning improves or reduces health professionals' skills (2912 health professionals; 6 studies; very low-certainty evidence), and it may make little or no difference in health professionals' knowledge (3236 participants; 11 studies; low-certainty evidence).Due to the paucity of studies and data, we were unable to explore differences in effects across different subgroups. Owing to poor reporting, we were unable to collect sufficient information to complete a meaningful 'Risk of bias' assessment for most of the quality criteria. We evaluated the risk of bias as unclear for most studies, but we classified the largest trial as being at low risk of bias. Missing data represented a potential source of bias in several studies.

AUTHORS' CONCLUSIONS

When compared to traditional learning, e-learning may make little or no difference in patient outcomes or health professionals' behaviours, skills or knowledge. Even if e-learning could be more successful than traditional learning in particular medical education settings, general claims of it as inherently more effective than traditional learning may be misleading.

Appraising the role of the virtual patient for therapeutics health education

BACKGROUND

Face-to-face instruction, paper-based case-studies and clinical placements remain the most commonly used teaching methods for therapeutics curricula. Presenting clinical content in a didactic manner presents challenges in engaging learners and developing their clinical reasoning skills which may be overcome by inclusion of the virtual patient (VP). Currently there is limited literature examining the use of the VP in therapeutics teaching and learning. This review aimed to determine the role of VPs in therapeutics education, specifically the impact on student experiences, performance, and clinical skills.

METHODS

A search of primary literature was conducted with search terms including virtual patient, education, health, AND learning. Boolean operators were applied to include studies from health relevant fields with article titles and abstracts vetted.

RESULTS

Nine of the 21 included studies were control-matched, and all but one compared VPs to traditional teaching. VPs enhanced the learning experience in all 17 studies that measured this outcome. Fourteen studies measured performance and clinical skills and 12 found VPs were beneficial, while two did not. The VP was not superior to traditional teaching in all studies, but the VP appeared beneficial to the student learning experience. Discrepancy was found between the impact of VPs on short- and long-term knowledge.

IMPLICATIONS

The VP appears to enhance the student learning experience and has a role in therapeutics education, however a blended-learning (BL) approach may be required to account for individual learning styles. Additional investigation is required to clarify the efficacy of the VP, particularly as a component of BL, on longer-term knowledge retention.

Evidence-Based Principles for Using Technology-Enhanced Learning in the Continuing Professional Development of Health Professionals

Increasingly, health professional training involves the use of educational technologies through what is broadly termed "Technology-Enhanced Learning" (TEL). TEL includes hardware, such as computers and mobile devices, and software, such as software applications (apps), learning management systems, and discussion boards. For many years, TEL has formed an integral part of health professional programs and is growing in acceptance, if not expectation, in postgraduate training and continuing education. TEL generally aims to be flexible, engaging, learner focused and interactive, and may involve collaboration and communication. It offers many benefits for learning and teaching, whether used on its own or in conjunction with face-to-face teaching through blended learning. The ubiquity of mobile devices in clinical settings means TEL is ideal for busy clinicians, both as learners and teachers. TEL enables participants to learn at a time and place that is convenient to them, so learners living in geographically dispersed locations can access standardized courses. To realize these potential benefits, we recommend that those developing TEL programs for health professionals take a systematic approach to planning, development, implementation, and evaluation. To that end, we propose 10 principles: clarify purpose and conduct a needs assessment; allocate adequate time and technology; incorporate proven approaches to improve learning; consider the need for a skills component; enable interaction between learners and with others; create different resources for different groups; pilot before implementing; incorporate measures to retain learners; provide opportunities for revision to aid retention; and evaluate learning outcomes, not just satisfaction.

Nephrologists as Educators: Clarifying Roles, Seizing Opportunities

Nephrologists play an important role in providing medical education in a variety of settings, including the medical school classroom, nephrology consult service, outpatient clinic, and dialysis unit. Therefore, nephrologists interact with a variety of learners. In this article the current state of published literature in medical education in nephrology is reviewed. Eight attending roles are identified of the nephrologist as a medical educator in the academic settings: inpatient internal medicine service, nephrology inpatient consult service, inpatient ESRD service, outpatient nephrology clinic, kidney transplantation, dialysis unit, classroom teacher, and research mentor. Defining each of these distinct settings could help to promote positive faculty development and encourage more rigorous education scholarship in nephrology.

A Virtual Emergency Telemedicine Serious Game in Medical Training: A Quantitative, Professional Feedback-Informed Evaluation Study

Background

Serious games involving virtual patients in medical education can provide a controlled setting within which players can learn in an engaging way, while avoiding the risks associated with real patients. Moreover, serious games align with medical students’ preferred learning styles. The Virtual Emergency TeleMedicine (VETM) game is a simulation-based game that was developed in collaboration with the mEducator Best Practice network in response to calls to integrate serious games in medical education and training. The VETM game makes use of data from an electrocardiogram to train practicing doctors, nurses, or medical students for problem-solving in real-life clinical scenarios through a telemedicine system and virtual patients. The study responds to two gaps: the limited number of games in emergency cardiology and the lack of evaluations by professionals.

Objective

The objective of this study is a quantitative, professional feedback-informed evaluation of one scenario of VETM, involving cardiovascular complications. The study has the following research question: “What are professionals’ perceptions of the potential of the Virtual Emergency Telemedicine game for training people involved in the assessment and management of emergency cases?”

Methods

The evaluation of the VETM game was conducted with 90 professional ambulance crew nursing personnel specializing in the assessment and management of emergency cases. After collaboratively trying out one VETM scenario, participants individually completed an evaluation of the game (36 questions on a 5-point Likert scale) and provided written and verbal comments. The instrument assessed six dimensions of the game: (1) user interface, (2) difficulty level, (3) feedback, (4) educational value, (5) user engagement, and (6) terminology. Data sources of the study were 90 questionnaires, including written comments from 51 participants, 24 interviews with 55 participants, and 379 log files of their interaction with the game.

Results

Overall, the results were positive in all dimensions of the game that were assessed as means ranged from 3.2 to 3.99 out of 5, with user engagement receiving the highest score (mean 3.99, SD 0.87). Users’ perceived difficulty level received the lowest score (mean 3.20, SD 0.65), a finding which agrees with the analysis of log files that showed a rather low success rate (20.6%). Even though professionals saw the educational value and usefulness of the tool for pre-hospital emergency training (mean 3.83, SD 1.05), they identified confusing features and provided input for improving them.

Conclusions

Overall, the results of the professional feedback-informed evaluation of the game provide a strong indication of its potential as an educational tool for emergency training. Professionals’ input will serve to improve the game. Further research will aim to validate VETM, in a randomized pre-test, post-test control group study to examine possible learning gains in participants’ problem-solving skills in treating a patient’s symptoms in an emergency situation.

Efficacy of an internet-based learning module and small-group debriefing on trainees' attitudes and communication skills toward patients with substance use disorders: results of a cluster randomized controlled trial

PURPOSE

To examine whether an Internet-based learning module and small-group debriefing can improve medical trainees' attitudes and communication skills toward patients with substance use disorders (SUDs).

METHOD

In 2011-2012, 129 internal and family medicine residents and 370 medical students at two medical schools participated in a cluster randomized controlled trial, which assessed the effect of adding a two-part intervention to the SUDs curricula. The intervention included a self-directed, media-rich Internet-based learning module and a small-group, faculty-led debriefing. Primary study outcomes were changes in self-assessed attitudes in the intervention group (I-group) compared with those in the control group (C-group) (i.e., a difference of differences). For residents, the authors used real-time, Web-based interviews of standardized patients to assess changes in communication skills. Statistical analyses, conducted separately for residents and students, included hierarchical linear modeling, adjusted for site, participant type, cluster, and individual scores at baseline.

RESULTS

The authors found no significant differences between the I- and C-groups in attitudes for residents or students at baseline. Compared with those in the C-group, residents, but not students, in the I-group had more positive attitudes toward treatment efficacy and self-efficacy at follow-up (P<.006). Likewise, compared with residents in the C-group, residents in the I-group received higher scores on screening and counseling skills during the standardized patient interview at follow-up (P=.0009).

CONCLUSIONS

This intervention produced improved attitudes and communication skills toward patients with SUDs among residents. Enhanced attitudes and skills may result in improved care for these patients.

Virtual patients as activities: exploring the research implications of an activity theoretical stance

Virtual patients are computer-based simulators of patient encounters for the purposes of instruction, practice, and assessment. Although virtual patients have been around for some time they have yet to become part of mainstream medical education. A major reason for this would seem to be a lack of clarity as to what educational value virtual patients actually have. This paper argues that virtual patients should be seen as activities rather than artifacts and that activity theory can be used to generate different ways to frame scholarship in and around virtual patients. Drawing on the work of Leont'ev and Engeström this paper describes a range of perspectives based on the operations, actions, and objectives in and around virtual patients; the use of virtual patients to mediate activities; and the sociocultural context and the participants in virtual patient activities. This approach allows us to move beyond the 'does or does not work' discourse of much of the existing scholarship around virtual patients and, to an extent, around educational technologies as a whole. Activity perspectives, and activity theory in particular, offer new horizons for research and evaluation that address many of the limitations of intervention-based paradigms of inquiry.

Computerized-Aid Medical Training

The application of new technologies in training environments allows the development of new teaching modalities that enable knowledge and ability acquisition in healthcare professionals. Simulation has proven to be an effective method to favor and improve learning as well as to attain the necessary skills to perform a specific technique with greater reliability and security for the patient. We present a new tool or technological development in medical training, through an ultrasound simulator, valid for the knowledge and necessary ability acquisition in the proper infiltration of botulinum toxin guided by ultrasound. This tool benefits from the advantages that new technologies bring when applied in medical training, offering a virtual setting, comfortable and accessible, that does not require the user to move or have access to an ultrasound machine, allowing ultrasound explorations without the existence of a real patient.