A global model for effective use and evaluation of e-learning in health

Capacity-Building Through Digital Approaches: Evaluating the Feasibility and Effectiveness of eLearning to Introduce Subcutaneous DMPA Self-Injection in Senegal and Uganda

Training health workers is one of the biggest challenges and cost drivers when introducing a new contraceptive method or service delivery innovation. PATH developed a digital training curriculum for family planning providers who are learning to offer subcutaneous DMPA (DMPA-SC), including through self-injection, as an option among a range of contraceptive methods. The DMPA-SC eLearning course for health workers includes 10 lessons with an emphasis on informed choice counseling and training clients to self-inject. In partnership with Ministries of Health in Senegal and Uganda, the course was rolled out in select areas in 2019-2020, including during the COVID-19 pandemic when physical distancing requirements restricted in-person training. We conducted evaluations in both countries to assess the practical application of this digital training approach for contraceptive introduction. The evaluation consisted of a post-training survey, an observational assessment conducted during post-training supportive supervision, and an estimation of training costs.In both countries, a majority (88.6% in Uganda and 64.3% in Senegal) scored above 80% on a DMPA-SC knowledge test following the training. In Senegal, where there was a comparison group of providers trained in person, those providers scored similar on the post-test to eLearners. Providers in both groups and in both countries felt more prepared to administer DMPA-SC or offer self-injection to clients after receiving a supervision visit (93%-98% of eLearners felt very prepared after supervision as compared to 45%-72% prior). The evaluation results suggest that digital approaches offer a number of benefits, can be cost-effective, and are most optimal when blended with in-person training and/or supportive supervision.

Scaling up! Staff e-learning for a national take-home naloxone program

Background

A staff e-learning course was developed to prepare for scaling up a national take-home naloxone (THN) program in Norway. The aims of the study were to (a) describe participant characteristics for those that completed a THN e-learning course, (b) compare opioid overdose knowledge scores before and after e-learning course completion, and (c) to explore subsequent THN distribution by those trained.

Methods

This was a quasi-experimental pre-test, post-test longitudinal cohort study of individuals completing a THN e-learning course from April 2021 to May 2022. Frequency analyses were performed for participant characteristics and subsequent naloxone distributions at 1-week and 1-month follow-up. The opioid overdose knowledge scale (OOKS) was used to measure pre-test-post-test knowledge among participants. Wilcoxon signed-rank test was performed for comparison between pre-test and post-test. Effect size was calculated using Cohen criteria.

Results

In total, 371 individuals were included in this study. Most were either nurses or social workers (n = 277, 75%). Participant knowledge increased by medium or large effect for all items measured. At 1-month follow-up, 15% reported naloxone distribution. During the study period, 94 naloxone kits were distributed. Major reasons for not distributing were "clients not interested", "workplace not distributing" and "workplace in process of distributing".

Conclusions

Our findings suggest that an e-learning course is equally effective in terms of knowledge transfer as an in-person classroom setting, and may provide engagement in terms of naloxone distribution. However, our findings also emphasize the importance of clear implementation routines, including support from central coordinators to optimize the implementation process.

Optimizing e-Learning in CPD: Preferences and Perceptions of Health Professionals

INTRODUCTION

Continuing professional development for health professionals increasingly relies on e-learning. However, there is insufficient research into the instructional strategies health professionals prefer to engage with in e-learning. An empirical study was undertaken to answer the research question: What instructional strategies do learners prefer in e-learning modules to improve their learning experience?

METHODS

The Department of Health Professions Education at the Uniformed Services University of Health Sciences developed six, stand-alone, self-paced modules for health professionals focusing on education and leadership. The module evaluation survey consisted of six Likert scale questions and two open-ended questions. Responses from these anonymized module evaluations from 2019 to 2022 were analyzed. Descriptive statistics for the Likert scale questions were calculated. Responses to the two open-ended questions were compiled and analyzed thematically.

RESULTS

All survey respondents found the content of the modules helpful and met their stated learning objectives. A majority (94%) agreed or strongly agreed that readings and videos increased their knowledge in the topic area and that quizzes effectively strengthened their understanding of the topics. Four themes emerged from the qualitative data: pedagogical strategies, technology issues, feedback and interaction, and transfer of learning.

CONCLUSIONS

This study foregrounds the voice of the learner, which emphasizes health professionals' preference for instructional strategies that align with their needs as adult learners. The findings highlight the value of content relevance, expert creation, and authentic examples in enhancing learner satisfaction.

Learning Outcomes of e-Learning in Psychotherapy Training and Comparison With Conventional Training Methods: Systematic Review

BACKGROUND

Mental disorders pose a major public health problem in most western countries. The demand for services for common mental health disorders has been on the rise despite the widespread accessibility of medication. Especially, the supply and demand for evidence-based psychotherapy do not align. Large-scale increase of modern psychotherapy is difficult with current methods of training which are often expensive, time consuming, and dependent on a small number of top-level professionals as trainers. E-learning has been proposed to enhance psychotherapy training accessibility, quality, and scalability.

OBJECTIVE

This systematic review aims to provide an overview of the current evidence regarding e-learning in psychotherapy training. In particular, the review examines the usability, acceptability, and learning outcomes associated with e-learning. Learning outcomes are assessed in different modalities including trainee experiences, knowledge acquisition, skill acquisition, and application of trained content in daily practice. Furthermore, the equivalence of web-based training and conventional training methods is evaluated.

METHODS

Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a search from Ovid, MEDLINE, PsycINFO, and Scopus databases between 2008 and June 2022 was conducted. Inclusion criteria required studies to describe e-learning systems for psychotherapy training and assess acceptability, feasibility, or learning outcomes. The risk of bias was evaluated for both randomized and nonrandomized studies. Learning outcomes were categorized using the Kirkpatrick model. Effect sizes comparing e-learning and traditional methods were calculated.

RESULTS

The search yielded 3380 publications, of which 34 fulfilled the inclusion criteria. Positive learning outcomes are generally associated with various e-learning programs in psychotherapy training including trainee satisfaction, knowledge, and skill acquisition, and in application of trained content in clinical practice. Learning outcomes generally show equivalence between e-learning and conventional training methods. The overall effect size, indicating this disparity, was 0.01, suggesting no significant difference. This literature displays a high level of heterogeneity in e-learning solutions and assessment methods.

CONCLUSIONS

e-Learning seems to have good potential to enhance psychotherapy training by increasing access, scalability, and cost-effectiveness while maintaining quality in terms of learning outcomes. Results are congruent with findings related to e-learning in health education in general where e-learning as a pedagogy is linked to an opportunity to carry out learner-centric practices. Recommendations for conducting psychotherapy training programs in blended settings supported by activating learning methods are presented. However, due to the heterogeneity and limitations in the existing literature, further research is necessary to replicate these findings and to establish global standards for e-learning, as well as for the assessment of training outcomes in psychotherapy education. Research is especially needed on the effects of training on patient outcomes and optimal ways to combine e-learning and conventional training methods in blended learning settings.

The co-development and evaluation of an e-learning course on spinal cord injury physical activity counselling: a randomized controlled trial

BACKGROUND

Health, fitness and lifestyle professionals can play important roles in promoting physical activity in groups at risk of developing an inactive lifestyle, such as people with spinal cord injury (SCI). Tailored counselling is a promising tool to promote and improve physical activity levels. To support professionals to effectively have a conversation about physical activity with clients with SCI, evidence-based training and resources are needed. This project aimed to (1) co-develop an e-learning course on best practices for SCI physical activity counselling and, (2) examine the effectiveness and usability of this course.

METHODS

Guided by the technology-enhanced learning (TEL) evaluation framework, we used a systematic, multistep approach to co-develop and evaluate an e-learning course. The development process was informed by input and feedback from a diverse group of end-users and experts (n > 160) via online surveys and (think-aloud) interviews. A randomized controlled trial was used to compare learning outcomes (post-knowledge and self-efficacy) between participants who completed the course (intervention group) and the wait-listed control group. Usability, learning experiences, and satisfaction were assessed among all participants.

RESULTS

Forty-one participants (21 intervention-group; 20 control-group) with various backgrounds (e.g., lifestyle counsellors, physiotherapists, occupational therapists, recreation therapists, fitness trainers) enrolled in the randomized controlled trial. After completing the course, participants in the intervention group showed significantly improved knowledge on the best practices for SCI physical activity counselling and higher self-efficacy for using these best practices in conversations with clients with SCI compared to the control group (p <.001). Participants reported above average usability scores, positive learning experiences, and high levels of satisfaction when completing the course.

CONCLUSION

We used a systematic, multi-step, theory-informed approach to co-develop and evaluate an evidence-based e-learning course on SCI physical activity counselling to support professionals to promote physical activity in their daily practices. The overall positive findings demonstrate that the e-learning course is feasible and ready for further implementation in various health and community settings. Implementation of the e-learning course can help professionals improve the physical activity support they provide to their clients, and subsequently increase physical activity participation in people with SCI.

Mobile Application Increased Nutrition Knowledge Among Brazilian Physicians

OBJECTIVE

To assess whether using a Dietary Approaches to Stop Hypertension (DASH) diet recommendation application increases primary care physicians' knowledge and dietary counseling skills.

DESIGN

A randomized controlled trial.

SETTING

Brazilian public primary care service.

PARTICIPANTS

Two hundred and twenty-two physicians (intervention group: n = 111; control group: n = 111).

INTERVENTION

Thirty days of using the Dieta Dash application. The application provides information about nutritional recommendations for hypertension management.

MAIN OUTCOME MEASURES

Nutrition knowledge score.

SECONDARY OUTCOMES

self-assessment of knowledge, self-confidence, assessment of eating habits, and barriers to dietary counseling.

ANALYSIS

Linear mixed-effects models for repeated measures and generalized estimating equations for comparing changes between groups.

RESULTS

A total of 66.2% of participants completed the follow-up. There was no significant difference between the groups regarding the mean knowledge score (P = 0.15). The prevalence of high knowledge increased by 12% (prevalence ratio [PR] = 1.12; 95% confidence interval [CI], 1.00-1.25) in the intervention group and showed an improvement in the self-confidence assessment (PR = 1.21; 95% CI, 1.02-1.44), and increased assessment of eating habits (PR = 1.26; 95% CI, 1.10-1.55).

CONCLUSIONS AND IMPLICATIONS

The Dieta Dash application helped address dietary counseling, improving knowledge and self-confidence. However, innovative strategies are needed to minimize the primary care barriers.

Japanese nurses' confidence in their understanding of telenursing via e-learning: A mixed-methods study

Objective

Telenursing e-learning courses have been shown to enhance nurses' skills and knowledge; however, the subjective learning experience is unclear. In this study, we identified meta-inferences to quantitatively and qualitatively understand this experience, as well as the types of knowledge gained through an e-learning course and how they are linked to each other, in order to enhance nurses' confidence in their understanding of telenursing.

Methods

We employed a single-arm intervention with a mixed-methods convergent parallel design. We converged participants' self-reported pre- and post-course confidence scores with their reflections on the learning experience, which were reported qualitatively as improved or unimproved. A total of 143 Japanese nurses with a mean of 20 years of nursing experience participated in this study.

Results

Among the participants, 72.7% demonstrated improved confidence in their understanding of telenursing after completing the e-learning course. The baseline confidence score was originally higher in the group that reported unimproved confidence (p < .001). Although there was no statistical difference in the usability and practicality scores between the two groups, the qualitative learning experience in these aspects differed in terms of the depth of knowledge of telenursing obtained.

Conclusions

Nurses' quantitative confidence in their understanding of telenursing after course completion was incongruent with their qualitative perspectives of the learning experience. Nursing educators, healthcare policymakers, and other stakeholders should consider that learners' overconfidence in their understanding of telenursing and comprehension of e-learning materials may result in their failure to develop key telenursing competencies, skills, and knowledge.

e-Learning Evaluation Framework and Tools for Global Health and Public Health Education: Protocol for a Scoping Review

BACKGROUND

There has been a significant increase in the use of e-learning for global and public health education recently, especially following the COVID-19 pandemic. e-Learning holds the potential to offer equal opportunities, overcoming barriers like physical limitations and training costs. However, its effectiveness remains debated, with institutions unprepared for the sudden shift during the pandemic. To effectively evaluate the outcomes of e-learning, a standardized and rigorous approach is necessary. However, the existing literature on this subject often lacks standardized assessment tools and theoretical foundations, leading to ambiguity in the evaluation process. Consequently, it becomes imperative to identify a clear theoretical foundation and practical approach for evaluating global and public health e-learning outcomes.

OBJECTIVE

This protocol for a scoping review aims to map the state of e-learning evaluation in global and public health education to determine the existing theoretical evaluation frameworks, methods, tools, and domains and the gaps in research and practice.

METHODS

The scoping review will be conducted following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. The initial search was performed in PubMed, Education Resource Information Center, Web of Science, and Scopus to identify peer-reviewed articles that report on the use of evaluation and assessment for e-learning training. The search strings combined the concepts of e-learning, public health, and health science education, along with evaluation and frameworks. After the initial search, a screening process will be carried out to determine the relevance of the identified studies to the research question. Data related to the characteristics of the included studies, the characteristics of the e-learning technology used in the studies, and the study outcomes will be extracted from the eligible articles. The extracted data will then undergo a structured, descriptive, quantitative, and qualitative content analysis to synthesize the information from the selected studies.

RESULTS

 Initial database searches yielded a total of 980 results. Duplicates have been removed, and title and abstract screening of the 805 remaining extracted articles are underway. Quantitative and qualitative findings from the reviewed articles will be presented to answer the study objective.

CONCLUSIONS

This scoping review will provide global and public health educators with a comprehensive overview of the current state of e-learning evaluation. By identifying existing e-learning frameworks and tools, the findings will offer valuable guidance for further advancements in global and public health e-learning evaluation. The study will also enable the creation of a comprehensive, evidence-based e-learning evaluation framework and tools, which will improve the quality and accountability of global health and public health education. Ultimately, this will contribute to better health outcomes.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/49955.

The Effects of an E-learning Module on Medical Trainees Rotating on a Perioperative Medicine Clinical Service

Introduction

Dedicated perioperative care can be cost-effective and improve patient outcomes. Training future physicians to practice perioperative medicine is an important responsibility of medical educators. An e-learning module delivered asynchronously during clinical rotations in perioperative medicine may help to better satisfy this responsibility.

Method

Articulate software was used to create an interactive, 1-hour e-module based on six educational objectives. The e-module was offered as an elective self-directed learning experience to trainees on perioperative medicine clinical rotations, including third- and fourth-year medical students as well as residents from internal medicine, anesthesiology, neurology, and physical medicine and rehabilitation training programs. We assessed the effectiveness of this learning strategy as a complement to real-time clinical experiences by measuring the knowledge, confidence, and satisfaction of trainees before and after completion of the e-module.

Results

Of 113 trainees invited to participate, 75 completed the module and were included in our analysis. Knowledge scores improved for student (p < .001), intern (p < .001), and resident (p < .001) subgroups. Confidence ratings also improved for student (p < .001), intern (p < .001), and resident (p < .001) subgroups. Trainees reported high satisfaction with the e-module, and 60 (87%) reported that it would alter their practice.

Discussion

An e-module presenting evidence-based, interactive education to trainees during clinical rotations in perioperative medicine was an effective learning strategy. Sharing e-learning tools across institutions may help to deliver standardized education on core clinical topics, including perioperative medicine.

Examining the Effectiveness of an E-Learning Training Course for Coaches of a Type 2 Diabetes Prevention Program

Small Steps for Big Changes (SSBC) is a community-based diabetes prevention program (DPP). SSBC utilizes a motivational interviewing (MI) informed counseling style to deliver a structured diet and exercise curriculum to empower healthy behavioral modifications and prevent type 2 diabetes (T2D). An electronic learning (e-learning) platform to train SSBC coaches was developed to improve flexibility, reach, and accessibility. While e-learning has shown to be an effective mode of teaching content to health professionals, less is known in the context of DPP coaches. This study aimed to assess the effectiveness of the SSBC e-learning course. Twenty coaches (eleven fitness staff personnel and nine university students) were recruited through existing fitness facilities to participate in the online SSBC coach training which included completing pre- and post-training questionnaires, seven online modules of content and a mock client session. Knowledge regarding MI (Mpre = 3.30 ± 1.95, Mpost = 5.90 ± 1.29; p < 0.01), SSBC content (Mpre = 5.15 ± 2.23, Mpost = 8.60 ± 0.94; p < 0.01), and T2D (Mpre = 6.95 ± 1.57, Mpost = 8.25 ± 0.72; p < 0.01), and self-efficacy to deliver the program (Mpre = 7.93 ± 1.51, Mpost = 9.01 ± 1.00; p < 0.01) all significantly increased from pre- to post e-learning training. Participants reported positively on the user satisfaction and feedback questionnaire with a mean score of 4.58/5 (SD = 0.36). These findings suggest e-learning platforms are a promising mode to improve DPP coaches' knowledge, counseling skills, and to bolster confidence in program delivery with high levels of satisfaction. E-learning to train DPP coaches allows for effective and feasible expansion of DPP's, ultimately permitting more reach to adults living with prediabetes.

Supplementary Information

The online version contains supplementary material available at 10.1007/s41347-023-00316-3.

Evaluation of a continuing professional development strategy on COVID-19 for 10 000 health workers in Ghana: a two-pronged approach

BACKGROUND

COVID-19 has created unprecedented challenges for health systems worldwide. Since the confirmation of the first COVID-19 case in Ghana in March 2020 Ghanian health workers have reported fear, stress, and low perceived preparedness to respond to COVID-19, with those who had not received adequate training at highest risk. Accordingly, the Paediatric Nursing Education Partnership COVID-19 Response project designed, implemented, and evaluated four open-access continuing professional development courses related to the pandemic, delivered through a two-pronged approach: e-learning and in-person.

METHODS

This manuscript presents an evaluation of the project's implementation and outcomes using data for a subset of Ghanaian health workers (n = 9966) who have taken the courses. Two questions were answered: first, the extent to which the design and implementation of this two-pronged strategy was successful and, second, outcomes associated with strengthening the capacity of health workers to respond to COVID-19. The methodology involved quantitative and qualitative survey data analysis and ongoing stakeholder consultation to interpret the results.

RESULTS

Judged against the success criteria (reach, relevance, and efficiency) the implementation of the strategy was successful. The e-learning component reached 9250 health workers in 6 months. The in-person component took considerably more resources than e-learning but provided hands-on learning to 716 health workers who were more likely to experience barriers to accessing e-learning due to challenges around internet connectivity, or institutional capacity to offer training. After taking the courses, health workers' capacities (addressing misinformation, supporting individuals experiencing effects of the virus, recommending the vaccine, course-specific knowledge, and comfort with e-learning) improved. The effect size, however, varied depending on the course and the variable measured. Overall, participants were satisfied with the courses and found them relevant to their well-being and profession. An area for improvement was refining the content-to-delivery time ratio of the in-person course. Unstable internet connectivity and the high upfront cost of data to access and complete the course online were identified as barriers to e-learning.

CONCLUSIONS

A two-pronged delivery approach leveraged distinct strengths of respective e-learning and in-person strategies to contribute to a successful continuing professional development initiative in the context of COVID-19.

Considerations for Appropriateness of Virtual Learning in the Postpandemic Environment

BACKGROUND

During the coronavirus disease 2019 (COVID-19) pandemic, health professions educators who traditionally used a face-to-face mode to deliver education transitioned to virtual formats. With the widespread use of vaccines, restrictions on social distancing requirements have waned. Some educators have reverted to a face-to-face modality, whereas others have maintained a virtual modality.

METHOD

A framework was developed to evaluate the suitability of curricular elements to be presented in a virtual platform to guide educators in modality decision making.

RESULTS

Learner motivation, context and content compatibility, social learning community requirements, and technological infrastructure should be considered when planning future curricula delivery.

CONCLUSION

The virtual learning environment must be compatible with content and context. Appropriate technology infrastructure, which includes institutional support, virtual learning platform, and technological support, also must be in place. Hybrid modalities that divide content into face-to-face and virtual components can be used to ease demands on logistics and technology infrastructure limitations. [J Nurs Educ. 2022;61(9):503-509.].

Association between perceived self-confidence and abilities to distinguish oral mucosal lesions amongst dental students

INTRODUCTION

Dentists usually refer to difficulties in performing the diagnosis of oral mucosal lesions. This may be attributed to limited access to theoretical lectures and practical training on this subject along the graduation course. The primary aim of this cross-sectional study was to verify if there is an association between the perception of time dedicated to lectures/training and oral diagnosis abilities in oral medicine. The secondary aim was to evaluate the association between self--confidence to perform oral mucosal lesions diagnosis and performance in a diagnostic abilities test.

MATERIALS AND METHODS

The sample comprised 36 final-year dental students of a South-Brazilian dental school. The participants answered a questionnaire on their perception of time dedicated to lectures on oral medicine along the course (sufficient or insufficient) and their self-confidence to diagnose oral mucosal lesions or oral cancer (yes or not). The students were also submitted to a diagnostic abilities test based on 30 clinical photos of oral lesions, which should be classified as benign, potentially malignant or malignant. Moreover, the participants had to inform their clinical impression for each case. Finally, the participants informed their decision making for the case (refer the patient to a specialist or not).

RESULTS

Students with higher self-confidence showed a higher percentage of correct answers on classification of the nature of lesions (81.1% vs. 68.5%, p = .03, teste t de Student) and on their clinical impression (66.3% vs. 41.7%, p < .01, Student's t-test). The perception of time dedicated to theoretical lectures on oral medicine as sufficient did not influence the students' diagnostic abilities (p > .05, Student's t-test) CONCLUSION: It may be concluded that self-confidence to diagnose oral lesions is associated with dental students' diagnostic abilities.

Barriers and facilitators to adoption of e-learning in higher education institutions of Pakistan during COVID-19: perspectives from an emerging economy

Purpose

Integrating e-learning into higher education institutions (HEIs) is a complex process. Several universities had tried to impart learning online, especially amid the spread of COVID-19. However, they failed miserably due to the many barriers to online learning platforms’ delivery and acceptance. This study aims to explore the barriers and facilitators in adopting e-learning in HEIs of Pakistan by taking the perspective of key stakeholders involved in the management and administration of HEIs.

Design/methodology/approach

The authors recruited participants using purposive and snowball sampling. Interviews were conducted from a variety of participants, including academicians, administrators and information technology (IT) personnel. Data recorded was transcribed into verbatim and then analyzed using thematic analysis.

Findings

The analysis identified barriers and facilitators to the e-learning implementation. Barriers included lack of resources and training, lack of infrastructure, inadequate e-learning policies, absence of positive mindset among teachers and students and reservations and concerns about e-learning of parents and teachers. By contrast, facilitators included prior training and awareness (provided by HEIs regarding e-learning), the assistance of government and regulatory bodies (in terms of policy and training on e-learning), the role of IT (in development and implementation of online learning system) and good computer knowledge and skills of students and faculty. Moreover, respondents believed that teaching subjects online requires the availability of proper and complete gadgets, but these were hardly available due to high demand. Finally, the academicians and administrators believed that e-learning is indispensable in health emergencies such as COVID-19 and similar events ahead.

Originality/value

For the HEIs to sustain and grow, the adoption of e-learning is fundamental. Therefore, the government should provide the essential infrastructure for the HEIs to deploy e-learning modules, train faculty and ensure the availability of necessary equipment (e.g. network) and gadgets to faculty and students. From a theoretical perspective, the study provides a framework for similar future studies in other emerging markets, whereas practical implications of the study can assist the governments and HEIs of emerging markets in implementing the e-learning modes of education in times of health emergencies, such as COVID-19.

Remote Consulting in Primary Health Care in Low- and Middle-Income Countries: Feasibility Study of an Online Training Program to Support Care Delivery During the COVID-19 Pandemic

Background

Despite acceleration of remote consulting throughout the COVID-19 pandemic, many health care professionals are practicing without training to offer teleconsultation to their patients. This is especially challenging in resource-poor countries, where the telephone has not previously been widely used for health care.

Objective

As the COVID-19 pandemic dawned, we designed a modular online training program for REmote Consulting in primary Health care (REaCH). To optimize upscaling of knowledge and skills, we employed a train-the-trainer approach, training health workers (tier 1) to cascade the training to others (tier 2) in their locality. We aimed to determine whether REaCH training was acceptable and feasible to health workers in rural Tanzania to support their health care delivery during the pandemic.

Methods

We developed and pretested the REaCH training program in July 2020 and created 8 key modules. The program was then taught remotely via Moodle and WhatsApp (Meta Platforms) to 12 tier 1 trainees and cascaded to 63 tier 2 trainees working in Tanzania’s rural Ulanga District (August-September 2020). We evaluated the program using a survey (informed by Kirkpatrick's model of evaluation) to capture trainee satisfaction with REaCH, the knowledge gained, and perceived behavior change; qualitative interviews to explore training experiences and views of remote consulting; and documentary analysis of emails, WhatsApp texts, and training reports generated through the program. Quantitative data were analyzed using descriptive statistics. Qualitative data were analyzed thematically. Findings were triangulated and integrated during interpretation.

Results

Of the 12 tier 1 trainees enrolled in the program, all completed the training; however, 2 (17%) encountered internet difficulties and failed to complete the evaluation. In addition, 1 (8%) opted out of the cascading process. Of the 63 tier 2 trainees, 61 (97%) completed the cascaded training. Of the 10 (83%) tier 1 trainees who completed the survey, 9 (90%) would recommend the program to others, reported receiving relevant skills and applying their learning to their daily work, demonstrating satisfaction, learning, and perceived behavior change. In qualitative interviews, tier 1 and 2 trainees identified several barriers to implementation of remote consulting, including lacking digital infrastructure, few resources, inflexible billing and record-keeping systems, and limited community awareness. The costs of data or airtime emerged as the greatest immediate barrier to supporting both the upscaling of REaCH training and subsequently the delivery of safe and trustworthy remote health care.

Conclusions

The REaCH training program is feasible, acceptable, and effective in changing trainees’ behavior. However, government and organizational support is required to facilitate the expansion of the program and remote consulting in Tanzania and other low-resource settings.

Effectiveness of social giving on the engagement of pharmacy professionals with a computer-based education platform: a pilot randomized controlled trial

BACKGROUND

Computer-based education is gaining popularity in healthcare professional development education due to ease of distribution and flexibility. However, there are concerns regarding user engagement. This pilot study aims to: 1) assess the feasibility and acceptability of a social reward and the corresponding study design; and 2) to provide preliminary data on the impact of social reward on user engagement.

METHODS

A mixed method study combing a four-month pilot randomized controlled trial (RCT), surveys and interviews. The RCT was conducted using a computer-based education platform. Participants in the intervention group had access to a social reward feature, where they earned one meal for donation when completing a quiz with a passing score. Participants in the control group did not have access to this feature. Feasibility and acceptability of the social reward were assessed using surveys and telephone interviews. Feasibility of the RCT was assessed by participant recruitment and retention. User engagement was assessed by number of quizzes and modules completed.

RESULTS

A total of 30 pharmacy professionals were recruited with 15 users in each arm. Participants reported high acceptability of the intervention. The total number of quizzes completed by the intervention group was significantly higher compared to the control group (n = 267 quizzes Vs. n = 97 quizzes; p-value 0.023).

CONCLUSION

The study demonstrates the feasibility and acceptability of a web-based trial with pharmacy professionals and the social reward intervention. It also shows that the social reward can improve user engagement. A future definitive RCT will explore the sustainability of the intervention.

Global eHealth capacity: secondary analysis of WHO data on eHealth and implications for kidney care delivery in low-resource settings

OBJECTIVE

To describe the use of electronic health (eHealth) in support of health coverage for kidney care across International Society of Nephrology (ISN) regions.

DESIGN

Secondary analysis of WHO survey on eHealth as well as use of data from the World Bank, and Internet World Stats on global eHealth services.

SETTING

A web-based survey on the use of eHealth in support of universal health coverage.

PARTICIPANTS

125 WHO member states provided response.

PRIMARY OUTCOME MEASURES

Availability of eHealth services (eg, electronic health records, telehealth, etc) and governance frameworks (policies) for kidney care across ISN regions.

RESULTS

The survey conducted by the WHO received responses from 125 (64.4%) member states, representing 4.4 billion people globally. The number of mobile cellular subscriptions was <100% of the population in Africa, South Asia, North America and North East Asia; the percentage of internet users increased from 2015 to 2020 in all regions. Western Europe had the highest percentage of internet users in all the periods: 2015 (82.0%), 2019 (90.7%) and 2020 (93.9%); Africa had the least: 9.8%, 21.8% and 31.4%, respectively. The North East Asia region had the highest availability of national electronic health record system (75%) and electronic learning access in medical schools (100%), with the lowest in Africa (27% and 39%, respectively). Policies concerning governance aspects of eHealth (eg, privacy, liability, data sharing) were more widely available in high-income countries (55%-93%) than in low-income countries (0%-47%), while access to mobile health for treatment adherence was more available in low-income countries (21%) than in high-income countries (7%).

CONCLUSION

The penetration of eHealth services across ISN regions is suboptimal, particularly in low-income countries. Increasing utilisation of internet communication technologies provides an opportunity to improve access to kidney education and care globally, especially in low-income countries.

The characteristics of effective technology-enabled dementia education: a systematic review and mixed research synthesis

BACKGROUND

Dementia education is required to address gaps in dementia-specific knowledge among health and social care practitioners amidst increasing dementia prevalence. Harnessing technology for dementia education may remove obstacles to traditional education and empower large communities of learners. This systematic review aimed to establish the technological and pedagogical characteristics associated with effective technology-enabled dementia education for health and social care practitioners.

METHODS

MEDLINE, PubMed, Web of Science, CINAHL, Scopus, PsycINFO, ERIC and OVID Nursing Database were searched from January 2005 until February 2020. Quantitative, qualitative and mixed methods studies were eligible for inclusion. Study quality was assessed with the Mixed Methods Appraisal Tool. Quantitative evidence was categorised based on Kirkpatrick's Model. Qualitative data was synthesised thematically and integrated with quantitative findings before conclusions were drawn.

RESULTS

Twenty-one published papers were identified. Participants were acute, primary and long-term care practitioners, or were students in higher education. Most training was internet-based; CD-ROMs, simulations and tele-mentoring were also described. Technology-enabled dementia education was predominantly associated with positive effects on learning outcomes. Case-based instruction was the most frequently described instructional strategy and videos were common modes of information delivery. Qualitative themes emerged as existing strengths and experience; knowledge gaps and uncertainty; developing core competence and expertise; involving relevant others; and optimising feasibility.

DISCUSSION

Technology-enabled dementia education is likely to improve dementia knowledge, skills and attitudes among health and social care practitioners from multiple practice contexts. Confidence in the results from quantitative studies was undermined by multiple confounding factors that may be difficult to control in the educational research context. Convenience and flexibility are key benefits of technology-enabled instructive and simulated pedagogy that can support the application of theory into practice. More research is required to understand the role of online learning networks and provisions for equitable engagement. A future emphasis on organisational and environmental factors may elucidate the role of technology in ameliorating obstacles to traditional dementia education.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO ( CRD42018115378 ).

Professionals' Digital Training for Child Maltreatment Prevention in the COVID-19 Era: A Pan-European Model

The responsiveness of professionals working with children and families is of key importance for child maltreatment early identification. However, this might be undermined when multifaceted circumstances, such as the COVID-19 pandemic, reduce interdisciplinary educational activities. Thanks to technological developments, digital platforms seem promising in dealing with new challenges for professionals’ training. We examined a digital approach to child maltreatment training through the ERICA project experience (Stopping Child Maltreatment through Pan-European Multiprofessional Training Programme). ERICA has been piloted during the pandemic in seven European centers involving interconnected sectors of professionals working with children and families. The training consisted of interactive modules embedded in a digital learning framework. Different aspects (technology, interaction, and organization) were evaluated and trainers’ feedback on digital features was sought. Technical issues were the main barrier, however, these did not significantly disrupt the training. The trainers perceived reduced interaction between participants, although distinct factors were uncovered as potential favorable mediators. Based on participants’ subjective experiences and perspectives, digital learning frameworks for professionals working with children and families (such as the ERICA model nested in its indispensable adaptation to an e-learning mode) can represent a novel interactive approach to empower trainers and trainees to tackle child maltreatment during critical times such as a pandemic, and as an alternative to more traditional learning frameworks.

Improving Healthcare Worker Resilience and Well-Being During COVID-19 Using a Self-Directed E-Learning Intervention

Introduction: High rates of burnout, depression, anxiety, and insomnia in healthcare workers responding to the COVID-19 pandemic have been reported globally. Methods: Responding to the crisis, the Foundation for Professional Development (FPD) developed an e-learning course to support healthcare worker well-being and resilience. A self-paced, asynchronous learning model was used as the training intervention. Each module included practical, skill-building activities. An outcome evaluation was conducted to determine if completing the course improved healthcare worker knowledge of and confidence in the learning outcomes of the course, their use of resilience-building behaviours, their resilience, and their well-being. A secondary objective was to explore if there were any associations between behaviours, resilience, and well-being. Participants completed pre- and post-course questionnaires to measure knowledge of and confidence in the learning outcomes, y, frequency of self-reported resilience-building behaviours, and levels of resilience (CD-RISC) and well-being (WHO-5). Results were analysed in STATA using paired T-tests, univariate and multivariate linear regression models. Results: Participants (n = 474; 77.6% female; 55.7% primary care) exhibited significant increases in knowledge, confidence, resilience-building behaviour, resilience, and well-being scores. Statistically significant improvements in the frequency of resilience-building behaviours led to significant improvements in resilience (0.25 points; 95% CI: 0.06, 0.43) and well-being (0.21 points; 95% CI: 0.05, 0.36). Increasing changes in well-being scores had a positive effect on change in resilience scores (β = 0.20; 95% CI: 0.11, 0.29), and vice versa (β = 0.28; 95% CI: 0.14, 0.41). Conclusion: A healthcare worker e-learning course can build knowledge and skills that may prompt changes in resilience-building behaviours and improvements in well-being and resilience scores. The findings suggest that e-learning courses may improve more than competency-based outcomes alone but further research is warranted to further explore these relationships.

E-learning in medical education during COVID-19 pandemic: experiences of a research course at Kenya Medical Training College

BACKGROUND

E-learning has been widely adopted as a teaching and learning approach in medical education internationally. However, its adoption in low- and middle-income countries is still at an infantile stage. The use of e-learning may help to overcome some of the barriers to access to quality education and provide flexible, low-cost, user-centred, and easily updated learning. To address the need for research education during the COVID-19 pandemic, we developed and implemented an e-learning course for students enrolled in higher diploma courses at the Kenya Medical Training College (KMTC). In this paper, we report our experience teaching the online research course in resource-constrained settings to enable other medical educators, students and institutions in similar settings to understand the most appropriate approaches to incorporating e-learning interventions.

METHODS

This was a cross-sectional study that reviewed the experiences of learners and lecturers on a research course at Kenya Medical Training College. All higher diploma students admitted to the college in the 2020/21 academic year were invited to take part in the study. We also included all lecturers that were involved in the coordination and facilitation of the course. We analysed qualitative and quantitative data that were collected from the e-learning platform, an online course-evaluation form and reports from course lecturers.

RESULTS

We enrolled 933 students on the online research course. These students had joined 44 higher diploma courses in 11 campuses of the college. The students struggled to complete synchronous e-learning activities on the e-learning platform. Only 53 and 45% of the students were able to complete the pretest and the posttest, respectively. Four themes were identified through a thematic analysis of qualitative data (1) Students gained research competencies (2) Students appreciated the use of diverse e-learning technologies (3) Students felt overwhelmed by the research course (4) Technological challenges reduce the effectiveness of online learning.

CONCLUSION

Our results suggest that e-learning can be used to teach complex courses, such as research in resource-constrained settings. However, faculty should include more asynchronous e-learning activities to enhance teaching and learning and improve student experiences.

Integra Project: strengthening social participation in the agenda of health policies, services, and technologies

The 16th National Health Conference illustrated the interest of health councils to intervene in public policies in order to guarantee the right to health technologies. The INTEGRA project (Integration of policies for Health Surveillance, Pharmaceutical Care, Science, Technology, and Innovation in Health) is a partnership among the National Health Council, the National School of Pharmacists, and the Oswaldo Cruz Foundation (Fiocruz), with support from the Pan American Health Organization (PAHO), with the goal of strengthening participation and social engagement in the theme, as well as the integration of health policies and practices within different sectors of society (social movements, health councils, and health professionals), with the various stages related to the access to medicines (research, incorporation, national production, and services) being the main theme in the context of the COVID-19 pandemic. It seeks to offer training for leadership groups in the health regions and activities with a broad national and political scope, and it hopes to establish an intersectorial and integrated network of leaders capable of acting collaboratively to defend the development of science, public policies, national sovereignty, and social control of health.

Distance education in dentistry in Brazil: a critical STROBE-based analysis

The COVID-19 pandemic has forced dentistry schools (DSs) to adapt their teaching techniques to digital platforms. Therefore, we aimed to evaluate distance classes in the Brazilian DS curriculum. After an online search of higher education institutions (HEIs) with DS on the e-Ministry of Education (MEC) platform, we included institutions with at least one graduated class to extract the age/localization of the DS, funding, number of authorized seats, MEC-grade, ENADE-score, and workload. HEIs' webpages were consulted to identify the curriculum, subjects offered in the distance education (DE) format, extracurricular programs, scientific events, postgraduate programs, and institutional YouTube channels. Chi-square/Fisher's tests plus binary logistic regression were performed (SPSS 20.0, p < 0.05). Of the 241 DSs evaluated, 82 (34.0%) offered distance classes, and a high prevalence was observed in the southeast region (p <0.001) and private HEIs (p = 0.001). HEIs with distance classes had lower ENADE scores (p = 0.004), lower workload (p = 0.007), and higher workload for optional subjects (p = 0.016), doctoral programs (p = 0.041), specialization courses (p = 0.017), and institutional YouTube channels (p < 0.001). Southern dental schools (p < 0.001), lower workload (p = 0.022), optional subjects (p = 0.033), and institutional YouTube channels (p = 0.005) were independently associated with distance classes. In one-third of the Brazilian DSs, distance classes and institutional YouTube channels were strongly associated variables. The association of distance learning with lower workload and low academic performance draws attention to the need for regulatory bodies for controlling the quality of DE.

Virtual learning during the COVID-19 pandemic: What are the barriers and how to overcome them?

CONTEXT

Virtual learning is not without challenges. It can cause stress, lack of motivation, and social isolation. Due to COVID-19 pandemic, our college shifted from face-to-face to virtual teaching-learning style. the aim was to find out the barriers in virtual learning among medical students and provide solutions to overcome them.

MATERIALS AND METHODS

This cross-sectional study was conducted among 3^rd- and 4^th-year Bachelor of Medicine and Bachelor of Surgery students in 2020. Prevalidated electronic survey forms on institutional barrier, technical barrier, and individual barrier were sent to students, 160 students responded. SPSS version 12 was used to calculate descriptive statistics and independent t-test.

RESULTS

The students had the highest mean score in individual barrier (mean: 2.82 [standard deviation (SD): 0.72]) followed by institutional barrier (mean: 2.79 [SD: 0.74]) and technological barrier (mean: 2.72 [SD: 0.75]). Regarding technological barriers, 38.6% of the students agreed difficulty in procurement of the laptop and 66.4% faced slow Internet connection. Regarding institutional barriers, 75.9% were stressed to join one lecture to another lecture as the lectures were continuous, 69.6% had limited opportunity to interact with lecturers, and 62.7% had poor communication between lecturers and students. Regarding individual barriers, 74.1% of the students were not motivated for online learning, 71.5% of the students could not learn as well as they were in the classroom, and 58.2% disagreed taking online courses in future.

CONCLUSION

Low motivation, communication, Internet connectivity, and technical problems were the main barriers. Smaller size class, highly motivated and well-trained lecturers, and interactive lectures may help in breaking the barriers of virtual learning.

Speech and Language Therapists' Perspectives of an E-Learning Course on Providing Feedback in the Clinical Learning Environment

BACKGROUND

A fundamental component of supervising a student speech and language therapist (SLT) on placement is the provision of feedback. There are numerous identified challenges to ensure the delivery of high-quality feedback to optimise student learning and student success. Supervisors can help overcome these challenges and engage in evidence-based feedback processes if they are supported to develop the necessary knowledge and skills. E-learning is one possible means to provide this professional development to a large number of practising SLTs who are geographically dispersed and have conflicting schedules.

AIMS

This study aimed to capture and evaluate the perspectives of SLTs who completed an e-learning course on providing feedback in the clinical learning environment, including the suitability and effectiveness of the e-learning tool used.

METHODS AND PROCEDURES

An innovative e-learning course was designed to provide asynchronous video and interactive content on evidence-based theories and practices for effective feedback processes. Clinical scenarios relevant to the discipline of speech and language therapy were included. Participants were invited to complete optional, anonymous pre- and post-evaluation surveys. Data were analysed quantitively (descriptive and inferential statistics) and qualitatively (thematic analysis).

OUTCOMES AND RESULTS

Participants indicated that the e-learning course supported them to enhance their feedback processes in the clinical learning environment through identified changes to their practices. The increases in confidence providing feedback they reported were statistically significant. In addition, the e-learning course was rated highly on numerous variables related to quality. Recommendations for adaptations and additions were also highlighted.

CONCLUSIONS AND IMPLICATIONS

An e-learning course on effective and evidence-based feedback processes provides an opportunity to provide professional development to a large number of geographically dispersed practitioners in a cost-effective and flexible way. This could ensure more SLTs are confident and competent in their role as supervisor of students, which requires distinct knowledge and skills from that of a practitioner. Ultimately, this will help maximise educator and student success in the feedback process and consequently improve clinical performance and healthcare delivery.

Healthcare students' mental and physical well-being during the COVID-19 lockdown and distance learning

BACKGROUND

The sudden shift into distance learning during the coronavirus (COVID-19) lockdown might have impacted university students' well-being.

OBJECTIVE

This study aimed to investigate undergraduate healthcare university students' health-related quality of life (HRQoL) and its predictors during COVID-19.

METHODS

A cross-sectional study used an online self-administered questionnaire. The study targeted undergraduate medical, dental, pharmacy, and nursing students at Jordanian universities. Data collected included demographics,12-item Short Form health survey (SF-12), students' evaluation of distance learning, Neck Disability Index (NDI), Depression Anxiety Stress Scale (DASS21), and the International Physical Activity Questionnaire (IPAQ). Descriptive analyses were conducted to summarize primary outcome measures data. Predictors of HRQoL were determined using a multiple variable regression analysis.

RESULTS

In total, 485 university students successfully completed this study with a mean age of 20.6 (±2.0). Participants' HRQoL level measured by SF-12 mean scores were 66.5 (±20.2) for physical health component and 44.8 (±21.2) for mental health component. The regression model explained 65.5% of the variation (r2 = 0.655, F = 127.8, P < 0.001) in participants' HRQoL. Factors significantly associated with HRQoL included depression, neck disability index score, stress, health self-evaluation, average of satisfaction with distance learning, IPAQ score, and weekly studying hours.

CONCLUSIONS

This study showed that healthcare students had a relatively low level of HRQoL during COVID-19 pandemic in Jordan. Academic and non-academic factors associated with HRQoL were identified and should be considered by healthcare educational institutions for better academic planning in future similar pandemics.

Impact of a Pharmacy Management Course for Pharmacists Working Within Brazil's Public Health System

Objective. To assess the impact of a continuing education course that focused on the development of management competencies on pharmacists working in Brazil's public health system.Methods. A specialization blended in-service course (360 hours) entitled Pharmaceutical Service and Access to Medicine Management was offered to pharmacists working within the Brazilian public health system. Data on course outcomes were collected through individual interviews with pharmacists who worked in the Brazilian public health system, as well as from focus groups and records of researchers' observations. The analysis was based on models of learning and training evaluation theory.Results. The findings showed proximal outcomes on students' knowledge, skills, and attitudes; behavioral changes; and programmatic outcomes in the organization and management of health services, promoting the recognition and integration of the "pharmaceutical services division" - a dedicated sector within the health departments in municipalities and states. The inputs (course content, structure, and in-service hands-on activities) were directly linked to the outcomes reported by participants and helped them to overcome some of the barriers to using knowledge and skills in the workplace.Conclusion. A well-structured course including leaning activities to intervene in the workplace had a positive impact on pharmacists' behavior and contributed to the capacity building of the organizations in which they operate.

Virtual Microscopy as a Learning Tool in Brazilian Medical Education

Virtual microscopy (VM) is a widely used teaching method in Medical Education in many developed countries. In Brazil, however, this is not the case for most medical schools, considering Brazilian social inequality and uneven access to technology. Recently, the Covid-19 pandemic has also challenged Universities to seek and make a transition toward more effective methods of full-time online education. Thus, the main goal of this work was to verify student's perception and academic performance, assessed upon VM implementation in a Brazilian Medical School. Ribeirao Preto Medical School students answered a 26-question survey with regards to optical microscopy (OM) and VM. Academic performance was compared between participants that were (year of 2019) or were not (year of 2015) exposed to VM. Taken the results together, subjective impressions such as handling, suitability, learning effectiveness, and pleasure using the tools, have shown a higher score for virtual microscopy (median = 29), when compared to optical microscopy (median = 24) with a P-value < 0.001 by Wilcoxon rank test, upon measurement using an ordinal scale. Regarding academic performance, no statistically significant differences were found between groups (P-value = 0.38, Cohen's d = 0.19). Therefore, VM proved to be adequate to the Brazilian medical education in light of Brazilian social contexts and Covid-19 pandemic.

Approaches and perspectives for online learning during the COVID-19 pandemic and future chaos

BACKGROUND

Online learning (OLL) methodology has been incorporated in higher education extensively on the mount over the last few decades and with the onset of COVID-19 situation, the virtual method in academia became essential. After observing worldly destructions and death due to coronavirus, the WHO declared a high alert emergency, and since Pakistan started to follow lockdown since March 2020 to prevent high penetration and consequently, the online teaching method was adapted to keep the learning atmosphere alive. The study is aimed to identify the influencing factors and compliance for the implementation of the OLL system in COVID-19 and, in the future, nonpandemic state as well.

MATERIALS AND METHODS

The present study is designed to observe the adaptability and hurdles among pharmacy students, and for the purpose of the study, a questionnaire on the Likert scale was developed and asked to respond from pharmacy undergraduate and postgraduate students after taking consensus, which further analyzed through IBM SPSS Statistics Version 26.

RESULTS

The outcomes of the study were analyzed with a high level of conformity; however, the gender-based reservations were observed, and moreover, merits of OLL were observed with high jeopardy.

CONCLUSION

The adaptation of OLL, though proved as the only troubleshooter in an uncontrollable situation and enabled universities, professors, and students for patience, resilience, and hopefully, will serve as swift safeguard for future challenges of epidemic and pandemic disasters. According to the evolution theory, brain adaptability and plasticity of human organisms grow the capacity to adjust itself with an advanced characteristic.

Education Research: NeuroBytes: A New Rapid, High-Yield e-Learning Platform for Continuing Professional Development in Neurology

OBJECTIVE

To determine whether NeuroBytes is a helpful e-Learning tool in neurology through usage, viewer type, estimated time and cost of development, and postcourse survey responses.

BACKGROUND

A sustainable Continuing Professional Development (CPD) system is vital in neurology due to the field's expanding therapeutic options and vulnerable patient populations. In an effort to offer concise, evidence-based updates to a wide range of neurology professionals, the American Academy of Neurology (AAN) launched NeuroBytes in 2018. NeuroBytes are brief (<5 minutes) videos that provide high-yield updates to AAN members.

METHODS

NeuroBytes was beta tested from August 2018 to December 2018 and launched for pilot circulation from January 2019 to April 2019. Usage was assessed by quantifying course enrollment and completion rates; feasibility by cost and time required to design and release a module; appeal by user satisfaction; and effect by self-reported change in practice.

RESULTS

A total of 5,130 NeuroBytes enrollments (1,026 ± 551/mo) occurred from January 11, 2019, to May 28, 2019, with a median of 588 enrollments per module (interquartile range, 194-922) and 37% course completion. The majority of viewers were neurologists (54%), neurologists in training (26%), and students (8%). NeuroBytes took 59 hours to develop at an estimated $77.94/h. Of the 1,895 users who completed the survey, 82% were "extremely" or "very likely" to recommend NeuroBytes to a colleague and 60% agreed that the depth of educational content was "just right."

CONCLUSIONS

NeuroBytes is a user-friendly, easily accessible CPD product that delivers concise updates to a broad range of neurology practitioners and trainees. Future efforts will explore models where NeuroBytes combines with other CPD programs to affect quality of training and clinical practice.

Learning How to Order Imaging Tests and Make Subsequent Clinical Decisions: a Randomized Study of the Effectiveness of a Virtual Learning Environment for Medical Students

RATIONALE AND OBJECTIVES

Two critical skills that medical students must acquire during undergraduate education are the ability to order imaging tests and make clinical decisions based on their results. We implemented an e-learning course in Moodle specifically designed to teach these skills to medical students. The aim of this study was to assess the effectiveness of our course.

MATERIAL AND METHODS

We randomized 26 undergraduate medical students to an experimental group that had access to the virtual learning environment and a control group that did not. Three weeks after the course, we evaluated its effectiveness through a blinded objective structured clinical examination. To avoid any bias in favor of the experimental group, the assessment considered scores on two pre-specified subscales: one related to the contents of the course and the other to new clinical scenarios.

RESULTS

Students that completed the e-course performed better overall than controls (mean score ± standard deviation 59.3 ± 6.2 vs 41.8 ± 10.2, p = 0.0020). This better performance was observed in both types of skills assessed (ordering imaging tests, and making diagnostic and therapeutic decisions based on test results). More importantly, this better performance of the experimental group was observed consistently both with items related to the course content (1.7 times higher, p = 0.0034) and new scenarios (1.3 times higher, p = 0.0098).

CONCLUSIONS

Through an ad - hoc e-course, undergraduate medical students learned effectively how to order imaging tests and make optimal subsequent decisions. Moreover, they were able to apply these skills to new clinical scenarios.

Effectiveness of m-learning on knowledge and attitude of nurses about the prevention and control of MDR TB: A quasi-randomized study

BACKGROUND

Multidrug-Resistant Tuberculosis is a fatal form because of high morbidity and poor recovery. Improper use of first line medicines and default treatment are the prime reasons of developing resistance of mycobacterium towards conventional anti- TB drugs. Nurses with refined knowledge, current evidence and positive attitude can prevent arising of MDR TB cases by ensuring adequate treatment, promoting treatment adherence and real time case monitoring. Because of paucity of data, present study was aimed to assess efficacy of m-learning in improving knowledge and attitude of nurses about the prevention and control of MDR-TB.

METHODS

In this Quasi-randomized study, nurses working in the unit of pulmonary, emergency, respiratory ICU, general medicine of AIIMS Rishikesh during the months of August-October 2019 were involved. The number of participation was 190 (95 in each group; experimental and control) where m-learning intervention was available only for experimental group. There were structured questionnaire to measure knowledge and dichotomous checklist to evaluate attitude of nurses of both group before and one week after the provision of m-learning module.

RESULTS

Both the group was homogeneous and m-learning intervention was effective to improve knowledge, when compared post-test knowledge score between experimental and control group (18.2 ± 5.4 vs 12.4 ± 4.4; P < 0.001); however, this one-time social media based intervention could not improve attitude of participants (10.3 ± 1.8 vs. 9.9 ± 1.8; P = 0.175).

CONCLUSION

Hence, m-learning is useful for knowledge development among large number of nurses within limited resource setting but frequent provision of technology based module is recommended to acquire positive attitude among nurses.

The development and evaluation of an online educational tool for the evidence-based management of neck pain by chiropractic teaching faculty

OBJECTIVE

To develop an online, interactive educational tool to deliver an evidence-based clinical practice guideline to faculty members at a Canadian chiropractic college. Second, to evaluate the learning, design, and engagement constructs of the tool in a sample of chiropractic faculty members.

METHODS

Using an integrated knowledge translation methodology and the Knowledge to Action Framework, we developed an evidence-based online learning tool. The context of the tool focused on a clinical practice guideline on the management of neck pain. We evaluated the learning, design, and engagement constructs in a sample of faculty members and residents using the Learning Object Evaluation Scale for Students. Participants were also asked to provide suggestions for improvement of the tool.

RESULTS

Sixteen participants completed the evaluation. Most (68.8%) participants were chiropractors, 75% were male and 56% were between the ages of 25 and 44 years. At least 75% of participants agreed that the learning, design, and engagement constructs of the learning tool were adequate. The open-ended suggestions unveiled 3 pedagogical themes, relating to multimedia, thinking skills, and learner control, within the tool that could benefit from further development. These themes informed recommendations to improve the tool.

CONCLUSION

Our online, interactive, module-based learning tool has sound pedagogical properties. Further research is needed to determine if its use is associated with a change in knowledge.

Attending a Blended In-Service Management Training in a Public Health System: Constraints and Opportunities for Pharmacists and Health Services

Management and public health are important domains of competency for pharmacists. In about 90% of Brazilian health departments, pharmacists manage the selection and purchase of medicines. The Pharmaceutical Services and Access to Medicines Management Course (PSAMM) was offered to pharmacists working in the public health system. The aim of this study is to analyze the impacts of the course as perceived by the students (pharmacists). Two thousand five hundred pharmacists completed the course. It is a mixed-methods study, including subscribing forms (n = 2500), evaluation questionnaire (n = 1500), focus groups (n = 10), and semi-structured interviews (n = 31). Participants reported a high level of satisfaction with the course; they considered to have developed competencies related to leadership and management, competencies needed to enhance and sustain their practices in health services. Data analyses showed important barriers to complete the course: high course workload, poor quality of Internet access, lack of support from the health services. Participants highlighted crucial features of the course that helped them develop key competencies: practical in-service activities, useful and realistic contents, tutoring. These features helped participants overcome some important constraints described by them. The educational model described in this study was perceived as having a long-term impact on their behaviors and management practices in health services.

A Comprehensive Understanding of the Use of e-Learning in Continuing Education: Experiences of Pharmacists in a Public Health System

INTRODUCTION

The health and education sectors have experienced rapid technological development. In this scenario, the use of Internet technology has grown as an option for the expansion of continuing education (CE), as it allows professionals to develop educational activities with flexibility, autonomy, and convenience. E-learning has gained popularity and currently, thousands of online courses are being offered. However, studies of e-learning in professional training have presented only a few specific foci of study.

OBJECTIVE

to develop a comprehensive approach to understand both the experience and the complex scenario of the use of e-learning in the CE for pharmacists.

METHOD

Field research in 10 Brazilian states through interviews and focus groups with alumni of a CE e-learning specialization course for pharmacists in public health. Data analysis used the model of socio-technical systems and was based on a framework with the components Objectives, People, Processes, Culture, Technology, Infrastructure, and Scenario.

RESULTS

The People and Culture components indicated the assimilation and normalization of technologies in the educational process. Although the infrastructure (technical and organizational) was deficient in some regions, the Technology component suggested that the characteristics of the course design, associated with the personal characteristics of the students, provided ways to overcome obstacles. The objectives of the use of distance education seem to be related to the possibility of greater accessibility and autonomy. The Processes component, in turn, revealed the burden that a e-learning course puts on the pharmacist.

CONCLUSION

E-learning proved to be useful to enable and expand access to education, providing pharmacists with an opportunity for CE. On the other hand, e-learning contributes to the normalization of the precarious working conditions of pharmacists, attributing to individuals the sole responsibility for the CE even in an institutional CE program, which results in work overload.

Analysis of a Blended, In-Service, Continuing Education Course in a Public Health System: Lessons for Education Providers and Healthcare Managers

Introduction: To train pharmacists working in the public health system, the Brazilian Ministry of Health developed a specialization course called Pharmaceutical Service and Access to Medicine Management (PSAMM) between 2010 and 2016. The course was free of charge and used e-learning as its main approach. In the end, 2,500 pharmacists were trained. The purpose of this study was to identify and analyze the strengths, weaknesses, opportunities, and threats of an in-service and e-learning course for pharmacists working in a public health system.

Materials and Methods: Three workshops involving 67 participants were conducted at the conclusion of the course to analyze the perspective of the PSAMM course's faculty (tutors, regional coordinators, professors, and management committee) and students (pharmacists). Strengths, weaknesses, opportunities, and threats analysis and qualitative analysis methods were used.

Results and Discussion: The strength dimension had the greatest number of items. The qualitative analysis resulted in six categories: the category “E-learning in continuing education” had the most cited items. Internal elements such as in-service hands-on activities directly related to the professionals' roles, course contents, faculty, and the methods to offer the course (the mixed methods and materials) were positively assessed. Nonetheless, external elements were considered critical for the course's outcomes such as investments in the infrastructure of pharmaceutical services, access to the internet, local managers' support for continuing education and innovation implementation, practice of interprofessional collaboration, and political stability. The continuing education course in the public health system was affected by internal elements such as its project and structure as well as external elements such as the sociopolitical scenario. Continuing education investment must be accompanied by infrastructure investment and coordination of services.

'Learning from home': role of e-learning methodologies and tools during novel coronavirus pandemic outbreak

BACKGROUND

During the crucial time of coronavirus pandemic, education is being remodelled: opening the doors of electronic learning (e-learning). The review emphasises on the various e-learning methods that can be used in the current scenario.

METHODS

The review was based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines on databases, namely, PubMed, Google Scholar and Cochrane. Out of 1524 identified articles, after the process of screening and based on the eligibility criteria, 45 full-text articles were reviewed.

RESULTS

Though there are many caveats on the path of successful implementation this is the right time that we step towards e-learning. The article discusses the methods and tools in e-learning that can modify the traditional ways of content delivery, record maintenance, assessment and feedback.

CONCLUSION

During the period of 'planet arrest', when the whole world is locked down with the motive of social distancing, let us stay connected with e-learning.

Nurses' Attitudes Toward Lifelong Learning via New Technologies

Introduction: Lifelong professional education is considered as a qualitative indicator in the health discipline, as it can improve health professionals' knowledge and skills, as well as nursing care. Purpose: The purpose of this original research is to examine and record the attitudes and behavior of nurses working in state-run hospitals in the Municipality of Thessaloniki regarding lifelong education through new technologies. Identification of nurses' motivations for lifelong distance education, recording of nurses' perception of the need for continuing nursing education, and determining how nurses pursue lifelong learning are the objectives of this study. Methodology: The study was conducted between January and March 2019. The sample of the study consisted of 124 nurses (n = 124) from three state hospitals of the Municipality of Thessaloniki. A questionnaire consisting of 5 parts was used as a research tool. SPSS 23 statistical software platform was used for statistical analysis. Results: The sample consisted of 124 participants, 12 were men and 112 were women. The mean age of the participants was 42.37 years and the mean experience in the field was 16.78 years. Two main reasons for continuing education were attributed to the upgrade of the nursing profession and the need to improve the quality of care provided. Conclusions: Nurses believe that continuing education is essential and their professional knowledge must periodically be enriched and renewed.

Connecting Classrooms, Clinicians, and Community Clinics Through Technology (C4Tech) for Active and Collaborative Learning

PURPOSE

This pilot study investigated the level of cognition that physician assistant (PA) students achieved through adoption of an innovative blended learning model that connects the classroom, clinicians, and community clinics through electronic-learning (e-learning) technologies (C4Tech) used in a PA course. This education intervention aimed to facilitate authentic learning collaborations between PA students and practicing clinicians that would result in higher-order cognition related to the manifestations of social determinants of health and health disparities.

METHODS

A case study approach was adopted to assess levels of cognition and changes in those levels resulting from application of an innovative blended learning model. Content analysis using Bloom's taxonomy of cognitive domains facilitated determination levels of cognition and changes in those levels. The sample of 8 groups comprised 70 PA students and 8 clinical instructors from community clinics with underrepresented patient populations.

RESULTS

Analysis of 2 course assignments revealed that application of the C4Tech model yields high levels of cognition. By the course's end, all 8 groups achieved at least the "evaluate" level of cognition and half of the groups achieved the highest level of cognition, the "create" level. A wide variation in the level of cognition was demonstrated between the first and second assignments in each group and among groups.

CONCLUSION

Our findings suggest that e-learning technologies can be effective in blending classrooms and work environments for authentic and collaborative learning. Adoption of the C4Tech model yielded higher-order cognition related to course content.

Online versus in-person training of community health workers to enhance hepatitis B virus screening among Korean Americans: Evaluating cost & outcomes

From 2014 to 2018, we developed and implemented culturally appropriate interventions delivered by community health workers (CHWs) in Pennsylvania and New Jersey. To determine the most cost-effective approach, we recruited 40 predominantly foreign-born Korean American CHWs and used cluster sampling to assign them into two training groups (online training vs. in-person training). We prospectively assessed the cost of training 40 Korean American CHWs and the cost of subsequent HBV educational workshops delivered by the CHWs. We also assessed these costs relative to the success of each training approach in recruiting participants for HBV screening and vaccination. We found that the training costs per participant were higher for in-person training ($1.71 versus $1.12), while workshop costs per participant were lower for in-person training ($2.19 versus $4.22). Workshop attendee costs were comparable. After accounting for site clustering, there were no significant differences in total costs per participant ($24.55 for the online-trained group and $26.05 for the in-person group). In-person trained CHWs were able to generate higher HBV screening and vaccination rates (49.3% versus 21.4% and 17.0% versus 5.9%, respectively) among their participants compared with online-trained CHWs. Given better outcomes and no differences in costs, in-person training dominated the online training option. Despite the potential for efficiency to be gained with online training, CHWs who attended live training outperformed their online-trained colleagues. Elements of the didactic approach or practice with peers in the live session may have contributed to the superior training effectiveness and, ultimately, improved cost-effectiveness of the in-person approach.

Theory-based E-health literacy interventions in older adults: a systematic review

Background

e-health literacy can facilitate the uptake of benefits of health for older adults. In this review, we aimed to tabulate the types and outcomes of the theory-based e-health interventions that had been applied to improve the e-health literacy of older adults.

Methods

In this systematic review, theory-based e-health literacy interventions that published up to April 2020 were retrieved from several online electronic databases, including Medline via PubMed, Cochrane Library, ProQuest, and EMBASE. The published papers were included in this study, if the study had been conducted on older adults, a theory-based intervention aimed at promoting e-health literacy, and had been written in English language in the timeframe of 2008–2020.

Results

A total of 1658 records were identified initially, of which, 12 articles met the inclusion criteria. The systematic review identified the using of variety of intrapersonal, interpersonal, and societal level conceptual models in enhancing of e-health literacy in older adults, and the concept of self-efficacy was applied in the most of interventions as the main conceptual theoretical framework.

Conclusions

Despite the paucity of conceptual models, which are specifically designed for e-health literacy interventions, based on our findings, we recommend self-efficacy as a powerful concept that can play an important role in improving e-health literacy in older adults.

E-learning in a new era: enablers and barriers to its implementation in nursing

During these uncertain and unprecedented times, the use of technology has become paramount to staying connected to friends, family, work and society. Social distancing has forced a huge digital transformation to take place, and this will inevitably change the way we work, particularly within healthcare. One dramatic change is the reliance upon e-learning, which is now the preferred method of teaching and training. This article will explore both the benefits and barriers to e-learning, drawing upon the author's experience as a digital project nurse who aided with the implementation of e-learning for community nurses.

A systematic review of the factors - enablers and barriers - affecting e-learning in health sciences education

BACKGROUND

Recently, much attention has been given to e-learning in higher education as it provides better access to learning resources online, utilising technology - regardless of learners' geographical locations and timescale - to enhance learning. It has now become part of the mainstream in education in the health sciences, including medical, dental, public health, nursing, and other allied health professionals. Despite growing evidence claiming that e-learning is as effective as traditional means of learning, there is very limited evidence available about what works, and when and how e-learning enhances teaching and learning. This systematic review aimed to identify and synthesise the factors - enablers and barriers - affecting e-learning in health sciences education (el-HSE) that have been reported in the medical literature.

METHODS

A systemic review of articles published on e-learning in health sciences education (el-HSE) was performed in MEDLINE, EMBASE, Allied & Complementary Medicine, DH-DATA, PsycINFO, CINAHL, and Global Health, from 1980 through 2019, using 'Textword' and 'Thesaurus' search terms. All original articles fulfilling the following criteria were included: (1) e-learning was implemented in health sciences education, and (2) the investigation of the factors - enablers and barriers - about el-HSE related to learning performance or outcomes. Following the PRISMA guidelines, both relevant published and unpublished papers were searched. Data were extracted and quality appraised using QualSyst tools, and synthesised performing thematic analysis.

RESULTS

Out of 985 records identified, a total of 162 citations were screened, of which 57 were found to be of relevance to this study. The primary evidence base comprises 24 papers, with two broad categories identified, enablers and barriers, under eight separate themes: facilitate learning; learning in practice; systematic approach to learning; integration of e-learning into curricula; poor motivation and expectation; resource-intensive; not suitable for all disciplines or contents, and lack of IT skills.

CONCLUSIONS

This study has identified the factors which impact on e-learning: interaction and collaboration between learners and facilitators; considering learners' motivation and expectations; utilising user-friendly technology; and putting learners at the centre of pedagogy. There is significant scope for better understanding of the issues related to enablers and facilitators associated with e-learning, and developing appropriate policies and initiatives to establish when, how and where they fit best, creating a broader framework for making e-learning effective.

Antecedents of use of e-health services in Central Eastern Europe: a qualitative comparative analysis

Background

The objective of this paper is to identify the key conditions that positively affect the use of e-health services in Central Eastern Europe (CEE) countries. CEE countries after the political and economic transformation in 1989/90 implemented slightly different national health care models. The research question of the study is: how do the various institutional conditions at the national level affect the use of e-health services in CEE countries?

Methods

The e-health description was derived from papers indexed in Web of Science and Scopus. The data for computation were collected from the 2015 global survey by the WHO Global Observatory for eHealth. We used a narrative literature review in order to identify key terms associated to e-health and conditions for the implementation of e-health services. The search terms were “e-health” and “*” where * was particular thematic section of e-health according to WHO GOeH. The inclusion criterion was relevance of the paper to e-health and searched phase. Eligibility criteria for countries for being described as CEE countries: Estonia, Lithuania, Latvia, Poland, Hungary, Romania, Bulgaria, Czech Republic, Slovenia, and Croatia (we omitted Slovakia from the analysis because this country was not covered by the WHO Survey). We applied qualitative comparative analysis (QCA) to analyse the necessary order of conditions. The dependent variable of the study is the national rate of use of e-health services.

Results

QCA shows that legal medical jurisdiction, teleprogramme and electronic health records supplemented by adequate training constitute critical conditions to achieve success in e-health implementation.

Conclusions

We conclude that the more formalised a framework for e-health service delivery is, the more likely it will be used. Therefore formalisation fosters the diffusion, dissemination and implementation of e-health solutions in this area. Formalisation must be accompanied by tailored training for health care professionals and patients. Our analyses are related only to the paths of e-health implementation in CEE countries thus consequently the findings and conclusions cannot be directly applied to other countries. The limitations of this study are related the absence of a broader context of e-health development, including the development of ICT infrastructure and ICT literacy.

Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review

In low- and middle-income countries (LMICs), e-learning for medical education may alleviate the burden of severe health worker shortages and deliver affordable access to high quality medical education. However, diverse challenges in infrastructure and adoption are encountered when implementing e-learning within medical education in particular. Understanding what constitutes successful e-learning is an important first step for determining its effectiveness. The objective of this study was to systematically review e-learning interventions for medical education in LMICs, focusing on their evaluation and assessment methods. Nine databases were searched for publications from January 2007 to June 2017. We included 52 studies with a total of 12,294 participants. Most e-learning interventions were pilot studies (73%), which mainly employed summative assessments of study participants (83%) and evaluated the e-learning intervention with questionnaires (45%). Study designs, evaluation and assessment methods showed considerable variation, as did the study quality, evaluation periods, outcome and effectiveness measures. Included studies mainly utilized subjective measures and custom-built evaluation frameworks, which resulted in both low comparability and poor validity. The majority of studies self-concluded that they had had an effective e-learning intervention, thus indicating potential benefits of e-learning for LMICs. However, MERSQI and NOS ratings revealed the low quality of the studies' evidence for comparability, evaluation instrument validity, study outcomes and participant blinding. Many e-learning interventions were small-scale and conducted as short-termed pilots. More rigorous evaluation methods for e-learning implementations in LMICs are needed to understand the strengths and shortcomings of e-learning for medical education in low-resource contexts. Valid and reliable evaluations are the foundation to guide and improve e-learning interventions, increase their sustainability, alleviate shortages in health care workers and improve the quality of medical care in LMICs.

Dissecting the Contemporary Clerkship: Theory-based Educational Trial of Videos Versus Lectures in Medical Student Education

BACKGROUND

Despite increasing use of the flipped classroom (FC) technique in undergraduate medical education, the benefit in learning outcomes over lectures is inconsistent. Best practices in preclass video design principles are rarely used, and it is unclear if videos can replace lectures in contemporary medical education.

METHODS

We conducted a prospective quasi-experimental controlled educational study comparing theory-based videos to traditional lectures in a medical student curriculum. Medical students enrolled in an emergency medicine clerkship were randomly assigned to either a lecture group (LG) or a video group (VG). The slide content was identical, and the videos aligned with cognitive load theory-based multimedia design principles. Students underwent baseline (pretest), week 1 (posttest), and end-of-rotation (retention) written knowledge tests and an observed structured clinical examination (OSCE) assessment. We compared scores between both groups and surveyed student attitudes and satisfaction with respect to the two learning methods.

RESULTS

There were 104 students who participated in OSCE assessments (49 LG, 55 VG) and 101 students who participated in knowledge tests (48 LG, 53 VG). The difference in OSCE scores was statistically significant 1.29 (95% confidence interval = 0.23 to 2.35, t(102) = 2.43, p = 0.017), but the actual score difference was small from an educational standpoint (12.61 for LG, 11.32 for VG). All three knowledge test scores for both groups were not significantly different.

CONCLUSIONS

Videos based on cognitive load theory produced similar results and could replace traditional lectures for medical students. Educators contemplating a FC approach should devote their valuable classroom time to active learning methods.

E-learning as valuable caregivers' support for people with dementia - A systematic review

Background

Present demographic trends show a considerable rise in elderly populations with aging disorders, such as dementia. The current article focused on the exploitation of e-learning as an informal support for caregivers of people with dementia and considered its benefits and limitations to provide proper and relevant care for this target group of people as well as maintain the quality of life of their caregivers.

Methods

The methodology of this study is based on a literature review of accessible peer-review articles from three recognized databases: Web of Science, Scopus, and PubMed. The findings of the selected studies were compared and evaluated.

Results

The findings showed that e-learning educational programs/courses helped caregivers feel more confident about dementia care, reduced their perceived stress and enhanced their feelings of empathy, understanding and concern.

Conclusions

The findings of this study reveal that the exploitation of e-learning as a support tool, especially for informal caregivers, in the management of dementia may be a promising method, but its implementation requires professional training of informal caregivers in the use of this technology. More evidence-based studies are needed on this topic.

Effectiveness of the Distance Learning Strategy Applied to Orthodontics Education: A Systematic Literature Review

Introduction: Tele-education refers to the use of interactive distance learning technologies. The objective of this systematic review was to evaluate the impact of tele-education in the field of orthodontics. Methods: This systematic review has been registered in PROSPERO and followed PRISMA guidelines. Two independent researchers reviewed the literature available in the databases of PubMed/MEDLINE, Bireme, the Cochrane Library, EMBASE, TRIP, SCIELO, LILAS, SCIENCEDIRECT, and Google Scholar using the following descriptors: "Education, Distance" OR "e-learning" AND "Orthodontics," including only interventional studies. The descriptive synthesis was conducted according to the Center for Reviews and Dissemination. The analysis of the biases was conducted using the MINORS protocol, and the analysis of the interventions using Kirkpatrick's method was evaluated. Results: Of the 15 remaining articles for complete reading, 4 were excluded for not meeting the inclusion criteria, leaving 11 articles for evaluation in the systematic review. Eight articles emphasized the evaluation of the distance education materials available, achieving a high percentage of acceptability among students, two cited only satisfaction, and one article evaluated the practical performance of the students. Conclusion: The results showed that orthodontic distance learning is an effective but complementary element, with no significant differences, to the traditional method of teaching.

Supporting the provision of pharmacy medication reviews to marginalised (medically underserved) groups: a before/after questionnaire study investigating the impact of a patient-professional co-produced digital educational intervention

OBJECTIVES

People who are marginalised (medically underserved) experience significant health disparities and their voices are often 'seldom heard'. Interventions to improve professional awareness and engagement with these groups are urgently needed. This study uses a co-production approach to develop an online digital educational intervention in order to improve pharmacy staffs' intention to offer a community pharmacy medication review service to medically underserved groups.

DESIGN

Before/after (3 months) self-completion online questionnaire.

SETTING

Community pharmacies in the Nottinghamshire (England) geographical area.

PARTICIPANTS

Community pharmacy staff.

INTERVENTION

Online digital educational intervention.

PRIMARY AND SECONDARY OUTCOME MEASURES

The primary outcome measure was 'behaviour change intention' using a validated 12-item survey measure. The secondary outcome measure was pharmacist self-reported recruitment of underserved groups to the medication review service.

RESULTS

All pharmacies in the Nottinghamshire area (n=237) were approached in June 2017 and responses were received from 149 staff (from 122 pharmacies). At 3 months (after completing the baseline questionnaire), 96 participants (from 80 pharmacies) completed a follow-up questionnaire, of which two-thirds (n=62) reported completing the e-learning. A before/after comparison analysis found an improving trend in all the five constructs of behaviour change intention (intention, social influence, beliefs about capabilities, moral norms and beliefs about consequences), with a significant increase in mean score of participants' 'beliefs about capabilities' (0.44; 95% CI 0.11 to 0.76, p=0.009). In the short-term, no significant change was detected in the number of patients being offered and the patient completing a medication review.

CONCLUSIONS

Although increases in the numbers of patients being offered a medication review was not detected, the intervention has the potential to significantly improve pharmacy professionals' 'beliefs about capabilities' in the short-term. Wider organisational and policy barriers to engagement with marginasied groups may need to be addressed. Future research should focus on the interplay between digital learning and practice to better identify and understand effective practice change pathways.