Gamification in Biomedical Science Education: The Successful Implementation of Resimion, a Scenario-Based Learning Tool

Introduction: Scenario-based learning and gamification have many advantages in comparison to traditional didactic teaching methods, including development of many higher-level skills such as analysis and evaluation. It is hoped that these simulations provide a real-world experience in a format accessible to students. Integration of these tools into teaching excelled during the COVID-19 pandemic, an event that completely changed education and initiated the greatest advancement in digital learning to date. We discuss our experiences using Resimion, a novel scenario-based learning tool that was adapted to biomedical science, both for teaching and assessment. Methods: Our cohort included 769 students studying BSc(Hons) Biomedical Science at the University of the West of England from 2020 to 2023. Data was obtained from assessments within four different modules, two at FHEQ level 5 and two at level 6. Students were grouped based on reasonable adjustment (RA) status, including physical issues, specific learning differences and neurodiversity, with differences between student groups and assessment types analysed by ANOVA. Results: Data clearly demonstrate good engagement from students utilising Resimion software, representing 18,436 student interactions in total, across both assessed and non-assessed activities. RAs of any type did not alter submission rates (p = 0.53) or student outcome in any of the assessment types analysed. However, submission rates for Resimion assessments were notably higher than for other assessment types (p = 0.002). Whist outcomes were not significantly different, students with RAs did take significantly longer to complete the Haematology and Transfusion assessments (p = 0.0012). Specifically, neurodiverse students and those with specific learning differences used on average 81% of their allocated time, students with other RAs used 76%, whereas students without RAs used just 56% (p ≤ 0.0001), highlighting the appropriate adjustment of extra time provided for these students. It was further observed that 1.3% of Resimion activities undertaken by students utilised the in-built inclusivity features in the software. Both students with known RAs, and those without, utilised these features, therefore also aiding students without a formal diagnosis. Conclusion: The scenario-based learning tool Resimion was successfully integrated into the teaching of biomedical science and provided an engaging platform for students, with comparable results to other traditional assessment types.

Effectiveness of online teaching during the COVID-19 pandemic on practical manual therapy skills of undergraduate physiotherapy students

OBJECTIVES

This study includes two separate parts: the objective for part A was to evaluate the practical manual therapy skills of undergraduate physiotherapy students who had learned manual therapy techniques either online or in classroom depending on the phases of the pandemic. The objective for part B was to evaluate in a randomized prospective design the effectiveness of video-based versus traditional teaching of a manual therapy technique.

DESIGN

Cross-sectional cohort study (part A) and randomized controlled trial (part B).

SETTING

University of Luebeck, undergraduate physiotherapy students in years 1-3.

METHOD

In part A, physiotherapy students who had learned manual therapy either online (during the pandemic) or in classroom (prior to and after the lock down periods of the pandemic) were videotaped while performing two manual techniques on the knee joint and on the lumbar spine. Recordings were analyzed independently by two blinded raters according to a 10-item list of criteria. Inter-rater reliability was assessed using Cohen's kappa for each item. Performance across cohorts was analyzed using analysis of variance. In part B, students were randomized to learn a new technique on the cervical spine either from a lecturer or from the same lecturer on a video recording (independent variable). Practical performance of the technique was analyzed by two raters blinded to group allocation according to a 10-item list of criteria (dependent variable). Results were analyzed statistically by using ANCOVA with year of study as a covariate.

RESULTS

Sixty-three and 56 students participated in part A and part B of the study, respectively. The inter-rater reliability for video analyses for both parts of the study was moderate (k = 0.402 to 0.441). In part A, there was no statistically significant difference across years of study for the practical performance of the technique on the back F(2,59) = 2.271; p = 0.112 or the knee joint F(2,59) = 3.028; p = 0.056. In part B, performance was significantly better when learned from a lecturer and practiced on a peer than when learned from a video and practiced on a rescue dummy (p < 0.001).

CONCLUSION

Practical skill performance can be acquired from videos but immediate skill reproduction is significantly better when the technique is presented by a lecturer in classroom and practiced on peer students.

A Diabetes Education App for People Living With Type 2 Diabetes: Co-Design Study

BACKGROUND

Type 2 diabetes (T2D) is a growing global health concern, including in Singapore. Diabetes education programs have been shown to be effective in improving health outcomes and diabetes self-management skills. Mobile health apps have emerged as useful tools for diabetes education; however, their use and acceptance by the target population remain inconsistent. Therefore, end-user participation in the design and development of a mobile health app is crucial for designing an acceptable app that can improve outcomes for populations with a chronic disease.

OBJECTIVE

The objective of this study was to apply an end-user participatory approach to co-design a diabetes education app prototype for people living with T2D by exploring their perceptions, acceptance, and usability of an app prototype, as well as their diabetes experience and perspectives on digital diabetes education.

METHODS

A total of 8 people with T2D, who were recruited from diabetes management Facebook groups, participated in 4 web-based surveys via Qualtrics and 2 structured interviews via Zoom (Zoom Video Communications, Inc) between August 20, 2021, and January 28, 2022. Descriptive statistics and thematic analyses of the discussion and iterative feedback on the app prototype were used to assess the participants' perceptions of living with T2D, attitudes toward digital diabetes education, and acceptance of the prototype.

RESULTS

Analyses of the surveys and interview data revealed 3 themes: challenges of living with T2D; validation, acceptability, and usability of the diabetes education app prototype; and perspectives on digital diabetes education. In the first theme, participants highlighted the importance of solitary accountability, translating knowledge into practice, and developing pragmatic self-consciousness. The second theme indicated that the diabetes education app prototype was acceptable, with information and appearance being key; revealed ambivalent and polarized opinions toward the chatbot; and confirmed potential impact of the app on diabetes self-management skills and practice. The third theme comprised the necessity of using a variety of information-seeking strategies and recommendations for desired content and app qualities, including accessibility, adaptability, autonomy, evidence-based design and content, gamification, guidance, integration, personalization, and up-to-date content. The findings were used to reiterate the app design.

CONCLUSIONS

Despite a small sample size, the study demonstrated the feasibility of engaging and empowering people living with T2D to consider digital therapeutics for diabetes self-management skills and practice. Participants gave rather positive feedback on the design and content of the app prototype, with some recommendations for improvements. The findings suggest that incorporating end-user feedback into app design can lead to the creation of feasible and acceptable tools for diabetes education, potentially improving outcomes for populations with a chronic disease. Further research is needed to test the impact of the refined diabetes education app prototype on diabetes self-management skills and practice and quality of life.

Impact on Knowledge, Competence, and Performance of a Faculty-Led Web-Based Educational Activity for Type 2 Diabetes and Obesity: Questionnaire Study Among Health Care Professionals and Analysis of Anonymized Patient Records

BACKGROUND

Strategies for managing type 2 diabetes (T2D) and obesity are evolving with the introduction of targeted therapies, including incretin-based dual agonists and growing knowledge of the importance of multidisciplinary care. Accessible, effective continuing medical education (CME) activities are required to ensure that health care professionals (HCPs) understand and can implement the most recent data to optimize patient outcomes.

OBJECTIVE

We aimed to measure changes in knowledge, competence, and self-reported performance and quantitatively evaluate changes in performance using anonymized patient data following participation in a web-based educational activity. The faculty-led CME-accredited activity was based on incretin-based dual agonists and patient education on T2D and obesity. The remaining educational gaps in this field were also identified.

METHODS

A CME-accredited, web-based, multidisciplinary (touchMDT) educational activity titled "The future for glycemic control and weight loss in T2D and obesity: Incretin-based dual-agonists and optimizing patient education" was developed. HCP knowledge, competence, and performance were assessed before and after the activity against Moore's expanded outcomes framework (levels 1-5), using self-reported questionnaires and by analyzing anonymized patient record data.

RESULTS

For evaluating knowledge and competence (50 respondents before and 50 learners after the activity), the mean number of correctly answered questions was significantly higher post activity (median 5.0, IQR 4.0-6.0 to 6.0, IQR 5.0-7.0; mean 4.98, SD 1.22 to 5.78, SD 1.13; P<.001). Modest, nonsignificant improvements in self-reported performance (N=50 respondents preactivity; N=50 learners postactivity) from before to after the activity were observed (median 4.0, IQR 3.25-4.0 to 4.0, IQR 4.0-4.0; mean 3.64, SD 0.69 to 3.76, SD 0.48; P=.32). PPatient data analysis indicated that patients were being treated more intensively postactivity: before the activity, the most commonly used treatment regimens were metformin monotherapy (13/50, 26%) and dual therapy with metformin plus injectable glucagon-like peptide-1 (GLP-1) receptor agonist (RA; 11/50, 22%); post activity, this changed to dual therapy with metformin plus injectable GLP-1 RA (12/50, 24%) and triple therapy with metformin plus injectable GLP-1 RA plus sodium-glucose cotransporter-2 inhibitor (SGLT2i; 10/50, 20%). In addition, there was an increased number of referrals to a combination of specialists (physicians referred 27%, 8/30 of patients to ≥2 specialists before the activity and 36%, 10/28 to ≥2 specialists post activity). The remaining educational gaps included understanding the biology and psychology of obesity, efficacy and safety data for incretin-based dual agonists, and the role of the diabetes educator or diabetes care and education specialist in managing T2D and obesity.

CONCLUSIONS

This short, web-based CME activity on the management of T2D and obesity led to improvements in HCP knowledge, competence, and performance. Several remaining unmet needs were identified, which can be used to inform the content of future educational activities in this disease area.

Digital Education for the Deployment of Artificial Intelligence in Health Care

Artificial Intelligence (AI) represents a significant milestone in health care's digital transformation. However, traditional health care education and training often lack digital competencies. To promote safe and effective AI implementation, health care professionals must acquire basic knowledge of machine learning and neural networks, critical evaluation of data sets, integration within clinical workflows, bias control, and human-machine interaction in clinical settings. Additionally, they should understand the legal and ethical aspects of digital health care and the impact of AI adoption. Misconceptions and fears about AI systems could jeopardize its real-life implementation. However, there are multiple barriers to promoting electronic health literacy, including time constraints, overburdened curricula, and the shortage of capacitated professionals. To overcome these challenges, partnerships among developers, professional societies, and academia are essential. Integrating specialists from different backgrounds, including data specialists, lawyers, and social scientists, can significantly contribute to combating digital illiteracy and promoting safe AI implementation in health care.

Interprofessional Needs Analysis and User-Centred Prototype Evaluation as a Foundation for Building Individualized Digital Education in Dementia Healthcare Supported by Artificial Intelligence: A Study Protocol

Continuous profession-specific training is necessary to provide high-quality care for people with dementia. Research shows the need for more educational programmes that are personalized and responsive to the learning needs and preferences of staff. Digital solutions supported by artificial intelligence (AI) may be a means of making these improvements. There is a lack of formats that support learners in selecting the right content according to their learning needs and preferences. The project "My INdividual Digital EDucation.RUHR" (MINDED.RUHR) addresses this problem and seeks to develop an automatized delivery system for individual learning content using AI. The sub-project presented here aims to achieve the following: (a) explore learning needs and preferences regarding behavioural changes in people with dementia, (b) develop learning nuggets, (c) evaluate the feasibility of the digital learning platform, and (d) identify optimization criteria. Following the first phase of the framework for the design and evaluation of digital health interventions (DEDHI), we use a qualitative approach with focus group interviews for exploration and development, and co-design workshops and expert audits to evaluate the developed learning nuggets. The developed e-learning tool is the first step in supporting the digital training of healthcare professionals in the context of caring for people with dementia, individualized through AI.

A Web Tool to Help Counter the Spread of Misinformation and Fake News: Pre-Post Study Among Medical Students to Increase Digital Health Literacy

BACKGROUND

The COVID-19 pandemic was accompanied by the spread of uncontrolled health information and fake news, which also quickly became an infodemic. Emergency communication is a challenge for public health institutions to engage the public during disease outbreaks. Health professionals need a high level of digital health literacy (DHL) to cope with difficulties; therefore, efforts should be made to address this issue starting from undergraduate medical students.

OBJECTIVE

The aim of this study was to investigate the DHL skills of Italian medical students and the effectiveness of an informatics course offered by the University of Florence (Italy). This course focuses on assessing the quality of medical information using the "dottoremaeveroche" (DMEVC) web resource offered by the Italian National Federation of Orders of Surgeons and Dentists, and on health information management.

METHODS

A pre-post study was conducted at the University of Florence between November and December 2020. First-year medical students participated in a web-based survey before and after attending the informatics course. The DHL level was self-assessed using the eHealth Literacy Scale for Italy (IT-eHEALS) tool and questions about the features and quality of the resources. All responses were rated on a 5-point Likert scale. Change in the perception of skills was assessed using the Wilcoxon test.

RESULTS

A total of 341 students participated in the survey at the beginning of the informatics course (women: n=211, 61.9%; mean age 19.8, SD 2.0) and 217 of them (64.2%) completed the survey at the end of the course. At the first assessment, the DHL level was moderate, with a mean total score of the IT-eHEALS of 2.9 (SD 0.9). Students felt confident about finding health-related information on the internet (mean score of 3.4, SD 1.1), whereas they doubted the usefulness of the information they received (mean score of 2.0, SD 1.0). All scores improved significantly in the second assessment. The overall mean score of the IT-eHEALS significantly increased (P<.001) to 4.2 (SD 0.6). The item with the highest score related to recognizing the quality of health information (mean score of 4.5, SD 0.7), whereas confidence in the practical application of the information received remained the lowest (mean of 3.7, SD 1.1) despite improvement. Almost all students (94.5%) valued the DMEVC as an educational tool.

CONCLUSIONS

The DMEVC tool was effective in improving medical students' DHL skills. Effective tools and resources such as the DMEVC website should be used in public health communication to facilitate access to validated evidence and understanding of health recommendations.

The impact of Covid-19 pandemic on modification of medical teaching in Italy: A narrative review

During the first wave of Covid-19 in Italy, there was a problem with University. Universities couldn't do face-to-face (FTF) lessons and started to do online lessons (OL). This study investigates the impressions of students, teachers, and institutions during the first wave situation. A search was conducted on the main international databases, and only studies conducted in Italy starting during the Covid-19 pandemic are considered. 9 studies tell about the impressions of students about OL lessons, and 10 studies speak about medical resident's situation and teacher's impressions. Studies about students give conflicting results, teachers are generally satisfied with the contents, but agree on the difficulty of not having relationships with students. Medical residents have reduced significantly the clinical and surgical practice, sometimes increasing the research. In the future, it is indispensable to create a system that guarantees the efficacy of FTF lessons for practice, it is still low in sanitary and medical courses in Italy during the pandemic period.

Implementation of a Student-Teacher-Based Blended Curriculum for the Training of Medical Students for Nasopharyngeal Swab and Intramuscular Injection: Mixed Methods Pre-Post and Satisfaction Surveys

BACKGROUND

The COVID-19 pandemic caused a major disruption in the health care sector with increased workload and the need for new staff to assist with screening and vaccination tasks. Within this context, teaching medical students to perform intramuscular injections and nasal swabs could help address workforce needs. Although several recent studies discuss medical students' role and integration in clinical activities during the pandemic, knowledge gaps exist concerning their role and potential benefit in designing and leading teaching activities during this period.

OBJECTIVE

The aim of our study was to prospectively assess the impact in terms of confidence, cognitive knowledge, and perceived satisfaction of a student-teacher-designed educational activity consisting of nasopharyngeal swabs and intramuscular injections for the training of second-year medical students in the Faculty of Medicine, University of Geneva, Switzerland.

METHODS

This was a mixed methods pre-post surveys and satisfaction survey study. Activities were designed using evidence-based teaching methodologies based on the SMART (specific, measurable, achievable, realistic, and timely) criteria. All second-year medical students who did not participate in the activity's old format were recruited unless they explicitly stated that they wanted to opt out. Pre-post activity surveys were designed to assess perception of confidence and cognitive knowledge. An additional survey was designed to assess satisfaction in the mentioned activities. Instructional design was blended with a presession e-learning activity and a 2-hour practice session with simulators.

RESULTS

Between December 13, 2021, and January 25, 2022, a total of 108 second-year medical students were recruited; 82 (75.9%) students participated in the preactivity survey and 73 (67.6%) in the postactivity survey. Students' confidence in performing intramuscular injections and nasal swabs significantly increased on a 5-point Likert scale for both procedures-from 3.31 (SD 1.23) and 3.59 (SD 1.13) before the activity to 4.45 (SD 0.62) and 4.32 (SD 0.76) after the activity (P<.001), respectively. Perceptions of cognitive knowledge acquisition also significantly increased for both activities. For the nasopharyngeal swab, knowledge acquisition concerning indications increased from 2.7 (SD 1.24) to 4.15 (SD 0.83), and for the intramuscular injection, knowledge acquisition concerning indications increased from 2.64 (SD 1.1) to 4.34 (SD 0.65) (P<.001). Knowledge of contraindications for both activities increased from 2.43 (SD 1.1) to 3.71 (SD 1.12) and from 2.49 (SD 1.13) to 4.19 (SD 0.63), respectively (P<.001). High satisfaction rates were reported for both activities.

CONCLUSIONS

Student-teacher-based blended activities for training novice medical students in commonly performed procedural skills seem effective for increasing their confidence and cognitive knowledge and should be further integrated within a medical school curriculum. Blended learning instructional design increases students' satisfaction about clinical competency activities. Future research should elucidate the impact of student-teacher-designed and student-teacher-led educational activities.

Design and Assessment of Telepharmacy and Telehealth Training in Two Pharmacy Programs

Objective. To develop and assess the impact of a learning module through the evaluation of students' knowledge of, perceptions of, and intent to provide telepharmacy and telehealth services.Methods. Second- and third-year students from two schools of pharmacy completed a telepharmacy and telehealth learning module and discussion questions. A postsurvey measured their knowledge, perceptions of, and intent to provide remote services.Results. Students scored an average of 94.8% on a post-knowledge assessment. The theory of planned behavior was used to develop a survey measuring intent to provide remote services. Mean scores (1=strongly disagree to 4=strongly agree) were attitude (mean=3.18, SD=0.36), subjective norm (mean=3.02, SD=0.43), behavioral control (mean=2.67, SD=0.41), and intent (mean=2.63, SD=0.59). Thematic analysis of discussion question responses found that students felt the delivery and quality of care was similar between in-person and remote care. Students felt that differences with face-to-face care included technology use and troubleshooting, perceived difficulty in building relationships, and, finally, the inability to provide device training, medication show-and-tell, and physical examinations. They felt telehealth services would expand in the next five years due to increased access, convenience, and cost savings.Conclusion. Upon completion of a learning module, students were knowledgeable about telepharmacy and telehealth. Students agreed that remote services positively impact patient care and would be well received by patients and providers. Students had lower intent to offer remote services upon graduation; thus, simulations and service management information should be added to curricula to prepare students for and develop student interest in telepharmacy and telehealth.

The Use of Open-Source Online Course Content for Training in Public Health Emergencies: Mixed Methods Case Study of a COVID-19 Course Series for Health Professionals

BACKGROUND

The onset of the COVID-19 pandemic generated an urgent need for credible and actionable information to guide public health responses. The massive open-source online course (MOOC) format may be a valuable path for disseminating timely and widely accessible training for health professionals during public health crises; however, the reach and effectiveness of health worker-directed online courses during the pandemic remain largely unexplored.

OBJECTIVE

This study investigated the use of an open-source online course series designed to provide critical COVID-19 knowledge to frontline health workers and public health professionals globally. The study investigated how open-source online educational content can be optimized to support knowledge sharing among health professionals in public health emergencies, particularly in resource-limited contexts.

METHODS

The study examined global course enrollment patterns (N=2185) and performed in-depth interviews with a purposive subsample of health professionals enrolled in the course series (N=12) to investigate the sharing of online content in pandemic responses. Interviewed learners were from Ethiopia, India, Kenya, Liberia, Malawi, Rwanda, Thailand, Uganda, the United Arab Emirates, and the United States. Inductive analysis and constant comparative methods were used to systematically code data and identify key themes emerging from interview data.

RESULTS

The analysis revealed that the online course content helped fill a critical gap in trustworthy COVID-19 information for pandemic responses and was shared through health worker professional and personal networks. Enrollment patterns and qualitative data illustrate how health professionals shared information within their professional networks. While learners shared the knowledge they gained from the course, they expressed a need for contextualized information to more effectively educate others in their networks and in their communities. Due to technological and logistical barriers, participants did not attempt to adapt the content to share with others.

CONCLUSIONS

This study illustrates that health professional networks can facilitate the sharing of online open-source health education content; however, to fully leverage potential benefits, additional support is required to facilitate the adaptation of course content to more effectively reach communities globally.

Impact of Coding Educational Programs (CEP) on Digital Media Problematic Use (DMPU) and on Its Relationship with Psychological Dependence and Emotional Dysregulation

Alongside the positive effects linked to the introduction of digital technologies into our lives, particular dysfunctional behaviors in the use of digital tools have appeared, through which the expression of conditions such as addiction, difficulties in affective and behavioral self-regulation and mental health problems have been channeled. The present study aims to investigate, in a sample of young students aged m = 12.91 (ds = 0.56) years, whether Coding Educational Programs (CEP), deployed to 44.9% of the sample, is effective in psychological dependence, emotional self-regulation and Digital Media Problematic Use (DMPU), as self-assessed through questionnaires (DERS, DSRS, IAT, MPIQ and MPPUS). CEP had no effect on emotional dysregulation or on DMPU. They were effective in the time management of mobile phone use, with students rescheduling from daytime use on working days to daytime use on the weekend. Moreover, people who attended CEP more frequently used smartphones for orienting themselves and for obtaining information. In conclusion, CEP are effective in achieving a more functional and important use of smartphones and better time management. It is possible that CEP effect on metacognition could reduce DMPU if alternative ways to regulate emotions are available.

Perceptions and Expectations of Academic Staff in Bucharest towards the COVID-19 Pandemic Impact on Dental Education

Dental education was severely challenged by the COVID-19 pandemic worldwide. The evaluation of the viewpoint of the dental teachers of the Faculty of Dentistry at "Carol Davila" University of Medicine and Pharmacy in Bucharest, Romania, on these exceptional circumstances' consequences was the objective of this paper. A cross-sectional study was conducted in April 2022, on the academic staff who reported their perceptions of the emotional and educational impact of the pandemic by completing a Google Forms questionnaire. Although a significant emotional impact of the pandemic was reported by over a third of the participants (31.2%), most of them being teachers of fifth-year dental students (p = 0.019), the perceived stress had an impact on the teaching performance in few of them (14%), the quality of sleep remaining unaffected in most of them (53.7%), whereas the level of anxiety was low (57%). An educational impact regarding the techno difficulties during the online transition was mentioned by few respondents (16.1%), with male teaching staff facing the fewest problems (p = 0.024), as well as low levels of difficulties in transmitting academic information (11.9), with men also being the most unaffected (p = 0.006). More than half of the participants (59.1%) rather see digital and/or virtual education during the pandemic as having adverse effects on the educational system, the most sceptical being teachers of the fifth (p = 0.001) and sixth years (p = 0.001). The COVID-19 pandemic affected the academic staff of the Faculty of Dentistry at "Carol Davila" University of Medicine and Pharmacy in Bucharest, Romania, not only at a personal level but also at a professional, pedagogical one, due to the introduction of the online teaching system followed by the hybrid one. Age group, gender, and teaching year differentiated the degree of emotional and educational impairment.

Beliefs and expectations on digital learning and examinations among adult learners of a tertiary level health-care institution

BACKGROUND

Coronavirus disease 2019 (COVID-19) constrained the regular teaching in educational institutions and hampered the teaching-learning process across the globe. E-learning method is widely used in higher education in the current situation. the objective is to assess the beliefs and expectations of the students on e-learning among adult learners of a tertiary level health-care institution.

MATERIALS AND METHODS

A single group pre-post design was adopted. Microsoft Go two-in-one devices were used to find the effectiveness of e-learning, including digital exam solution. Depending on the availability of device, 25 participants were selected for the study from three different steams. A 5-point Likert scale was used for assessing the quality, adoptability, and acceptance of digital education developed by the researchers. Chi-square/Fisher's exact or McNemar's test was used to test the association between independent or related categorical variables. Comparison of the average score between different courses was performed using the Kruskal-Wallis test.

RESULTS

Twenty-two participants who completed the final assessment were retained for the analysis. Majority of the participants believed that e-learning helps to achieve personal learning goals or objectives and bridge skill or knowledge gaps and caters to learning preferences. However, the overall quality score across the study groups was found to be statistically insignificant (Kruskal-Wallis statistic: 1.26; P value: 0.533).

CONCLUSION

The findings show that the adult learners in higher education, irrespective of their age differences, believe that intense e-learning support with Microsoft Go two-in-one device has a complementary effect on their learning outcome.

Migration of an Escape Room-Style Educational Game to an Online Environment: Design Thinking Methodology

Background

The COVID-19 pandemic outbreak has led to a sudden change in education, closing schools and shifting to online teaching, which has become an enormous challenge for teachers and students. Implementing adequate online pedagogical approaches and integrating different digital tools in the teaching process have become a priority in educational systems. Finding a way to keep students' interest and persistence in learning is an important issue that online education is facing. One possible way to establish engaging and interactive learning environments, using the energy and enthusiasm of students for educational purposes, is the use of game-based learning activities and gamification of different parts of the educational process.

Objective

This paper presents a use case of migrating an escape room–style educational game to an online environment by using the design thinking methodology. We wanted to show that the design thinking methodology is useful to create engaging and motivating online games that provide educational value.

Methods

Starting from students’ perspective, we created a simple digital escape room–style game where students got an opportunity to self-assess their knowledge in computer science at their own pace. Students tested this prototype game, and their opinions about the game were collected through an online survey. The test's goal was to evaluate the students' perceptions about the implemented digital escape room–style educational game and gather information about whether it could achieve students' engagement in learning computer science during online teaching.

Results

In total, 117 students from sixth and seventh grades completed the survey regarding the achieved student engagement. Despite the differences in students’ answers about game complexity and puzzle difficulty, most students liked the activity (mean 4.75, SD 0.67, on a scale from 1 to 5). They enjoyed the game, and they would like to participate in this kind of activity again (mean 4.74, SD 0.68). All (n=117, 100%) students found the digital escape room–style educational game interesting for playing and learning.

Conclusions

The results confirmed that digital escape room–style games could be used as an educational tool to engage students in the learning process and achieve learning outcomes. Furthermore, the design thinking methodology proved to be a useful tool in the process of adding novel educational value to the digital escape room–style game.

Using Mobile Virtual Reality Simulation to Prepare for In-Person Helping Babies Breathe Training: Secondary Analysis of a Randomized Controlled Trial (the eHBB/mHBS Trial)

BACKGROUND

Neonatal mortality accounts for approximately 46% of global under-5 child mortality. The widespread access to mobile devices in low- and middle-income countries has enabled innovations, such as mobile virtual reality (VR), to be leveraged in simulation education for health care workers.

OBJECTIVE

This study explores the feasibility and educational efficacy of using mobile VR for the precourse preparation of health care professionals in neonatal resuscitation training.

METHODS

Health care professionals in obstetrics and newborn care units at 20 secondary and tertiary health care facilities in Lagos, Nigeria, and Busia, Western Kenya, who had not received training in Helping Babies Breathe (HBB) within the past 1 year were randomized to access the electronic HBB VR simulation and digitized HBB Provider's Guide (VR group) or the digitized HBB Provider's Guide only (control group). A sample size of 91 participants per group was calculated based on the main study protocol that was previously published. Participants were directed to use the electronic HBB VR simulation and digitized HBB Provider's Guide or the digitized HBB Provider's Guide alone for a minimum of 20 minutes. HBB knowledge and skills assessments were then conducted, which were immediately followed by a standard, in-person HBB training course that was led by study staff and used standard HBB evaluation tools and the Neonatalie Live manikin (Laerdal Medical).

RESULTS

A total of 179 nurses and midwives participated (VR group: n=91; control group: n=88). The overall performance scores on the knowledge check (P=.29), bag and mask ventilation skills check (P=.34), and Objective Structured Clinical Examination A checklist (P=.43) were similar between groups, with low overall pass rates (6/178, 3.4% of participants). During the Objective Structured Clinical Examination A test, participants in the VR group performed better on the critical step of positioning the head and clearing the airway (VR group: 77/90, 86%; control group: 57/88, 65%; P=.002). The median percentage of ventilations that were performed via head tilt, as recorded by the Neonatalie Live manikin, was also numerically higher in the VR group (75%, IQR 9%-98%) than in the control group (62%, IQR 13%-97%), though not statistically significantly different (P=.35). Participants in the control group performed better on the identifying a helper and reviewing the emergency plan step (VR group: 7/90, 8%; control group: 16/88, 18%; P=.045) and the washing hands step (VR group: 20/90, 22%; control group: 32/88, 36%; P=.048).

CONCLUSIONS

The use of digital interventions, such as mobile VR simulations, may be a viable approach to precourse preparation in neonatal resuscitation training for health care professionals in low- and middle-income countries.

Instructor Development Workshops for Advanced Life Support Training Courses Held in a Fully Virtual Space: Observational Study

Background

Various face-to-face training opportunities have been lost due to the COVID-19 pandemic. Instructor development workshops for advanced resuscitation (ie, advanced life support) training courses are no exception. Virtual reality (VR) is an attractive strategy for remote training. However, to our knowledge, there are no reports of resuscitation instructor training programs being held in a virtual space.

Objective

This study aimed to investigate the learning effects of an instructor development workshop that was conducted in a virtual space.

Methods

In this observational study, we created a virtual workshop space by using NEUTRANS (Synamon Inc)—a commercial VR collaboration service. The instructor development workshop for the advanced life support training course was held in a virtual space (ie, termed the VR course) as a certified workshop by the Japanese Association of Acute Medicine. We asked 13 instructor candidates (students) who participated in the VR course to provide a workshop report (VR group). Reports from a previously held face-to-face workshop (ie, the face-to-face course and group) were likewise prepared for comparison. A total of 5 certified instructor trainers viewed and scored the reports on a 5-point Likert scale.

Results

All students completed the VR course without any problems and received certificates of completion. The scores for the VR group and the face-to-face group did not differ at the level of statistical significance (median 3.8, IQR 3.8-4.0 and median 4.2, IQR 3.9-4.2, respectively; P=.41).

Conclusions

We successfully conducted an instructor development workshop in a virtual space. The degree of learning in the virtual workshop was the same as that in the face-to-face workshop.

Why are you offline? The issue of digital consent and discrimination of Roma communities during pandemic in Slovakia

The article is focused on the issue of discrimination against Roma communities in the use of educational online platforms on account of failure to provide digital consent. The digital education model used during the COVID-19 pandemic in the Slovak Republic somehow forgot about Roma communities, thus preventing Roma students from accessing education through online platforms. This contribution is aimed to foster the discussion of discrimination against marginalized Roma communities in accessing education through online platforms and to point out the inadequacy of national legislation on the provision of digital consent.

Using Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2

Background

COVID-19 has had a catastrophic impact in terms of human lives lost. Medical education has also been impacted as appropriately stringent infection control policies precluded medical trainees from attending clinical teaching. Lecture-based education has been easily transferred to a digital platform, but bedside teaching has not.

Objective

This study aims to assess the feasibility of using a mixed reality (MR) headset to deliver remote bedside teaching.

Methods

Two MR sessions were led by senior doctors wearing the HoloLens headset. The trainers selected patients requiring their specialist input. The headset allowed bidirectional audiovisual communication between the trainer and trainee doctors. Trainee doctor conceptions of bedside teaching, impact of the COVID-19 pandemic on bedside teaching, and the MR sessions were evaluated using pre- and postround questionnaires, using Likert scales. Data related to clinician exposure to at-risk patients and use of personal protective equipment (PPE) were collected.

Results

Prequestionnaire respondents (n=24) strongly agreed that bedside teaching is key to educating clinicians (median 7, IQR 6-7). Postsession questionnaires showed that, overall, users subjectively agreed the MR session was helpful to their learning (median 6, IQR 5.25-7) and that it was worthwhile (median 6, IQR 5.25-7). Mixed reality versus in-person teaching led to a 79.5% reduction in cumulative clinician exposure time and 83.3% reduction in PPE use.

Conclusions

This study is proof of principle that HoloLens can be used effectively to deliver clinical bedside teaching. This novel format confers significant advantages in terms of minimizing exposure of trainees to COVID-19, reducing PPE use, enabling larger attendance, and delivering convenient and accessible real-time clinical training.

The Development and Evaluation of an e-Learning Course That Promotes Digital Health Literacy in School-age Children: Pre-Post Measurement Study

Background

Experts agree that the promotion of (digital) health literacy should be an integral part of the school curriculum. However, promoting (digital) health literacy within the German school system is difficult because (digital) health education is not a mandatory school subject in all the German states. Therefore, experts suggest that (digital) health literacy could be addressed as part of the mandatory framework for digital education and digital literacy in schools developed by the German Conference on Education Ministries and Cultural Affairs (Kultusministerkonferenz).

Objective

The goal of this study was to evaluate a newly developed e-learning course that was designed to improve (digital) health literacy in school-age children and concurrently to teach skills specified in the mandatory framework for digital education and digital literacy in schools. It was hypothesized that participants’ health literacy and digital health literacy levels would be higher after completing the e-learning course than they were before doing the course. Furthermore, it was hypothesized that after completing the e-learning course, participants’ subjective and objective knowledge in the domain of (digital) health literacy would be higher than it was before doing the course.

Methods

The pre-post measurement study was conducted online. After participants (N=323) gave their informed consent to participate in the study, they provided demographic information and answered all measures (premeasurement). Following this, participants had 7 days to complete the e-learning course. After finishing the e-learning course, participants answered all the measures again (postmeasurement).

Results

To test the hypotheses, Bayesian paired samples t tests (1-sided) were conducted. After completing the e-learning course, participants showed higher health literacy levels. Specifically, they showed higher competency levels in the domains of theoretical knowledge (Bayes factor [BF]_–0=676,000; δ=–0.316), practical knowledge (BF_–0=92,300; δ=–0.294), critical thinking (BF_–0=7.42e+13; δ=–0.482), self-awareness (BF_–0=11,500,000; δ=–0.345), and citizenship (BF_–0=266,000; δ=–0.306). Furthermore, participants achieved higher digital health literacy levels. Specifically, they achieved higher competency levels in the domains of information searching (BF_–0=2.339; δ=–0.135), evaluating reliability (BF_–0=2.03e+11; δ=–0.434), and determining relevance (BF_–0=316,000; δ=–0.308). Moreover, participants demonstrated higher subjective (BF_–0=3.58e+82; δ=–1.515) and objective knowledge (BF_–0=3.82e+97; δ=–1.758) in the domain of (digital) health literacy.

Conclusions

The newly designed e-learning course provides an easy way for schools and teachers from all German states to integrate (digital) health literacy education into their school curriculums and lessons. The evaluated course is especially attractive because it was designed to improve (digital) health literacy and at the same time to teach skills specified in the mandatory framework for digital education and digital literacy in schools developed by the German Conference on Education Ministries and Cultural Affairs (Kultusministerkonferenz).

Outcomes, Measurement Instruments, and Their Validity Evidence in Randomized Controlled Trials on Virtual, Augmented, and Mixed Reality in Undergraduate Medical Education: Systematic Mapping Review

BACKGROUND

Extended reality, which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR), is increasingly used in medical education. Studies assessing the effectiveness of these new educational modalities should measure relevant outcomes using outcome measurement tools with validity evidence.

OBJECTIVE

Our aim is to determine the choice of outcomes, measurement instruments, and the use of measurement instruments with validity evidence in randomized controlled trials (RCTs) on the effectiveness of VR, AR, and MR in medical student education.

METHODS

We conducted a systematic mapping review. We searched 7 major bibliographic databases from January 1990 to April 2020, and 2 reviewers screened the citations and extracted data independently from the included studies. We report our findings in line with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

Of the 126 retrieved RCTs, 115 (91.3%) were on VR and 11 (8.7%) were on AR. No RCT on MR in medical student education was found. Of the 115 studies on VR, 64 (55.6%) were on VR simulators, 30 (26.1%) on screen-based VR, 9 (7.8%) on VR patient simulations, and 12 (10.4%) on VR serious games. Most studies reported only a single outcome and immediate postintervention assessment data. Skills outcome was the most common outcome reported in studies on VR simulators (97%), VR patient simulations (100%), and AR (73%). Knowledge was the most common outcome reported in studies on screen-based VR (80%) and VR serious games (58%). Less common outcomes included participants' attitudes, satisfaction, cognitive or mental load, learning efficacy, engagement or self-efficacy beliefs, emotional state, competency developed, and patient outcomes. At least one form of validity evidence was found in approximately half of the studies on VR simulators (55%), VR patient simulations (56%), VR serious games (58%), and AR (55%) and in a quarter of the studies on screen-based VR (27%). Most studies used assessment methods that were implemented in a nondigital format, such as paper-based written exercises or in-person assessments where examiners observed performance (72%).

CONCLUSIONS

RCTs on VR and AR in medical education report a restricted range of outcomes, mostly skills and knowledge. The studies largely report immediate postintervention outcome data and use assessment methods that are in a nondigital format. Future RCTs should include a broader set of outcomes, report on the validity evidence of the measurement instruments used, and explore the use of assessments that are implemented digitally.

Digital Education for Health Professionals: An Evidence Map, Conceptual Framework, and Research Agenda

BACKGROUND

Health professions education has undergone major changes with the advent and adoption of digital technologies worldwide.

OBJECTIVE

This study aims to map the existing evidence and identify gaps and research priorities to enable robust and relevant research in digital health professions education.

METHODS

We searched for systematic reviews on the digital education of practicing and student health care professionals. We searched MEDLINE, Embase, Cochrane Library, Educational Research Information Center, CINAHL, and gray literature sources from January 2014 to July 2020. A total of 2 authors independently screened the studies, extracted the data, and synthesized the findings. We outlined the key characteristics of the included reviews, the quality of the evidence they synthesized, and recommendations for future research. We mapped the empirical findings and research recommendations against the newly developed conceptual framework.

RESULTS

We identified 77 eligible systematic reviews. All of them included experimental studies and evaluated the effectiveness of digital education interventions in different health care disciplines or different digital education modalities. Most reviews included studies on various digital education modalities (22/77, 29%), virtual reality (19/77, 25%), and online education (10/77, 13%). Most reviews focused on health professions education in general (36/77, 47%), surgery (13/77, 17%), and nursing (11/77, 14%). The reviews mainly assessed participants' skills (51/77, 66%) and knowledge (49/77, 64%) and included data from high-income countries (53/77, 69%). Our novel conceptual framework of digital health professions education comprises 6 key domains (context, infrastructure, education, learners, research, and quality improvement) and 16 subdomains. Finally, we identified 61 unique questions for future research in these reviews; these mapped to framework domains of education (29/61, 47% recommendations), context (17/61, 28% recommendations), infrastructure (9/61, 15% recommendations), learners (3/61, 5% recommendations), and research (3/61, 5% recommendations).

CONCLUSIONS

We identified a large number of research questions regarding digital education, which collectively reflect a diverse and comprehensive research agenda. Our conceptual framework will help educators and researchers plan, develop, and study digital education. More evidence from low- and middle-income countries is needed.

Comparison of Interactive Teaching in Online and Offline Platforms among Dental Undergraduates

In recent years, the educational system has focused more on the holistic development of an individual. Modern technology has changed the educational environment to provide students with better academic opportunities. Along with the education system, teaching techniques and learning tools have also changed with digital evolution. This research was undertaken to assess the academic performance of interactive teaching methods in offline and online platforms in Periodontics among BDS undergraduates at a dental college in India. This prospective study was conducted among 49 students: Group I (n = 24, online class through Zoom) and Group II (n = 25, offline classes). The subject was divided into three modules and was covered in one week. The topics covered, teaching methods, lectures, and activities were similar for both groups. A formative assessment mark was obtained from written tests during the module, whereas the summative assessment mark was recorded from exams conducted towards the end of the module. In the results, a statistically significant difference was not observed in terms of formative assessment between Group I (77.88 ± 12.89) and Group II (77.80 ± 16.09) (p = 0.98). In addition, a statistically significant difference was not observed in terms of summative assessment between Group I (80.54 ± 8.39) and Group II (80.28 ± 11.57) (p = 0.93). Overall, this study suggests that interactive teaching methods in both offline and online platforms in Periodontics showed equivalent performance by the undergraduate dental students.

A Computer-Based Interactive Narrative and a Serious Game for Children With Asthma: Development and Content Validity Analysis

Background

Nonadherence to medications, failure to prevent exposure to asthma triggers, lack of knowledge about using medications, and fixed mindsets contribute to poor asthma control in children. Digital learning could provide a new strategy for improving health-related outcomes in children with asthma.

Objective

The aim of this study is to develop and design a digital educational program, titled Module of Inhaler and Asthma Triggers for Children (MIRACLE), for Indonesian children with asthma. The program comprises an interactive narrative and a serious game. It was proposed to increase the understanding of asthma self-management, instruct on proper inhaler techniques, improve asthma control, and promote a growth mindset for children with asthma.

Methods

Two phases of research were conducted to develop the program. In the first phase, a literature search and two rounds of the Delphi technique were conducted to obtain agreement from an expert panel regarding elements of asthma self-management and the design of interactive narratives and a serious game. The expert panel item statements were evaluated using the content validity index (CVI). In the second phase, the SERES framework, Norma Engaging Multimedia Design, and Psychological Theory of Growth Mindset were applied to create a storyline, learn objectives, and game challenges.

Results

In the first phase, 40 experts were invited to participate in Delphi round 1. Forty responses were collected to generate 38 item statements that consisted of part 1, elements of asthma self-management (25 items), and part 2, design of an interactive narrative and a serious game (13 items); 38 experts were involved in Delphi round 2. In total, 24 statements in part 1 and 13 items in part 2 had item-CVI values >0.80. The average CVI was 0.9, which was considered acceptable. Four narrative plots and five game sessions were developed during the second phase. Challenges with the scenario, scoring, and feedback on asthma difficulties were designed to promote a growth mindset for learners.

Conclusions

We developed a culture-specific, computer-based asthma program containing an interactive narrative and a serious game to deliver asthma self-management and promote a growth mindset among Indonesian children.

Virtual Interactive Surgical Skills Classroom: Protocol for a Parallel-Group, Noninferiority, Adjudicator-Blinded, Randomized Controlled Trial (VIRTUAL)

Background

Traditional face-to-face training (FFT) for basic surgical skills is inaccessible and resource-intensive. Noninteractive computer-based learning is more economical but less educationally beneficial. Virtual classroom training (VCT) is a novel method that permits distanced interactive expert instruction. VCT may optimize resources and increase accessibility.

Objective

We aim to investigate whether VCT is superior to computer-based learning and noninferior to FFT in improving proficiency in basic surgical skills.

Methods

This is a protocol for a parallel-group, noninferiority, randomized controlled trial. A sample of 72 undergraduates will be recruited from 5 medical schools in London. Participants will be stratified by subjective and objective suturing experience level and allocated to 3 intervention groups at a 1:1:1 ratio. VCT will be delivered using the BARCO weConnect software, and FFT will be provided by expert instructors. Optimal student-to-teacher ratios of 12:1 for VCT and 4:1 for FFT will be maintained. The assessed task will be interrupted suturing with hand-tied knots.

Results

The primary outcome will be the postintervention Objective Structured Assessment of Technical Skills score, adjudicated by 2 experts blinded to the study and adjusted for baseline proficiency. The noninferiority margin (δ) will be defined using historical data.

Conclusions

This study will serve as a comprehensive appraisal of the suitability of virtual basic surgical skills classroom training as an alternative to FFT. Our findings will assist the development and implementation of further resource-efficient, accessible, virtual basic surgical skills training programs during the COVID-19 pandemic and in the future.

Trial Registration

International Standard Randomized Controlled Trial Number ISRCTN12448098; https://www.isrctn.com/ISRCTN12448098

International Registered Report Identifier (IRRID)

PRR1-10.2196/28671

Policy Recommendations for Preventing Problematic Internet Use in Schools: A Qualitative Study of Parental Perspectives

Parenting in the digital age has been characterized as one of the most challenging tasks of the modern era. Parents are ambivalent about their mediating role. However, problematic aspects of adolescent online use have not been adequately addressed in education. The present study investigated parental perceptions of intervention needs within schools to prevent excessive/problematic use, enhance parent-child communication, and reduce family conflicts. Nine interviews with parents of adolescents residing in the UK were carried out and analyzed utilizing thematic analysis. Three main themes emerged as parental proposals: (i) schools as digital education providers and prevention hubs, (ii) provision of mental health literacy to raise awareness, resolve ambiguity regarding impacts and mitigate excessive use and impacts, and (iii) psychoeducation and upskilling. The third theme related to impacts from time spent on screens (time displacement), content-related impacts, and context-related impacts. The present study offers recommendations for media literacy during adolescence beyond e-safety (i.e., addressing interpersonal communication problems, privacy vs. disclosure issues), based on parents' views, and provides new insights for media and emotional health literacy collaboration efforts. Future work should investigate the feasibility and effectiveness of such interventions to support the emotional health of young people and prevent problematic internet use escalation.

Twelve tips for using synchronous virtual classroom technologies in medical education

This article was migrated. The article was marked as recommended. The COVID-19 pandemic has resulted in unprecedented transformations in medical education, with a shift from face-to-face learning activities to digital education. Virtual classroom technologies have played a pivotal role in supporting synchronous teaching activities; however, it can be extremely challenging for many educators to use virtual classrooms tools effectively. This article presents twelve tips based on best practices in educational design, learning theories, current research in online learning, and the authors' personal experiences of designing online activities within medical education. The twelve tips aim to help medical educators use virtual classroom solutions more effectively to promote learner engagement and learning.

Get Privacy Trending: Best Practices for the Social Media Educator

Social media is an increasingly popular forum for medical education. Many educators, including those in infectious diseases, are now creating and sharing unique and educational patient cases online. Unfortunately, some educators unknowingly threaten patient privacy and open themselves to legal liability. Further, the use of published figures or tables creates risk of copyright infringement. As more and more infectious diseases physicians engage in social media, it is imperative to create best practices to protect both patients and physicians. This summary will define the legal requirements of patient de-identification as well as other practical recommendations as they relate to use of clinical case information, patient images, and attribution of primary references on social media.

Management lessons through an interactive online discussion about hospital management during the COVID-19 pandemic

Background: In light of the COVID-19 pandemic and resulting demand for innovative hospital management we organized an interactive online discussion for medical students and healthcare professionals about hospital management during the crisis. Objective: The event offered an opportunity to learn from a hospital crisis management. We looked at how this new online format compares to a traditional discussion event. Methods: We used an online platform with four guests, a moderator and about 100 attendees. During the event we gathered demographic facts through an interactive questionnaire tool and an extensive evaluation afterwards. Results: The event was rated with an overall grade of 1.4 (Likert from 1 to 6, 1 best grade; SD 0.5) and participants agreed that this format should be organized again (1.2; SD 0.5). 70% of audience members preferred the online format of the event. Due to the high volume, only about 30% (total n~35) of the questions posed by the audience were addressed. Conclusion: Firstly, most participants preferred the event to be online, contrary to our expectation. Secondly, the handling of the amount of individual questions posed significant challenges. Finally, the number of attendees and questions suggested a continuing demand among students and physicians for further education regarding hospital management, especially regarding COVID-19. These findings also require a critical look at future formats and topics of podium discussions in medical education. The online format might be a good alternative to face-to-face lectures.

"The lockdown of physical co-operation touches the heart of adult education": A Delphi study on immediate and expected effects of COVID-19

This article is based on the first wave of an ongoing worldwide Delphi study which is currently analysing the immediate and expected effects of the COVID-19 pandemic on adult education and adult learning. While the methodology of Delphi studies varies a lot, in a nutshell, the core idea of a Delphi study is that it explores the future of a particular field in a collaborative way. The authors contacted more than 50 international experts in the field of adult education for a qualitative online survey between April and May 2020, asking them to provide information, observations, expectations and advice. While the findings show many cross-national similarities, there are also many differences. Clearly, adult educators are still trying to understand the implications of the crisis, which they perceive as unprecedented.

Development and evaluation of a digital education tool for medical students in wound care

The aim of this study was to develop and evaluate an interactive, video‐enhanced, and case‐based online course for medical students. We chose a case about wound care since this topic is still underrepresented in the medical curriculum. First, instructional videos were created to teach practical skills in wound care. These were implemented into a case‐based online course, using the online learning platform ILIAS. In a comparative initial and final survey, numbers of users were assessed, content and structure of the course, as well as the thematic interest of the students and self‐assessed gain of competence, were evaluated. Since the summer of 2019, 310 students have successfully completed the course. The survey data showed a high participation rate and a positive response regarding the content as well as the structural concept. Most of the students rated the content within the course as useful for their future medical work (86.1%) and the gain of knowledge superior to a traditional lecture (69.4%). Self‐assessments of video‐mediated skills showed a significant increase in subjectively perceived competence. The online course is an efficient way to reach many students by the small use of resources. It resembles an option to arouse growing interest in wound care in medical students.

Promoting Students' Well-Being and Inclusion in Schools Through Digital Technologies: Perceptions of Students, Teachers, and School Leaders in Italy Expressed Through SELFIE Piloting Activities

Digital technology in its various forms is a significant component of our working environment and lifestyles. However, there is a broad difference between using digital technologies in everyday life and employing them in formal education. Digital technologies have largely untapped potential for improving education and fostering students' well-being and inclusion at school. To bring this to fruition, systemic and coordinated actions involving the whole school community are called for. To help schools exploit the full range of opportunities digital technologies offer for learning, the European Commission has designed and implemented a self-reflection tool called SELFIE (Self-reflection on Effective Learning by Fostering Innovation through Educational Technology). Based on the DigCompOrg conceptual framework, SELFIE encompasses key aspects for effectively integrating digital technologies in school policies and practices. The present study investigates how SELFIE can also support the school community to self-reflect about students' well-being and inclusion. In Italy, the SELFIE online questionnaire has been completed by 24,715 students, 5,690 teachers, and 1,507 school leaders, for a total of 31,912 users from 201 schools (at primary, lower secondary, and upper secondary levels) located in 10 different regions. The complementary data we have collected regarding student well-being and inclusion highlight significant differences in the perceptions on this issue reported by students, teachers, and school leaders. These findings have important implications for facilitating successful practices within the whole school community in order to promote students' well-being and inclusion using educational technologies, as well as for planning future actions following a systemic approach.

A multifaceted continuing professional development intervention to move stroke rehabilitation guidelines into professional practice: A feasibility study

INTRODUCTION

Rehabilitation post-stroke is critical for maximizing patient outcomes. This study assessed the feasibility of implementing and evaluating a continuing professional development (CPD) intervention aimed at increasing the uptake of stroke best practice guidelines among physiotherapists (PTs), occupational therapists (OTs) and speech-language pathologists (SLPs) in six university-affiliated stroke rehabilitation centers in Quebec, Canada.

METHOD

Twelve stroke best practice recommendations with reflective tools were sent weekly by e-mail. Participants' eligibility criteria included: a) profession; b) practicing more than 1 year in a stroke rehabilitation program; c) fluency in French or English; and d) basic computer literacy. Feasibility (operationalized via participation, satisfaction and relevance), cognitive impact, perceived application in practice and expected patient outcomes were measured over 24 weeks using three questionnaires and analyzed using descriptive statistics.

RESULTS

The sample totaled 62 of 133 eligible (47%) clinicians. Satisfaction, relevance and cognitive impact of delivered information varied across disciplines and recommendations. Agreement with the recommendations was high across disciplines. On average, three-interdisciplinary recommendations (related to post-stoke depression, post-stoke fatigue and patients' and caregivers' learning needs) were rated as the most relevant for at least one patient. The majority of clinicians would use the recommendations for a specific patient and expected health benefits by applying those recommendations.

CONCLUSION

This study demonstrated the feasibility of assessing the impact of a CPD intervention in stroke rehabilitation uptake and informed the design of a research program aimed at increasing the use of stroke evidence-based rehabilitation interventions.

The Italian Deaf Community at the Time of Coronavirus

The present paper will explore the impacts of the recent pandemic crisis on the Italian Deaf community, as a linguistic minority. Recent research has shown that minorities are suffering much more the effects of the pandemia because their lack of access to services and in a much wider perspective, to education and welfare. We will show that, during the COVID crisis, despite lockdown measures, various actions at the formal political level (from the Italian Deaf Association) and at the informal level (from the members of the community) promoted sign language and the Deaf community within the hearing majority. In particular, we will analyse how social networks were exploited at the grassroot level in order to promote social cohesion and share information about the coronavirus emergency and how the Deaf community shaped the interpreting services on the public media. The role of social networks, however, has gone far beyond the emergency as it has allowed deaf people to create a new virtual space where it was possible to discuss the appropriateness of various linguistic choices related to the COVID lexicon and to argue about the various interpreting services. Furthermore, in such emergency, the interpreting services were shaped following the needs expressed by the Deaf community with the results of an increased visibility of Italian sign language (LIS) and empowerment of the community. Materials spontaneously produced by members of the Deaf Italian community (conferences, debates, fairy tales, and entertainment games) were selected, as well as materials produced by LIS interpreters committed to guaranteeing access to information. By highlighting the strategies that a minority group put in place to deal with the COVID-19 emergency, we can better understand the peculiarities of that community, creating a bridge between worlds that often travel in parallel for respecting the peculiarities of each other (deaf and hearing communities).

Digital Health Professions Education in the Field of Pediatrics: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

BACKGROUND

Reducing childhood morbidity and mortality is challenging, particularly in countries with a shortage of qualified health care workers. Lack of trainers makes it difficult to provide the necessary continuing education in pediatrics for postregistration health professionals. Digital education, teaching and learning by means of digital technologies, has the potential to deliver medical education to a large audience while limiting the number of trainers needed.

OBJECTIVE

The goal of the research was to evaluate whether digital education can replace traditional learning to improve postregistration health professionals' knowledge, skills, attitudes, and satisfaction and foster behavior change in the field of pediatrics.

METHODS

We completed a systematic review of the literature by following the Cochrane methodology. We searched 7 major electronic databases for articles published from January 1990 to August 2017. No language restrictions were applied. We independently selected studies, extracted data, and assessed risk of bias, and pairs of authors compared information. We contacted authors of studies for additional information if necessary. All pooled analyses were based on random effects models. We included individually or cluster randomized controlled trials that compared digital education with traditional learning, no intervention, or other forms of digital education. We assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) criteria.

RESULTS

Twenty studies (1382 participants) were included. Participants included pediatricians, physicians, nurses, and midwives. Digital education technologies were assessed including high-fidelity mannequins (6 studies), computer-based education (12 studies), mobile learning (1 study), and virtual reality (1 study). Most studies reported that digital education was either as effective as or more effective than the control intervention for outcomes including skill, knowledge, attitude, and satisfaction. High-fidelity mannequins were associated with higher postintervention skill scores compared with low-fidelity mannequins (standardized mean difference 0.62; 95% CI 0.17-1.06; moderate effect size, low-quality evidence). One study reported physician change in practicing behavior and found similar effects between offline plus online digital education and no intervention. The only study that assessed impact on patient outcome found no difference between intervention and control groups. None of the included studies reported adverse or untoward effects or economic outcomes of the digital education interventions. The risk of bias was mainly unclear or high. The quality of evidence was low due to study inconsistencies, limitations, or imprecision across the studies.

CONCLUSIONS

Digital education for postregistration health professions education in pediatrics is at least as effective as traditional learning and more effective than no learning. High-fidelity mannequins were found to be more effective at improving skills than traditional learning with low-fidelity mannequins. Computer-based offline/online digital education was better than no intervention for knowledge and skill outcomes and as good as traditional face-to-face learning. This review highlights evidence gaps calling for more methodologically rigorous randomized controlled trials on the topic.

TRIAL REGISTRATION

PROSPERO CRD42017057793; https://tinyurl.com/y5q9q5o6.

Health Professions Digital Education on Antibiotic Management: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

BACKGROUND

Inappropriate antibiotic prescription is one of the key contributors to antibiotic resistance, which is managed with a range of interventions including education.

OBJECTIVE

We aimed to summarize evidence on the effectiveness of digital education of antibiotic management compared to traditional education for improving health care professionals' knowledge, skills, attitudes, and clinical practice.

METHODS

Seven electronic databases and two trial registries were searched for randomized controlled trials (RCTs) and cluster RCTs published between January 1, 1990, and September 20, 2018. There were no language restrictions. We also searched the International Clinical Trials Registry Platform Search Portal and metaRegister of Controlled Trials to identify unpublished trials and checked the reference lists of included studies and relevant systematic reviews for study eligibility. We followed Cochrane methods to select studies, extract data, and appraise and synthesize eligible studies. We used random-effect models for the pooled analysis and assessed statistical heterogeneity by visual inspection of a forest plot and calculation of the I² statistic.

RESULTS

Six cluster RCTs and two RCTs with 655 primary care practices, 1392 primary care physicians, and 485,632 patients were included. The interventions included personal digital assistants; short text messages; online digital education including emails and websites; and online blended education, which used a combination of online digital education and traditional education materials. The control groups received traditional education. Six studies assessed postintervention change in clinical practice. The majority of the studies (4/6) reported greater reduction in antibiotic prescription or dispensing rate with digital education than with traditional education. Two studies showed significant differences in postintervention knowledge scores in favor of mobile education over traditional education (standardized mean difference=1.09, 95% CI 0.90-1.28; I²=0%; large effect size; 491 participants [2 studies]). The findings for health care professionals' attitudes and patient-related outcomes were mixed or inconclusive. Three studies found digital education to be more cost-effective than traditional education. None of the included studies reported on skills, satisfaction, or potential adverse effects.

CONCLUSIONS

Findings from studies deploying mobile or online modalities of digital education on antibiotic management were complementary and found to be more cost-effective than traditional education in improving clinical practice and postintervention knowledge, particularly in postregistration settings. There is a lack of evidence on the effectiveness of other digital education modalities such as virtual reality or serious games. Future studies should also include health care professionals working in settings other than primary care and low- and middle-income countries.

CLINICAL TRIAL

PROSPERO CRD42018109742; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=109742.

Digital Education for the Management of Chronic Wounds in Health Care Professionals: Protocol for a Systematic Review by the Digital Health Education Collaboration

Background

Digital education is “the act of teaching and learning by means of digital technologies.” Digital education comprises a wide range of interventions that can be broadly divided into offline digital education, online digital education, digital game-based learning, massive open online courses (MOOCs), psychomotor skills trainers, virtual reality environments, virtual patient simulations, and m-learning. Chronic wounds pose an immense economic and psychosocial burden to patients and the health care system, as caring for them require highly specialized personnel. Current training strategies face significant barriers, such as lack of time due to work commitments, distance from provider centers, and costs. Therefore, there is an increased need to synthesize evidence on the effectiveness of digital education interventions on chronic wounds management in health care professionals.

Objective

Our main objective is to assess the effectiveness of digital education as a stand-alone approach or as part of a blended-learning approach in improving pre- and postregistration health care professionals’ knowledge, attitudes, practical skills, and behavior in the management of chronic wounds, as well as their satisfaction with the intervention. Secondary objectives are to evaluate patient-related outcomes, cost-effectiveness of the interventions, and any unfavorable or undesirable outcomes that may arise.

Methods

This systematic review will follow the methodology as described in the Cochrane Handbook for Systematic Reviews of Interventions. As our systematic review is one of a series of reviews on digital education for health professionals’ education, we will use a previously developed search strategy. This search includes the following databases: the Cochrane Central Register of Controlled Trials (CENTRAL) (Cochrane Library), MEDLINE (Ovid), Embase (Ovid), Web of Science, the Educational Resource Information Centre (ERIC) (Ovid), PsycINFO (Ovid), the Cumulative Index to Nursing and Allied Health Literature (CINAHL) (EBSCO), the ProQuest Dissertation and Theses database, and trial registries. Databases will be searched for studies published from January 1990 to August 2018. Two independent reviewers will screen the library for included studies. We will describe the screening process using a flowchart as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We will extract the data using a previously developed, structured data extraction form. Included studies will be quality-assessed using the Risk of Bias tool from Cochrane. We will narratively summarize the data and, if possible, we will conduct a meta-analysis. We will use Cochrane’s RevMan 5.3 software for data analysis.

Results

We have completed the screening of titles and abstracts for this systematic review and are currently selecting papers against our inclusion and exclusion criteria through full-text revision. We are expecting to complete our review by the end of April 2019.

Conclusions

This systematic review will provide an in-depth analysis of digital education strategies to train health care providers in the management of chronic wounds. We consider this topic particularly relevant given the current challenges facing health care systems worldwide, including shortages of skilled personnel and a steep increase in the population of older adults as a result of a prolonged life expectancy.

Trial Registration

PROSPERO CRD42018109971; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=109971

International Registered Report Identifier (IRRID)

DERR1-10.2196/12488

Health Professions' Digital Education: Review of Learning Theories in Randomized Controlled Trials by the Digital Health Education Collaboration

Background

Learning theory is an essential component for designing an effective educational curriculum. Reviews of existing literature consistently lack sufficient evidence to support the effectiveness of digital interventions for health professions’ education, which may reflect disconnections among learning theories, curriculum design, use of technology, and outcome evaluation.

Objective

The aim of this review was to identify, map, and evaluate the use of learning theories in designing and implementing intervention trials of health professions’ digital education, as well as highlight areas for future research on technology-enhanced education via the establishment of a development framework for practice and research.

Methods

We performed a systematic search of Medical Literature Analysis and Retrieval System Online, Excerpta Medica database, Cochrane Central Register of Controlled Trials (Cochrane Library), PsycINFO, Cumulative Index to Nursing and Allied Health Literature, Education Resources Information Center, and Web of Science for randomized controlled trials (RCTs) published between 2007 and 2016.

Results

A total of 874 RCTs on digital health education were identified and categorized into online-offline, mobile digital education, and simulation-based modalities for pre and postregistration health professions’ education. Of these, 242 studies were randomly selected for methodological review and thematic analysis. Data were extracted by one author using a standardized form, with a (48/242, 20%) random sample extracted by a second author, in duplicate. One-third (81/242, 33.4%) of the studies reported single or multiple learning theories in design, assessment, conceptualization, or interpretation of outcomes of the digital education interventions. Commonly reported learning theories were problem-based learning (16/81, 20%), social learning theory (11/81, 14%), and cognitive theory of multimedia learning (10/81, 12%). Most of these studies assessed knowledge (118/242, 48.8%), skills (62/242, 25.6%), and performance (59/242, 24.3%) as primary outcomes with nonvalidated assessment tools (151/242, 62.4%). Studies with reported learning theories (χ²₁=8.2; P=.002) and validated instruments (χ²₁=12.6; P=.006) have shown effective acquisition of learning outcomes.

Conclusions

We proposed a Theory-Technology Alignment Framework to safeguard the robustness and integrity of the design and implementation of future digital education programs for the training of health professionals.

Mobile Digital Education for Health Professions: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Background

There is a pressing need to implement efficient and cost-effective training to address the worldwide shortage of health professionals. Mobile digital education (mLearning) has been mooted as a potential solution to increase the delivery of health professions education as it offers the opportunity for wide access at low cost and flexibility with the portability of mobile devices. To better inform policy making, we need to determine the effectiveness of mLearning.

Objective

The primary objective of this review was to evaluate the effectiveness of mLearning interventions for delivering health professions education in terms of learners’ knowledge, skills, attitudes, and satisfaction.

Methods

We performed a systematic review of the effectiveness of mLearning in health professions education using standard Cochrane methodology. We searched 7 major bibliographic databases from January 1990 to August 2017 and included randomized controlled trials (RCTs) or cluster RCTs.

Results

A total of 29 studies, including 3175 learners, met the inclusion criteria. A total of 25 studies were RCTs and 4 were cluster RCTs. Interventions comprised tablet or smartphone apps, personal digital assistants, basic mobile phones, iPods, and Moving Picture Experts Group-1 audio layer 3 player devices to deliver learning content. A total of 20 studies assessed knowledge (n=2469) and compared mLearning or blended learning to traditional learning or another form of digital education. The pooled estimate of studies favored mLearning over traditional learning for knowledge (standardized mean difference [SMD]=0.43, 95% CI 0.05-0.80, N=11 studies, low-quality evidence). There was no difference between blended learning and traditional learning for knowledge (SMD=0.20, 95% CI –0.47 to 0.86, N=6 studies, low-quality evidence). A total of 14 studies assessed skills (n=1097) and compared mLearning or blended learning to traditional learning or another form of digital education. The pooled estimate of studies favored mLearning (SMD=1.12, 95% CI 0.56-1.69, N=5 studies, moderate quality evidence) and blended learning (SMD=1.06, 95% CI 0.09-2.03, N=7 studies, low-quality evidence) over traditional learning for skills. A total of 5 and 4 studies assessed attitudes (n=440) and satisfaction (n=327), respectively, with inconclusive findings reported for each outcome. The risk of bias was judged as high in 16 studies.

Conclusions

The evidence base suggests that mLearning is as effective as traditional learning or possibly more so. Although acknowledging the heterogeneity among the studies, this synthesis provides encouraging early evidence to strengthen efforts aimed at expanding health professions education using mobile devices in order to help tackle the global shortage of health professionals.

The First Year of Global Cleft Surgery Education Through Digital Simulation: A Proof of Concept

INTRODUCTION

Parallel to worldwide disparities in patient access to health care, the operative opportunities of surgical trainees are increasingly restricted across the globe. Efforts have been directed toward enhancing surgical education outside the operating room and reducing the wide variability in global trainee operative experience. However, high costs and other logistical concerns may limit the reproducibility and sustainability of nonoperative surgical education resources.

METHODS

A partnership between the academic, nonprofit, and industry sectors resulted in the development of an online virtual surgical simulator for cleft repair. First year global access patterns were observed.

RESULTS

The simulator is freely accessible online and includes 5 normal and pathologic anatomy modules, 5 modules demonstrating surgical markings, and 7 step-by-step procedural modules. Procedural modules include high-definition intraoperative footage to supplement the virtual animation in addition to include multiple-choice test questions. In its first year, the simulator was accessed by 849 novel users from 78 countries; 70% of users accessed the simulator from a developing nation.

CONCLUSION

The Internet shows promise as a platform for surgical education and may help address restrictions and reduce disparities in surgical training. The virtual surgical simulator presented may serve as the foundation for the development of a global curriculum in cleft repair.

A Web-based module and online video for pain management education for caregivers of children with fractures: A randomized controlled trial

IntroductionOver 80% of children experience compromise in functioning following a fracture. Digital media may improve caregiver knowledge of managing fracture pain at home.

OBJECTIVES

To determine whether an educational video was superior to an interactive web-based module (WBM) and verbal instructions, the standard of care (SOC).

METHODS

This randomized trial included caregivers of children 0-17 years presenting to the emergency department (ED) with non-operative fractures. Primary outcome was the gain score (pre-post intervention) on a 21-item questionnaire testing knowledge surrounding pain recognition and management for children with fractures. Secondary outcomes included survey of caregiver confidence in managing pain (five-item Likert scale), number of days with difficulty sleeping, before return to a normal diet, and work/school missed.

RESULTS

We analyzed 311 participants (WBM 99; video 108; SOC 104) with a mean (SD) child age of 9.6 (4.2) years, of which 125/311 (40.2%) were female. The video (delta=2.3, 95% CI: 1.3, 3.3; p<0.001) and WBM (delta=1.6; 95% CI: 0.5, 2.6; p=0.002) groups had significantly greater gain scores than the SOC group. The mean video gain score was not significantly greater than WBM (delta=0.7; 95% CI: -0.3, 1.8; p=0.25). There were no significant differences in caregiver confidence (p=0.4), number of absent school days (p=0.43), nights with difficulty sleeping (p=0.94), days before return to a normal diet (p=0.07), or workdays missed (p=0.95).

CONCLUSIONS

A web-based module and online video are superior to verbal instructions for improving caregiver knowledge on management of children's fracture pain without improvement in functional outcomes.