Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

The effect of case-based mobile virtual patient application on students' academic achievement in clinical reasoning skills

This mixed-method study aims to determine the effect of the use of mobile virtual patient application with narrated case-based virtual patients as an assistive technology on students' clinical reasoning skills. It makes a notable contribution by exploring the impact of mobile virtual patient applications on healthcare students' clinical skills and their preparation for real-world patient care. In addition, the accuracy of the analysis results regarding the effect on student achievement was analyzed with a second dataset tool, and thus, aiming to increase reliability by verifying the same research question with a different quantitative analysis technique. In the qualitative part of the study, students' views on the implementation were collected through an open-ended questionnaire and the data were subjected to content analysis. An achievement test was also developed to determine the development of students' clinical reasoning skills, which revealed that each of the learning environments had different outcomes regarding students' achievement and that supporting the traditional environment with the mobile virtual patient application yielded better results for increasing students' achievement. Students' opinions about the mobile virtual patient application and the process also support the increase in academic achievement aimed at measuring clinical reasoning skills. The content analysis showed that the students, who generally reported multiple positive factors related to the application, thought that the stories and cases presented created a perception of reality, and they especially highlighted the contribution of the application to learning the story organization. Based on all these results, it can be said that the application supports clinical reasoning, provides practical experience, improves academic achievement, and contributes positively to motivation.

Gamification in the Design of Virtual Patients for Swedish Military Medics to Support Trauma Training: Interaction Analysis and Semistructured Interview Study

BACKGROUND

This study explores gamification in the design of virtual patients (VPs) to enhance the training of Swedish military medics in trauma care. The challenges related to prehospital trauma care faced on the battlefield require tailored educational tools that support military medics' education and training.

OBJECTIVE

The aim of the study is to investigate how to design VPs with game elements for Swedish military medics to support learning in military trauma care. By understanding the reasoning and perceptions of military medics when interacting with VPs, this study aims to provide insights and recommendations for designing VPs with game elements that are specifically tailored to their needs.

METHODS

The study involved 14 Swedish military medics of the Home Guard-National Security Forces participating in a tactical combat care course. Participants interacted with 3 different VP cases designed to simulate military trauma scenarios. Data were collected through think-aloud sessions and semistructured interviews. The data were analyzed using interaction analysis, structured by the unawareness, problem identification, explanation, and alternative strategies or solutions (uPEA) framework, and reflexive thematic analysis to explore participants' reasoning processes and perceptions and identify possible game elements to inform the VP design.

RESULTS

Mapping the military medics' reasoning to the uPEA framework revealed that study participants became more creative after making a mistake followed by feedback and after receiving a prompt to make a new decision. The thematic analysis revealed 6 themes: motivation, "keep on trying"; agency in interaction with VPs; realistic tactical experience; confidence, "I know that the knowledge I have works"; social influence on motivation; and personalized learning. Participants suggested that game elements such as scoring; badges; virtual goods; progress bars; performance tables; content unlocking; hints; challenge; control; imposed choice; narrative; avatars; sensation; randomness; difficulty adapting; competition; leaderboards; social pressure; progression; and renovation can promote engagement, motivation, and support confidence in decision-making.

CONCLUSIONS

Gamification in the design of VPs represents a promising approach to military medical training, offering a platform for medics to practice medical and tactical decision-making in a risk-free environment. The insights gained by the study may encourage designing VPs with game elements, as well as including possibly wrong decisions, their consequences, and relevant feedback, that may support military medics' reflections and decision-making.

Gaming the System? A Qualitative Exploration of Physician Assistant Learner Perceptions of Virtual Patient Education

INTRODUCTION

Virtual patients (VPs) are increasingly used in health professions education. How learners engage with VPs and the relationship between engagement and authenticity is not well understood. We explored learners' perceptions of VP education to gain an understanding of the characteristics promoting meaningful engagement in learning, including perceived authenticity.

METHODS

Using a constructivist grounded theory approach, we conducted interviews and focus groups with 11 students from 2 Canadian Physician Assistant programs, where VP learning was implemented to supplement clinical education during the COVID-19 pandemic. We explored trainee perspectives on the use of VPs as an educational modality. Data were iteratively collected and descriptively analyzed thematically using a constant comparison approach until theoretical sufficiency was reached.

RESULTS

We identified 3 groups of factors influencing these students' VP learning experiences: (1) technical factors related to the VP platform influenced the perceived authenticity of the patient interactions; (2) individual factors of learners' attitudes influenced their engagement and motivation; and (3) contextual factors related to the learning environment influenced the acceptability and perceived value of the learning experience. Overall, the psychological authenticity of the learning platform and students' motivation for self-directed learning were perceived as most important for students' learning experiences.

CONCLUSIONS

Implementing VP learning as a supplement to clinical education should be done with consideration of factors that enhance the psychological authenticity of the learning platform, promote learner engagement and accountability, and encourage acceptability of the learning modality through curricular placement and messaging.

Assessment of communication skills in health professions education; Ottawa 2024 consensus statement

Despite the increasing inclusion of communication skills in accreditation standards and an increase in time dedicated to teaching these skills, communication is often regarded as a separate skill and is therefore, not consistently represented in overall systems of assessment in Health Professions Education (HPE). The ascendence of competency-based medical education, programmatic assessment, artificial intelligence, and widespread use of telehealth, alongside changing patient expectations warrant an update in thinking about the assessment of communication skills in health professions education. This consensus statement draws on existing literature, expert pinion, and emerging challenges to situate the assessment of communication skills in the contemporary health professions education context. The statement builds on previous work to offer an update on the topic and include new developments related to assessment, particularly: the challenges and opportunities associated with systems of assessment; patient and peer perspectives in assessment; assessment of interprofessional communication, cross-cultural communication, digital communication; and assessment using digital technologies. Consensus was reached through extensive discussion among the authors and other experts in HPE, exploration of the literature, and discussion during an Ottawa 2024 conference workshop. The statement puts forward a summary of available evidence with suggestions for what educators and curriculum developers should consider in their planning and design of the assessment of communication.

Spaced Digital Education for Health Professionals: Systematic Review and Meta-Analysis

BACKGROUND

Spaced digital education applies digital tools to deliver educational content via multiple, repeated learning sessions separated by prespecified time intervals. Spaced digital education appears to promote acquisition and long-term retention of knowledge, skills, and change in clinical behavior.

OBJECTIVE

The aim of this review was to assess the effectiveness of spaced digital education in improving pre- and postregistration health care professionals' knowledge, skills, attitudes, satisfaction, and change in clinical behavior.

METHODS

This review followed Cochrane's methodology and PRISMA (Preferred Reporting Items of Systematic Reviews and Meta-Analyses) reporting guidelines. We searched MEDLINE, Embase, Web of Science, ERIC, PsycINFO, CINAHL, CENTRAL, and ProQuest Dissertation and Theses databases from January 1990 to February 2023. We included randomized controlled trials (RCTs), cluster RCTs, and quasi-RCTs comparing spaced digital education with nonspaced education, spaced nondigital education, traditional learning, or no intervention for pre- or postregistration health care professionals. Study selection, data extraction, study quality, and certainty of evidence were assessed by 2 independent reviewers. Meta-analyses were conducted using random effect models.

RESULTS

We included 23 studies evaluating spaced online education (n=17, 74%) or spaced digital simulation (n=6, 26%) interventions. Most studies assessed 1 or 2 outcomes, including knowledge (n=15, 65%), skills (n=9, 39%), attitudes (n=8, 35%), clinical behavior change (n=8, 35%), and satisfaction (n=7, 30%). Most studies had an unclear or a high risk of bias (n=19, 83%). Spaced online education was superior to massed online education for postintervention knowledge (n=9, 39%; standardized mean difference [SMD] 0.32, 95% CI 0.13-0.51, I2=66%, moderate certainty of evidence). Spaced online education (n=3, 13%) was superior to massed online education (n=2, 9%) and no intervention (n=1, 4%; SMD 0.67, 95% CI 0.43-0.91, I2=5%, moderate certainty of evidence) for postintervention clinical behavior change. Spaced digital simulation was superior to massed simulation for postintervention surgical skills (n=2, 9%; SMD 1.15, 95% CI 0.34-1.96, I2=74%, low certainty of evidence). Spaced digital education positively impacted confidence and satisfaction with the intervention.

CONCLUSIONS

Spaced digital education is effective in improving knowledge, particularly in substantially improving surgical skills and promoting clinical behavior change in pre- and postregistration health care professionals. Our findings support the use of spaced digital education interventions in undergraduate and postgraduate health profession education. Trial Registration: PROSPERO CRD42021241969.

TRIAL REGISTRATION

PROSPERO CRD42021241969; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=241969.

Effectiveness of a virtual patient simulation training on improving provider engagement in suicide safer care

BACKGROUND

Health care providers have a critical opportunity to mitigate the public health problem of suicide. Virtual patient simulations (VPS) allow providers to learn and practice evidence-based suicide prevention practices in a realistic and risk-free environment. The purpose of this study was to test whether receiving VPS training increases the likelihood that providers will engage in effective suicide safer care practices.

METHODS

Behavioral health and non-behavioral health providers (N = 19) at a Federally Qualified Health Center who work with patients at risk for suicide received the VPS training on risk assessment, safety planning, and motivation to engage in treatment. Providers' electronic health records were compared 6 months pre- and post-VPS training on their engagement in suicide safer care practices of screening, assessment, safety planning, and adding suicide ideation to the problem list.

RESULTS

Most behavioral health providers were already engaging in evidence-based suicide prevention care prior to the VPS training. Findings demonstrated the VPS training may impact the likelihood that non-behavioral health providers engage in suicide safer care practices.

CONCLUSION

VPS training in evidence-based suicide prevention practices can optimize and elevate all health care providers' skills in suicide care regardless of role and responsibility, demonstrating the potential to directly impact patient outcomes.

An e-learning platform for clinical reasoning in cardiovascular diseases: a study reporting on learner and tutor satisfaction

BACKGROUND

Medical students gain essential skills through hospital training and internships, which complement their theoretical education. However, virtual patient platforms have been shown to effectively promote clinical reasoning and enhance learning outcomes. This study evaluates a web-based platform designed for learning clinical reasoning in cardiovascular diseases, detailing its functionalities and user satisfaction.

METHODS

The Virtual Patient platform presents medical students with clinically valid scenarios, encompassing stages such as patient description, anamnesis, objective examination, presumptive diagnosis, health investigations, treatment planning, complications, differential and final diagnoses, and prognosis. Scenarios are generated either automatically or manually by professors, based on labeled and annotated clinical data. The Virtual Patient contains two types of medical cases: simple scenarios describing patients with one pathology, and complex scenarios describing patients with several related pathologies. The platform was evaluated by a total of 210 users: 178 medical students, 7 professors, and 25 engineering students, using questionnaires adjusted for each evaluation round to assess satisfaction and gather feedback. The evaluation by medical students was performed in four rounds, each round corresponding to successive enhancements of the platform functionalities and addition of new cases, with a total number of 1,098 evaluation sessions.

RESULTS

The platform was evaluated at different implementation stages, involving simple and complex scenarios for various heart diseases. The majority of students found the platform very useful (82.58%), with significant appreciation for its features and functionalities, for example the dialogue module supporting natural language interactions in Romanian and English or the feed-back obtained during interaction. Professors highly valued the platform's flexibility in scenario generation, real-time feedback provision, and data management capabilities. They appreciated the possibility to provide feedback and score student performance in real-time or after the session, though some professors suggested improving the explainability of the scores.

CONCLUSIONS

The Virtual Patient platform enables medical students to virtually replicate hospital interactions, diagnose patients, and plan treatments in clinically valid scenarios for cardiovascular diseases. User evaluations demonstrated high satisfaction and appreciation for the platform's features. Future work will focus on expanding medical cases, enhancing the dialogue module, improving scenario generation for complex cases, and extending the synthetic data generation component to produce additional types of medical investigations.

Harnessing Innovative Technologies to Train Nurses in Suicide Safety Planning With Hospital Patients: Formative Acceptability Evaluation of an eLearning Continuing Education Training

BACKGROUND

Suicide is the 12th leading cause of death in the United States. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill building are resource intensive and difficult to implement. Novel computer technologies harnessing artificial intelligence are now available, which hold promise for increasing the feasibility of providing trainees opportunities across a range of continuing education contexts to engage in skills practice with constructive feedback on performance.

OBJECTIVE

This pilot study aims to evaluate the feasibility and acceptability of an eLearning training in suicide safety planning among nurses serving patients admitted to a US level 1 trauma center for acute or intensive care. The training included a didactic portion with demonstration, practice of microcounseling skills with a web-based virtual patient (Client Bot Emily), role-play with a patient actor, and automated coding and feedback on general counseling skills based on the role-play via a web-based platform (Lyssn Advisor). Secondarily, we examined learning outcomes of knowledge, confidence, and skills in suicide safety planning descriptively.

METHODS

Acute and intensive care nurses were recruited between November 1, 2021, and May 31, 2022, to participate in a formative evaluation using pretraining, posttraining, and 6-month follow-up surveys, as well as observation of the nurses' performance in delivering suicide safety planning via standardized patient role-plays over 6 months and rated using the Safety Plan Intervention Rating Scale. Nurses completed the System Usability Scale after interacting with Client Bot Emily and reviewing general counseling scores based on their role-play via Lyssn Advisor.

RESULTS

A total of 18 nurses participated in the study; the majority identified as female (n=17, 94%) and White (n=13, 72%). Of the 17 nurses who started the training, 82% (n=14) completed it. On average, the System Usability Scale score for Client Bot Emily was 70.3 (SD 19.7) and for Lyssn Advisor was 65.4 (SD 16.3). On average, nurses endorsed a good bit of knowledge (mean 3.1, SD 0.5) and confidence (mean 2.9, SD 0.5) after the training. After completing the training, none of the nurses scored above the expert-derived cutoff for proficiency on the Safety Plan Intervention Rating Scale (≥14); however, on average, nurses were above the cutoffs for general counseling skills per Lyssn Advisor (empathy: mean 4.1, SD 0.6; collaboration: mean 3.6, SD 0.7).

CONCLUSIONS

Findings suggest the completion of the training activities and use of novel technologies within this context are feasible. Technologic modifications may enhance the training acceptability and utility, such as increasing the virtual patient conversational abilities and adding automated coding capability for specific suicide safety planning skills.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/33695.

Medical Students' Perception Toward Using AI in Medical Education in the Kurdistan Region, Iraq: A Cross-Sectional Study

Background and aim AI is revolutionizing medical education by offering innovative tools and simulations that augment traditional teaching methods. This study explored the perceptions and expectations of medical students in the Kurdistan region, Iraq, regarding AI integration in medical education. Methods A cross-sectional online survey collected data from 224 medical students over four months. A descriptive analysis was conducted to present the student's attitudes.  Results In total, 224 medical students responded to the online survey. The majority of them were female (n=129; 57.6%), while 95 were male (42.4%). Additionally, most of the participants were in stage 4 (54 (24.1%); stage 1, 48 (21.4%); and stage 2, 43 (19.2%). In terms of measuring students' perceptions of AI integration in medical education, 186 (83%) of the students wanted to use smartphones and tablets, and 38 (17%) of them reported wanting hard copies. In addition, 112 (50%) of the medical students considered themselves experts in using AI and 98 (43.8%) did not know exactly what AI was used; however, only a few of them (6.3%) did not use AI. Few patients reported using Manikins instead of real patients (42 (18.8%)), while 140 (62.5%) reported that they could be used but not an alternative. Conclusion While many agree that digital tools and simulations are useful teaching tools, they are frequently viewed as adjunctive approaches. Better integration and training are required for the infrequent use of AI tools in medical education.

Exploring barriers to the effective use of computer-based simulation in pharmacy education: a mixed-methods case study

Background

At the University of Tasmania (UTAS), pharmacy education traditionally relies on placements to provide students with hands-on experience. However, these placements have become increasingly limited due to logistical challenges and growing student numbers. Computer-based simulation (CBS) has the potential to offer a scalable, effective alternative to enhance learning and critical thinking. However, integrating CBS in pharmacy education faces several barriers that must be addressed for successful implementation.

Objective

To gain insight into pharmacy educators' and students' views regarding the barriers, and potential solutions, to integrating CBS in pharmacy practice education.

Methods

This mixed-methods case study involved semi-structured interviews with pharmacy educators and quantitative surveys with pharmacy students. The data underwent thematic coding for interview transcripts and statistical analysis for survey responses. The findings were integrated by examining convergence, complementarity, and discrepancy, revealing insights into how pharmacy students and educators perceive implementation barriers and improvement strategies for CBS.

Results

Ten interviews were conducted, and 75 survey responses were collected, with a 62.5% response rate. Key barriers to CBS integration included educators' heavy workload, scepticism about CBS's educational value, and general integration challenges. Students, however, showed high acceptance of CBS, with 70.7% agreeing that CBS could assess their knowledge, 69.3% emphasising its role in developing problem-solving skills, and 80% viewing CBS as a complement to classroom study. Proposed solutions for enhancing CBS uptake included additional institutional support by appointing dedicated simulation technicians, leveraging champions to advocate for CBS, and aligning CBS with educational objectives.

Conclusion

A significant gap between students' readiness and educators' hesitancy to use CBS in pharmacy education was identified. While students are eager to adopt new technologies, educators expressed reservations, primarily due to workload concerns and uncertainties about the efficacy of CBS. The feedback from educators suggests that institutions may see improved uptake by employing dedicated support personnel and initiating targeted training programs. Future research should focus on exploring barriers and facilitators, using larger and more diverse samples, and gaining deeper insights into decision-makers' perspectives to enhance the integration and efficacy of CBS in pharmacy education.

Model-driven engineering for digital twins: a graph model-based patient simulation application

Introduction

Digital twins of patients are virtual models that can create a digital patient replica to test clinical interventions in silico without exposing real patients to risk. With the increasing availability of electronic health records and sensor-derived patient data, digital twins offer significant potential for applications in the healthcare sector.

Methods

This article presents a scalable full-stack architecture for a patient simulation application driven by graph-based models. This patient simulation application enables medical practitioners and trainees to simulate the trajectory of critically ill patients with sepsis. Directed acyclic graphs are utilized to model the complex underlying causal pathways that focus on the physiological interactions and medication effects relevant to the first 6 h of critical illness. To realize the sepsis patient simulation at scale, we propose an application architecture with three core components, a cross-platform frontend application that clinicians and trainees use to run the simulation, a simulation engine hosted in the cloud on a serverless function that performs all of the computations, and a graph database that hosts the graph model utilized by the simulation engine to determine the progression of each simulation.

Results

A short case study is presented to demonstrate the viability of the proposed simulation architecture.

Discussion

The proposed patient simulation application could help train future generations of healthcare professionals and could be used to facilitate clinicians' bedside decision-making.

Comparative Effectiveness of Developed Serious Game Versus Standardized Patients' Simulation in Nursing Education

Background: Serious games provide a realistic environment in nursing education, a stimulating and experiential learning environment for developing skills necessary for learning, recognizing, analyzing, selecting, and applying information. Methods: This study aims to determine the impact of serious games and standard patient practices developed for nursing education on students' knowledge levels, satisfaction, self-confidence, critical thinking, and problem-solving skills. A serious game was designed using the educational principles of the diabetes course and developed using the 3D interactive content creation platform UNITY. One group played the game online, whereas another had a face-to-face experience. Both groups completed forms before, after, and 4 weeks later via Google Forms. Results: Quantitative analysis showed significant improvements in knowledge and increases in student satisfaction and confidence in learning in both the serious game and standardized patient groups. The groups had no significant differences in problem-solving and critical-thinking abilities (P > 0.005). Conclusion: Developing advanced clinical proficiencies in nursing students requires an engaging and reliable educational environment. Using serious games and standardized patient simulations in nursing instruction highlights the need for diverse digital teaching tools. Therefore, it is essential to support the professional development of nursing educators in these innovative modalities.

[Exploring Needs, Motivations, and Limitations Towards Healthy Eating and Digital Resources: A Qualitative Study in a Mexican Primary Education Setting]

OBJECTIVE

To explore the needs, motivations, and limitations related to healthy eating and digital materials, as well as to identify patterns for their design as a strategy aimed at Mexican families.

DESIGN

A qualitative observational study of the phenomenon through focus group sessions.

LOCATION

A public primary education center in the city of Querétaro, Mexico.

PARTICIPANTS

Children aged 9 to 11 years and parents, mothers, or caregivers with children in primary education.

METHOD

Twelve sessions were conducted with three groups of students and two sessions with parents, mothers, or caregivers using an interview guide. Various digital materials, developed based on social cognitive theory, were presented during the sessions. The sessions were recorded with the participants' or their guardians' prior consent and transcribed for analysis. Coding was performed for key points of analysis, and information saturation was confirmed.

RESULTS

Students expressed motivation towards digital material that promotes play and experimentation, especially within the family context. The main perceived barrier was the caregivers' resistance to change. Parents expressed motivation and a need for explanatory material on diseases, with economic and time-related barriers.

CONCLUSIONS

Digital material based on social cognitive theory, designed to improve nutrition, can be an effective strategy in nutritional education if it considers the circumstances of the target population. It is advisable to include affective and behavioral elements to achieve meaningful learning within households.

The Use of Immersive Virtual Reality Training for Developing Nontechnical Skills Among Nursing Students: Multimethods Study

BACKGROUND

Immersive virtual reality (IVR) is a niche technology rising in popularity in nursing education. Although there is an abundance of evidence to demonstrate the effect of virtual reality (VR) on desired learning outcomes, this evidence is limited to technical or procedural skills or managing a single patient with clinical problems. Nontechnical skills (NTS), such as communication, decision-making, teamwork, situation awareness, and managerial skills, have not been explored using IVR technology.

OBJECTIVE

This study aimed to (1) investigate the potential efficacy of the IVR system virtual reality hospital (VR-Hospital, or VR-Hosp), a single-user game we developed, on nursing students' NTS, sense of presence in the virtual clinical environment, and satisfaction and self-confidence in learning; (2) identify variables that predict NTS; and (3) explore students' experience in using VR-Hosp.

METHODS

A multimethods design with a quantitative and qualitative approach was adopted. Participants were provided with VR-Hosp with 3 scenarios in training. VR-Hosp adopted a multibed, multipatient, multitask approach and was embedded with various clinical situations. Learning outcomes were measured after the training, followed by group interviews.

RESULTS

In total, 202 students joined the study. Results revealed high levels of satisfaction and self-confidence in learning. Significant achievement in NTS was perceived by the students. The levels of satisfaction and self-confidence in learning and the involvement and sensory fidelity domains in the sense of presence were positive predictors of NTS.

CONCLUSIONS

The promising results offer a basis for designing IVR activities for nursing education. Further investigations are imperative to determine the impact of IVR technology on learning outcomes in clinical practice.

Integrating virtual patients into undergraduate health professions curricula: a framework synthesis of stakeholders' opinions based on a systematic literature review

BACKGROUND

Virtual patients (VPs) are widely used in health professions education. When they are well integrated into curricula, they are considered to be more effective than loosely coupled add-ons. However, it is unclear what constitutes their successful integration. The aim of this study was to identify and synthesise the themes found in the literature that stakeholders perceive as important for successful implementation of VPs in curricula.

METHODS

We searched five databases from 2000 to September 25, 2023. We included qualitative, quantitative, mixed-methods and descriptive case studies that defined, identified, explored, or evaluated a set of factors that, in the perception of students, teachers, course directors and researchers, were crucial for VP implementation. We excluded effectiveness studies that did not consider implementation characteristics, and studies that focused on VP design factors. We included English-language full-text reports and excluded conference abstracts, short opinion papers and editorials. Synthesis of results was performed using the framework synthesis method with Kern's six-step model as the initial framework. We appraised the quality of the studies using the QuADS tool.

RESULTS

Our search yielded a total of 4808 items, from which 21 studies met the inclusion criteria. We identified 14 themes that formed an integration framework. The themes were: goal in the curriculum; phase of the curriculum when to implement VPs; effective use of resources; VP alignment with curricular learning objectives; prioritisation of use; relation to other learning modalities; learning activities around VPs; time allocation; group setting; presence mode; VPs orientation for students and faculty; technical infrastructure; quality assurance, maintenance, and sustainability; assessment of VP learning outcomes and learning analytics. We investigated the occurrence of themes across studies to demonstrate the relevance of the framework. The quality of the studies did not influence the coverage of the themes.

CONCLUSIONS

The resulting framework can be used to structure plans and discussions around implementation of VPs in curricula. It has already been used to organise the curriculum implementation guidelines of a European project. We expect it will direct further research to deepen our knowledge on individual integration themes.

The application of blended teaching in medical practical course of clinical skills training

BACKGROUND

Blended teaching is an effective approach that combines online and offline teaching methods, leading to improved outcomes in medical education compared to traditional offline teaching. In this study, we examined the impact of blended teaching in clinical skills training, a medical practice course.

METHODS

This study involved forty-eight undergraduate students studying clinical medicine in the fifth semester at Wuhan University of Science and Technology. The students were divided into two groups: the control group, which received traditional offline teaching, and the experimental group, which received hybrid teaching. Following the completion of the 4-month course, both groups underwent the Objective Structured Clinical Examination (OSCE) to evaluate their proficiency in clinical skills. Furthermore, the experimental group was given a separate questionnaire to gauge their feedback on the Blended Teaching approach.

RESULTS

Based on the OSCE scores, the experimental group outperformed the control group significantly (P<0.05). The questionnaire results indicated that a majority of students (54.2%, 3.71 ± 1.06) believed that blended teaching is superior to traditional offline teaching, and a significant number of students (58.3%, 3.79 ± 1.15) expressed their willingness to adopt blended teaching in other courses. Furthermore, students in the experimental group displayed varying levels of interest in different teaching contents, with emergency medicine (79.2%), internal medicine (70.8%), and surgery (66.7%) being the most popular among them.

CONCLUSIONS

This research demonstrates for the first time that blended teaching can achieve a good pedagogical effectiveness in the medical practice course, clinical skills training and practice. Moreover, in different teaching contents, the teaching effects are different. In the content of Emergency Medicine and Surgery, which is more attractive to students, the application of blended teaching could result in a better pedagogical outcome than other contents.

Dry eye in primary care: the relationship between digital display device usage and dry eye syndrome (DES) in medical students

OBJECTIVE

As digital display devices become more and more indispensable, associated health problems have started to increase. We aimed to investigate the frequency and relationship of digital display device usage behaviours and dry eye syndrome (DES) in medical students.

METHODS

An observational, cross-sectional study was conducted on medical school students who voluntarily participated in our study online, about the duration and variety of their digital screen use, usage patterns, and protective measures, together with the Ocular Surface Disease Index (OSDI) questionnaire. Where necessary, the Schirmer-I, tear break-up time, and fluorescein staining tests were carried out.

RESULTS

Of the 255 participants, 75.3% (n = 192) were female, 63.1% (n = 161) had no refractive vision defects, and 45.9% used smartphones for more than 5 h a day. According to the OSDI scores for DES screening, only 36.1% of the participants were normal, 17.3% had mild DES, 20.4% had moderate DES, and 26.3% had severe DES. A positive correlation was found between digital display usage time in hours per day and a high OSDI score. As the distance between the eye and the screen decreased, the DES score increased, which is significant for computer, e-book, and tablet use (P < 0.005). The DES rate of the 25 participants who underwent further evaluation was 40% for the tear break-up time test and 52% for the fluorescein staining test.

CONCLUSION

The high prevalence of DES due to digital screen use among medical school students highlights the importance of DES screening as a preventive measure in family medicine.

Findings Favor Haptics Feedback in Virtual Simulation Surgical Education: An Updated Systematic and Scoping Review

BACKGROUND

Virtual simulations (VSs) enhance clinical competencies and skills. However, a previous systematic review of 9 RCT studies highlighted a paucity of literature on the effects of haptic feedback in surgical VSs. An updated systematic and scoping review was conducted to encompass more studies and a broader range of study methodologies.

METHODS

A systematic literature search was conducted on July 31, 2023, in MEDLINE, Embase, and Cochrane. English language studies comparing haptic vs non-haptic conditions and using VSs were included. Studies were evaluated and reported using PRISMA-ScR guidelines.

RESULTS

Out of 2782 initial studies, 51 were included in the review. Most studies used RCT (21) or crossover (23) methodologies with medical residents, students, and attending physicians. Most used post-intervention metrics, while some used pre- and post-intervention metrics. Overall, 34 performance results from studies favored haptics, 3 favored non-haptics, and the rest showed mixed or equal results.

CONCLUSION

This updated review highlights the diverse application of haptic technology in surgical VSs. Haptics generally enhances performance, complements traditional teaching methods, and offers personalized learning with adequate simulator validation. However, a sparsity of orienting to the simulator, pre-/post-study designs, and small sample sizes poses concerns with the validity of the results. We underscore the urgent need for standardized protocols, large-scale studies, and nuanced understanding of haptic feedback integration. We also accentuate the significance of simulator validation, personalized learning potential, and the need for researcher, educator, and manufacturer collaboration. This review is a guidepost for navigating the complexities and advancements in haptic-enhanced surgical VSs.

Comparing Face-to-Face, Blended and Online Teaching Approaches for Practical Skill Acquisition: A Randomised Controlled Trial

Introduction

The efficacy of blended and online teaching methods for practical skill acquisition remains ambiguous, particularly for skills requiring haptic awareness and/or sensory training. This study aims to compare three teaching methods (face-to-face, blended, online) for the acquisition of skills requiring sensory learning and haptic awareness. A secondary aim was to explore student experience of each teaching approach.

Design

A post-test only randomised controlled trial.

Methods

Forty-seven participants chose between learning two skills: manual measurement of blood pressure during exercise (BPM) and/or skin fold measurement using callipers (SKM). Participants were randomised to one of three learning groups: face-to-face (n = 23), blended (n = 22) and online (n = 26). Assessors determined skill competency during an in-person skill demonstration session. A survey captured student experiences.

Results

For SKM, there was a statistically significant difference in skill competency between the online learning group (17% achieved competency) and both the face-to-face (75% achieved competency; p = 0.011) and blended (89% achieved competency; p = 0.001) learning groups. For BPM, the online group had the lowest percentage of participants achieve overall skill competency. Both knowledge-based and sensory-based sub-competencies were negatively affected by the online learning method. For both skills, students in the face-to-face and blended learning group were significantly more confident in their knowledge and their ability to perform the skill in a clinical setting, compared to the online learning group.

Conclusion

Both face-to-face and blended teaching methods were more effective at leading to skill acquisition and were preferred by students when compared to a fully online teaching method.

Knowledge of Antibiotic Use and Resistance Among Medical Students in Saudi Arabia

Introduction

The World Health Organization (WHO) has placed great importance on providing thorough, hands-on training to medical students regarding responsible and appropriate antibiotic prescription. Accordingly, this study aims to gain a better perspective on the knowledge of antibiotic use and resistance among medical students in Jeddah, Saudi Arabia.

Methods

A questionnaire-based cross-sectional study was conducted among medical students in Jeddah, Saudi Arabia, from 1 September to 30 November 2023. The categorical variables are presented as frequencies and percentages. Mann-Whitney and Kruskal-Wallis tests were used to compare the outcomes, and generalised linear regression models were constructed to predict the students' knowledge of antibiotics and antibiotic resistance. A p-value of < 0.05 was taken to indicate statistical significance.

Results

The study included a total of 353 medical students. First-year medical students represented 28.60% of the participants, while females represented 76.80%. Most participants (92.40%) agreed that antibiotics are effective against bacteria, whereas only 25.20% agreed about antibiotics' effectiveness against viruses. More than half of the participants (53.80%) believed that bacterial infections can be resolved without antibiotics. A significant majority (78.20%) agreed that the unnecessary use of antibiotics makes them less effective. More than half of the participants (56.90%) acknowledged that infections caused by resistant bacteria are increasing in Saudi Arabia, and two-thirds (75.10%) believed that healthcare workers could effectively reduce antibiotic resistance in Saudi Arabia. Male students had low knowledge about antibiotics [Beta = -1.429, 95% CI (-2.618, -0.241), P value = 0.019].

Conclusion

Improving the curriculum by incorporating topics like resistance mechanisms and responsible antibiotic usage can address the knowledge gap among male students. This comprehensive training, utilizing various educational methods, is essential for fostering responsible antibiotic practices among future healthcare professionals.

Virtual patients versus standardized patients for improving clinical reasoning skills in ophthalmology residents. A randomized controlled trial

BACKGROUND

History taking and clinical reasoning are important skills that require knowledge, cognition and meta-cognition. It is important that a trainee must experience multiple encounters with different patients to practice these skills. However, patient safety is also important, and trainees are not allowed to handle critically ill patients. To address this issue, a randomized controlled trial was conducted to determine the effectiveness of using Virtual Patients (VP) versus Standardized Patients (SP) in acquiring clinical reasoning skills in ophthalmology postgraduate residents.

METHODS

Postgraduate residents from two hospitals in Lahore, Pakistan, were randomized to either the VP group or the SP group and were exposed to clinical reasoning exercise via the VP or SP for 30 min after the pretest. This was followed by a posttest. One month after this activity, a follow-up posttest was conducted. The data were collected and analysed using IBM-SPSS version 25. Repeated measures ANOVA was used to track the effect of learning skills over time.

RESULTS

The mean age of the residents was 28.5 ± 3 years. The male to female ratio was 1:1.1. For the SP group, the mean scores were 12.6 ± 3.08, 16.39 ± 3.01 and 15.39 ± 2.95, and for the VP group, the mean scores were 12.7 ± 3.84, 16.30 ± 3.19 and 15.65 ± 3.18 for the pretest, posttest and follow-up posttest, respectively (p value < 0.00). However, the difference between the VP and SP groups was not statistically significant (p = 0.896). Moreover, there was no statistically significant difference between the VP and SP groups regarding the retention of clinical reasoning ability. In terms of learning gain, compared with the VP group, the SP group had a score of 51.46% immediately after clinical reasoning exercise as compared to VP group, in which it was 49.1%. After one month, it was 38.01 in SP and 40.12% in VP group.

CONCLUSION

VPs can be used for learning clinical reasoning skills in postgraduate ophthalmology residents in a safe environment. These devices can be used repeatedly without any risk to the real patient. Although similarly useful, SP is limited by its nonavailability for repeated exercises.

The use of virtual patients for breaking bad news: A rapid review

BACKGROUND

Breaking bad news is an imperative skill for clinical practice that health care professionals struggle with. Virtual patients have been adopted as a new teaching aide in medical education and have shown efficacy in teaching clinical skills; however, there is limited research for use in communication skills. Virtual patients are especially well-suited for difficult communication skills, as students can practice without risk to patients. This rapid review aimed to review literature observing the potential of virtual patients as an effective means to teach breaking bad news.

METHOD

A systematic search strategy was applied for papers published between November 2012 and November 2022 on Medline and Embase databases. Following the application of inclusion criteria, three studies were included. The Medical Education Research Study Quality Instrument and Critical Appraisal Skills Programme checklist were used for quality appraisal of the studies. Tabular and narrative synthesis was used to present the findings.

FINDINGS

The findings of the studies suggest that when teaching breaking bad news, virtual patients are valuable compared with no intervention and are not inferior compared with simulated patients. An unexpected benefit of virtual patients was videotaping. A barrier to learning was the lack of affect and interaction. More research into the design of virtual simulations and its integration into existing curricula is required.

CONCLUSION

Virtual patients are a valuable educational tool for breaking bad news; however, they are yet to replace existing educational approaches. There is a need for more large-scale, homogeneous studies to inform instructional design and curriculum integration.

Generative Artificial Intelligence as a Tool for Teaching Communication in Nutrition and Dietetics Education-A Novel Education Innovation

Although effective communication is fundamental to nutrition and dietetics practice, providing novice practitioners with efficacious training remains a challenge. Traditionally, human simulated patients have been utilised in health professions training, however their use and development can be cost and time prohibitive. Presented here is a platform the authors have created that allows students to interact with virtual simulated patients to practise and develop their communication skills. Leveraging the structured incorporation of large language models, it is designed by pedagogical content experts and comprises individual cases based on curricula and student needs. It is targeted towards the practice of rapport building, asking of difficult questions, paraphrasing and mistake making, all of which are essential to learning. Students appreciate the individualised and immediate feedback based on validated communication tools that encourage self-reflection and improvement. Early trials have shown students are enthusiastic about this platform, however further investigations are required to determine its impact as an experiential communication skills tool. This platform harnesses the power of artificial intelligence to bridge the gap between theory and practice in communication skills training, requiring significantly reduced costs and resources than traditional simulated patient encounters.

Clinical virtual simulation: predictors of user acceptance in nursing education

BACKGROUND

Using virtual patients integrated in simulators expands students' training opportunities in healthcare. However, little is known about the usability perceived by students and the factors/determinants that predict the acceptance and use of clinical virtual simulation in nursing education.

OBJECTIVES

To identify the factors/determinants that predict the acceptance and use of clinical virtual simulation in learning in nursing education.

METHODS

Observational, cross-sectional, analytical study of the use of clinical virtual simulation in nursing to answer the research question: What factors/determinants predict the acceptance and use of a clinical virtual simulator in nursing education? We used a non-probabilistic sampling, more specifically a convenience sample of nursing degree students. The data were collected through a questionnaire adapted from the Technology Acceptance Model 3. In technology and education, the Technology Acceptance Model is a theoretical model that predicts the acceptance of the use of technology by users.

RESULTS

The sample comprised 619 nursing students, who revealed mean values of perceived usefulness (M = 5.34; SD = 1.19), ease of use (M = 4.74; SD = 1.07), and intention to use the CVS (M = 5.21; SD = 1.18), in a Likert scale of seven points (1-the worst and 7 the best possible opinion). This study validated the use of Technology Acceptance Model 3 adapted and tested the related hypotheses, showing that the model explains 62% of perceived utility, 32% of ease of use, and 54% of intention to use the clinical virtual simulation in nursing by nursing students. The adequacy of the model was tested by analysis of the direct effects of the relationships between the internal constructs (PU-BI, β = 0.11, p = 0.012; PEOU-BI, β = -0.11, p = 0.002) and the direct relations between some of the constructs internal to the Technology Acceptance Model 3 and the external determinants Relevance for learning and Enjoyability. In the proposed model, the external constructs that best predicted perceived usefulness, ease of use, and behaviour intention to use the clinical virtual simulation in nursing were Relevance for learning and Enjoyability.

CONCLUSIONS

These study results allowed us to identify relevance for learning and enjoyability as the main factors/determinants that predict the acceptance and use of clinical virtual simulation in learning in nursing.

A Virtual Case Presentation Platform: Protocol Study

Gaining practical experience is indispensable for medical students. Therefore, when medical students were prevented access to hospitals during the COVID-19 pandemic in Romania, there was an urgent need to find a solution that would allow medical students to develop the skills they would usually develop in hospitals but without the need to be physically present in a hospital. This was the reason behind the idea of developing a Virtual Case Presentation Platform. The platform offers the possibility for medical students to reproduce virtually, in clinically valid scenarios, the diagnostic process and treatment recommendation, as well as the interactions with patients that usually take place in hospitals using natural language through speech and text. On the platform, the students receive valuable feedback from the professors about their performance. In order to reproduce the whole targeted experience for students, without missing anything, before starting the development of the platform, it was mandatory to identify and understand all the aspects that should be covered by the platform. The proposed platform covers the different aspects that have been identified for the diagnostic process and treatment recommendation. It enables medical students to develop essential skills for their future careers as doctors.

Enhancing Surgical Nursing Student Performance: Comparative Study of Simulation-Based Learning and Problem-Based Learning

Background

Surgical nursing is a high-risk, high-pressure, and complex field. Nurses need extensive knowledge, skills, and abilities. Problem-Based Learning (PBL) and Simulation-Based Learning (SBL) are effective student-centered methods. Which method is better for surgical nurse training? More research is needed to determine the best approach for undergraduate surgical nurse education.

Purpose

To compare the impact of PBL and SBL on undergraduate nursing students' performance and improve learning outcomes in surgical nursing education.

Methods

We used a pretest/post-test design with 318 nursing undergraduates randomly assigned to two groups. Participants completed three progressive scenarios focused on surgical nursing cases. Experts blindly reviewed video recordings using the 70-item Korean Nurses' Core Competence Scale (KNCCS) to assess performance. The 13-item Satisfaction and Self-confidence in learning Scale (SSS) measured learning confidence and satisfaction. SBL participants also completed the 16-item Educational Practices in Simulation Scale (EPSS) and 20-item Simulation Design Scale (SDS).

Results

The study found significant positive effects on both groups, with noticeable improvements in post-test, retention, and follow-up test results (P < 0.001). The SBL group showed higher competency levels in nurses (P < 0.001). The Cohen's d and effect size (r) for various skills were as follows: clinical performance (0.84767 and 6.39023), critical thinking (0.31017 and 0.15325), professional attitude (0.85868 and 0.39452), and communication skills (1.55149 and 0.61294). The satisfaction and self-confidence of nurses were higher in the SBL group (4.53±0.596; 4.47±0.611) compared to the PBL group (4.32±0.689; 4.25±0.632) in all dimensions of SSS (all P < 0.05). The SBL group also scored high in simulation design and EPSS. However, improvements are needed in fidelity, objectives, information, and students' expectations.

Conclusion

SBL and PBL improve nurses' core competence, satisfaction, and self-confidence. SBL is superior. This study promotes student-centered education, enhancing surgical nursing professionals' quality and ensuring future patient safety.

Leveraging ChatGPT for ophthalmic education: A critical appraisal

In recent years, the advent of artificial intelligence (AI) has transformed many sectors, including medical education. This editorial critically appraises the integration of ChatGPT, a state-of-the-art AI language model, into ophthalmic education, focusing on its potential, limitations, and ethical considerations. The application of ChatGPT in teaching and training ophthalmologists presents an innovative method to offer real-time, customized learning experiences. Through a systematic analysis of both experimental and clinical data, this editorial examines how ChatGPT enhances engagement, understanding, and retention of complex ophthalmological concepts. The study also evaluates the efficacy of ChatGPT in simulating patient interactions and clinical scenarios, which can foster improved diagnostic and interpersonal skills. Despite the promising advantages, concerns regarding reliability, lack of personal touch, and potential biases in the AI-generated content are scrutinized. Ethical considerations concerning data privacy and potential misuse are also explored. The findings underline the need for carefully designed integration, continuous evaluation, and adherence to ethical guidelines to maximize benefits while mitigating risks. By shedding light on these multifaceted aspects, this paper contributes to the ongoing discourse on the incorporation of AI in medical education, offering valuable insights and guidance for educators, practitioners, and policymakers aiming to leverage modern technology for enhancing ophthalmic education.

Virtual patients in undergraduate psychiatry education: a systematic review and synthesis

Virtual patients are increasingly used in undergraduate psychiatry education. This article reports on a systematic review aimed at providing an overview of different approaches in this context, describing their effectiveness, and thematically comparing learning outcomes across different undergraduate programs. The authors searched PubMed, PsycInfo, CINAHL, and Scopus databases for articles published between 2000 and January 2021. Quantitative and qualitative studies that reported on outcomes related to learners' knowledge, skills, and attitudes following an intervention with virtual patients in undergraduate psychiatry education were reviewed. Outcomes were thematically compared, and a narrative synthesis of the different outcomes and effectiveness was provided. Of 7856 records identified, 240 articles were retrieved for full-text review and 46 articles met all inclusion criteria. There were four broad types of virtual patient interventions: case-based presentation (n = 17), interactive virtual patient scenarios (n = 14), standardized virtual patients (n = 10), and virtual patient videogames (n = 5). The thematic analysis revealed that virtual patients in psychiatry education have been used for learners to construe knowledge about symptomatology and psychopathology, develop interpersonal and clinical communicative skills, and to increase self-efficacy and decrease stigmatizing attitudes towards psychiatric patients. In comparison with no intervention, traditional teaching, and text-based interventions, virtual patients were associated with higher learning outcomes. However, the results did not indicate any superiority of virtual patients over non-technological simulation. Virtual patients in psychiatry education offer opportunities for students from different health disciplines to build knowledge, practice skills, and improve their attitudes towards individuals with mental illness. The article discusses methodological shortcomings in the reviewed literature. Future interventions should consider the mediating effects of the quality of the learning environment, psychological safety, and level of authenticity of the simulation.

Exploring medical students' perceptions of individual and group-based clinical reasoning with virtual patients: a qualitative study

BACKGROUND

Virtual Patients are computer-based simulations used to teach and evaluate patient interviews, medical diagnoses, and treatment of medical conditions. It helps develop clinical reasoning skills, especially in undergraduate medical education. This study aimed to and investigate the medical students' perceptions of individual and group-based clinical reasoning and decision-making processes by using Virtual Patients.

METHODS

The study group comprised 24 third-year medical students. Body Interact® software was utilized as a VP tool. The students' readiness and the courses' learning goals were considered when choosing the scenarios. Semi-structured interview forms were employed for data collection. MAXQDA 2020 qualitative analysis software was used to analyze the data. The students' written answers were analyzed using content analysis.

RESULTS

The participants perceived individual applications as beneficial when making clinical decisions with Virtual Patients, but they suggested that group-based applications used with the same cases immediately following individual applications were a more appropriate decision-making method. The results indicated that students learn to make decisions through trial and error, based on software scoring priorities, or using clinical reasoning protocols.

CONCLUSION

In group-based reasoning, the discussion-conciliation technique is utilized. The students stated that the individual decision-making was advantageous because it provided students with the freedom to make choices and the opportunity for self-evaluation. On the other hand, they stated that the group based decision-making process activated their prior knowledge, assisted in understanding misconceptions, and promoted information retention. Medical educators need to determine the most appropriate method when using Virtual Patients, which can be structured as individual and/or group applications depending on the competency sought.

A comparative study on the effectiveness of online and in-class team-based learning on student performance and perceptions in virtual simulation experiments

BACKGROUND

The swift transition to online teaching in medical education has presented the challenge of replicating in-class engagement and interaction essential for active learning. Despite online team-based learning (TBL) offering potential solutions through structured cooperative activities, its efficacy in virtual simulation experiment courses remains scantily researched. This study investigates the effectiveness of online TBL for teaching virtual patient experiments in a basic medical laboratory course and contrasts it with traditional offline teaching in terms of student performance and perceptions.

METHODS

A comparative analysis involved 179 Year 3 medical students using online TBL, face-to-face TBL (FTF-TBL), and the flipped classroom (FC) approach. The learning outcomes were assessed based on experiment reports, IRAT scores, TRAT scores, and final exam performance. Students' perceptions of both online and in-class TBL methodologies were also surveyed.

RESULTS

Both online and in-class TBL groups demonstrated comparable academic outcomes and surpassed the FC group in academic performance. Students displayed a marked preference for the TBL format (whether online or in-class), valuing its enhancement of learning interest and practical knowledge application. Nevertheless, refinements in discussion efficiency, platform convenience, and student-instructor interaction were indicated as potential areas of improvement in the online setting.

CONCLUSIONS

Online TBL, along with its in-class counterpart, showed superior academic performance and a more positive learning experience compared to the FC group. These findings underscore the potential of online TBL in adapting to modern pedagogical challenges and enriching medical education through virtual simulation experiments.

*SMARTSIM* A multicenter prospective randomized trial of 3D virtual reality versus traditional patient simulation

Objective

Simulations are an integral part of paramedic education. Technological advancements have introduced three-dimensional virtual reality patient simulations (3DVRS), offering a low-cost, accessible alternative. This study compares the impact of 3DVRS and traditional simulation on paramedic students.

Methods

Students selected from a convenience sample of 11 cohorts in 10 accredited programs distributed across the United States were allocated to 2 groups using a stratified random sampling. One group received simulations via 3DVRS, the second used traditional in-person simulation. Students were exposed to 6 scenarios over 2 h from the National Association of Emergency Medical Technicians (NAEMT) Advanced Medical Life Support (AMLS) program. Altered mental status scenarios were selected a priori by the research team containing approximately 30 potential differential diagnoses. A 50-item posttest was administered using validated cognitive items provided by Fisdap.

Results

A multicenter prospective randomized trial of 174 paramedic students was undertaken from April until August of 2022. The traditional simulation group was comprised of 88 students and the 3DVRS group had 86 students. A Mann-Whitney U test (U = 4064.5, n 1 = 88, n 2 = 86, p = 0.396) detected no statistical difference between two distributions or median exam score (70%), the range of values and interquartile range (IQR) for both groups: TS IQR = 64-75 (range, 32-82); 3DVRS IQR = 64-76 (range, 34-86).

Conclusion

No difference in exam scores using 3DVRS versus traditional simulation was detected. Paramedic programs may have an effective new option when incorporating simulation with 3DVRS, potentially reducing financial and real-estate resources required with in-person simulations. Larger studies are needed to truly evaluate the impact and usability of virtual reality on paramedic education.

Assessing clinical reasoning skills following a virtual patient dizziness curriculum

OBJECTIVES

Dizziness is a common medical symptom that is frequently misdiagnosed. While virtual patient (VP) education has been shown to improve diagnostic accuracy for dizziness as assessed by VPs, trainee performance has not been assessed on human subjects. The study aimed to assess whether internal medicine (IM) interns after training on a VP-based dizziness curriculum using a deliberate practice framework would demonstrate improved clinical reasoning when assessed in an objective structured clinical examination (OSCE).

METHODS

All available interns volunteered and were randomized 2:1 to intervention (VP education) vs. control (standard clinical teaching) groups. This quasi-experimental study was conducted at one academic medical center from January to May 2021. Both groups completed pre-posttest VP case assessments (scored as correct diagnosis across six VP cases) and participated in an OSCE done 6 weeks later. The OSCEs were recorded and assessed using a rubric that was systematically developed and validated.

RESULTS

Out of 21 available interns, 20 participated. Between intervention (n=13) and control (n=7), mean pretest VP diagnostic accuracy scores did not differ; the posttest VP scores improved for the intervention group (3.5 [SD 1.3] vs. 1.6 [SD 0.8], p=0.007). On the OSCE, the means scores were higher in the intervention (n=11) compared to control group (n=4) for physical exam (8.4 [SD 4.6] vs. 3.9 [SD 4.0], p=0.003) and total rubric score (43.4 [SD 12.2] vs. 32.6 [SD 11.3], p=0.04).

CONCLUSIONS

The VP-based dizziness curriculum resulted in improved diagnostic accuracy among IM interns with enhanced physical exam skills retained at 6 weeks post-intervention.

The Lived Experiences of Saudi Nursing Students in Digital Clinical Experience: A Phenomenological Study

Background Novel digital methods of simulation are gaining popularity in nursing education in light of the limited access to clinical placement and expensive high-fidelity simulation technologies. Aim The aim of this study is to explore the lived experiences of Saudi nursing students in digital clinical experiences (DCEs). Methods A qualitative phenomenological research design, grounded in Husserlian phenomenology, was employed. Purposive sampling was utilized to select 21 participants actively involved in DCEs. In-depth interviews were conducted to collect rich, narrative data. Results The thematic analysis has yielded four themes, namely, "comfort and safety", "critical thinking and problem solving", "appraisal of knowledge", and "transition to practice." Conclusions The findings contribute to ongoing discussions about leveraging technology in nursing education, emphasizing the need for educators and policymakers to integrate digital tools that enhance the learning experiences of nursing students.

Increasing Realism and Variety of Virtual Patient Dialogues for Prenatal Counseling Education Through a Novel Application of ChatGPT: Exploratory Observational Study

BACKGROUND

Using virtual patients, facilitated by natural language processing, provides a valuable educational experience for learners. Generating a large, varied sample of realistic and appropriate responses for virtual patients is challenging. Artificial intelligence (AI) programs can be a viable source for these responses, but their utility for this purpose has not been explored.

OBJECTIVE

In this study, we explored the effectiveness of generative AI (ChatGPT) in developing realistic virtual standardized patient dialogues to teach prenatal counseling skills.

METHODS

ChatGPT was prompted to generate a list of common areas of concern and questions that families expecting preterm delivery at 24 weeks gestation might ask during prenatal counseling. ChatGPT was then prompted to generate 2 role-plays with dialogues between a parent expecting a potential preterm delivery at 24 weeks and their counseling physician using each of the example questions. The prompt was repeated for 2 unique role-plays: one parent was characterized as anxious and the other as having low trust in the medical system. Role-play scripts were exported verbatim and independently reviewed by 2 neonatologists with experience in prenatal counseling, using a scale of 1-5 on realism, appropriateness, and utility for virtual standardized patient responses.

RESULTS

ChatGPT generated 7 areas of concern, with 35 example questions used to generate role-plays. The 35 role-play transcripts generated 176 unique parent responses (median 5, IQR 4-6, per role-play) with 268 unique sentences. Expert review identified 117 (65%) of the 176 responses as indicating an emotion, either directly or indirectly. Approximately half (98/176, 56%) of the responses had 2 or more sentences, and half (88/176, 50%) included at least 1 question. More than half (104/176, 58%) of the responses from role-played parent characters described a feeling, such as being scared, worried, or concerned. The role-plays of parents with low trust in the medical system generated many unique sentences (n=50). Most of the sentences in the responses were found to be reasonably realistic (214/268, 80%), appropriate for variable prenatal counseling conversation paths (233/268, 87%), and usable without more than a minimal modification in a virtual patient program (169/268, 63%).

CONCLUSIONS

Generative AI programs, such as ChatGPT, may provide a viable source of training materials to expand virtual patient programs, with careful attention to the concerns and questions of patients and families. Given the potential for unrealistic or inappropriate statements and questions, an expert should review AI chat outputs before deploying them in an educational program.

How to Partner With Persons Living With Mental Health Conditions: A Guide for Meaningful Simulation Cocreation

SUMMARY STATEMENT

Screen-based simulation is an effective educational strategy that can enhance health care students' engagement with content and critical thinking across various topics, including mental health. To create relevant and realistic simulations, best-practice guidelines recommend the involvement of experts in the development process. We collaborated with persons with lived experience and community partners to cocreate a mental health-focused screen-based simulation. Cocreating meant establishing a nonhierarchical partnership, with shared decision-making from start to finish.In this article, we present 8 principles developed to guide our cocreation with persons with lived experience: person-centeredness, trauma-informed approaches and ethical guidance, supportive environment, two-way partnership, mutual respect, choice and flexibility, open communication, and room to grow. These principles provide practical guidance for educators seeking to engage the expertise of persons who have been historically disadvantaged in society. By sharing these principles, we strive to contribute to a more equitable process in simulation development and promote meaningful, respectful, and safer collaborations.

Development and usability testing of a patient digital twin for critical care education: a mixed methods study

Background

Digital twins are computerized patient replicas that allow clinical interventions testing in silico to minimize preventable patient harm. Our group has developed a novel application software utilizing a digital twin patient model based on electronic health record (EHR) variables to simulate clinical trajectories during the initial 6 h of critical illness. This study aimed to assess the usability, workload, and acceptance of the digital twin application as an educational tool in critical care.

Methods

A mixed methods study was conducted during seven user testing sessions of the digital twin application with thirty-five first-year internal medicine residents. Qualitative data were collected using a think-aloud and semi-structured interview format, while quantitative measurements included the System Usability Scale (SUS), NASA Task Load Index (NASA-TLX), and a short survey.

Results

Median SUS scores and NASA-TLX were 70 (IQR 62.5-82.5) and 29.2 (IQR 22.5-34.2), consistent with good software usability and low to moderate workload, respectively. Residents expressed interest in using the digital twin application for ICU rotations and identified five themes for software improvement: clinical fidelity, interface organization, learning experience, serious gaming, and implementation strategies.

Conclusion

A digital twin application based on EHR clinical variables showed good usability and high acceptance for critical care education.

Nursing students' experiences of teaching and learning during the COVID-19 pandemic: a systematic review and meta-synthesis of qualitative studies

INTRODUCTION

During the COVID-19 pandemic, the sudden transition to virtual learning led to several challenges for nursing students. This study aimed to synthesis nursing students' experiences of teaching and learning during the COVID-19 pandemic.

CONTENT

A meta-synthesis of qualitative articles were conducted. Three online databases were searched from December 2019 to December 2022. Qualitative studies and qualitative sections of mixed method studies were included.

SUMMARY

Twenty-four qualitative studies and seven mixed-method studies were included in the review. The findings consisted of one main theme "educational transformation", and three categories "challenging face-to-face clinical training", "transition from face-to-face to virtual education", and "support continua". The evidence indicated that during this health-related crisis, most of the training was provided as distance learning in various forms. According to the findings, distance education alone cannot replace face-to-face education and is suggested to be considered as a supplementary learning method.

OUTLOOK

This study provides a comprehensive understanding of nursing students' experiences during the COVID-19 pandemic, offering practical implications for educators and institutions globally. The lessons learned can inform strategic decisions, policies, and practices to enhance the resilience and adaptability of nursing education in the face of unforeseen challenges.

Incorporation of Simulation in Graduate Medical Education: Historical Perspectives, Current Status, and Future Directions

Technological advancement and improved training strategies have transformed the healthcare practice environment in the last few decades. Simulation has evolved as one of the leading training models for the next generation of healthcare professionals. Simulation-based training enables healthcare professionals to acquire knowledge and skills in a safe and educationally oriented environment and can be a valuable tool for improving clinical practice and patient outcomes. The field of healthcare simulation has been rapidly growing, and various graduate medical education programs around the world have started incorporating this modality into their curricula. In graduate medical education, simulation-based training helps implement an outcome-based curriculum that tests the trainee's actual skill level as the primary factor for the trainee's competency rather than relying on the current model of a predetermined training period. However, the major challenge revolves around developing an educational curriculum incorporating a simulation-based educational model, understanding the value of this new technology, the overall cost factor, and the lack of adequate infrastructure. Hence, embracing the full potential of simulation technology in graduate medical education curricula requires an innovative approach with participation from institutions and stakeholders.

Online learning in health professions education. Part 2: Tools and practical application: AMEE Guide No. 163

Part 1 of the AMEE Guide Online learning in health professions education focused on foundational concepts such as theory, methods, and instructional design in online learning. Part 2 builds upon Part 1, introducing technology tools and applications of these foundational concepts by exploring the various levels (from beginner to advanced) of utilisation, while describing how their usage can transform Health Professions Education. This Part covers Learning Management Systems, infographics, podcasting, videos, websites, social media, online discussion forums, simulation, virtual patients, extended and virtual reality. Intertwined are other topics, such as online small group teaching, game-based learning, FOAM, online social and collaboration learning, and virtual care teaching. We end by discussing digital scholarship and emerging technologies. Combined with Part 1, the overall aim of Part 2 is to produce a comprehensive overview to help guide effective use online learning in Health Professions Education.

Virtual Patient Simulation Offers an Objective Assessment of CME Activity by Improving Clinical Knowledge and the Levels of Competency of Healthcare Providers

The main goal of continuing medical education (CME) is to help healthcare providers (HCP) improve their knowledge and levels of competency with an ultimate enhancement of their performance in practice. Despite the long and well-intentional history of CME, the proof of success (based on improved clinical outcomes) is difficult to obtain objectively. In the past several years, the traditional CME world has been disrupted by replacing multiple-choice questions with virtual simulation. We utilised an innovative, next-generation virtual patient simulation (VPS) platform to develop objective measures to assess the success of educational activities that can be applied to the CME. This VPS platform was used at five distinct educational events designed to assess learners' knowledge and competency in the guideline-driven management of Type 2 diabetes, hyperlipidaemia, and hypertension. A total of 432 learners (medical doctors, nurse practitioners, and clinical pharmacists) participated in these educational events of whom 149 went through two consecutive cases with a similar clinical picture and educational goals. Their ability to achieve glycaemic, lipid, and blood pressure control improved significantly as they moved from the first to the second case. The participants improved their test performance in all categories - between 5 and 38%, achieving statistically significant increases in the many goals examined. In conclusion, this study employed the pioneering application of technology to produce, collect and analyse the VPS data to evaluate objectively educational activities. This VPS platform allows not only an objective assessment of the effectiveness of the CME activity but also provides timely and helpful feedback to both learners and providers of a given educational event.

"It kinda helped us to be there": students' perspectives on the use of virtual patient software in psychiatry posting

BACKGROUND

At the Faculty of Medicine of the National University of Malaysia, a virtual patient software program, DxR Clinician, was utilised for the teaching of neurocognitive disorder topics during the psychiatry posting of undergraduate medical students in a modified team-based learning (TBL) module. This study aimed to explore medical students' learning experiences with virtual patient.

METHODS

Ten students who previously underwent the learning module were recruited through purposive sampling. The inclusion criteria were: (a) Fourth-year medical students; and (b) Completed psychiatry posting with the new module. Students who dropped out or were unable to participate in data collection were excluded. Two online focus group discussions (FGDs) with five participants each were conducted by an independent facilitator, guided by a questioning route. The data were transcribed verbatim and coded using the thematic analysis approach to identify themes.

RESULTS

Three main themes of their learning experience were identified: (1) fulfilment of the desired pedagogy (2), realism of the clinical case, and (3) ease of use related to technical settings. The pedagogy theme was further divided into the following subthemes: level of entry for students, flexibility of presentation of content, provision of learning guidance, collaboration with peers, provision of feedback, and assessment of performance. The realism theme had two subthemes: how much the virtual patient experience mimicked an actual patient and how much the case scenario reflected real conditions in the Malaysian context. The technical setting theme entailed two subthemes: access to the software and appearance of the user interface. The study findings are considered in the light of learning formats, pedagogical and learning theories, and technological frameworks.

CONCLUSIONS

The findings shed light on both positive and negative aspects of using virtual patients for medical students' psychiatry posting, which opens room for further improvement of their usage in undergraduate psychiatry education.

Simulation-based education in neurology: lessons from the COVID-19 pandemic

OBJECTIVES

The COVID-19 pandemic has led to the disruption of all sectors of the economy including education. According to UNESCO over 1.37 million young people including medical students, were affected by the lockdowns in response to COVID-19 and the subsequent closure of the education system. The primary challenge for medical education was to provide clerkships in a biosafety environment. This study aimed to determine the impact of a simulated hospital in a neurology clerkship of 5-year medical students during the coronavirus pandemic and compare their results with a non-pandemic group in Bogotá, Colombia.

RESULTS

The students in the pandemic group answered a Likert scale survey regarding their satisfaction with the simulated hospital. Both groups were required to perform an oral, mid-term and final examination. From the results, it is clear that students perceived that exposure to a simulated hospital facilitated their learning process (93.1%) and allowed greater interaction with the teacher compared to a face-to-face environment (77.3%). There were no clinically significant differences in test results. This experience indicates that a simulated hospital is a valuable method to acquire clinical skills in trainees, that could be integrated into the curricular milestones of medical education programs regardless of the pandemic.

On-Campus Nursing Training During COVID-19 in Japan: A Systematic Literature Review

During the coronavirus disease 2019 (COVID-19) pandemic, nursing education in Japan recommended the implementation of on-campus practical training as a substitute for hospital-based clinical training. This study explores nursing students' experiences with on-campus nursing training as an alternative to clinical practice by clarifying its advantages and disadvantages. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis and we included 26 articles in this study. Our findings reveal both the advantages of acquiring nursing knowledge, basic skills, and membership among students. Contrastingly, many students failed to acquire skills related to patient communication and flexible nursing care. Thus, despite some strengths, on-campus training is not a complete replacement for clinical training. Although this method has benefits in emergency situations, it is desirable to consider other educational methods in preparation for future pandemics.

Artificial Intelligence Revolutionizing the Field of Medical Education

Medical education has ventured into a new arena of computer-assisted teaching powered by artificial intelligence (AI). In medical institutions, AI can serve as an intelligent tool facilitating the decision-making process effectively. AI can enhance teaching by assisting in developing new strategies for educators. Similarly, students also benefit from intelligent systems playing the role of competent teachers. Thus, AI-integrated medical education paves new opportunities for advanced teaching and learning experiences and improved outcomes. On the other hand, optical mark recognition and automated scoring are ways AI can also transform into a real-time assessor and evaluator in medical education. This review summarizes the AI tools and their application in medical teaching or learning, assessment, and administrative support. This article can aid medical institutes in planning and implementing AI according to the needs of the educators.

Health science staff and student experiences of teaching and assessing clinical skills using digital tools: a qualitative study

INTRODUCTION

Once considered a supplement to traditional teaching approaches, digital tools now play a pivotal role in building core clinical competencies. This study aims to explore staff and student experiences of navigating the challenges of teaching and assessing clinical skills using digital technology. It also aims to provide insight into what skills, or aspects of skills, may be best suited to digitally enhanced teaching, thereby advancing the future of health science education.

METHODS

This qualitative study comprises the second phase of data generation for a mixed-methods research project entitled DEPTH (Digitally Enhanced Practical Teaching in Health Science). Health science staff and students expressed interest in taking part in the current study during the first stage of data collection. Qualitative data was collected in January 2022 through semi-structured group interviews and individual semi-structured interviews. An interpretivist qualitative research design underpinned by a critical realist epistemological position was used. Themes were generated following Braun and Clarke's 6-step process for reflexive thematic analysis.

RESULTS

Overall, 10 staff and 8 students across 11 health science disciplines participated in this research. Fourteen hours of transcripts were analysed and 4 themes generated. Our findings highlight the suitability of digitally enhanced teaching for low-stake skills requiring visual and auditory training, while skills requiring tactile training require in-person practice to build student competency. Importantly, our findings indicate a desire for increased remote teaching. While our work was not specifically aimed at documenting experiences related to the Covid-19 pandemic, all participants had lived experience teaching or learning during the pandemic and many spoke specifically about this.

CONCLUSIONS

The timing of this paper captures a novel moment in the history of clinical pedagogy. Staff and students advocate for the continued integration of technology into health science education generally, and clinical skills teaching specifically. For this to be successful, judicious selection of methods, skills, skill components and technology, that can be appropriately mapped onto specific learning outcomes, is required.

The association between quality of connections and diagnostic accuracy in student-generated concept maps for clinical reasoning education with virtual patients

Objectives

Concept maps are a learning tool that fosters clinical reasoning skills in healthcare education. They can be developed by students in combination with virtual patients to create a visual representation of the clinical reasoning process while solving a case. However, in order to optimize feedback, there is a need to better understand the role of connections between concepts in student-generated maps. Therefore, in this study we investigated whether the quality of these connections is indicative of diagnostic accuracy.

Methods

We analyzed 40 concept maps created by fifth-year medical students in the context of four virtual patients with commonly encountered diagnoses. Half of the maps were created by students who made a correct diagnosis on the first attempt; the other half were created by students who made an error in their first diagnosis. The connections in the maps were rated by two reviewers using a relational scoring system. Analysis of covariance was employed to examine the difference in mean connection scores among groups while controlling for the number of connections.

Results

There were no differences between the groups in the number of concepts or connections in the maps; however, maps made by students who made a correct first diagnosis had higher scores for the quality of connections than those created by students who made an incorrect first diagnosis (12.13 vs 9.09; p=0.03). We also observed students' general reluctance to use connections in their concept maps.

Conclusion

Our results suggest that the quality, not the quantity, of connections in concept maps is indicative of their diagnostic accuracy.

A systematic review on the use of virtual patient and computer-based simulation for experiential pharmacy education

Background

Simulation use is rapidly expanding, with technologies like virtual patients (VPs) and computer-based simulation (CBS) allowing for educators to equip pharmacy students with the necessary skills that are aligned with the demands and expectations of a practicing pharmacy professional. These technologies enable pharmacy students to be exposed to challenging or infrequent patient case scenarios in an authentic pharmacy setting. This allows for the reinforcing of care processes and for techniques and crucial skills to be applied.

Aim of the study

To consolidate the existing evidence regarding the utilization of VPs and CBS in preparing and supporting students in pharmacy experiential education and evaluate the effectiveness of these approaches in enhancing student pharmacists' learning outcomes, including knowledge, skills, confidence, enjoyment, and engagement.

Methods

Five electronic databases were searched using combined keyword and indexing terms (when available) with Boolean operators for the literature search. Studies that reported or investigated the use of VPs and CBS in pharmacy experiential education were included. Data on study design, demographics of participants, information on the interventions, course/skills, primary and secondary outcomes, and qualitative findings were extracted.

Results

A total of 911 unique articles were initially identified and filtered down to 19 articles fitting within the inclusion criteria. The selected 19 articles involved student pharmacists (Y1-Y5) and pre-registered pharmacists from ten countries. Simulation tools were used in various pharmacy courses, including Advanced Pharmacy Practice Experience (APPE), Advanced Pharmaceutical Care II, and Medication Management. Implementing these tools in pharmacy experiential education demonstrated a statistically significant improvement in student knowledge (p < 0.05). Most students agreed/strongly agreed that practicing with virtual patient cases enhanced their clinical reasoning, counseling skills, confidence in communication, and attitudes toward the courses.

Conclusions

This systematic review supports the use of VPs and CBS in pharmacy experiential education and provides practical recommendations for educators including selecting suitable tools, implementing them strategically within courses, integrating them with existing activities, and considering financial and IT support.

Influence of simulation design on stress, anxiety and self-confidence of nursing students: Systematic review with meta-analysis

AIM

To evaluate the simulation design characteristics that may influence the stress, anxiety and self-confidence of undergraduate nursing students during learning.

DESIGN

Systematic review with meta-analysis.

DATA SOURCES

Searchers were conducted in October 2020 and updated in August 2022 in the databases CENTRAL, CINAHL, Embase®, ERIC, LILACS, MEDLINE, PsycINFO®, Scopus and Web of Science, PQDT Open (ProQuest), BDTD, Google Scholar and specific journals on simulation.

REVIEW METHODS

This review was conducted according to the recommendations of Cochrane Handbook for Systematic Reviews and reported according to the PRISMA Statement. Experimental and quasi-experimental studies that compared the effect of simulation on stress, anxiety and self-confidence of nursing students were included. The selection of studies and data extraction was performed independently by two reviewers. Simulation information was collected as prebriefing, scenario, debriefing, duration, modality, fidelity and simulator. Data summarization was performed by qualitative synthesis and meta-analytical methods.

RESULTS

Eighty studies were included in the review, and most reported in detail the structure of the simulation, contemplating prebriefing, scenario, debriefing and the duration of each step. In subgroup meta-analysis, the presence of prebriefing, duration of more than 60 min and high-fidelity simulations helped reduce anxiety, while the presence of prebriefing and debriefing, duration, immersive clinical simulation modalities and procedure simulation, high-fidelity simulations and use of mannequins, standardised patients and virtual simulators, contributed to greater students' self-confidence.

CONCLUSIONS

Different modulations of simulation design components imply reduction of anxiety and increased self-confidence in nursing students, especially highlighting the quality of the methodological report of simulation interventions.

RELEVANCE TO CLINICAL PRACTICE

These findings help to support the need of more rigorous methodology in simulation designs and research methods. Consequently, impact on the education of qualified professionals prepared to work in clinical practice. No Patient or Public Contribution.

Developing a European longitudinal and interprofessional curriculum for clinical reasoning

Clinical reasoning is a complex and crucial ability health professions students need to acquire during their education. Despite its importance, explicit clinical reasoning teaching is not yet implemented in most health professions educational programs. Therefore, we carried out an international and interprofessional project to plan and develop a clinical reasoning curriculum with a train-the-trainer course to support educators in teaching this curriculum to students. We developed a framework and curricular blueprint. Then we created 25 student and 7 train-the-trainer learning units and we piloted 11 of these learning units at our institutions. Learners and faculty reported high satisfaction and they also provided helpful suggestions for improvements. One of the main challenges we faced was the heterogeneous understanding of clinical reasoning within and across professions. However, we learned from each other while discussing these different views and perspectives on clinical reasoning and were able to come to a shared understanding as the basis for developing the curriculum. Our curriculum fills an important gap in the availability of explicit clinical reasoning educational materials both for students and faculty and is unique with having specialists from different countries, schools, and professions. Faculty time and time for teaching clinical reasoning in existing curricula remain important barriers for implementation of clinical reasoning teaching.

Evaluating the Effectiveness of Interactive Virtual Patients for Medical Education in Zambia: Randomized Controlled Trial

BACKGROUND

Zambia is facing a severe shortage of health care workers, particularly in rural areas. Innovative educational programs and infrastructure have been established to bridge this gap; however, they encounter substantial challenges because of constraints in physical and human resources. In response to these shortcomings, strategies such as web-based and blended learning approaches have been implemented, using virtual patients (VPs) as a means to promote interactive learning at the Levy Mwanawasa Medical University (LMMU) in Zambia.

OBJECTIVE

This study aimed to evaluate the students' knowledge acquisition and acceptance of 2 VP medical topics as a learning tool on a Zambian higher education e-learning platform.

METHODS

Using a mixed methods design, we assessed knowledge acquisition using pre- and posttests. In a randomized controlled trial setting, students were assigned (1:1) to 2 medical topics (topic 1: appendicitis and topic 2: severe acute malnutrition) and then to 4 different learning tools within their respective exposure groups: VPs, textbook content, preselected e-learning materials, and self-guided internet materials. Acceptance was evaluated using a 15-item questionnaire with a 5-point Likert scale.

RESULTS

A total of 63 third- and fourth-year Bachelor of Science clinical science students participated in the study. In the severe acute malnutrition-focused group, participants demonstrated a significant increase in knowledge within the textbook group (P=.01) and the VP group (P=.01). No substantial knowledge gain was observed in the e-learning group or the self-guided internet group. For the appendicitis-focused group, no statistically significant difference in knowledge acquisition was detected among the 4 intervention groups (P=.62). The acceptance of learning materials exhibited no substantial difference between the VP medical topics and other learning materials.

CONCLUSIONS

In the context of LMMU, our study found that VPs were well accepted and noninferior to traditional teaching methods. VPs have the potential to serve as an engaging learning resource and can be integrated into blended learning approaches at LMMU. However, further research is required to investigate the long-term knowledge gain and the acceptance and effectiveness of VPs in medical education.

TRIAL REGISTRATION

Pan African Clinical Trials Registry (PACTR) PACTR202211594568574; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=20413.