The effectiveness of using virtual patient educational tools to improve medical students' clinical reasoning skills: a systematic review

The effect of case-based mobile virtual patient application on students' academic achievement in clinical reasoning skills

This mixed-method study aims to determine the effect of the use of mobile virtual patient application with narrated case-based virtual patients as an assistive technology on students' clinical reasoning skills. It makes a notable contribution by exploring the impact of mobile virtual patient applications on healthcare students' clinical skills and their preparation for real-world patient care. In addition, the accuracy of the analysis results regarding the effect on student achievement was analyzed with a second dataset tool, and thus, aiming to increase reliability by verifying the same research question with a different quantitative analysis technique. In the qualitative part of the study, students' views on the implementation were collected through an open-ended questionnaire and the data were subjected to content analysis. An achievement test was also developed to determine the development of students' clinical reasoning skills, which revealed that each of the learning environments had different outcomes regarding students' achievement and that supporting the traditional environment with the mobile virtual patient application yielded better results for increasing students' achievement. Students' opinions about the mobile virtual patient application and the process also support the increase in academic achievement aimed at measuring clinical reasoning skills. The content analysis showed that the students, who generally reported multiple positive factors related to the application, thought that the stories and cases presented created a perception of reality, and they especially highlighted the contribution of the application to learning the story organization. Based on all these results, it can be said that the application supports clinical reasoning, provides practical experience, improves academic achievement, and contributes positively to motivation.

A Language Model-Powered Simulated Patient With Automated Feedback for History Taking: Prospective Study

BACKGROUND

Although history taking is fundamental for diagnosing medical conditions, teaching and providing feedback on the skill can be challenging due to resource constraints. Virtual simulated patients and web-based chatbots have thus emerged as educational tools, with recent advancements in artificial intelligence (AI) such as large language models (LLMs) enhancing their realism and potential to provide feedback.

OBJECTIVE

In our study, we aimed to evaluate the effectiveness of a Generative Pretrained Transformer (GPT) 4 model to provide structured feedback on medical students' performance in history taking with a simulated patient.

METHODS

We conducted a prospective study involving medical students performing history taking with a GPT-powered chatbot. To that end, we designed a chatbot to simulate patients' responses and provide immediate feedback on the comprehensiveness of the students' history taking. Students' interactions with the chatbot were analyzed, and feedback from the chatbot was compared with feedback from a human rater. We measured interrater reliability and performed a descriptive analysis to assess the quality of feedback.

RESULTS

Most of the study's participants were in their third year of medical school. A total of 1894 question-answer pairs from 106 conversations were included in our analysis. GPT-4's role-play and responses were medically plausible in more than 99% of cases. Interrater reliability between GPT-4 and the human rater showed "almost perfect" agreement (Cohen κ=0.832). Less agreement (κ<0.6) detected for 8 out of 45 feedback categories highlighted topics about which the model's assessments were overly specific or diverged from human judgement.

CONCLUSIONS

The GPT model was effective in providing structured feedback on history-taking dialogs provided by medical students. Although we unraveled some limitations regarding the specificity of feedback for certain feedback categories, the overall high agreement with human raters suggests that LLMs can be a valuable tool for medical education. Our findings, thus, advocate the careful integration of AI-driven feedback mechanisms in medical training and highlight important aspects when LLMs are used in that context.

Integrating virtual patients into undergraduate health professions curricula: a framework synthesis of stakeholders' opinions based on a systematic literature review

BACKGROUND

Virtual patients (VPs) are widely used in health professions education. When they are well integrated into curricula, they are considered to be more effective than loosely coupled add-ons. However, it is unclear what constitutes their successful integration. The aim of this study was to identify and synthesise the themes found in the literature that stakeholders perceive as important for successful implementation of VPs in curricula.

METHODS

We searched five databases from 2000 to September 25, 2023. We included qualitative, quantitative, mixed-methods and descriptive case studies that defined, identified, explored, or evaluated a set of factors that, in the perception of students, teachers, course directors and researchers, were crucial for VP implementation. We excluded effectiveness studies that did not consider implementation characteristics, and studies that focused on VP design factors. We included English-language full-text reports and excluded conference abstracts, short opinion papers and editorials. Synthesis of results was performed using the framework synthesis method with Kern's six-step model as the initial framework. We appraised the quality of the studies using the QuADS tool.

RESULTS

Our search yielded a total of 4808 items, from which 21 studies met the inclusion criteria. We identified 14 themes that formed an integration framework. The themes were: goal in the curriculum; phase of the curriculum when to implement VPs; effective use of resources; VP alignment with curricular learning objectives; prioritisation of use; relation to other learning modalities; learning activities around VPs; time allocation; group setting; presence mode; VPs orientation for students and faculty; technical infrastructure; quality assurance, maintenance, and sustainability; assessment of VP learning outcomes and learning analytics. We investigated the occurrence of themes across studies to demonstrate the relevance of the framework. The quality of the studies did not influence the coverage of the themes.

CONCLUSIONS

The resulting framework can be used to structure plans and discussions around implementation of VPs in curricula. It has already been used to organise the curriculum implementation guidelines of a European project. We expect it will direct further research to deepen our knowledge on individual integration themes.

Mock Wards: Incorporating a Theoretical Framework to Create a Blended Virtual and In-Person Clinical Reasoning Education Platform

Introduction The coronavirus 2019 pandemic highlighted virtual learning (VL) as a promising tool for medical education, yet its effectiveness in teaching clinical reasoning (CR) remains underexplored. Past studies have suggested VL can effectively prepare students for clinical settings. Informed by the Milestones of Observable Behaviours for CR (MOBCR) and whole-case theoretical frameworks, the Mock Wards (MW) program was created using a novel blended in-person learning (IPL) and VL platform. MW consisted of case-based small-group formats for medical students interested in learning approaches and differentials to commonly encountered presenting symptoms and diagnoses in internal medicine. This study sought to use MW's blended design to qualitatively analyze CR development and compare its utility between VL and IPL. Methods Qualitative analysis was conducted using in-depth semi-structured interviews with first-year pre-clerkship medical students (n = 8) who completed the MW program and participated in the study. The interview guide was informed by the MOBCR framework. Interview transcripts were analyzed using a directed qualitative content analysis approach. Translational coding and HyperRESEARCHTM (Researchware, Inc., Randolph, MA) software-generated mind maps guided the theme development. Results Three overarching themes were constructed: (1) tailoring pedagogical frameworks to learning modalities, (2) learning through interactivity, and (3) balancing accessibility with learner engagement. Participants emphasized that teaching CR skills is modality-specific and not fully interchangeable, with IPL being superior in facilitating social cohesion, non-verbal communication, and feedback. In contrast, VL required structured approaches and relied more on verbal communication and pre-made digital materials. IPL also enhanced interactivity, peer relationships, and spontaneous communication, whereas VL faced challenges such as social awkwardness and technological constraints hindering effective collaboration. VL provided superior accessibility to facilitate distributed learning and management of concurrent academic obligations. Conclusion The MW-blended platform highlights the importance of focusing on modality-tailored pedagogies, emphasizing group interactability, and balancing VL accessibility against decreased engagement within the IPL environment when teaching CR skills. Blended education models may benefit from a scaffolding approach, using IPL as a prerequisite to VL to improve CR development and alignment within a learner's zone of proximal development.

Transmogrifying Anatomy Learning by Kaizen Strategies and Game-Based Education

INTRODUCTION

The study explores the significance of continuous improvement through Kaizen in the evolving landscape of anatomy education. In this study, our objectives were twofold: 1) to assess the effectiveness of incorporating games in the first-year medical curriculum for reinforcing anatomy knowledge, and 2) to explore whether game-based sessions elicit improved student responses in the learning of anatomy.

METHODOLOGY

A total of 100 first-year Bachelor of Medicine and Bachelor of Surgery (MBBS) students at All India Institute of Medical Sciences (AIIMS), Bibinagar, Hyderabad, Telangana, India, were exposed to game-based learning which involved six rounds: acronym mnemonics (Redolent), jigsaw puzzle solving (Dumbfound), Filling gaps in concept maps (Blogging), Connecting images (Kinship), case scenario creation (Penman), and rapid-fire round (Rattling).

RESULTS

At the end of the intervention, a test was taken and feedback was obtained from all the participants using a prevalidated questionnaire prepared based on a 5-point Likert scale. Questionnaire responses were subjected to descriptive analysis, and reliability analysis (Cronbach's α) was performed to evaluate the internal consistencies of items. A paired t-test indicated that there was a significantly large difference between before (mean (M) = 17.2, standard deviation (SD) = 9.1) and after (M = 25.9, SD = 8), t(99) = 18.4, p < .001, signifying that the performance of the students was far better with game-based learning approaches than conventional learning.

CONCLUSION

Combining game-based education with Kaizen principles in anatomy education not only prepares students for success in their academic pursuits but also empowers them to navigate the complexities of the ever-evolving healthcare landscape with confidence and proficiency.

Current status and ongoing needs for the teaching and assessment of clinical reasoning - an international mixed-methods study from the students` and teachers` perspective

BACKGROUND

Clinical reasoning (CR) is a crucial ability that can prevent errors in patient care. Despite its important role, CR is often not taught explicitly and, even when it is taught, typically not all aspects of this ability are addressed in health professions education. Recent research has shown the need for explicit teaching of CR for both students and teachers. To further develop the teaching and learning of CR we need to improve the understanding of students' and teachers' needs regarding content as well as teaching and assessment methods for a student and trainer CR curriculum.

METHODS

Parallel mixed-methods design that used web-surveys and semi-structured interviews to gather data from both students (nsurvey = 100; ninterviews = 13) and teachers (nsurvey = 112; ninterviews = 28). The interviews and surveys contained similar questions to allow for triangulation of the results. This study was conducted as part of the EU-funded project DID-ACT ( https://did-act.eu ).

RESULTS

Both the surveys and interview data emphasized the need for content in a clinical reasoning (CR) curriculum such as "gathering, interpreting and synthesizing patient information", "generating differential diagnoses", "developing a diagnostic and a treatment plan" and "collaborative and interprofessional aspects of CR". There was high agreement that case-based learning and simulations are most useful for teaching CR. Clinical and oral examinations were favored for the assessment of CR. The preferred format for a train-the-trainer (TTT)-course was blended learning. There was also some agreement between the survey and interview participants regarding contents of a TTT-course (e.g. teaching and assessment methods for CR). The interviewees placed special importance on interprofessional aspects also for the TTT-course.

CONCLUSIONS

We found some consensus on needed content, teaching and assessment methods for a student and TTT-course in CR. Future research could investigate the effects of CR curricula on desired outcomes, such as patient care.

Effectiveness of combined virtual and clinical simulation compared with other active teaching strategies on health students' learning: a systematic review protocol

OBJECTIVE

The objective of this review is to synthesize the available evidence on the effectiveness of combined virtual and clinical simulation compared with other active teaching strategies on health students' learning.

INTRODUCTION

Current evidence indicates that both virtual simulation and clinical simulation are effective in assisting students to acquire clinical skills. However, there is a knowledge gap regarding the effectiveness of the combined use of both teaching strategies, which could enhance health students' learning.

INCLUSION CRITERIA

This review will consider experimental, quasi-experimental, and observational studies that address the combined use of virtual simulation with clinical simulation compared with other active teaching strategies in learning, clinical reasoning, clinical decision-making, and/or clinical competencies of health students. Combining different hybrid simulators to form a new one will not be considered for inclusion in the review.

METHODS

The databases to be searched will include Cochrane Library, MEDLINE (PubMed), CINAHL (EBSCOhost), Scopus, LILACS (VHL), Web of Science Core Collection, Embase, ERIC, and gray literature sources. Two independent reviewers will perform the study selection, critical appraisal, and data extraction using JBI tools. A narrative synthesis will be performed and, if possible, meta-analysis and risk assessment of publication bias. The Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach will be used to assess the certainty of the findings.

REVIEW REGISTRATION

PROSPERO CRD42023422410.

Virtual patients versus standardized patients for improving clinical reasoning skills in ophthalmology residents. A randomized controlled trial

BACKGROUND

History taking and clinical reasoning are important skills that require knowledge, cognition and meta-cognition. It is important that a trainee must experience multiple encounters with different patients to practice these skills. However, patient safety is also important, and trainees are not allowed to handle critically ill patients. To address this issue, a randomized controlled trial was conducted to determine the effectiveness of using Virtual Patients (VP) versus Standardized Patients (SP) in acquiring clinical reasoning skills in ophthalmology postgraduate residents.

METHODS

Postgraduate residents from two hospitals in Lahore, Pakistan, were randomized to either the VP group or the SP group and were exposed to clinical reasoning exercise via the VP or SP for 30 min after the pretest. This was followed by a posttest. One month after this activity, a follow-up posttest was conducted. The data were collected and analysed using IBM-SPSS version 25. Repeated measures ANOVA was used to track the effect of learning skills over time.

RESULTS

The mean age of the residents was 28.5 ± 3 years. The male to female ratio was 1:1.1. For the SP group, the mean scores were 12.6 ± 3.08, 16.39 ± 3.01 and 15.39 ± 2.95, and for the VP group, the mean scores were 12.7 ± 3.84, 16.30 ± 3.19 and 15.65 ± 3.18 for the pretest, posttest and follow-up posttest, respectively (p value < 0.00). However, the difference between the VP and SP groups was not statistically significant (p = 0.896). Moreover, there was no statistically significant difference between the VP and SP groups regarding the retention of clinical reasoning ability. In terms of learning gain, compared with the VP group, the SP group had a score of 51.46% immediately after clinical reasoning exercise as compared to VP group, in which it was 49.1%. After one month, it was 38.01 in SP and 40.12% in VP group.

CONCLUSION

VPs can be used for learning clinical reasoning skills in postgraduate ophthalmology residents in a safe environment. These devices can be used repeatedly without any risk to the real patient. Although similarly useful, SP is limited by its nonavailability for repeated exercises.

The effect of different patient-based learning models on student perceptions of empathy, engagement, knowledge, and learning experience

BACKGROUND

Problem-based learning is used widely in pharmacy and medical programmes, incorporating realistic patient scenarios into regular teaching as a way of linking theory to practice. Routine case-based learning lessons ranges from real patient involvement, scripted patient scenarios, digital simulations (avatars) as well as through media such as Zoom. The existing literature has explored the extensive benefits of using patients in clinical education, but fewer studies have directly compared the efficacy of each model as learning tools.

AIM

To compare student perceptions of patient-based learning models to elicit student empathy, increase engagement, improve knowledge, and enrich learning experience.

METHODS

A questionnaire was distributed to second-year pharmacy students in Swansea University to gather their perceptions on the nine different patient-based learning models in their routine teaching (SUMS RESC 2023-0011). Students were asked to rank their experience of the models explicitly against each other, based on the four pillars of (1) eliciting student empathy, (2) increasing engagement, (3) improving knowledge and (4) enriching the learning experience. Students were also asked to rate the significance of realism (i.e. knowing the patient demographics/having a visual representation of the patient) to their experience.

RESULTS

Altogether, 31 student rankings of the nine learning models were weighted (9 = highest rank; 1 = lowest ranked). The data showed clear preferences for real-patient involvement over fictional cases, especially for eliciting empathy. Interestingly, scripted scenarios were rated highly for both engagement and learning experience only when avatars were involved, which suggests a role of animated visual representation of the patient in facilitating these outcomes.

CONCLUSION

Whilst it is useful to have multiple patient-based learning models, this study serves as a guide for educators in preparing case-based learning sessions for achieving the desired outcomes of any of the four pillars above.

Clinical virtual simulation: predictors of user acceptance in nursing education

BACKGROUND

Using virtual patients integrated in simulators expands students' training opportunities in healthcare. However, little is known about the usability perceived by students and the factors/determinants that predict the acceptance and use of clinical virtual simulation in nursing education.

OBJECTIVES

To identify the factors/determinants that predict the acceptance and use of clinical virtual simulation in learning in nursing education.

METHODS

Observational, cross-sectional, analytical study of the use of clinical virtual simulation in nursing to answer the research question: What factors/determinants predict the acceptance and use of a clinical virtual simulator in nursing education? We used a non-probabilistic sampling, more specifically a convenience sample of nursing degree students. The data were collected through a questionnaire adapted from the Technology Acceptance Model 3. In technology and education, the Technology Acceptance Model is a theoretical model that predicts the acceptance of the use of technology by users.

RESULTS

The sample comprised 619 nursing students, who revealed mean values of perceived usefulness (M = 5.34; SD = 1.19), ease of use (M = 4.74; SD = 1.07), and intention to use the CVS (M = 5.21; SD = 1.18), in a Likert scale of seven points (1-the worst and 7 the best possible opinion). This study validated the use of Technology Acceptance Model 3 adapted and tested the related hypotheses, showing that the model explains 62% of perceived utility, 32% of ease of use, and 54% of intention to use the clinical virtual simulation in nursing by nursing students. The adequacy of the model was tested by analysis of the direct effects of the relationships between the internal constructs (PU-BI, β = 0.11, p = 0.012; PEOU-BI, β = -0.11, p = 0.002) and the direct relations between some of the constructs internal to the Technology Acceptance Model 3 and the external determinants Relevance for learning and Enjoyability. In the proposed model, the external constructs that best predicted perceived usefulness, ease of use, and behaviour intention to use the clinical virtual simulation in nursing were Relevance for learning and Enjoyability.

CONCLUSIONS

These study results allowed us to identify relevance for learning and enjoyability as the main factors/determinants that predict the acceptance and use of clinical virtual simulation in learning in nursing.

A Virtual Case Presentation Platform: Protocol Study

Gaining practical experience is indispensable for medical students. Therefore, when medical students were prevented access to hospitals during the COVID-19 pandemic in Romania, there was an urgent need to find a solution that would allow medical students to develop the skills they would usually develop in hospitals but without the need to be physically present in a hospital. This was the reason behind the idea of developing a Virtual Case Presentation Platform. The platform offers the possibility for medical students to reproduce virtually, in clinically valid scenarios, the diagnostic process and treatment recommendation, as well as the interactions with patients that usually take place in hospitals using natural language through speech and text. On the platform, the students receive valuable feedback from the professors about their performance. In order to reproduce the whole targeted experience for students, without missing anything, before starting the development of the platform, it was mandatory to identify and understand all the aspects that should be covered by the platform. The proposed platform covers the different aspects that have been identified for the diagnostic process and treatment recommendation. It enables medical students to develop essential skills for their future careers as doctors.

Exploring medical students' perceptions of individual and group-based clinical reasoning with virtual patients: a qualitative study

BACKGROUND

Virtual Patients are computer-based simulations used to teach and evaluate patient interviews, medical diagnoses, and treatment of medical conditions. It helps develop clinical reasoning skills, especially in undergraduate medical education. This study aimed to and investigate the medical students' perceptions of individual and group-based clinical reasoning and decision-making processes by using Virtual Patients.

METHODS

The study group comprised 24 third-year medical students. Body Interact® software was utilized as a VP tool. The students' readiness and the courses' learning goals were considered when choosing the scenarios. Semi-structured interview forms were employed for data collection. MAXQDA 2020 qualitative analysis software was used to analyze the data. The students' written answers were analyzed using content analysis.

RESULTS

The participants perceived individual applications as beneficial when making clinical decisions with Virtual Patients, but they suggested that group-based applications used with the same cases immediately following individual applications were a more appropriate decision-making method. The results indicated that students learn to make decisions through trial and error, based on software scoring priorities, or using clinical reasoning protocols.

CONCLUSION

In group-based reasoning, the discussion-conciliation technique is utilized. The students stated that the individual decision-making was advantageous because it provided students with the freedom to make choices and the opportunity for self-evaluation. On the other hand, they stated that the group based decision-making process activated their prior knowledge, assisted in understanding misconceptions, and promoted information retention. Medical educators need to determine the most appropriate method when using Virtual Patients, which can be structured as individual and/or group applications depending on the competency sought.

Assessing clinical reasoning skills following a virtual patient dizziness curriculum

OBJECTIVES

Dizziness is a common medical symptom that is frequently misdiagnosed. While virtual patient (VP) education has been shown to improve diagnostic accuracy for dizziness as assessed by VPs, trainee performance has not been assessed on human subjects. The study aimed to assess whether internal medicine (IM) interns after training on a VP-based dizziness curriculum using a deliberate practice framework would demonstrate improved clinical reasoning when assessed in an objective structured clinical examination (OSCE).

METHODS

All available interns volunteered and were randomized 2:1 to intervention (VP education) vs. control (standard clinical teaching) groups. This quasi-experimental study was conducted at one academic medical center from January to May 2021. Both groups completed pre-posttest VP case assessments (scored as correct diagnosis across six VP cases) and participated in an OSCE done 6 weeks later. The OSCEs were recorded and assessed using a rubric that was systematically developed and validated.

RESULTS

Out of 21 available interns, 20 participated. Between intervention (n=13) and control (n=7), mean pretest VP diagnostic accuracy scores did not differ; the posttest VP scores improved for the intervention group (3.5 [SD 1.3] vs. 1.6 [SD 0.8], p=0.007). On the OSCE, the means scores were higher in the intervention (n=11) compared to control group (n=4) for physical exam (8.4 [SD 4.6] vs. 3.9 [SD 4.0], p=0.003) and total rubric score (43.4 [SD 12.2] vs. 32.6 [SD 11.3], p=0.04).

CONCLUSIONS

The VP-based dizziness curriculum resulted in improved diagnostic accuracy among IM interns with enhanced physical exam skills retained at 6 weeks post-intervention.

Reflecting on gamified learning in medical education: a systematic literature review grounded in the Structure of Observed Learning Outcomes (SOLO) taxonomy 2012-2022

BACKGROUND

The acquisition of in-depth medical knowledge, skills, and competencies is of utmost importance when training future medical professionals. This systematic literature review delves into the empirical connection between gamified learning in medical education and the Structure of Observed Learning Outcomes (SOLO) taxonomy.

METHODS

Following PRISMA guidelines, a systematic literature review was conducted in seven databases to identify empirical studies related to gamification and medical education. The literature search was limited to peer-reviewed articles published between January 2012 and December 2022. Articles focusing on games or learning technologies in a broader sense as well as research focusing on nursing or pharmacy education were excluded.

RESULTS

Upon reviewing 23 qualified empirical studies that applied gamified learning strategies in medical education, 18 (78%) studies are associated with the second lowest level (uni-structural) of the SOLO taxonomy. The mid-level (multi-structural) learning outcomes are associated with three (13%) of the reviewed studies. There are five (22%) studies focusing on the second highest (relational) level of the SOLO. Only one study (4%) is associated with the highest SOLO level (extended-abstract). Finally, three (13%) studies were identified with multiple levels of the SOLO. In addition to the SOLO levels, the review found six (26%) studies emphasizing motivational and engagement support of gamified learning strategies in facilitating intended learning outcome attainment. A total of three (13%) studies, across three SOLO levels, suggested that gamified learning strategies can improve students' soft skills in medical education programs.

CONCLUSION

These findings collectively emphasize the need for future research and development to design gamified learning experiences capable of fostering higher SOLO taxonomy attainment in medical education. Moreover, there is potential to extend the SOLO framework to encompass motivational and affective learning outcomes, providing a comprehensive understanding of the impact of gamified learning on medical students.

Harnessing the benefits of ChatGPT for radiography education: A discussion paper

OBJECTIVE

Radiography education is pivotal in training skilled radiographers for diagnostic imaging and therapeutic applications. With technological advancements, interest in innovative educational tools to enhance traditional teaching methods is growing. This discussion paper explores the possibility of the integration of ChatGPT, a cutting-edge conversational AI language model, into radiography education.

KEY FINDINGS

We report that ChatGPT offers interactive learning opportunities that can facilitate learning. It also provides self-paced learning, revision platforms, and supports educators in scenario creation, assessment development, group collaboration, and professional and research activities. Despite these benefits, it is important to carefully consider issues related to academic integrity and privacy, along with the opportunities and challenges presented by this new technology in radiography education.

CONCLUSION

This paper highlights some of the prospects and limitations of the potential applications of ChatGPT in radiography education, underscoring the benefits for both students and educators. However, its implementation must be considered thoughtfully and ethically, taking into account its strengths and limitations.

IMPLICATIONS FOR PRACTICE

Integrating ChatGPT in radiography education has the potential to improve radiography education by improving digital literacy and graduate outcomes of students while streamlining the preparation process for educators. However, ethical implementation is vital for optimal outcomes.

"It kinda helped us to be there": students' perspectives on the use of virtual patient software in psychiatry posting

BACKGROUND

At the Faculty of Medicine of the National University of Malaysia, a virtual patient software program, DxR Clinician, was utilised for the teaching of neurocognitive disorder topics during the psychiatry posting of undergraduate medical students in a modified team-based learning (TBL) module. This study aimed to explore medical students' learning experiences with virtual patient.

METHODS

Ten students who previously underwent the learning module were recruited through purposive sampling. The inclusion criteria were: (a) Fourth-year medical students; and (b) Completed psychiatry posting with the new module. Students who dropped out or were unable to participate in data collection were excluded. Two online focus group discussions (FGDs) with five participants each were conducted by an independent facilitator, guided by a questioning route. The data were transcribed verbatim and coded using the thematic analysis approach to identify themes.

RESULTS

Three main themes of their learning experience were identified: (1) fulfilment of the desired pedagogy (2), realism of the clinical case, and (3) ease of use related to technical settings. The pedagogy theme was further divided into the following subthemes: level of entry for students, flexibility of presentation of content, provision of learning guidance, collaboration with peers, provision of feedback, and assessment of performance. The realism theme had two subthemes: how much the virtual patient experience mimicked an actual patient and how much the case scenario reflected real conditions in the Malaysian context. The technical setting theme entailed two subthemes: access to the software and appearance of the user interface. The study findings are considered in the light of learning formats, pedagogical and learning theories, and technological frameworks.

CONCLUSIONS

The findings shed light on both positive and negative aspects of using virtual patients for medical students' psychiatry posting, which opens room for further improvement of their usage in undergraduate psychiatry education.

The association between quality of connections and diagnostic accuracy in student-generated concept maps for clinical reasoning education with virtual patients

Objectives

Concept maps are a learning tool that fosters clinical reasoning skills in healthcare education. They can be developed by students in combination with virtual patients to create a visual representation of the clinical reasoning process while solving a case. However, in order to optimize feedback, there is a need to better understand the role of connections between concepts in student-generated maps. Therefore, in this study we investigated whether the quality of these connections is indicative of diagnostic accuracy.

Methods

We analyzed 40 concept maps created by fifth-year medical students in the context of four virtual patients with commonly encountered diagnoses. Half of the maps were created by students who made a correct diagnosis on the first attempt; the other half were created by students who made an error in their first diagnosis. The connections in the maps were rated by two reviewers using a relational scoring system. Analysis of covariance was employed to examine the difference in mean connection scores among groups while controlling for the number of connections.

Results

There were no differences between the groups in the number of concepts or connections in the maps; however, maps made by students who made a correct first diagnosis had higher scores for the quality of connections than those created by students who made an incorrect first diagnosis (12.13 vs 9.09; p=0.03). We also observed students' general reluctance to use connections in their concept maps.

Conclusion

Our results suggest that the quality, not the quantity, of connections in concept maps is indicative of their diagnostic accuracy.

A systematic review on the use of virtual patient and computer-based simulation for experiential pharmacy education

Background

Simulation use is rapidly expanding, with technologies like virtual patients (VPs) and computer-based simulation (CBS) allowing for educators to equip pharmacy students with the necessary skills that are aligned with the demands and expectations of a practicing pharmacy professional. These technologies enable pharmacy students to be exposed to challenging or infrequent patient case scenarios in an authentic pharmacy setting. This allows for the reinforcing of care processes and for techniques and crucial skills to be applied.

Aim of the study

To consolidate the existing evidence regarding the utilization of VPs and CBS in preparing and supporting students in pharmacy experiential education and evaluate the effectiveness of these approaches in enhancing student pharmacists' learning outcomes, including knowledge, skills, confidence, enjoyment, and engagement.

Methods

Five electronic databases were searched using combined keyword and indexing terms (when available) with Boolean operators for the literature search. Studies that reported or investigated the use of VPs and CBS in pharmacy experiential education were included. Data on study design, demographics of participants, information on the interventions, course/skills, primary and secondary outcomes, and qualitative findings were extracted.

Results

A total of 911 unique articles were initially identified and filtered down to 19 articles fitting within the inclusion criteria. The selected 19 articles involved student pharmacists (Y1-Y5) and pre-registered pharmacists from ten countries. Simulation tools were used in various pharmacy courses, including Advanced Pharmacy Practice Experience (APPE), Advanced Pharmaceutical Care II, and Medication Management. Implementing these tools in pharmacy experiential education demonstrated a statistically significant improvement in student knowledge (p < 0.05). Most students agreed/strongly agreed that practicing with virtual patient cases enhanced their clinical reasoning, counseling skills, confidence in communication, and attitudes toward the courses.

Conclusions

This systematic review supports the use of VPs and CBS in pharmacy experiential education and provides practical recommendations for educators including selecting suitable tools, implementing them strategically within courses, integrating them with existing activities, and considering financial and IT support.

Evaluating the Effectiveness of Interactive Virtual Patients for Medical Education in Zambia: Randomized Controlled Trial

BACKGROUND

Zambia is facing a severe shortage of health care workers, particularly in rural areas. Innovative educational programs and infrastructure have been established to bridge this gap; however, they encounter substantial challenges because of constraints in physical and human resources. In response to these shortcomings, strategies such as web-based and blended learning approaches have been implemented, using virtual patients (VPs) as a means to promote interactive learning at the Levy Mwanawasa Medical University (LMMU) in Zambia.

OBJECTIVE

This study aimed to evaluate the students' knowledge acquisition and acceptance of 2 VP medical topics as a learning tool on a Zambian higher education e-learning platform.

METHODS

Using a mixed methods design, we assessed knowledge acquisition using pre- and posttests. In a randomized controlled trial setting, students were assigned (1:1) to 2 medical topics (topic 1: appendicitis and topic 2: severe acute malnutrition) and then to 4 different learning tools within their respective exposure groups: VPs, textbook content, preselected e-learning materials, and self-guided internet materials. Acceptance was evaluated using a 15-item questionnaire with a 5-point Likert scale.

RESULTS

A total of 63 third- and fourth-year Bachelor of Science clinical science students participated in the study. In the severe acute malnutrition-focused group, participants demonstrated a significant increase in knowledge within the textbook group (P=.01) and the VP group (P=.01). No substantial knowledge gain was observed in the e-learning group or the self-guided internet group. For the appendicitis-focused group, no statistically significant difference in knowledge acquisition was detected among the 4 intervention groups (P=.62). The acceptance of learning materials exhibited no substantial difference between the VP medical topics and other learning materials.

CONCLUSIONS

In the context of LMMU, our study found that VPs were well accepted and noninferior to traditional teaching methods. VPs have the potential to serve as an engaging learning resource and can be integrated into blended learning approaches at LMMU. However, further research is required to investigate the long-term knowledge gain and the acceptance and effectiveness of VPs in medical education.

TRIAL REGISTRATION

Pan African Clinical Trials Registry (PACTR) PACTR202211594568574; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=20413.

Virtual versus paper-based PBL in a pulmonology course for medical undergraduates

BACKGROUND

Problem-based learning (PBL) remains a valid and effective tool for small-group medical education. Using Virtual patients (VP) case simulation in PBL is a recognizable educational method that has successfully prepared students to focus learning on core information that uses realistic patient-based cases relating to everyday clinical scenarios. Using other modalities as the virtual patient in PBL instead of the paper-based methods remains debatable. This study aimed to evaluate the effectiveness of using VP case simulation mannequin in PBL versus the PBL in paper-based cases in improving the cognitive skills by comparing the grades of a multiple-choice question test and assess its ability to reach students' satisfaction using questionnaire with Likert survey instrument.

METHODS

The study was conducted on 459 fourth-year medical students studying in the pulmonology module of the internal medicine course, Faculty of Medicine, October 6 University. All students were divided into 16 PBL classes and randomly divided into groups A and B by simple manual randomization. The groups were parallel with a controlled cross-over study between paper-based and virtual patient PBL.

RESULTS

The pre-test showed no significant difference between both, while post-test scores were significantly higher in both VP PBL cases 1 discussing COPD (6.25 ± 0.875) and case 2 discussing pneumonia (6.56 ± 1.396) compared to paper-based PBL (5.29 ± 1.166, 5.57 ± SD1.388, respectively) at p < 0.1 When students in Group A experienced PBL using VP in case 2 after paper-based PBL in case 1, their post-test score improved significantly. (from 5.26 to 6.56, p < .01). Meanwhile, there was a significant regression in the post-test score of the students in Group B when they experienced the paper-based PBL session in case 2 after using PBL using VP in case 1, (from 6.26 to 5.57, p < .01). Most of the students recommended using VP in PBL as they found VP was more engaging and inducing concentration in gathering the information needed to characterize the patient's problem than in a classroom- paper-based cases session. They also enjoyed the teaching of the instructor and found it a suitable learning style for them.

CONCLUSION

Implementing virtual patients in PBL increased knowledge acquisition and understanding in medical students and was more motivating for students than paper based PBL to gather the needed information.

Educators' perspectives of adopting virtual patient online learning tools to teach clinical reasoning in medical schools: a qualitative study

BACKGROUND

Learning tools using virtual patients can be used to teach clinical reasoning (CR) skills and overcome limitations of using face-to-face methods. However, the adoption of new tools is often challenging. The aim of this study was to explore UK medical educators' perspectives of what influences the adoption of virtual patient learning tools to teach CR.

METHODS

A qualitative research study using semi-structured telephone interviews with medical educators in the UK with control over teaching materials of CR was conducted. The Consolidated Framework for Implementation Research (CFIR), commonly used in healthcare services implementation research was adapted to inform the analysis. Thematic analysis was used to analyse the data.

RESULTS

Thirteen medical educators participated in the study. Three themes were identified from the data that influenced adoption: the wider context (outer setting); perceptions about the innovation; and the medical school (inner context). Participants' recognition of situations as opportunities or barriers related to their prior experiences of implementing online learning tools. For example, participants with experience of teaching using online tools viewed limited face-to-face placements as opportunities to introduce innovations using virtual patients. Beliefs that virtual patients may not mirror real-life consultations and perceptions of a lack of evidence for them could be barriers to adoption. Adoption was also influenced by the implementation climate of the setting, including positioning of CR in curricula; relationships between faculty, particularly where faculty were dispersed.

CONCLUSIONS

By adapting an implementation framework for health services, we were able to identify features of educators, teaching processes and medical schools that may determine the adoption of teaching innovations using virtual patients. These include access to face-to-face teaching opportunities, positioning of clinical reasoning in the curriculum, relationship between educators and institutions and decision-making processes. Framing virtual patient learning tools as additional rather than as a replacement for face-to-face teaching could reduce resistance. Our adapted framework from healthcare implementation science may be useful in future studies of implementation in medical education.

Evaluation of Virtual Reality High-Fidelity Adult Mannequin-based Simulation of Real-Life Clinical Scenarios in Teaching Clinical Pharmacology to Medical Students

Background

Presently, competency-based medical (CBME) curriculum challenges the medical educators to provide continuing education with new approaches to make learning more stimulating, motivating, and entertaining, fostering excellence in clinical practice. To address these issues, educators have advocated the use of virtual reality and mannequins to teach clinical pharmacology.

Aims and Objectives

To study the effect, perception, and feedback of virtual reality high-fidelity adult mannequin-based (VHFM) simulation of real-life clinical scenarios over conventional tutorials in teaching clinical pharmacology to medical students.

Material and Methods

An interventional study was designed for 2nd year MBBS students for a period of 6 months. The enrolled students were randomly assigned to the test group (VHFM) or control group (tutorials). The CAE Healthcare Ltd. maestro, high-fidelity prehospital mannequin (APOLLO) was used in the test group. Three sessions consisting of six different cases were discussed, and multiple-choice questions (MCQs)-based pre-test, post–test, and retest after a month were conducted in both groups and compared. The perception and feedback of faculty and students were obtained by using a modified and revalidated questionnaire.

Results

The test group outperformed the control group ( p <.001) in all sessions based on pre-test, post-test, and retest scores, and within-group comparisons revealed significant improvements in both groups. Students’ perceptions and feedback regarding VHFM were more enthusiastic and promising than in the tutorial group.

Conclusions

VHFM is student-centered, provides an active learning environment, and aids in skill development. We strongly suggest VHFM-based learning as a complement to traditional teaching strategies in pharmacology, especially for teaching clinical reasoning to medical students.