Development, implementation and pilot evaluation of a Web-based Virtual Patient Case Simulation environment--Web-SP

The Use of Virtual Patients to Provide Feedback on Clinical Reasoning: A Systematic Review

PURPOSE

Virtual patients (VPs) are increasingly used in health care professions education to support clinical reasoning (CR) development. However, the extent to which feedback is given across CR components is unknown, and guidance is lacking on how VPs can optimize CR development. This systematic review sought to identify how VPs provide feedback on CR.

METHOD

Seven databases (MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, and ProQuest Dissertations) were searched in March 2023 using terms (e.g., medical education , virtual patient , case-based learning , computer simulation ) adapted from a previous systematic review. All studies describing VP use for developing CR in medical professionals and provided feedback on at least 1 CR component were retrieved. Screening, data extraction, and quality assessment were performed. Narrative synthesis was performed to describe the approaches used to measure and provide feedback on CR.

RESULTS

A total of 6,526 results were identified from searches, of which 72 met the criteria, but only 35 full-text articles were analyzed because the reporting of interventions in abstracts (n = 37) was insufficient. The most common CR components developed by VPs were leading diagnosis (23 [65.7%]), management or treatment plan (23 [65.7%]), and information gathering (21 [60%]). The CR components were explored by various approaches, from predefined questions to free text and concept maps.

CONCLUSIONS

Studies describing VP use for giving CR feedback have mainly focused on easy-to-assess CR components, whereas few studies have described VPs designed for assessing CR components, such as problem representation, hypothesis generation, and diagnostic justification. Despite feedback being essential for learning, few VPs provided information on the learner's use of self-regulated learning processes. Educators designing or selecting VPs for CR use must consider the needs of learner groups and how different CR components can be explored and should make the instructional design of VPs explicit in published work.

Determining the effectiveness of a virtual service /patient-based education program on patient care and clinical decision-making in nursing: A quasi-experimental study

OBJECTIVE

The aim of this study was to determine the effectiveness of a virtual service/patient-based program (vSPBP) developed for nursing education and its effect on the development of care plan preparation and clinical decision-making skills.

METHODS

The study was conducted in a quasi-experimental design with a sample of fourth-year nursing students. Participants were assigned to the intervention group (n=44) and control group (n=51). The intervention group participated in a full-day vSPBP in addition to clinical training, whereas the control group received only the clinical training. Both groups were evaluated at the end of the intervention for care planning skills and at the beginning, middle, and end of the academic year for clinical decision-making skills. The Modified Simulation Effectiveness Tool (mSET) and focused group interview were used to evaluate the effectiveness of the vSPBP; nursing students' Clinical Decision-Making in Nursing Scale (CDM-NS) and Care Plan Evaluation Form were used to evaluate learning outcomes. Quantitative data were analyzed using the t-test and ANOVA. Qualitative data were analyzed by three researchers, and themes were identified. Ethical permissions were obtained from the relevant units.

RESULTS

The total score of the Turkish Version of the mSET was 84.39±12.08 (51-95) and the education program was found to be highly effective. The mean care plan preparation skills scores of the intervention and control groups were 44.84±2.77 and 27.75±4.28 (0-50), respectively, and the total scores of the CDM-NS (at the last measurement) were 147.90±11.28 and 146.42±12.21. While there was a significant difference between the intervention and control groups in the ability to prepare a care plan (p=0.001), there was no difference between the groups in clinical decision-making skills over time (p=0.433), between the second and third measurements over time (p>0.05), but both measurements increased significantly compared with the first measurement (p=0.000).

CONCLUSION

The vSPBP was determined to be an effective learning activity for the development of care plan preparation and clinical reasoning skills, as well as effective in closing the gap between theoretical and clinical knowledge and adaptation to the nursing process when applied in an integrated manner with the existing nursing program.

Designing and Evaluating an Emotionally Responsive Virtual Patient Simulation

INTRODUCTION

Virtual patient (VP) simulations have been widely used for healthcare training, education, and assessment. However, few VP systems have integrated emotion sensing and analyzed how a user's emotions may influence the overall training experience. This article presents a VP that can recognize and respond to 5 human emotions (anger, disgust, fear, joy, and sadness), as well as 2 facial expressions (smiling and eye contact).

METHODS

The VP was developed by combining the capabilities of a facial recognition system, a tone analyzer, a cloud-based artificial intelligence chatbot, and interactive 3-dimensional avatars created in a high-fidelity game engine (Unity). The system was tested with healthcare professionals at Changzhou Traditional Chinese Medicine Hospital.

RESULTS

A total of 65 participants (38 females and 27 males) aged between 23 and 57 years (mean = 38.35, SD = 11.48) completed the survey, and 19 participants were interviewed. Most participants perceived that the VP was useful in improving their communication skills, particularly their nonverbal communication skills. They also reported that adding users' affective states as an additional interaction increased engagement of the VP and helped them build connections with the VP.

CONCLUSIONS

The emotionally responsive VP seemed to be functionally complete and usable. However, some technical limitations need to be addressed before the system's official implementation in real-world clinical practice. Future development will include improving the accuracy of the speech recognition system, using more sophisticated emotion sensing software, and developing a natural user interface.

A Virtual Case Presentation Platform: Protocol Study

Gaining practical experience is indispensable for medical students. Therefore, when medical students were prevented access to hospitals during the COVID-19 pandemic in Romania, there was an urgent need to find a solution that would allow medical students to develop the skills they would usually develop in hospitals but without the need to be physically present in a hospital. This was the reason behind the idea of developing a Virtual Case Presentation Platform. The platform offers the possibility for medical students to reproduce virtually, in clinically valid scenarios, the diagnostic process and treatment recommendation, as well as the interactions with patients that usually take place in hospitals using natural language through speech and text. On the platform, the students receive valuable feedback from the professors about their performance. In order to reproduce the whole targeted experience for students, without missing anything, before starting the development of the platform, it was mandatory to identify and understand all the aspects that should be covered by the platform. The proposed platform covers the different aspects that have been identified for the diagnostic process and treatment recommendation. It enables medical students to develop essential skills for their future careers as doctors.

Evaluating the Effectiveness of Interactive Virtual Patients for Medical Education in Zambia: Randomized Controlled Trial

BACKGROUND

Zambia is facing a severe shortage of health care workers, particularly in rural areas. Innovative educational programs and infrastructure have been established to bridge this gap; however, they encounter substantial challenges because of constraints in physical and human resources. In response to these shortcomings, strategies such as web-based and blended learning approaches have been implemented, using virtual patients (VPs) as a means to promote interactive learning at the Levy Mwanawasa Medical University (LMMU) in Zambia.

OBJECTIVE

This study aimed to evaluate the students' knowledge acquisition and acceptance of 2 VP medical topics as a learning tool on a Zambian higher education e-learning platform.

METHODS

Using a mixed methods design, we assessed knowledge acquisition using pre- and posttests. In a randomized controlled trial setting, students were assigned (1:1) to 2 medical topics (topic 1: appendicitis and topic 2: severe acute malnutrition) and then to 4 different learning tools within their respective exposure groups: VPs, textbook content, preselected e-learning materials, and self-guided internet materials. Acceptance was evaluated using a 15-item questionnaire with a 5-point Likert scale.

RESULTS

A total of 63 third- and fourth-year Bachelor of Science clinical science students participated in the study. In the severe acute malnutrition-focused group, participants demonstrated a significant increase in knowledge within the textbook group (P=.01) and the VP group (P=.01). No substantial knowledge gain was observed in the e-learning group or the self-guided internet group. For the appendicitis-focused group, no statistically significant difference in knowledge acquisition was detected among the 4 intervention groups (P=.62). The acceptance of learning materials exhibited no substantial difference between the VP medical topics and other learning materials.

CONCLUSIONS

In the context of LMMU, our study found that VPs were well accepted and noninferior to traditional teaching methods. VPs have the potential to serve as an engaging learning resource and can be integrated into blended learning approaches at LMMU. However, further research is required to investigate the long-term knowledge gain and the acceptance and effectiveness of VPs in medical education.

TRIAL REGISTRATION

Pan African Clinical Trials Registry (PACTR) PACTR202211594568574; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=20413.

Potential Barriers to the Implementation of Computer-Based Simulation in Pharmacy Education: A Systematic Review

Computer-based simulation (CBS) is an interactive pedagogical training method that has seen increased interest, especially in recent years. There is some evidence that CBS in pharmacy education is not as widely adopted compared to other healthcare disciplines. Pharmacy education literature to date has not specifically discussed the potential barriers which may cause this uptake challenge. In this systematic narrative review, we attempted to explore and discuss potential barriers that may impact the integration of CBS in pharmacy practice education and provide our suggestions to overcome them. We searched five major databases and used the AACODS checklist for grey literature assessment. We identified 42 studies and four grey literature reports, published between 1 January 2000 and 31 August 2022, which met the inclusion criteria. Then, the specific approach of Braun and Clarke for thematic analysis was followed. The majority of the included articles were from Europe, North America, and Australasia. Although none of the included articles had a specific focus on barriers to implementation, thematic analysis was used to extract and discuss several potential barriers, such as resistance to change, cost, time, usability of software, meeting accreditation standards, motivating and engaging students, faculty experience, and curriculum constraints. Ad- dressing academic, process, and cultural barriers can be considered the first step in providing guidance for future implementation research for CBS in pharmacy education. The analysis suggests that to effectively overcome any possible barriers to implementing CBS, different stakeholders must engage in careful planning, collaboration, and investment in resources and training. The review indicates that additional research is required to offer evidence-based approach and strategies to prevent overwhelming or disengaging users from either learning or teaching process. It also guides further research into exploring potential barriers in different institutional cultures and regions.

Computer-Based Simulators in Pharmacy Practice Education: A Systematic Narrative Review

Computer-based simulations may represent an innovative, flexible, and cost-efficient training approach that has been underutilised in pharmacy practice education. This may need to change, with increasing pressure on clinical placement availability, COVID-19 restrictions, and economic pressures to improve teaching efficiency. This systematic narrative review summarises various computer-based simulations described in the pharmacy practice education literature, identifies the currently available products, and highlights key characteristics. Five major databases were searched (Medline, CINAHL, ERIC, Education Source and Embase). Authors also manually reviewed the publication section of major pharmacy simulator websites and performed a citation analysis. We identified 49 studies describing 29 unique simulators, which met the inclusion criteria. Only eight of these simulators were found to be currently available. The characteristics of these eight simulators were examined through the lens of eight main criteria (feedback type, grading, user play mode, cost, operational requirement, community/hospital setting, scenario sharing option, and interaction elements). Although a number of systems have been developed and trialled, relatively few are available on the market, and each comes with benefits and drawbacks. Educators are encouraged to consider their own institutional, professional and curriculum needs, and determine which product best aligns with their teaching goals.

Effect of different teaching/learning approaches using virtual patients on student's situational interest and cognitive load: a comparative study

BACKGROUND

Virtual Patients (VPs) have been receiving considerable attention in medical education as an authentic learning and teaching approach. The study aimed to evaluate the effect of using different approaches of conduction of virtual patients (VPs) on students' cognitive load and situational interest.

METHODS

The study is an experimental study. Two different cohorts have participated during the academic year 2019/2020 and 2020/2021. The first cohort (Group 1) was exposed to a lecture followed by an independent VPs session, and the second cohort (Group 2) was exposed to a collaborative VPs session. The situational interest and Cognitive load were compared between the two groups. All sessions are about one topic related to maxillofacial trauma.

RESULTS

Findings showed that there was no significant difference between the median score of the situational interest at repeated time points during the Collaborative VPs (Group 2). However, in group 1, there was a significant difference between the median score of situational interest at repeated time points during independent VPs where the lowest score was found to be at the end of the session. Also, results showed that the collaborative VPs (Group 2) showed a high median score of situational interest than both lecture and independent VPs (Group 1). Furthermore, the study showed that there is no significant difference in the intrinsic cognitive load among the three sessions. However, the extraneous cognitive load was low in collaborative VPs (Group 2) than in both lecture and independent VPs sessions (Group 1).

CONCLUSION

The use of VPs in a collaborative interactive learning activity is more effective than its use as an independent learning activity in enhancing students' situational interest and reducing cognitive load. However, giving independent VPs after the lecture with the same topic is considered a limitation of the study as this can affect the situational interest of the students by filling their gab of knowledge.

Comparison of Digital Interactive Case-Based Educational Resource with Virtual Role Play in Dental Undergraduates in Clinical Oral Medicine/Oral Pathology Education

Case-based learning has always been a key element of dental education and the incorporation of technology into the concept became increasingly important during the COVID-19 pandemic. This study aimed to compare the effectiveness of a virtual interactive case resource in oral medicine/oral pathology, Virtual Oral Medicine Clinic (VOMC), with the virtual role play among third-year dental undergraduates. Fifty-one students were randomly assigned into two groups and the control group was subjected to a role play activity, whereas the experimental group was provided with VOMC. Both groups were assessed with an objective structured clinical examination (OSCE) before and after the intervention. Students’ self-perceived usefulness of the interventions was evaluated by a questionnaire and randomly selected students were invited for focus group discussions. Data were analysed using the Wilcoxon signed-rank test and the Mann−Whitney U test. Descriptive statistics were used to analyse student responses. Students in both groups demonstrated significant improvement (p < 0.001) in the post-test compared to the pre-test. Students in the experimental group demonstrated higher overall scores (p < 0.001) when compared to the control group. Though both methods were received favourably by the students, role play was more positively perceived when compared to digital resource. Though VOMC was shown to improve student scores, the perception of VOMC was not quantitatively superior to the role play activity. Hence VOMC can be recommended as an adjunct tool to enhance learning in oral medicine in undergraduate dental students.

Using a Virtual Patient via an Artificial Intelligence Chatbot to Develop Dental Students’ Diagnostic Skills

Knowing how to diagnose effectively and efficiently is a fundamental skill that a good dental professional should acquire. If students perform a greater number of clinical cases, they will improve their performance with patients. In this sense, virtual patients with artificial intelligence offer a controlled, stimulating, and safe environment for students. To assess student satisfaction after interaction with an artificially intelligent chatbot that recreates a virtual patient, a descriptive cross-sectional study was carried out in which a virtual patient was created with artificial intelligence in the form of a chatbot and presented to fourth and fifth year dental students. After several weeks interacting with the AI, they were given a survey to find out their assessment. A total of 193 students participated. A large majority of the students were satisfied with the interaction (mean 4.36), the fifth year students rated the interaction better and showed higher satisfaction values. The students who reached a correct diagnosis rated this technology more positively. Our research suggests that the incorporation of this technology in dental curricula would be positively valued by students and would also ensure their training and adaptation to new technological developments.

Learning Analytics Applied to Clinical Diagnostic Reasoning Using a Natural Language Processing-Based Virtual Patient Simulator: Case Study

BACKGROUND

Virtual patient simulators (VPSs) log all users' actions, thereby enabling the creation of a multidimensional representation of students' medical knowledge. This representation can be used to create metrics providing teachers with valuable learning information.

OBJECTIVE

The aim of this study is to describe the metrics we developed to analyze the clinical diagnostic reasoning of medical students, provide examples of their application, and preliminarily validate these metrics on a class of undergraduate medical students. The metrics are computed from the data obtained through a novel VPS embedding natural language processing techniques.

METHODS

A total of 2 clinical case simulations (tests) were created to test our metrics. During each simulation, the students' step-by-step actions were logged into the program database for offline analysis. The students' performance was divided into seven dimensions: the identification of relevant information in the given clinical scenario, history taking, physical examination, medical test ordering, diagnostic hypothesis setting, binary analysis fulfillment, and final diagnosis setting. Sensitivity (percentage of relevant information found) and precision (percentage of correct actions performed) metrics were computed for each issue and combined into a harmonic mean (F₁), thereby obtaining a single score evaluating the students' performance. The 7 metrics were further grouped to reflect the students' capability to collect and to analyze information to obtain an overall performance score. A methodological score was computed based on the discordance between the diagnostic pathway followed by students and the reference one previously defined by the teacher. In total, 25 students attending the fifth year of the School of Medicine at Humanitas University underwent test 1, which simulated a patient with dyspnea. Test 2 dealt with abdominal pain and was attended by 36 students on a different day. For validation, we assessed the Spearman rank correlation between the performance on these scores and the score obtained by each student in the hematology curricular examination.

RESULTS

The mean overall scores were consistent between test 1 (mean 0.59, SD 0.05) and test 2 (mean 0.54, SD 0.12). For each student, the overall performance was achieved through a different contribution in collecting and analyzing information. Methodological scores highlighted discordances between the reference diagnostic pattern previously set by the teacher and the one pursued by the student. No significant correlation was found between the VPS scores and hematology examination scores.

CONCLUSIONS

Different components of the students' diagnostic process may be disentangled and quantified by appropriate metrics applied to students' actions recorded while addressing a virtual case. Such an approach may help teachers provide students with individualized feedback aimed at filling competence drawbacks and methodological inconsistencies. There was no correlation between the hematology curricular examination score and any of the proposed scores as these scores address different aspects of students' medical knowledge.

Experiencing a virtual patient to practice patient counselling skills

INTRODUCTION

Virtual patients (VPs) are a safe and standardised method of simulating clinical environments but few studies have explored health care professional's experiences of learning via a VP. This study explored how users experienced and used a VP that aimed to teach the user to deliver non-vitamin K oral anticoagulant patient education.

METHODS

The study used semi-structured interviews with pharmacists and pre-registration trainees from a wider research study. Interview topics were based on key areas concerning VP use. Interviews were audio-recorded and transcribed verbatim before being analysed using the framework approach to thematic analysis. Ethical approval was granted by Keele University.

RESULTS

There was variation in the type and nature of use of the VP and in the reported learning, which included reinforcement of knowledge, an opportunity to promote reflection, and acquisition and application of knowledge to clinical, patient-facing interactions. The VP was seen as an adjunct to other education and training. The majority of users indicated that they used the VP more than once. Some users seemed to have gamified their learning with a drive to achieve perfect feedback rather than true engagement with the learning, whereas for others the learning appeared to be deep with a reflective focus.

CONCLUSIONS

The VP offered an educational use as experiential learning, although the users experienced the VP differently; commonly the VP facilitated learning via reinforcement of pre-existing knowledge. The users reported that the VP had value as an adjunct to other education and training resources.

Establishing the acceptability and usability of an animated virtual patient simulation

Background

An animated, video-based, virtual patient (VP) has been developed to allow pharmacists to learn how, and practice how, to advise patients taking non-vitamin K oral anticoagulants, a group of high-risk medicines. VPs are well-established resources but have historically only been accessed within specific online teaching sessions or at university sites; this new VP represents a mobile design that can be accessed from anywhere.

Objective

To investigate the usability and acceptability of the VP application with a focus on exploring perspectives on accessibility.

Methods

The study used an exploratory sequential mixed method design consisting of a satisfaction survey and interviews. Survey data were analysed descriptively to assess satisfaction with the application and to identify interview discussion areas. Interview data were analysed using the Framework Approach to thematic analysis. Participants were hospital or community pharmacists, or pre-registration pharmacists.

Results

A total of 94 survey responses were collected and 22 respondents went on to take part in an interview. Participants reported liking the concept and delivery of the VP, particularly the high-quality technology. They also reported finding it usable, and appeared to favour its mobility and accessibility, particularly as the VP can be used on any internet accessible device, including mobile phones, with no specific requirements. Amendments that were suggested included quickening the delivery of some animations and improving navigation within the application, possibly through a button to return to the previous step should a mistake be made.

Conclusions

The mobile VP appeared to be functional and usable, with the majority of users reporting satisfaction with use across a range of devices. Users reported positively about the VP's remote access, but navigation around the application requires development.

Canadian general internal medicine residents’ perception of a pedagogical tool of online cases in obstetric medicine

Background

Sufficient exposure to rarer medical problems around pregnancy is a challenge during short rotations in obstetric medicine (OM). A Canadian research group created online clinical cases, the CanCOM cases, to overcome this.

Methods

We conducted an exploratory study to document the use and perceived utility of the CanCOM cases. 77 residents doing an OM rotation participated in our study. We used a survey to document their perception of CanCOM cases (12 items, 7-point scale), clinical exposure to several conditions (pre and post rotation; 41 items, 7-point scale) and use of the educational tool (1 item, 4-option scale).

Results

CanCOM cases was perceived as an accessible and useful tool. Participants completed a median of 6/20 cases (range 1–20), and highly recommended the cases (6.48 ± 0.73 SD on a 7-point Likert scale).

Conclusion

Despite some technical limitations, CanCOM cases was shown to contribute to clinical exposure to rare but essential medical conditions.

Exploring the Cost of eLearning in Health Professions Education: Scoping Review

BACKGROUND

Existing research on the costs associated with the design and deployment of eLearning in health professions education is limited. The relative costs of these learning platforms to those of face-to-face learning are also not well understood. The lack of predefined costing models used for eLearning cost data capture has made it difficult to complete cost evaluation.

OBJECTIVE

The key aim of this scoping review was to explore the state of evidence concerning cost capture within eLearning in health professions education. The review explores the available data to define cost calculations related to eLearning.

METHODS

The scoping review was performed using a search strategy with Medical Subject Heading terms and related keywords centered on eLearning and cost calculation with a population scope of health professionals in all countries. The search was limited to articles published in English. No restriction was placed on literature publication date.

RESULTS

In total, 7344 articles were returned from the original search of the literature. Of these, 232 were relevant to associated keywords or abstract references following screening. Full-text review resulted in 168 studies being excluded. Of these, 61 studies were excluded because they were unrelated to eLearning and focused on general education. In addition, 103 studies were excluded because of lack of detailed information regarding costs; these studies referred to cost in ways either indicating cost favorability or unfavorability, but without data to support findings. Finally, 4 studies were excluded because of limited cost data that were insufficient for analysis. In total, 42 studies provided data and analysis of the impact of cost and value in health professions education. The most common data source was total cost of training (n=29). Other sources included cost per learner, referring to the cost for individual students (n=13). The population most frequently cited was medical students (n=15), although 12 articles focused on multiple populations. A further 22 studies provide details of costing approaches for the production and delivery of eLearning. These studies offer insight into the ways eLearning has been budgeted and project-managed through implementation.

CONCLUSIONS

Although cost is a recognized factor in studies detailing eLearning design and implementation, the way cost is captured is inconsistent. Despite a perception that eLearning is more cost-effective than face-to-face instruction, there is not yet sufficient evidence to assert this conclusively. A rigorous, repeatable data capture method is needed, in addition to a means to leverage existing economic evaluation methods that can then test eLearning cost-effectiveness and how to implement eLearning with cost benefits and advantages over traditional instruction.

A Comprehensive Understanding of the Use of e-Learning in Continuing Education: Experiences of Pharmacists in a Public Health System

INTRODUCTION

The health and education sectors have experienced rapid technological development. In this scenario, the use of Internet technology has grown as an option for the expansion of continuing education (CE), as it allows professionals to develop educational activities with flexibility, autonomy, and convenience. E-learning has gained popularity and currently, thousands of online courses are being offered. However, studies of e-learning in professional training have presented only a few specific foci of study.

OBJECTIVE

to develop a comprehensive approach to understand both the experience and the complex scenario of the use of e-learning in the CE for pharmacists.

METHOD

Field research in 10 Brazilian states through interviews and focus groups with alumni of a CE e-learning specialization course for pharmacists in public health. Data analysis used the model of socio-technical systems and was based on a framework with the components Objectives, People, Processes, Culture, Technology, Infrastructure, and Scenario.

RESULTS

The People and Culture components indicated the assimilation and normalization of technologies in the educational process. Although the infrastructure (technical and organizational) was deficient in some regions, the Technology component suggested that the characteristics of the course design, associated with the personal characteristics of the students, provided ways to overcome obstacles. The objectives of the use of distance education seem to be related to the possibility of greater accessibility and autonomy. The Processes component, in turn, revealed the burden that a e-learning course puts on the pharmacist.

CONCLUSION

E-learning proved to be useful to enable and expand access to education, providing pharmacists with an opportunity for CE. On the other hand, e-learning contributes to the normalization of the precarious working conditions of pharmacists, attributing to individuals the sole responsibility for the CE even in an institutional CE program, which results in work overload.

Interactive Clinical Avatar Use in Pharmacist Preregistration Training: Design and Review

BACKGROUND

Virtual patients are interactive computer-based simulations that are being increasingly used in modern health care education. They have been identified as tools that can provide experiential learning and assessment in a standardized and safe environment. However, the study of high-fidelity virtual patients such as interactive clinical avatars within pharmacy is limited.

OBJECTIVE

The aim of this paper is to describe the design and review of three interactive clinical avatar simulations as part of pharmacist preregistration training.

METHODS

A multistep design approach was taken to create interactive clinical avatar simulations on the topics of emergency hormonal contraception (EHC), calculation of renal function, and childhood illnesses. All case studies were reviewed by registered pharmacists to establish content and face validity. The EHC case study and data collection questionnaire were also reviewed by a purposive sample of preregistration trainees and newly qualified pharmacists. The questionnaire used Likert ranking statements and open-ended questions to obtain users' feedback on the design, usability, and usefulness of the interactive clinical avatars as learning tools. Descriptive statistics and content analysis were undertaken on the data.

RESULTS

Ten preregistration trainees and newly qualified pharmacists reviewed the EHC interactive clinical avatars and data collection questionnaire. The data collection questionnaire was associated with a Cronbach alpha=.95, demonstrating good reliability. All three interactive clinical avatar simulations were reported as usable and appropriately designed for preregistration training. Users perceived they were developing skills and knowledge from the simulations. The high-fidelity nature of the avatars and relevance of the simulations to real-life practice were reported as aspects that encouraged the application of theory to practice. Improvements were suggested to ensure the simulations were more user-friendly.

CONCLUSIONS

The design and creation of the interactive clinical avatar simulations was successful. The multistep review process ensured validity and reliability of the simulations and data collection questionnaire. The in-depth explanation of the design process and provision of a questionnaire may help widen the use and evaluation of interactive clinical avatars or other simulation tools in pharmacy education. The interactive clinical avatars were reported as novel learning tools that promoted experiential learning and allowed users to feel like they were engaging in real-life scenarios, thus developing transferable knowledge and skills. This may be potentially beneficial for many health care training courses as a way to provide standardized experiences promoting active learning and reflection.

Biosensor Real-Time Affective Analytics in Virtual and Mixed Reality Medical Education Serious Games: Cohort Study

Background

The role of emotion is crucial to the learning process, as it is linked to motivation, interest, and attention. Affective states are expressed in the brain and in overall biological activity. Biosignals, like heart rate (HR), electrodermal activity (EDA), and electroencephalography (EEG) are physiological expressions affected by emotional state. Analyzing these biosignal recordings can point to a person’s emotional state. Contemporary medical education has progressed extensively towards diverse learning resources using virtual reality (VR) and mixed reality (MR) applications.

Objective

This paper aims to study the efficacy of wearable biosensors for affect detection in a learning process involving a serious game in the Microsoft HoloLens VR/MR platform.

Methods

A wearable array of sensors recording HR, EDA, and EEG signals was deployed during 2 educational activities conducted by 11 participants of diverse educational level (undergraduate, postgraduate, and specialist neurosurgeon doctors). The first scenario was a conventional virtual patient case used for establishing the personal biosignal baselines for the participant. The second was a case in a VR/MR environment regarding neuroanatomy. The affective measures that we recorded were EEG (theta/beta ratio and alpha rhythm), HR, and EDA.

Results

Results were recorded and aggregated across all 3 groups. Average EEG ratios of the virtual patient (VP) versus the MR serious game cases were recorded at 3.49 (SD 0.82) versus 3.23 (SD 0.94) for students, 2.59 (SD 0.96) versus 2.90 (SD 1.78) for neurosurgeons, and 2.33 (SD 0.26) versus 2.56 (SD 0.62) for postgraduate medical students. Average alpha rhythm of the VP versus the MR serious game cases were recorded at 7.77 (SD 1.62) μV versus 8.42 (SD 2.56) μV for students, 7.03 (SD 2.19) μV versus 7.15 (SD 1.86) μV for neurosurgeons, and 11.84 (SD 6.15) μV versus 9.55 (SD 3.12) μV for postgraduate medical students. Average HR of the VP versus the MR serious game cases were recorded at 87 (SD 13) versus 86 (SD 12) bpm for students, 81 (SD 7) versus 83 (SD 7) bpm for neurosurgeons, and 81 (SD 7) versus 77 (SD 6) bpm for postgraduate medical students. Average EDA of the VP versus the MR serious game cases were recorded at 1.198 (SD 1.467) μS versus 4.097 (SD 2.79) μS for students, 1.890 (SD 2.269) μS versus 5.407 (SD 5.391) μS for neurosurgeons, and 0.739 (SD 0.509) μS versus 2.498 (SD 1.72) μS for postgraduate medical students. The variations of these metrics have been correlated with existing theoretical interpretations regarding educationally relevant affective analytics, such as engagement and educational focus.

Conclusions

These results demonstrate that this novel sensor configuration can lead to credible affective state detection and can be used in platforms like intelligent tutoring systems for providing real-time, evidence-based, affective learning analytics using VR/MR-deployed medical education resources.

Interactive virtual scenarios as a technological resource to improve musculoskeletal clinical reasoning skills of undergraduate physiotherapy students

BACKGROUND

Clinical reasoning is a fundamental competency in the learning process of health professionals. Since learning with traditional methods presents difficulties, teaching with interactive virtual scenarios is a good alternative.

OBJECTIVE

To describe the impact of a blended training with interactive virtual scenarios for the development of clinical reasoning skills in undergraduate physiotherapy students.

METHODS

A sample of 92 students solved eight storylines. Assessment error percentage, clinical pattern recognition, satisfaction, and the perception of difficulty were obtained. A proportions test was used to compare baseline and final assessments. To analyze the relationship between the variables, multilevel univariate logistic regression models were built.

RESULTS

A significant difference was observed in the error percentage between baseline and final assessment (p < .001). Comparing the last storyline to the first one, there were 2.63 times more possibilities to correctly recognize the pattern. The error percentage was associated with the opportunity to recognize the pattern precisely (p < .001). Thus, for each increasing unit in the error percentage, the possibility to correctly recognize the pattern decreased by 11% (OR = 0.89).

CONCLUSIONS

The use of this innovative blended training with virtual scenarios allowed students to systematically improve their recognition abilities of clinical patterns and decrease mistakes in the decision-making process.

Dental Decision Simulation (DDSim): Development of a virtual training environment

PURPOSE

Case-based simulations are powerful training tools that can enhance learning and drive behavior change. This is an overview of the design/development of Dental Decision Simulation (DDSim), a web-based simulation of an electronic dental record (EDR). The purpose was to use DDSim to train dentists to make evidence-based treatment planning decisions consistent with current evidence. This simulated EDR provides case-based information in support of a set of defined evidence-based learning objectives.

METHODS

The development of this complex simulation model required coordinated efforts to create several components: identify behavior changes, case authoring mechanism, create virtual patient visits, require users to make treatment plan decisions related to learning objectives, and a feedback mechanism to help users recognize departures from those learning objectives. This simulation was evaluated in a 2-arm, clinic-randomized, controlled pilot study examining the extent to which DDSim changed dentists' planned treatment to conform to evidence-based treatment guidelines relative to change in dentists not exposed to DDSim. Outcomes were measured by comparing preintervention and postintervention patient EDR treatment data.

RESULTS

Changes in behavior over time did not favor intervention or control clinics.

CONCLUSION

DDSim provides a standardized learning platform that cannot be achieved through the use of live patients. Both live patients and case-based simulations can be used to transfer knowledge and skill development. DDSim offers the advantage of providing a platform for developing treatment planning skills in a low-risk environment. However, further research examining behavior change is needed.

Using Virtual Patient Software to Improve Pharmacy Students' Knowledge of and Attitudes Toward Geriatric Patients

Objective. To evaluate the effect of using a virtual patient software program to improve pharmacy students' knowledge of and attitudes toward geriatric patients. Methods. The Virtual Patient for Geriatric Education (VIPAGE) software program was used in two Bachelor of Pharmacy (BPharm) degree programs in Brazilian universities. The virtual consultations were divided into an initial evaluation, care plan, letter of referral to another professional, and evaluation of follow-up. Each weekly session lasted two hours. Students answered questionnaires before and after using the virtual patient software relating to the following: demographics, geriatric experiences, Geriatric Attitudes Scale, and the Facts on Aging Quiz. Results. Of the 128 students who completed the baseline questionnaires, 109 students also completed the second questionnaire. The mean Geriatric Attitudes Scale score before the intervention was 3.7 (SD=0.8) and after was 3.9 (SD=0.7). Significant improvements in Geriatric Attitudes Scale scores after using the virtual patient software were seen in students who were male, whose grandparents were still alive, or whose parents were elderly, who had frequent contact with the elderly, who did not have frequent contact with the elderly, and who did not have professional contact with the elderly. The average score on geriatrics knowledge was 44.7 (SD=12.0) before completing the virtual patient consultations and 52.6 (SD=11.9) after. The mean score measuring students' lack of geriatrics knowledge was 27.3 (SD=15.8) before and 19.1 (SD=12.8) after using the software. Conclusion. Completing virtual patient consultations using the VIPAGE software positively impacted pharmacy students' geriatrics knowledge and attitudes.

Evaluation of an interactive simulated patient educational tool on course performance among current pharmacy students

BACKGROUND AND PURPOSE

In an accelerated doctor of pharmacy program, student examination performance on a key knowledge concept, the Cockcroft-Gault equation (CGE) for creatinine clearance estimation, was suboptimal. A scenario-based online tutorial using a virtual patient activity was developed to provide just-in-time access to an active-learning opportunity, consistent with Millennial learning styles. The purposes of this study were to assess the association between tutorial use and CGE examination performance and to explore learner characteristics that may affect this association, including student age group.

EDUCATIONAL ACTIVITY AND SETTING

CGE calculation is a required component of Renal and Cardiovascular System I, the fourth of a five-quarter intensive integrated course sequence. The tutorial used pretest-based branching, learner personalization, and virtual-patient scenarios in a realistic environment. Statistical analyses estimated the association of voluntary tutorial usage with CGE-calculation performance using Spearman's Rho correlations and linear regression analysis. Covariates included age group and course grade, excluding CGE points.

FINDINGS

Over a three-year study period (2015 to 2017), students (n = 436) accessed the tutorial a mean (median) of 5.64 (5.0) times. Tutorial access varied significantly, but not consistently, across age categories. In both bivariate and linear regression analyses, tutorial access was significantly associated with CGE grade only among students with non-CGE grades in the top 25% (i.e. top quartile).

SUMMARY

The majority of learners took advantage of an interactive educational tool designed for active learner engagement. Frequency of tutorial access was associated with improvements in CGE calculation performance only among top-quartile students.

Learning clinical reasoning: how virtual patient case format and prior knowledge interact

INTRODUCTION

Clinical reasoning has been fostered with varying case formats including the use of virtual patients. Existing literature points to different conclusions regarding which format is most beneficial for learners with diverse levels of prior knowledge. We designed our study to better understand which case format affects clinical reasoning outcomes and cognitive load, dependent on medical students' prior knowledge.

METHODS

Overall, 142 medical students (3 rd to 6 th year) were randomly assigned to either a whole case or serial cue case format. Participants worked on eight virtual patients in their respective case format. Outcomes included diagnostic accuracy, knowledge, and cognitive load.

RESULTS

We found no effect of case format on strategic knowledge scores pre- vs post-test (whole case learning gain = 3, 95% CI. -.01 to .01, serial cue learning gain = 3, 95% CI. -.06 to .00 p = .50). In both case formats, students with high baseline knowledge (determined by median split on the pre-test in conceptual knowledge) benefitted from learning with virtual patients (learning gain in strategic knowledge = 5, 95% CI .03 to .09, p = .01) while students with low prior knowledge did not (learning gain = 0, 95%CI -.02 to .02). We found no difference in diagnostic accuracy between experimental conditions (difference = .44, 95% CI -.96 to .08, p = .22), but diagnostic accuracy was higher for students with high prior knowledge compared to those with low prior knowledge (difference = .8, 95% CI 0.31 to 1.35, p < .01). Students with low prior knowledge experienced higher extraneous cognitive load than students with high prior knowledge (multiple measurements, p < .01).

CONCLUSIONS

The whole case and serial cue case formats alone did not affect students' knowledge gain or diagnostic accuracy. Students with lower knowledge experienced increased cognitive load and appear to have learned less from their interaction with virtual patients. Cognitive load should be taken into account when attempting to help students learn clinical reasoning with virtual patients, especially for students with lower knowledge.

Influence of simulation on electronic health record use patterns among pediatric residents

Objective

Electronic health record (EHR) simulation with realistic test patients has improved recognition of safety concerns in test environments. We assessed if simulation affects EHR use patterns in real clinical settings.

Materials and Methods

We created a 1-hour educational intervention of a simulated admission for pediatric interns. Data visualization and information retrieval tools were introduced to facilitate recognition of the patient's clinical status. Using EHR audit logs, we assessed the frequency with which these tools were accessed by residents prior to simulation exposure (intervention group, pre-simulation), after simulation exposure (intervention group, post-simulation), and among residents who never participated in simulation (control group).

Results

From July 2015 to February 2017, 57 pediatric residents participated in a simulation and 82 did not. Residents were more likely to use the data visualization tool after simulation (73% in post-simulation weeks vs 47% of combined pre-simulation and control weeks, P <. 0001) as well as the information retrieval tool (85% vs 36%, P < .0001). After adjusting for residents' experiences measured in previously completed inpatient weeks of service, simulation remained a significant predictor of using the data visualization (OR 2.8, CI: 2.1-3.9) and information retrieval tools (OR 3.0, CI: 2.0-4.5). Tool use did not decrease in interrupted time-series analysis over a median of 19 (IQR: 8-32) weeks of post-simulation follow-up.

Discussion

Simulation was associated with persistent changes to EHR use patterns among pediatric residents.

Conclusion

EHR simulation is an effective educational method that can change participants' use patterns in real clinical settings.

Virtual patients versus small-group teaching in the training of oral and maxillofacial surgery: a randomized controlled trial

BACKGROUND

Computerized virtual patients (VP) have spread into many areas of healthcare delivery and medical education. They provide various advantages like flexibility in pace and space of learning, a high degree of teaching reproducibility and a cost effectiveness. However, the educational benefit of VP as an additive or also as an alternative to traditional teaching formats remains unclear. Moreover, there are no randomized-controlled studies that investigated the use of VP in a dental curriculum. Therefore, this study investigates VP as an alternative to lecturer-led small-group teaching in a curricular, randomized and controlled setting.

METHODS

Randomized and controlled cohort study. Four VP cases were created according to previously published design principles and compared with lecturer-led small group teaching (SGT) within the Oral and Maxillofacial Surgery clerkship for dental students at the Department for Cranio-, Oral and Maxillofacial Plastic Surgery, Goethe University, Frankfurt, Germany. Clinical competence was measured prior (T0), directly (T1) and 6 weeks (T2) after the intervention using theoretical tests and a self-assessment questionnaire. Furthermore, VP design was evaluated using a validated toolkit.

RESULTS

Fifty-seven students (VP = 32; SGT = 25) agreed to participate in the study. No competence differences were found at T0 (p = 0.56). The VP group outperformed (p < .0001) the SGT group at T1. At T2 there was no difference between both groups (p = 0.55). Both interventions led to a significant growth in self-assessed competence. The VP group felt better prepared to diagnose and treat real patients and regarded VP cases as a rewarding learning experience.

CONCLUSIONS

VP cases are an effective alternative to lecture-led SGT in terms of learning efficacy in the short and long-term as well as self-assessed competence growth and student satisfaction. Furthermore, integrating VP cases within a curricular Oral and Maxillofacial Surgery Clerkship is feasible and leads to substantial growth of clinical competence in undergraduate dental students.

Curricular integration of virtual patients: a unifying perspective of medical teachers and students

BACKGROUND

Virtual Patients (VPs) may improve cognitive and behavioral skills better than traditional methods do. The aim of this paper was to investigate challenges faced by teachers and students in order to effectively implement VPs across undergraduate and postgraduate curricula. In addition, differences in student and teacher perceptions that could impact curricular integration of VPs were explored.

METHODS

A two-phase descriptive study was performed: 1) evaluation of the VP design process and curricular integration, conducted upon academic medical teachers; 2) evaluation of learning and clinical reasoning experiences with VPs, from the students' perspective.

RESULTS

The results of this study document high acceptance of VPs by both medical teachers and students (n = 252).VPs seem to fulfill most needs as set by course directors, while they satisfy student needs and create perceptions of improved knowledge and clinical skills reasoning.

CONCLUSIONS

Medical educators have encountered educational challenges upon transforming the curriculum. To develop VPs, academic institutions have to pay equal attention to the needs of potential adopters and VP authors. Strategic development and use of VPs may motivate more widespread integration of VPs and lead to a high quality medical education system.

A Web-Based Alcohol Screening and Brief Intervention Training Module Within Physician Assistant Programs in the Midwest to Increase Knowledge, Attitudes, and Confidence: Evaluation Study

BACKGROUND

Preventing and reducing risky alcohol use and its side effects remains a public health priority. Discussing alcohol use with patients can be difficult; dedicated training for health care providers is needed to facilitate these conversations. A Web-based alcohol screening and brief intervention (SBI), comprising didactic and skills application training, was designed for physician assistant students.

OBJECTIVE

This paper details experiences and outcomes in developing an alcohol SBI training curriculum and coordinating virtual encounters with standardized patients. We also explain challenges faced with developing an alcohol SBI training and a Web-based learning management site to fit the needs of 5 different physician assistant programs.

METHODS

Training development comprised 3 phases-precourse, development, and implementation. The precourse phase included developing the initial training curriculum, building a website, and testing with a pilot group. The development phase refined the training curriculum based on user feedback and moved into a three-component module: didactic training module, guided interactive encounter with a simulated patient, and live encounter with a standardized patient. A learning management system website was also created. In the implementation phase, 5 physician assistant schools incorporated the Web-based training into curricula. Each school modified the implementation method to suit their organizational environment. Evaluation methods included pre- and postchange over time on trainee attitudes, knowledge, and skills (confidence) on talking to patients about alcohol use, trainee self-reported proficiency on the standardized patient encounter, standardized patient evaluation of the trainee proficiency during the alcohol use conversation, user evaluation of the type of technology mode for the standardized patient conversation, and overall trainee satisfaction with the Web-based training on alcohol SBI.

RESULTS

Final evaluation outcomes indicated a significant (P<.01) change over time in trainee knowledge and skills (confidence) in the conduct of the alcohol SBI with a standardized patient, regardless of the program implementation method. Trainees were generally satisfied with the Web-based training experience and rated the use of the videoconference medium as most useful when conducting the alcohol SBI conversation with the standardized patient. Training that included a primer on the importance of screening, individual participation in the Web-based didactic alcohol SBI modules, and virtual encounters with standardized patients through a university-based simulation center was the most widely accepted. Successful implementation included program investment and curriculum planning. Implementation barriers involved technical challenges with standardized patient encounters and simulation center logistics, and varying physician assistant school characteristics.

CONCLUSIONS

Development and implementation of Web-based educational modules to educate health care professionals on alcohol SBI is effective, easy to reproduce, and readily accessible. Identifying challenges affecting development, implementation, and utilization of learned techniques in practice, enhances facilitation of learning and training efficacy. As the value of technology-based learning becomes more apparent, reports detailing what has worked versus what has not may help guide the process.

The virtual asthma guideline e-learning program: learning effectiveness and user satisfaction

BACKGROUND/AIMS

Effective educational tools are important for increasing adherence to asthma guidelines and clinical improvement of asthma patients. We developed a computer-based interactive education program for asthma guideline named the Virtual Learning Center for Asthma Management (VLCAM). We evaluated the usefulness of program in terms of its effects on user awareness of asthma guideline and level of satisfaction.

METHODS

Physicians-in-training at tertiary hospitals in Korea were enrolled in a cross-sectional questionnaire survey. The e-learning program on asthma guideline was conducted over a 2-week period. We investigated changes in the awareness of asthma guideline using 35-item self-administered questionnaire aiming at assessing physicians' knowledge, attitude, and practice. Satisfaction with the program was scored on 4-point Likert scales.

RESULTS

A total of 158 physicians-in-training at six tertiary hospitals completed the survey. Compared with baseline, the overall awareness obtained from the scores of knowledge, attitude, and practice was improved significantly. Participants were satisfied with the VLCAM program in the following aspects: helpfulness, convenience, motivation, effectiveness, physicians' confidence, improvement of asthma management, and willingness to recommend. All items in user satisfaction questionnaires received high scores over 3 points. Moreover, the problem-based learning with a virtual patient received the highest user satisfaction among all parts of the program.

CONCLUSIONS

Our computer-based e-learning program is useful for improving awareness of asthma management. It could improve adherence to asthma guidelines and enhance the quality of asthma care.

Virtual Simulations: A Creative, Evidence-Based Approach to Develop and Educate Nurses

The use of virtual simulations in nursing is an innovative strategy that is increasing in application. There are several terms related to virtual simulation; although some are used interchangeably, the meanings are not the same. This article presents examples of virtual simulation, virtual worlds, and virtual patients in continuing education, staff development, and academic nursing education. Virtual simulations in nursing use technology to provide safe, as realistic as possible clinical practice for nurses and nursing students. Virtual simulations are useful for learning new skills; practicing a skill that puts content, high-order thinking, and psychomotor elements together; skill competency learning; and assessment for low-volume, high-risk skills. The purpose of this article is to describe the related terms, examples, uses, theoretical frameworks, challenges, and evidence related to virtual simulations in nursing.

Evaluation of the Use of a Virtual Patient on Student Competence and Confidence in Performing Simulated Clinic Visits

Objective. To assess the effect of incorporating virtual patient activities in a pharmacy skills lab on student competence and confidence when conducting real-time comprehensive clinic visits with mock patients. Methods. Students were randomly assigned to a control or intervention group. The control group completed the clinic visit prior to completing virtual patient activities. The intervention group completed the virtual patient activities prior to the clinic visit. Student proficiency was evaluated in the mock lab. All students completed additional exercises with the virtual patient and were subsequently assessed. Student impressions were assessed via a pre- and post-experience survey. Results. Student performance conducting clinic visits was higher in the intervention group compared to the control group. Overall student performance continued to improve in the subsequent module. There was no change in student confidence from pre- to post-experience. Student rating of the ease of use and realistic simulation of the virtual patient increased; however, student rating of the helpfulness of the virtual patient decreased. Despite student rating of the helpfulness of the virtual patient program, student performance improved. Conclusion. Virtual patient activities enhanced student performance during mock clinic visits. Students felt the virtual patient realistically simulated a real patient. Virtual patients may provide additional learning opportunities for students.

Teaching Child and Adolescent Psychiatry in the Twenty-First Century: A Reflection on the Role of Technology in Education

Technology has become an integral part of everyday life and is starting to shape the landscape of graduate medical education. This article reviews the use of technology in teaching child and adolescent psychiatry (CAP) fellows, and 3 main aspects are considered. The first aspect is use of technology to enhance active learning. The second aspect covers technology and administrative tasks, and the third aspect is the development of a technology curriculum for CAP trainees. The article concludes with a brief review of some of the challenges and pitfalls that have to be considered and recommendations for future research.

Virtual Patient Case Sharing Across Two Schools of Pharmacy

Objective. To expand the use of virtual patients at 2 schools of pharmacy through virtual patient case sharing. Design. Faculty members at two schools of pharmacy collaborated to expand the use of virtual patients. Two simulation programs, vpSim and DecisionSim (Decision Simulation, LLC, Chadsford, PA), were used to create interactive patient cases for a required course and an elective course at the different schools. Each school developed cases for their own use and then shared the cases with the other school. Assessment. The development, sharing, and subsequent modification of cases were examined using a standardized data collection form completed by both schools. Survey instruments were used to gather data regarding faculty perception and student satisfaction. Pre- and post-tests were administered to assess student learning. Five cases were developed and shared between the institutions. The time spent constructing new cases (22 hours/case) was significantly longer than the time spent modifying the shared cases (1.2 hours/case). Faculty members and students were largely satisfied with case sharing and the use of virtual patient cases, respectively. Virtual patients significantly enhanced student learning of material (mean score: 3.2 vs 3.6 on a 5-point scale). Conclusions. The sharing of virtual patient cases may allow institutions to overcome barriers to implementation of virtual patient programs, namely faculty resources, while improving student learning and satisfaction.

A qualitative analysis of virtual patient descriptions in healthcare education based on a systematic literature review

BACKGROUND

Virtual Patients (VPs) have been in the focus of research in healthcare education for many years. The aim of our study was to analyze how virtual patients are described in the healthcare education literature, and how the identified concepts relate to each other.

METHODS

We performed a literature review and extracted 185 descriptions of virtual patients from the articles. In a qualitative content analysis approach we inductively-deductively developed categories and deducted subcategories. We constructed a concept map to illustrate these concepts and their interrelations.

RESULTS

We developed the following five main categories: Patient, Teacher, Virtual Patient, Curriculum, and Learner. The concept map includes these categories and highlights aspects such as the under-valued role of patients in shaping their virtual representation and opposing concepts, such as standardization of learner activity versus learner-centeredness.

CONCLUSIONS

The presented concept map synthesizes VP descriptions and serves as a basis for both, VP use and discussions of research topics related to virtual patients.

A Scenario-Based Virtual Patient Program to Support Substance Misuse Education

Objective. To evaluate virtual patient (VP) programs for injecting equipment provision (IEP) and opiate substitution therapy (OST) services with respect to confidence and knowledge among preregistration pharmacist trainees. Methods. Preregistration trainee pharmacists pilot-tested the VP programs and were invited to complete pre/post and 6-month assessments of knowledge and perceived confidence. Results. One hundred six trainees participated and completed the pre/postassessments. Forty-six (43.4%) participants repeated the assessments at six months. Scores in perceived confidence increased in all domains at both time points postprogram. Knowledge scores were greater posteducation than preeducation. Knowledge scores were also greater six months after education than preeducation. Knowledge scores at six months were lower than posteducation for both programs. Conclusion. Virtual patients programs increased preregistration pharmacists' knowledge and confidence with regard to IEP and OST immediately after use and at six months postprogram. There was a loss of clinical knowledge over time but confidence change was sustained.

Dynamics of study strategies and teacher regulation in virtual patient learning activities: a cross sectional survey

BACKGROUND

Students' self-regulated learning becomes essential with increased use of exploratory web-based activities such as virtual patients (VPs). The purpose was to investigate the interplay between students' self-regulated learning strategies and perceived benefit in VP learning activities.

METHOD

A cross-sectional study (n = 150) comparing students' study strategies and perceived benefit of a virtual patient learning activity in a clinical clerkship preparatory course. Teacher regulation varied among three settings and was classified from shared to strong. These settings were compared regarding their respective relations between regulation strategies and perceived benefit of the virtual patient activity.

RESULTS

Self-regulation learning strategy was generally associated with perceived benefit of the VP activities (rho 0.27, p < 0.001), but was not true in all settings. The association was higher in the two strongly regulated settings. The external regulation strategy did generally associate weakly with perceived benefit (rho 0.17, p < 0.05) with large variations between settings.

CONCLUSIONS

The flexible student-autonomous appeal of virtual patients should not lead to the dismissal of guidance and related course activities. External teacher and peer regulation seem to be productive for increasing learners' perceived benefit. Awareness of the interplay among teacher regulation (external) and various study strategies can increase the value of flexible web-based learning resources to students.

Impact of a Paper vs Virtual Simulated Patient Case on Student-Perceived Confidence and Engagement

OBJECTIVE

To evaluate online case simulation vs a paper case on student confidence and engagement.

DESIGN

Students enrolled in a pharmacotherapy laboratory course completed a patient case scenario as a component of an osteoarthritis laboratory module. Two laboratory sections used a paper case (n=53); three sections used an online virtual case simulation (n=81). Student module performance was assessed through a submitted subjective objective assessment plan (SOAP) note. Students completed pre/post surveys to measure self-perceived confidence in providing medication management. The simulation group completed postmodule questions related to realism and engagement of the online virtual case simulation. Group assessments were performed using chi-square and Mann Whitney tests.

ASSESSMENT

A significant increase in all 13 confidence items was seen in both student groups following completion of the laboratory module. The simulation group had an increased change of confidence compared to the paper group in assessing medication efficacy and documenting a thorough assessment. Comparing the online virtual simulation to a paper case, students agreed the learning experience increased interest, enjoyment, relevance, and realism. The simulation group performed better on the subjective SOAP note domain though no differences in total SOAP note scores was found between the two groups.

CONCLUSION

Virtual case simulations result in increased student engagement and may lead to improved documentation performance in the subjective domain of SOAP notes. However, virtual patient cases may offer limited benefit over paper cases in improving overall student self-confidence to provide medication management.

The effect of constructing versus solving virtual patient cases on transfer of learning: a randomized trial

The purpose of this study was to explore the effect of actively constructing virtual patient (VP) cases compared with solving VP cases on knowledge gains, skills transfer and time spent on cases. Forty-five fourth-year medical students were randomized to constructing (VP-construction, n = 23) or solving (VP-solving, n = 22) four cardiopulmonary VP cases. Whereas the VP-solving group solved the cases, the VP-construction group only received the final diagnosis and had to complete the history, physical findings, and lab results. After a week, participants completed a transfer test involving two standardized patients representing cardiopulmonary cases. Performances on the transfer test were video-recorded and assessed by two blinded raters using the Reporter, Interpreter, Manager, Educator (RIME) framework. Thirty-nine participants completed the transfer test. The VP-construction group spent significantly more time on the VP cases compared with the VP-solving group, p = 0.002. There were no significant differences in RIME scores between the VP-construction group and VP-solving group, p = 0.54.In conclusion, engaging novice students in active VP case construction may be more time consuming than solving VP cases, without resulting in superior skills transfer.

Evaluation of a novel scoring and grading model for VP-based exams in postgraduate nurse education

For Virtual Patient-based exams, several scoring and grading methods have been proposed, but none have yet been validated. The aim of this study was to evaluate a new scoring and grading model for VP-based exams in postgraduate paediatric nurse education. The same student group of 19 students performed a VP-based exam in three consecutive courses. When using the scoring and grading assessment model, which contains a deduction system for unnecessary or unwanted actions, a progression was found in the three courses: 53% of the students passed the first exam, 63% the second and 84% passed the final exam. The most common reason for deduction of points was due to students asking too many interview questions or ordering too many laboratory tests. The results showed that the new scoring model made it possible to judge the students' clinical reasoning process as well as their progress.

Assessing progression of clinical reasoning through virtual patients: An exploratory study

To avoid test-driven learning, there have been discussions regarding the use of more formative assessments in health care education to promote students' deep learning. Feedback is important in formative assessment, but many students ignore it; therefore, interventions should be introduced which stimulate them to reflect on the new knowledge. The aim for this study was to explore if Virtual Patient (VP)-based formative assessments, in connection with self-evaluations, had an impact on postgraduate pediatric nursing students' development of clinical reasoning abilities. Students' self-evaluations served as the basis for measuring progress. Data was analysed using deductive content analysis. The findings showed a clear progression of the clinical reasoning ability of the students. After the first assessment, the students described feelings of uncertainty and that their knowledge gaps were exposed. At the mid-course assessment the awareness of improved clinical reasoning was obvious and the students were more certain of knowing how to solve the VP cases. In the final assessment, self-efficacy was expressed. VP-based assessments, in connection with self-evaluations, early in the education resulted in a gain of students' own identification of the concept of clinical reasoning, awareness of what to focus on during clinical practice and visualised expected clinical competence.

Evidence of virtual patients as a facilitative learning tool on an anesthesia course

Virtual patients are computerised representations of realistic clinical cases. They were developed to teach clinical reasoning skills through delivery of multiple standardized patient cases. The anesthesia course at The Chinese University of Hong Kong developed two novel types of virtual patients, formative assessment cases studies and storyline, to teach its final year medical students on a 2 week rotational course. Acute pain management cases were used to test if these two types of virtual patient could enhance student learning. A 2 × 2 cross over study was performed in academic year 2010-2011 on 130 students divided into four groups of 32-34. Performance was evaluated by acute pain management items set within three examinations; an end of module 60-item multiple choice paper, a short answer modified essay paper and the end of year final surgery modified essay paper. The pain management case studies were found to enhanced student performance in all three examinations, whilst the storyline virtual patient had no demonstrable effect. Student-teaching evaluation questionnaires showed that the case studies were favored more than the storyline virtual patient. Login times showed that students on average logged onto the case studies for 6 h, whereas only half the students logged on and used the storyline virtual patient. Formative assessment case studies were well liked by the students and reinforced learning of clinical algorithms through repetition and feedback, whereas the educational role of the more narrative and less interactive storyline virtual patient was less clear .

Towards immersive virtual reality (iVR): a route to surgical expertise

Surgery is characterized by complex tasks performed in stressful environments. To enhance patient safety and reduce errors, surgeons must be trained in environments that mimic the actual clinical setting. Rasmussen’s model of human behavior indicates that errors in surgical procedures may be skill-, rule-, or knowledge-based. While skill-based behavior and some rule-based behavior may be taught using box trainers and ex vivo or in vivo animal models, we posit that multimodal immersive virtual reality (iVR) that includes high-fidelity visual as well as other sensory feedback in a seamless fashion provides the only means of achieving true surgical expertise by addressing all three levels of human behavior. While the field of virtual reality is not new, realization of the goals of complete immersion is challenging and has been recognized as a Grand Challenge by the National Academy of Engineering. Recent technological advances in both interface and computational hardware have generated significant enthusiasm in this field. In this paper, we discuss convergence of some of these technologies and possible evolution of the field in the near term.

Virtual patients--what are we talking about? A framework to classify the meanings of the term in healthcare education

BACKGROUND

The term "virtual patients" (VPs) has been used for many years in academic publications, but its meaning varies, leading to confusion. Our aim was to investigate and categorize the use of the term "virtual patient" and then classify its use in healthcare education.

METHODS

A literature review was conducted to determine all articles using the term "virtual patient" in the title or abstract. These articles were categorized into: Education, Clinical Procedures, Clinical Research and E-Health. All educational articles were further classified based on a framework published by Talbot et al. which was further developed using a deductive content analysis approach.

RESULTS

536 articles published between 1991 and December 2013 were included in the study. From these, 330 were categorized as educational. Classifying these showed that 37% articles used VPs in the form of Interactive Patient Scenarios. VPs in form of High Fidelity Software Simulations (19%) and Virtual Standardized Patients (16%) were also frequent. Less frequent were other forms, such as VP Games. Analyzing the literature across time shows an overall trend towards the use of Interactive Patient Scenarios as the predominant form of VPs in healthcare education.

CONCLUSIONS

The main form of educational VPs in the literature are Interactive Patient Scenarios despite rapid technical advances that would support more complex applications. The adapted classification provides a valuable model for VP developers and researchers in healthcare education to more clearly communicate the type of VP they are addressing avoiding misunderstandings.

Virtual patients on the semantic Web: a proof-of-application study

Background

Virtual patients are interactive computer simulations that are increasingly used as learning activities in modern health care education, especially in teaching clinical decision making. A key challenge is how to retrieve and repurpose virtual patients as unique types of educational resources between different platforms because of the lack of standardized content-retrieving and repurposing mechanisms. Semantic Web technologies provide the capability, through structured information, for easy retrieval, reuse, repurposing, and exchange of virtual patients between different systems.

Objective

An attempt to address this challenge has been made through the mEducator Best Practice Network, which provisioned frameworks for the discovery, retrieval, sharing, and reuse of medical educational resources. We have extended the OpenLabyrinth virtual patient authoring and deployment platform to facilitate the repurposing and retrieval of existing virtual patient material.

Methods

A standalone Web distribution and Web interface, which contains an extension for the OpenLabyrinth virtual patient authoring system, was implemented. This extension was designed to semantically annotate virtual patients to facilitate intelligent searches, complex queries, and easy exchange between institutions. The OpenLabyrinth extension enables OpenLabyrinth authors to integrate and share virtual patient case metadata within the mEducator3.0 network. Evaluation included 3 successive steps: (1) expert reviews; (2) evaluation of the ability of health care professionals and medical students to create, share, and exchange virtual patients through specific scenarios in extended OpenLabyrinth (OLabX); and (3) evaluation of the repurposed learning objects that emerged from the procedure.

Results

We evaluated 30 repurposed virtual patient cases. The evaluation, with a total of 98 participants, demonstrated the system’s main strength: the core repurposing capacity. The extensive metadata schema presentation facilitated user exploration and filtering of resources. Usability weaknesses were primarily related to standard computer applications’ ease of use provisions. Most evaluators provided positive feedback regarding educational experiences on both content and system usability. Evaluation results replicated across several independent evaluation events.

Conclusions

The OpenLabyrinth extension, as part of the semantic mEducator3.0 approach, is a virtual patient sharing approach that builds on a collection of Semantic Web services and federates existing sources of clinical and educational data. It is an effective sharing tool for virtual patients and has been merged into the next version of the app (OpenLabyrinth 3.3). Such tool extensions may enhance the medical education arsenal with capacities of creating simulation/game-based learning episodes, massive open online courses, curricular transformations, and a future robust infrastructure for enabling mobile learning.

The preparedness level of final year medical students for an adequate medical approach to emergency cases: computer-based medical education in emergency medicine

Background

We aimed to observe the preparedness level of final year medical students in approaching emergencies by computer-based simulation training and evaluate the efficacy of the program.

Methods

A computer-based prototype simulation program (Lsim), designed by researchers from the medical education and computer science departments, was used to present virtual cases for medical learning. Fifty-four final year medical students from Ondokuz Mayis University School of Medicine attended an education program on June 20, 2012 and were trained with Lsim. Volunteer attendants completed a pre-test and post-test exam at the beginning and end of the course, respectively, on the same day.

Results

Twenty-nine of the 54 students who attended the course accepted to take the pre-test and post-test exams; 58.6% (n = 17) were female. In 10 emergency medical cases, an average of 3.9 correct medical approaches were performed in the pre-test and an average of 9.6 correct medical approaches were performed in the post-test (t = 17.18, P = 0.006).

Conclusions

This study’s results showed that the readiness level of students for an adequate medical approach to emergency cases was very low. Computer-based training could help in the adequate approach of students to various emergency cases.