Using a virtual patient system for the teaching of pharmaceutical care

Effectiveness of teaching and evaluation methods of clinical competencies for pharmacy: A systematic review

BACKGROUND

This review aimed to analyze the effectiveness of the teaching and assessment methodologies used to develop fundamental clinical skills in pharmacist who are training in patient care.

METHODS

SCOPUS, EMBASE, ERIC, and PubMed were searched for original studies that featured randomized controlled trials as the study design published until March 2024. The search and extraction process followed PRISMA Guidelines.

RESULTS

The database search resulted in 2954 articles, of which 14 met the inclusion criteria. Four studies developed and tested interactive web-based software as the teaching methodologies. Eight studies applied simulation to their teaching and/or evaluation strategies. Two articles used high fidelity simulation, and the remaining studies used standardized patients associated with other teaching and evaluation techniques. The simulation methodologies were more effective than the conventional ones in three studies. In the other studies, the interventions were as effective or better than the control, albeit there no meaningful differences between the methods. In the studies that focused on the assessment methods, immediate feedback was preferred by students over delayed feedback. Additionally, the tested assessment tool, General Level Framework, proposed a pragmatic assessment from which the individual's training needs were identified.

CONCLUSION

Few studies involved the objective quantification of learning beyond pre- and post-intervention knowledge tests. Proper assessment in pharmaceutical education requires expansion beyond the administration of student satisfaction, self-efficacy research tools, and knowledge assessments, and should encompass an examination of clinical performance and critical thinking.

Implementation of Virtual Interactive Cases for Pharmacy Education: A Single-Center Experience

Patient case simulation software are described in pharmacy education literature as useful tools to improve skills in patient assessment (including medication history-taking and physical assessment), clinical reasoning and communication, and are typically well-received by students and instructors. The virtual interactive case (VIC) system is a web-based software developed to deliver deliberate practice opportunities in simulated patient encounters across a spectrum of clinical topics. This article describes the implementation and utilization of VIC in the undergraduate curriculum at one Canadian pharmacy school. Methods: At our facility, the use of VIC was integrated across the training spectrum in the curriculum, including core and elective didactic courses and practice labs, experiential learning, interprofessional education, and continuing education. Its use was evaluated through student and instructor surveys and qualitative student interviews). VIC is easy to navigate and created a positive and realistic learning environment. Students identified that it enhanced their ability to identify relevant patient information, accurately simulated hospital pharmacy practice and thereby helped them to prepare for their upcoming experiential courses. The use of VIC has expanded beyond its original intended purpose for individual student practice to become a valuable addition to pharmacy undergraduate education. Future plans include ongoing development of cases and exploration of further uses of VIC within the didactic curriculum, for remediation in experiential courses, and for pharmacist continuing education.

Potential Barriers to the Implementation of Computer-Based Simulation in Pharmacy Education: A Systematic Review

Computer-based simulation (CBS) is an interactive pedagogical training method that has seen increased interest, especially in recent years. There is some evidence that CBS in pharmacy education is not as widely adopted compared to other healthcare disciplines. Pharmacy education literature to date has not specifically discussed the potential barriers which may cause this uptake challenge. In this systematic narrative review, we attempted to explore and discuss potential barriers that may impact the integration of CBS in pharmacy practice education and provide our suggestions to overcome them. We searched five major databases and used the AACODS checklist for grey literature assessment. We identified 42 studies and four grey literature reports, published between 1 January 2000 and 31 August 2022, which met the inclusion criteria. Then, the specific approach of Braun and Clarke for thematic analysis was followed. The majority of the included articles were from Europe, North America, and Australasia. Although none of the included articles had a specific focus on barriers to implementation, thematic analysis was used to extract and discuss several potential barriers, such as resistance to change, cost, time, usability of software, meeting accreditation standards, motivating and engaging students, faculty experience, and curriculum constraints. Ad- dressing academic, process, and cultural barriers can be considered the first step in providing guidance for future implementation research for CBS in pharmacy education. The analysis suggests that to effectively overcome any possible barriers to implementing CBS, different stakeholders must engage in careful planning, collaboration, and investment in resources and training. The review indicates that additional research is required to offer evidence-based approach and strategies to prevent overwhelming or disengaging users from either learning or teaching process. It also guides further research into exploring potential barriers in different institutional cultures and regions.

Computer-Based Simulators in Pharmacy Practice Education: A Systematic Narrative Review

Computer-based simulations may represent an innovative, flexible, and cost-efficient training approach that has been underutilised in pharmacy practice education. This may need to change, with increasing pressure on clinical placement availability, COVID-19 restrictions, and economic pressures to improve teaching efficiency. This systematic narrative review summarises various computer-based simulations described in the pharmacy practice education literature, identifies the currently available products, and highlights key characteristics. Five major databases were searched (Medline, CINAHL, ERIC, Education Source and Embase). Authors also manually reviewed the publication section of major pharmacy simulator websites and performed a citation analysis. We identified 49 studies describing 29 unique simulators, which met the inclusion criteria. Only eight of these simulators were found to be currently available. The characteristics of these eight simulators were examined through the lens of eight main criteria (feedback type, grading, user play mode, cost, operational requirement, community/hospital setting, scenario sharing option, and interaction elements). Although a number of systems have been developed and trialled, relatively few are available on the market, and each comes with benefits and drawbacks. Educators are encouraged to consider their own institutional, professional and curriculum needs, and determine which product best aligns with their teaching goals.

History-taking level and its influencing factors among nursing undergraduates based on the virtual standardized patient testing results: Cross sectional study

BACKGROUND

History-taking is an essential skill for nurses. In nursing education, it is necessary to objectively assess history-taking skills in a way that accurately reflects differences among students. Current history-taking evaluation methods lack objectivity, consistency and standardization, which makes it difficult to identify factors that influence history-taking skill. A virtual standardized patient (VSP) can provide history-taking practice with repeatability and consistency. It can make objective and standardized assessment possible by eliminating the subjectivity of different teachers and patients.

PURPOSE

To evaluate the history-taking skills of nursing undergraduates using a VSP, and to explore its independent influencing factors.

METHODS

A cross-sectional design was employed with a sample of convenience from 3 universities. All 174 nursing undergraduates had their history-taking level evaluated using one VSP via computer or mobile terminal. For each query raised by the students, the VSP could give a preset response. The responses were assigned corresponding scores according to their importance, with a total score of 100. The students' general demographics were documented, and their self-efficacy, critical thinking and communication skills were measured online with the Nursing History-taking Self-Efficacy Questionnaire, Yoon's Critical Thinking Disposition Instrument and the Supportive Communicative Scale. Univariate analysis, Pearson correlation analysis and multiple linear regression were performed.

RESULTS

The mean total history-taking score was 58.53 ± 14.32. History-taking scores were well discriminated among the students tested, with 10% of the students scoring above 80, 37% between 60 and 80, 22% between 50 and 60 and 31% scored below 50. The history-taking level of the nursing students was significantly associated with ethnicity, previous academic performance, and Supportive Communicative Scale scores.

CONCLUSIONS

Using the VSP as a history-taking assessment method is an effective way to achieve a relatively objective, standardized and consistent assessment of history-taking education. Ethnicity, previous academic performance and supportive communication skills independently influenced the students' history-taking level. Mature history-taking skills require not only solid theoretical knowledge but good communication skills.

Experiencing a virtual patient to practice patient counselling skills

INTRODUCTION

Virtual patients (VPs) are a safe and standardised method of simulating clinical environments but few studies have explored health care professional's experiences of learning via a VP. This study explored how users experienced and used a VP that aimed to teach the user to deliver non-vitamin K oral anticoagulant patient education.

METHODS

The study used semi-structured interviews with pharmacists and pre-registration trainees from a wider research study. Interview topics were based on key areas concerning VP use. Interviews were audio-recorded and transcribed verbatim before being analysed using the framework approach to thematic analysis. Ethical approval was granted by Keele University.

RESULTS

There was variation in the type and nature of use of the VP and in the reported learning, which included reinforcement of knowledge, an opportunity to promote reflection, and acquisition and application of knowledge to clinical, patient-facing interactions. The VP was seen as an adjunct to other education and training. The majority of users indicated that they used the VP more than once. Some users seemed to have gamified their learning with a drive to achieve perfect feedback rather than true engagement with the learning, whereas for others the learning appeared to be deep with a reflective focus.

CONCLUSIONS

The VP offered an educational use as experiential learning, although the users experienced the VP differently; commonly the VP facilitated learning via reinforcement of pre-existing knowledge. The users reported that the VP had value as an adjunct to other education and training resources.

Establishing the acceptability and usability of an animated virtual patient simulation

Background

An animated, video-based, virtual patient (VP) has been developed to allow pharmacists to learn how, and practice how, to advise patients taking non-vitamin K oral anticoagulants, a group of high-risk medicines. VPs are well-established resources but have historically only been accessed within specific online teaching sessions or at university sites; this new VP represents a mobile design that can be accessed from anywhere.

Objective

To investigate the usability and acceptability of the VP application with a focus on exploring perspectives on accessibility.

Methods

The study used an exploratory sequential mixed method design consisting of a satisfaction survey and interviews. Survey data were analysed descriptively to assess satisfaction with the application and to identify interview discussion areas. Interview data were analysed using the Framework Approach to thematic analysis. Participants were hospital or community pharmacists, or pre-registration pharmacists.

Results

A total of 94 survey responses were collected and 22 respondents went on to take part in an interview. Participants reported liking the concept and delivery of the VP, particularly the high-quality technology. They also reported finding it usable, and appeared to favour its mobility and accessibility, particularly as the VP can be used on any internet accessible device, including mobile phones, with no specific requirements. Amendments that were suggested included quickening the delivery of some animations and improving navigation within the application, possibly through a button to return to the previous step should a mistake be made.

Conclusions

The mobile VP appeared to be functional and usable, with the majority of users reporting satisfaction with use across a range of devices. Users reported positively about the VP's remote access, but navigation around the application requires development.

Viability of Virtual Skills-based Assessments Focused on Communication

Objective To evaluate faculty and student perceptions of and performance on virtual skills-based assessments focused on communication compared to in-person assessments.Methods In spring 2020, virtual skills-based assessments were conducted. After all assessments were completed, two 12-item questionnaires, one for students and one for the faculty members who conducted the assessment, were designed to assess perceptions of virtual skills-based assessments. The surveys were distributed via an online platform to second- and third-year (P2 and P3) pharmacy students and to faculty who had participated in a virtual skills-based assessment. Scores from the spring 2020 virtual skills-based assessment were compared to scores on the in-person skills-based assessment that took place in spring 2019.Results Of the 19 faculty and 279 students invited to participate, 18 (94.7%) faculty and 241 (86.4%) students responded. The majority of faculty (88.9%) and students (63.5%) perceived the virtual skills-based assessments to be effective at simulating an interaction. However, only 33.3% of faculty and 28.6% of students preferred the virtual environment. There was not a significant difference in student performance between in-person and virtual assessments for patient consultation and SOAP note skills.Conclusion Providing sufficient formative and summative feedback to pharmacy students is a challenge, particularly in the context of skills-based assessments. Students and faculty reported that the virtual assessment provided an opportunity for an appropriate assessment of student communication skills. However, a strong preference for using virtual skills-based assessments in the future was not observed.

Lessons Learned from the Usability Evaluation of a Simulated Patient Dialogue System

Simulated consultations through virtual patients allow medical students to practice history-taking skills. Ideally, applications should provide interactions in natural language and be multi-case, multi-specialty. Nevertheless, few systems handle or are tested on a large variety of cases. We present a virtual patient dialogue system in which a medical trainer types new cases and these are processed without human intervention. To develop it, we designed a patient record model, a knowledge model for the history-taking task, and a termino-ontological model for term variation and out-of-vocabulary words. We evaluated whether this system provided quality dialogue across medical specialities (n = 18), and with unseen cases (n = 29) compared to the cases used for development (n = 6). Medical evaluators (students, residents, practitioners, and researchers) conducted simulated history-taking with the system and assessed its performance through Likert-scale questionnaires. We analysed interaction logs and evaluated system correctness. The mean user evaluation score for the 29 unseen cases was 4.06 out of 5 (very good). The evaluation of correctness determined that, on average, 74.3% (sd = 9.5) of replies were correct, 14.9% (sd = 6.3) incorrect, and in 10.7% the system behaved cautiously by deferring a reply. In the user evaluation, all aspects scored higher in the 29 unseen cases than in the 6 seen cases. Although such a multi-case system has its limits, the evaluation showed that creating it is feasible; that it performs adequately; and that it is judged usable. We discuss some lessons learned and pivotal design choices affecting its performance and the end-users, who are primarily medical students.

Interactive Clinical Avatar Use in Pharmacist Preregistration Training: Design and Review

BACKGROUND

Virtual patients are interactive computer-based simulations that are being increasingly used in modern health care education. They have been identified as tools that can provide experiential learning and assessment in a standardized and safe environment. However, the study of high-fidelity virtual patients such as interactive clinical avatars within pharmacy is limited.

OBJECTIVE

The aim of this paper is to describe the design and review of three interactive clinical avatar simulations as part of pharmacist preregistration training.

METHODS

A multistep design approach was taken to create interactive clinical avatar simulations on the topics of emergency hormonal contraception (EHC), calculation of renal function, and childhood illnesses. All case studies were reviewed by registered pharmacists to establish content and face validity. The EHC case study and data collection questionnaire were also reviewed by a purposive sample of preregistration trainees and newly qualified pharmacists. The questionnaire used Likert ranking statements and open-ended questions to obtain users' feedback on the design, usability, and usefulness of the interactive clinical avatars as learning tools. Descriptive statistics and content analysis were undertaken on the data.

RESULTS

Ten preregistration trainees and newly qualified pharmacists reviewed the EHC interactive clinical avatars and data collection questionnaire. The data collection questionnaire was associated with a Cronbach alpha=.95, demonstrating good reliability. All three interactive clinical avatar simulations were reported as usable and appropriately designed for preregistration training. Users perceived they were developing skills and knowledge from the simulations. The high-fidelity nature of the avatars and relevance of the simulations to real-life practice were reported as aspects that encouraged the application of theory to practice. Improvements were suggested to ensure the simulations were more user-friendly.

CONCLUSIONS

The design and creation of the interactive clinical avatar simulations was successful. The multistep review process ensured validity and reliability of the simulations and data collection questionnaire. The in-depth explanation of the design process and provision of a questionnaire may help widen the use and evaluation of interactive clinical avatars or other simulation tools in pharmacy education. The interactive clinical avatars were reported as novel learning tools that promoted experiential learning and allowed users to feel like they were engaging in real-life scenarios, thus developing transferable knowledge and skills. This may be potentially beneficial for many health care training courses as a way to provide standardized experiences promoting active learning and reflection.

Using Virtual Patient Software to Improve Pharmacy Students' Knowledge of and Attitudes Toward Geriatric Patients

Objective. To evaluate the effect of using a virtual patient software program to improve pharmacy students' knowledge of and attitudes toward geriatric patients. Methods. The Virtual Patient for Geriatric Education (VIPAGE) software program was used in two Bachelor of Pharmacy (BPharm) degree programs in Brazilian universities. The virtual consultations were divided into an initial evaluation, care plan, letter of referral to another professional, and evaluation of follow-up. Each weekly session lasted two hours. Students answered questionnaires before and after using the virtual patient software relating to the following: demographics, geriatric experiences, Geriatric Attitudes Scale, and the Facts on Aging Quiz. Results. Of the 128 students who completed the baseline questionnaires, 109 students also completed the second questionnaire. The mean Geriatric Attitudes Scale score before the intervention was 3.7 (SD=0.8) and after was 3.9 (SD=0.7). Significant improvements in Geriatric Attitudes Scale scores after using the virtual patient software were seen in students who were male, whose grandparents were still alive, or whose parents were elderly, who had frequent contact with the elderly, who did not have frequent contact with the elderly, and who did not have professional contact with the elderly. The average score on geriatrics knowledge was 44.7 (SD=12.0) before completing the virtual patient consultations and 52.6 (SD=11.9) after. The mean score measuring students' lack of geriatrics knowledge was 27.3 (SD=15.8) before and 19.1 (SD=12.8) after using the software. Conclusion. Completing virtual patient consultations using the VIPAGE software positively impacted pharmacy students' geriatrics knowledge and attitudes.

Supporting Empathy Training Through Virtual Patients

For the training of interpersonal skills, such as those required in the medical field, virtual agents can provide a safe environment for practice. However, many agent systems are not developed with the ability to understand non-verbal input. Being able to automatically parse such input is essential for the practice of interpersonal skills such as empathy. Currently, it is still an open question which prosodic or visual features would aid automatic classification of empathy and how this knowledge can be used to support the practice of these skills. As a first step towards this goal, we report on 42 second-year nursing students practicing their empathy skills with a virtual patient or through collaborative role playing. We found that across both the role playing and simulation, students assessed their empathy as increasing over time but as higher during the role playing. This work contributes to the continued development of virtual agents for the training of interpersonal skills.

Curriculum integration of virtual patients

BACKGROUND AND PURPOSE

Virtual patients (VP) offer an enhanced learning experience for students to assume the role of health professional and make therapeutic decisions in a simulated environment. While VPs are valued by students and offer benefits to the learner, little is known about how best to implement them in pharmacy education curricula. The purpose of our study was to investigate students' perceptions of VPs and build understanding about how to optimally implement them in the future.

EDUCATIONAL ACTIVITY AND SETTING

Four VP cases were implemented over the first three years of the entry to practice doctor of pharmacy program. Each case was focused on a different condition and implemented in one of three settings (i.e. integration activities, large lecture setting, or independent review). Students were invited to complete a survey and participate in a focus group after completing the patient case.

FINDINGS

One-hundred eighty students completed the survey and six students participated in a focus group. Ninety-four percent of respondents strongly agreed/agreed that VPs were valuable for their learning. Students preferred the VP cases be implemented in small-group settings and be relevantly timed with course material. Students found helpful that cases were realistic, clear, comprehensive, engaging, and incorporated feedback. Perceived benefits included enhanced learning about medical conditions, development of clinical reasoning skills and processes for working through cases.

SUMMARY

VPs continue to be identified as a valuable learning experience. When implemented it is important to consider the learner setting in order to get the greatest value from their use.

Improving resident's skills in the management of circulatory shock with a knowledge-based e-learning tool

BACKGROUND

Correct clinical management of circulatory shock in emergency departments (ER) and intensive care units (ICU) is critical. In this context, the transmission of professional skills by means of the practical supervision of real cases at the point of care entails important issues that can be widely overcome with the use of computer knowledge-based e-learning tools.

OBJECTIVE

Shock-Instructor is a web-based e-learning tool implementing the already tested training program model (TPM) that uses a knowledge base about the evidence found in the clinical practice guidelines about seven types of shock. This tool is expected to reduce the learning times and to improve the skills of hospital residents with regard to both the correct application of the guidelines and patient recovery, suppressing the risks of direct interventions.

METHODS

Shock-Instructor has been used to train residents in the Emergency Department of the Hospital Clínic de Barcelona (Spain) in order to reduce the learning cycle without affecting quality. A case-base with the description of 51 cases with shock and a knowledge-base with 137 clinical rules about the treatment of shock were incorporated to the Shock-Instructor system. A group of 33 residents was involved in a randomized controlled trial to check whether the use of Shock-Instructor can significantly improve the skills of clinicians after one week of problem-based training.

RESULTS

No significant differences were found in the skill levels of the intervention (IG) and control (CG) groups prior to learning. However, we observed an improvement of the IG clinicians capacity to stabilize patients with shock in better clinical conditions (5% improvement, p = 0.004), and to reduce the risk of death in 19.52% (p = 0.004), after training. First-year residents in IG enhanced 14.3% their sensitivity in the correct application of guidelines (p = 0.01), and 14.9% the mean survival rate of their patients (p = 0.01), after being trained with Shock-Instructor for a week. Residents with specialties different from ER and ICU enhanced 16.1% their application of guidelines (p = 0.04), and 14.5% the survival rate of the cases attended (p = 0.01).

CONCLUSIONS

Web-oriented knowledge-based e-learning computer tools such as Shock-Instructor can significantly reduce the learning time of ER and ICU residents, while enhancing their assimilation of evidence-based medicine and both the survival rate and health condition of patients with shock.

Appraising the role of the virtual patient for therapeutics health education

BACKGROUND

Face-to-face instruction, paper-based case-studies and clinical placements remain the most commonly used teaching methods for therapeutics curricula. Presenting clinical content in a didactic manner presents challenges in engaging learners and developing their clinical reasoning skills which may be overcome by inclusion of the virtual patient (VP). Currently there is limited literature examining the use of the VP in therapeutics teaching and learning. This review aimed to determine the role of VPs in therapeutics education, specifically the impact on student experiences, performance, and clinical skills.

METHODS

A search of primary literature was conducted with search terms including virtual patient, education, health, AND learning. Boolean operators were applied to include studies from health relevant fields with article titles and abstracts vetted.

RESULTS

Nine of the 21 included studies were control-matched, and all but one compared VPs to traditional teaching. VPs enhanced the learning experience in all 17 studies that measured this outcome. Fourteen studies measured performance and clinical skills and 12 found VPs were beneficial, while two did not. The VP was not superior to traditional teaching in all studies, but the VP appeared beneficial to the student learning experience. Discrepancy was found between the impact of VPs on short- and long-term knowledge.

IMPLICATIONS

The VP appears to enhance the student learning experience and has a role in therapeutics education, however a blended-learning (BL) approach may be required to account for individual learning styles. Additional investigation is required to clarify the efficacy of the VP, particularly as a component of BL, on longer-term knowledge retention.