Online virtual-patient cases versus traditional problem-based learning in advanced pharmacy practice experiences

Virtual versus paper-based PBL in a pulmonology course for medical undergraduates

BACKGROUND

Problem-based learning (PBL) remains a valid and effective tool for small-group medical education. Using Virtual patients (VP) case simulation in PBL is a recognizable educational method that has successfully prepared students to focus learning on core information that uses realistic patient-based cases relating to everyday clinical scenarios. Using other modalities as the virtual patient in PBL instead of the paper-based methods remains debatable. This study aimed to evaluate the effectiveness of using VP case simulation mannequin in PBL versus the PBL in paper-based cases in improving the cognitive skills by comparing the grades of a multiple-choice question test and assess its ability to reach students' satisfaction using questionnaire with Likert survey instrument.

METHODS

The study was conducted on 459 fourth-year medical students studying in the pulmonology module of the internal medicine course, Faculty of Medicine, October 6 University. All students were divided into 16 PBL classes and randomly divided into groups A and B by simple manual randomization. The groups were parallel with a controlled cross-over study between paper-based and virtual patient PBL.

RESULTS

The pre-test showed no significant difference between both, while post-test scores were significantly higher in both VP PBL cases 1 discussing COPD (6.25 ± 0.875) and case 2 discussing pneumonia (6.56 ± 1.396) compared to paper-based PBL (5.29 ± 1.166, 5.57 ± SD1.388, respectively) at p < 0.1 When students in Group A experienced PBL using VP in case 2 after paper-based PBL in case 1, their post-test score improved significantly. (from 5.26 to 6.56, p < .01). Meanwhile, there was a significant regression in the post-test score of the students in Group B when they experienced the paper-based PBL session in case 2 after using PBL using VP in case 1, (from 6.26 to 5.57, p < .01). Most of the students recommended using VP in PBL as they found VP was more engaging and inducing concentration in gathering the information needed to characterize the patient's problem than in a classroom- paper-based cases session. They also enjoyed the teaching of the instructor and found it a suitable learning style for them.

CONCLUSION

Implementing virtual patients in PBL increased knowledge acquisition and understanding in medical students and was more motivating for students than paper based PBL to gather the needed information.

Potential Barriers to the Implementation of Computer-Based Simulation in Pharmacy Education: A Systematic Review

Computer-based simulation (CBS) is an interactive pedagogical training method that has seen increased interest, especially in recent years. There is some evidence that CBS in pharmacy education is not as widely adopted compared to other healthcare disciplines. Pharmacy education literature to date has not specifically discussed the potential barriers which may cause this uptake challenge. In this systematic narrative review, we attempted to explore and discuss potential barriers that may impact the integration of CBS in pharmacy practice education and provide our suggestions to overcome them. We searched five major databases and used the AACODS checklist for grey literature assessment. We identified 42 studies and four grey literature reports, published between 1 January 2000 and 31 August 2022, which met the inclusion criteria. Then, the specific approach of Braun and Clarke for thematic analysis was followed. The majority of the included articles were from Europe, North America, and Australasia. Although none of the included articles had a specific focus on barriers to implementation, thematic analysis was used to extract and discuss several potential barriers, such as resistance to change, cost, time, usability of software, meeting accreditation standards, motivating and engaging students, faculty experience, and curriculum constraints. Ad- dressing academic, process, and cultural barriers can be considered the first step in providing guidance for future implementation research for CBS in pharmacy education. The analysis suggests that to effectively overcome any possible barriers to implementing CBS, different stakeholders must engage in careful planning, collaboration, and investment in resources and training. The review indicates that additional research is required to offer evidence-based approach and strategies to prevent overwhelming or disengaging users from either learning or teaching process. It also guides further research into exploring potential barriers in different institutional cultures and regions.

Comparison of Learning Facilitated by Traditional and Virtual Case Studies for Teaching the Nursing Approach to Care

Aim:

The objective of this study is to investigate the adoption of these two strategies for teaching the steps of the care process to Moroccan nursing students. We attempt to answer the following questions: What is the preference of nursing students between traditional case studies and virtual case studies? What are their suggestions for improving teaching practices? According to their point of view, which of the teaching strategies is more conducive to the appropriation of knowledge and the development of skills related to the care process?

Background:

Case-based learning has long been one of the active teaching strategies widely used by nursing educators. However, the constraints inherent to traditional case study learning have prompted educators to seek alternative teaching practices. Today, virtual case studies are recognised as one of the most recommended and innovative teaching approaches to address these constraints in the nursing context.

Objective:

the present study aims to explore students' perceptions of traditional case studies and virtual case studies as facilitated learning methods for teaching the nursing process.

Methods:

We conducted a questionnaire survey at the Higher Institute of Nursing Professions and Health Techniques Casablanca in 2021 among first-year polyvalent nursing students. The course ‘Conceptualization and Care Planning’ was taught based on these two different pedagogies.

Results:

Comparing the means via a t-test of the paired samples showed that there was a significant difference for all items (p-value&lt;0.005) between learning facilitated by traditional case studies and virtual case studies.

Conclusion:

These results demonstrate that virtual case studies are an innovative and well-received educational tool for nursing students compared to traditional case studies.

Computer-Based Simulators in Pharmacy Practice Education: A Systematic Narrative Review

Computer-based simulations may represent an innovative, flexible, and cost-efficient training approach that has been underutilised in pharmacy practice education. This may need to change, with increasing pressure on clinical placement availability, COVID-19 restrictions, and economic pressures to improve teaching efficiency. This systematic narrative review summarises various computer-based simulations described in the pharmacy practice education literature, identifies the currently available products, and highlights key characteristics. Five major databases were searched (Medline, CINAHL, ERIC, Education Source and Embase). Authors also manually reviewed the publication section of major pharmacy simulator websites and performed a citation analysis. We identified 49 studies describing 29 unique simulators, which met the inclusion criteria. Only eight of these simulators were found to be currently available. The characteristics of these eight simulators were examined through the lens of eight main criteria (feedback type, grading, user play mode, cost, operational requirement, community/hospital setting, scenario sharing option, and interaction elements). Although a number of systems have been developed and trialled, relatively few are available on the market, and each comes with benefits and drawbacks. Educators are encouraged to consider their own institutional, professional and curriculum needs, and determine which product best aligns with their teaching goals.

Cross-sectional study of the quality of randomized control trials on problem-based learning in medical education

Problem-based learning (PBL) is increasingly being used in medical education globally, but its effectiveness in teaching remains controversial. A randomized controlled trial (RCT) is the method of choice for evaluating its effectiveness. The quality of an RCT has a significant effect on this evaluation, but to date we have not seen an assessment of the quality of RCTs for PBL. Two researchers searched MEDLINE and EMBASE for RCTs addressing PBL in medical education. The overall quality of each report was measured on a 28-point overall quality score (OQS) based on the 2010 revised Comprehensive Standards for Reporting and Testing (CONSORT) Statement. Furthermore, to study the key factors affecting OQS more effectively, a linear regression model of those factors was established using SPSS. After literature screening, 30 RCTs were eventually included and analyzed. The median OQS was 15 (range, 7-20), which meant that half of the items in the revised 2010 CONSORT statement were poorly reported in at least 40% of the RCTs analyzed. The regression model showed that the year of publication of RCTs and the impact factors of the journals in which they were published were the main factors affecting OQS. The overall quality of reporting of RCTs on PBL teaching in medical education was not satisfactory. Some RCTs were subjectively selective in reporting certain items, leading to heterogeneity in quality. It is expected that statisticians will develop new standards more suitable for evaluating RCTs related to teaching research and that editors and peer reviewers will be required to review the relevant RCTs more strictly.

Mapping Simulated-Based Learning Experiences Incorporated Into Professional Placements in Allied Health Programs: A Scoping Review

SUMMARY STATEMENT

Emerging literature continues to demonstrate the use of innovative practices such as simulated-based learning experiences to prepare students for professional placements. This scoping review aimed to provide a broad overview of how simulated-based learning experiences have been implemented within or immediately before the professional practice placements of entry-level allied health programs. Four databases (MEDLINE, EMCARE, CINAHL, and Scopus) were searched up to August 2020. Kirkpatrick's evaluation framework was used to categorize outcomes, and the Simulation-Based Research Extension for the CONSORT statement was used to appraise the quality of simulation reporting. The search revealed 6584 unique abstracts with 321 full-text articles reviewed. Forty-eight studies met the inclusion criteria. This review has shown a clear trend toward using simulation within or immediately before the professional practice placements of allied health programs. Using Kirkpatrick's evaluation framework, most studies reported on student reaction (level 1) and learning (level 2) obtained during the simulation experience. There was limited evidence showing how the benefits gained in simulation translated to the clinical environment (level 3) or impacted the organization (level 4). Further research is required to review the optimal proximity of simulation to allied health professional placements and how gains are obtained from simulation transition to the clinical environment. In addition, more consistent reporting of simulation methodologies and evaluation methods are needed to strengthen the evidence base.

Implementation and Assessment of a Heart Failure Virtual Patient Simulation in a Required Pharmacotherapy Course

Objective. To assess second year Doctor of Pharmacy students' academic performance in and perceptions of a heart failure (HF) virtual patient simulation used in a required pharmacotherapy course.Methods. A heart failure virtual patient simulation was created to augment heart failure pharmacotherapy course material at the University at Buffalo School of Pharmacy and Pharmaceutical Sciences in the fall of 2019. This was a retrospective, pre-post observational cohort study. The primary objective was to compare student performance on heart failure pharmacotherapy examination questions in a cohort of students who completed a virtual patient simulation in 2019 compared to a control cohort who completed a paper-based case activity in 2018. Student perceptions of the simulation experience were assessed via electronic survey.Results. Students completed either the virtual patient simulation (n=122) or a paper-based case activity (n=123). Overall, the proportion of correctly answered heart failure pharmacotherapy examination questions was 83.3% in the virtual simulation group compared to 79.2% in the paper-based case group. Survey results indicated that students would prefer that the virtual patient simulation be incorporated in the pharmacotherapy curriculum.Conclusion. Use of a heart failure virtual patient simulation was associated with improved examination performance and was well received by students.

Effects of virtual simulation on student pharmacists' ability to assess self-care patient cases

INTRODUCTION

The use of simulation is recognized as an effective means to teach skills necessary for pharmacy practice. It is essential these educational activities are evaluated. The purpose of this study is to evaluate the effectiveness of virtual simulation on student pharmacists' ability to assess and formulate a plan for patients seeking self-care.

METHODS

In a third-year course, student pharmacists are assessed on their abilities to assist a patient seeking self-care. This assessment is a standardized patient (SP) case graded using a checklist. Previously, students prepared by participating in workshops and lectures only. In 2017, students continued workshops and lecture, but MyDispense virtual exercises were also assigned. Student performance after using MyDispense was compared to the previous year's students. Each student was assigned one of six different cases for the SP assessment. The maximum possible score was 20. Statistics used were chi-square, Fischer's exact, and t-test.

RESULTS

Data from 135 students in the intervention group were compared to 178 students in the control group. No differences were detected between the mean total scores of all cases when the intervention group was compared to the control group (16.89 vs. 17.22, respectively). A significant difference was only detected for Case 4 (15.91 vs. 18.02, intervention vs. control respectively, P < .001). Significant differences on the grading checklist were identified for six items.

CONCLUSIONS

Virtual simulation may impact student pharmacists' ability to assist patients seeking self-care recommendations. However, not all changes identified were positive.

Simulation-Based Education Implementation in Pharmacy Curriculum: A Review of the Current Status

Simulation-based education (SBE) is a fundamental teaching method that complements traditional teaching modalities. SBE has improved students' knowledge, understanding, and numerous essential skills within undergraduate pharmacy education, similar to traditional teaching methods. However, SBE has become crucial for developing students' teamwork, decision-making, and communication skills. Even though the Accreditation Council for Pharmacy Education (ACPE) has acknowledged the benefit of SBE in interprofessional education (IPE) and the introductory pharmacy practice experience (IPPE). This article provides evidence that SBE can be effective beyond that. This narrative review is focused on the literature related to SBE modalities and the assessment methods of student learning outcomes in the undergraduate pharmacy curriculum. The review illustrates that SBE is an effective teaching method that could be utilized within the pharmacy curriculum. The review also could help pharmacy educators decide on the best modality and placement of integrating patient simulation within the pharmacy curriculum. Combining multiple simulation techniques may be the best way to achieve the desired student learning outcomes.

When a Pharmacist Health Assessment Simulation Becomes a Real Patient-Provider Experience

This commentary presents two simulated pharmacist training events during which concerning medical issues were discovered. The simulation exercises, the pharmacist's responsibility in those exercises, and the need to plan for unexpected findings when conducting simulation events are discussed.

Is Technology Enhanced Learning Cost-effective to Improve Skills?: The Monash Objective Structured Clinical Examination Virtual Experience

INTRODUCTION

Objective Structured Clinical Examinations (OSCEs) are an accepted technique for evaluation of clinical competence in healthcare. However, the economic imperative requires faculty to control cost, using innovative educational strategies such as virtual simulation. The objective of this study was to evaluate the cost implications of implementing an online interactive learning module [Monash OSCE Virtual Experience (MOVE)].

METHODS

All fourth-year pharmacy students enrolled in Monash University in 2017 were provided access to MOVE. Cost-minimization analyses were performed to evaluate the cost of introducing MOVE in the pharmacy course using the smallest cohort size (Malaysia campus) of 40 students as the base case. We also determined under what circumstances MOVE would be more cost-effective, considering the different operational situations such as when student numbers increased or when the number of simulation modules created were increased.

RESULTS

The overall cost of setup and implementation of MOVE in the first year of implementation among 40 students was US $94.38 per student. In comparison, the face-to-face workshop cost was US $64.14 per student. On the second year of implementation, the ongoing cost of operation of MOVE was US $32.86 per student compared with US $58.97 per student using face-to-face workshop. A net benefit using MOVE was observed after the third year of implementation. Larger savings were noted when the cohort size extends larger than 100 students.

CONCLUSIONS

Monash OSCE Virtual Experience was a flexible and cost-effective approach to aid students in preparation for an OSCE and enhanced students' learning experience. The wider applicability of these findings will need to be explored in other settings.

Experiencing a virtual patient to practice patient counselling skills

INTRODUCTION

Virtual patients (VPs) are a safe and standardised method of simulating clinical environments but few studies have explored health care professional's experiences of learning via a VP. This study explored how users experienced and used a VP that aimed to teach the user to deliver non-vitamin K oral anticoagulant patient education.

METHODS

The study used semi-structured interviews with pharmacists and pre-registration trainees from a wider research study. Interview topics were based on key areas concerning VP use. Interviews were audio-recorded and transcribed verbatim before being analysed using the framework approach to thematic analysis. Ethical approval was granted by Keele University.

RESULTS

There was variation in the type and nature of use of the VP and in the reported learning, which included reinforcement of knowledge, an opportunity to promote reflection, and acquisition and application of knowledge to clinical, patient-facing interactions. The VP was seen as an adjunct to other education and training. The majority of users indicated that they used the VP more than once. Some users seemed to have gamified their learning with a drive to achieve perfect feedback rather than true engagement with the learning, whereas for others the learning appeared to be deep with a reflective focus.

CONCLUSIONS

The VP offered an educational use as experiential learning, although the users experienced the VP differently; commonly the VP facilitated learning via reinforcement of pre-existing knowledge. The users reported that the VP had value as an adjunct to other education and training resources.

Establishing the acceptability and usability of an animated virtual patient simulation

Background

An animated, video-based, virtual patient (VP) has been developed to allow pharmacists to learn how, and practice how, to advise patients taking non-vitamin K oral anticoagulants, a group of high-risk medicines. VPs are well-established resources but have historically only been accessed within specific online teaching sessions or at university sites; this new VP represents a mobile design that can be accessed from anywhere.

Objective

To investigate the usability and acceptability of the VP application with a focus on exploring perspectives on accessibility.

Methods

The study used an exploratory sequential mixed method design consisting of a satisfaction survey and interviews. Survey data were analysed descriptively to assess satisfaction with the application and to identify interview discussion areas. Interview data were analysed using the Framework Approach to thematic analysis. Participants were hospital or community pharmacists, or pre-registration pharmacists.

Results

A total of 94 survey responses were collected and 22 respondents went on to take part in an interview. Participants reported liking the concept and delivery of the VP, particularly the high-quality technology. They also reported finding it usable, and appeared to favour its mobility and accessibility, particularly as the VP can be used on any internet accessible device, including mobile phones, with no specific requirements. Amendments that were suggested included quickening the delivery of some animations and improving navigation within the application, possibly through a button to return to the previous step should a mistake be made.

Conclusions

The mobile VP appeared to be functional and usable, with the majority of users reporting satisfaction with use across a range of devices. Users reported positively about the VP's remote access, but navigation around the application requires development.

Implementation and assessment patient cases using the SBAR method to teach patient quality of life issues

BACKGROUND AND PURPOSE

Quality of life (QoL) preferences are an important consideration with respect to the Pharmacists' Patient Care Process (PPCP) and should be assessed prior to implementing a patient-centered plan. The objectives of this intervention were to determine if the design of a QoL activity impacts student performance, and to discern student perceptions of an innovative, case-based activity.

EDUCATIONAL ACTIVITY AND SETTING

Two cohorts of students in their second professional year were asked to present an article that included a QoL consideration. The two student cohorts were asked to complete the activity using a case report and modified SBAR (Situation, Background, Assessment, Recommendation) format. Presentations were graded using a rubric, and scores were assessed retrospectively. An unpaired t-test was used to examine differences. The final cohort of students was also asked to complete a survey to gather their perspectives. Results were described using descriptive statistics; thematic analyses were also performed.

FINDINGS

Students who completed the SBAR activity (N = 71) performed significantly better than those who completed the article (N = 98) presentation (95.62 ± 5.47 vs. 86.30 ± 16.54, P < .001). Those who completed the survey (N = 22) felt they made moderate to excellent progress explaining QoL (86%) and that the activity was helpful (68%). Overall, students reported an improved understanding of the patient's perspective.

SUMMARY

The PPCP requires that students must consider the patient's QoL in order to develop an optimal patient-centered plan. Activities such as this may improve student understanding of QoL implications.

Readiness, Reception, and Performance of Students in a Communications Course Delivered Amid the Pandemic

Objective. To examine pharmacy student readiness, reception, and performance in a communications course amid the COVID-19 pandemic. Methods. First-year pharmacy students (2020 cohort) enrolled in a professional communications course completed a pre- and post-course questionnaire indicating their readiness and changes in reception toward online learning during the pandemic. Student learning performance (midterm and final examination grades) at the end of the course was compared with that of a class which took the same course face-to-face on campus the previous year (2019 cohort). Results. Student preference for face-to-face instruction decreased (difference in means = -1.59; p <.05), while their comfort level for online learning increased (difference in means = +0.38, p <.05) by the end of the course. No appreciable changes in rapport development with the instructor were perceived by the end of the study compared to the beginning. Student learning performance for the online cohort did not differ significantly (p >.05) compared to that of the 2019 cohort. Conclusion. The study demonstrates that students were partly prepared for online learning with the remainder of their maturation to it occurring while the quarter progressed. Remote online learning did not seem to impact student learning (grades) in this communications course during the COVID-19 crisis. Looking past the pandemic, educators and leadership at pharmacy schools and colleges may reassuringly continue to sustain online instruction, where deemed necessary, in their didactic curricula.

Enhancing Student Knowledge of Diabetes through Virtual Choose Your Own Adventure Patient Case Format

Educational strategies to teach pharmacy students about diabetes are necessary to prepare future pharmacists to manage complex patients. The Choose Your Own Adventure (CYOA) patient case format is an innovative activity that presents a patient case in an engaging way. The objectives of this study were (1) to describe the development of the innovative teaching activity and (2) to assess its effect on student knowledge and confidence in outpatient management of diabetes. The CYOA patient case activity was designed by transforming a traditional paper patient case involving outpatient diabetes management into an interactive format utilizing an online platform. The activity was conducted with 186 second-year pharmacy students in a skills-based course. This activity was administered virtually through a combination of small group work and large group discussion. After completion of the activity, students completed an online self-assessment questionnaire. Of 178 completed questionnaires, there was a statistically significant difference in students’ self-ratings after versus before the activity for all survey items (p < 0.001). The CYOA activity improved self-reported knowledge of outpatient diabetes management and increased self-reported confidence in clinical decision-making skills. This format shows promise as an educational tool that may be adapted for other disease states to enhance clinical decision-making skills.

The effect of PBL combined with comparative nursing rounds on the teaching of nursing for traumatology

OBJECTIVE

To investigate the effect of problem-based learning (PBL) combined with comparative nursing rounds on the teaching of nursing for traumatology.

METHODS

This prospective study was performed in 186 nursing student interns. According to a random number table, these interns were assigned to the control group (n=93) and the experimental group (n=93). In the control group, the interns received traditional teaching methods. Meanwhile, interns in the experimental group received PBL combined with comparative nursing rounds teaching. The level of teaching approval, excellent and good rate of theoretical knowledge, operational ability, medical record writing, and critical thinking disposition inventory-Chinese version scores were compared between the two groups.

RESULTS

Teaching approval in learning initiative, problem solving ability, critical thinking, clinical work ability, independent information acquisition ability, and teamwork spirit in the experimental group were improved compared with the control group (all P<0.05). The excellent and good rate of theoretical knowledge, operational ability, and medical record writing in the experimental group were all higher than those in the control group (all P<0.05). Compared with the control group, critical thinking disposition inventory-Chinese version scores in all aspects in the experimental group after training were improved (all P<0.05).

CONCLUSION

The application of PBL combined comparative nursing rounds in the teaching of nursing for traumatology is beneficial for a significant improvement in the grasp of theoretical knowledge, operational ability, critical thinking ability, and teaching approval.

Incorporating verbal defense into problem-based learning

INTRODUCTION

The objective of this project was to evaluate the effect of adjusting the solution reporting phase of problem-based learning (PBL) while keeping core components of the pedagogy constant.

METHODS

A PBL course for third year pharmacy students changed delivery of the problem solution from a written format to a verbal defense. Comparisons were made between the written format and verbal defense groups. The primary outcome was the change in the motivation domain of the Motivated Strategies for Learning Questionnaire (MSLQ). Secondary outcomes included evaluation of the learning strategies domain of the MSLQ, changes in MSLQ scores within each group, exam scores, and themes identified using focus groups.

RESULTS

There was no difference in the change of motivation and learning domains between the groups. However, scores in both groups increased significantly from the beginning to the end of the semester for both motivation and learning. There was no difference in exam scores and facilitator confidence between groups. Themes from focus groups who used the written format were appreciation of PBL outcomes, discomfort with the pedagogy, and disconnect of assessments. Themes from the verbal format group were realism, increased confidence, and comments with course logistics.

CONCLUSIONS

No difference in motivation and learning was observed between the groups, although both groups improved over the course of the semester. Changes to PBL approach within the confines of the pedagogy may not impact motivation and learning.

Impact of a problem-based learning elective on performance in non-problem-based learning required courses

BACKGROUND AND PURPOSE

Use of problem-based learning (PBL) in health professions education has limited data supporting improved exam performance and confidence in problem solving, primarily within courses converted to a PBL format. This study aimed to demonstrate a similar benefit in simultaneous and subsequent required, non-PBL courses that involved critical thinking.

EDUCATIONAL ACTIVITY AND SETTING

This retrospective cohort study included students who were enrolled in the pharmacotherapeutics and case studies/laboratory course sequences in the second and third professional (P3) years. We compared performance across both course sequences of students who took a PBL elective course in the fall of the P3 year (PBL students) and students who did not take the elective course (non-PBL students).

FINDINGS

There was a statistically significant difference favoring PBL students in performance in both the therapeutics and case/lab courses offered simultaneously with the PBL elective. There was no significant difference noted between PBL and non-PBL student performance in the subsequent therapeutics and case/lab courses; however, results within individual cohorts differed strikingly from the aggregate analysis. Performance in the PBL elective had no impact on the outcomes of the study.

SUMMARY

This study demonstrated an overall benefit for students who participated in a PBL course on performance in simultaneous, critical thinking courses that did not incorporate PBL. However, the aggregate did not show a difference in performance in subsequent critical thinking, non-PBL courses. Further studies are needed to elucidate the true benefit of the PBL approach in other non-PBL courses that require advanced clinical reasoning.

Interactive Clinical Avatar Use in Pharmacist Preregistration Training: Design and Review

BACKGROUND

Virtual patients are interactive computer-based simulations that are being increasingly used in modern health care education. They have been identified as tools that can provide experiential learning and assessment in a standardized and safe environment. However, the study of high-fidelity virtual patients such as interactive clinical avatars within pharmacy is limited.

OBJECTIVE

The aim of this paper is to describe the design and review of three interactive clinical avatar simulations as part of pharmacist preregistration training.

METHODS

A multistep design approach was taken to create interactive clinical avatar simulations on the topics of emergency hormonal contraception (EHC), calculation of renal function, and childhood illnesses. All case studies were reviewed by registered pharmacists to establish content and face validity. The EHC case study and data collection questionnaire were also reviewed by a purposive sample of preregistration trainees and newly qualified pharmacists. The questionnaire used Likert ranking statements and open-ended questions to obtain users' feedback on the design, usability, and usefulness of the interactive clinical avatars as learning tools. Descriptive statistics and content analysis were undertaken on the data.

RESULTS

Ten preregistration trainees and newly qualified pharmacists reviewed the EHC interactive clinical avatars and data collection questionnaire. The data collection questionnaire was associated with a Cronbach alpha=.95, demonstrating good reliability. All three interactive clinical avatar simulations were reported as usable and appropriately designed for preregistration training. Users perceived they were developing skills and knowledge from the simulations. The high-fidelity nature of the avatars and relevance of the simulations to real-life practice were reported as aspects that encouraged the application of theory to practice. Improvements were suggested to ensure the simulations were more user-friendly.

CONCLUSIONS

The design and creation of the interactive clinical avatar simulations was successful. The multistep review process ensured validity and reliability of the simulations and data collection questionnaire. The in-depth explanation of the design process and provision of a questionnaire may help widen the use and evaluation of interactive clinical avatars or other simulation tools in pharmacy education. The interactive clinical avatars were reported as novel learning tools that promoted experiential learning and allowed users to feel like they were engaging in real-life scenarios, thus developing transferable knowledge and skills. This may be potentially beneficial for many health care training courses as a way to provide standardized experiences promoting active learning and reflection.

Pharmacy Students' Perceptions and Performance on the Use of an Online Virtual Experience Tool for Practicing Objective Structured Clinical Examinations

Objective. To examine pharmacy students' performance on and perceptions regarding the use of an interactive online tool for practicing to take objective structured clinical examinations (OSCEs).Methods. The Monash OSCE Virtual Experience (MOVE), an online module consisting of 20 pharmacy case scenarios with virtual patients, was piloted with final-year pharmacy students at Monash University campuses in Australia and Malaysia. A mixed methods approach that included reviewing user attempts and comparing grades, collecting student-administered questionnaires, and holding focus groups was used to examine students' perception and performance.Results. More than 99% of all students attempted at least one online case scenario in preparation for their final in-person OSCE, and 81% attempted all 20 scenarios two or more times. Ninety percent of students at the Malaysia campus and 70% of students at the Australia campus reported that MOVE was a helpful study tool for their OSCE preparation. However, a raw comparison of user attempts and OSCE grades did not find a direct correlation between online module attempts and assessment grades. Self-administered questionnaire and focus group results indicated that MOVE prepared students for targeted and time-restricted history-taking and problem-solving skills. Overall, students perceived MOVE to be a useful learning tool and a less overwhelming learning experience than were face-to-face sessions. Nevertheless, students still preferred face-to-face OSCE practice with simulated patients over online practice with virtual patients.Conclusion. The Monash OSCE Virtual Experience was perceived by our students as a flexible and useful online learning aid in preparing for their final-year OSCE However, there was no direct correlation between online practice attempts and students' exam grades.

Virtual Versus Paper-based Cases in Reinforcing the Collect and Assess Elements of the Pharmacists' Patient Care Process

Objective. To compare pharmacy students' perceptions about and performance when using paper-based versus virtual patient cases to reinforce knowledge of the collect and assess elements of the Pharmacists' Patient Care Process (PPCP). Methods. Twenty-seven pharmacy students enrolled in an ambulatory care elective course were randomized to receive either paper-based cases or virtual patient cases for three weeks. They then crossed over to receive the alternative case format for the next three weeks. Each student received a score for their performance on questions related to the collect and assess elements of the PPCP. Students completed a survey and participated in a focus group to evaluate their perceptions of each learning method. Statistical analyses were performed on all data collected. Results. Students' performance (n=27) was better on the assess questions of the PPCP when they used paper-based patient cases than when they used virtual patient cases. The only difference in students' perceptions was related to the collect element, as students favored using paper-based patient cases over virtual patient cases when collecting subjective and objective information. Students who participated in the focus groups believed that the virtual patient cases provided a more realistic and engaging experience in addition to promoting critical thinking. Conclusion. While paper-based patient cases allowed pharmacy students to quickly identify and "collect" relevant information, increased use of virtual patient cases may enhance students' comfort level with and ability to "assess" actual patients.

Evaluation of an interactive simulated patient educational tool on course performance among current pharmacy students

BACKGROUND AND PURPOSE

In an accelerated doctor of pharmacy program, student examination performance on a key knowledge concept, the Cockcroft-Gault equation (CGE) for creatinine clearance estimation, was suboptimal. A scenario-based online tutorial using a virtual patient activity was developed to provide just-in-time access to an active-learning opportunity, consistent with Millennial learning styles. The purposes of this study were to assess the association between tutorial use and CGE examination performance and to explore learner characteristics that may affect this association, including student age group.

EDUCATIONAL ACTIVITY AND SETTING

CGE calculation is a required component of Renal and Cardiovascular System I, the fourth of a five-quarter intensive integrated course sequence. The tutorial used pretest-based branching, learner personalization, and virtual-patient scenarios in a realistic environment. Statistical analyses estimated the association of voluntary tutorial usage with CGE-calculation performance using Spearman's Rho correlations and linear regression analysis. Covariates included age group and course grade, excluding CGE points.

FINDINGS

Over a three-year study period (2015 to 2017), students (n = 436) accessed the tutorial a mean (median) of 5.64 (5.0) times. Tutorial access varied significantly, but not consistently, across age categories. In both bivariate and linear regression analyses, tutorial access was significantly associated with CGE grade only among students with non-CGE grades in the top 25% (i.e. top quartile).

SUMMARY

The majority of learners took advantage of an interactive educational tool designed for active learner engagement. Frequency of tutorial access was associated with improvements in CGE calculation performance only among top-quartile students.

Impact of virtual simulation in self-care therapeutics course on introductory pharmacy practice experience self-care encounters

BACKGROUND AND PURPOSE

Pharmacy education programs use simulation to provide a realistic and safe environment for student learning. We studied whether incorporation of virtual simulation into a required first year self-care therapeutics course impacted frequency of interactions, self-reported student confidence, and preceptor-reported student performance during second-year community pharmacy introductory pharmacy practice experiences (IPPEs).

EDUCATIONAL ACTIVITY AND SETTING

Virtual simulation cases using MyDispense were incorporated into a self-care therapeutics course in winter 2017. Students and preceptors were surveyed at the end of the fall semester community pharmacy IPPE. Data from IPPE experiences was compared with students who took the self-care therapeutics course in winter 2016 (control).

FINDINGS

Students completed 30 virtual simulation cases and three cases as part of the final examination (n = 33). Students in the intervention group reported more patient care interactions during their IPPEs than students who did not complete virtual simulation cases, but there was no difference in self-reported confidence. Preceptors did not report any differences in the ability of students to complete over-the-counter medication interactions during IPPEs.

SUMMARY

Cases were well received by students although they took longer to complete than initially anticipated. Students in the intervention group reported significantly more patient care interactions during IPPEs than those in the control group; however, there were no differences in self-reported confidence. Incorporation of virtual simulation was a sustainable change as the cases were able to be re-used the following year with minimal edits.

Curriculum integration of virtual patients

BACKGROUND AND PURPOSE

Virtual patients (VP) offer an enhanced learning experience for students to assume the role of health professional and make therapeutic decisions in a simulated environment. While VPs are valued by students and offer benefits to the learner, little is known about how best to implement them in pharmacy education curricula. The purpose of our study was to investigate students' perceptions of VPs and build understanding about how to optimally implement them in the future.

EDUCATIONAL ACTIVITY AND SETTING

Four VP cases were implemented over the first three years of the entry to practice doctor of pharmacy program. Each case was focused on a different condition and implemented in one of three settings (i.e. integration activities, large lecture setting, or independent review). Students were invited to complete a survey and participate in a focus group after completing the patient case.

FINDINGS

One-hundred eighty students completed the survey and six students participated in a focus group. Ninety-four percent of respondents strongly agreed/agreed that VPs were valuable for their learning. Students preferred the VP cases be implemented in small-group settings and be relevantly timed with course material. Students found helpful that cases were realistic, clear, comprehensive, engaging, and incorporated feedback. Perceived benefits included enhanced learning about medical conditions, development of clinical reasoning skills and processes for working through cases.

SUMMARY

VPs continue to be identified as a valuable learning experience. When implemented it is important to consider the learner setting in order to get the greatest value from their use.

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Background

Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education.

Objective

The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction.

Methods

We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models.

Results

A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI −0.17 to 0.39, I²=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I²=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence.

Conclusions

Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.

Digital Problem-Based Learning in Health Professions: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

BACKGROUND

The use of digital education in problem-based learning, or digital problem-based learning (DPBL), is increasingly employed in health professions education. DPBL includes purely digitally delivered as well as blended problem-based learning, wherein digital and face-to-face learning are combined.

OBJECTIVE

The aim of this review is to evaluate the effectiveness of DPBL in improving health professionals' knowledge, skills, attitudes, and satisfaction.

METHODS

We used the gold-standard Cochrane methods to conduct a systematic review of randomized controlled trials (RCTs). We included studies that compared the effectiveness of DPBL with traditional learning methods or other forms of digital education in improving health professionals' knowledge, skills, attitudes, and satisfaction. Two authors independently screened studies, extracted data, and assessed the risk of bias. We contacted study authors for additional information, if necessary. We used the random-effects model in the meta-analyses.

RESULTS

Nine RCTs involving 890 preregistration health professionals were included. Digital technology was mostly employed for presentation of problems. In three studies, PBL was delivered fully online. Digital technology modalities spanned online learning, offline learning, virtual reality, and virtual patients. The control groups consisted of traditional PBL and traditional learning. The pooled analysis of seven studies comparing the effect of DPBL and traditional PBL reported little or no difference in postintervention knowledge outcomes (standardized mean difference [SMD] 0.19, 95% CI 0.00-0.38). The pooled analysis of three studies comparing the effect of DPBL to traditional learning on postintervention knowledge outcomes favored DPBL (SMD 0.67, 95% CI 0.14-1.19). For skill development, the pooled analysis of two studies comparing DPBL to traditional PBL favored DPBL (SMD 0.30, 95% CI 0.07-0.54). Findings on attitudes and satisfaction outcomes were mixed. The included studies mostly had an unclear risk of bias.

CONCLUSIONS

Our findings suggest that DPBL is as effective as traditional PBL and more effective than traditional learning in improving knowledge. DPBL may be more effective than traditional learning or traditional PBL in improving skills. Further studies should evaluate the use of digital technology for the delivery of other PBL components as well as PBL overall.

Virtual simulation to personalize student learning in a required pharmacy course

BACKGROUND AND PURPOSE

Virtual simulation is used to provide a realistic and safe environment for student pharmacists to learn and practice a variety of skills in the didactic and experiential settings.

EDUCATION ACTIVITY AND SETTING

The simulation program, MyDispense, that is used to teach medication dispensing in the outpatient setting was incorporated into a 2-credit hour required first-year pharmacy practice skills course. A total of 30 optional and 16 required exercises were completed by students.

FINDINGS

There was a total of 2,457 attempts (mean = 28.9 attempts per student) at optional practice exercises and students completed an average of 16.6 ± 7.9 (range 1-30). While variation in the number of optional practice exercises completed was observed between students with varying levels of pharmacy experience, the difference was not statistically significant. A component of the final exam utilized the virtual simulation program and all students passed this portion of the exam based on a minimum requirement of 70.0% (mean 92.9%, range 74.5-100%).

DISCUSSION

Students generally identified that the use of virtual simulation was an effective tool to learn medication dispensing skills in a classroom setting. Furthermore, this created an opportunity for pharmacy practice residents to develop teaching skills. The biggest barrier to implementation was the amount of time required to create and test each exercise.

SUMMARY

The virtual simulation program allowed students to self-identify the amount of practice they thought was necessary in order to gain specific skills related to medication dispensing.

Simulated patient cases using DecisionSim™ improves student performance and satisfaction in pharmacotherapeutics education

BACKGROUND AND PURPOSE

Pharmacy education is continuously evolving and incorporation of technology is more prevalent. Computer-based patient cases are being utilised to illustrate complex concepts and develop clinical decision-making skills by enabling deliberate practice and continued feedback to scaffold student learning. Simulations are received positively by students but there is limited information on the benefit to student performance. The study aim was to determine the benefits of computer-based cases for oncology therapeutics in terms of student satisfaction and performance.

EDUCATIONAL ACTIVITY AND SETTING

Computer based oncology cases were designed using DecisionSim™ technology and introduced to final year pharmacy students. Student satisfaction was measured using a questionnaire with a 5-point Likert scale (1 strongly agree to 5 strongly disagree), and an option for open-ended comments. Performance was measured using results of assessment items in the oncology course compared to a similar course (psychiatric/neurology).

FINDINGS

Students found the simulated oncology cases engaged them in learning (median 1.5), had a role in therapeutics education (median 1), and developed decision making skills (median 1). Thematic analysis of open comments suggested it was most beneficial as a self-directed study tool. The students performed significantly higher (p < 0.05) in the oncology end of semester exam (78.6 ± 8.6) compared to psychiatric/neurology (70.7 ± 9.6).

SUMMARY

A computer-based simulation for oncology pharmacotherapeutics can engage students and develop decision making skills. DecisionSim™ enhanced both student satisfaction and performance in management of oncology cases, and is a beneficial educational tool for teaching complex therapeutic topics to pharmacy students.

An open randomized controlled study comparing an online text-based scenario and a serious game by Belgian and Swiss pharmacy students

INTRODUCTION

To compare online learning tools, looped, branch serious game (SG) and linear text-based scenario (TBS), among a sample of Belgian and Swiss pharmacy students.

METHODS

Open randomized controlled study. The lesson was based on the case of a benign cough in a healthy child. A randomized sample of 117 students: only the Swiss students had attended a previous lecture on coughs. Participation rate, pre- and post-experience Likert scales and students' clinical knowledge were measured.

RESULTS

Our primary hypothesis was demonstrated: students favored the SG even if navigation was rated as more complex, and students who performed the SG better understood the aim of pharmacist triage in case of cough. The influence of the SG appeared to be linked to the presence of a previous lecture in the curriculum.

DISCUSSION AND CONCLUSION

SG and TBS are effective to teach pharmacist triage. Higher SG complexity should be used to teach the aim of pharmacist triage in the case of a specific disease and could be an alternative to simulated patients. A simpler TBS does not require a previous lecture and a debriefing to be fully effective.

Using a course pilot in the development of an online problem-based learning (PBL) therapeutics course in a post-professional PharmD program

BACKGROUND AND PURPOSE

To assess whether the traditional problem-based learning (PBL) process can be replicated in an online environment, and to identify any barriers and facilitators to learning using a course pilot.

EDUCATIONAL ACTIVITY AND SETTING

Eight alumni and one experienced tutor participated in a two-week simulated PBL course comprised of two three-hour synchronous online tutorials. Blackboard Collaborate^® software was used to permit audio and visual interaction. The PBL tutorials were recorded and observed by the researchers. Participants completed satisfaction surveys after the pilot, and were invited to take part in a focus group to debrief about their experience.

FINDINGS

Once the steep learning curve with the technology was overcome, the quality of the PBL process was similar in the online course as it was in the face-to-face course. Several key factors for success were identified through analysis of the videotaped sessions, and interviews with the participants in the course pilot.

SUMMARY

Conducting a course pilot study demonstrated that an online PBL course is feasible, and identified some considerations to facilitate success.

Pharmacy student decision making in over-the-counter medicine supply: A critical incident study

BACKGROUND

Various factors influence decision making in over-the-counter (OTC) medicine consultations, yet limited studies have focused, in-depth, on the thought process of pharmacy staff. This includes pharmacy students as pharmacists-in-training.

AIM

To explore the factors that influence pharmacy students' decisions in relation to OTC consultations and choice of OTC medicine/s.

METHODS

Semi-structured interviews using the critical incident technique were undertaken with ten pharmacy students in Australia, who also worked as part-time pharmacy staff.

RESULTS

Nine key themes were identified to influence pharmacy student decision making in OTC consultations, including customer response, confidence and scope of practice. Product requests were reported as more challenging due to customer expectations and experiences in other pharmacies, states or countries. Although negative customer response influenced some students to supply medicines in contradiction of evidence, an overarching concern for safety meant that a medicine was only supplied if unlikely to cause harm. Students reported developing confidence in OTC decision making more from real-life practice than university training; greater confidence was identified for inquiries more frequently experienced in the pharmacy. Students perceived that customers had assumptions around support staff, and were happier to talk to students than assistants.

CONCLUSION

This study further identified that OTC decision making is a complex process for pharmacy students. Additional opportunities for experiential learning within this area are suggested, such as work-based placements or in-class activities such as role-plays with simulated patients.

Utilization of a virtual patient for advanced assessment of student performance in pain management

BACKGROUND AND PURPOSE

To assess student performance and achievement of course objectives following the integration of a virtual patient case designed to promote active, patient-centered learning in a required pharmacy course.

EDUCATIONAL ACTIVITY AND SETTING

DecisionSim™ (Kynectiv, Inc., Chadsford, PA), a dynamic virtual patient platform, was used to implement an interactive patient case to augment pain management material presented during a didactic session in a pharmacotherapy course. Simulation performance data were collected and analyzed. Student exam performance on pain management questions was compared to student exam performance on nearly identical questions from a prior year when a paper-based case was used instead of virtual patient technology.

FINDINGS

Students who performed well on the virtual patient case performed better on exam questions related to patient assessment (p = 0.0244), primary pharmacological therapy (p = 0.0001), and additional pharmacological therapy (p = 0.0001). Overall exam performance did not differ between the two groups. However, students with exposure to the virtual patient case demonstrated significantly better performance on higher level Bloom's Taxonomy questions that required them to create pharmacotherapy regimens (p=0.0005). Students in the previous year (exposed only to a paper patient case) performed better in calculating conversions of opioids for patients (p = 0.0001).

SUMMARY

Virtual patient technology may enhance student performance on high-level Bloom's Taxonomy examination questions. This study adds to the current literature demonstrating the value of virtual patient technology as an active-learning strategy.

Appraising the role of the virtual patient for therapeutics health education

BACKGROUND

Face-to-face instruction, paper-based case-studies and clinical placements remain the most commonly used teaching methods for therapeutics curricula. Presenting clinical content in a didactic manner presents challenges in engaging learners and developing their clinical reasoning skills which may be overcome by inclusion of the virtual patient (VP). Currently there is limited literature examining the use of the VP in therapeutics teaching and learning. This review aimed to determine the role of VPs in therapeutics education, specifically the impact on student experiences, performance, and clinical skills.

METHODS

A search of primary literature was conducted with search terms including virtual patient, education, health, AND learning. Boolean operators were applied to include studies from health relevant fields with article titles and abstracts vetted.

RESULTS

Nine of the 21 included studies were control-matched, and all but one compared VPs to traditional teaching. VPs enhanced the learning experience in all 17 studies that measured this outcome. Fourteen studies measured performance and clinical skills and 12 found VPs were beneficial, while two did not. The VP was not superior to traditional teaching in all studies, but the VP appeared beneficial to the student learning experience. Discrepancy was found between the impact of VPs on short- and long-term knowledge.

IMPLICATIONS

The VP appears to enhance the student learning experience and has a role in therapeutics education, however a blended-learning (BL) approach may be required to account for individual learning styles. Additional investigation is required to clarify the efficacy of the VP, particularly as a component of BL, on longer-term knowledge retention.

Evaluation of the Use of a Virtual Patient on Student Competence and Confidence in Performing Simulated Clinic Visits

Objective. To assess the effect of incorporating virtual patient activities in a pharmacy skills lab on student competence and confidence when conducting real-time comprehensive clinic visits with mock patients. Methods. Students were randomly assigned to a control or intervention group. The control group completed the clinic visit prior to completing virtual patient activities. The intervention group completed the virtual patient activities prior to the clinic visit. Student proficiency was evaluated in the mock lab. All students completed additional exercises with the virtual patient and were subsequently assessed. Student impressions were assessed via a pre- and post-experience survey. Results. Student performance conducting clinic visits was higher in the intervention group compared to the control group. Overall student performance continued to improve in the subsequent module. There was no change in student confidence from pre- to post-experience. Student rating of the ease of use and realistic simulation of the virtual patient increased; however, student rating of the helpfulness of the virtual patient decreased. Despite student rating of the helpfulness of the virtual patient program, student performance improved. Conclusion. Virtual patient activities enhanced student performance during mock clinic visits. Students felt the virtual patient realistically simulated a real patient. Virtual patients may provide additional learning opportunities for students.

Five years of lesson modification to implement non-traditional learning sessions in a traditional-delivery curriculum: A retrospective assessment using applied implementation variables

Non-traditional learning (NTL), including aspects of self-directed learning (SDL), may address self-awareness development needs. Many factors can impact successful implementation of NTL.

OBJECTIVES

To share our multi-year experience with modifications that aim to improve NTL sessions in a traditional curriculum. To improve understanding of applied implementation variables (some of which were based on successful SDL implementation components) that impact NTL.

METHODS

We delivered a single lesson in a traditional-delivery curriculum once annually for five years, varying delivery annually in response to student learning and reaction-to-learning results. At year 5, we compared student learning and reaction-to-learning to applied implementation factors using logistic regression.

RESULTS

Higher instructor involvement and overall NTL levels predicted correct exam responses (p=0.0007 and p<0.0001, respectively). Exam responses were statistically equivalent between the most traditional and highest overall NTL deliveries. Students rated instructor presentation skills and teaching methods higher when greater instructor involvement (p<0.0001, both) and lower overall NTL levels (P<0.0001, both) were used. Students perceived that teaching methods were most effective when lower student involvement and higher technology levels (p<0.0001, both) were used.

CONCLUSION

When implementing NTL sessions as a single lesson in a traditional-delivery curriculum, instructor involvement appears essential, while the impact of student involvement and educational technology levels varies.

Virtual Patient Case Sharing Across Two Schools of Pharmacy

Objective. To expand the use of virtual patients at 2 schools of pharmacy through virtual patient case sharing. Design. Faculty members at two schools of pharmacy collaborated to expand the use of virtual patients. Two simulation programs, vpSim and DecisionSim (Decision Simulation, LLC, Chadsford, PA), were used to create interactive patient cases for a required course and an elective course at the different schools. Each school developed cases for their own use and then shared the cases with the other school. Assessment. The development, sharing, and subsequent modification of cases were examined using a standardized data collection form completed by both schools. Survey instruments were used to gather data regarding faculty perception and student satisfaction. Pre- and post-tests were administered to assess student learning. Five cases were developed and shared between the institutions. The time spent constructing new cases (22 hours/case) was significantly longer than the time spent modifying the shared cases (1.2 hours/case). Faculty members and students were largely satisfied with case sharing and the use of virtual patient cases, respectively. Virtual patients significantly enhanced student learning of material (mean score: 3.2 vs 3.6 on a 5-point scale). Conclusions. The sharing of virtual patient cases may allow institutions to overcome barriers to implementation of virtual patient programs, namely faculty resources, while improving student learning and satisfaction.

Pharmacy Student Learning During Advanced Pharmacy Practice Experiences in Relation to the CAPE 2013 Outcomes

Outcomes from The Center for Advancement of Pharmacy Education (CAPE) are intended to represent the terminal knowledge, skills, and attitudes pharmacy students should possess and have guided delivery of pharmacy education for more than two decades. Advanced pharmacy practice experiences (APPEs) are the endpoint of pharmacy curricula where demonstration and assessment of terminal learning occurs. This review examines published literature in relation to the most recent CAPE outcomes to determine the extent to which they have been addressed during APPEs since 1996. Details related to the APPE focus, intervention(s)/learning setting(s), and assessments are summarized according to the 15 CAPE outcomes. Further, the assessments are categorized according to the level of learning achieved using an available method. Common CAPE outcomes are highlighted, as well as those for which published reports are lacking for APPEs. The range and quality of assessments are discussed and emphasize the need for continuous improvement of scholarly design and assessment.

A Secure, Social Media-Based "Case of the Month" Module in a Neurocritical Care Unit

BACKGROUND

Systems to meet the on-demand learning needs of nurses in intensive care units are not well studied beyond the traditional classroom models.

OBJECTIVE

To study the feasibility and effect of implementing an online discussion forum for nurses in a busy neuroscience intensive care unit.

METHODS

A baseline survey was done to highlight the areas of educational need in the unit. Freeform-a password-protected, online discussion forum supported by the university-was used for the pilot project. Freeform has functions similar to Facebook, with "likes," "follow," discussion/comment spaces, and the capacity for uploading images and files. A page called "All things NeuroCritical Care" was created. All nurses working in the intensive care unit were automatically enrolled. Clinical vignettes relevant to neurocritical care were posted once a month with 1 to 2 lead questions. All participation was voluntary, and topics were chosen on the basis of the needs survey. At the end of each case, a recent review article on the topic was posted for secure download.

RESULTS

Eight sentinel diagnoses have been presented as clinical vignettes, and 34 of 76 members formally follow the page. The mean number of discussion strings per case is 8.3 posts. The number of unique visitors to the page during active case discussions exceeds 100.

CONCLUSION

A secure, online, problem-based learning discussion format is a feasible point-of-care learning opportunity that can help overcome some of the traditional barriers to ongoing nursing education needs in a busy intensive care unit.

Strategies to grow an experiential learning program-The role of administrators

With the newly released ACPE standards, challenges exist in growing experiential learning programs at many schools. The role of administrators in the experiential learning office, practice department, and the dean׳s office is critical for success. This article provides practical tips and strategies to help grow an experiential learning program by emphasizing the role of administrators. In 2012, the administrators of the University of Maryland School of Pharmacy brainstormed and came up with a list of challenges faced by its experiential learning program, provided suggested solutions to each challenge, and began a process of implementing solutions to help grow the program. As of fall 2014, we were able to document increases in the numbers of preceptors and different rotation types, growth in the clinical track program, changes in our learning management system to better accommodate our needs, and increases in satisfaction rates among our preceptors, sites, and students. This article summarizes the challenges faced by University of Maryland Experiential Learning Program, the practical solutions implemented, and the role of leadership in growing the program. Many of the suggestions and lessons learned here can benefit many programs with similar challenges.

A Scenario-Based Virtual Patient Program to Support Substance Misuse Education

Objective. To evaluate virtual patient (VP) programs for injecting equipment provision (IEP) and opiate substitution therapy (OST) services with respect to confidence and knowledge among preregistration pharmacist trainees. Methods. Preregistration trainee pharmacists pilot-tested the VP programs and were invited to complete pre/post and 6-month assessments of knowledge and perceived confidence. Results. One hundred six trainees participated and completed the pre/postassessments. Forty-six (43.4%) participants repeated the assessments at six months. Scores in perceived confidence increased in all domains at both time points postprogram. Knowledge scores were greater posteducation than preeducation. Knowledge scores were also greater six months after education than preeducation. Knowledge scores at six months were lower than posteducation for both programs. Conclusion. Virtual patients programs increased preregistration pharmacists' knowledge and confidence with regard to IEP and OST immediately after use and at six months postprogram. There was a loss of clinical knowledge over time but confidence change was sustained.

Family Medicine Education with Virtual Patients: a Qualitative Study

Objectives:

Virtual patients (VP) have been present within the medical education process for some time. Although they are assumed to be of great benefit for student learning, very little is know about student perception and outcomes of learning, especially during the pre-clerkship years. Therefore we have decided to investigate the use of VPs during lectures, which has never been analyzed before, but could present an opportunity for more effective and holistic learning.

Methods:

This was a qualitative study among the 4th year undergraduate medical students at the Medical Faculty, University of Maribor, Slovenia. Students, after completing 4 virtual patient cases during the semester, were asked to participate in focus groups. Using these focus groups we asked students to provide information about their perceptions of VP cases, their learning, and suggestions for educational improvements. Data was transcribed and analyzed using the grounded theory-based coding method (open coding).

Results:

Medical students reported having a positive attitude towards virtual patient learning. They perceived them as helpful for filling in knowledge gaps, learning appropriate patient care and clinical reasoning. However, especially within the setting of early clinical learning, students felt the need to discuss their questions with their tutors in order to achieve better learning outcomes.

Conclusion:

Students on teaching courses feel the need for structured instructor sessions and the integration of VPs in the course planning in order to maximize their learning outcomes.