The Emotional and Behavioral Impact of Delivering Bad News to Virtual versus Real Standardized Patients: A Pilot Study

Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review

BACKGROUND

Chatbots, or conversational agents, have emerged as significant tools in health care, driven by advancements in artificial intelligence and digital technology. These programs are designed to simulate human conversations, addressing various health care needs. However, no comprehensive synthesis of health care chatbots' roles, users, benefits, and limitations is available to inform future research and application in the field.

OBJECTIVE

This review aims to describe health care chatbots' characteristics, focusing on their diverse roles in the health care pathway, user groups, benefits, and limitations.

METHODS

A rapid review of published literature from 2017 to 2023 was performed with a search strategy developed in collaboration with a health sciences librarian and implemented in the MEDLINE and Embase databases. Primary research studies reporting on chatbot roles or benefits in health care were included. Two reviewers dual-screened the search results. Extracted data on chatbot roles, users, benefits, and limitations were subjected to content analysis.

RESULTS

The review categorized chatbot roles into 2 themes: delivery of remote health services, including patient support, care management, education, skills building, and health behavior promotion, and provision of administrative assistance to health care providers. User groups spanned across patients with chronic conditions as well as patients with cancer; individuals focused on lifestyle improvements; and various demographic groups such as women, families, and older adults. Professionals and students in health care also emerged as significant users, alongside groups seeking mental health support, behavioral change, and educational enhancement. The benefits of health care chatbots were also classified into 2 themes: improvement of health care quality and efficiency and cost-effectiveness in health care delivery. The identified limitations encompassed ethical challenges, medicolegal and safety concerns, technical difficulties, user experience issues, and societal and economic impacts.

CONCLUSIONS

Health care chatbots offer a wide spectrum of applications, potentially impacting various aspects of health care. While they are promising tools for improving health care efficiency and quality, their integration into the health care system must be approached with consideration of their limitations to ensure optimal, safe, and equitable use.

The use of virtual patients for breaking bad news: A rapid review

BACKGROUND

Breaking bad news is an imperative skill for clinical practice that health care professionals struggle with. Virtual patients have been adopted as a new teaching aide in medical education and have shown efficacy in teaching clinical skills; however, there is limited research for use in communication skills. Virtual patients are especially well-suited for difficult communication skills, as students can practice without risk to patients. This rapid review aimed to review literature observing the potential of virtual patients as an effective means to teach breaking bad news.

METHOD

A systematic search strategy was applied for papers published between November 2012 and November 2022 on Medline and Embase databases. Following the application of inclusion criteria, three studies were included. The Medical Education Research Study Quality Instrument and Critical Appraisal Skills Programme checklist were used for quality appraisal of the studies. Tabular and narrative synthesis was used to present the findings.

FINDINGS

The findings of the studies suggest that when teaching breaking bad news, virtual patients are valuable compared with no intervention and are not inferior compared with simulated patients. An unexpected benefit of virtual patients was videotaping. A barrier to learning was the lack of affect and interaction. More research into the design of virtual simulations and its integration into existing curricula is required.

CONCLUSION

Virtual patients are a valuable educational tool for breaking bad news; however, they are yet to replace existing educational approaches. There is a need for more large-scale, homogeneous studies to inform instructional design and curriculum integration.

Development and validation of the physician self-efficacy to manage emotional challenges Scale (PSMEC)

BACKGROUND

Medical students experience emotional challenges during their undergraduate education, often related to work-based learning. Consequently, they may experience feelings of uncertainty and self-doubt, which can negatively affect their well-being. Therefore, it is crucial to support students' development of their ability to manage distressful situations. Self-efficacy beliefs may be a central aspect of supporting them in this development, and have been shown to relate to resilient factors such as students' motivation, learning, and well-being.

METHODS

We constructed a scale to measure medical students' physician self-efficacy to manage emotional challenges during work-based learning, the PSMEC scale. The aim of the present study was to evaluate some of the psychometric properties of the PSMEC scale. The scale consists of 17 items covering five subscales: (1) medical knowledge and competence, (2) communication with difficult patients and delivering bad news, (3) being questioned and challenged, (4) educative competence in patient encounters, and (5) ability to establish and maintain relationships with healthcare professionals. Data were collected from 655 medical students from all seven medical schools in Sweden. To investigate the scale's dimensionality and measurement invariance with regard to gender and time in education, single and multiple group confirmatory factor models were estimated using techniques suitable for ordered categorical data. Measures of Cronbach's alpha were calculated to evaluate internal consistency.

RESULTS

The scale showed good internal consistency on both the global dimension and the five subdimensions of self-efficacy. In addition, the scale was shown to be measurement invariant across genders and times in education, indicating that the scale means of male and female medical students and the scale means of students at the middle and end of their education can be compared.

CONCLUSIONS

The physician self-efficacy to manage emotional challenges scale demonstrated satisfactory psychometric properties, with regards to dimensionality, internal consistency, and measurement invariance relating to gender and time in education, and this study supports the usefulness of this scale when measuring self-efficacy in relation to emotional challenges.

Society for Simulation in Healthcare Guidelines for Simulation Training

BACKGROUND

Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.

METHODS

Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

OBJECTIVE

These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare.

RESULTS

Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided.

CONCLUSIONS

The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

The Use of Standardized Patients to Teach Communication Skills-A Systematic Review

OBJECTIVES

The aim of this systematic review was to synthesize research completed between 2011 and 2021 to report the current state of the science on the use of standardized patients (SPs) to teach communication skills. The research question that guided this study was, "Among health care professionals, does the use of SP methodology as a means of teaching communication skills result in improved learner knowledge, skills, attitudes, and/or patient outcomes when compared with other simulation methodologies?"

DESIGN

This review was reported in line with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA).Data SourcesFour databases (CINAHL, Ovid Embase, Ovid Medline, and Scopus) were searched using a combination of medical subject headings, or Mesh terms, as well as keywords to retrieve nonindexed citations.Review MethodsThe inclusion criteria were broad to complete a comprehensive search of the literature. To be eligible for inclusion, a study had to be original research that compared simulation using an SP to another simulation methodology. The study had to evaluate communication knowledge, skill, attitude, and/or patient outcome with an academic or practicing health care professional.

RESULTS

The initial database search strategy yielded 8058 citations. These results were narrowed down to 18 studies through an in-depth analysis of each article using identified inclusion criteria. The SPs were superior to role play in 1 (33%, n = 3) study where knowledge was evaluated, 6 (75%, n = 8) studies where skills were evaluated, and 1 (20%, n = 5) study where attitude was evaluated. The SPs were compared with a manikin in 5 studies. The SPs were superior to a manikin in 3 (60%, n = 5) studies where knowledge was measured and in 1 (100%, n = 1) study where attitude was measured. No study measured the outcome knowledge of an SP to a manikin. Finally, SPs were compared with a virtual SP in 3 studies. When knowledge was evaluated, SPs were superior to a virtual SP in 1 study (100%, n = 1). When skills were evaluated, SPs were superior to a virtual SP in 1 study (50%, n = 2), and when attitude was evaluated, SPs were superior to a virtual SP in no study (0%, n = 2). No study evaluated patient outcomes in the comparison of an SP to another simulation methodology.

CONCLUSIONS

Studies show a weak indication that SP-based education is superior to other simulation methodologies in most contexts. However more rigorous studies with larger sample sizes, validated instruments, and effects on patient outcomes are needed to definitively determine the optimal method/modality for teaching communication to health care professionals.

A scoping review of emotions and related constructs in simulation-based education research articles

BACKGROUND

While acknowledgement of emotions' importance in simulation-based education is emerging, there are concerns regarding how education researchers understand the concept of emotions for them to deliberately incorporate emotionally charged scenarios into simulation-based education. This concern is highlighted especially in the context of medical education often lacking strong theoretical integration. To map out how current simulation-based education literature conceptualises emotion, we conducted a scoping review on how emotions and closely related constructs (e.g. stress, and emotional intelligence) are conceptualised in simulation-based education articles that feature medical students, residents, and fellows.

METHODS

The scoping review was based on articles published in the last decade identified through database searches (EMBASE and Medline) and hand-searched articles. Data extraction included the constructs featured in the articles, their definitions, instruments used, and the types of emotions captured. Only empirical articles were included (e.g. no review or opinion articles). Data were charted via descriptive analyses.

RESULTS

A total of 141 articles were reviewed. Stress was featured in 88 of the articles, while emotions and emotional intelligence were highlighted in 45 and 34 articles respectively. Conceptualisations of emotions lacked integration of theory. Measurements of emotions mostly relied on self-reports while stress was often measured via physiological and self-report measurements. Negative emotions such as anxiety were sometimes seen as interchangeable with the term stress. No inferences were made about specific emotions of participants from their emotional intelligence.

CONCLUSIONS

Our scoping review illustrates that learners in simulation-based education are most often anxious and fearful. However, this is partially due to medical education prioritising measuring negative emotions. Further theoretical integration when examining emotions and stress may help broaden the scope towards other kinds of emotions and better conceptualisations of their impact. We call for simulation education researchers to reflect on how they understand emotions, and whether their understanding may neglect any specific aspect of affective experiences their simulation participants may have.

Avatar led interventions in the Metaverse reveal that interpersonal effectiveness can be measured, predicted, and improved

Experiential learning has been known to be an engaging and effective modality for personal and professional development. The Metaverse provides ample opportunities for the creation of environments in which such experiential learning can occur. In this work, we introduce a novel interpersonal effectiveness improvement framework (ELAINE) that combines Artificial Intelligence and Virtual Reality to create a highly immersive and efficient learning experience using avatars. We present findings from a study that uses this framework to measure and improve the interpersonal effectiveness of individuals interacting with an avatar. Results reveal that individuals with deficits in their interpersonal effectiveness show a significant improvement (p < 0.02) after multiple interactions with an avatar. The results also reveal that individuals interact naturally with avatars within this framework, and exhibit similar behavioral traits as they would in the real world. We use this as a basis to analyze the underlying audio and video data streams of individuals during these interactions. We extract relevant features from these data and present a machine-learning based approach to predict interpersonal effectiveness during human-avatar conversation. We conclude by discussing the implications of these findings to build beneficial applications for the real world.

A scoping review: virtual patients for communication skills in medical undergraduates

BACKGROUND

Communication is an essential competence for medical students. Virtual patients (VP), computerized educational tools where users take the role of doctor, are increasingly used. Despite the wide range of VP utilization, evidence-based practical guidance on supporting development of communication skills for medical students remains unclear. We focused this scoping review on VP affordance for student learning especially important in the current environment of constrained patient access.

METHODS

This scoping review followed Arksey & O'Malley's methodology. We tested and used a search strategy involving six databases, resulting in 5,262 citations. Two reviewers independently screened titles, full texts (n= 158) and finally performed data extraction on fifty-five included articles. To support consideration of educational affordance the authors employed a pragmatic framework (derived from activity theory) to map included studies on VP structure, curricular alignment, mediation of VP activity, and socio-cultural context.

RESULTS

Findings suggest that not only the VP itself, but also its contextualization and associated curricular activities influence outcomes. The VP was trialled in the highest proportion of papers as a one-off intervention (19 studies), for an average duration of 44.9 minutes (range 10-120min), mainly in senior medical students (n=23), notably the largest group of studies did not have VP activities with explicit curricular integration (47%). There was relatively little repeated practice, low levels of feedback, self-reflection, and assessment. Students viewed VPs overall, citing authenticity and ease of use as important features. Resource implications are often omitted, and costings would facilitate a more complete understanding of implications of VP use.

CONCLUSION

Students should be provided with maximal opportunity to draw out the VPs' full potential through repeated practice, without time-constraint and with curricular alignment. Feedback delivery enabling reflection and mastery is also key. The authors recommend educators to explicitly balance computerized authenticity with instructional design integrated within the curriculum.

Outcomes, Measurement Instruments, and Their Validity Evidence in Randomized Controlled Trials on Virtual, Augmented, and Mixed Reality in Undergraduate Medical Education: Systematic Mapping Review

BACKGROUND

Extended reality, which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR), is increasingly used in medical education. Studies assessing the effectiveness of these new educational modalities should measure relevant outcomes using outcome measurement tools with validity evidence.

OBJECTIVE

Our aim is to determine the choice of outcomes, measurement instruments, and the use of measurement instruments with validity evidence in randomized controlled trials (RCTs) on the effectiveness of VR, AR, and MR in medical student education.

METHODS

We conducted a systematic mapping review. We searched 7 major bibliographic databases from January 1990 to April 2020, and 2 reviewers screened the citations and extracted data independently from the included studies. We report our findings in line with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

Of the 126 retrieved RCTs, 115 (91.3%) were on VR and 11 (8.7%) were on AR. No RCT on MR in medical student education was found. Of the 115 studies on VR, 64 (55.6%) were on VR simulators, 30 (26.1%) on screen-based VR, 9 (7.8%) on VR patient simulations, and 12 (10.4%) on VR serious games. Most studies reported only a single outcome and immediate postintervention assessment data. Skills outcome was the most common outcome reported in studies on VR simulators (97%), VR patient simulations (100%), and AR (73%). Knowledge was the most common outcome reported in studies on screen-based VR (80%) and VR serious games (58%). Less common outcomes included participants' attitudes, satisfaction, cognitive or mental load, learning efficacy, engagement or self-efficacy beliefs, emotional state, competency developed, and patient outcomes. At least one form of validity evidence was found in approximately half of the studies on VR simulators (55%), VR patient simulations (56%), VR serious games (58%), and AR (55%) and in a quarter of the studies on screen-based VR (27%). Most studies used assessment methods that were implemented in a nondigital format, such as paper-based written exercises or in-person assessments where examiners observed performance (72%).

CONCLUSIONS

RCTs on VR and AR in medical education report a restricted range of outcomes, mostly skills and knowledge. The studies largely report immediate postintervention outcome data and use assessment methods that are in a nondigital format. Future RCTs should include a broader set of outcomes, report on the validity evidence of the measurement instruments used, and explore the use of assessments that are implemented digitally.

Decision making at extreme prematurity: Innovation in clinician education

Decision-making at extreme prematurity remains ethically and practically challenging and can result in parental and clinician distress. It is vital that clinicians learn the necessary skills integral to counseling and decision-making with families in these situations. A pedagogical approach to teaching counseling should incorporate adult learning theory, emphasize multidisciplinary team in-situ simulation that links to counseling clinicians' daily practice, and includes critical reflection, debriefing, and program assessment. Multiple educational strategies that train clinicians in advanced communication and decision-making offer promising results to optimize antenatal counseling and shared decision-making for families facing possible delivery at extreme prematurity. Continued process evaluation and innovation in these educational domains are needed while also assessing the effect on patient-centered outcomes.

Virtual Simulation in Undergraduate Medical Education: A Scoping Review of Recent Practice

Virtual simulation (VS) as an emerging interactive pedagogical strategy has been paid more and more attentions in the undergraduate medical education. Because of the fast development of modern computer simulation technologies, more and more advanced and emerging VS-based instructional practices are constantly increasing to promote medical education in diverse forms. In order to describe an overview of the current trends in VS-based medical teaching and learning, this scoping review presented a worldwide analysis of 92 recently published articles of VS in the undergraduate medical teaching and learning. The results indicated that 98% of included articles were from Europe, North America, and Asia, suggesting a possible inequity in digital medical education. Half (52%) studies reported the immersive virtual reality (VR) application. Evidence for educational effectiveness of VS in medical students’ knowledge or skills was sufficient as per Kirkpatrick’s model of outcome evaluation. Recently, VS has been widely integrated in surgical procedural training, emergency and pediatric emergency medicine training, teaching of basic medical sciences, medical radiation and imaging, puncture or catheterization training, interprofessional medical education, and other case-based learning experiences. Some challenges, such as accessibility of VS instructional resources, lack of infrastructure, “decoupling” users from reality, as well as how to increase students’ motivation and engagement, should be addressed.

Learning Outcomes of Immersive Technologies in Health Care Student Education: Systematic Review of the Literature

BACKGROUND

There is a lack of evidence in the literature regarding the learning outcomes of immersive technologies as educational tools for teaching university-level health care students.

OBJECTIVE

The aim of this review is to assess the learning outcomes of immersive technologies compared with traditional learning modalities with regard to knowledge and the participants' learning experience in medical, midwifery, and nursing preclinical university education.

METHODS

A systematic review was conducted according to the Cochrane Collaboration guidelines. Randomized controlled trials comparing traditional learning methods with virtual, augmented, or mixed reality for the education of medicine, nursing, or midwifery students were evaluated. The identified studies were screened by 2 authors independently. Disagreements were discussed with a third reviewer. The quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). The review protocol was registered with PROSPERO (International Prospective Register of Systematic Reviews) in April 2020.

RESULTS

Of 15,627 studies, 29 (0.19%) randomized controlled trials (N=2722 students) were included and evaluated using the MERSQI tool. Knowledge gain was found to be equal when immersive technologies were compared with traditional learning modalities; however, the learning experience increased with immersive technologies. The mean MERSQI score was 12.64 (SD 1.6), the median was 12.50, and the mode was 13.50. Immersive technology was predominantly used to teach clinical skills (15/29, 52%), and virtual reality (22/29, 76%) was the most commonly used form of immersive technology. Knowledge was the primary outcome in 97% (28/29) of studies. Approximately 66% (19/29) of studies used validated instruments and scales to assess secondary learning outcomes, including satisfaction, self-efficacy, engagement, and perceptions of the learning experience. Of the 29 studies, 19 (66%) included medical students (1706/2722, 62.67%), 8 (28%) included nursing students (727/2722, 26.71%), and 2 (7%) included both medical and nursing students (289/2722, 10.62%). There were no studies involving midwifery students. The studies were based on the following disciplines: anatomy, basic clinical skills and history-taking skills, neurology, respiratory medicine, acute medicine, dermatology, communication skills, internal medicine, and emergency medicine.

CONCLUSIONS

Virtual, augmented, and mixed reality play an important role in the education of preclinical medical and nursing university students. When compared with traditional educational modalities, the learning gain is equal with immersive technologies. Learning outcomes such as student satisfaction, self-efficacy, and engagement all increase with the use of immersive technology, suggesting that it is an optimal tool for education.

The use of simulation in medical student education on the topic of breaking bad news: A systematic review

BACKGROUND

Simulated patients (SPs) are widely used, but the most effective way of utilising them in undergraduate breaking bad news (BBN) medical education is unknown.

OBJECTIVES

To conduct a systematic review into SP's use in developing BBN skills in medical students.

METHODS

14 databases searched with the terms "Medical education", "Patient simulation", "Bad news". Data was systematically extracted, and thematic analysis undertaken.

RESULTS

Of 2117 articles screened, 29 publications met the inclusion criteria. These demonstrated a variety of SP models, including actors as patients (65.5%), peers (7.0%), and cancer survivors (3.5%). with delivery at varying times in the curricula. SPs are uniformly reported as having positive impact, but there is a lack of high-quality evidence comparing the use of differing forms of training. There was some evidence that virtual SPs were as useful as in-person SPs.

CONCLUSIONS

SPs allow students to practise vital BBN communication skills without risking detriment to patient care. Despite the heterogeneity of ways in which SPs have been used, the benefits of different approaches and when and how these should be delivered remains unclear.

PRACTICE IMPLICATIONS

Further educational development and research is needed about the use of SPs to support undergraduate BBN communication skills development.

Virtual Standardized Patients for Mental Health Education

PURPOSE OF REVIEW

The training of psychiatrists and other mental health professionals requires education on a range of interpersonal, communication, and psychotherapy techniques. Classroom and workshop training must be augmented by experiential learning with feedback for skill implementation with fidelity. Virtual standardized patients (VSPs) are computerized conversational agents that can support experiential learning through standardized, consequence-free training environments at reduced costs.

RECENT FINDINGS

Research on mental health VSPs is rife with feasibility and acceptability pilot studies across various training populations and settings. Users have generally reported positive reactions to training with VSPs, though frustrations with some VSP speech recognition or VSP response relevance has been reported. Several studies have demonstrated a promising transfer of clinical skills from VSP training to human standardized patients and randomized trials supporting improved skill relative to reading or academic study are encouraging. As technology improves and natural language processing and accurate computer response generation for broad ranging conversational topics emerges, the field would benefit from research on the characteristics of effective VSPs for a range of purposes and trainee populations. Well-designed randomized evaluations of VSPs relative to best practices in education are needed, particularly regarding the impact of VSPs on clinical practice among actual patients.

"I FELT THE CONNECTION": A QUALITATIVE EXPLORATION OF STANDARDIZED PATIENTS' EXPERIENCES IN A DELIVERING BAD NEWS SCENARIO

Background

Little research has examined standardized patient experiences in stressful simulation scenarios.

Methods

Qualitative, secondary data analysis.

Results

Emergent themes included: "Those kinds of things are important": The incorporation of personal experiences enhances communication accommodation experiential learning; "She was trying to buffer the bad news": How SPs recognize and address problematic divergent behaviors; and "The emotions come up": Interactions with excellent communication accommodation behaviors can lead to SP emotional and physical distress.

Conclusion

Standardized patient expertise enhances scenario realism and communication skills evaluation. To minimize distress, simulation educators should tailor safety measures specifically for the individual standardized patient and the scenario.

Virtual exams: has COVID-19 provided the impetus to change assessment methods in medicine?

AIMS

The ongoing COVID-19 pandemic has disrupted and delayed medical and surgical examinations where attendance is required in person. Our article aims to outline the validity of online assessment, the range of benefits to both candidate and assessor, and the challenges to its implementation. In addition, we propose pragmatic suggestions for its introduction into medical assessment.

METHODS

We reviewed the literature concerning the present status of online medical and surgical assessment to establish the perceived benefits, limitations, and potential problems with this method of assessment.

RESULTS

Global experience with online, remote virtual examination has been largely successful with many benefits conferred to the trainee, and both an economic and logistical advantage conferred to the assessor or organization. Advances in online examination software and remote proctoring are overcoming practical caveats including candidate authentication, cheating prevention, cybersecurity, and IT failure.

CONCLUSION

Virtual assessment provides benefits to both trainee and assessor in medical and surgical examinations and may also result in cost savings. Virtual assessment is likely to be increasingly used in the post-COVID world and we present recommendations for the continued adoption of virtual examination. It is, however, currently unable to completely replace clinical assessment of trainees. Cite this article: Bone Jt Open 2021;2(2):111-118.