Skepticism towards advancing VR technology - student acceptance of VR as a teaching and assessment tool in medicine

Objective: The high didactic potential of Virtual Reality (VR) contrasts with the point of view of students that the technology only has a relatively low significance for current and future teaching. This discrepancy was studied in a differentiated manner in order to gear the further development and implementation of VR towards the target group. Methods: From January 2020 to July 2020, medical students (N=318) were asked to watch ten videos online and rate them on the basis of acceptance indicators (e.g., fun and fairness). Using obstetrics as an example, the videos demonstrated five levels of VR technology functionality (e.g., haptic and adaptive feedback), some of which were visionary, in two use scenarios (teaching and the OSCE). The individual and aggregate indicators were compared with non-parametric testing procedures across application scenarios, functional levels and genders. In addition, correlations between the acceptance and the factors of semester, age, computer affinity, and previous VR experience were analyzed. Results: Across all functional levels, VR was more likely to be accepted in the classroom than in the OSCE. Comparisons across functional levels also revealed that the VR ready to be marketed was significantly more accepted than the visionary functions. This skepticism toward advancing VR technology was most pronounced with regard to the vision of autonomous VR examinations and among female students with a low computer affinity. Conclusion: The results suggest that the students' reservations are due to a lack of experience with the VR technology. In order for young physicians to become familiar with the technology and to be able to use it competently in the everyday clinical practice in the future, VR should not only be used as a teaching tool but also be part of the curriculum. Practical examinations using VR, on the other hand, are only recommended once the technology has become established in teaching and has been proven to be reliable.

Virtual Standardized Patients for Mental Health Education

PURPOSE OF REVIEW

The training of psychiatrists and other mental health professionals requires education on a range of interpersonal, communication, and psychotherapy techniques. Classroom and workshop training must be augmented by experiential learning with feedback for skill implementation with fidelity. Virtual standardized patients (VSPs) are computerized conversational agents that can support experiential learning through standardized, consequence-free training environments at reduced costs.

RECENT FINDINGS

Research on mental health VSPs is rife with feasibility and acceptability pilot studies across various training populations and settings. Users have generally reported positive reactions to training with VSPs, though frustrations with some VSP speech recognition or VSP response relevance has been reported. Several studies have demonstrated a promising transfer of clinical skills from VSP training to human standardized patients and randomized trials supporting improved skill relative to reading or academic study are encouraging. As technology improves and natural language processing and accurate computer response generation for broad ranging conversational topics emerges, the field would benefit from research on the characteristics of effective VSPs for a range of purposes and trainee populations. Well-designed randomized evaluations of VSPs relative to best practices in education are needed, particularly regarding the impact of VSPs on clinical practice among actual patients.

A Virtual Standardized Patient-Based Assessment Tool to Evaluate Psychiatric Residents' Psychopharmacology Proficiency

OBJECTIVES

A virtual standardized patient-based assessment simulator was developed to address biases and practical limitations in existing methods for evaluating residents' proficiency in psychopharmacological knowledge and practice.

METHODS

The simulator was designed to replicate an outpatient psychiatric clinic experience. The virtual patient reported symptoms of a treatment-resistant form of major depressive disorder (MDD), requiring the learner to use various antidepressants in order for the patient to fully remit. Test scores were based on the proportion of correct responses to questions asked by the virtual patient about possible side effects, dosing, and titration decisions, which depended upon the patient's tolerability and response to the learner's selected medications. The validation paradigm included a novice-expert performance comparison across 4th year medical students, psychiatric residents from all four post-graduate year classes, and psychiatry department faculty, and a correlational analysis of simulator performance with the PRITE Somatic Treatments subscale score. Post-test surveys evaluated the test takers' subjective impressions of the simulator.

RESULTS

Forty-three subjects completed the online exam and survey. Total mean scores on the exam differed significantly across all the learner groups in a step-wise manner from students to faculty (F = 6.10, p = 0.0001). Total mean scores by residency class correlated with PRITE Somatic Therapies subscale scores (p < 0.01). The post-test survey mean Likert results ranged from 3.33 ± 1.20 to 4.4 ± 0.79, indicating neutral to favorable responses for use of the simulator.

CONCLUSIONS

This simulator demonstrated strong construct validity and high participant acceptability for assessing proficiency in the psychopharmacologic treatment of MDD.