The same video game in 2D, 3D or virtual reality - How does technology impact game evaluation and brand placements?

Updating the Foodbot Factory serious game with new interactive engaging features and enhanced educational content

Serious games (i.e., digital games designed for educational purposes) can foster positive learning attitudes and are increasingly used as educational tools. Foodbot Factory is a serious game application (app) that helps children learn about healthy eating based on Canada's Food Guide principles and has demonstrated to increase nutrition knowledge among this group. This paper describes the process followed to expand Foodbot Factory's educational content and integrate immersive technologies and innovative features into the app. The revision process, which was guided by the Obesity-Related Behavioral Intervention Trials model, included the following phases: first, an interdisciplinary team of nutrition scientists, education experts, and computer scientists analyzed data from the original pilot study, recently published literature, and feedback from stakeholders to define areas to improve Foodbot Factory. The five original Foodbot Factory modules were evaluated by the team during weekly meetings, where the educational content, interactive features, and other elements that required updates (e.g., aesthetics and accessibility) were identified. Second, prototypes were created and refined until a final version of Foodbot Factory was approved. Nineteen children tested the updated Foodbot Factory and found it "easy to use" (89%) and "fun" (95%). The new version of Foodbot Factory contains 19 learning objectives, including 13 original and six new objectives. Interactive engagement features in the updated Foodbot Factory included augmented reality incorporated into two learning modules; new mini-games were created, including a memory game; an overhaul of the aesthetics; (e.g., new food images); and accessibility features were included to support users with cognitive and vision disabilities.

A modularity design approach to behavioral research with immersive virtual reality: A SkyrimVR-based behavioral experimental framework

Virtual reality (VR) has been shown to be a potential research tool, yet the gap between traditional and VR behavioral experiment systems poses a challenge for many behavioral researchers. To address the challenge posed, the present study first adopted a modularity design strategy and proposed a five-module architectural framework for a VR behavioral experiment system that aimed to reduce complexity and costs of development. Applying the five-module architectural framework, the present study developed the SkyrimVR-based behavioral experimental framework (SkyBXF) module, a basic experimental framework module that adopted and integrated the classic human behavior experiment structure (i.e., session-block-trial model) with the modifiable VR massive gaming franchise The Elder Scrolls V: Skyrim VR. A modified version of previous behavioral research to investigate the effects of masked peripheral vision on visually-induced motion sickness in an immersive virtual environment was conducted as a proof of concept to showcase the feasibility of the proposed five-module architectural framework and the SkyBXF module developed. Behavioral data acquired through the case study were consistent with those from previous behavioral research. This indicates the viability of the proposed five-module architectural framework and the SkyBXF module developed, and provides proof that future behavioral researchers with minimal programming proficiency, 3D environment development expertise, time, personnel, and resources may reuse ready-to-go resources and behavioral experiment templates offered by SkyBXF to swiftly establish realistic virtual worlds that can be further customized for experimental need on the go.

Artificial intelligence for video game visualization, advancements, benefits and challenges

In recent years, the field of artificial intelligence (AI) has witnessed remarkable progress and its applications have extended to the realm of video games. The incorporation of AI in video games enhances visual experiences, optimizes gameplay and fosters more realistic and immersive environments. In this review paper, we systematically explore the diverse applications of AI in video game visualization, encompassing machine learning algorithms for character animation, terrain generation and lighting effects following the PRISMA guidelines as our review methodology. Furthermore, we discuss the benefits, challenges and ethical implications associated with AI in video game visualization as well as the potential future trends. We anticipate that the future of AI in video gaming will feature increasingly sophisticated and realistic AI models, heightened utilization of machine learning and greater integration with other emerging technologies leading to more engaging and personalized gaming experiences.

Effectiveness of virtual reality-based programs as vestibular rehabilitative therapy in peripheral vestibular dysfunction: a meta-analysis

PURPOSE

To study the efficacy of virtual reality (VR) interventional programs as a vestibular rehabilitative method for patients with uncompensated peripheral vestibular disorders.

METHODS

The databases PubMed, Google scholar, Embase and Cochrane Library were used (up to July 2021). Studies selected in this study were controlled trials in which virtual reality was used as vestibular rehabilitative therapy in comparison to any other vestibular rehabilitative methods or medical or dietary recommendations. Comparison was made in at least one of these outcomes measures; Subjective measures such as Dizziness Handicap Inventory, Vertigo Symptom Scale-Short Form questionnaire, Activities-specific Balance Confidence questionnaire, Dizziness Analogue Scale or Visual Analogue Scale, besides objective measures as posturography. Six articles were included in the meta-analysis; tested for heterogeneity of the estimates using chi-squared and I2 tests, outcomes were expressed as mean difference and 95% CI. Estimates from included studies were pooled using the random-effect model.

RESULTS

virtual reality as a vestibular rehabilitative intervention was able to improve scores of Dizziness Handicap Inventory, Vertigo Symptom Scale-Short Form questionnaire, Visual Analogue sale and posturography as outcome measures of vestibular rehabilitation.

CONCLUSION

virtual reality has a potential clinical benefit for vestibular rehabilitation in peripheral vestibular dysfunction compared with conventional vestibular rehabilitation methods. However, further research is needed to document the exact parameters of an optimal protocol for virtual reality rehabilitation, the period needed for effective rehabilitation and its side effects.

Investigating how immersive virtual reality and active navigation mediate the experience of virtual concerts

We conducted an experiment to examine how virtual reality (VR) and active navigation interact to improve audience experience in virtual concerts. To manipulate the medium, the participants were presented with concert-related audiovisual stimuli via a head-mounted VR device or a computer. To manipulate the participants' access to different perspectives (navigation mode), they were allowed to actively switch, or were passively guided, between the audience's perspective and the performer's perspective. According to the results, VR and active navigation induced a higher sense of presence (feeling of being somewhere else) than did computer and passive navigation, and thus, they increased the audience's state of flow and gave them higher degrees of satisfaction and concert-attending intention. VR and active navigation also increased the participants' role identification (feeling of being someone else), which again gave them higher degrees of satisfaction and concert-attending intention. This research contributes to the literature supporting VR's enhancement of concert experiences and further highlights the important relationship between action, perception, and experience satisfaction.

Virtual reality against Zoom fatigue? A field study on the teaching and learning experience in interactive video and VR conferencing

Aim

During the COVID-19 pandemic, the absence of in-person teaching was partially compensated for through videoconferencing. However, lecturers complain that students do not participate actively in video-based online seminars. One reason cited for this is Zoom fatigue. Conferences in virtual reality (VR), accessible with and without head-mounted display, represent one potential remedy to this issue. The research to date does not shed any light on the (1.) teaching experience, (2.) student demand, (3.) learning experience (including participation and social presence), and (4.) learning performance (declarative and spatial) associated with VR conferences. The present work will compare these aspects for videoconferencing, independent study, and - in the case of teaching experience - with in-person teaching.

Methods

A compulsory seminar in General Physiology was offered during the 2020/21 winter semester and the 2021 summer semester as part of the Human Medicine program at the Faculty of Medicine at Ulm University. The seminars were offered in three different formats with identical content: (a) VR conference, (b) video conference, and (c) independent study, with students selecting the format of their choice. In the VR conferences, the lecturer taught using a head-mounted display while students participated via PC, laptop, or tablet. The learning experience and learning performance were assessed using questionnaires and a knowledge test. A semi-structured interview was conducted to assess the VR teaching experience.

Results

The lecturer's teaching experience in the VR conferences was similar to in-person teaching. Students predominantly chose independent study and videoconferencing. The latter resulted in worse outcomes with regard to learning experience (including participation and social presence) and spatial learning performance than the VR conferences. Declarative learning performance differed only slightly between teaching formats.

Conclusions

VR conferencing offers lecturers new didactic opportunities and a teaching experience similar to that of in-person teaching. Students prefer time-efficient videoconferencing and independent study, but rate participation and social presence, among other things, higher in VR conferencing. If faculty and students are open to the technology, VR conferencing can promote interactive exchange in online seminars. This subjective assessment is not associated with better declarative learning performance.

Virtual reality assessment of walking in a modifiable urban environment: a feasibility and acceptability study

Physical activity is known to be one of the most health-beneficial behaviors, and salutogenic design modifications to the built environment can facilitate increased physical activity. Unfortunately, it is not often clear in advance which environmental and urban design implementations will generate increases in activities such as walking, and which will have little impact or even reduce walking. The present study tested the feasibility and acceptability of a virtual reality (VR) model for pre-testing urban designs for their impact on walking. Using a wearable VR head-mounted display/computer, young adults (n = 40) walked freely through a large indoor gymnasium, simultaneously walking through a virtual model of an urban streetscape that was designed to be modifiable and allow for testing impacts on walking of various changes to the urban environment. The majority of participants found the experience to be acceptable: pleasant and nonaversive, and they walked freely through the VR model for approximately 20 min, on average. Using modifiable VR models to pre-test built-environment changes for their impacts on walking behavior appears to be a feasible and acceptable approach and worthy of continued research investigation.

Presence in video games: A systematic review and meta-analysis of the effects of game design choices

Sense of presence is a widely assessed dimension of video game player experience. A systematic literature review and a meta-analysis were conducted to provide a more comprehensive view of the elements of game design that have an effect on the sense of presence, as well as its different dimensions studied and assessment techniques. The review revealed that many major categories of game design aspects were well represented. The meta-analysis revealed that several game design factors have significant effects on different dimensions of presence. The largest revealed effects were that playing games with a head-mounted display and motion controller rather than a monitor display and non-motion controller has a large effect on global presence. Also, playing with human co-players rather than computer-controlled co-players and playing cooperatively rather than competitively have a very large and large effect on social presence, respectively. Implications for future research are discussed, such as investigating the effects of design factors on presence in a more targeted manner, systematically assessing presence with its most relevant sub-dimensions, and using more similar rating scales. Design recommendations, with their expected impact on players' sense of presence, are proposed.

Awareness of and interaction with physician rating websites: A cross-sectional study in Austria

To date, the digital assessment of service experiences represents a decisive process step of a feedback culture in numerous economic areas. In view of this digitalization of service assessments, the importance of Physician Rating Websites (PRWs) has also increased steadily in recent years. Even though these websites could be perceived as a powerful communication tool for the exchange of health specific information, the knowledge about whether and how different population segments use these portals has been limited so far. For this reason, our aim was to investigate the level of awareness regarding PRWs among the study population and to discover how users interact with this specific type of online portals. We performed an online survey including 558 participants. To ensure the attention and integrity of participants, attention checks were included in the questionnaire. Study participants who did not exceed the mentioned security levels were excluded from the study. Statistical analyses were carried out, using IBM SPSS Statistics 27. To illustrate the relationship between demographic variables and dependent variables, two tailed chi square tests were performed. Comparison of means and t-testing was used to investigate the relationship between psychographic variables and the dependent variables. In addition to that, the awareness levels regarding different rating portals were evaluated using descriptive methods. Our results suggest that the general awareness regarding PRWs is relatively high (75.6%, 423/558), especially among female (x21 = 9.880, P = .002), middle-aged (x29 = 26.810, P = .002), more highly educated (x24 = 19.038, P = .001), urban (x21 = 6.274, P = .012), digitally literate (t203 = 2.63, P = .009) individuals and particularly among respondents with a higher eHealth literacy (t203 = 2.37, P = .019). Even though more than three quarters of the respondents know that PRWs exist, compared to other rating platforms, they are only in the lower midfield. The upper ranks are taken by websites on which restaurant visits (98.9%, 552/558), hotel stays (97.7%, 545/558) or movies (95.5%, 533/558) can be rated. The most popular PRWs in Austria include Docfinder.at (31.3%, 175/558; 77.8%, 434/558) followed by the evaluation tools provided by Google.at (8.24%, 46/558; 70.3%, 392/558) and Herold.at (1.61%, 9/558; 44.8%, 250/558). In Austria, PRWs seem to be characterized by a high degree of interaction (89.2%, 498/558) with a wide variety of different types of interactions. While many respondents use PRWs to retrieve general information (83.2%, 464/558), there are significantly fewer who read physicians' reviews (60.9%, 340/558) and use this portal to select a physician (60.6%, 338/558). Respondents who have already rated a doctor themselves belong to the smallest group accounting for just 14.7% (82/558). Significant effects regarding the interaction with PRWs exist between different genders, ages, education levels, marital statuses, occupations and areas of living. In addition to that, respondents with better feelings towards the internet, greater digital literacy as well as a higher eHealth literacy were also characterized with a higher interaction rate regarding PRWs. According to the high level of awareness of and interaction with PRWs within our study population, PRWs appear to be a successful medium for health-related communication. Especially for female, middle-aged, more highly educated, urban and more technology savvy population segments, PRWs seem to represent an effective tool to support the health-specific decision-making process.

Immersion Therapy with Head-Mounted Display for Rehabilitation of the Upper Limb after Stroke-Review

Immersive virtual therapy technology is a new method that uses head-mounted displays for rehabilitation purposes. It offers a realistic experience that puts the user in a virtual reality. This new type of therapy is used in the rehabilitation of stroke patients. Many patients after this disease have complications related to the upper extremities that limit independence in their everyday life, which affects the functioning of society. Conventional neurological rehabilitation can be supplemented by the use of immersive virtual therapy. The system allows patients with upper limb dysfunction to perform a motor and task-oriented training in virtual reality that is individually tailored to their performance. The complete immersion therapy itself is researched and evaluated by medical teams to determine the suitability for rehabilitation of the upper limb after a stroke. The purpose of this article is to provide an overview of the latest research (2019-2022) on immersive virtual reality with head-mounted displays using in rehabilitation of the upper extremities of stroke patients.

Combining physical and virtual worlds for motor-cognitive training interventions: Position paper with guidelines on technology classification in movement-related research

Efficient movements require intact motor and cognitive function. There is a growing literature on motor-cognitive interventions to improve the overall quality of life of healthy or diseased older people. For such interventions, novel technological advances are crucial not only in terms of motivation but also to improve the user experience in a multi-stimuli world, usually offered as a mixture of real and virtual environments. This article provides a classification system for movement-related research dealing with motor-cognitive interventions performed in different extents of a virtual environment. The classification is divided into three categories: (a) type of digital device with the associated degree of immersiveness provided; (b) presence or absence of a human-computer interaction; and (c) activity engagement during training, defined by activity >1.5 Metabolic Equivalent of task. Since virtual reality (VR) often categorizes different technologies under the same term, we propose a taxonomy of digital devices ranging from computer monitors and projectors to head-mounted VR technology. All immersive technologies that have developed rapidly in recent years are grouped under the umbrella term Extended Reality (XR). These include augmented reality (AR), mixed reality (MR), and VR, as well as all technologies that have yet to be developed. This technology has potential not only for gaming and entertainment, but also for research, motor-cognitive training programs, rehabilitation, telemedicine, etc. This position paper provides definitions, recommendations, and guidelines for future movement-related interventions based on digital devices, human-computer interactions, and physical engagement to use terms more consistently and contribute to a clearer understanding of their implications.

The (In)effectiveness of Attention Guidance Methods for Enhancing Brand Memory in 360° Video

Sensing and remembering features in visual scenes are conditioned by visual attention and methods to guide it. This should be relevant in terms of product placement, which has become an important part of incorporating brands into different mass media formats with a commercial purpose. The approach can be challenging in 360° video, where an omnidirectional view enables consumers to choose different viewing perspectives, which may result in overlooking the brands. Accordingly, attention guidance methods should be applied. This study is the first to explore diegetic guidance methods as the only appropriate guiding method for an unobtrusive and unconscious nature of product placement. To test the effectiveness of three different diegetic guiding methods, a between-subject design was employed, where the participants were assigned randomly to one of four videos with the same scene but different guiding methods. The findings show and explain the discrepancy with studies on guiding attention in other contexts, as there were no significant differences between the guiding cues according to brand recall and brand recognition. The results also indicate a significant influence of brand familiarity on brand recall in 360° video. The article concludes by providing limitations, future research directions, and recommendations for audiovisual policy.

EEG-based analysis of various sensory stimulation effects to reduce visually induced motion sickness in virtual reality

The use of virtual reality (VR) is frequently accompanied by motion sickness, and approaches for preventing it are not yet well established. We explored the effects of synchronized presentations of sound and motion on visually induced motion sickness (VIMS) in order to reduce VIMS. A total of 25 participants bicycle riding for 5 min with or without sound and motion synchronization presented on a head-mounted display. As a result, the VIMS scores measured by the fast motion sickness scale and simulator sickness questionnaire were significantly lower in the participants who experienced the riding scene with sound and motion than those who experienced the riding scene with sound only, motion only, or neither. Furthermore, analysis of the EEG signal showed that the higher the VIMS, the significant increase in alpha and theta waves in the parietal and occipital lobes. Therefore, we demonstrate that the simultaneous presentation of sound and motion, closely associated with synchronous and visual flow speed, is effective in reducing VIMS while experiencing simulated bicycle riding in a VR environment.

The influence of a virtual reality entertainment program on depressive symptoms and sedentary behaviour in inpatient stroke survivors: a research protocol for a pilot randomized controlled trial

Background

Sedentary behaviour among stroke inpatients may be due to high rates of depressive symptoms after stroke. Thus, efforts to address depressive symptoms among stroke inpatients are warranted to in turn lessen sedentary behaviour. Despite evidence that virtual reality (VR) is emerging as a method to help with depression, the use of VR to improve depression among inpatient stroke survivors has yet to be studied. In this paper, we report on the protocol investigating the feasibility of a VR entertainment system at improving depressive symptoms among stroke survivors receiving inpatient rehabilitation.

Methods

In this single-blind randomized controlled trial, 30 inpatient stroke survivors from the rehabilitation unit at Kelowna General Hospital will be randomized to either (1) intervention: 3 times per week of VR entertainment for duration of inpatient rehabilitation or (2) control: usual care. Individuals will be included if they have a confirmed diagnosis of stroke, are 19 years of age or older, able to provide informed consent, have physician clearance to participate in the study (medically stable or fit), or are able to understand English. Outcome measures to address depressive symptoms (primary outcome), sedentary behaviour, motivation, anxiety, stress, and happiness (secondary outcome) will be administered at two timepoints: (1) baseline (T1) and (2) post-intervention (T2). Study analyses will consider study feasibility indicators and clinical (statistical) outcomes. Means and standard deviations (for continuous variables) and frequencies and proportions (for categorical variables) will be used to summarize the variables. Feasibility indicators will be dichotomized into either ‘success’ if they meet the a priori criteria, or ‘revise’ if they do not meet the criteria. Intervention effects post-intervention (T2) for the primary and secondary clinical outcomes will be estimated using linear regression including baseline (T1) controlling for age and sex.

Discussion

The results of this trial will add to our understanding of depression and sedentary behaviour among individuals receiving inpatient stroke rehabilitation as well as the feasibility of a VR entertainment program to improve depressive symptoms, which will in turn may lessen sedentary behaviour in inpatient stroke survivors.

Trial registration

ClinicalTrials.gov Identifier: NCT04011202 . First posted July 8, 2019 (study postponed from March 2020 to July 2021 due to COVID-19).

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01189-8.

Fully Immersive Virtual Reality Game-Based Training for an Adolescent with Spastic Diplegic Cerebral Palsy: A Case Report

BACKGROUND

Recently, virtual reality-based training (VR-based training) is receiving attention as greater emphasis is placed on the importance of interest and motivation in participation. However, studies investigating the effects of fully immersive VR-based training are insufficient.

CASE PRESENTATION

We report a case of using a fully immersive VR game-based training in a patient with cerebral palsy. A 15-year-old girl was diagnosed with spastic diplegia cerebral palsy Gross Motor Function Classification System level II. A six-week intervention (18 sessions) phase was performed with one fully immersive VR game using PlayStation^®VR in three sessions per week. After 18 sessions of training, the scores on the gross motor function measure-88 (Gross Motor Function Measure-88-GMFM-88), pediatric balance scale (PBS), timed up and go test (TUG), functional gait assessment (FGA), and 10 m walking test (10MWT) were improved: GMFM-88, 91.56 points (9.31 points increase); PBS, 45 points (6 points increase); TUG, 8.23 s (6.9 s decrease); FGA, 11 points (3 points increase); the 10 MWT, 5.27 s (6.59 s decrease).

CONCLUSIONS

This study found that a fully immersive VR game-based training using PlayStation^®VR may be an effective intervention for GMFCS level II adolescent, leading to some improvement of motor function, balance and gait skills in adolescents with cerebral palsy.

Experiencing an art education program through immersive virtual reality or iPad: Examining the mediating effects of sense of presence and extraneous cognitive load on enjoyment, attention, and retention

Sense of presence and extraneous cognitive load (ECL) are the two psychological effects widely employed to explain the cognitive outcomes caused by high-immersive media (e. g., virtual reality). This study identified the concepts of both technological affordance (i.e., immersion) and the psychological effects of VR learning. It investigated the mechanism by which immersion leads to better or worse communication in the context of art education. We operationalized the concept of immersion into two levels: a high-immersive VR system (HTC VIVE Cosmos) and a low-immersive tablet system (iPad). Through a between-subject experiment, we found that higher immersion not only led to a greater sense of presence but also lowered extraneous cognitive load. Enjoyment and attention increased as a sense of presence rose but were not necessarily predicted by extraneous cognitive load. This study found that sense of presence was a more robust explanatory variable than ECL and that cognitive load could be lower in a high-immersive environment with content specifically designed for VR.

An Exploratory EEG Analysis on the Effects of Virtual Reality in People with Neuropathic Pain Following Spinal Cord Injury

Neuropathic pain in people with spinal cord injury is thought to be due to altered central neuronal activity. A novel therapeutic intervention using virtual reality (VR) head-mounted devices was investigated in this study for pain relief. Given the potential links to neuronal activity, the aim of the current study was to determine whether use of VR was associated with corresponding changes in electroencephalography (EEG) patterns linked to the presence of neuropathic pain. Using a within-subject, randomised cross-over pilot trial, we compared EEG activity for three conditions: no task eyes open state, 2D screen task and 3D VR task. We found an increase in delta activity in frontal regions for 3D VR with a decrease in theta activity. There was also a consistent decrease in relative alpha band (8–12 Hz) and an increase in low gamma (30–45 Hz) power during 2D screen and 3D VR corresponding, with reduced self-reported pain. Using the nonlinear and non-oscillatory method of extracting fractal dimensions, we found increases in brain complexity during 2D screen and 3D VR. We successfully classified the 3D VR condition from 2D screen and eyes opened no task conditions with an overall accuracy of 80.3%. The findings in this study have implications for using VR applications as a therapeutic intervention for neuropathic pain in people with spinal cord injury.

A Perspective on Implementation of Technology-Driven Exergames for Adults as Telerehabilitation Services

A major concern of public health authorities is to also encourage adults to be exposed to enriched environments (sensory and cognitive-motor activity) during the pandemic lockdown, as was recently the case worldwide during the COVID-19 outbreak. Games for adults that require physical activity, known as exergames, offer opportunities here. In particular, the output of the gaming industry nowadays offers computer games with extended reality (XR) which combines real and virtual environments and refers to human-machine interactions generated by computers and wearable technologies. For example, playing the game in front of a computer screen while standing or walking on a force plate or treadmill allows the user to react to certain infrastructural changes and obstacles within the virtual environment. Recent developments, optimization, and minimizations in wearable technology have produced wireless headsets and sensors that allow for unrestricted whole-body movement. This makes the virtual experience more immersive and provides the opportunity for greater engagement than traditional exercise. Currently, XR serves as an umbrella term for current immersive technologies as well as future realities that enhance the experience with features that produce new controllable environments. Overall, these technology-enhanced exergames challenge the adult user and modify the experience by increasing sensory stimulation and creating an environment where virtual and real elements interact. As a therapy, exergames can potentially create new environments and visualizations that may be more ecologically valid and thus simulate real activities of daily living that can be trained. Furthermore, by adding telemedicine features to the exergame, progress over time can be closely monitored and feedback provided, offering future opportunities for cognitive-motor assessment. To more optimally serve and challenge adults both physically and cognitively over time in future lockdowns, there is a need to provide long-term remote training and feedback. Particularly related to activities of daily living that create opportunities for effective and lasting rehabilitation for elderly and sufferers from chronic non-communicable diseases (CNDs). The aim of the current review is to envision the remote training and monitoring of physical and cognitive aspects for adults with limited mobility (due to disability, disease, or age), through the implementation of concurrent telehealth and exergame features using XR and wireless sensor technologies.

User-Centered Virtual Environment for Post-Stroke Motor Rehabilitation

The use of Virtual Reality in the rehabilitation of lost or diminished functions after a stroke has been shown to be an innovative means in motor recovery. However, there are still several design challenges to increment the efficiency of these systems. This paper presents the development and evaluation of a non-immersive 3D virtual environment for post-stroke rehabilitation of elbow flexion-extension movements, which considers the therapist as a direct user and the patient as a secondary user. The development of virtual environment was supported by the criteria of a team of specialists in physical and occupational therapy, following the philosophy of User-Centered Design through three iterations, and incorporating tasks based on the Activities of Daily Living of the Barthel scale. Tests were carried out with healthy users and a patient with a diagnosis of stroke, using the SUS test and a flow status questionnaire respectively. Average satisfaction of user group without diagnosis was 79.6 out of 100 points. On the other hand, according to mean values observed with the patient, dimensions of control sense (6.33) and positive emotional experience (6.66) reflect an "optimal" experience, which indicates an enjoyment of virtual tasks de-spite the effort made to fulfill them.

Similarity of gaze patterns across physical and virtual versions of an installation artwork

An experiment was conducted to compare museum visitors' gaze patterns using mobile eye-trackers, whilst they were engaging with a physical and a virtual reality (VR) installation of Piet Mondrian's Neo-plasticist room design. Visitors' eye movements produced approximately 25,000 fixations and were analysed using linear mixed-effects models. Absolute and area-normalized dwell time analyses yielded mostly non-significant main effects of the environment, indicating similarity of visual exploration patterns between physical and VR settings. One major difference observed was the decrease of average fixation duration in VR, where visitors tended to more rapidly switch focus in this environment with shorter bursts of attentional focus. The experiment demonstrated the ability to compare gaze data between physical and virtual environments as a proxy to measure the similarity of aesthetic experience. Similarity of viewing patterns along with questionnaire results suggested that virtual galleries can be treated as ecologically valid environments that are parallel to physical art galleries.

IMVEST, an immersive multimodal virtual environment stress test for humans that adjusts challenge to individual's performance

Laboratory stressors are essential tools to study the human stress response. However, despite considerable progress in the development of stress induction procedures in recent years, the field is still missing standardization and the methods employed frequently require considerable personnel resources. Virtual reality (VR) offers flexible solutions to these problems, but available VR stress-induction tests still contain important sources of variation that challenge data interpretation. One of the major drawbacks is that tasks based on motivated performance do not adapt to individual abilities. Here, we provide open access to, and present, a novel and standardized immersive multimodal virtual environment stress test (IMVEST) in which participants are simultaneously exposed to mental -arithmetic calculations- and environmental challenges, along with intense visual and auditory stimulation. It contains critical elements of stress elicitation – perceived threat to physical self, social-evaluative threat and negative feedback, uncontrollability and unpredictability – and adjusts mathematical challenge to individual's ongoing performance. It is accompanied by a control VR scenario offering a comparable but not stressful situation. We validate and characterize the stress response to IMVEST in one-hundred-and-eighteen participants. Both cortisol and a wide range of autonomic nervous system (ANS) markers – extracted from the electrocardiogram, electrodermal activity and respiration – are significantly affected. We also show that ANS features can be used to train a stress prediction machine learning model that strongly discriminates between stress and control conditions, and indicates which aspects of IMVEST affect specific ANS components.

•

Laboratory stressors are an essential tool to study the stress response in humans.

•

We present a novel immersive multimodal virtual environment stress test (IMVEST).

•

IMVEST adapts to individual performance.

•

Induces acute increase in stress markers.

•

Stress responses do not depend on performance differences.

A Virtual Reality Game (The Secret Trail of Moon) for Treating Attention-Deficit/Hyperactivity Disorder: Development and Usability Study

Background

Attention-deficit/hyperactivity disorder (ADHD) affects between 4% and 8% of children worldwide. The treatment of choice is multimodal treatment. Multimodal interventions for ADHD may be improved by incorporating new treatments, such as treatment via serious video games. The Secret Trail of Moon (TSTM) is a virtual reality serious video game that was designed for cognitive training related to core ADHD symptoms and executive dysfunction.

Objective

We aimed to describe the development and usability of TSTM.

Methods

The usability study included 37 children and adolescents who tested TSTM during the early usability stage (preinclusion) of a randomized controlled clinical trial for testing the effectiveness of TSTM. Chi-square tests were performed to compare patients with ADHD (ADHD combined subtype vs inattentive subtype) and to compare frequent and infrequent video game players in the second study. We used SPSS version 20 for Macintosh (IBM Corporation).

Results

A total of 31/37 (86%) and 30/37 (83%) of participants liked playing TSTM and wanted to continue playing TSTM, respectively. Further, 5/37 (14%) of participants reported that they experienced either perceived dizziness or virtual reality motion sickness. We found no statistically significant differences after comparing the ADHD combined subtype to the inattentive subtype and frequent video game players to infrequent video game players.

Conclusions

Serious video games, such as TSTM, may complement the current multimodal approach for treating ADHD.

Trial Registration

ClinicalTrials.gov NCT04355065; https://clinicaltrials.gov/ct2/show/NCT04355065

Could virtual reality applications pose real risks to children and adolescents? A systematic review of ethical issues and concerns

Virtual reality technologies (VRTs) are high-tech human-computer interfaces used to develop digital content and can be applied to multiple different areas, often offering innovative solutions to existing problems. A wide range of digital games is being also developed with VRTs and together with their components, the games' structural elements are appealing to children and engaging them more in virtual worlds. Our research interest is directed towards children's development and the effects of VRTs within gaming environments. Contemporary psychology studies perceive human development as a holistic and lifelong process with important interrelationships between physical, mental, social and emotional aspects. For the objectives and scope of this work, we examine children development across three domains: physical, cognitive and psychosocial. In this context, the authors review the literature on the impact of VRTs on children, in terms of software and hardware. Since research requires an wide-ranging approach, we study the evidence reported on the brain and neural structure, knowledge, behaviour, pedagogy, academic performance, and wellness. Our main concern is to outline the emerging ethical issues and worries of parents, educators, ophthalmologists, neurologists, psychologists, paediatricians and all relevant scientists, as well as the industry's views and actions. The systematic review was performed on the databases Scopus, IEEE Xplore, PubMed, and Google Scholar from 2010 to 2020 and 85 studies were selected. The review concluded that findings remain contradictory especially for the psychosocial domain. Official recommendations from organizations and well-documented researches by academics on child well-being are reassuring if health and safety specifications and particularly the time limit are met. Research is still ongoing, constantly updated and consist of a priority for the scientific community given that technology evolves.

Immersion positively affects learning in virtual reality games compared to equally interactive 2d games

Purpose

This study isolates the effect of immersion on players’ learning in a virtual reality (VR)-based game about cellular biology by comparing two versions of the game with the same level of interactivityand different levels of immersion. The authors identify immersion and additional interactivity as two key affordances of VR as a learning tool. A number of research studies compare VR with two-dimensional or minimally interactive media; this study focuses on the effect of immersion as a result of the head mounted display (HMD).

Design/methodology/approach

In the game, players diagnose a cell by exploring a virtual cell and search for clues that indicate one of five possible types of cystic fibrosis. Fifty-one adults completed all aspects of the study. Players took pre and post assessments and drew pictures of cells and translation before and after the game. Players were randomly assigned to play the game with the HMD (stereoscopic view) or without the headset (non-stereoscopic view). Players were interviewed about their drawings and experiences at the end of the session.

Findings

Players in both groups improved in their knowledge of the cell environment and the process of translation. Players who experienced the immersive stereoscopic view had a more positive learning effect in the content assessment, and stronger improvement in their mental models of the process of translation between pre- and post-drawings compared to players who played the two-dimensional game.

Originality/value

This study suggests that immersion alone has a positive effect on conceptual understanding, especially in helping learners understand spatial environments and processes. These findings set the stage for a new wave of research on learning in immersive environments; research that moves beyond determining whether immersive media correlate with more learning, toward a focus on the types of learning outcomes that are best supported by immersive media.

Floor-vibration VR: Mitigating Cybersickness Using Whole-body Tactile Stimuli in Highly Realistic Vehicle Driving Experiences

This work addresses cybersickness, a major barrier to successful long-exposure immersive virtual reality (VR) experiences since user discomfort frequently leads to prematurely ending such experiences. Starting from sensory conflict theory, we posit that if a vibrating floor delivers vestibular stimuli that minimally match the vibration characteristics of a scenario, the size of the conflict between the visual and vestibular senses will be reduced and, thus, the incidence and/or severity of cybersickness will also be reduced. We integrated a custom-built, computer-controlled vibrating floor in our VR system. To evaluate the system, we implemented a realistic off-road vehicle driving simulator in which participants rode multiple laps as passengers on an off-road course. We programmed the floor to generate vertical vibrations similar to those experienced in real off-road vehicle travel. The scenario and driving conditions were designed to be cybersickness-inducing for users in both the Vibration and No-vibration conditions. We collected subjective and objective data for variables previously shown to be related to levels of cybersickness or presence. These included presence and simulator sickness questionnaires (SSQ), self-rated discomfort levels, and the physiological signals of heart rate, galvanic skin response (GSR), and pupil size. Comparing data between participants in the Vibration group (N=11) to the No-Vibration group (N=11), we found that Delta-SSQ Oculomotor response and the GSR physiological signal, both known to be positively correlated with cybersickness, were significantly lower (with large effect sizes) for the Vibration group. Other variables differed between groups in the same direction, but with trivial or small effect sizes. The results indicate that the floor vibration significantly reduced some measures of cybersickness.

Application of Virtual Environments for Biophilic Design: A Critical Review

Biophilic design as a new design approach promotes the integration of natural elements into the built environment, leading to a significant impact on human health, well-being, and productivity. On the other hand, scholars have explored Virtual Environment (VE) to create virtual nature and provide a complex experience of exposure to natural elements virtually. However, there is a lack of understanding about such studies in general, which use VE as a reliable tool to support biophilic design. Thus, the authors conducted a literature review on the applications, capabilities, and limitations of VE for biophilic design. The literature review shows that VE is capable of supporting critical features of biophilic design studies such as representing combinations of biophilic patterns, providing multimodal sensory inputs, simulating stress induction tasks, supporting required exposure time to observe biophilic patterns, and measuring human’s biological responses to natural environment. However, factors affecting user’s experience of a virtual biophilic environment exist, such as VE experience dimensions, user-related factors, cybersickness, navigational issues, and possible limitations of VE sensory input. Overall, biophilic design studies in VEs are still limited. Nevertheless, there are many opportunities for further research in this field.

Mobile Virtual reality vs. Mobile 360 Video to Promote Enrollment in the Diabetes Prevention Program Amongst Hispanic Adults (Preprint)

Background

Hispanic adults are at increased risk of developing type 2 diabetes. The Diabetes Prevention Program (DPP) reduces the risk of developing type 2 diabetes; however, the rate of enrollment is very low.

Objective

The goal of this pilot project was to determine whether presenting brief motivational mobile videos in virtual reality vs 360° video has differential effects on risk perceptions and enrollment in the DPP.

Methods

Adults with prediabetes were recruited at a clinic serving a low-income Hispanic community. After consenting, the participants completed a baseline survey that collected information about demographics and risk perceptions. All participants then viewed 2 videos. Per random assignment, the videos were presented either using the participant’s smartphone alone (360° video) or were viewed with their smartphone in a virtual reality (VR) cardboard headset. Two weeks later, a follow-up survey collected measures of enrollment in the DPP, risk perceptions, health literacy, the importance of contextual factors related to the decision of whether to enroll in the DPP (eg, distance to the class), and qualitative feedback on the interventions. We used logistic regression to determine whether enrollment in the DPP differed by intervention mode, while accounting for health literacy and contextual factors related to the DPP. We used unpaired t tests to examine differences in change in risk perceptions between groups. Paired t tests were used to examine within-subject changes in risk perceptions.

Results

A total of 116 participants provided complete data. Most participants were middle-aged (mean age 44.6 years; SD 11.9) Hispanic (114/116), female (79/116), with low health literacy (mean score 12.3/20; SD 3.4). Enrollment in the DPP was 44/116 (37.9%) overall but did not differ by group (odds ratio for enrolling in VR group 1.78, 95% CI 0.75-4.3; P=.19). Individuals who rated the distance needed to travel to attend the DPP as more important were less likely to enroll in the DPP (odds ratio 0.56, 95% CI 0.33-0.92; P=.03). Risk perceptions did not differ by group (mean change in 360° video group -0.07, mean change in VR group 0.03, t=0.6, P=.54) and did not change within subjects (mean 0.02, t=0.21, P=.83). Participant feedback suggested that the videos are emotionally engaging and educational.

Conclusions

The videos presented in 360° video and mobile VR had equal efficacy in promoting enrollment in the DPP. Future work to rigorously evaluate this intervention, its mechanism of action, and potential moderators of the efficacy are discussed.

Experts and Gamers on Immersion into Reconstructed Strongholds

In this study, we have touched upon a problem in evaluating the method of immersion in specific historico-geographical virtual space constructed on the basis of traditional cartographic and graphic materials. We have obtained opinions from two groups of users on the perception of cultural objects reconstructed in a virtual reality previously unknown to them. To achieve our objective and answer the questions, we have adopted four main stages of research: to pinpoint concepts adopted by researchers by discussing two types of approach, to create a virtual reality application according to the scheme based on knowledge from analog sources and digital actions in several workspaces, to prepare and conduct a survey among experts and gamers, and to graphically juxtapose the results of the survey. The evaluation by experts in medieval strongholds and serious story game users of the specific ways of immersion in the VR of reconstructed buildings in the current area provides researchers with an extended view of its effectiveness and attractiveness as well as with suggestions for further design processes.

Full-immersion virtual reality: Adverse effects related to static balance

The use of virtual reality (VR) is associated with several adverse effects including dizziness, headache, and motion sickness. This study investigates how full-immersion VR games cause changes in static balance with associated adverse effects, and whether a fixed or a changing game background is more likely to contribute to such problems. Static balance and adverse effects (eye fatigue and dizziness) were measured in 15 healthy adults under three conditions: baseline; after a full-immersion virtual reality game (PlayStation 4 Pro and PlayStation® VR headset) with a fixed background (15 min); and after a full-immersion virtual reality game with a unfixed background (15 min). Static balance was measured with an AMTI force plate, while eye fatigue and dizziness were measured with the Virtual Reality Symptom Questionnaire (VRSQ) and the Simulator Sickness Questionnaire (SSQ). It was determined that playing a full-immersion VR game had a negative effect on static balance and produced several adverse effects including eye fatigue and dizziness. Moreover, sway velocity and sway length increased significantly in the game with a moving background compared to both the baseline and the game with a fixed background (p < 0.05); VRSQ and SSQ were also significantly higher in this case. It is thus preferable from the perspective of reducing adverse effects that only fixed-background full-immersion VR games be used in rehabilitative interventions.

Are Modern Head-Mounted Displays Sexist? A Systematic Review on Gender Differences in HMD-Mediated Virtual Reality

Modern head-mounted displays (HMDs) are a promising technology. Thanks to their affordable cost and versatility, HMDs are gaining attention from different sectors. However, the experience reported by the users of these technologies is sometimes negative. A number of people, when using an HMD, complain of various types of physical discomfort as well as symptoms like headache, disorientation, and nausea. These symptoms, developed during or after exposure to virtual environments, are commonly referred to with the term simulator sickness. Some scientific studies have shown that women are commonly more sensitive to simulator sickness. However, a gender imbalance in the susceptibility to simulator sickness has not been widely studied in the context of modern HMDs, and the studies that have been done have reported heterogeneous findings. The present systematic review aims to gather the pieces of evidence that support and oppose a gender difference in the susceptibility of simulator sickness in the framework of modern HMDs. We also aim to individuate other gender differences in the experience of the use of these technologies to establish whether there is sufficient evidence to support a gender discrepancy in the user experience.

The Use of Virtual Reality Alone Does Not Promote Training Performance (but Sense of Presence Does)

Virtual reality (VR) offers novel ways to develop skills and learning. This technology can be used to enhance the way we educate and train professionals by possibly being more effective, cost-efficient, and reducing training-related risks. However, the potential benefits from virtual training assume that the trained skills can be transferred to the real world. Nevertheless, in the current published scientific literature, there is limited empirical evidence that links VR use to better learning. The present investigation aimed to explore the use of VR as a tool for training procedural skills and compare this modality with traditional instruction methods. To investigate skill development using the two forms of training, participants were randomly divided into two groups. The first group received training through an instructional video, while the second group trained in VR. After the training session, the participants performed the trained task in a real setting, and task performance was measured. Subsequently, the user's experienced sense of presence and simulator sickness (SS) was measured with self-report questionnaires. There were no significant differences between groups for any of the performance measures. There was no gender effect on performance. Importantly, the results of the present study indicate that a high sense of presence during the VR simulation might contribute to increased skill learning. These findings can be used as a starting point that could be of value when further exploring VR as a tool for skill development.

Virtual Reality Games and the Role of Body Involvement in Enhancing Positive Emotions and Decreasing Anxiety: Within-Subjects Pilot Study

Background

In the last few years, the introduction of immersive technologies, especially virtual reality, into the gaming market has dramatically altered the traditional concept of video games. Given the unique features of virtual reality in terms of interaction and its ability to completely immerse the individual into the game, this technology should increase the propensity for video games to effectively elicit positive emotions and decrease negative emotions and anxiety in the players. However, to date, few studies have investigated the ability of virtual reality games to induce positive emotions, and the possible effect of this new type of video game in diminishing negative emotions and anxiety has not yet been tested. Furthermore, given the critical role of body movement in individuals’ well-being and in emotional responses to video games, it seems critical to investigate how body involvement can be exploited to modulate the psychological benefits of virtual reality games in terms of enhancing players’ positive emotions and decreasing negative emotions and anxiety.

Objective

This within-subjects study aimed to explore the ability of commercial virtual reality games to induce positive emotions and diminish negative emotions and state anxiety of the players, investigating the effects of the level of body involvement requested by the game (ie, high vs low).

Methods

A total of 36 young adults played a low body-involvement (ie, Fruit Ninja VR) and a high body-involvement (ie, Audioshield) video game in virtual reality. The Visual Analogue Scale (VAS) and the State-Trait Anxiety Inventory, Form-Y1 (STAI-Y1) were used to assess positive and negative emotions and state anxiety.

Results

Results of the generalized linear model (GLM) for repeated-measures multivariate analysis of variance (MANOVA) revealed a statistically significant increase in the intensity of happiness (P<.001) and surprise (P=.003) and, in parallel, a significant decrease in fear (P=.01) and sadness (P<.001) reported by the users. Regarding the ability to improve anxiety in the players, the results showed a significant decrease in perceived state anxiety after game play, assessed with both the STAI-Y1 (P=.003) and the VAS-anxiety (P=.002). Finally, the results of the GLM MANOVA showed a greater efficacy of the high body-involvement game (ie, Audioshield) compared to the low body-involvement game (ie, Fruit Ninja VR), both for eliciting positive emotions (happiness, P<.001; and surprise, P=.01) and in reducing negative emotions (fear, P=.05; and sadness, P=.05) and state anxiety, as measured by the STAI-Y1 (P=.05).

Conclusions

The two main principal findings of this study are as follows: (1) virtual reality video games appear to be effective tools to elicit positive emotions and to decrease negative emotions and state anxiety in individuals and (2) the level of body involvement of the virtual video game has an important effect in determining the ability of the game to improve positive emotions and decrease negative emotions and state anxiety of the players.

Impact of Using a 3D Visual Metaphor Serious Game to Teach History-Taking Content to Medical Students: Longitudinal Mixed Methods Pilot Study

BACKGROUND

History taking is a key component of clinical practice; however, this skill is often poorly performed by students and doctors.

OBJECTIVE

The study aimed to determine whether Metaphoria, a 3D serious game (SG), is superior to another electronic medium (PDF text file) in learning the history-taking content of a single organ system (cardiac).

METHODS

In 2015, a longitudinal mixed methods (quantitative and qualitative) pilot study was conducted over multiple sampling time points (10 weeks) on a group of undergraduate medical students at The University of Auckland Medical School, New Zealand. Assessors involved in the study were blinded to group allocation. From an initial sample of 83, a total of 46 medical students were recruited. Participants were assigned to either a PDF group (n=19) or a game group (n=27). In total, 1 participant left the PDF group after allocation was revealed and was excluded. A total of 24 students in the game group and 14 students in the PDF group completed follow-up 7 weeks later. Using an iterative design process for over a year, with input from a variety of clinical disciplines, a cardiac history-taking game and PDF file were designed and informed by Cognitive Load Theory. Each group completed its intervention in 40 min. A total of 3 levels of Kirkpatrick training evaluation model were examined using validated questionnaires: affective (perception and satisfaction), cognitive (knowledge gains and cognitive load), and behavioral attitudes (Objective Structured Clinical Exam) as well as qualitative assessment. A priori hypotheses were formulated before data collection.

RESULTS

Compared with baseline, both groups showed significant improvement in knowledge and self-efficacy longitudinally (P<.001). Apart from the game group having a statistically significant difference in terms of satisfaction (P<.001), there were no significant differences between groups in knowledge gain, self-efficacy, cognitive load, ease of use, acceptability, or objective structured clinical examination scores. However, qualitative findings indicated that the game was more engaging and enjoyable, and it served as a visual aid compared with the PDF file.

CONCLUSIONS

Students favored learning through utilization of an SG with regard to cardiac history taking. This may be relevant to other areas of medicine, and this highlights the importance of innovative methods of teaching the next generation of medical students.

Desktop VR Is Better Than Non-ambulatory HMD VR for Spatial Learning

Use of virtual reality (VR) technology is proliferating for designing and upgrading entertainment devices, and creating virtual environments that could be used for research and training. VR is becoming a strong research tool by providing a tighter control on the experimental environment and by allowing almost limitless possibilities of creating ecologically valid stimuli. However, the enhanced fidelity between the real and virtual worlds that VR provides does not always benefit human performance. For a better understanding, and increasing VR's usability, we need to identify the relevant constituent components of immersive technologies, and differentiate their roles, for example, how visual and interaction fidelity differentially improves human performance. We conducted an experiment to examine how two common VR display modes, head mounted display (HMD) and desktop (DT), would affect spatial learning when we restrict ambulatory locomotion in HMD. This manipulation allowed examining the role of varying visual fidelity with low interaction fidelity. We used a between-group design with 40 naïve participants. They explored a virtual environment and later drew its sketch-map. Our results showed participants spent more time and perceived less motion-sickness and task effort using desktop than HMD VR. With reduced interaction fidelity, the high visual fidelity of HMD as compared to desktop resulted in similar or poorer performance on different spatial learning tasks after accounting for motion-sickness and workload effort. Participants were better in recalling spatial components related to junction and cyclic order of the navigated virtual space in desktop vs. HMD VR, and performed equally well on components related to street segments and object associations. We explain these results in terms of deficient idiothetic information in non-ambulatory HMD and lesser sensory conflicts in desktop mode. Overall, our results highlight the differential effect of visual vs. interaction fidelity on human performance based on using immersive technologies, how such an effect depends on the nature of cognitive and functional behavior users employ, and the higher usability of traditional desktop VR. These results are relevant for developing customized and sustainable virtual reality based human-computer interactions.

Psychophysiological Alteration After Virtual Reality Experiences Using Smartphone-Assisted Head Mount Displays: An EEG-Based Source Localization Study

Brain functional changes could be observed in people after an experience of virtual reality (VR). The present study investigated cyber sickness and changes of brain regional activity using electroencephalogram (EEG)-based source localization, before and after a VR experience involving a smartphone-assisted head mount display. Thirty participants (mean age = 25 years old) were recruited. All were physically healthy and had no ophthalmological diseases. Their corrected vision was better than 20/20. Resting state EEG and the simulator sickness questionnaire (SSQ) were measured before and after the VR experience. Source activity of each frequency band was calculated using the sLORETA program. After the VR experience, the SSQ total score and sub scores (nausea, oculomotor symptoms, and disorientation) were significantly increased, and brain source activations were significantly increased: alpha1 activity in the cuneus and alpha2 activity in the cuneus and posterior cingulate gyrus (PCG). The change of SSQ score (after–before) showed significant negative correlation with the change of PCG activation (after–before) in the alpha2 band. The study demonstrated increased cyber sickness and increased alpha band power in the cuneus and PCG after the VR experience. Reduced PCG activation in alpha band may be associated with the symptom severity of cyber sickness.