Are there side effects to watching 3D movies? A prospective crossover observational study on visually induced motion sickness

EEG classification model for virtual reality motion sickness based on multi-scale CNN feature correlation

BACKGROUND

Virtual reality motion sickness (VRMS) is a key issue hindering the development of virtual reality technology, and accurate detection of its occurrence is the first prerequisite for solving the issue.

OBJECTIVE

In this paper, a convolutional neural network (CNN) EEG detection model based on multi-scale feature correlation is proposed for detecting VRMS.

METHODS

The model uses multi-scale 1D convolutional layers to extract multi-scale temporal features from the multi-lead EEG data, and then calculates the feature correlations of the extracted multi-scale features among all the leads to form the feature adjacent matrixes, which converts the time-domain features to correlation-based brain network features, thus strengthen the feature representation. Finally, the correlation features of each layer are fused. The fused features are then fed into the channel attention module to filter the channels and classify them using a fully connected network. Finally, we recruit subjects to experience 6 different modes of virtual roller coaster scenes, and collect resting EEG data before and after the task to verify the model.

RESULTS

The results show that the accuracy, precision, recall and F1-score of this model for the recognition of VRMS are 98.66 %, 98.65 %, 98.68 %, and 98.66 %, respectively. The proposed model outperforms the current classic and advanced EEG recognition models.

SIGNIFICANCE

It shows that this model can be used for the recognition of VRMS based on the resting state EEG.

Potential factors contributing to observed sex differences in virtual-reality-induced sickness

Virtual reality (VR) technology has been widely adopted for several professional and recreational applications. Despite rapid innovation in hardware and software, one of the long prevailing issues for end users of VR is the experience of VR sickness. Females experience stronger VR sickness compared to males, and previous research has linked susceptibility to VR sickness to the menstrual cycle (Munafo et al., Exp Brain Res 235(3):889-901). Here we investigated the female versus male experience in VR sickness while playing an immersive VR game, comparing days of the menstrual cycle when hormones peak: day 15 (ovulation-peak estrogen) and day 22 (mid-luteal phase-peak progesterone). We found that immersion duration was greater in the second session than the first, and discomfort was lessened, suggesting a powerful adaptation with repeated exposure. Due to the estrogen levels changing along with the exposure, there was no clear independent impact of that; note, though, that there was a significant difference between self-report and physiological measures implying that GSR is potentially an unreliable measure of motion sickness. Although prior work found a delay over 2 days between session would not allow adaptation and habituation to reduce VR sickness susceptibility, we found that a week delay has potential success.

Projection of realistic three-dimensional photogrammetry models using stereoscopic display: A technical note

The 3D stereoscopic technique consists in providing the illusional perception of depth of a given object using two different images mimicking how the right and left eyes capture the object. Both images are slightly different and when overlapped gives a three-dimensional (3D) experience. Considering the limitations for establishing surgical laboratories and dissections courses in some educational institutions, techniques such as stereoscopy and photogrammetry seem to play an important role in neuroanatomy and neurosurgical education. The aim of this study was to describe how to combine and set up realistic models acquired with photogrammetry scans in 3D stereoscopic projections. Three donors, one dry skull, embalmed brain and head, were scanned using photogrammetry. The software used for displaying the final realistic 3D models (Blender, Amsterdam, the Netherlands) is a free software and allows stereoscopic projection without compromising the interactivity of each model. By default, the model was exported and immediately displayed as a red cyan 3D mode. The 3D projector used in the manuscript required a side-by-side 3D mode which was set up with simple commands on the software. The final stereoscopy projection offered depth perception and a visualization in 360° of each donor; this perception was noted especially when visualizing donors with different cavities and fossae. The combination of 3D techniques is of paramount importance for neuroanatomy education. Stereoscopic projections could provide a valuable tool for neuroanatomy instruction directed at clinical trainees and could be especially useful when access to laboratory-based learning is limited.

Antihistamines for motion sickness

BACKGROUND

Motion sickness is a syndrome that occurs as a result of passive body movement in response to actual motion, or the illusion of motion when exposed to virtual and moving visual environments. The most common symptoms are nausea and vomiting. Antihistamines have been used in the management of motion sickness for decades, however studies have shown conflicting results regarding their efficacy.

OBJECTIVES

To assess the effectiveness of antihistamines in the prevention and treatment of motion sickness in adults and children.

SEARCH METHODS

The Cochrane ENT Information Specialist searched the Cochrane ENT Register; Central Register of Controlled Trials; Ovid MEDLINE; Ovid Embase; Web of Science; ClinicalTrials.gov; ICTRP and additional sources for published and unpublished trials. The date of the search was 7 December 2021.

SELECTION CRITERIA

Randomised controlled trials (RCTs) in susceptible adults and children in whom motion sickness was induced under natural conditions such as air, sea and land transportation. We also included studies in which motion sickness was induced under experimental conditions (analysed separately). Antihistamines were included regardless of class, route or dosage and compared to no treatment, placebo or any other pharmacological or non-pharmacological interventions.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods. Our primary outcomes were 1) the proportion of susceptible participants who did not experience any motion sickness symptoms; 2) the proportion of susceptible participants who experienced a reduction or resolution of existing symptoms. Secondary outcomes were 1) physiological measures (heart rate, core temperature and gastric tachyarrhythmia (electrogastrography)) and 2) adverse effects (sedation, impaired cognition, blurred vision). We used GRADE to assess the certainty of the evidence for each outcome.

MAIN RESULTS

We included nine RCTs (658 participants). Studies were conducted across seven countries, with an overall age range of 16 to 55 years. Motion sickness was induced naturally in six studies and experimentally in four studies (rotating chair). All the naturally induced studies only evaluated first-generation antihistamines (cinnarizine and dimenhydrinate). Risk of bias across the studies varied, with mostly low risk for random sequence generation and allocation concealment, and mostly high risk for selective reporting. Only the experimentally induced studies measured physiological parameters and only the naturally induced studies evaluated adverse effects. There were no studies that clearly assessed the paediatric population. Antihistamines versus placebo or no treatment Antihistamines are probably more effective than placebo at preventing motion sickness symptoms under natural conditions (symptoms prevented: 25% placebo; 40% antihistamines) (risk ratio (RR) 1.81, 95% confidence interval (CI) 1.23 to 2.66; 3 studies; 240 participants) (moderate-certainty). The evidence is very uncertain about the effect of antihistamines on preventing motion sickness under experimental conditions (standardised mean difference (SMD) 0.32, 95% CI -0.18 to 0.83; 2 studies; 62 participants) (very low-certainty). No studies reported results on the resolution of existing motion sickness symptoms. Antihistamines may result in little or no difference in gastric tachyarrhythmia under experimental conditions (mean difference (MD) -2.2, 95% CI -11.71 to 7.31; 1 study; 42 participants) (low-certainty). No studies reported results for any other physiological measures. When compared to placebo, antihistamines may be more likely to cause sedation (sedation: 44% placebo; 66% antihistamines) (RR 1.51, 95% CI 1.12 to 2.02; 2 studies; 190 participants) (low-certainty); they may result in little or no difference in blurred vision (blurred vision: 12.5% placebo; 14% antihistamines) (RR 1.14, 95% CI 0.53 to 2.48; 2 studies; 190 participants) (low-certainty); and they may result in little or no difference in terms of impaired cognition (impaired cognition: 33% placebo; 29% antihistamines) (RR 0.89, 95% CI 0.58 to 1.38; 2 studies; 190 participants) (low-certainty). Antihistamines versus scopolamine The evidence is very uncertain about the effect of antihistamines on preventing motion sickness under natural conditions when compared to scopolamine (symptoms prevented: 81% scopolamine; 71% antihistamines) (RR 0.89, 95% CI 0.68 to 1.16; 2 studies; 71 participants) (very low-certainty). No studies were performed under experimental conditions. No studies reported results on the resolution of existing motion sickness symptoms. The evidence is very uncertain about the effect of antihistamines on heart rate under natural conditions (narrative report, 1 study; 20 participants; "No difference in pulse frequency"; very low-certainty). No studies reported results for any other physiological measures. When compared to scopolamine, the evidence is very uncertain about the effect of antihistamines on sedation (sedation: 21% scopolamine; 30% antihistamines) (RR 0.82, 95% CI 0.07 to 9.25; 2 studies; 90 participants) (very low-certainty) and on blurred vision (narrative report: not a significant difference; 1 study; 51 participants; very low-certainty). No studies evaluated impaired cognition. Antihistamines versus antiemetics Antihistamines may result in little or no difference in the prevention of motion sickness under experimental conditions (MD -0.20, 95% CI -10.91 to 10.51; 1 study; 42 participants) (low-certainty). The evidence is of low certainty due to imprecision as the sample size is small and the confidence interval crosses the line of no effect. No studies assessed the effects of antihistamines versus antiemetics under natural conditions. No studies reported results on the resolution of existing motion sickness symptoms. Antihistamines may result in little or no difference in gastric tachyarrhythmia (MD 4.56, 95% CI -3.49 to 12.61; 1 study; 42 participants) (low-certainty). No studies reported results for any other physiological measures. No studies evaluated sedation, impaired cognition or blurred vision. One study reported physiological data for this outcome, evaluating gastric tachyarrhythmia specifically. Antihistamines may result in little or no difference in gastric tachyarrhythmia (MD 4.56, 95% CI -3.49 to 12.61; 1 study; 42 participants; low-certainty evidence). This evidence is of low certainty due to imprecision as the sample size is small and the confidence interval crosses the line of no effect. Antihistamines versus acupuncture The evidence is very uncertain about the effects of antihistamines on the prevention of motion sickness under experimental conditions when compared to acupuncture (RR 1.32, 95% CI 1.12 to 1.57; 1 study; 100 participants) (very low-certainty). This study did not assess the prevention of motion sickness under natural conditions, nor the resolution of existing motion sickness symptoms. There was no study performed under natural conditions. Physiological measures and adverse effects were not reported.

AUTHORS' CONCLUSIONS

There is probably a reduction in the risk of developing motion sickness symptoms under naturally occurring conditions of motion when using first-generation antihistamines, in motion sickness-susceptible adults, compared to placebo. Antihistamines may be more likely to cause sedation when compared to placebo. No studies evaluated the treatment of existing motion sickness, and there are few data on the effect of antihistamines in children. The evidence for all other outcomes and comparisons (versus scopolamine, antiemetics and acupuncture) was of low or very low certainty and we are therefore uncertain about these effects of antihistamines.

Beyond Perceptual Thresholds and Personal Preference: Towards Novel Research Questions and Methodologies of Quality of Experience Studies on Light Field Visualization

With the upcoming emergence of the IEEE P3333.1.4 standard, the first ever standardization document on the subjective quality assessment of light field visualization, we are approaching a major milestone of light field Quality of Experience (QoE). The research efforts leading up to this point have answered the fundamental questions regarding perceptual thresholds and personal preference, and best practices regarding research methodologies have been formed. However, in order to introduce successful and efficient light field systems and services, research questions beyond perceptual thresholds and personal preference must be addressed, along with the associated methodologies. In this paper, we propose a comprehensive set of novel research questions and methodologies regarding light field QoE. Our work also provides a detailed discussion of related factors, particularly those that extend to test participants and thus may affect the results of subjective studies.

Myopia-correcting lenses decrease eye fatigue in a visual search task for both adolescents and adults

The steady, world-wide increase in myopia prevalence in children over the past decades has raised concerns. As an early intervention for axial-length-related myopia, correcting lenses have been developed (such as Defocus Incorporated Multiple Segment (DIMS) lenses), which have been shown to be effective in slowing myopia progression. Beyond this direct effect, however, it is not known whether such lenses also affect other aspects important to the wearer, such as eye fatigue, and how such effects may differ across age, as these lenses so far are typically only tested with adolescents. In the present work, we therefore investigated perceived fatigue levels according to lens type (normal vs DIMS) and age (adolescents vs adults) in a demanding visual search task ("Finding Wally") at two difficulty levels (easy vs difficult). Whereas age and difficulty did not result in significant differences in eye fatigue, we found a clear reduction of fatigue levels in both age groups when wearing the correcting lenses. Hence, the additional accommodation of these lens types may result in less strain in a task requiring sustained eye movements at near viewing distances.

First-time sports-related concussion recovery revisited: management changes and impact on recovery

Context

Concussion is among the most common injuries in athletes. Over the past 10 years, concussion knowledge has expanded, and guidelines for management have changed. Recent changes include recommendations against strict mental and physical rest after sustaining a concussion, a better recognition of preexisting conditions predisposing protracted concussion recovery, and the addition of preliminary patient counseling and education about the expected course of concussion recovery.

Objective

To assess the impact of changes in concussion management on the duration of symptoms in middle school and high school athletes after sustaining a first-time, sports-related concussion.

Methods

A retrospective review was performed of medical records of athletes who sustained a concussion between 2016 and 2018 and were treated by the same primary care physician (J.M.N) using the revised approach to concussion management described. Patients were included if they were 11 to 18 years old and had a diagnosis of first-time concussion sustained while playing organized sports. Athletes who sustained a concomitant injury or sustained a concussion outside of organized sports were excluded from the study; athletes lost to follow-up or with incomplete forms were also excluded. Each athlete's length of symptomatic time from his or her concussion was calculated. This data was then compared with a previously-published data set of athletes who sustained a concussion between 2011 and 2013, with the same inclusion criteria but a different approach to concussion management.

Results

A total of 110 male and 72 female athletes (N=182) met the study's eligibility criteria. Collectively, athletes of both sexes from the 2016-2018 data set reported a higher incidence of preexisting conditions associated with prolonged concussion recovery compared with the data set of 2011-2013 athletes. However, both sexes from the 2016-2018 data set also reported a shorter median duration of concussion symptoms compared with the 2011-2013 athletes (median duration 5 vs. 11 days for male athletes and 7 vs. 28 days for female athletes, respectively; p<0.001).

Conclusion

Recent changes in concussion management have led to decreased duration of symptoms among 11- to 18-year-old athletes with first-time, sports-related concussions. These management changes include advocating for early activity, recognizing preexisting conditions, and educating athletes about the realities of concussion recovery.

Stereoscopic 3D geometric distortions analyzed from the viewer's point of view

Stereoscopic 3D (S3D) geometric distortions can be introduced by mismatches among image capture, display, and viewing configurations. In previous work of S3D geometric models, geometric distortions have been analyzed from a third-person perspective based on the binocular depth cue (i.e., binocular disparity). A third-person perspective is different from what the viewer sees since monocular depth cues (e.g., linear perspective, occlusion, and shadows) from different perspectives are different. However, depth perception in a 3D space involves both monocular and binocular depth cues. Geometric distortions that are solely predicted by the binocular depth cue cannot describe what a viewer really perceives. In this paper, we combine geometric models and retinal disparity models to analyze geometric distortions from the viewer's perspective where both monocular and binocular depth cues are considered. Results show that binocular and monocular depth-cue conflicts in a geometrically distorted S3D space. Moreover, user-initiated head translations averting from the optimal viewing position in conventional S3D displays can also introduce geometric distortions, which are inconsistent with our natural 3D viewing condition. The inconsistency of depth cues in a dynamic scene may be a source of visually induced motions sickness.

Are new vision standards and tests needed for military aircrew using 3D stereo helmet-mounted displays?

Visual standards for military aviators were historically set in the 1920s with requirements based on the visual systems of aircraft at the time, and these standards have changed very little despite significant advances in aircraft technology. Helmet-mounted displays (HMDs) today enable pilots to keep their head out of the cockpit while flying and can be monocular, biocular or binocular in design. With next generation binocular HMDs, flight data can be displayed in three-dimensional stereo to declutter information presented, improving search times and potentially improve overall performance further. However, these new visually demanding technologies place previously unconsidered stresses on the human visual system. As such, new medical vision standards may be required for military aircrew along with improved testing methods to accurately characterise stereo acuity.

Cognitive load in 3d and 2d minimally invasive colorectal surgery

BACKGROUND

Three-dimensional (3d) laparoscopy has been introduced to enhance depth perception and facilitate surgical operations. The aim of this study was to compare cognitive load during 3d and 2d laparoscopic procedures.

METHODS

Two subjective questionnaires (the Simulator Sickness Questionnaire and the NASA task load index) were used to prospectively collect data regarding cognitive load in surgeons performing 2d and 3d laparoscopic colorectal resections. Moreover, the perioperative results of 3d and 2d laparoscopic operations were analyzed.

RESULTS

A total of 313 patients were included: 82 in the 2d group and 231 in the 3d group. The NASA TLX results did not reveal significantly major cognitive load differences in the 3d group compared with the 2d group; the SSQ results were better in the 3d group than in the 2d group in terms of general discomfort, whereas difficulty concentrating, difficulty focusing, and fatigue were more frequent in 3d operations than in 2d operations (p = 0.001-0.038). The results of age, sex, and ASA score were comparable between the two groups (p = 0.299-0.374). The median operative time showed no statistically significant difference between the 3d and 2d groups (median, IQR, 2d 150 min [120-180]-3d 160 min [130-190] p = 0.611). There was no statistically significant difference in the risk of severe complications between patients in the 3d group and in the 2d group (2d 7 [8.54%] vs 3d 21 [9.1%], p = 0.271). The median hospitalization time and the reoperation rate showed no difference between the 2d and 3d operations (p = 0.417-0.843).

CONCLUSION

The NASA TLX did not reveal a significant difference in cognitive load between the 2d and 3d groups, whereas data reported by the SSQ showed a mild risk of cognitive load in the 3d group. Furthermore, 3d laparoscopic surgery revealed the same postoperative results as 2d standard laparoscopy.

Stereoscopic 3D Optic Flow Distortions Caused by Mismatches between Image Acquisition and Display Parameters

We analyze the impact of common stereoscopic 3D (S3D) depth distortion on S3D optic flow in virtual reality (VR) environments. The depth distortion is introduced by mismatches between the image acquisition and display parameter. The results show that such S3D distortions induce large S3D optic flow distortions and may even induce partial/full optic flow reversal within a certain depth range, depending on the viewer's moving speed and the magnitude of S3D distortion introduced. We hypothesize that the S3D optic flow distortion may be a source of intra-sensory conflict that may be a source of visually induced motion sickness (VIMS) in S3D.

Video Display Operator Complaints: A 10-Year Follow-Up of Visual Fatigue and Refractive Disorders

Visual fatigue and discomfort are very common complaints for video display operators (VDTs). The aim of our study was to study work-related visual symptoms in relation to refractive disorders and psychosocial factors in 3054 public employees by way of follow-ups for 10 years with periodic medical examinations with eye evaluation in the period 2000-2009. Factors related to visual fatigue were evaluated in the follow-up using generalized equation estimation. Visual fatigue was very common in VDT operators (64.03%). During the follow-up, no relationship between visual fatigue and age, sex, seniority of work, visual acuity and refractory disorders was found. Visual fatigue was significantly associated with anxiety perception in a dose-related matter (odds ratio (OR) 7.40, confidence interval (CI) 95% 1.77-31.3), psychosocial factors (OR 1.03, CI 95% 1.01-1.07), use of lenses (OR 1.34, CI 95% 1.09-1.64) and time of VDT usage (OR 1.27, CI 95% 1.04-1.53). This study confirmed that visual fatigue is common in VDT users and is related to anxiety perception, time of VDT usage, use of lenses and stress. No relationship was found between visual fatigue and refractory disorders or visual acuity.

Motion Sickness Prediction in Stereoscopic Videos using 3D Convolutional Neural Networks

In this paper, we propose a three-dimensional (3D) convolutional neural network (CNN)-based method for predicting the degree of motion sickness induced by a 360° stereoscopic video. We consider the user's eye movement as a new feature, in addition to the motion velocity and depth features of a video used in previous work. For this purpose, we use saliency, optical flow, and disparity maps of an input video, which represent eye movement, velocity, and depth, respectively, as the input of the 3D CNN. To train our machine-learning model, we extend the dataset established in the previous work using two data augmentation techniques: frame shifting and pixel shifting. Consequently, our model can predict the degree of motion sickness more precisely than the previous method, and the results have a more similar correlation to the distribution of ground-truth sickness.

Comparison of 3D endoscopy and conventional 2D endoscopy in gastric endoscopic submucosal dissection: an ex vivo animal study

BACKGROUND AND OBJECTIVES

Conventional endoscopy provides two-dimensional (2D) information without depth information. This study compared three-dimensional (3D) endoscopy and 2D endoscopy using an endoscopic submucosal dissection (ESD) training model to evaluate the utility of 3D endoscopy.

METHODS

Porcine stomach specimens (7 × 7 cm) were prepared from commercially available resected porcine stomachs and a 10-mm hypothetical lesion was marked at the center of each specimen. Specimens were individually placed in an ESD training model, and subjected to either 2D or 3D ESD. En bloc resection rate, perforation rate, incision time, dissection time, and levels of five eyestrain symptoms (fatigue, pain, blurred vision, head-heaviness, and headache; 100-mm visual analog scale) were compared between the 2D and 3D procedures. In a crossover design, 8 endoscopists each performed two 2D and two 3D procedures.

RESULTS

All 32 lesions were resected en block, but perforation occurred in one 2D procedure. Incision time was significantly shorter in 3D ESD than in 2D ESD (102.8 ± 42.1 s vs. 135.8 ± 65.7 s, p < 0.05). Dissection time was also significantly shorter in 3D ESD than in 2D ESD (366.3 ± 187.6 s vs. 517.8 ± 282.3 s, p < 0.05). Differences in levels of all symptoms except blurred vision between before and after ESD were larger in 3D ESD than in 2D ESD.

CONCLUSIONS

Incision time and dissection time were significantly shorter in 3D ESD compared with 2D ESD, but eyestrain was increased. Depth information from 3D images appears to facilitate rapid and stable ESD maneuvers.

An evaluation for VR glasses system user experience: The influence factors of interactive operation and motion sickness

As a new type of Virtual Reality (VR) headset, VR glasses rise rapidly in a number of areas. It's essential to understand the importance of user experience (UX) on VR glasses design. This study aimed to develop questionnaires for evaluating VR glasses' UX, as well as to investigate the relationship between various UX variables. With using lab-based usability tests, this study analyzed participants' self-reports and performance based on testing eight VR glasses and seven mobile applications. A nine-item questionnaire and a ten-item questionnaire were successfully developed to measure VR glasses systems' UX quality in terms of hardware and application, respectively. Within a proposed UX evaluation framework, the perceived UX quality relative to VR glasses hardware emerged as a core predictor in predicting interactive operation performance, whereas the application UX perception was a significant predictor of motion sickness.

3D presentation in surgery: a review of technology and adverse effects

A systematic review was undertaken to assess the technology used to create stereovision for human perception. Adverse effects associated with artificial stereoscopic technology were reviewed with an emphasis on the impact of surgical performance in the operating room. MEDLINE/PubMed library databases were used to identify literature published up to Aug 2017. In the past 60 years, four major types of technologies have been used for reconstructing stereo images: anaglyph, polarization, active shutter, and autostereoscopy. As none of them can perfectly duplicate our natural stereoperception, user exposure to this artificial environment for a period of time can lead to a series of psychophysiological responses including nausea, dizziness, and others. The exact mechanism underlying these symptoms is not clear. Neurophysiologic evidences suggest that the visuo-vestibular pathway plays a vital role in coupling unnatural visual inputs to autonomic neural responses. When stereoscopic technology was used in surgical environments, controversial results were reported. Although recent advances in stereoscopy are promising, no definitive evidence has yet been presented to support that stereoscopes can enhance surgical performance in image-guided surgery. Stereoscopic technology has been rapidly introduced to healthcare. Adverse effects to human operators caused by immature technology seem inevitable. The impact on surgeons working with this visualization system needs to be explored and its safety and feasibility need to be addressed.

The same video game in 2D, 3D or virtual reality - How does technology impact game evaluation and brand placements?

Video game technology is changing from 2D to 3D and virtual reality (VR) graphics. In this research, we analyze how an identical video game that is either played in a 2D, stereoscopic 3D or Head-Mounted-Display (HMD) VR version is experienced by the players, and how brands that are placed in the video game are affected. The game related variables, which are analyzed, are presence, attitude towards the video game and arousal while playing the video game. Brand placement related variables are attitude towards the placed brands and memory (recall and recognition) for the placed brands. 237 players took part in the main study and played a jump'n'run game consisting of three levels. Results indicate that presence was higher in the HMD VR than in the stereoscopic 3D than in the 2D video game, but neither arousal nor attitude towards the video game differed. Memory for the placed brands was lower in the HMD VR than in the stereoscopic 3D than in the 2D video game, whereas attitudes towards the brands were not affected. A post hoc study (n = 53) shows that cognitive load was highest in the VR game, and lowest in the 3D game. Subjects reported higher levels of dizziness and motion-sickness in the VR game than in the 3D and in the 2D game. Limitations are addressed and implications for researchers, marketers and video game developers are outlined.

Towards a Machine-Learning Approach for Sickness Prediction in 360° Stereoscopic Videos

Virtual reality systems are widely believed to be the next major computing platform. There are, however, some barriers to adoption that must be addressed, such as that of motion sickness - which can lead to undesirable symptoms including postural instability, headaches, and nausea. Motion sickness in virtual reality occurs as a result of moving visual stimuli that cause users to perceive self-motion while they remain stationary in the real world. There are several contributing factors to both this perception of motion and the subsequent onset of sickness, including field of view, motion velocity, and stimulus depth. We verify first that differences in vection due to relative stimulus depth remain correlated with sickness. Then, we build a dataset of stereoscopic 3D videos and their corresponding sickness ratings in order to quantify their nauseogenicity, which we make available for future use. Using this dataset, we train a machine learning algorithm on hand-crafted features (quantifying speed, direction, and depth as functions of time) from each video, learning the contributions of these various features to the sickness ratings. Our predictor generally outperforms a naïve estimate, but is ultimately limited by the size of the dataset. However, our result is promising and opens the door to future work with more extensive datasets. This and further advances in this space have the potential to alleviate developer and end user concerns about motion sickness in the increasingly commonplace virtual world.

Surgical outcomes of total laparoscopic hysterectomy with 2-dimensional versus 3-dimensional laparoscopic surgical systems

Three-dimensional (3D) laparoscopic surgical systems have been developed to account for the lack of depth perception, a known disadvantage of conventional 2-dimensional (2D) laparoscopy. In this study, we retrospectively compared the outcomes of total laparoscopic hysterectomy (TLH) with 3D versus conventional 2D laparoscopy. From November 2014, when we began using a 3D laparoscopic system at our hospital, to December 2015, 47 TLH procedures were performed using a 3D laparoscopic system (3D-TLH). The outcomes of 3D-TLH were compared with the outcomes of TLH using the conventional 2D laparoscopic system (2D-TLH) performed just before the introduction of the 3D system. The 3D-TLH group had a statistically significantly shorter mean operative time than the 2D-TLH group (119±20 vs. 137±20 min), whereas the mean weight of the resected uterus and mean intraoperative blood loss were not statistically different. When we compared the outcomes for 20 cases in each group, using the same energy sealing device in a short period of time, only mean operative time was statistically different between the 3D-TLH and 2D-TLH groups (113±19 vs. 133±21 min). During the observation period, there was one occurrence of postoperative peritonitis in the 2D-TLH group and one occurrence of vaginal cuff dehiscence in each group, which was not statistically different. The surgeon and assistant surgeons did not report any symptoms attributable to the 3D imaging system such as dizziness, eyestrain, nausea, and headache. Therefore, we conclude that the 3D laparoscopic system could be used safely and efficiently for TLH.

Feasibility Study of the Three-Dimensional Flexible Endoscope in Endoscopic Submucosal Dissection: An ex vivo Animal Study

BACKGROUND/AIM

Clinical application of 3-dimensional (3D) technology for flexible endoscopes has not been reported. We developed a 3D flexible endoscope and conducted a feasibility study of endoscopic submucosal dissection (ESD) in porcine stomach.

METHODS

Four endoscopists used a 3D flexible endoscope to perform a total of 8 ESD procedures on resected porcine stomachs. We assessed the en bloc resection rate, perforation rate, and mechanical issues that arise during ESD. A visual analog scale (0, 2D superior; 100, 3D superior) was used to evaluate the depth perception, sense of security of the procedure, and eyestrain of 3D visualization.

RESULTS

En bloc resection was achieved in all cases and there were no cases of perforation or mechanical issues. Depth perception and sense of security were rated 85.5 ± 12.4 and 70.7 ± 9.7 respectively (mean ± SDs). Eyestrain was rated high for 3D visualization (mean ± SDs, 12.6 ± 8.6).

CONCLUSIONS

ESD using a 3D flexible endoscope was technically feasible. The endoscopists reported good depth perception and a high sense of security when using 3D visualization but also noted strong eyestrain.

Introducing a Virtual Reality Experience in Anatomic Pathology Education

OBJECTIVES

A proper examination of surgical specimens is fundamental in anatomic pathology (AP) education. However, the resources available to residents may not always be suitable for efficient skill acquisition. We propose a method to enhance AP education by introducing high-definition videos featuring methods for appropriate specimen handling, viewable on two-dimensional (2D) and stereoscopic three-dimensional (3D) platforms.

METHODS

A stereo camera system recorded the gross processing of commonly encountered specimens. Three edited videos, with instructional audio voiceovers, were experienced by nine junior residents in a crossover study to assess the effects of the exposure (2D vs 3D movie views) on self-reported physiologic symptoms. A questionnaire was used to analyze viewer acceptance.

RESULTS

All surveyed residents found the videos beneficial in preparation to examine a new specimen type. Viewer data suggest an improvement in specimen handling confidence and knowledge and enthusiasm toward 3D technology. None of the participants encountered significant motion sickness.

CONCLUSIONS

Our novel method provides the foundation to create a robust teaching library. AP is inherently a visual discipline, and by building on the strengths of traditional teaching methods, our dynamic approach allows viewers to appreciate the procedural actions involved in specimen processing.

The viewpoint-specific failure of modern 3D displays in laparoscopic surgery

PURPOSE

Surgeons conventionally assume the optimal viewing position during 3D laparoscopic surgery and may not be aware of the potential hazards to team members positioned across different suboptimal viewing positions. The first aim of this study was to map the viewing positions within a standard operating theatre where individuals may experience visual ghosting (i.e. double vision images) from crosstalk. The second aim was to characterize the standard viewing positions adopted by instrument nurses and surgical assistants during laparoscopic pelvic surgery and report the associated levels of visual ghosting and discomfort.

METHODS

In experiment 1, 15 participants viewed a laparoscopic 3D display from 176 different viewing positions around the screen. In experiment 2, 12 participants (randomly assigned to four clinically relevant viewing positions) viewed laparoscopic suturing in a simulation laboratory. In both experiments, we measured the intensity of visual ghosting. In experiment 2, participants also completed the Simulator Sickness Questionnaire.

RESULTS

We mapped locations within the dimensions of a standard operating theatre at which visual ghosting may result during 3D laparoscopy. Head height relative to the bottom of the image and large horizontal eccentricities away from the surface normal were important contributors to high levels of visual ghosting. Conventional viewing positions adopted by instrument nurses yielded high levels of visual ghosting and severe discomfort.

CONCLUSIONS

The conventional viewing positions adopted by surgical team members during laparoscopic pelvic operations are suboptimal for viewing 3D laparoscopic displays, and even short periods of viewing can yield high levels of discomfort.

Viewing 3D TV over two months produces no discernible effects on balance, coordination or eyesight

With the rise in stereoscopic 3D media, there has been concern that viewing stereoscopic 3D (S3D) content could have long-term adverse effects, but little data are available. In the first study to address this, 28 households who did not currently own a 3D TV were given a new TV set, either S3D or 2D. The 116 members of these households all underwent tests of balance, coordination and eyesight, both before they received their new TV set, and after they had owned it for 2 months. We did not detect any changes which appeared to be associated with viewing 3D TV. We conclude that viewing 3D TV does not produce detectable effects on balance, coordination or eyesight over the timescale studied. Practitioner Summary: Concern has been expressed over possible long-term effects of stereoscopic 3D (S3D). We looked for any changes in vision, balance and coordination associated with normal home S3D TV viewing in the 2 months after first acquiring a 3D TV. We find no evidence of any changes over this timescale.

Stereoscopically Observing Manipulative Actions

The purpose of this study was to investigate the contribution of stereopsis to the processing of observed manipulative actions. To this end, we first combined the factors "stimulus type" (action, static control, and dynamic control), "stereopsis" (present, absent) and "viewpoint" (frontal, lateral) into a single design. Four sites in premotor, retro-insular (2) and parietal cortex operated specifically when actions were viewed stereoscopically and frontally. A second experiment clarified that the stereo-action-specific regions were driven by actions moving out of the frontoparallel plane, an effect amplified by frontal viewing in premotor cortex. Analysis of single voxels and their discriminatory power showed that the representation of action in the stereo-action-specific areas was more accurate when stereopsis was active. Further analyses showed that the 4 stereo-action-specific sites form a closed network converging onto the premotor node, which connects to parietal and occipitotemporal regions outside the network. Several of the specific sites are known to process vestibular signals, suggesting that the network combines observed actions in peripersonal space with gravitational signals. These findings have wider implications for the function of premotor cortex and the role of stereopsis in human behavior.

3D Cinema and Headache: The First Evidential Relation and Analysis of Involved Factors

Background

A possible link between 3D movies and headache (HA) has never been a target of specific and systematic investigations. The aim of this study was to investigate the relationship between 3D cinema and HA and to evaluate possible risk factors of developing HA during or after watching a 3D movie.

Methods

This was a prospective, non-randomized, observational study. Six thousand specifically designed questionnaires were distributed to consecutive cinema visitors. Relative HA risks for 2D- vs. 3D-movie visitors and the effects of background variables were analyzed.

Results

The questionnaire was filled and returned by 1293 persons. The mean age of responders was 33.0 ± 11.3 years. Individuals who viewed 3D movies reported HA during or after the movie 1.61 times more often than 2D-movie viewers (11.1% in 3D vs. 7.2% in 2D movies, p = 0.017). The risk was higher in women: 2.65 times for 2D (p = 0.019) and 1.85 times for 3D movies (p = 0.06), and decreased with age by 4.6% with each year for 2D (p = 0.0035) and by 3.2% for 3D movies (p = 0.0098). Among 3D-movie visitors, those with previous HAs were 4.17 times more prone to get a cinema-induced HA (p = 0.02). The risk was the highest for persons with migraine (OR = 3.37, p = 0.001).

Conclusion

For the first time, it was evidentially shown that 3D movies can provoke HA. Persons at risk are mostly younger women and/or migraineurs. Based on our results, for those belonging to the aforementioned risk groups, it can be mainly recommended to choose passive 3D technology and to view movies from the farthest possible distance.

Motion sickness

Over 2000 years ago the Greek physician Hippocrates wrote, "sailing on the sea proves that motion disorders the body." Indeed, the word "nausea" derives from the Greek root word naus, hence "nautical," meaning a ship. The primary signs and symptoms of motion sickness are nausea and vomiting. Motion sickness can be provoked by a wide variety of transport environments, including land, sea, air, and space. The recent introduction of new visual technologies may expose more of the population to visually induced motion sickness. This chapter describes the signs and symptoms of motion sickness and different types of provocative stimuli. The "how" of motion sickness (i.e., the mechanism) is generally accepted to involve sensory conflict, for which the evidence is reviewed. New observations concern the identification of putative "sensory conflict" neurons and the underlying brain mechanisms. But what reason or purpose does motion sickness serve, if any? This is the "why" of motion sickness, which is analyzed from both evolutionary and nonfunctional maladaptive theoretic perspectives. Individual differences in susceptibility are great in the normal population and predictors are reviewed. Motion sickness susceptibility also varies dramatically between special groups of patients, including those with different types of vestibular disease and in migraineurs. Finally, the efficacy and relative advantages and disadvantages of various behavioral and pharmacologic countermeasures are evaluated.

Pathophysiology and treatment of motion sickness

PURPOSE OF REVIEW

Motion sickness remains bothersome in conventional transport and is an emerging hazard in visual information technologies. Treatment remains unsatisfactory but advances in brain imaging, neurophysiology, and neuropharmacology may provide insights into more effective drug and behavioural management. We review these major developments.

RECENT FINDINGS

Recent progress has been in identifying brain mechanisms and loci associated with motion sickness and nausea per se. The techniques have included conventional neurophysiology, pathway mapping, and functional MRI, implicating multiple brain regions including cortex, brainstem, and cerebellum. Understanding of the environmental and behavioural conditions provocative of and protective against motion sickness and how vestibular disease may sensitize to motion sickness has increased. The problem of nauseogenic information technology has emerged as a target for research, motivated by its ubiquitous applications. Increased understanding of the neurophysiology and brain regions associated with motion sickness may provide for more effective medication in the future. However, the polysymptomatic nature of motion sickness, high interindividual variability, and the extensive brain regions involved may preclude a single, decisive treatment.

SUMMARY

Motion sickness is an emerging hazard in information technologies. Adaptation remains the most effective countermeasure together with established medications, notably scopolamine and antihistamines. Neuropharmacological investigations may provide more effective medication in the foreseeable future.

Instability of the perceived world while watching 3D stereoscopic imagery: A likely source of motion sickness symptoms

Watching 3D content using a stereoscopic display may cause various discomforting symptoms, including eye strain, blurred vision, double vision, and motion sickness. Numerous studies have reported motion-sickness-like symptoms during stereoscopic viewing, but no causal linkage between specific aspects of the presentation and the induced discomfort has been explicitly proposed. Here, we describe several causes, in which stereoscopic capture, display, and viewing differ from natural viewing resulting in static and, importantly, dynamic distortions that conflict with the expected stability and rigidity of the real world. This analysis provides a basis for suggested changes to display systems that may alleviate the symptoms, and suggestions for future studies to determine the relative contribution of the various effects to the unpleasant symptoms.

Effects of stimulation by three-dimensional natural images on prefrontal cortex and autonomic nerve activity: a comparison with stimulation using two-dimensional images

Empirical evidence suggests that three-dimensional (3D) images of nature promote physiological relaxation in humans by providing more realistic effects compared with two-dimensional (2D) images. However, no studies have evaluated the physiological relaxation effects of nature-derived 3D images on prefrontal cortex and autonomic nerve activity. The present study aimed to clarify the physiological relaxation effects of visual stimulation by 3D flower images on prefrontal cortex and autonomic nerve activity. Nineteen male university students (22.2 ± 0.6 years) were presented with 3D and 2D images of the water lily for 90 s. Prefrontal cortex activity was measured using near-infrared spectroscopy, while autonomic nerve activity was measured using heart rate variability (HRV). Psychological effects were determined using a modified semantic differential method (SD). Compared with visual stimulation by 2D images, that by 3D images resulted in a significant decrease in oxyhemoglobin concentration in the right prefrontal cortex, lower sympathetic activity as calculated by the ratio of the low-frequency to high-frequency HRV component, and a significantly greater realistic feeling as evidenced by higher SD ratings. In conclusion, visual stimulation by realistic 3D floral images promotes physiological relaxation more effectively than the corresponding 2D image.