1
|
Park S, Ha J, Kim L. Effect of Visually Induced Motion Sickness from Head-Mounted Display on Cardiac Activity. Sensors (Basel) 2022; 22:s22166213. [PMID: 36015973 PMCID: PMC9412462 DOI: 10.3390/s22166213] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Revised: 08/14/2022] [Accepted: 08/15/2022] [Indexed: 05/28/2023]
Abstract
Head-mounted display (HMD) virtual reality devices can facilitate positive experiences such as co-presence and deep immersion; however, motion sickness (MS) due to these experiences hinders the development of the VR industry. This paper proposes a method for assessing MS caused by watching VR content on an HMD using cardiac features. Twenty-eight undergraduate volunteers participated in the experiment by watching VR content on a 2D screen and HMD for 12 min each, and their electrocardiogram signals were measured. Cardiac features were statistically analyzed using analysis of covariance (ANCOVA). The proposed model for classifying MS was implemented in various classifiers using significant cardiac features. The results of ANCOVA reveal a significant difference between 2D and VR viewing conditions, and the correlation coefficients between the subjective ratings and cardiac features have significant results in the range of -0.377 to -0.711 (for SDNN, pNN50, and ln HF) and 0.653 to 0.677 (for ln VLF and ln VLF/ln HF ratio). Among the MS classification models, the linear support vector machine achieves the highest average accuracy of 91.1% (10-fold cross validation) and has a significant permutation test outcome. The proposed method can contribute to quantifying MS and establishing viewer-friendly VR by determining its qualities.
Collapse
Affiliation(s)
- Sangin Park
- Industry-Academy Cooperation Team, Hanyang University, Seoul 04763, Korea
| | - Jihyeon Ha
- Center for Bionics, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 04763, Korea
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea
| | - Laehyun Kim
- Center for Bionics, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 04763, Korea
- Department of HY-KIST Bio-Convergence, Hanyang University, Seoul 04763, Korea
| |
Collapse
|
2
|
Sugiura A, Ono R, Itazu Y, Sakakura H, Takada H. [Analysis of Characteristics of Eye Movement While Viewing Movies and Its Application]. Nihon Eiseigaku Zasshi 2022; 77:n/a. [PMID: 35314573 DOI: 10.1265/jjh.21004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In this article, we present the following: a background of visually induced motion sickness (VIMS), the goal of our study, and descriptions of three recent studies conducted by our group on the measurement and analysis of eye movement while viewing movies and the relationship of eye movement with VIMS. First, this study focuses on the relationship between eye movement and motion sickness susceptibility. We investigated the relationship between the motion sickness susceptibility and the frequency of optokinetic nystagmus (OKN) with peripheral viewing. It was revealed that susceptible participants showed a lower OKN frequency under conditions that strongly support the occurrence of OKN than insusceptible participants. Second, this study focuses on the relationship between visual information and postural variation such as visually evoked postural responses (VEPRs). In this study, both eye movement and the center of gravity while viewing a movie were measured. Additionally, we evaluated the difference in the transfer gain of the transfer function (vision as input and equilibrium function as output) due to the type of movie content or way of viewing. The gain for the three-dimensional movie with peripheral viewing exceeded that for the two-dimensional movie with central viewing. Third, this study focuses on eye movement and the application of deep-learning technology. In this study, we classified the eye movement as peripheral or central using a convolutional deep neural network with supervised learning. Then, cross validation was performed to test the classification accuracy. The use of >1-s eye movement data yielded an accuracy of >90%.
Collapse
Affiliation(s)
- Akihiro Sugiura
- Department of Radiological Technology, Gifu University of Medical Science
| | - Rentaro Ono
- Graduate School of Engineering, University of Fukui
| | | | | | | |
Collapse
|
3
|
Han YG, Song T, Kang H, Kang DY, Oh TY. Incidence and severity of Visually Induced motion Sickness during 3D laparoscopy In Operators who had No experience with it (VISION). Wideochir Inne Tech Maloinwazyjne 2020; 15:283-9. [PMID: 32489488 DOI: 10.5114/wiitm.2020.94347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Accepted: 10/06/2019] [Indexed: 11/17/2022] Open
Abstract
Aim The aim of the study was to evaluate the incidence and severity of visually induced motion sickness (VIMS) during 3D laparoscopy, in operators without prior experience. Material and methods Design: A retrospective comparative study (Canadian Task Force classification II-2). Setting: A university hospital. Intervention: Gynecologic surgery. Main outcome measure: This is a prospective observational study, which enrolled 9 surgeons as participants. None of these surgeons had any prior experience with 3D laparoscopy. Each participant performed 10 consecutive cases of 3D laparoscopy in patients with benign or premalignant gynecological diseases. The primary outcome measure was the incidence and severity of VIMS, which was evaluated using the validated Simulator Sickness Questionnaire. Personal preferences, discomfort, and ease of 3D laparoscopy were also evaluated. Results Sixty-seven percent of surgeons experienced VIMS during their first 3D laparoscopy case. The incidence and severity of VIMS dramatically decreased from the second case onward. However, in some surgeons (22-44%), VIMS did not completely disappear until the tenth case. With respect to the discomfort using 3D laparoscopy, 84 self-reported responses after each surgery were "favor 3D laparoscopy," and "no" in 61 (72.6%) and 47 (55.9%) participants, respectively. Most participants found it easier to perform 3D laparoscopy than 2D laparoscopy. Conclusions The occurrence of visually induced symptoms in susceptible individuals during 3D laparoscopy is high, particularly during their first case. This suggests the need for increasing surgeons' awareness regarding the possibility of discomfort.
Collapse
|
4
|
Abstract
The most prominent problem in virtual reality (VR) technology is that users may experience motion sickness-like symptoms when they immerse into a VR environment. These symptoms are recognized as visually induced motion sickness (VIMS) or virtual reality motion sickness (VRMS). The objectives of this study were to investigate the association between the electroencephalogram (EEG) and subjectively rated VIMS level (VIMSL) and find the EEG markers for VIMS evaluation. In this study, a VR-based vehicle-driving simulator (VDS) was used to induce VIMS symptoms, and a wearable EEG device with four electrodes, the Muse, was used to collect EEG data of subjects. Our results suggest that individual tolerance, susceptibility, and recoverability to VIMS varied largely among subjects; the following markers were shown to be significantly different from no-VIMS and VIMS states (P < 0.05): (1) Means of gravity frequency (GF) for theta@FP1, alpha@TP9, alpha@FP2, alpha@TP10, and beta@FP1; (2) Standard deviation of GF for alpha@TP9, alpha@FP1, alpha@FP2, alpha@TP10, and alpha@(FP2-FP1); (3) Standard deviation of power spectral entropy (PSE) for FP1; (4) Means of Kolmogorov complexity (KC) for TP9, FP1, and FP2. These results also demonstrate that it is feasible to perform VIMS evaluation using an EEG device with a small number of electrodes.
Collapse
Affiliation(s)
- Ran Liu
- College of Computer Science, Chongqing University, Chongqing, China
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
- School of microelectronics and communication engineering, Chongqing University, Chongqing, China
| | - Miao Xu
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu County, Jinzhong City, Shanxi Province, China
| | - Yanzhen Zhang
- School of microelectronics and communication engineering, Chongqing University, Chongqing, China
| | - Eli Peli
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
| | - Alex D Hwang
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
5
|
Riecke BE, Jordan JD. Comparing the effectiveness of different displays in enhancing illusions of self-movement (vection). Front Psychol 2015; 6:713. [PMID: 26082735 PMCID: PMC4450174 DOI: 10.3389/fpsyg.2015.00713] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2014] [Accepted: 05/13/2015] [Indexed: 11/13/2022] Open
Abstract
Illusions of self-movement (vection) can be used in virtual reality (VR) and other applications to give users the embodied sensation that they are moving when physical movement is unfeasible or too costly. Whereas a large body of vection literature studied how various parameters of the presented visual stimulus affect vection, little is known how different display types might affect vection. As a step toward addressing this gap, we conducted three experiments to compare vection and usability parameters between commonly used VR displays, ranging from stereoscopic projection and 3D TV to high-end head-mounted display (HMD, NVIS SX111) and recent low-cost HMD (Oculus Rift). The last experiment also compared these two HMDs in their native full field of view (FOV) and a reduced, matched FOV of 72° × 45°. Participants moved along linear and curvilinear paths in the virtual environment, reported vection onset time, and rated vection intensity at the end of each trial. In addition, user ratings on immersion, motion sickness, vection, and overall preference were recorded retrospectively and compared between displays. Unexpectedly, there were no significant effects of display on vection measures. Reducing the FOV for the HMDs (from full to 72° × 45°) decreased vection onset latencies, but did not affect vection intensity. As predicted, curvilinear paths yielded earlier and more intense vection. Although vection has often been proposed to predict or even cause motion sickness, we observed no correlation for any of the displays studied. In conclusion, perceived self-motion and other user experience measures proved surprisingly tolerant toward changes in display type as long as the FOV was roughly matched. This suggests that display choice for vection research and VR applications can be largely based on other considerations as long as the provided FOV is sufficiently large.
Collapse
Affiliation(s)
- Bernhard E Riecke
- iSpace Lab, School of Interactive Arts and Technology, Simon Fraser University , Surrey, BC, Canada
| | - Jacqueline D Jordan
- iSpace Lab, School of Interactive Arts and Technology, Simon Fraser University , Surrey, BC, Canada
| |
Collapse
|
6
|
Keshavarz B, Riecke BE, Hettinger LJ, Campos JL. Vection and visually induced motion sickness: how are they related? Front Psychol 2015; 6:472. [PMID: 25941509 PMCID: PMC4403286 DOI: 10.3389/fpsyg.2015.00472] [Citation(s) in RCA: 142] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2014] [Accepted: 04/01/2015] [Indexed: 11/13/2022] Open
Abstract
The occurrence of visually induced motion sickness has been frequently linked to the sensation of illusory self-motion (vection), however, the precise nature of this relationship is still not fully understood. To date, it is still a matter of debate as to whether vection is a necessary prerequisite for visually induced motion sickness (VIMS). That is, can there be VIMS without any sensation of self-motion? In this paper, we will describe the possible nature of this relationship, review the literature that addresses this relationship (including theoretical accounts of vection and VIMS), and offer suggestions with respect to operationally defining and reporting these phenomena in future.
Collapse
Affiliation(s)
- Behrang Keshavarz
- Intelligent Design for Adaptation, Participation and Technology (iDAPT), Research Department, Toronto Rehabilitation Institute, University Health Network , Toronto, ON, Canada
| | - Bernhard E Riecke
- School of Interactive Arts and Technology, Simon Fraser University , Surrey, BC, Canada
| | - Lawrence J Hettinger
- Center for Behavioral Sciences, Liberty Mutual Research Institute for Safety , Hopkinton, MA, USA
| | - Jennifer L Campos
- Intelligent Design for Adaptation, Participation and Technology (iDAPT), Research Department, Toronto Rehabilitation Institute, University Health Network , Toronto, ON, Canada ; Department of Psychology, University of Toronto , Toronto, ON, Canada
| |
Collapse
|
7
|
Keshavarz B, Berti S. Integration of sensory information precedes the sensation of vection: a combined behavioral and event-related brain potential (ERP) study. Behav Brain Res 2014; 259:131-6. [PMID: 24211538 DOI: 10.1016/j.bbr.2013.10.045] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2013] [Revised: 10/24/2013] [Accepted: 10/28/2013] [Indexed: 11/22/2022]
Abstract
Illusory self-motion (known as vection) describes the sensation of ego-motion in the absence of physical movement. Vection typically occurs in stationary observers being exposed to visual information that suggest self-motion (e.g. simulators, virtual reality). In the present study, we tested whether sensory integration of visual information triggers vection: participants (N=13) perceived patterns of moving altered black-and-white vertical stripes on a screen that was divided into a central and a surrounding peripheral visual field. In both fields the pattern was either moving or stationary, resulting in four combinations of central and peripheral motions: (1) central and peripheral stripes moved into the same direction, (2) central and peripheral stripes moved in opposite directions, or (3) either the central or (4) the peripheral stripes were stable while the other stripes were in motion. This stimulation induced vection: Results showed significantly higher vection ratings when the stationary center of the pattern was surrounded by a moving periphery. Event-related potentials mirrored this finding: The occipital N2 was largest with stationary central and moving peripheral stripes. Our findings suggest that sensory integration of peripheral and central visual information triggers the perception of vection. Furthermore, we found evidence that neural processes precede the subjective perception of vection strength prior to the actual onset of vection. We will discuss our findings with respect to the role of stimulus eccentricity, stimulus' depth, and neural correlates involved during the genesis of vection.
Collapse
|
8
|
Solimini AG, Mannocci A, Di Thiene D, La Torre G. A survey of visually induced symptoms and associated factors in spectators of three dimensional stereoscopic movies. BMC Public Health 2012; 12:779. [PMID: 22974235 PMCID: PMC3490878 DOI: 10.1186/1471-2458-12-779] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2012] [Accepted: 08/31/2012] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND The increasing popularity of commercial movies showing three dimensional (3D) computer generated images has raised concern about image safety and possible side effects on population health.This study aims to (1) quantify the occurrence of visually induced symptoms suffered by the spectators during and after viewing a commercial 3D movie and (2) to assess individual and environmental factors associated to those symptoms. METHODS A cross-sectional survey was carried out using a paper based, self administered questionnaire. The questionnaire includes individual and movie characteristics and selected visually induced symptoms (tired eyes, double vision, headache, dizziness, nausea and palpitations). Symptoms were queried at 3 different times: during, right after and after 2 hours from the movie. RESULTS We collected 953 questionnaires. In our sample, 539 (60.4%) individuals reported 1 or more symptoms during the movie, 392 (43.2%) right after and 139 (15.3%) at 2 hours from the movie. The most frequently reported symptoms were tired eyes (during the movie by 34.8%, right after by 24.0%, after 2 hours by 5.7% of individuals) and headache (during the movie by 13.7%, right after by 16.8%, after 2 hours by 8.3% of individuals). Individual history for frequent headache was associated with tired eyes (OR = 1.34, 95%CI = 1.01-1.79), double vision (OR = 1.96; 95%CI = 1.13-3.41), headache (OR = 2.09; 95%CI = 1.41-3.10) during the movie and of headache after the movie (OR = 1.64; 95%CI = 1.16-2.32). Individual susceptibility to car sickness, dizziness, anxiety level, movie show time, animation 3D movie were also associated to several other symptoms. CONCLUSIONS The high occurrence of visually induced symptoms resulting from this survey suggests the need of raising public awareness on possible discomfort that susceptible individuals may suffer during and after the vision of 3D movies.
Collapse
Affiliation(s)
- Angelo G Solimini
- Department of Public Health and Infectious Diseases, Sapienza University of Rome, Piazza Aldo Moro, 5, 00185, Rome, Italy
| | - Alice Mannocci
- Department of Public Health and Infectious Diseases, Sapienza University of Rome, Piazza Aldo Moro, 5, 00185, Rome, Italy
| | - Domitilla Di Thiene
- Department of Public Health and Infectious Diseases, Sapienza University of Rome, Piazza Aldo Moro, 5, 00185, Rome, Italy
| | - Giuseppe La Torre
- Department of Public Health and Infectious Diseases, Sapienza University of Rome, Piazza Aldo Moro, 5, 00185, Rome, Italy
| |
Collapse
|