A wellness platform for stereoscopic 3D video systems using EEG-based visual discomfort evaluation technology

A Review on Human Comfort Factors, Measurements, and Improvements in Human-Robot Collaboration

As the development of robotics technologies for collaborative robots (COBOTs), the applications of human-robot collaboration (HRC) have been growing in the past decade. Despite the tremendous efforts from both academia and industry, the overall usage and acceptance of COBOTs are still not so high as expected. One of the major affecting factors is the comfort of humans in HRC, which is usually less emphasized in COBOT development; however, it is critical to the user acceptance during HRC. Therefore, this paper gives a review of human comfort in HRC including the influential factors of human comfort, measurement of human comfort in terms of subjective and objective manners, and human comfort improvement approaches in the context of HRC. Discussions on each topic are also conducted based on the review and analysis.

Mixture Kernel Density Estimation and Remedied Correlation Matrix on the EEG-Based Copula Model for the Assessment of Visual Discomfort

Since electroencephalogram (EEG) signals can directly provide information on changes in brain activity due to behaviour changes, how to assess visual discomfort through EEG signals attracts researchers’ attention. However, previous assessments based on time-domain EEG features lack sufficient consideration of the dependence among EEG signals, which may affect the discrimination to visual discomfort. Although the copula model can explore the dependence among variables, the EEG-based copula models still have the following deficiencies: (1) the methods ignoring the fine-grained information hidden in EEG signals could make the estimated marginal density function improper, and (2) the approaches neglecting the pseudo-correlation among data may inappropriately estimate the correlation matrix parameter of the copula density function. The mixture kernel density estimation (MKDE) and remedied correlation matrix (RCM) on the EEG-based copula model are proposed to mitigate the mentioned shortcomings. The simulation experiments show that MKDE can not only better estimate the marginal density function but also explore fine-grained information. The RCM can be closer to the real correlation matrix parameter. With the favourable quality of the proposed EEG-based model, it is used to extract time-domain EEG features to assess visual discomfort further. To our best knowledge, the extracted features present better discrimination to visual discomfort compared with the features extracted by the state-of-the-art method.

Single stimulus location for two inputs: A combined brain-computer interface based on Steady-State Visual Evoked Potential (SSVEP)

Brain-computer interfaces (BCI) help severely paralyzed people communicate with the outside world. One type of BCI depends on eye movements and has high information transfer (ITR) but is tiring for users and not applicable to people with eye dyskinesia. Conversely, independent BCIs enable attention shifts across visual stimuli without eye movement, but at the cost of a lower ITR. Steady-state visual evoked potential (SSVEP) is an oscillatory brain response and typically used as BCI signal sources because of high signal-to-noise ratio (SNR). Considering the effect of attentional modulation on the SSVEP, we proposed the novel concept of one-to-two BCI to optimize existing problems, wherein the target and other stimuli shared the same location. Specifically, two spatially overlapping stimuli were displayed in the center-of-view field, as in the independent BCI, and participants were required to divide their attention between the right and left visual fields, as in the dependent BCI. Using three different design schemes in two experiments, we aimed to provide a new framework for BCI design by exploring the feasibility of a combined BCI that can realize a single stimulus location for two inputs. The results strongly demonstrated that, even when the targets and distractors overlapped spatially, the former evoked stronger SSVEP responses. Notably, the BCI scheme based on the object-based attention could achieve a recognition rate as high as 83.2% and an ITR of 12.5 bits per minute. The feasibility of a one-to-two BCI design, which simplified the keyboard layout, reduced the attention shift, and relieved user fatigue, was established.

Stereoscopic Motion Perception Research Based on Steady-state Visual Motion Evoked Potential

The combination of BCI technology and stereoscopic three-dimensional (3D) display has gradually become a trend, while stereo-based BCI has been used in rehabilitation training and medical testing. However, present stereo-based BCI research mainly stays in the static stereo environment, and the main method of visual stimulation is flickering, which does not effectively utilize the characteristic of the stereoscopic display technology. Therefore, we proposed a novel stimulation method based on stereoscopic motion. It utilized the stereo reciprocating motion of the plane of intensive line to elicit steady-state visual motion evoked potential (SSMVEP). The results shown that the correlation canonical analysis (CCA) coefficients of the EEG signal of stereoscopic motion (4.3 Hz-6.3 Hz) was significant higher than the non-stereoscopic motion, and more brain areas were activated. This stimulation method can induce significant visual response and has a great potential in the application of virtual reality stereo-based BCI system.

Effects of disparity on visual discomfort caused by short-term stereoscopic viewing based on electroencephalograph analysis

BACKGROUND

Discomfort evoked by stereoscopic depth has been widely concerned. Previous studies have proposed a comfortable disparity range and considered that disparities exceed this range would cause visual discomfort. Brain activity recordings including Electroencephalograph (EEG) monitoring enable better understanding of perceptual and cognitive processes related to stereo depth-induced visual comfort.

METHODS

EEG data was collected using a stereo-visual evoked potential (VEP) test system by providing visual stimulus to subjects aged from 21 to 25 with normal stereoscopic vision. For each type of visual stimulus, data were processed using directed transfer function (DTF) and adaptive directed transfer function (ADTF) in combination with subjective feedbacks (comfort or discomfort). The topographies of information flow were constructed to compare responses stimulated by different stereoscopic depth, and to determine the difference in comfort and discomfort situations upon stimulation with same stereoscopic depth.

RESULTS

Based on EEG analysis results, we found that the occipital P270 was moderately related to the disparity. Moreover, the ADTF of P270 showed that the information flows at frontal lobe and central-parietal lobe changed when stimulation with different stereoscopic depth applied. As to the stereo images with same stereoscopic depth, the DTF outflows at the temporal and temporal-parietal lobes in δ band, central and central-parietal lobes in α and θ bands, and the comparison of inflows in these three bands could be considered as discriminated indexes for matching the stereoscopic effect with viewers' comfort or discomfort state impacted by disparity. The subjective feedbacks indicated that the comfort judgments remained as a result of cumulative effect.

CONCLUSIONS

This study proposed a short-term stereo-VEP experiment that shorted the duration of each stimulus in the experimental scheme to minimize the interference from other factors except the disparity. The occipital P270 had a mid-relevance to the disparity and its ADTF showed the affected areas when viewers are receiving stimulations with different disparities. DTF could be considered as discriminated indexes for matching the stereoscopic effect with viewers' comfort or discomfort state induced by disparity. This study proposed a preferable experiment to observe the single effect of disparity and provided an intuitive and easy-to-read result in a more convenient manner.