Graph-Based Analysis of Visual Scanning Patterns: A Developmental Study on Green and Normal Images

Gaze-based attention network analysis in a virtual reality classroom

This article provides a step-by-step guideline for measuring and analyzing visual attention in 3D virtual reality (VR) environments based on eye-tracking data. We propose a solution to the challenges of obtaining relevant eye-tracking information in a dynamic 3D virtual environment and calculating interpretable indicators of learning and social behavior. With a method called "gaze-ray casting," we simulated 3D-gaze movements to obtain information about the gazed objects. This information was used to create graphical models of visual attention, establishing attention networks. These networks represented participants' gaze transitions between different entities in the VR environment over time. Measures of centrality, distribution, and interconnectedness of the networks were calculated to describe the network structure. The measures, derived from graph theory, allowed for statistical inference testing and the interpretation of participants' visual attention in 3D VR environments. Our method provides useful insights when analyzing students' learning in a VR classroom, as reported in a corresponding evaluation article with N = 274 participants. •Guidelines on implementing gaze-ray casting in VR using the Unreal Engine and the HTC VIVE Pro Eye.•Creating gaze-based attention networks and analyzing their network structure.•Implementation tutorials and the Open Source software code are provided via OSF: https://osf.io/pxjrc/?view_only=1b6da45eb93e4f9eb7a138697b941198.

Towards tacit knowledge mining within context: Visual cognitive graph model and eye movement image interpretation

Visual attention is one of the most important brain cognitive functions, which filters the rich information of the outside world to ensure the efficient operation of limited cognitive resources. The underlying knowledge, i.e., tacit knowledge, hidden in the human attention allocation performances, is context-related and is hard to be expressed by experts, but it is essential for novice operator training and interaction system design. Traditional models of visual attention allocation and corresponding analysis methods seldomly involve task contextual information or present the tacit knowledge in an explicit and quantified way. Thus, it is challenging to pass on the expert's tacit knowledge to the novice or utilize it to construct an interaction system by employing traditional methods. Therefore, this paper first proposes a new model called the visual cognitive graph model based on graph theory to model the visual attention allocation associated with the task context. Then, based on this graph model, utilize the data mining method to reveal attention patterns within context to quantitatively analyze the operator's tacit knowledge during operation tasks. We introduced three physical quantities derived from graph theory to describe the tacit knowledge, which can be used directly to construct an interaction system or operator training. For example, discover the essential information within the task context, the relevant information affecting critical information, and the bridge information revealing the decision-making process. We tested the proposed method in the example of flight operation, the comparison results with the traditional eye movement graph model demonstrate that the proposed visual cognitive model can compromise the task context. The comparison results with the statistical analysis method demonstrate that our tacit knowledge mining method can reveal the underlying knowledge hidden in the visual information. Finally, we give practical applications in the examples of operator training guidance and adaptive interaction system. Our proposed method can explore more in-depth knowledge of visual information, such as the correlations of different obtained information and the way operator obtains information, most of which are even not noticed by operators themselves.

Contribution of Eye-Tracking to Study Cognitive Impairments Among Clinical Populations

In the field of psychology, the merge of decision-theory and neuroscientific methods produces an array of scientifically recognized paradigms. For example, by exploring consumer’s eye-movement behavior, researchers aim to deepen the understanding of how patterns of retinal activation are being meaningfully transformed into visual experiences and connected with specific reactions (e.g., purchase). Notably, eye-movements provide knowledge of one’s homeostatic balance and gatekeep information that shape decisions. Hence, vision science investigates the quality of observed environments determined under various experimental conditions. Moreover, it answers questions on how human process visual stimuli and use gained information for a successful strategy to achieve certain goals. While capturing cognitive states with the support of the eye-trackers progresses at a relatively fast pace in decision-making research, measuring the visual performance of real-life tasks, which require complex cognitive skills, is tentatively translated into clinical experiments. Nevertheless, the potential of the human eye as a highly valuable source of biomarkers has been underlined. In this article, we aim to draw readers attention to decision-making experimental paradigms supported with eye-tracking technology among clinical populations. Such interdisciplinary approach may become an important component that will (i) help in objectively illustrating patient’s models of beliefs and values, (ii) support clinical interventions, and (iii) contribute to health services. It is possible that shortly, eye-movement data from decision-making experiments will grant the scientific community a greater understanding of mechanisms underlining mental states and consumption practices that medical professionals consider as obsessions, disorders or addiction.