Modelling the influence of central and peripheral information on saccade biases in gaze-contingent scene viewing

Eye movements during visual imagery and perception show spatial correspondence but have unique temporal signatures

Eye fixation patterns during mental imagery are similar to those during perception of the same picture, suggesting that oculomotor mechanisms play a role in mental imagery (i.e., the "looking at nothing" effect). Previous research has focused on the spatial similarities of eye movements during perception and mental imagery. The primary aim of this study was to assess whether the spatial similarity translates to the temporal domain. We used recurrence quantification analysis (RQA) to assess the temporal structure of eye fixations in visual perception and mental imagery and we compared the temporal as well as the spatial characteristics in mental imagery with perception by means of Bayesian hierarchical regression models. We further investigated how person and picture-specific characteristics contribute to eye movement behavior in mental imagery. Working memory capacity and mental imagery abilities were assessed to either predict gaze dynamics in visual imagery or to moderate a possible correspondence between spatial or temporal gaze dynamics in perception and mental imagery. We were able to show the spatial similarity of fixations between visual perception and imagery and we provide first evidence for its moderation by working memory capacity. Interestingly, the temporal gaze dynamics in mental imagery were unrelated to those in perception and their variance between participants was not explained by variance in visuo-spatial working memory capacity or vividness of mental images. The semantic content of the imagined pictures was the only meaningful predictor of temporal gaze dynamics. The spatial correspondence reflects shared spatial structure of mental images and perceived pictures, while the unique temporal gaze behavior could be driven by generation, maintenance and protection processes specific to visual imagery. The unique temporal gaze dynamics offer a window to new insights into the genuine process of mental imagery independent of its similarity to perception.

Switch from ambient to focal processing mode explains the dynamics of free viewing eye movements

Previous studies have reported that humans employ ambient and focal modes of visual exploration while they freely view natural scenes. These two modes have been characterized based on eye movement parameters such as saccade amplitude and fixation duration, but not by any visual features of the viewed scenes. Here we propose a new characterization of eye movements during free viewing based on how eyes are moved from and to objects in a visual scene. We applied this characterization to data obtained from freely-viewing macaque monkeys. We show that the analysis based on this characterization gives a direct indication of a behavioral shift from ambient to focal processing mode along the course of free viewing exploration. We further propose a stochastic model of saccade sequence generation incorporating a switch between the two processing modes, which quantitatively reproduces the behavioral features observed in the data.

Eye and head movements are complementary in visual selection

In the natural environment, visual selection is accomplished by a system of nested effectors, moving the head and body within space and the eyes within the visual field. However, it is not yet known if the principles of selection for these different effectors are the same or different. We used a novel gaze-contingent display in which an asymmetric window of visibility (a horizontal or vertical slot) was yoked to either head or eye position. Participants showed highly systematic changes in behaviour, revealing clear differences in the principles underlying selection by eye and head. Eye movements were more likely to move in the direction of visible information-horizontally when viewing with a horizontal slot, and vertically with a vertical slot. Head movements showed the opposite and complementary pattern, moving to reveal new information (e.g. vertically with a horizontal slot and vice versa). These results are consistent with a nested system in which the head favours exploration of unknown regions, while the eye exploits what can be seen with finer-scale saccades.

Examination strategies of experienced and novice clinicians viewing the retina

PURPOSE

Expertise in viewing medical images is thought to be due to the ability to process holistic image information. Eye care clinicians can inspect photographs of the retina to search for signs of disease. However, they commonly also view the eye in vivo using the restricted view of a slit lamp, which removes the potential benefits of holistic processing. We investigated how expert and novice clinicians inspect the fundus using these two methods.

METHODS

Twenty clinicians (10 experienced, 10 novices) examined 64 photographs of human retinae. Each participant viewed half of the images as fundus photographs while having their eye position recorded. The other half were viewed via a simple slit lamp simulation, whereby a computer mouse was used to control the position of a viewing window that revealed the underlying fundus photograph.

RESULTS

Experienced clinicians made decisions significantly faster than novices, with faster decision-making when viewing the fundus photograph compared to via the slit lamp simulation. The distribution of inspection was similar, although novices spent longer examining the optic nerve head than other regions. Experienced clinicians showed significantly earlier inspection of the optic nerve head when it was judged to be unhealthy.

CONCLUSIONS

Our results support the idea that experienced eyecare clinicians use holistic image information, if available, when inspecting the fundus. This was particularly prominent for the optic nerve head region, which was the region that novices spent most of their time examining. Holistic processing benefits were only present in experts' free-viewing fundus photographs; the limited field of view from the slit lamp disrupts such global image benefits.

Leftward biases in picture scanning and line bisection: a gaze-contingent window study

A bias for humans to attend to the left side of space has been reported in a variety of experiments. While patients with hemispatial neglect mistakenly bisect horizontal lines to the right of centre, neurologically healthy individuals show a mean leftward error. Here, two experiments demonstrated a robust tendency for participants to saccade to the left when viewing photographs. We were able to manipulate this bias by using an asymmetrical gaze-contingent window, which revealed more of the scene on one side of fixation-causing participants to saccade more often in that direction. A second experiment demonstrated the same change in eye movements occurring rapidly from trial to trial, and investigated whether it would carry over and effect attention during a line bisection task. There was some carry-over from gaze-contingent scene viewing to the eye movements during line bisection. However, despite frequent initial eye movements and many errors to the left, manual responses were not affected by this change in orienting. We conclude that the mechanisms underlying asymmetrical attention in picture scanning and line bisection are flexible and can be separated, with saccades in scene perception driven more by a skewed perceptual span.