Humans are Detected More Efficiently than Machines in the Context of Natural Scenes

A perceptual field test in object experts using gaze-contingent eye tracking

A hallmark of expert object recognition is rapid and accurate subordinate-category recognition of visually homogenous objects. However, the perceptual strategies by which expert recognition is achieved is less known. The current study investigated whether visual expertise changes observers' perceptual field (e.g., their ability to use information away from fixation for recognition) for objects in their domain of expertise, using a gaze-contingent eye-tracking paradigm. In the current study, bird experts and novices were presented with two bird images sequentially, and their task was to determine whether the two images were of the same species (e.g., two different song sparrows) or different species (e.g., song sparrow and chipping sparrow). The first study bird image was presented in full view. The second test bird image was presented fully visible (full-view), restricted to a circular window centered on gaze position (central-view), or restricted to image regions beyond a circular mask centered on gaze position (peripheral-view). While experts and novices did not differ in their eye-movement behavior, experts' performance on the discrimination task for the fastest responses was less impaired than novices in the peripheral-view condition. Thus, the experts used peripheral information to a greater extent than novices, indicating that the experts have a wider perceptual field to support their speeded subordinate recognition.

Comparable search efficiency for human and animal targets in the context of natural scenes

In a previous series of studies, we have shown that search for human targets in the context of natural scenes is more efficient than search for mechanical targets. Here we asked whether this search advantage extends to other categories of biological objects. We used videos of natural scenes to directly contrast search efficiency for animal and human targets among biological or nonbiological distractors. In visual search arrays consisting of two, four, six, or eight videos, observers searched for animal targets among machine distractors, and vice versa (Exp. 1). Another group searched for animal targets among human distractors, and vice versa (Exp. 2). We measured search slope as a proxy for search efficiency, and complemented the slope with eye movement measurements (fixation duration on the target, as well as the proportion of first fixations landing on the target). In both experiments, we observed no differences in search slopes or proportions of first fixations between any of the target-distractor category pairs. With respect to fixation durations, we found shorter on-target fixations only for animal targets as compared to machine targets (Exp. 1). In summary, we did not find that the search advantage for human targets over mechanical targets extends to other biological objects. We also found no search advantage for detecting humans as compared to other biological objects. Overall, our pattern of findings suggests that search efficiency in natural scenes, as elsewhere, depends crucially on the specific target-distractor categories.

Look up to the body: An eye-tracking investigation of 7-months-old infants' visual exploration of emotional body expressions

The human body is an important source of information to infer a person's emotional state. Research with adult observers indicate that the posture of the torso, arms and hands provide important perceptual cues for recognising anger, fear and happy expressions. Much less is known about whether infants process body regions differently for different body expressions. To address this issue, we used eye tracking to investigate whether infants' visual exploration patterns differed when viewing body expressions. Forty-eight 7-months-old infants were randomly presented with static images of adult female bodies expressing anger, fear and happiness, as well as an emotionally-neutral posture. Facial cues to emotional state were removed by masking the faces. We measured the proportion of looking time, proportion and number of fixations, and duration of fixations on the head, upper body and lower body regions for the different expressions. We showed that infants explored the upper body more than the lower body. Importantly, infants at this age fixated differently on different body regions depending on the expression of the body posture. In particular, infants spent a larger proportion of their looking times and had longer fixation durations on the upper body for fear relative to the other expressions. These results extend and replicate the information about infant processing of emotional expressions displayed by human bodies, and they support the hypothesis that infants' visual exploration of human bodies is driven by the upper body.

Searching for illusory motion

In a series of four experiments, standard visual search was used to explore whether the onset of illusory motion pre-attentively guides vision in the same way that the onset of real-motion is known to do. Participants searched for target stimuli based on Akiyoshi Kitaoka's classic illusions, configured so that they either did or did not give the subjective impression of illusory motion. Distractor items always contained the same elements as target items, but did not convey a sense of illusory motion. When target items contained illusory motion, they popped-out, with flat search slopes that were independent of set size. Search for control items without illusory motion - but with identical structural differences to distractors - was slow and serial in nature (> 200 ms/item). Using a nulling task, we estimated the speed of illusory rotation in our displays to be approximately 2 °/s. Direct comparison of illusory and real-motion targets moving with matched velocity showed that illusory motion targets were detected more quickly. Blurred target items that conveyed a weak subjective impression of illusory motion gave rise to serial but faster (< 100 ms/item) search than control items. Our behavioral findings of parallel detection across the visual field, together with previous imaging and neurophysiological studies, suggests that relatively early cortical areas play a causal role in the perception of illusory motion. Furthermore, we hope to re-emphasize the way in which visual search can be used as a flexible, objective measure of illusion strength.