Eye movements are functional during face learning

The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception

During face-to-face conversation the face provides auditory and visual linguistic information, and also conveys information about the identity of the speaker. This study investigated behavioral strategies involved in gathering visual information while watching talking faces. The effects of varying talker identity and varying the intelligibility of speech (by adding acoustic noise) on gaze behavior were measured with an eyetracker. Varying the intelligibility of the speech by adding noise had a noticeable effect on the location and duration of fixations. When noise was present subjects adopted a vantage point that was more centralized on the face by reducing the frequency of the fixations on the eyes and mouth and lengthening the duration of their gaze fixations on the nose and mouth. Varying talker identity resulted in a more modest change in gaze behavior that was modulated by the intelligibility of the speech. Although subjects generally used similar strategies to extract visual information in both talker variability conditions, when noise was absent there were more fixations on the mouth when viewing a different talker every trial as opposed to the same talker every trial. These findings provide a useful baseline for studies examining gaze behavior during audiovisual speech perception and perception of dynamic faces.

Eye-hand strategies in copying complex lines

Eye movements and eye–hand interactions have been recorded for 10 beginner art students copying complex lines representing outlines of caricature heads seen in profile. Four copying conditions mimicking real-world drawing situations were tested: Direct copying where the original and copy were placed side by side, Direct Blind copying where the subject could not see the drawing hand and copy, Memory copying where the original was first memorized for drawing and subsequently hidden before drawing commenced, and Non-specific Memory copying where the original was encoded for facial recognition before being hidden and drawn from memory. We observed four very different eye–hand interaction strategies which provide evidence for the eye's dual role in the copying process: acquiring visual information in order to activate the visuomotor transformation and guiding the hand on the paper. The Direct copying strategies were best understood in terms of a Drawing Hypothesis stating that shape is the result of visuomotor mapping alone and, consequently, can be accurately drawn without vision of the drawing hand or paper. A double just-in-time mechanism is proposed whereby the eye refers alternatively to the original for shape and to the copy for spatial position just in time for the drawing action to proceed continuously.

The influence of change in the size of face elements on the perception of a woman's portrait

This research attempts to answer the question how the change of selected face elements influences the likeness between the original portrait (sketch) and its modified versions. For this purpose, several series of portraits were created into which changes to the original sizes of eyes, mouth and nose within a scope of +/-14% (every 2%) were introduced. The task for a subject consisted of indicating one portrait out of each row that was the first to be "clearly unlike the original image". In this way, two values were obtained for each feature (lesser and greater than the initial one). These values have been called "the terminal values", i.e. those which, according to the subjects, once exceeded, the portrait becomes unlike the original. The results obtained indicate that the majority of the subjects, as much as 61.7%, consider the face they observe to be "clearly different" when the change of the studied features amounts to at least 8% of the original value, or even 6% in some cases. In addition, it has been noticed that, in the process of identification, men much earlier than women (p=0.049) consider the portraits in the row with the reduction of eye size unlike the original image.

Age-related deficits in face recognition are related to underlying changes in scanning behavior

Previous studies demonstrating age-related impairments in recognition memory for faces are suggestive of underlying differences in face processing. To study these differences, we monitored eye movements while younger and older adults viewed younger and older faces. Compared to the younger group, older adults showed increased sampling of facial features, and more transitions. However, their scanning behavior was most similar to the younger group when looking at older faces. Moreover, while older adults exhibited worse recognition memory than younger adults overall, their memory was more accurate for older faces. These findings suggest that age-related differences in recognition memory for faces may be related to changes in scanning behavior, and that older adults may use social group status as a compensatory processing strategy.

Early face processing specificity: it's in the eyes!

Unlike most other objects that are processed analytically, faces are processed configurally. This configural processing is reflected early in visual processing following face inversion and contrast reversal, as an increase in the N170 amplitude, a scalp-recorded event-related potential. Here, we show that these face-specific effects are mediated by the eye region. That is, they occurred only when the eyes were present, but not when eyes were removed from the face. The N170 recorded to inverted and negative faces likely reflects the processing of the eyes. We propose a neural model of face processing in which face- and eye-selective neurons situated in the superior temporal sulcus region of the human brain respond differently to the face configuration and to the eyes depending on the face context. This dynamic response modulation accounts for the N170 variations reported in the literature. The eyes may be central to what makes faces so special.

Explicit versus implicit gaze processing assessed by ERPs

Gaze processing was investigated using event-related potentials in two different tasks in which front-view and 3/4-view faces were presented, with eyes gazing straight ahead or averted. Task alternated between an explicit gaze direction judgment and a judgment on head orientation where gaze was irrelevant. Accuracy and reaction times were affected by the congruency of gaze and head directions in both tasks suggesting gaze was processed implicitly in the head orientation task. In both tasks, larger P1 and N170 were found for 3/4-view faces compared to front-view faces that were not due to the luminance or contrast of the pictures. The N170 was also larger for averted than straight gaze but for front-view faces only. In contrast, larger amplitudes for straight than averted gaze were reliably measured around 400-600 ms regardless of head orientation or task demands, and likely reflected the outcome of gaze processing. The results suggest that head orientation and gaze direction discrimination occur regardless of task demands and interact at the decision making level. Neural markers of head orientation occur before those for gaze direction and the early structural encoding stages of face processing are view-dependant.

Eye movements during information processing tasks: individual differences and cultural effects

The eye movements of native English speakers, native Chinese speakers, and bilingual Chinese/English speakers who were either born in China (and moved to the US at an early age) or in the US were recorded during six tasks: (1) reading, (2) face processing, (3) scene perception, (4) visual search, (5) counting Chinese characters in a passage of text, and (6) visual search for Chinese characters. Across the different groups, there was a strong tendency for consistency in eye movement behavior; if fixation durations of a given viewer were long on one task, they tended to be long on other tasks (and the same tended to be true for saccade size). Some tasks, notably reading, did not conform to this pattern. Furthermore, experience with a given writing system had a large impact on fixation durations and saccade lengths. With respect to cultural differences, there was little evidence that Chinese participants spent more time looking at the background information (and, conversely less time looking at the foreground information) than the American participants. Also, Chinese participants' fixations were more numerous and of shorter duration than those of their American counterparts while viewing faces and scenes, and counting Chinese characters in text.

Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation

Convergent evidence from functional imaging and from neuropsychological studies of basal ganglia disorders indicates that the striatum is involved in learning to categorize visual stimuli with feedback. However, it is unclear which cognitive process or processes involved in categorization is or are responsible for striatal recruitment; different regions of the striatum have been linked to feedback processing and to acquisition of stimulus-category associations. We examined the effect of the presence of feedback during learning on striatal recruitment by comparing feedback learning with observational learning of an information integration task. In the feedback task, participants were shown a stimulus, made a button press response, and then received feedback as to whether they had made the correct response. In the observational task, participants were given the category label before the stimulus appeared and then made a button press indicating the correct category membership. A region-of-interest analysis was used to examine activity in three regions of the striatum: the head of the caudate, body and tail of the caudate, and the putamen. Activity in the left head of the caudate was modulated by the presence of feedback: The magnitude of activation change was greater during feedback learning than during observational learning. In contrast, the bilateral body and tail of the caudate and the putamen were active to a similar degree in both feedback and observational learning. This pattern of results supports a functional dissociation between regions of the striatum, such that the head of the caudate is involved in feedback processing, whereas the body and tail of the caudate and the putamen are involved in learning stimulus-category associations. The hippocampus was active bilaterally during both feedback and observational learning, indicating potential parallel involvement with the striatum in information integration category learning.

Eyes always attract attention but gaze orienting is task-dependent: Evidence from eye movement monitoring

Eyes and gaze are central to social cognition but whether they attract attention differently depending on the task is unknown. Here, the shift in attention towards the eye region and gaze direction of a perceived face was studied in two tasks by monitoring eye movements. The same face stimuli in front- or 3/4-view, with direct or averted gaze, were used in both tasks. In the Gaze task, subjects performed an explicit gaze direction judgment (gaze straight or averted) while in the Head task they performed a head orientation judgment (front- or 3/4-view). Gaze processing was evident in both tasks as shown by longer RTs and lower accuracy when head and gaze directions did not match. In both tasks the eye region was the most attended area but the amount of viewing was task-dependent. Most importantly, approximately 90% of the initial saccades landed in the eye region in the Gaze task but only approximately 50% of them did so in the Head task. These saccades were made in the direction signaled by gaze in the Gaze task but in the direction signaled by head orientation in the Head task. Altogether, these task-modulated behaviors argue against a purely exogenous and automatic orienting-to-gaze mechanism. Based on patient work and neuroimaging studies of gaze processing, we suggest that this task-dependent orienting behavior is rather endogenous and subtended by cortical areas amongst which frontal regions play a central role. We discuss the implications of this finding for clinical populations.

Look-ahead fixations: anticipatory eye movements in natural tasks

During performance of natural tasks subjects sometimes fixate objects that are manipulated several seconds later. Such early looks are known as "look-ahead fixations" (Pelz and Canosa in Vision Res 41(25-26):3587-3596, 2001). To date, little is known about their function. To investigate the possible role of these fixations, we measured fixation patterns in a model-building task. Subjects assembled models in two sequences where reaching and grasping were interrupted in one sequence by an additional action. Results show look-ahead fixations prior to 20% of the reaching and grasping movements, occurring on average 3 s before the reach. Their frequency was influenced by task sequence, suggesting that they are purposeful and have a role in task planning. To see if look-aheads influenced the subsequent eye movement during the reach, we measured eye-hand latencies and found they increased by 122 ms following a look-ahead to the target. The initial saccades to the target that accompanied a reach were also more accurate following a look-ahead. These results demonstrate that look-aheads influence subsequent visuo-motor coordination, and imply that visual information on the temporal and spatial structure of the scene was retained across intervening fixations and influenced subsequent movement programming. Additionally, head movements that accompanied look-aheads were significantly smaller in amplitude (by 10 degrees) than those that accompanied reaches to the same locations, supporting previous evidence that head movements play a role in the control of hand movements. This study provides evidence of the anticipatory use of gaze in acquiring information about objects for future manipulation.

Honeybee (Apis mellifera) vision can discriminate between and recognise images of human faces

Recognising individuals using facial cues is an important ability. There is evidence that the mammalian brain may have specialised neural circuitry for face recognition tasks, although some recent work questions these findings. Thus, to understand if recognising human faces does require species-specific neural processing, it is important to know if non-human animals might be able to solve this difficult spatial task. Honeybees (Apis mellifera) were tested to evaluate whether an animal with no evolutionary history for discriminating between humanoid faces may be able to learn this task. Using differential conditioning, individual bees were trained to visit target face stimuli and to avoid similar distractor stimuli from a standard face recognition test used in human psychology. Performance was evaluated in non-rewarded trials and bees discriminated the target face from a similar distractor with greater than 80% accuracy. When novel distractors were used, bees also demonstrated a high level of choices for the target face, indicating an ability for face recognition. When the stimuli were rotated by 180 degrees there was a large drop in performance, indicating a possible disruption to configural type visual processing.