Identification of facial images in peripheral vision

Short-latency preference for faces in primate superior colliculus depends on visual cortex

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here, we report that visual neurons in the midbrain superior colliculus (SC) of macaque monkeys display a preference for images of faces. This preference emerges within 40 ms of stimulus onset-well before "face patches" in visual cortex-and, at the population level, can be used to distinguish faces from other visual objects with accuracies of ∼80%. This short-latency face preference in SC depends on signals routed through early visual cortex because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Object recognition in primates: what can early visual areas contribute?

Introduction

If neuroscientists were asked which brain area is responsible for object recognition in primates, most would probably answer infero-temporal (IT) cortex. While IT is likely responsible for fine discriminations, and it is accordingly dominated by foveal visual inputs, there is more to object recognition than fine discrimination. Importantly, foveation of an object of interest usually requires recognizing, with reasonable confidence, its presence in the periphery. Arguably, IT plays a secondary role in such peripheral recognition, and other visual areas might instead be more critical.

Methods

To investigate how signals carried by early visual processing areas (such as LGN and V1) could be used for object recognition in the periphery, we focused here on the task of distinguishing faces from non-faces. We tested how sensitive various models were to nuisance parameters, such as changes in scale and orientation of the image, and the type of image background.

Results

We found that a model of V1 simple or complex cells could provide quite reliable information, resulting in performance better than 80% in realistic scenarios. An LGN model performed considerably worse.

Discussion

Because peripheral recognition is both crucial to enable fine recognition (by bringing an object of interest on the fovea), and probably sufficient to account for a considerable fraction of our daily recognition-guided behavior, we think that the current focus on area IT and foveal processing is too narrow. We propose that rather than a hierarchical system with IT-like properties as its primary aim, object recognition should be seen as a parallel process, with high-accuracy foveal modules operating in parallel with lower-accuracy and faster modules that can operate across the visual field.

Featural Representation and Internal Noise Underlie the Eccentricity Effect in Contrast Sensitivity

Human visual performance for basic visual dimensions (e.g., contrast sensitivity and acuity) peaks at the fovea and decreases with eccentricity. The eccentricity effect is related to the larger visual cortical surface area corresponding to the fovea, but it is unknown if differential feature tuning contributes to this eccentricity effect. Here, we investigated two system-level computations underlying the eccentricity effect: featural representation (tuning) and internal noise. Observers (both sexes) detected a Gabor embedded in filtered white noise which appeared at the fovea or one of four perifoveal locations. We used psychophysical reverse correlation to estimate the weights assigned by the visual system to a range of orientations and spatial frequencies (SFs) in noisy stimuli, which are conventionally interpreted as perceptual sensitivity to the corresponding features. We found higher sensitivity to task-relevant orientations and SFs at the fovea than that at the perifovea, and no difference in selectivity for either orientation or SF. Concurrently, we measured response consistency using a double-pass method, which allowed us to infer the level of internal noise by implementing a noisy observer model. We found lower internal noise at the fovea than that at the perifovea. Finally, individual variability in contrast sensitivity correlated with sensitivity to and selectivity for task-relevant features as well as with internal noise. Moreover, the behavioral eccentricity effect mainly reflects the foveal advantage in orientation sensitivity compared with other computations. These findings suggest that the eccentricity effect stems from a better representation of task-relevant features and lower internal noise at the fovea than that at the perifovea.

Short-latency preference for faces in the primate superior colliculus

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Featural representation and internal noise underlie the eccentricity effect in contrast sensitivity

Human visual performance for basic visual dimensions (e.g., contrast sensitivity and acuity) peaks at the fovea and decreases with eccentricity. The eccentricity effect is related to the larger surface area of the visual cortex corresponding to the fovea, but it is unknown if differential feature tuning contributes to this eccentricity effect. Here, we investigated two system-level computations underlying the eccentricity effect: featural representation (tuning) and internal noise. Observers (both sexes) detected a Gabor embedded in filtered white noise which appeared at the fovea or one of four perifoveal locations. We used psychophysical reverse correlation to estimate the weights assigned by the visual system to a range of orientations and spatial frequencies (SFs) in noisy stimuli, which are conventionally interpreted as perceptual sensitivity to the corresponding features. We found higher sensitivity to task-relevant orientations and SFs at the fovea than the perifovea, and no difference in selectivity for either orientation or SF. Concurrently, we measured response consistency using a double-pass method, which allowed us to infer the level of internal noise by implementing a noisy observer model. We found lower internal noise at the fovea than perifovea. Finally, individual variability in contrast sensitivity correlated with sensitivity to and selectivity for task-relevant features as well as with internal noise. Moreover, the behavioral eccentricity effect mainly reflects the foveal advantage in orientation sensitivity compared to other computations. These findings suggest that the eccentricity effect stems from a better representation of task-relevant features and lower internal noise at the fovea than at the perifovea.

Figure–Ground Segmentation and Biological Motion Perception in Peripheral Visual Field

Biological motion perception is a specific type of perceptual organization, during which a clear image of a moving human body is perceptually generated in virtue of certain core light dots representing the major joint movements. While the processes of biological motion perception have been studied extensively for almost a century, there is still a debate on whether biological motion task performance can be equally precise across all visual field or is central visual field specified for biological motion perception. The current study explores the processes of biological motion perception and figure–ground segmentation in the central and peripheral visual field, expanding the understanding of perceptual organization across different eccentricities. The method involved three different tasks of visual grouping: (1) a static visual grouping task, (2) a dynamic visual grouping task, and (3) a biological motion detection task. The stimuli in (1) and (2) were generated from 12–13 dots grouped by proximity and common fate, and, in (3), light dots representing human motion. All stimuli were embedded in static or dynamics visual noise and the threshold value for the number of noise dots in which the elements could still be grouped by proximity and/or common fate was determined. The results demonstrate that biological motion can be differentiated from the scrambled set of moving dots in a more intensive visual noise than static and dynamic visual grouping tasks. Furthermore, in all three visual tasks (static and dynamic grouping, and biological motion detection) the performance was significantly worse in the periphery than in the central visual field, and object magnification could not compensate for the reduced performance in any of the three grouping tasks. The preliminary results of nine participants indicate that (a) human motion perception involves specific perceptual processes, providing the high-accuracy perception of the human body and (b) the processes of figure–ground segmentation are governed by the bottom-up processes and the best performance can be achieved only when the object is demonstrated in the central visual field.

Peripheral vision in matching-to-sample procedures

Eye-tracking has been used to investigate observing responses in matching-to-sample procedures. However, in visual search, peripheral vision plays an important role. Therefore, three experiments were conducted to investigate the extent to which adult participants can discriminate stimuli that vary in size and position in the periphery. Experiment 1 used arbitrary matching with abstract stimuli, Experiment 2 used identity matching with abstract stimuli, and Experiment 3 used identity matching with simple (familiar) shapes. In all three experiments, participants were taught eight conditional discriminations establishing four 3-member classes of stimuli. Four different stimulus sizes and three different stimulus positions were manipulated in the 12 peripheral test phases. In these test trials, participants had to fixate their gaze on the sample stimulus in the middle of the screen while selecting a comparison stimulus. Eye movements were measured with a head-mounted eye-tracker during both training and testing. Experiment 1 shows that participants can discriminate small abstract stimuli that are arbitrarily related in the periphery. Experiment 2 shows that matching identical stimuli does not affect discrimination in the periphery compared to arbitrarily related stimuli. However, Experiment 3 shows that discrimination increases when stimuli are well-known simple shapes.

The Detection of Face-like Stimuli at the Edge of the Infant Visual Field

Human infants are highly sensitive to social information in their visual world. In laboratory settings, researchers have mainly studied the development of social information processing using faces presented on standard computer displays, in paradigms exploring face-to-face, direct eye contact social interactions. This is a simplification of a richer visual environment in which social information derives from the wider visual field and detection involves navigating the world with eyes, head and body movements. The present study measured 9-month-old infants’ sensitivities to face-like configurations across mid-peripheral visual areas using a detection task. Upright and inverted face-like stimuli appeared at one of three eccentricities (50°, 55° or 60°) in the left and right hemifields. Detection rates at different eccentricities were measured from video recordings. Results indicated that infant performance was heterogeneous and dropped beyond 55°, with a marginal advantage for targets appearing in the left hemifield. Infants’ orienting behaviour was not influenced by the orientation of the target stimulus. These findings are key to understanding how face stimuli are perceived outside foveal regions and are informative for the design of infant paradigms involving stimulus presentation across a wider field of view, in more naturalistic visual environments.

The retinal and perceived locus of fixation in the human visual system

Due to the dramatic difference in spatial resolution between the central fovea and the surrounding retinal regions, accurate fixation on important objects is critical for humans. It is known that the preferred retinal location (PRL) for fixation of healthy human observers rarely coincides with the retinal location with the highest cone density. It is not currently known, however, whether the PRL is consistent within an observer or is subject to fluctuations and, moreover, whether observers' subjective fixation location coincides with the PRL. We studied whether the PRL changes between days. We used an adaptive optics scanning laser ophthalmoscope to project a Maltese cross fixation target on an observer's retina and continuously imaged the exact retinal location of the target. We found that observers consistently use the same PRL across days, regardless of how much the PRL is displaced from the cone density peak location. We then showed observers small stimuli near the visual field location on which they fixated, and the observers judged whether or not the stimuli appeared in fixation. Observers' precision in this task approached that of fixation itself. Observers based their judgment on both the visual scene coordinates and the retinal location of the stimuli. We conclude that the PRL in a normally functioning visual system is fixed, and observers use it as a reference point in judging stimulus locations.

Peripheral facial features guiding eye movements and reducing fixational variability

Face processing is a fast and efficient process due to its evolutionary and social importance. A majority of people direct their first eye movement to a featureless point just below the eyes that maximizes accuracy in recognizing a person's identity and gender. Yet, the exact properties or features of the face that guide the first eye movements and reduce fixational variability are unknown. Here, we manipulated the presence of the facial features and the spatial configuration of features to investigate their effect on the location and variability of first and second fixations to peripherally presented faces. Our results showed that observers can utilize the face outline, individual facial features, and feature spatial configuration to guide the first eye movements to their preferred point of fixation. The eyes have a preferential role in guiding the first eye movements and reducing fixation variability. Eliminating the eyes or altering their position had the greatest influence on the location and variability of fixations and resulted in the largest detriment to face identification performance. The other internal features (nose and mouth) also contribute to reducing fixation variability. A subsequent experiment measuring detection of single features showed that the eyes have the highest detectability (relative to other features) in the visual periphery providing a strong sensory signal to guide the oculomotor system. Together, the results suggest a flexible multiple-cue approach that might be a robust solution to cope with how the varying eccentricities in the real world influence the ability to resolve individual feature properties and the preferential role of the eyes.

The influence of spatial location on same-different judgments of facial identity and expression

The "spatial congruency bias" is a behavioral phenomenon where 2 objects presented sequentially are more likely to be judged as being the same object if they are presented in the same location (Golomb, Kupitz, & Thiemann, 2014), suggesting that irrelevant spatial location information may be bound to object representations. Here, we examine whether the spatial congruency bias extends to higher-level object judgments of facial identity and expression. On each trial, 2 real-world faces were sequentially presented in variable screen locations, and subjects were asked to make same-different judgments on the facial expression (Experiments 1-2) or facial identity (Experiment 3) of the stimuli. We observed a robust spatial congruency bias for judgments of facial identity, yet a more fragile one for judgments of facial expression. Subjects were more likely to judge 2 faces as displaying the same expression if they were presented in the same location (compared to in different locations), but only when the faces shared the same identity. On the other hand, a spatial congruency bias was found when subjects made judgments on facial identity, even across faces displaying different facial expressions. These findings suggest a possible difference between the binding of facial identity and facial expression to spatial location. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Connectivity at the origins of domain specificity in the cortical face and place networks

It is well established that the adult brain contains a mosaic of domain-specific networks. But how do these domain-specific networks develop? Here we tested the hypothesis that the brain comes prewired with connections that precede the development of domain-specific function. Using resting-state fMRI in the youngest sample of newborn humans tested to date, we indeed found that cortical networks that will later develop strong face selectivity (including the "proto" occipital face area and fusiform face area) and scene selectivity (including the "proto" parahippocampal place area and retrosplenial complex) by adulthood, already show domain-specific patterns of functional connectivity as early as 27 d of age (beginning as early as 6 d of age). Furthermore, we asked how these networks are functionally connected to early visual cortex and found that the proto face network shows biased functional connectivity with foveal V1, while the proto scene network shows biased functional connectivity with peripheral V1. Given that faces are almost always experienced at the fovea, while scenes always extend across the entire periphery, these differential inputs may serve to facilitate domain-specific processing in each network after that function develops, or even guide the development of domain-specific function in each network in the first place. Taken together, these findings reveal domain-specific and eccentricity-biased connectivity in the earliest days of life, placing new constraints on our understanding of the origins of domain-specific cortical networks.

Filtered beauty in Oslo and Tokyo: A spatial frequency analysis of facial attractiveness

Images of European female and male faces were digitally processed to generate spatial frequency (SF) filtered images containing only a narrow band of visual information within the Fourier spectrum. The original unfiltered images and four SF filtered images (low, medium-low, medium-high and high) were then paired in trials that kept constant SF band and face gender and participants made a forced-choice decision about the more attractive among the two faces. In this way, we aimed at identifying those specific SF bands where forced-choice preferences corresponded best to forced-choice judgements made when viewing the natural, broadband, facial images. We found that aesthetic preferences dissociated across SFs and face gender, but similarly for participants from Asia (Japan) and Europe (Norway). Specifically, preferences when viewing SF filtered images were best related to the preference with the broadband face images when viewing the highest filtering band for the female faces (about 48-77 cycles per face). In contrast, for the male faces, the medium-low SF band (about 11-19 cpf) related best to choices made with the natural facial images. Eye tracking provided converging evidence for the above, gender-related, SF dissociations. We suggest greater aesthetic relevance of the mobile and communicative parts for the female face and, conversely, of the rigid, structural, parts for the male face for facial aesthetics.

Temporal modulation improves dynamic peripheral acuity

Macular degeneration and related visual disorders greatly limit foveal function, resulting in reliance on the peripheral retina for tasks requiring fine spatial vision. Here we investigate stimulus manipulations intended to maximize peripheral acuity for dynamic targets. Acuity was measured using a single interval orientation discrimination task at 10° eccentricity. Two types of image motion were investigated along with two different forms of temporal manipulation. Smooth object motion was generated by translating targets along an isoeccentric path at a constant speed (0-20°/s). Ocular motion was simulated by jittering target location using previously recorded fixational eye movement data, amplified by a variable gain factor (0-8). In one stimulus manipulation, the sequence was temporally subsampled by displaying the target on an evenly spaced subset of video frames. In the other, the contrast polarity of the stimulus was reversed at a variable rate. We found that threshold under object motion was improved at all speeds by reversing contrast polarity, while temporal subsampling improved resolution at high speeds but impaired performance at low speeds. With simulated ocular motion, thresholds were consistently improved by contrast polarity reversal, but impaired by temporal subsampling. We find that contrast polarity reversal and temporal subsampling produce differential effects on peripheral acuity. Applying contrast polarity reversal may offer a relatively simple image manipulation that could enhance visual performance in individuals with central vision loss.

Object categorization in visual periphery is modulated by delayed foveal noise

Behavioral studies in humans indicate that peripheral vision can do object recognition to some extent. Moreover, recent studies have shown that some information from brain regions retinotopic to visual periphery is somehow fed back to regions retinotopic to the fovea and disrupting this feedback impairs object recognition in human. However, it is unclear to what extent the information in visual periphery contributes to human object categorization. Here, we designed two series of rapid object categorization tasks to first investigate the performance of human peripheral vision in categorizing natural object images at different eccentricities and abstraction levels (superordinate, basic, and subordinate). Then, using a delayed foveal noise mask, we studied how modulating the foveal representation impacts peripheral object categorization at any of the abstraction levels. We found that peripheral vision can quickly and accurately accomplish superordinate categorization, while its performance in finer categorization levels dramatically drops as the object presents further in the periphery. Also, we found that a 300-ms delayed foveal noise mask can significantly disturb categorization performance in basic and subordinate levels, while it has no effect on the superordinate level. Our results suggest that human peripheral vision can easily process objects at high abstraction levels, and the information is fed back to foveal vision to prime foveal cortex for finer categorizations when a saccade is made toward the target object.

Luminance gradient at object borders communicates object location to the human oculomotor system

The locations of objects in our environment constitute arguably the most important piece of information our visual system must convey to facilitate successful visually guided behaviour. However, the relevant objects are usually not point-like and do not have one unique location attribute. Relatively little is known about how the visual system represents the location of such large objects as visual processing is, both on neural and perceptual level, highly edge dominated. In this study, human observers made saccades to the centres of luminance defined squares (width 4 deg), which appeared at random locations (8 deg eccentricity). The phase structure of the square was manipulated such that the points of maximum luminance gradient at the square's edges shifted from trial to trial. The average saccade endpoints of all subjects followed those shifts in remarkable quantitative agreement. Further experiments showed that the shifts were caused by the edge manipulations, not by changes in luminance structure near the centre of the square or outside the square. We conclude that the human visual system programs saccades to large luminance defined square objects based on edge locations derived from the points of maximum luminance gradients at the square's edges.

Foveal input is not required for perception of crowd facial expression

The visual system extracts average features from groups of objects (Ariely, 2001; Dakin & Watt, 1997; Watamaniuk & Sekuler, 1992), including high-level stimuli such as faces (Haberman & Whitney, 2007, 2009). This phenomenon, known as ensemble perception, implies a covert process, which would not require fixation of individual stimulus elements. However, some evidence suggests that ensemble perception may instead be a process of averaging foveal input across sequential fixations (Ji, Chen, & Fu, 2013; Jung, Bulthoff, Thornton, Lee, & Armann, 2013). To test directly whether foveating objects is necessary, we measured observers' sensitivity to average facial emotion in the absence of foveal input. Subjects viewed arrays of 24 faces, either in the presence or absence of a gaze-contingent foveal occluder, and adjusted a test face to match the average expression of the array. We found no difference in accuracy between the occluded and non-occluded conditions, demonstrating that foveal input is not required for ensemble perception. Unsurprisingly, without foveal input, subjects spent significantly less time directly fixating faces, but this did not translate into any difference in sensitivity to ensemble expression. Next, we varied the number of faces visible from the set to test whether subjects average multiple faces from the crowd. In both conditions, subjects' performance improved as more faces were presented, indicating that subjects integrated information from multiple faces in the display regardless of whether they had access to foveal information. Our results demonstrate that ensemble perception can be a covert process, not requiring access to direct foveal information.

Misidentifying a tennis racket as keys: object identification in people with age-related macular degeneration

PURPOSE

Previous studies showed that people with age-related macular degeneration (AMD) can categorise a pre-defined target object or scene with high accuracy (above 80%). In these studies participants were asked to detect the target (e.g. an animal) in serial visual presentation. People with AMD must rely on peripheral vision which is more adapted to the low resolution required for detection than for the higher resolution required to identify a specific exemplar. We investigated the ability of people with central vision loss to identify photographs of objects and scenes.

METHODS

Photographs of isolated objects, natural scenes and objects in scenes were centrally displayed for 2 s each. Participants were asked to name the stimuli. We measured accuracy and naming times in 20 patients with AMD, 15 age-matched and 12 young controls.

RESULTS

Accuracy was lower (by about 30%) and naming times were longer (by about 300 ms) in people with AMD than in age-matched controls in the three categories of images. Correct identification occurred in 62-66% of the stimuli for patients. More than 20% of the misidentifications resulted from a structural and/or semantic similarity between the object and the name (e.g. spectacles for dog plates or dolphin for shark). Accuracy and naming times did not differ significantly between young and older normally sighted participants indicating that the deficits resulted from pathology rather than to normal ageing.

CONCLUSIONS

These results show that, in contrast to performance for categorisation of a single pre-defined target, people with central vision loss are impaired at identifying various objects and scenes. The decrease in accuracy and the increase in response times in patients with AMD indicate that peripheral vision might be sufficient for object and scene categorisation but not for precise scene or object identification.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

Perceptual grouping across eccentricity

Across the visual field, progressive differences exist in neural processing as well as perceptual abilities. Expansion of stimulus scale across eccentricity compensates for some basic visual capacities, but not for high-order functions. It was hypothesized that as with many higher-order functions, perceptual grouping ability should decline across eccentricity. To test this prediction, psychophysical measurements of grouping were made across eccentricity. Participants indicated the dominant grouping of dot grids in which grouping was based upon luminance, motion, orientation, or proximity. Across trials, the organization of stimuli was systematically decreased until perceived grouping became ambiguous. For all stimulus features, grouping ability remained relatively stable until 40°, beyond which thresholds significantly elevated. The pattern of change across eccentricity varied across stimulus feature, in which stimulus scale, dot size, or stimulus size interacted with eccentricity effects. These results demonstrate that perceptual grouping of such stimuli is not reliant upon foveal viewing, and suggest that selection of dominant grouping patterns from ambiguous displays operates similarly across much of the visual field.

Uniformity and diversity of response properties of neurons in the primary visual cortex: selectivity for orientation, direction of motion, and stimulus size from center to far periphery

Although the primary visual cortex (V1) is one of the most extensively studied areas of the primate brain, very little is known about how the far periphery of visual space is represented in this area. We characterized the physiological response properties of V1 neurons in anaesthetized marmoset monkeys, using high-contrast drifting gratings. Comparisons were made between cells with receptive fields located in three regions of V1, defined by eccentricity: central (3-5°), near peripheral (5-15°), and far peripheral (>50°). We found that orientation selectivity of individual cells was similar from the center to the far periphery. Nonetheless, the proportion of orientation-selective neurons was higher in central visual field representation than in the peripheral representations. In addition, there were similar proportions of cells representing all orientations, with the exception of the representation of the far periphery, where we detected a bias favoring near-horizontal orientations. The proportions of direction-selective cells were similar throughout V1. When the center/surround organization of the receptive fields was tested with gratings with varying diameters, we found that the population of neurons that was suppressed by large gratings was smaller in the far periphery, although the strength of suppression in these cells tended to be stronger. In addition, the ratio between the diameters of the excitatory centers and suppressive surrounds was similar across the entire visual field. These results suggest that, superimposed on the broad uniformity of V1, there are subtle physiological differences, which indicate that spatial information is processed differently in the central versus far peripheral visual fields.

Abnormal fixation in individuals with age-related macular degeneration when viewing an image of a face

PURPOSE

It has been reported that patients with macular disease have difficulties with face perception. Some of this difficulty may be caused by the sensory and perceptual consequences of using peripheral retina. However, strong correlations have not always been found between performance on face tasks and clinical measure of function. Based on the evidence of abnormal eye movements by patients with age-related macular degeneration (AMD), we explored whether abnormal fixation patterns occur when these patients view an image of a face.

METHODS

An OPKO OCT/SLO was used to collect structural and functional data. For each subject, the structural location of disease was determined, and the locus and stability of fixation were quantified. A SLO movie of fundus movements was recorded while the subject viewed an image of a face.

RESULTS

The number of fixations on internal (eyes, nose, and mouth) and external features were measured. A two-way repeated-measures analysis of variance found significant differences between the control and patient groups and among locations. A significant interaction between group and location was also found. Post hoc comparisons found a significantly greater proportion of fixations on external features for the AMD group than that in the control group.

CONCLUSIONS

The observed patterns of fixations of our subjects with AMD were similar to those observed in other groups of patients who have difficulties with face perception. For example, individuals with social phobias, Williams syndrome, autism, schizophrenia, or prosopagnosia have altered face perceptions and also have a significantly greater proportion of fixations on external features of faces. Abnormal eye movement patterns and fixations may contribute to deficits in face perception in AMD patients.

Scene categorization at large visual eccentricities

Studies of scene perception have shown that the visual system is particularly sensitive to global properties such as the overall layout of a scene. Such global properties cannot be computed locally, but rather require relational analysis over multiple regions. To what extent is observers' perception of scenes impaired in the far periphery? We examined the perception of global scene properties (Experiment 1) and basic-level categories (Experiment 2) presented in the periphery from 10° to 70°. Pairs of scene photographs were simultaneously presented left and right of fixation for 80ms on a panoramic screen (5m diameter) covering the whole visual field while central fixation was controlled. Observers were instructed to press a key corresponding to the spatial location left/right of a pre-defined target property or category. The results show that classification of global scene properties (e.g., naturalness, openness) as well as basic-level categorization (e.g., forests, highways), while better near the center, were accomplished with a performance highly above chance (around 70% correct) in the far periphery even at 70° eccentricity. The perception of some global properties (e.g., naturalness) was more robust in peripheral vision than others (e.g., indoor/outdoor) that required a more local analysis. The results are consistent with studies suggesting that scene gist recognition can be accomplished by the low resolution of peripheral vision.

Contour enhancement benefits older adults with simulated central field loss

PURPOSE

Age-related macular degeneration is the leading cause of vision loss among Americans aged >65 years. Currently, no effective treatment can reverse the central vision loss associated with most age-related macular degeneration. Digital image-processing techniques have been developed to improve image visibility for peripheral vision; however, both the selection and efficacy of such methods are limited. Progress has been difficult for two reasons: the exact nature of image enhancement that might benefit peripheral vision is not well understood, and efficient methods for testing such techniques have been elusive. The current study aims to develop both an effective image enhancement technique for peripheral vision and an efficient means for validating the technique.

METHODS

We used a novel contour-detection algorithm to locate shape-defining edges in images based on natural-image statistics. We then enhanced the scene by locally boosting the luminance contrast along such contours. Using a gaze-contingent display, we simulated central visual field loss in normally sighted young (aged 18-30 years) and older adults (aged 58-88 years). Visual search performance was measured as a function of contour enhancement strength ["original" (unenhanced), "medium," and "high"]. For preference task, a separate group of subjects judged which image in a pair "would lead to better search performance."

RESULTS

We found that although contour enhancement had no significant effect on search time and accuracy in young adults, Medium enhancement resulted in significantly shorter search time in older adults (about 13% reduction relative to original). Both age-groups preferred images with Medium enhancement over original (2-7 times). Furthermore, across age-groups, image content types, and enhancement strengths, there was a robust correlation between preference and performance.

CONCLUSIONS

Our findings demonstrate a beneficial role of contour enhancement in peripheral vision for older adults. Our findings further suggest that task-specific preference judgments can be an efficient surrogate for performance testing.

Peripheral vision and pattern recognition: a review

We summarize the various strands of research on peripheral vision and relate them to theories of form perception. After a historical overview, we describe quantifications of the cortical magnification hypothesis, including an extension of Schwartz's cortical mapping function. The merits of this concept are considered across a wide range of psychophysical tasks, followed by a discussion of its limitations and the need for non-spatial scaling. We also review the eccentricity dependence of other low-level functions including reaction time, temporal resolution, and spatial summation, as well as perimetric methods. A central topic is then the recognition of characters in peripheral vision, both at low and high levels of contrast, and the impact of surrounding contours known as crowding. We demonstrate how Bouma's law, specifying the critical distance for the onset of crowding, can be stated in terms of the retinocortical mapping. The recognition of more complex stimuli, like textures, faces, and scenes, reveals a substantial impact of mid-level vision and cognitive factors. We further consider eccentricity-dependent limitations of learning, both at the level of perceptual learning and pattern category learning. Generic limitations of extrafoveal vision are observed for the latter in categorization tasks involving multiple stimulus classes. Finally, models of peripheral form vision are discussed. We report that peripheral vision is limited with regard to pattern categorization by a distinctly lower representational complexity and processing speed. Taken together, the limitations of cognitive processing in peripheral vision appear to be as significant as those imposed on low-level functions and by way of crowding.

Resolution of spatial and temporal visual attention in infants with fragile X syndrome

Fragile X syndrome is the most common cause of inherited intellectual impairment and the most common single-gene cause of autism. Individuals with fragile X syndrome present with a neurobehavioural phenotype that includes selective deficits in spatiotemporal visual perception associated with neural processing in frontal-parietal networks of the brain. The goal of the current study was to examine whether reduced resolution of spatial and/or temporal visual attention may underlie perceptual deficits related to fragile X syndrome. Eye tracking was used to psychophysically measure the limits of spatial and temporal attention in infants with fragile X syndrome and age-matched neurotypically developing infants. Results from these experiments revealed that infants with fragile X syndrome experience drastically reduced resolution of temporal attention in a genetic dose-sensitive manner, but have a spatial resolution of attention that is not impaired. Coarse temporal attention could have significant knock-on effects for the development of perceptual, cognitive and motor abilities in individuals with the disorder.

Spatial-frequency cutoff requirements for pattern recognition in central and peripheral vision

It is well known that object recognition requires spatial frequencies exceeding some critical cutoff value. People with central scotomas who rely on peripheral vision have substantial difficulty with reading and face recognition. Deficiencies of pattern recognition in peripheral vision, might result in higher cutoff requirements, and may contribute to the functional problems of people with central-field loss. Here we asked about differences in spatial-cutoff requirements in central and peripheral vision for letter and face recognition. The stimuli were the 26 letters of the English alphabet and 26 celebrity faces. Each image was blurred using a low-pass filter in the spatial frequency domain. Critical cutoffs (defined as the minimum low-pass filter cutoff yielding 80% accuracy) were obtained by measuring recognition accuracy as a function of cutoff frequency (in cycles per object). Our data showed that critical cutoffs increased from central to peripheral vision by 20% for letter recognition and by 50% for face recognition. We asked whether these differences could be accounted for by central/peripheral differences in the contrast sensitivity function (CSF). We addressed this question by implementing an ideal-observer model which incorporates empirical CSF measurements and tested the model on letter and face recognition. The success of the model indicates that central/peripheral differences in the cutoff requirements for letter and face recognition can be accounted for by the information content of the stimulus limited by the shape of the human CSF, combined with a source of internal noise and followed by an optimal decision rule.

Emotional facial expression detection in the peripheral visual field

Background

In everyday life, signals of danger, such as aversive facial expressions, usually appear in the peripheral visual field. Although facial expression processing in central vision has been extensively studied, this processing in peripheral vision has been poorly studied.

Methodology/Principal Findings

Using behavioral measures, we explored the human ability to detect fear and disgust vs. neutral expressions and compared it to the ability to discriminate between genders at eccentricities up to 40°. Responses were faster for the detection of emotion compared to gender. Emotion was detected from fearful faces up to 40° of eccentricity.

Conclusions

Our results demonstrate the human ability to detect facial expressions presented in the far periphery up to 40° of eccentricity. The increasing advantage of emotion compared to gender processing with increasing eccentricity might reflect a major implication of the magnocellular visual pathway in facial expression processing. This advantage may suggest that emotion detection, relative to gender identification, is less impacted by visual acuity and within-face crowding in the periphery. These results are consistent with specific and automatic processing of danger-related information, which may drive attention to those messages and allow for a fast behavioral reaction.

Critical orientation for face identification in central vision loss

PURPOSE

Difficulty identifying faces is a common complaint of people with central vision loss. Dakin and Watt (2009) reported that the horizontal components of face images are most informative for face identification in normal vision. In this study, we examined whether people with central vision loss similarly rely primarily on the horizontal components of face images for face identification.

METHODS

Seven observers with central vision loss (mean age = 69 ± 9 [SD]) and five age-matched observers with normal vision (mean age = 65 ± 6) participated in this study. We measured observers' accuracy for reporting the identity of face images spatially filtered using an orientation filter with center orientation ranging from 0 (horizontal) to 150° in steps of 30°, with a bandwidth of 23°. Face images without filtering were also tested.

RESULTS

For all observers, accuracy for identifying filtered face images was highest around the horizontal orientation, dropping systematically as the filter orientation deviated from horizontal, and was the lowest at the vertical orientation. Compared with control observers, observers with central vision loss showed (1) a larger difference in accuracy between identifying filtered (at peak performance) and unfiltered face images; (2) a reduced accuracy at peak performance; and (3) a smaller difference in performance for identifying filtered images between the horizontal and the vertical filter orientations.

CONCLUSIONS

Spatial information around the horizontal orientation in face images is the most important for face identification, for people with normal vision and central vision loss alike. While the horizontal information alone can support reasonably good performance for identifying faces in people with normal vision, people with central vision loss seem to also rely on information along other orientations.

I Know You are Beautiful Even without Looking at You: Discrimination of Facial Beauty in Peripheral Vision

Earlier research suggests that facial attractiveness may capture attention at parafovea. However, little is known about how well facial beauty can be detected at parafoveal and peripheral vision. Participants in this study judged relative attractiveness of a face pair presented simultaneously at several eccentricities from the central fixation. The results show that beauty is not only detectable at parafovea but also at periphery. The discrimination performance at parafovea was indistinguishable from the performance around the fovea. Moreover, performance was well above chance even at the periphery. The results show that the visual system is able to use the low-spatial-frequency information to appraise attractiveness. These findings not only provide an explanation why a beautiful face could capture attention when central vision is already engaged elsewhere, but also reveal the potential means by which a crowd of faces is quickly scanned for attractiveness.

The wide window of face detection

Faces are detected more rapidly than other objects in visual scenes and search arrays, but the cause for this face advantage has been contested. In the present study, we found that under conditions of spatial uncertainty, faces were easier to detect than control targets (dog faces, clocks and cars) even in the absence of surrounding stimuli, making an explanation based only on low-level differences unlikely. This advantage improved with eccentricity in the visual field, enabling face detection in wider visual windows, and pointing to selective sparing of face detection at greater eccentricities. This face advantage might be due to perceptual factors favoring face detection. In addition, the relative face advantage is greater under flanked than non-flanked conditions, suggesting an additional, possibly attention-related benefit enabling face detection in groups of distracters.

Face or building superiority in peripheral vision reversed by task requirements

Peripheral vision has been the topic of few studies compared with central vision. Nevertheless, given that visual information covers all the visual field and that relevant information can originate from highly eccentric positions, the understanding of peripheral vision abilities for object perception seems essential. The poorer resolution of peripheral vision would first suggest that objects requiring large-scale feature integration such as buildings would be better processed than objects requiring finer analysis such as faces. Nevertheless, task requirements also determine the information (coarse or fine) necessary for a given object to be processed. We therefore investigated how task and eccentricity modulate object processing in peripheral vision. Three experiments were carried out requiring finer or coarser information processing of faces and buildings presented in central and peripheral vision. Our results showed that buildings were better judged as identical or familiar in periphery whilst faces were better categorised. We conclude that this superiority for a given stimulus in peripheral vision results (a) from the available information, which depends on the decrease of resolution with eccentricity, and (b) from the useful information, which depends on both the task and the semantic category.

Holistic crowding of Mooney faces

An object or feature is generally more difficult to identify when other objects are presented nearby, an effect referred to as crowding. Here, we used Mooney faces to examine whether crowding can also occur within and between holistic face representations (C. M. Mooney, 1957). Mooney faces are ideal stimuli for this test because no cues exist to distinguish facial features in a Mooney face; to find any facial feature, such as an eye or a nose, one must first holistically perceive the image as a face. Through a series of six experiments we tested the effect of crowding on Mooney face recognition. Our results demonstrate crowding between and within Mooney faces and fulfill the diagnostic criteria for crowding, including eccentricity dependence and lack of crowding in the fovea, critical flanker spacing consistent with less than half the eccentricity of the target, and inner-outer flanker asymmetry. Further, our results show that recognition of an upright Mooney face is more strongly impaired by upright Mooney face flankers than inverted ones. Taken together, these results suggest crowding can occur selectively between high-level representations of faces and that crowding must occur at multiple levels in the visual system.

Can beauty be ignored? Effects of facial attractiveness on covert attention

Facial beauty has important social and biological implications. Research has shown that people tend to look longer at attractive than at unattractive faces. However, little is known about whether an attractive face presented outside foveal vision can capture attention. The effect of facial attractiveness on covert attention was investigated in a spatial cuing task. Participants were asked to judge the orientation of a cued target presented to the left or right visual field while ignoring a task-irrelevant face image flashed in the opposite field. The presentation of attractive faces significantly lengthened task performance. The results suggest that facial beauty automatically competes with an ongoing cognitive task for spatial attention.

The obligatory effects of memory on eye movements

Previous work has shown that eye movement behaviour is affected by previous experience, such that alterations in viewing patterns can be observed to previously viewed compared to novel displays. The current work addresses the extent to which such effects of memory on eye movement behaviour are obligatory; that is, we examined whether prior experience could alter subsequent eye movement behaviour under a variety of testing conditions, for stimuli that varied on the nature of the prior exposure. While task demands influenced whether viewing was predominantly directed to the novel versus familiar faces, viewing of the familiar faces was distinguished from viewing of the novel faces, regardless of whether the task required incidental encoding or intentional retrieval. Changes in scanning of previously viewed over novel faces emerged early in viewing; in particular, viewing duration of the first fixation to the familiar faces was often significantly different from the duration of the first fixation directed to the novel faces, regardless of whether prior exposure was solely in the context of the experiment or due to real-world exposure. These findings suggest that representations maintained in memory may be retrieved and compared with presented information obligatorily.

Face identification in the near-absence of focal attention

In contrast to artificial geometric shapes, natural scenes and face-gender can be processed even when spatial attention is not fully available. In this study, we investigate whether a finer discrimination, at the level of the individual, is possible in the near-absence of focal attention. Using the paradigm, subjects performed face identification on faces of celebrities and relatively unfamiliar individuals, along with a task that is known to engage spatial attention. We find that face-identification performance is only modestly impaired under dual-task conditions. These results suggest that the visual system is well able to make complex judgments of natural stimuli, even when attention is not fully available.

Orientation discrimination across the visual field: size estimates near contrast threshold

Performance in detection and discrimination tasks can often be made equal across the visual field through appropriate stimulus scaling. The parameter E2 is used to characterize the rate at which stimulus dimensions (e.g., size or contrast) must increase in order to achieve foveal levels of performance. We calculated both size and contrast E2 values for orientation discrimination using a spatial scaling procedure that involves measuring combination size and contrast thresholds for stimuli with constant size-to-contrast ratios. E2 values for size scaling were 5.77 degrees and 5.92 degrees. These values are three to four times larger than those recovered previously using similar stimuli at contrasts well above detection threshold (Sally & Gurnsey, 2003). E2 values for contrast scaling were 324.2 degrees and 44.3 degrees, indicating that for large stimuli little contrast scaling (.3% to 2.3% increase) was required in order to equate performance in the fovea and the largest eccentricity (10 degrees). A similar pattern of results was found using a spatial scaling method that involves measuring contrast thresholds for target identification as a function of size across eccentricities. We conclude that the size scaling for orientation discrimination at near-threshold stimulus contrasts is much larger than that required at suprathreshold contrasts. This may arise, at least in part, from contrast-dependent changes in mechanisms that subserve task performance.

Eccentric perception of biological motion is unscalably poor

Accurately perceiving the activities of other people is a crucially important social skill of obvious survival value. Human vision is equipped with highly sensitive mechanisms for recognizing activities performed by others [Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14, 201; Johansson, G. (1976). Spatio-temporal differentiation and integration in visual motion perception: An experimental and theoretical analysis of calculus-like functions in visual data processing. Psychological Research, 38, 379]. One putative functional role of biological motion perception is to register the presence of biological events anywhere within the visual field, not just within central vision. To assess the salience of biological motion throughout the visual field, we compared the detectability performances of biological motion animations imaged in central vision and in peripheral vision. To compensate for the poorer spatial resolution within the periphery, we spatially magnified the motion tokens defining biological motion. Normal and scrambled biological motion sequences were embedded in motion noise and presented in two successively viewed intervals on each trial (2AFC). Subjects indicated which of the two intervals contained normal biological motion. A staircase procedure varied the number of noise dots to produce a criterion level of discrimination performance. For both foveal and peripheral viewing, performance increased but saturated with stimulus size. Foveal and peripheral performance could not be equated by any magnitude of size scaling. Moreover, the inversion effect--superiority of upright over inverted biological motion [Sumi, S. (1984). Upside-down presentation of the Johansson moving light-spot pattern. Perception, 13, 283]--was found only when animations were viewed within the central visual field. Evidently the neural resource responsible for biological motion perception are embodied within neural mechanisms focused on central vision.

Orientation discrimination across the visual field: matching perceived contrast near threshold

Performance can often be made equal across the visual field by scaling peripherally presented stimuli according to F=1+E/E2 where E2 is the eccentricity at which stimulus size must double to maintain foveal performance levels. Previous studies suggest that E2 for orientation discrimination is in the range of 1.5 degrees -2 degrees when stimuli are presented at contrasts well above detection threshold. Recent psychophysical and physiological evidence suggests spatial reorganization of receptive fields at near-threshold contrasts. Such contrast-dependent changes in receptive field structure might alter the amount of size scaling necessary to equate task performance across the visual field. To examine this question we measured orientation discrimination thresholds for a range of stimulus sizes and eccentricities (0 degrees -15 degrees ). We used the same procedure previously employed except that stimuli were presented at near-threshold contrasts. We controlled for the effects of perceptual contrast on thresholds through a matching procedure. A standard line of 3 degrees in length presented at fixation was set to 2 just noticeable differences above detection threshold. The perceived contrast of all other stimuli was adjusted by the subject to match this one. Orientation discrimination thresholds were then obtained at these matching contrasts for all stimulus sizes and eccentricities. E2 values of 3.42 degrees and 3.50 degrees were recovered for two subjects; these values were about a factor of two larger than E2 values previously found for this task when stimuli were presented at higher physical contrasts.

Wideband enhancement of television images for people with visual impairments

Wideband enhancement was implemented by detecting visually relevant edge and bar features in an image to produce a bipolar contour map. The addition of these contours to the original image resulted in increased local contrast of these features and an increase in the spatial bandwidth of the image. Testing with static television images revealed that visually impaired patients (n = 35) could distinguish the enhanced images and preferred them over the original images (and degraded images). Most patients preferred a moderate level of wideband enhancement, since they preferred natural-looking images and rejected visible artifacts of the enhancement. Comparison of the enhanced images with the originals revealed that the improvement in the perceived image quality was significant for only 22% of the patients. Possible reasons for the limited increase in perceived image quality are discussed, and improvements are suggested.

Orientation discrimination in foveal and extra-foveal vision: effects of stimulus bandwidth and contrast

The parameter E2 is used in many spatial scaling studies to characterize the rate at which stimulus size must increase with eccentricity to achieve foveal levels of performance in detection and discrimination tasks. We examined whether the E2 for an orientation discrimination task was dependent on the spatial frequency bandwidth of the stimulus used. Two methods were employed. In Experiments 1 and 2 stimuli were presented at a fixed high level of contrast across viewing conditions. In both experiments the E2s recovered for narrowband stimuli were larger than those recovered for broadband stimuli. In Experiment 3 we controlled for the potentially confounding effects of perceptual contrast by measuring orientation thresholds over a range of stimulus contrast levels. Only thresholds which had reached an asymptotic level, such that increases in stimulus contrast led to no further changes to thresholds, were included in the calculation of E2. We observed that E2s recovered in the latter condition were in the range of 1.29 degrees -1.83 degrees and similar for narrowband and broadband stimuli. We conclude that a failure to consider the role of perceptual contrast may result in inflated estimates of E2.

Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect

We conducted three experiments in order to examine the influence of gaze behavior and fixation on audiovisual speech perception in a task that required subjects to report the speech sound they perceived during the presentation of congruent and incongruent (McGurk) audiovisual stimuli. Experiment 1 showed that the subjects' natural gaze behavior rarely involved gaze fixations beyond the oral and ocular regions of the talker's face and that these gaze fixations did not predict the likelihood of perceiving the McGurk effect. Experiments 2 and 3 showed that manipulation of the subjects' gaze fixations within the talker's face did not influence audiovisual speech perception substantially and that it was not until the gaze was displaced beyond 10 degrees - 20 degrees from the talker's mouth that the McGurk effect was significantly lessened. Nevertheless, the effect persisted under such eccentric viewing conditions and became negligible only when the subject's gaze was directed 60 degrees eccentrically. These findings demonstrate that the analysis of high spatial frequency information afforded by direct oral foveation is not necessary for the successful processing of visual speech information.