Identification of band-pass filtered letters and faces by human and ideal observers

Contribution of internal noise and calculation efficiency to face discrimination deficits in older adults

Classification images (CIs) measured in a face discrimination task differ significantly between older and younger observers. These age differences are consistent with the hypothesis that older adults sample diagnostic face information less efficiently, or have higher levels of internal noise, compared to younger adults. The current experiments assessed the relative contributions of efficiency and internal noise to age differences in face discrimination using the external noise masking and double-pass response consistency paradigms. Experiment 1 measured discrimination thresholds for faces embedded in several levels of static white noise, and the resulting threshold-vs.-noise curves were used to estimate calculation efficiency and equivalent input noise: older observers had lower efficiency and higher equivalent input noise than younger observers. Experiment 2 presented observers with two identical sequences of faces embedded in static white noise to measure the association between response accuracy and response consistency and estimate the internal:external (i/e) noise ratio for each observer. We found that i/e noise ratios did not differ significantly between groups. These results suggest that age differences in face discrimination are due to differences in calculation efficiency and additive internal noise, but not to age differences in multiplicative internal noise.

Detection of emotional faces: The role of spatial frequencies and local features

Models of emotion processing suggest that threat-related stimuli such as fearful faces can be detected based on the rapid extraction of low spatial frequencies. However, this remains debated as other models argue that the decoding of facial expressions occurs with a more flexible use of spatial frequencies. The purpose of this study was to clarify the role of spatial frequencies and differences in luminance contrast between spatial frequencies, on the detection of facial emotions. We used a saccadic choice task in which emotional-neutral face pairs were presented and participants were asked to make a saccade toward the neutral or the emotional (happy or fearful) face. Faces were displayed either in low, high, or broad spatial frequencies. Results showed that participants were better to saccade toward the emotional face. They were also better for high or broad than low spatial frequencies, and the accuracy was higher with a happy target. An analysis of the eye and mouth saliency ofour stimuli revealed that the mouth saliency of the target correlates with participants' performance. Overall, this study underlines the importance of local more than global information, and of the saliency of the mouth region in the detection of emotional and neutral faces.

Dynamics of low-pass-filtered object categories: A decoding approach to ERP recordings

Rapid analysis of low spatial frequencies (LSFs) in the brain conveys the global shape of the object and allows for rapid expectations about the visual input. Evidence has suggested that LSF processing differs as a function of the semantic category to identify. The present study sought to specify the neural dynamics of the LSF contribution to the rapid object representation of living versus non-living objects. In this EEG experiment, participants had to categorize an object displayed at different spatial frequencies (LSF or non-filtered). Behavioral results showed an advantage for living versus non-living objects and a decrease in performance with LSF pictures of pieces of furniture only. Moreover, despite a difference in classification performance between LSF and non-filtered pictures for living items, the behavioral performance was maintained, which suggests that classification under our specific condition can be based on LSF information, in particular for living items.

Sensitivity to naturalistic texture relies primarily on high spatial frequencies

Natural images contain information at multiple spatial scales. Though we understand how early visual mechanisms split multiscale images into distinct spatial frequency channels, we do not know how the outputs of these channels are processed further by mid-level visual mechanisms. We have recently developed a texture discrimination task that uses synthetic, multi-scale, "naturalistic" textures to isolate these mid-level mechanisms. Here, we use three experimental manipulations (image blur, image rescaling, and eccentric viewing) to show that perceptual sensitivity to naturalistic structure is strongly dependent on features at high object spatial frequencies (measured in cycles/image). As a result, sensitivity depends on a texture acuity limit, a property of the visual system that sets the highest retinal spatial frequency (measured in cycles/degree) at which observers can detect naturalistic features. Analysis of the texture images using a model observer analysis shows that naturalistic image features at high object spatial frequencies carry more task-relevant information than those at low object spatial frequencies. That is, the dependence of sensitivity on high object spatial frequencies is a property of the texture images, rather than a property of the visual system. Accordingly, we find human observers' ability to extract naturalistic information (their efficiency) is similar for all object spatial frequencies. We conclude that the mid-level mechanisms that underlie perceptual sensitivity effectively extract information from all image features below the texture acuity limit, regardless of their retinal and object spatial frequency.

Contributions of low- and high-level contextual mechanisms to human face perception

Contextual modulations at primary stages of visual processing depend on the strength of local input. Contextual modulations at high-level stages of (face) processing show a similar dependence to local input strength. Namely, the discriminability of a facial feature determines the amount of influence of the face context on that feature. How high-level contextual modulations emerge from primary mechanisms is unclear due to the scarcity of empirical research systematically addressing the functional link between the two. We tested (62) young adults' ability to process local input independent of the context using contrast detection and (upright and inverted) morphed facial feature matching tasks. We first investigated contextual modulation magnitudes across tasks to address their shared variance. A second analysis focused on the profile of performance across contextual conditions. In upright eye matching and contrast detection tasks, contextual modulations only correlated at the level of their profile (averaged Fisher-Z transformed r = 1.18, BF10 > 100), but not magnitude (r = .15, BF10 = .61), suggesting the functional independence but similar working principles of the mechanisms involved. Both the profile (averaged Fisher-Z transformed r = .32, BF10 = 9.7) and magnitude (r = .28, BF10 = 4.58) of the contextual modulations correlated between inverted eye matching and contrast detection tasks. Our results suggest that non-face-specialized high-level contextual mechanisms (inverted faces) work in connection to primary contextual mechanisms, but that the engagement of face-specialized mechanisms for upright faces obscures this connection. Such combined study of low- and high-level contextual modulations sheds new light on the functional relationship between different levels of the visual processing hierarchy, and thus on its functional organization.

Effects of Emotional Expression on Face Recognition May Be Accounted for by Image Similarity

We examined the degree to which differences in face recognition rates across emotional expression conditions varied concomitantly with differences in mean objective image similarity. Effects of emotional expression on face recognition performance were measured via an old/new recognition paradigm in which stimuli at both learning and testing had happy, neutral, and angry expressions. Results showed an advantage for faces learned with neutral expressions, as well as for angry faces at testing. Performance data was compared to three quantitative image-similarity indices. Findings showed that mean human performance was strongly correlated with mean image similarity, suggesting that the former may be at least partly explained by the latter. Our findings sound a cautionary note regarding the necessity of considering low-level stimulus properties as explanations for findings that otherwise may be prematurely attributed to higher order phenomena such as attention or emotional arousal.

Coarse-to-Fine(r) Automatic Familiar Face Recognition in the Human Brain

At what level of spatial resolution can the human brain recognize a familiar face in a crowd of strangers? Does it depend on whether one approaches or rather moves back from the crowd? To answer these questions, 16 observers viewed different unsegmented images of unfamiliar faces alternating at 6 Hz, with spatial frequency (SF) content progressively increasing (i.e., coarse-to-fine) or decreasing (fine-to-coarse) in different sequences. Variable natural images of celebrity faces every sixth stimulus generated an objective neural index of single-glanced automatic familiar face recognition (FFR) at 1 Hz in participants' electroencephalogram (EEG). For blurry images increasing in spatial resolution, the neural FFR response over occipitotemporal regions emerged abruptly with additional cues at about 6.3-8.7 cycles/head width, immediately reaching amplitude saturation. When the same images progressively decreased in resolution, the FFR response disappeared already below 12 cycles/head width, thus providing no support for a predictive coding hypothesis. Overall, these observations indicate that rapid automatic recognition of heterogenous natural views of familiar faces is achieved from coarser visual inputs than generally thought, and support a coarse-to-fine FFR dynamics in the human brain.

Critical information thresholds underlying generic and familiar face categorisation at the same face encounter

Seeing a face in the real world provokes a host of automatic categorisations related to sex, emotion, identity, and more. Such individual facets of human face recognition have been extensively examined using overt categorisation judgements, yet their relative informational dependencies during the same face encounter are comparatively unknown. Here we used EEG to assess how increasing access to sensory input governs two ecologically relevant brain functions elicited by seeing a face: Distinguishing faces and nonfaces, and recognising people we know. Observers viewed a large set of natural images that progressively increased in either image duration (experiment 1) or spatial frequency content (experiment 2). We show that in the absence of an explicit categorisation task, the human brain requires less sensory input to categorise a stimulus as a face than it does to recognise whether that face is familiar. Moreover, where sensory thresholds for distinguishing faces/nonfaces were remarkably consistent across observers, there was high inter-individual variability in the lower informational bound for familiar face recognition, underscoring the neurofunctional distinction between these categorisation functions. By i) indexing a form of face recognition that goes beyond simple low-level differences between categories, and ii) tapping multiple recognition functions elicited by the same face encounters, the information minima we report bear high relevance to real-world face encounters, where the same stimulus is categorised along multiple dimensions at once. Thus, our finding of lower informational requirements for generic vs. familiar face recognition constitutes some of the strongest evidence to date for the intuitive notion that sensory input demands should be lower for recognising face category than face identity.

The role of spatial frequencies for facial pain categorization

Studies on low-level visual information underlying pain categorization have led to inconsistent findings. Some show an advantage for low spatial frequency information (SFs) and others a preponderance of mid SFs. This study aims to clarify this gap in knowledge since these results have different theoretical and practical implications, such as how far away an observer can be in order to categorize pain. This study addresses this question by using two complementary methods: a data-driven method without a priori expectations about the most useful SFs for pain recognition and a more ecological method that simulates the distance of stimuli presentation. We reveal a broad range of important SFs for pain recognition starting from low to relatively high SFs and showed that performance is optimal in a short to medium distance (1.2-4.8 m) but declines significantly when mid SFs are no longer available. This study reconciles previous results that show an advantage of LSFs over HSFs when using arbitrary cutoffs, but above all reveal the prominent role of mid-SFs for pain recognition across two complementary experimental tasks.

Object expectations alter information use during visual recognition

Prior expectations influence how we perceive and recognize objects. However, how they do so remains unclear, especially in the case of real-world complex objects. Expectations of objects may affect which features are used to recognize them subsequently. In this study, we used reverse correlation to reveal with high precision how the use of information across time is modulated by real-world object expectations in a visual recognition task. We show that coarse information leads to accurate responses earlier when an object is expected, indicating that observers use diagnostic features earlier in this situation. We also demonstrate an increased variability in the use of coarse information depending on the expected object, indicating that observers adopt a more specialized recognition strategy when they expect a specific object. In summary, our results reveal potential mechanisms underlying the effect of expectations on the recognition of complex objects.

Unresolvable Pixels Contribute to Character Legibility: Another Reason Why High-Resolution Images Appear Clearer

This study examined the effect of character sample density on legibility. As the spatial frequency component important for character recognition is said to be 1 to 3 cycles/letter (cpl), six dots in each direction should be sufficient to represent a character; however, some studies have reported that high-density characters are more legible. Considering that these seemingly contradictory findings could be compatible, we analyzed the frequency component of the character stimulus with adjusted sample density and found that the component content of 1 to 3 cpl increased in the high-density character. In the following three psychophysical experiments, high sample density characters tended to have lower contrast thresholds, both for normal and low vision. Furthermore, the contrast threshold with characters of each sample density was predicted from the amplitude of the 1 to 3 cpl component. Thus, while increasing the sample density improves legibility, adding a high frequency is not important in itself. The findings suggest that enhancing the frequency components important for recognizing characters by adding the high-frequency component contributes to making characters more legible.

The Effect of Perceptual Learning on Face Recognition in Individuals with Central Vision Loss

Purpose

To examine whether perceptual learning can improve face discrimination and recognition in older adults with central vision loss.

Methods

Ten participants with age-related macular degeneration (ARMD) received 5 days of training on a face discrimination task (mean age, 78 ± 10 years). We measured the magnitude of improvements (i.e., a reduction in threshold size at which faces were able to be discriminated) and whether they generalized to an untrained face recognition task. Measurements of visual acuity, fixation stability, and preferred retinal locus were taken before and after training to contextualize learning-related effects. The performance of the ARMD training group was compared to nine untrained age-matched controls (8 = ARMD, 1 = juvenile macular degeneration; mean age, 77 ± 10 years).

Results

Perceptual learning on the face discrimination task reduced the threshold size for face discrimination performance in the trained group, with a mean change (SD) of –32.7% (+15.9%). The threshold for performance on the face recognition task was also reduced, with a mean change (SD) of –22.4% (+2.31%). These changes were independent of changes in visual acuity, fixation stability, or preferred retinal locus. Untrained participants showed no statistically significant reduction in threshold size for face discrimination, with a mean change (SD) of –8.3% (+10.1%), or face recognition, with a mean change (SD) of +2.36% (–5.12%).

Conclusions

This study shows that face discrimination and recognition can be reliably improved in ARMD using perceptual learning. The benefits point to considerable perceptual plasticity in higher-level cortical areas involved in face-processing. This novel finding highlights that a key visual difficulty in those suffering from ARMD is readily amenable to rehabilitation.

Healthy aging delays the neural processing of face features relevant for behavior by 40 ms

Fast and accurate face processing is critical for everyday social interactions, but it declines and becomes delayed with age, as measured by both neural and behavioral responses. Here, we addressed the critical challenge of understanding how aging changes neural information processing mechanisms to delay behavior. Young (20-36 years) and older (60-86 years) adults performed the basic social interaction task of detecting a face versus noise while we recorded their electroencephalogram (EEG). In each participant, using a new information theoretic framework we reconstructed the features supporting face detection behavior, and also where, when and how EEG activity represents them. We found that occipital-temporal pathway activity dynamically represents the eyes of the face images for behavior ~170 ms poststimulus, with a 40 ms delay in older adults that underlies their 200 ms behavioral deficit of slower reaction times. Our results therefore demonstrate how aging can change neural information processing mechanisms that underlie behavioral slow down.

Perceptual Similarity Can Drive Age-Related Elevation of False Recognition

Older adults consistently show elevated rates of false recognition of new items that are related to studied items. This finding has been largely attributed to a greater tendency for older adults to rely on conceptual gist during memory recognition tasks. However, perceptual factors may also be implicated considering that related items are not only conceptually but also perceptually similar. While some findings do suggest that age-related increases in false recognitions can be driven by perceptual factors, little is known about the nature and circumstances under which these factors operate. To address this gap, we measured basic visual ability as well as false recognition for four different image categories (upright faces, inverted faces, chairs, houses) in younger (n = 34) and older (n = 34) adults. Each image category represented different levels of variability in perceptual similarity and pre-experimental exposure. Perceptual similarity was objectively defined on the basis of the low-level properties of the images. We found evidence that perceptual similarity can contribute to elevated rates of false recognition in older adults. Our results also suggest that declines in basic visual abilities influence elevated false recognition in older adults for perceptually similar but not perceptually dissimilar items. We conclude that both perceptual and conceptual similarity can drive age-related differences in false recognition.

Face perception: A brief journey through recent discoveries and current directions

Faces are a rich source of information about the people around us. Identity, state of mind, emotions, intentions, age, gender, ethnic background, attractiveness and a host of other attributes about an individual can be gleaned from a face. When face perception fails, dramatic psycho-social consequences can follow at the individual level, as in the case of prosopagnosic parents who are unable to recognize their children at school pick-up. At the species level, social interaction patterns are shaped by human face perception abilities. The computational feat of recognizing faces and facial attributes, and the challenges overcome by the human brain to achieve this feat, have fascinated generations of vision researchers. In this paper, we present a brief overview of some of the milestones of discovery as well as outline a selected set of current directions and open questions on this topic.

The Effects of Blur and Inversion on the Recognition of Ambient Face Images

When viewing unfamiliar faces that vary in expressions, angles, and image quality, observers make many recognition errors. Specifically, in unconstrained identity-sorting tasks, observers struggle to cope with variation across different images of the same person while succeeding at telling different people apart. The use of ambient face images in this simple card-sorting task reveals the magnitude of these face recognition errors and suggests a useful platform to reexamine the nature of face processing using naturalistic stimuli. In the present study, we chose to investigate the impact of two basic stimulus manipulations (image blur and face inversion) on identity sorting with ambient images. Although these manipulations are both known to affect face processing when well-controlled, frontally viewed face images are used, examining how they affect performance for ambient images is an important step toward linking the large body of research using controlled face images to more ecologically valid viewing conditions. Briefly, we observed a high cost of image blur regardless of blur magnitude, and a strong inversion effect that affected observers’ sensitivity to extrapersonal variability but did not affect the number of unique identities they estimated were present in the set of images presented to them.

Greater reliance on the eye region predicts better face recognition ability

Interest in using individual differences in face recognition ability to better understand the perceptual and cognitive mechanisms supporting face processing has grown substantially in recent years. The goal of this study was to determine how varying levels of face recognition ability are linked to changes in visual information extraction strategies in an identity recognition task. To address this question, fifty participants completed six tasks measuring face and object processing abilities. Using the Bubbles method (Gosselin & Schyns, 2001), we also measured each individual's use of visual information in face recognition. At the group level, our results replicate previous findings demonstrating the importance of the eye region for face identification. More importantly, we show that face processing ability is related to a systematic increase in the use of the eye area, especially the left eye from the observer's perspective. Indeed, our results suggest that the use of this region accounts for approximately 20% of the variance in face processing ability. These results support the idea that individual differences in face processing are at least partially related to the perceptual extraction strategy used during face identification.

Classification images characterize age-related deficits in face discrimination

Face perception is impaired in older adults, but the cause of this decline is not well understood. We examined this issue by measuring Classification Images (CIs) in a face discrimination task in younger and older adults. Faces were presented in static, white visual noise, and face contrast was varied with a staircase to maintain an accuracy rate of ≈71%. The noise fields were used to construct a CI using the method described by Nagai et al. (2013) and each observer's CI was cross-correlated with the visual template of a linear ideal discriminator to obtain an estimate of the absolute efficiency of visual processing. Face discrimination thresholds were lower in younger than older adults. Like Sekuler, Gaspar, Gold, and Bennett (2004), we found that CIs from younger adults contained structure near the eyes and brows, suggesting that those observers consistently relied on information conveyed by pixels in those regions of the stimulus. CIs obtained from older adults were noticeably different: CIs from only two older adults exhibited structure near the eye/brow regions, and CIs from the remaining older observers showed no obvious structure. Nevertheless, face discrimination thresholds in both groups were strongly and similarly correlated with the cross-correlation between the CI and the ideal template, suggesting that despite older observers' lack of consistent structure, the CI method is sensitive to between-subject differences in older observers' perceptual strategy.

Very small faces are easily discriminated under long and short exposure times

Acuity measures related to overall face size that can be perceived have not been studied quantitatively. Consequently, experimenters use a wide range of sizes (usually large) without always providing a rationale for their choices. I studied thresholds for face discrimination by presenting both long (500 ms)- and short (17, 33, 50 ms)-duration stimuli. Face width threshold for the long presentation was ~0.2°, and thresholds for the flashed stimuli ranged from ~0.3° for the 17-ms flash to ~0.23° for the 33- and 50-ms flashes. Such thresholds indicate that face stimuli used in physiological or psychophysical experiments are often too large to tap human fine spatial capabilities, and thus interpretations of such experiments should take into account face discrimination acuity. The 0.2° threshold found in this study is incompatible with the prevalent view that faces are represented by a population of specialized “face cells” because those cells do not respond to <1° stimuli and are optimally tuned to >4° faces. Also, the ability to discriminate small, high-spatial frequency flashed face stimuli is inconsistent with models suggesting that fixational drift transforms retinal spatial patterns into a temporal code. It seems therefore that the small image motions occurring during fixation do not disrupt our perception, because all relevant processing is over with before those motions can have significant effects.

NEW & NOTEWORTHY Although face perception is central to human behavior, the minimally perceived face size is not known. This study shows that humans can discriminate very small (~0.2°) faces. Furthermore, even when flashed for tens of milliseconds, ~0.25° faces can be discriminated. Such fine acuity should impact modeling of physiological mechanisms of face perception. The ability to discriminate flashed faces where there is almost no eye movement indicates that eye drift is not essential for visibility.

The Bandwidth of Diagnostic Horizontal Structure for Face Identification

Horizontally oriented spatial frequency components are a diagnostic source of face identity information, and sensitivity to this information predicts upright identification accuracy and the magnitude of the face-inversion effect. However, the bandwidth at which this information is conveyed, and the extent to which human tuning matches this distribution of information, has yet to be characterized. We designed a 10-alternative forced choice face identification task in which upright or inverted faces were filtered to retain horizontal or vertical structure. We systematically varied the bandwidth of these filters in 10° steps and replaced the orientation components that were removed from the target face with components from the average of all possible faces. This manipulation created patterns that looked like faces but contained diagnostic information in orientation bands unknown to the observer on any given trial. Further, we quantified human performance relative to the actual information content of our face stimuli using an ideal observer with perfect knowledge of the diagnostic band. We found that the most diagnostic information for face identification is conveyed by a narrow band of orientations along the horizontal meridian, whereas human observers use information from a wide range of orientations.

Comparing the minimum spatial-frequency content for recognizing Chinese and alphabet characters

Visual blur is a common problem that causes difficulty in pattern recognition for normally sighted people under degraded viewing conditions (e.g., near the acuity limit, when defocused, or in fog) and also for people with impaired vision. For reliable identification, the spatial frequency content of an object needs to extend up to or exceed a minimum value in units of cycles per object, referred to as the critical spatial frequency. In this study, we investigated the critical spatial frequency for alphabet and Chinese characters, and examined the effect of pattern complexity. The stimuli were divided into seven categories based on their perimetric complexity, including the lowercase and uppercase alphabet letters, and five groups of Chinese characters. We found that the critical spatial frequency significantly increased with complexity, from 1.01 cycles per character for the simplest group to 2.00 cycles per character for the most complex group of Chinese characters. A second goal of the study was to test a space-bandwidth invariance hypothesis that would represent a tradeoff between the critical spatial frequency and the number of adjacent patterns that can be recognized at one time. We tested this hypothesis by comparing the critical spatial frequencies in cycles per character from the current study and visual-span sizes in number of characters (measured by Wang, He, & Legge, 2014) for sets of characters with different complexities. For the character size (1.2°) we used in the study, we found an invariant product of approximately 10 cycles, which may represent a capacity limitation on visual pattern recognition.

Efficiencies for parts and wholes in biological-motion perception

People can reliably infer the actions, intentions, and mental states of fellow humans from body movements (Blake & Shiffrar, 2007). Previous research on such biological-motion perception has suggested that the movements of the feet may play a particularly important role in making certain judgments about locomotion (Chang & Troje, 2009; Troje & Westhoff, 2006). One account of this effect is that the human visual system may have evolved specialized processes that are efficient for extracting information carried by the feet (Troje & Westhoff, 2006). Alternatively, the motion of the feet may simply be more discriminable than that of other parts of the body. To dissociate these two possibilities, we measured people's ability to discriminate the walking direction of stimuli in which individual body parts (feet, hands) were removed or shown in isolation. We then compared human performance to that of a statistically optimal observer (Gold, Tadin, Cook, & Blake, 2008), giving us a measure of humans' discriminative ability independent of the information available (a quantity known as efficiency). We found that efficiency was highest when the hands and the feet were shown in isolation. A series of follow-up experiments suggested that observers were relying on a form-based cue with the isolated hands (specifically, the orientation of their path through space) and a motion-based cue with the isolated feet to achieve such high efficiencies. We relate our findings to previous proposals of a distinction between form-based and motion-based mechanisms in biological-motion perception.

Proficient use of low spatial frequencies facilitates face memory but shows protracted maturation throughout adolescence

Face perception is characterized by configural processing, which depends on visual information in the low spatial frequency (LSF) ranges. However, it is unclear whether LSF content is equally important for face memory. The present study investigated how face information in the low and high SF range plays a role in the configural encoding of faces for short-term and long-term recall. Moreover, we examined how SF-dependent face memorization develops in female adolescence, by comparing children (9-10-year-olds), adolescents (12-13-year-olds and 15-16-year-olds), and young adults (21-32-year-olds). Results show that similar to face perception, delayed face recognition was consistently facilitated by LSF content. However, only adults were able to adequately employ configural LSF cues for short-term recall, analogous to the slow maturation of LSF-driven configural face perception reported by previous studies. Moreover, the insensitivity to face inversion of early adolescents revealed their inadequate use of configural face cues regardless of SF availability, corroborating previous reports on an adolescent "dip" in face recognition. Like face perception, face recognition has a protracted maturational course. In (female) adolescence, sensitivity to configural LSF cues is developed, which aids not only configural face perception but also face memorization.

Assessing Suppression in Amblyopic Children With a Dichoptic Eye Chart

Purpose

Suppression has a key role in the etiology of amblyopia, and contrast-balanced binocular treatment can overcome suppression and improve visual acuity. Quantitative assessment of suppression could have a role in managing amblyopia. We describe a novel eye chart to assess suppression in children.

Methods

We enrolled 100 children (7–12 years; 63 amblyopic, 25 nonamblyopic with strabismus or anisometropia, 12 controls) in the primary cohort and 22 children (3–6 years; 13 amblyopic, 9 nonamblyopic) in a secondary cohort. Letters were presented on a dichoptic display (5 letters per line). Children wore polarized glasses so that each eye saw a different letter chart. At each position, the identity of the letter and its contrast on each eye's chart differed. Children read 8 lines of letters for each of 3 letter sizes. The contrast balance ratio was the ratio at which 50% of letters seen by the amblyopic eye were reported.

Results

Amblyopic children had significantly higher contrast balance ratios for all letter sizes compared to nonamblyopic children and controls, requiring 4.6 to 5.6 times more contrast in the amblyopic eye compared to the fellow eye (P < 0.0001). Amblyopic eye visual acuity was correlated with contrast balance ratio (r ranged from 0.49–0.57 for the 3 letter sizes). Change in visual acuity with amblyopia treatment was correlated with change in contrast balance ratio (r ranged from 0.43–0.62 for the 3 letter sizes).

Conclusions

Severity of suppression can be monitored as part of a routine clinical exam in the management of amblyopia in children.

The Impact of Symmetry on the Efficiency of Human Face Perception

The presence of symmetric properties in a stimulus has been shown to often exert an influence on perception and information processing. Investigations into symmetry have given rise to the notion that it is processed easily and efficiently by the human visual system. However, only a handful of studies have attempted to actually measure symmetry’s role in the efficiency of information use. We explored the impact of symmetry on the perception of human faces, a domain where it has been thought to play a particularly important role. Specifically, we measured information processing efficiency, defined as human performance relative to that of an ideal observer, for the detection, discrimination, and identification of symmetric and asymmetric faces. Surprisingly, we found no evidence for significant differences in efficiency between these two classes of stimuli. Training yielded significant improvements in overall efficiency, but had no significant effect on the relative efficiency of asymmetric and symmetric face identification. Our results indicate that although symmetry may be important to other aspects of face perception (e.g., perceived beauty), it has no discernible impact upon the efficiency with which information is used when detecting, discriminating, and identifying faces.

Scene perception in age-related macular degeneration: Effect of spatial frequencies and contrast in residual vision

Age-related macular degeneration (AMD) is characterized by a central vision loss. Here, we investigated the ability of AMD patients to process the spatial frequency content of scenes in their residual vision, depending of the luminance contrast level. AMD patients and normally-sighted elderly participants (controls) performed a categorization task involving large scenes (outdoors vs. indoors) filtered in low spatial frequencies (LSF), high spatial frequencies (HSF), and non-filtered scenes (NF). Luminance contrast of scenes was equalized between stimuli using a root-mean square (RMS) contrast normalization. In Experiment 1, we applied an RMS contrast of 0.1 (for luminance values between 0 and 1), a value situated between the mean contrast of LSF and HSF scenes in natural conditions. In Experiment 2, we applied an RMS contrast of 0.3, corresponding to the mean contrast of HSF scenes in natural conditions. In Experiment 3, we manipulated four levels of linearly-increasing RMS contrasts (0.05, 0.10, 0.15, and 0.20) for HSF scenes only. Compared to controls, AMD patients gave more non-responses in the categorization of HSF than NF or LSF scenes, irrespective of the contrast level of scenes. Performances improved as contrast increased in HSF scenes. Controls were not differentially affected by the spatial frequency content of scenes. Overall, results suggest that LSF processing is well preserved in AMD patients and allows efficient scene categorization in their parafoveal residual vision. The HSF processing deficit could be partially restored by enhancing luminance contrast.

What is in a View? The Role of Featural Information in the Recognition of Unfamiliar Faces across Viewpoint Transformation

In recognising a face the visual system shows a remarkable ability in overcoming changes in viewpoint. However, the mechanisms involved in solving this complex computational problem, particularly in terms of information processing, have not been clearly defined. Considerable evidence indicates that face recognition involves both featural and configural processing. In this study we examined the contribution of featural information across viewpoint change. Participants were familiarised with unknown faces and were later tested for recognition in complete or part-face format, across changes in view. A striking effect of viewpoint resulting in a reduction in profile recognition compared with the three-quarter and frontal views was found. However, a complete-face over part-face advantage independent of transformation was demonstrated across all views. A hierarchy of feature salience was also demonstrated. Findings are discussed in terms of the problem of object constancy as it applies to faces.

How Many Faces Can Be Processed during a Single Eye Fixation?

The purpose of our study was to estimate the perceptual span for facial information: how many faces can be processed during a single eye fixation. We used a visual-search task, in which the targets and distractors were facial photographs. The task of the observer was to search for and identify a target face in an array of faces. We measured the time needed for one search—threshold search time—by using a multiple-alternative staircase method. The threshold represents the duration of stimulus presentation at which the probability of correct responses was 79%. The array size was varied from 2 × 2 to 8 × 8 faces. Simultaneously with the performance measurements we measured eye movements with a video eye tracker. We found that threshold search time increased with increasing set size nearly linearly. The number of fixations also increased linearly from unity at the smallest set size to about fifteen at the largest set size. The result of 2 × 2 faces during a single fixation gave an estimate of 4 faces for the perceptual span. If, on average, only half of the elements had to be scanned for finding the target, 15 fixations at the largest set size (8 × 8) gave another estimate of 2.13 faces. The mean fixation duration was around 200 ms. Thus, the results suggest that 2–4 faces can be processed during one fixation of about 200 ms.

The Respective Role of Low and High Spatial Frequencies in Supporting Configural and Featural Processing of Faces

One distinctive feature of processing faces, as compared to other categories, is thought to be the large dependence on configural cues such as the metric relations among features. To test the role of low spatial frequencies (LSFs) and high spatial frequencies (HSFs) in configural and featural processing, subjects were presented with triplets of faces that were filtered to preserve either LSFs (below 8 cycles per face width), HSFs (above 32 cycles per face width), or the full frequency spectrum. They were asked to match one of two probe faces to a target face. The distractor probe face differed from the target either configurally, featurally, or both featurally and configurally. When the difference was at the configural level, performance was better with LSF faces than with HSF faces. In contrast, with a featural difference, a strong performance advantage was found for HSF faces as compared to LSF faces. These results support the dominant role that LSFs play in the configural processing of faces, whereas featural processing is largely dependent on HSFs.

The perception of a face can be greater than the sum of its parts

Holistic processing is often used as a construct to characterize face recognition. An important recent study by Gold, Mundy, and Tjan (2012) quantified holistic processing by computing a facial-feature integration index derived from an ideal observer model. This index was mathematically defined as the ratio of the psychophysical contrast sensitivities squared for recognizing a whole face versus the sum of contrast sensitivities squared for individual face parts (left eye, right eye, nose, and mouth). They observed that this index was not significantly different from 1, leading to the provocative conclusion that the perception of a face is no more than the sum of its parts. What may not be obvious to all readers of this work is that these conclusions were based on a collection of faces that shared essentially the same configuration of face parts. We tested whether the facial-feature integration index would also equal 1 when faces have a range of configurations mirroring the range of variability in real-world faces, using the same experimental procedure and calculating the same integration index as Gold et al. When tested on faces with the same configuration, we also observed an integration index similar to what Gold et al. reported. But when tested on faces with variable configurations, we observed an integration index significantly greater than 1. Combing our results with those of Gold et al. further clarifies the theoretical construct of holistic processing in face recognition and what it means for the whole to be greater than the sum of its parts.

The perception of a familiar face is no more than the sum of its parts

Why do faces become easier to recognize with repeated exposure? Previous research has suggested that familiarity may induce a qualitative shift in visual processing from an independent analysis of individual facial features to analysis that includes information about the relationships among features (Farah, Wilson, Drain, & Tanaka Psychological Review, 105, 482-498, 1998; Maurer, Grand, & Mondloch Trends in Cognitive Science, 6, 255-260, 2002). We tested this idea by using a "summation-at-threshold" technique (Gold, Mundy, & Tjan Psychological Science, 23, 427-434, 2012; Nandy & Tjan Journal of Vision, 8, 3.1-20, 2008), in which an observer's ability to recognize each individual facial feature shown independently is used to predict their ability to recognize all of the features shown in combination. We find that, although people are better overall at recognizing familiar as opposed to unfamiliar faces, their ability to integrate information across features is similar for unfamiliar and highly familiar faces and is well predicted by their ability to recognize each of the facial features shown in isolation. These results are consistent with the idea that familiarity has a quantitative effect on the efficiency with which information is extracted from individual features, rather than a qualitative effect on the process by which features are combined.

The influence of natural contour and face size on the spatial frequency tuning for identifying upright and inverted faces

It has previously been proposed that holistic face processing is based on low spatial frequencies (SFs) whereas featural processing relies on higher SFs, a hypothesis still widespread in the face processing literature today (e.g. Peters et al. in Eur J Neurosci 37(9):1448-1457, 2013). Since upright faces are supposedly recognized through holistic processing and inverted faces, using features, it is easy to take the leap to suggest a qualitatively different SF tuning for the identification of upright and vs. inverted faces. However, two independent studies (e.g. Gaspar et al. in Vision Res 48(28):2817-2826, 2008; Willenbockel et al. in J Exp Psychol Human 36(1):122-135, 2010a) found the same SF tuning for both stimulus presentations. Since these authors used relatively small faces hiding the natural facial contour, it is possible that differences in the SF tuning for identifying upright and inverted faces were missed. The present study thus revisits the SF tuning for upright and inverted faces face identification using the SF Bubbles technique. Our results still indicate that the same SFs are involved in both upright and inverted face recognition regardless of these additional parameters (contour and size), thus contrasting with previous data obtained using different methods (e.g. Oruc and Barton in J Vis 10(12):20, 1-12, 2010). The possible reasons subtending this divergence are discussed.

Spatial-frequency dependent binocular imbalance in amblyopia

While amblyopia involves both binocular imbalance and deficits in processing high spatial frequency information, little is known about the spatial-frequency dependence of binocular imbalance. Here we examined binocular imbalance as a function of spatial frequency in amblyopia using a novel computer-based method. Binocular imbalance at four spatial frequencies was measured with a novel dichoptic letter chart in individuals with amblyopia, or normal vision. Our dichoptic letter chart was composed of band-pass filtered letters arranged in a layout similar to the ETDRS acuity chart. A different chart was presented to each eye of the observer via stereo-shutter glasses. The relative contrast of the corresponding letter in each eye was adjusted by a computer staircase to determine a binocular Balance Point at which the observer reports the letter presented to either eye with equal probability. Amblyopes showed pronounced binocular imbalance across all spatial frequencies, with greater imbalance at high compared to low spatial frequencies (an average increase of 19%, p < 0.01). Good test-retest reliability of the method was demonstrated by the Bland-Altman plot. Our findings suggest that spatial-frequency dependent binocular imbalance may be useful for diagnosing amblyopia and as an outcome measure for recovery of binocular vision following therapy.

A robust and representative lower bound on object processing speed in humans

How early does the brain decode object categories? Addressing this question is critical to constrain the type of neuronal architecture supporting object categorization. In this context, much effort has been devoted to estimating face processing speed. With onsets estimated from 50 to 150 ms, the timing of the first face-sensitive responses in humans remains controversial. This controversy is due partially to the susceptibility of dynamic brain measurements to filtering distortions and analysis issues. Here, using distributions of single-trial event-related potentials (ERPs), causal filtering, statistical analyses at all electrodes and time points, and effective correction for multiple comparisons, we present evidence that the earliest categorical differences start around 90 ms following stimulus presentation. These results were obtained from a representative group of 120 participants, aged 18-81, who categorized images of faces and noise textures. The results were reliable across testing days, as determined by test-retest assessment in 74 of the participants. Furthermore, a control experiment showed similar ERP onsets for contrasts involving images of houses or white noise. Face onsets did not change with age, suggesting that face sensitivity occurs within 100 ms across the adult lifespan. Finally, the simplicity of the face-texture contrast, and the dominant midline distribution of the effects, suggest the face responses were evoked by relatively simple image properties and are not face specific. Our results provide a new lower benchmark for the earliest neuronal responses to complex objects in the human visual system.

On the particular vulnerability of face recognition to aging: a review of three hypotheses

Age-related face recognition deficits are characterized by high false alarms to unfamiliar faces, are not as pronounced for other complex stimuli, and are only partially related to general age-related impairments in cognition. This paper reviews some of the underlying processes likely to be implicated in theses deficits by focusing on areas where contradictions abound as a means to highlight avenues for future research. Research pertaining to the three following hypotheses is presented: (i) perceptual deterioration, (ii) encoding of configural information, and (iii) difficulties in recollecting contextual information. The evidence surveyed provides support for the idea that all three factors are likely to contribute, under certain conditions, to the deficits in face recognition seen in older adults. We discuss how these different factors might interact in the context of a generic framework of the different stages implicated in face recognition. Several suggestions for future investigations are outlined.

The PCA learning effect: An emerging correlate of face memory during childhood

Human adults implicitly learn the prototype and the principal components of the variability distinguishing faces (Gao & Wilson, 2014). Here we measured the implicit learning effect in adults and 9-year-olds, and with a modified child-friendly procedure, in 7-year-olds. All age groups showed the implicit learning effect by falsely recognizing the average (the prototype effect) and the principal component faces as having been seen (the PCA learning effect). The PCA learning effect, but not the prototype effect increased between 9years of age and adulthood and at both ages was the better predictor of memory for the actually studied faces. In contrast, for the 7-year-olds, the better predictor of face memory was the prototype effect. The pattern suggests that there may be a developmental change between ages 7 and 9 in the mechanism underlying memory for faces. We provide the first evidence that children as young as age 7 can extract the most important dimensions of variation represented by principal components among individual faces, a key ability that grows stronger with age and comes to underlie memory for faces.