Global precedence, spatial frequency channels, and the statistics of natural images

Do You Want to See the Tree? Ignore the Forest

The visual environment consists of global structures (e.g., a forest) made up of local parts (e.g., trees). When compound stimuli are presented (e.g., large global letters composed of arrangements of small local letters), the global unattended information slows responses to local targets. Using a negative priming paradigm, we investigated whether inhibition is required to process hierarchical stimuli when information at the local level is in conflict with the one at the global level. The results show that when local and global information is in conflict, global information must be inhibited to process local information, but that the reverse is not true. This finding has potential direct implications for brain models of visual recognition, by suggesting that when local information is conflicting with global information, inhibitory control reduces feedback activity from global information (e.g., inhibits the forest) which allows the visual system to process local information (e.g., to focus attention on a particular tree).

How semantic category modulates preschool children's visual memory

The dynamic interplay between perception and memory has been explored in preschool children by presenting filtered stimuli regarding animals and artifacts. The identification of filtered images was markedly influenced by both prior exposure and the semantic nature of the stimuli. The identification of animals required less physical information than artifacts did. Our results corroborate the notion that the human attention system evolves to reliably develop definite category-specific selection criteria by which living entities are monitored in different ways.

The neural bases of spatial frequency processing during scene perception

Theories on visual perception agree that scenes are processed in terms of spatial frequencies. Low spatial frequencies (LSF) carry coarse information whereas high spatial frequencies (HSF) carry fine details of the scene. However, how and where spatial frequencies are processed within the brain remain unresolved questions. The present review addresses these issues and aims to identify the cerebral regions differentially involved in low and high spatial frequency processing, and to clarify their attributes during scene perception. Results from a number of behavioral and neuroimaging studies suggest that spatial frequency processing is lateralized in both hemispheres, with the right and left hemispheres predominantly involved in the categorization of LSF and HSF scenes, respectively. There is also evidence that spatial frequency processing is retinotopically mapped in the visual cortex. HSF scenes (as opposed to LSF) activate occipital areas in relation to foveal representations, while categorization of LSF scenes (as opposed to HSF) activates occipital areas in relation to more peripheral representations. Concomitantly, a number of studies have demonstrated that LSF information may reach high-order areas rapidly, allowing an initial coarse parsing of the visual scene, which could then be sent back through feedback into the occipito-temporal cortex to guide finer HSF-based analysis. Finally, the review addresses spatial frequency processing within scene-selective regions areas of the occipito-temporal cortex.

A bimodal tuning curve for spatial frequency across left and right human orbital frontal cortex during object recognition

Orbital frontal cortex (OFC) is known to play a role in object recognition by generating "first-pass" hypotheses about the identity of naturalistic images based on low spatial frequency (SF) information. These hypotheses are evaluated by more detailed (and slower) ventral visual pathway processes. While it has been suggested on theoretical grounds, it remains unknown whether OFC also receives postrecognition feedback about stimulus identity. We used a novel paradigm in the context of functional magnetic resonance imaging that permits the first few hundred milliseconds of object recognition to be spread out over 120 s. OFC shows a robust response to low and relatively high SFs, whereas ventral stream regions display unimodal response distributions shifted toward high SFs. These findings in OFC were modulated by hemisphere, with right OFC differentially responding to low SFs and left OFC differentially responding to high SFs. Psychophysical experiments confirmed that the same ranges of SFs preferred by ventral stream regions are critical for determining the accuracy and speed of object recognition. Our findings indicate that OFC accesses global form (low SF information, right OFC) and object identity (high SF information, left OFC), and suggest that OFC receives feedback about the accuracy of its initial hypothesis regarding stimulus identity.

Coarse-to-fine categorization of visual scenes in scene-selective cortex

Neurophysiological, behavioral, and computational data indicate that visual analysis may start with the parallel extraction of different elementary attributes at different spatial frequencies and follows a predominantly coarse-to-fine (CtF) processing sequence (low spatial frequencies [LSF] are extracted first, followed by high spatial frequencies [HSF]). Evidence for CtF processing within scene-selective cortical regions is, however, still lacking. In the present fMRI study, we tested whether such processing occurs in three scene-selective cortical regions: the parahippocampal place area (PPA), the retrosplenial cortex, and the occipital place area. Fourteen participants were subjected to functional scans during which they performed a categorization task of indoor versus outdoor scenes using dynamic scene stimuli. Dynamic scenes were composed of six filtered images of the same scene, from LSF to HSF or from HSF to LSF, allowing us to mimic a CtF or the reverse fine-to-coarse (FtC) sequence. Results showed that only the PPA was more activated for CtF than FtC sequences. Equivalent activations were observed for both sequences in the retrosplenial cortex and occipital place area. This study suggests for the first time that CtF sequence processing constitutes the predominant strategy for scene categorization in the PPA.

Attending to global versus local stimulus features modulates neural processing of low versus high spatial frequencies: an analysis with event-related brain potentials

Spatial frequency (SF) selection has long been recognized to play a role in global and local processing, though the nature of the relationship between SF processing and global/local perception is debated. Previous studies have shown that attention to relatively lower SFs facilitates global perception, and that attention to relatively higher SFs facilitates local perception. Here we recorded event-related brain potentials (ERPs) to investigate whether processing of low versus high SFs is modulated automatically during global and local perception, and to examine the time course of any such effects. Participants compared bilaterally presented hierarchical letter stimuli and attended to either the global or local levels. Irrelevant SF grating probes flashed at the center of the display 200 ms after the onset of the hierarchical letter stimuli could either be low or high in SF. It was found that ERPs elicited by the SF grating probes differed as a function of attended level (global versus local). ERPs elicited by low SF grating probes were more positive in the interval 196–236 ms during global than local attention, and this difference was greater over the right occipital scalp. In contrast, ERPs elicited by the high SF gratings were more positive in the interval 250–290 ms during local than global attention, and this difference was bilaterally distributed over the occipital scalp. These results indicate that directing attention to global versus local levels of a hierarchical display facilitates automatic perceptual processing of low versus high SFs, respectively, and this facilitation is not limited to the locations occupied by the hierarchical display. The relatively long latency of these attention-related ERP modulations suggests that initial (early) SF processing is not affected by attention to hierarchical level, lending support to theories positing a higher level mechanism to underlie the relationship between SF processing and global versus local perception.

Contributions of magno- and parvocellular channels to conscious and non-conscious vision

The dorsal and ventral cortical pathways, driven predominantly by magnocellular (M) and parvocellular (P) inputs, respectively, assume leading roles in models of visual information processing. Although in prior proposals, the dorsal and ventral pathways support non-conscious and conscious vision, respectively, recent modelling and empirical developments indicate that each pathway plays important roles in both non-conscious and conscious vision. In these models, the ventral P-pathway consists of one subpathway processing an object's contour features, e.g. curvature, the other processing its surface attributes, e.g. colour. Masked priming studies have shown that feed-forward activity in the ventral P-pathway on its own supports non-conscious processing of contour and surface features. The dorsal M-pathway activity contributes directly to conscious vision of motion and indirectly to object vision by projecting to prefrontal cortex, which in turn injects top-down neural activity into the ventral P-pathway and there 'ignites' feed-forward-re-entrant loops deemed necessary for conscious vision. Moreover, an object's shape or contour remains invisible without the prior conscious registration of its surface properties, which for that reason are taken to comprise fundamental visual qualia. Besides suggesting avenues for future research, these developments bear on several recent and past philosophical issues.

Behavioral assessment of emotional and motivational appraisal during visual processing of emotional scenes depending on spatial frequencies

Previous studies performed on visual processing of emotional stimuli have revealed preference for a specific type of visual spatial frequencies (high spatial frequency, HSF; low spatial frequency, LSF) according to task demands. The majority of studies used a face and focused on the appraisal of the emotional state of others. The present behavioral study investigates the relative role of spatial frequencies on processing emotional natural scenes during two explicit cognitive appraisal tasks, one emotional, based on the self-emotional experience and one motivational, based on the tendency to action. Our results suggest that HSF information was the most relevant to rapidly identify the self-emotional experience (unpleasant, pleasant, and neutral) while LSF was required to rapidly identify the tendency to action (avoidance, approach, and no action). The tendency to action based on LSF analysis showed a priority for unpleasant stimuli whereas the identification of emotional experience based on HSF analysis showed a priority for pleasant stimuli. The present study confirms the interest of considering both emotional and motivational characteristics of visual stimuli.

Polymorphism in the CHRNA4 gene is associated with rapid scene categorization performance

The CHRNA4 gene is known to be associated with individual differences in attention. However, its associations with other cognitive functions remain to be elucidated. In the present study, we investigated the effects of genetic variations in CHRNA4 on rapid scene categorization by 100 healthy human participants. In Experiment 1, we also conducted the Attention Network Test (ANT) in order to examine whether the genetic effects could be accounted for by attention. CHRNA4 was genotyped as carrying the TT, CT, or CC allele. The scene categorization task required participants to judge whether the category of a scene image (natural or man-made) was consistent with a cue word displayed at the response phase. The target-mask stimulus onset asynchrony (SOA) ranged from 13 to 93 ms. In comparison with CC-allele carriers, CT- and TT-allele carriers responded more accurately at the long SOA (93 ms) only during natural-scene categorization. In contrast, we observed no consistent association between CHRNA4 and the ANT, and no intertask correlation between scene categorization and the ANT. To validate our natural-scene categorization results, Experiment 2, carried out with an independent sample of 100 participants and a different stimulus set, successfully replicated the association between CHRNA4 genotypes and natural-scene categorization accuracy at long SOAs (67 and 93 ms). Our findings demonstrate, for the first time, that genetic variations in CHRNA4 can moderately contribute to individual differences in natural-scene categorization performance.

Early spatial frequency processing of natural images: an ERP study

The present study examined the role of spatial stimulus frequencies in the early visual processing of natural scenes. The content of initially degraded (low- or high-pass filtered) pictures was progressively revealed in a sequence of steps by adding high or low spatial frequencies. Event Related Potentials (ERPs) were used to track the early stages of visual processing. Picture degradation modulated the topography of the P1, with an occipital midline distribution for the most degraded pictures, which became progressively more laterally distributed as pictures became more complete. Picture degradation also modulated the amplitude of the P2. For both low-passed and high-passed scenes, a linear relationship between the spectral power and the amplitude of the P1 and P2 was observed. These results are likely to reflect the progressive engagement of the lateral occipital complex as the amount of information in both the low and high portions of the frequency spectrum increased.

The neural signature of spatial frequency-based information integration in scene perception

Spatial frequency-based information plays an important role in visual perception. By combining behavioral and electroencephalogram (EEG) measurements, we investigated the mechanisms of the interaction and information integration between different spatial frequency bands. The observers performed a scene categorization task on hybrid images that were generated by combining the low spatial frequency (LSF) component of one image with the high spatial frequency (HSF) component of another image. The results showed that the recognition of the HSF component was interfered by the non-attended LSF component at semantic level. The strength of the semantic interference was modulated by the physical similarity between the LSF and HSF components. Analyses of the EEG data revealed an early anterior N1 component (122 ms from stimulus onset) that was related to the observed interaction of the semantic and physical information between the LSF and HSF components. These findings demonstrate that the semantic information from different spatial frequency bands can be integrated at early stage of the perceptual processing. This early integration is likely to occur at frontal areas in order to initiate top-down facilitation.

Retinotopic and lateralized processing of spatial frequencies in human visual cortex during scene categorization

Using large natural scenes filtered in spatial frequencies, we aimed to demonstrate that spatial frequency processing could not only be retinotopically mapped but could also be lateralized in both hemispheres. For this purpose, participants performed a categorization task using large black and white photographs of natural scenes (indoors vs. outdoors, with a visual angle of 24° × 18°) filtered in low spatial frequencies (LSF), high spatial frequencies (HSF), and nonfiltered scenes, in block-designed fMRI recording sessions. At the group level, the comparison between the spatial frequency content of scenes revealed first that, compared with HSF, LSF scene categorization elicited activation in the anterior half of the calcarine fissures linked to the peripheral visual field, whereas, compared with LSF, HSF scene categorization elicited activation in the posterior part of the occipital lobes, which are linked to the fovea, according to the retinotopic property of visual areas. At the individual level, functional activations projected on retinotopic maps revealed that LSF processing was mapped in the anterior part of V1, whereas HSF processing was mapped in the posterior and ventral part of V2, V3, and V4. Moreover, at the group level, direct interhemispheric comparisons performed on the same fMRI data highlighted a right-sided occipito-temporal predominance for LSF processing and a left-sided temporal cortex predominance for HSF processing, in accordance with hemispheric specialization theories. By using suitable method of analysis on the same data, our results enabled us to demonstrate for the first time that spatial frequencies processing is mapped retinotopically and lateralized in human occipital cortex.

Agnosia for global patterns: When the cross-talk between grouping and visual selective attention failS

We present a single case study of a 72-year-old mild AD patient, MC, with a highly specific deficit in deriving the global pattern of visual stimuli, in the absence of visuospatial neglect. MC shows a specific difficulty in segregating overlapping figures, in object decision, and in all neuropsychological tasks requiring perception of a global structure from local cues, such as the Street Completion Test and the perception of illusory contours and of the global level of hierarchical stimuli. The detailed neuropsychological assessment prompted a psychophysical experiment aiming to quantify the limits of perceptual grouping in MC. We measured the thresholds of integration for a closed chain of Gabor Patches as a function of background noise using stimuli with different values of the distance between the local elements. When compared to normal controls, the patient displays a statistically significant drop of performance for stimuli with the larger interelement distance. The data are interpreted in the context of the "association field" theory (Field, Hayes, & Hess, 1993). As MC presents with a marked atrophy of the right temporoparietal junction, we interpret our data as providing further evidence of a neuromodulatory role of the right temporoparietal junction over the occipital cortices, in line with recent functional evidence (Fink et al., 1997a). The study also highlights the benefits of complementing classical neuropsychological investigations with more quantitative psychophysical procedures.

Different spatial frequency bands selectively signal for natural image statistics in the early visual system

Early visual evoked potentials (VEPs) measured in humans have recently been observed to be modulated by the image statistics of natural scene imagery. Specifically, the early VEP is dominated by a strong positivity when participants view minimally complex natural scene imagery, with the magnitude of that component being modulated by luminance contrast differences across spatial frequency (i.e., the slope of the amplitude spectrum). For scenes high in structural complexity, the early VEP is dominated by a prominent negativity that exhibits little dependency on luminance contrast. However, since natural scene imagery is broad band in terms of spatial frequency, it is not known whether the above-mentioned modulation results from a complex interaction within or between the early neural processes tuned to different bands of spatial frequency. Here, we sought to address this question by measuring early VEPs (specifically, the C1, P1, and N1 components) while human participants viewed natural scene imagery that was filtered to contain specific bands of spatial frequency information. The results show that the C1 component is largely unmodulated by the luminance statistics of natural scene imagery (being only measurable when such stimuli were made to contain high spatial frequencies). The P1 and N1, on the other hand, were observed to exhibit strong spatial frequency-dependent modulation to the luminance statistics of natural scene imagery. The results therefore suggest that the dependency of early VEPs on natural image statistics results from an interaction between the early neural processes tuned to different bands of spatial frequency.

Is coarse-to-fine strategy sensitive to normal aging?

Theories on visual perception agree that visual recognition begins with global analysis and ends with detailed analysis. Different results from neurophysiological, computational, and behavioral studies all indicate that the totality of visual information is not immediately conveyed, but that information analysis follows a predominantly coarse-to-fine processing sequence (low spatial frequencies are extracted first, followed by high spatial frequencies). We tested whether such processing continues to occur in normally aging subjects. Young and aged participants performed a categorization task (indoor vs. outdoor scenes), using dynamic natural scene stimuli, in which they resorted to either a coarse-to-fine (CtF) sequence or a reverse fine-to-coarse sequence (FtC). The results show that young participants categorized CtF sequences more quickly than FtC sequences. However, sequence processing interacts with semantic category only for aged participants. The present data support the notion that CtF categorization is effective even in aged participants, but is constrained by the spatial features of the scenes, thus highlighting new perspectives in visual models.

Residual abilities in age-related macular degeneration to process spatial frequencies during natural scene categorization

Age-related macular degeneration (AMD) is characterized by a central vision loss. We explored the relationship between the retinal lesions in AMD patients and the processing of spatial frequencies in natural scene categorization. Since the lesion on the retina is central, we expected preservation of low spatial frequency (LSF) processing and the impairment of high spatial frequency (HSF) processing. We conducted two experiments that differed in the set of scene stimuli used and their exposure duration. Twelve AMD patients and 12 healthy age-matched participants in Experiment 1 and 10 different AMD patients and 10 healthy age-matched participants in Experiment 2 performed categorization tasks of natural scenes (Indoors vs. Outdoors) filtered in LSF and HSF. Experiment 1 revealed that AMD patients made more no-responses to categorize HSF than LSF scenes, irrespective of the scene category. In addition, AMD patients had longer reaction times to categorize HSF than LSF scenes only for indoors. Healthy participants' performance was not differentially affected by spatial frequency content of the scenes. In Experiment 2, AMD patients demonstrated the same pattern of errors as in Experiment 1. Furthermore, AMD patients had longer reaction times to categorize HSF than LSF scenes, irrespective of the scene category. Again, spatial frequency processing was equivalent for healthy participants. The present findings point to a specific deficit in the processing of HSF information contained in photographs of natural scenes in AMD patients. The processing of LSF information is relatively preserved. Moreover, the fact that the deficit is more important when categorizing HSF indoors, may lead to new perspectives for rehabilitation procedures in AMD.

Enabling global processing in simultanagnosia by psychophysical biasing of visual pathways

A fundamental aspect of visual cognition is our disposition to see the 'forest before the trees'. However, damage to the posterior parietal cortex, a critical brain region along the dorsal visual pathway, can produce a neurological disorder called simultanagnosia, characterized by a debilitating inability to perceive the 'forest' but not the 'trees' (i.e. impaired global processing despite intact local processing). This impairment in perceiving the global shape persists even though the ventral visual pathway, the primary recognition pathway, is intact in these patients. Here, we enabled global processing in patients with simultanagnosia using a psychophysical technique, which allowed us to bias stimuli such that they are processed predominantly by the intact ventral visual pathway. Our findings reveal that the impairment in global processing that characterizes simultanagnosia stems from a disruption in the processing of low-spatial frequencies through the dorsal pathway. These findings advance our understanding of the relationship between visuospatial attention and perception and reveal the neural mechanism mediating the disposition to see the 'forest before the trees'.

Microgenesis of surface completion in visual objects: evidence for filling-out

Using metacontrast masking we examined the temporal dynamics of surface completion in object vision. By varying the stimulus onset asynchrony between the target object and the flanking mask(s), we obtained estimates of the time required for the entire surface contrast to fill out within the area delimited by the contours/edges of the target. The estimated speed of the filling-out process was 36.0 deg/s. Using existing estimates of cortical magnification, the computed filling-out speed in terms of cortical distance is .385 m/s, a value that approximates the estimated cortical filling-in speed and the speed of horizontal propagation in monkey V1. We discuss our results in relation to (1) prior findings of filling-in and filling-out phenomena, using surface completion in cortical space as the unifying principle, and (2) extant computational models of object vision.

Magnocellular and Parvocellular Pathway Influences on Location-Based Inhibition-Of-Return

The roles of the parvocellular (P) and magnocellular (M) retino-geniculo-cortical pathways during shifts of visual attention were investigated by creating M/dorsal-biased (eg low spatial frequency target, no objects present) and P/ventral-biased (ie high spatial frequency target, the perception of 3-D objects) stimulus conditions and measuring location-based inhibition-of-return (IOR). P/ventral-biased conditions produced the greatest IOR. M/dorsal-biased conditions produced the least IOR, in one instance eliminating it altogether. The results indicate a close relationship between IOR magnitude and relative P/ventral and M/dorsal activity with location-based IOR related more to P/ventral than to M/dorsal activity.

Priming global and local processing of composite faces: revisiting the processing-bias effect on face perception

We used the composite-face illusion and Navon stimuli to determine the consequences of priming local or global processing on subsequent face recognition. The composite-face illusion reflects the difficulty of ignoring the task-irrelevant half-face while attending the task-relevant half if the half-faces in the composite are aligned. On each trial, participants first matched two Navon stimuli, attending to either the global or the local level, and then matched the upper halves of two composite faces presented sequentially. Global processing of Navon stimuli increased the sensitivity to incongruence between the upper and the lower halves of the composite face, relative to a baseline in which the composite faces were not primed. Local processing of Navon stimuli did not influence the sensitivity to incongruence. Although incongruence induced a bias toward different responses, this bias was not modulated by priming. We conclude that global processing of Navon stimuli augments holistic processing of the face.

Valence resolution of ambiguous facial expressions using an emotional oddball task

Previous research suggests that neural and behavioral responses to surprised faces are modulated by explicit contexts (e.g., "He just found $500"). Here, we examined the effect of implicit contexts (i.e., valence of other frequently presented faces) on both valence ratings and ability to detect surprised faces (i.e., the infrequent target). In Experiment 1, we demonstrate that participants interpret surprised faces more positively when they are presented within a context of happy faces, as compared to a context of angry faces. In Experiments 2 and 3, we used the oddball paradigm to evaluate the effects of clearly valenced facial expressions (i.e., happy and angry) on default valence interpretations of surprised faces. We offer evidence that the default interpretation of surprise is negative, as participants were faster to detect surprised faces when presented within a happy context (Exp. 2). Finally, we kept the valence of the contexts constant (i.e., surprised faces) and showed that participants were faster to detect happy than angry faces (Exp. 3). Together, these experiments demonstrate the utility of the oddball paradigm to explore the default valence interpretation of presented facial expressions, particularly the ambiguously valenced facial expression of surprise.

[The integration of spatial frequency-based information in scene perception: evidence from spatially incongruent images]

Humans can recognize a complex natural scene even when it appears only briefly. The rapid recognition of natural scenes is accomplished by parallel processing of information based on multiple spatial frequencies and integration of this information. Previous studies have revealed the time course of integration of frequency-based information. However, it is still unclear how frequency-based information is integrated. There are two possible levels for the integration: One involves spatial integration of images and constructs a unified image, and the other entails semantic integration associated with the scene context level irrespective of spatial arrangements. We investigated the categorization accuracy of the low + high-pass images, in which a left-right mirror reversed low-pass image was superimposed on a nonreversed high-pass image or vice versa. In this context, the low+high-pass images were semantically integrable but spatially incongruent. The results indicated that accuracy of the low+high-pass images did not exceed the expected accuracy level estimated from separate presentations. This finding suggests that frequency-based information can be integrated spatially.

Global precedence effect in audition and vision: evidence for similar cognitive styles across modalities

This study aimed to provide evidence for a Global Precedence Effect (GPE) in both vision and audition modalities. In order to parallel Navon's paradigm, a novel auditory task was designed in which hierarchical auditory stimuli were used to involve local and global processing. Participants were asked to process auditory and visual hierarchical patterns at the local or global level. In both modalities, a global-over-local advantage and a global interference on local processing were found. The other compelling result is a significant correlation between these effects across modalities. Evidence that the same participants exhibit similar processing style across modalities strongly supports the idea of a cognitive style to process information and common processing principle in perception.

Coarse-to-fine encoding of spatial frequency information into visual short-term memory for faces but impartial decay

Face perception studies investigated how spatial frequencies (SF) are extracted from retinal display while forming a perceptual representation, or their selective use during task-imposed categorization. Here we focused on the order of encoding low-spatial frequencies (LSF) and high-spatial frequencies (HSF) from perceptual representations into visual short-term memory (VSTM). We also investigated whether different SF-ranges decay from VSTM at different rates during a study-test stimulus-onset asynchrony. An old/new VSTM paradigm was used in which two broadband faces formed the positive set and the probes preserved either low or high SF ranges. Exposure time of 500 ms was sufficient to encode both HSF and LSF in the perceptual representation (experiment 1). Nevertheless, when the positive-set was exposed for 500 ms, LSF-probes were better recognized in VSTM compared with HSF-probes; this effect vanished at 800-ms exposure time (experiment 2). Backward masking the positive set exposed for 800 ms re-established the LSF-probes advantage (experiment 3). The speed of decay up to 10 seconds was similar for LSF- and HSF-probes (experiment 4). These results indicate that LSF are extracted and consolidated into VSTM faster than HSF, supporting a coarse-to-fine order, while the decay from VSTM is not governed by SF.

Visual Consciousness Revisited

Current theoretical approaches to consciousness and vision associate the dorsal cortical pathway, in which magnocellular (M) input is dominant, with nonconscious visual processing and the ventral cortical pathway, in which parvocellular (P) input is dominant, with conscious visual processing. We explored the known differences between M and P contrast-response functions to investigate the roles of these channels in vision. Simulations of contrast-dependent priming revealed that priming effects obtained with unmasked, visible primes were best modeled by equations characteristic of M channel responses, whereas priming effects obtained with masked, invisible primes were best modeled by equations characteristic of P channel responses. In the context of current theoretical approaches to conscious and nonconscious processing, our results indicate a surprisingly significant role of M channels in conscious vision. In a broader discussion of the role of M channels in vision, we propose a neurophysiologically plausible interpretation of the present results: M channels indirectly contribute to conscious object vision via top-down modulation of reentrant activity in the ventral object-recognition stream.

Effects of stimulus type and level repetition on content-level binding in global/local processing

The processing and representation of hierarchical objects not only involves the identification of information at the different levels, but also the binding of the identified content to its respective level. Whereas identification is well understood, little is known about content-level binding (CLB). In a recent study, however, it has been shown that attentional priming of certain spatial frequencies is advantageous for this binding. Therefore, the present study investigated effects of related factors on the binding process, namely stimulus type (filled or outlined hierarchical letters), stimulus-type repetition, and target-level repetition. The results show that CLB was improved for outlined stimuli and after target-level repetition, whereas stimulus-type repetition had no effect. The data suggest that hierarchical stimuli are mentally represented by abstract level categories and that content is linked to these categories by means of level-specific and identity-specific spatial-frequency information.

Humans and monkeys share visual representations

Conceptual abilities in animals have been shown at several levels of abstraction, but it is unclear whether the analogy with humans results from convergent evolution or from shared brain mechanisms inherited from a common origin. Macaque monkeys can access "non-similarity-based concepts," such as when sorting pictures containing a superordinate target category (animal, tree, etc.) among other scenes. However, such performances could result from low-level visual processing based on learned regularities of the photographs, such as for scene categorization by artificial systems. By using pictures of man-made objects or animals embedded in man-made or natural contexts, the present study clearly establishes that macaque monkeys based their categorical decision on the presence of the animal targets regardless of the scene backgrounds. However, as is found with humans, monkeys performed better with categorically congruent object/context associations, especially when small object sizes favored background information. The accuracy improvements and the response-speed gains attributable to superordinate category congruency in monkeys were strikingly similar to those of human subjects tested with the same task and stimuli. These results suggest analogous processing of visual information during the activation of abstract representations in both humans and monkeys; they imply a large overlap between superordinate visual representations in humans and macaques as well as the implicit use of experienced associations between object and context.

Holistic face categorization in higher order visual areas of the normal and prosopagnosic brain: toward a non-hierarchical view of face perception

How a visual stimulus is initially categorized as a face in a network of human brain areas remains largely unclear. Hierarchical neuro-computational models of face perception assume that the visual stimulus is first decomposed in local parts in lower order visual areas. These parts would then be combined into a global representation in higher order face-sensitive areas of the occipito-temporal cortex. Here we tested this view in fMRI with visual stimuli that are categorized as faces based on their global configuration rather than their local parts (two-tones Mooney figures and Arcimboldo's facelike paintings). Compared to the same inverted visual stimuli that are not categorized as faces, these stimuli activated the right middle fusiform gyrus (“Fusiform face area”) and superior temporal sulcus (pSTS), with no significant activation in the posteriorly located inferior occipital gyrus (i.e., no “occipital face area”). This observation is strengthened by behavioral and neural evidence for normal face categorization of these stimuli in a brain-damaged prosopagnosic patient whose intact right middle fusiform gyrus and superior temporal sulcus are devoid of any potential face-sensitive inputs from the lesioned right inferior occipital cortex. Together, these observations indicate that face-preferential activation may emerge in higher order visual areas of the right hemisphere without any face-preferential inputs from lower order visual areas, supporting a non-hierarchical view of face perception in the visual cortex.

Spatial contrast sensitivity in adolescents with autism spectrum disorders

Adolescents with autism spectrum disorders (ASD) and typically developing (TD) controls underwent a rigorous psychophysical assessment that measured contrast sensitivity to seven spatial frequencies (0.5-20 cycles/degree). A contrast sensitivity function (CSF) was then fitted for each participant, from which four measures were obtained: visual acuity, peak spatial frequency, peak contrast sensitivity, and contrast sensitivity at a low spatial frequency. There were no group differences on any of the four CSF measures, indicating no differential spatial frequency processing in ASD. Although it has been suggested that detail-oriented visual perception in individuals with ASD may be a result of differential sensitivities to low versus high spatial frequencies, the current study finds no evidence to support this hypothesis.

Electrophysiological study of local/global processing in Williams syndrome

Persons with Williams syndrome (WS) demonstrate pronounced deficits in visuo-spatial processing. The purpose of the current study was to examine the preferred level of perceptual analysis in young adults with WS (n = 21) and the role of attention in the processing of hierarchical stimuli. Navon-like letter stimuli were presented to adults with WS and age-matched typical controls in an oddball paradigm where local and global targets could appear with equal probability. Participants received no explicit instruction to direct their attention toward a particular stimulus level. Behavioral and event-related potential (ERP) data were recorded. Behavioral data indicated presence of a global precedence effect in persons with WS. However, their ERP responses revealed atypical brain mechanisms underlying attention to local information. During the early perceptual analysis, global targets resulted in reduced P1 and enhanced N150 responses in both participant groups. However, only the typical comparison group demonstrated a larger N150 to local targets. At the more advanced stages of cognitive processing, a larger P3b response to global and local targets was observed in the typical group but not in persons with WS, who instead demonstrated an enhanced P3a to global targets only. The results indicate that in a perceptual task, adults with WS may experience greater than typical global-to-local interference and not allocate sufficient attentional resources to local information.

Are Coarse Scales Sufficient for Fast Detection of Visual Threat?

It has recently been suggested that low-spatial-frequency information would provide rapid visual cues to the amygdala for basic but ultrarapid behavioral responses to dangerous stimuli. The present behavioral study investigated the role of different spatial-frequency channels in visually detecting dangerous stimuli belonging to living or nonliving categories. Subjects were engaged in a visual detection task involving dangerous stimuli, and subjects’ behavioral responses were assessed in association with their fear expectations (induced by an aversive 90-dB white noise). Our results showed that, despite its crudeness, low-spatial-frequency information could constitute a sufficient signal for fast recognition of visual danger in a context of fear expectation. In addition, we found that this effect tended to be specific for living entities. These results were obtained despite a strong perceptual bias toward faster recognition of high-spatial-frequency stimuli under supraliminal perception durations.

Visual demand and visual field presentation influence natural scene processing

BACKGROUND

Bottom-up and top-down processes are involved in visual analysis of scenes. Here we examined the influence of top-down visual demand on natural scene processing.

METHODS

We measured accuracy and response time in adults performing two stimuli-equivalent tasks. Unfiltered, low or high spatial frequency (SF) natural scenes were presented in central, left, or right visual fields (CVF, LVF, RVF). The tasks differed only by the instructed visual demand. In the detection task, participants had to decide whether a scene was present or not. In the categorization task, they had to decide whether the scene was a city or a forest.

RESULTS

Higher accuracy was seen for the LVF in the detection task, but for categorization, greater accuracy was seen for the RVF. The interaction between Task and SF revealed coarse-to-fine processing in the categorization task for both accuracy and reaction time, which nearly disappeared in the detection task. Considering the interaction of Task, VF and SF, a left-hemisphere specialisation (i.e., RVF advantage) was observed for the categorisation of HSF scenes for accuracy alone, whereas a LVF advantage was seen for all SFs in the detection task for both accuracy and reaction time.

CONCLUSION

Our results revealed that the nature of top-down visual demand is essential to understanding how visual analysis is achieved in each hemisphere. Moreover, this study examining the effects of visual demand, visual field presentation, and SF content of stimuli through the use of ecological stimuli provides a tool to enrich the clinical examination of visual and neurovisual patients.

From coarse to fine? Spatial and temporal dynamics of cortical face processing

Primary vision segregates information along 2 main dimensions: orientation and spatial frequency (SF). An important question is how this primary visual information is integrated to support high-level representations. It is generally assumed that the information carried by different SF is combined following a coarse-to-fine sequence. We directly addressed this assumption by investigating how the network of face-preferring cortical regions processes distinct SF over time. Face stimuli were flashed during 75, 150, or 300 ms and masked. They were filtered to preserve low SF (LSF), middle SF (MSF), or high SF (HSF). Most face-preferring regions robustly responded to coarse LSF, face information in early stages of visual processing (i.e., until 75 ms of exposure duration). LSF processing decayed as a function of exposure duration (mostly until 150 ms). In contrast, the processing of fine HSF, face information became more robust over time in the bilateral fusiform face regions and in the right occipital face area. The present evidence suggests the coarse-to-fine strategy as a plausible modus operandi in high-level visual cortex.

The primacy of negative interpretations when resolving the valence of ambiguous facial expressions

Low-spatial-frequency (LSF) visual information is processed in an elemental fashion before a finer analysis of high-spatial-frequency information. Further, the amygdala is particularly responsive to LSF information contained within negative (e.g., fearful) facial expressions. In a separate line of research, it has been shown that surprised facial expressions are ambiguous in that they can be interpreted as either negatively or positively valenced. More negative interpretations of surprise are associated with increased ventral amygdala activity. In this report, we show that LSF presentations of surprised expressions bias the interpretation of surprised expressions in a negative direction, a finding suggesting that negative interpretations are first and fast during the resolution of ambiguous valence. We also examined the influence of subjects' positivity-negativity bias on this effect.

Local or global? Attentional selection of spatial frequencies binds shapes to hierarchical levels

Contrary to the traditional view that shapes and their hierarchical level (local or global) are a priori integrated in perception, recent evidence suggests that the identity of a shape and its level are encoded independently, implying the need for shape-level binding to account for normal perception. What is the binding mechanism in this case? Using hierarchically arranged letter shapes, we obtained evidence that the left hemisphere has a preference for binding shapes to the local level, whereas the right hemisphere has a preference for binding shapes to the global level. More important, binding is modulated by attentional selection of higher or lower spatial frequencies. Attention to higher spatial frequencies facilitated subsequent binding by the left hemisphere of elements to the local level, whereas attention to lower spatial frequencies facilitated subsequent binding by the right hemisphere of elements to the global level.

How spatial frequencies and visual awareness interact during face processing

In vision, high and low spatial frequencies have been dissociated at the cognitive and neural levels. Usually, high spatial frequency (HSF) is associated with slow analysis along the ventral cortical stream, and low spatial frequency (LSF) is associated with fast and automatic processing. These findings suggest a specific relation between spatial-frequency processing and visual awareness. We investigated this issue using masked-face priming with hybrid prime images of variable visibility. We found subliminal priming for both LSF and HSF information, along with a strong interaction between spatial frequency and visibility: HSF-related priming increased with stimulus visibility, whereas LSF influences remained unchanged. We argue that the results limit the validity of the coarse-to-fine model of vision and of models equating ventral-stream activity with perceptual awareness. Interpreting our results in light of the diagnostic approach suggests a close relation between awareness and diagnosticity.

Dynamics of trimming the content of face representations for categorization in the brain

To understand visual cognition, it is imperative to determine when, how and with what information the human brain categorizes the visual input. Visual categorization consistently involves at least an early and a late stage: the occipito-temporal N170 event related potential related to stimulus encoding and the parietal P300 involved in perceptual decisions. Here we sought to understand how the brain globally transforms its representations of face categories from their early encoding to the later decision stage over the 400 ms time window encompassing the N170 and P300 brain events. We applied classification image techniques to the behavioral and electroencephalographic data of three observers who categorized seven facial expressions of emotion and report two main findings: (1) over the 400 ms time course, processing of facial features initially spreads bilaterally across the left and right occipito-temporal regions to dynamically converge onto the centro-parietal region; (2) concurrently, information processing gradually shifts from encoding common face features across all spatial scales (e.g., the eyes) to representing only the finer scales of the diagnostic features that are richer in useful information for behavior (e.g., the wide opened eyes in ‘fear’; the detailed mouth in ‘happy’). Our findings suggest that the brain refines its diagnostic representations of visual categories over the first 400 ms of processing by trimming a thorough encoding of features over the N170, to leave only the detailed information important for perceptual decisions over the P300.

How the brain uses visual information to construct representations of categories is a central question of cognitive neuroscience. With our methods we visualize how the brain transforms its representations of facial expressions. Using electroencephalographic data, we analyze how representations change over the first 450 ms of processing both in feature content (e.g., which aspects of the face, such as the eyes or the mouth are represented across time) and level of detail. We show that facial expressions are initially encoded with most of their features (i.e., mouth and eyes) across all levels of details in the occipito-temporal regions. In a later phase, we show that a gradual reorganization of representations occurs, whereby only task relevant face features are kept (e.g., the mouth in “happy”) at only the finest level of details. We describe this elimination of irrelevant and redundant information as ‘trimming’. We suggest that this may be an example of the brain optimizing categorical representations.

The time-course of visual categorizations: you spot the animal faster than the bird

Background

Since the pioneering study by Rosch and colleagues in the 70s, it is commonly agreed that basic level perceptual categories (dog, chair…) are accessed faster than superordinate ones (animal, furniture…). Nevertheless, the speed at which objects presented in natural images can be processed in a rapid go/no-go visual superordinate categorization task has challenged this “basic level advantage”.

Principal Findings

Using the same task, we compared human processing speed when categorizing natural scenes as containing either an animal (superordinate level), or a specific animal (bird or dog, basic level). Human subjects require an additional 40–65 ms to decide whether an animal is a bird or a dog and most errors are induced by non-target animals. Indeed, processing time is tightly linked with the type of non-targets objects. Without any exemplar of the same superordinate category to ignore, the basic level category is accessed as fast as the superordinate category, whereas the presence of animal non-targets induces both an increase in reaction time and a decrease in accuracy.

Conclusions and Significance

These results support the parallel distributed processing theory (PDP) and might reconciliate controversial studies recently published. The visual system can quickly access a coarse/abstract visual representation that allows fast decision for superordinate categorization of objects but additional time-consuming visual analysis would be necessary for a decision at the basic level based on more detailed representations.