Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex

The neural structures expressing perceptual hysteresis in visual letter recognition

Perception can change nonlinearly with stimulus contrast, and perceptual threshold may depend on the direction of contrast change. Such hysteresis effects in neurometric functions provide a signature of perceptual awareness. We recorded brain activity with functional neuroimaging in observers exposed to gradual contrast changes of initially hidden visual stimuli. Lateral occipital, frontal, and parietal regions all displayed both transient activations and hysteresis that correlated with change and maintenance of a percept, respectively. Medial temporal activity did not follow perception but increased during hysteresis and showed transient deactivations during perceptual transitions. These findings identify a set of brain regions sensitive to visual awareness and suggest that medial temporal structures may provide backward signals that account for neural and, thereby, perceptual hysteresis.

Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming

We conducted two event-related functional magnetic resonance imaging (fMRI) experiments to investigate the neural substrates of visual object recognition in humans. We used a repetition-priming method with visual stimuli recurring at unpredictable intervals, either with the same appearance or with changes in size, viewpoint or exemplar. Lateral occipital and posterior inferior temporal cortex showed lower activity for repetitions of both real and non-sense objects; fusiform and left inferior frontal regions showed decreases for repetitions of only real objects. Repetition of different exemplars with the same name affected only the left inferior frontal cortex. Crucially, priming-induced decreases in activity of the right fusiform cortex depended on whether the three-dimensional objects were repeated with the same viewpoint, regardless of whether retinal image size changed; left fusiform decreases were independent of both viewpoint and size. These data show that dissociable subsystems in ventral visual cortex maintain distinct view-dependent and view-invariant object representations.

Task-related changes in cortical synchronization are spatially coincident with the hemodynamic response

Using group functional Magnetic Resonance Imaging (fMRI) and group Magnetoencephalography (MEG) we studied two cognitive paradigms: A language task involving covert letter fluency and a visual task involving biological motion direction discrimination. The MEG data were analyzed using an adaptive beam-former technique known as Synthetic Aperture Magnetometry (SAM), which provides continuous 3-D images of cortical power changes. These images were spatially normalized and averaged across subjects to provide a group SAM image in the same template space as the group fMRI data. The results show that frequency-specific, task-related changes in cortical synchronization, detected using MEG, match those areas of the brain showing an evoked cortical hemodynamic response with fMRI. The majority of these changes were event-related desynchronizations (ERDs) in the 5-10 Hz and 15-25 Hz frequency ranges. Our study demonstrates how SAM, spatial normalization, and intersubject averaging enable group MEG studies to be performed. SAM analysis also allows the MEG experiment to have exactly the same task design as the corresponding fMRI experiment. This new analysis framework represents an important advance in the use of MEG as a cognitive neuroimaging technique and also allows mutual cross-validation with fMRI.

Dynamics of visual feature analysis and object-level processing in face versus letter-string perception

Neurones in the human inferior occipitotemporal cortex respond to specific categories of images, such as numbers, letters and faces, within 150-200 ms. Here we identify the locus in time when stimulus-specific analysis emerges by comparing the dynamics of face and letter-string perception in the same 10 individuals. An ideal paradigm was provided by our previous study on letter-strings, in which noise-masking of stimuli revealed putative visual feature processing at 100 ms around the occipital midline followed by letter-string-specific activation at 150 ms in the left inferior occipitotemporal cortex. In the present study, noise-masking of cartoon-like faces revealed that the response at 100 ms increased linearly with the visual complexity of the images, a result that was similar for faces and letter-strings. By 150 ms, faces and letter-strings had entered their own stimulus-specific processing routes in the inferior occipitotemporal cortex, with identical timing and large spatial overlap. However, letter-string analysis lateralized to the left hemisphere, whereas face processing occurred more bilaterally or with right-hemisphere preponderance. The inferior occipitotemporal activations at approximately 150 ms, which take place after the visual feature analysis at approximately 100 ms, are likely to represent a general object-level analysis stage that acts as a rapid gateway to higher cognitive processing.

Neural mechanisms of object recognition

Single-unit recordings from behaving monkeys and human functional magnetic resonance imaging studies have continued to provide a host of experimental data on the properties and mechanisms of object recognition in cortex. Recent advances in object recognition, spanning issues regarding invariance, selectivity, representation and levels of recognition have allowed us to propose a putative model of object recognition in cortex.

Social interest and the development of cortical face specialization: what autism teaches us about face processing

Investigations of face processing in persons with an autism spectrum disorder (ASD) inform upon theories of the development of "normal" face processing, and the story that emerges challenges some models of the nature and origin of cortical face specialization. Individuals with an ASD possess deficits in face processing and a lack of a fusiform face area (FFA). Evidence from studies of ASD can be conceptualized best using an expertise framework of face processing rather than models that postulate a face module in the fusiform gyrus. Because persons with an ASD have reduced social interest, they may fail to develop cortical face specialization. Face specialization may develop in normal individuals because they are socially motivated to regard the face, and such motivation promotes expertise for faces. The amygdala is likely the key node in the system that marks objects as emotionally salient and could be crucial to the development of cortical face specialization.

The topography of high-order human object areas

Cortical topography is one of the most fundamental organizing principles of cortical areas. One such topography - eccentricity mapping - is present even in high-order, ventral stream visual areas. Within these areas, different object categories have specific eccentricity biases. In particular, faces, letters and words appear to be associated with central visual-field bias, whereas buildings are associated with a peripheral one. We propose that resolution needs are an important factor in organizing object representations: objects whose recognition depends on analysis of fine detail will be associated with central-biased representations, whereas objects whose recognition entails large-scale integration will be more peripherally biased.

Parallel visual motion processing streams for manipulable objects and human movements

We tested the hypothesis that different regions of lateral temporal cortex are specialized for processing different types of visual motion by studying the cortical responses to moving gratings and to humans and manipulable objects (tools and utensils) that were either stationary or moving with natural or artificially generated motions. Segregated responses to human and tool stimuli were observed in both ventral and lateral regions of posterior temporal cortex. Relative to ventral cortex, lateral temporal cortex showed a larger response for moving compared with static humans and tools. Superior temporal cortex preferred human motion, and middle temporal gyrus preferred tool motion. A greater response was observed in STS to articulated compared with unarticulated human motion. Specificity for different types of complex motion (in combination with visual form) may be an organizing principle in lateral temporal cortex.

Perceptual completion across the vertical meridian and the role of early visual cortex

Perceptual completion can link widely separated contour fragments and interpolate illusory contours (ICs) between them. The mechanisms underlying such long-range linking are not well understood. Here we report that completion is much poorer when ICs cross the vertical meridian than when they reside entirely within the left or right visual hemifield. This deficit reflects limitations in cross-hemispheric integration. We also show that the sensitivity to the interhemispheric divide is unique to perceptual completion: a comparable task which did not require completion showed no across-meridian impairment. We propose that these findings support the existence of specialized completion mechanisms in early visual cortical areas (V1/V2), since those areas are likely to be more sensitive to the interhemispheric divide.

Three-dimensional shape representation in monkey cortex

Using fMRI in anesthetized monkeys, this study investigates how the primate visual system constructs representations of three-dimensional (3D) shape from a variety of cues. Computer-generated 3D objects defined by shading, random dots, texture elements, or silhouettes were presented either statically or dynamically (rotating). Results suggest that 3D shape representations are highly localized, although widely distributed, in occipital, temporal, parietal, and frontal cortices and may involve common brain regions regardless of shape cue. This distributed network of areas cuts across both "what" and "where" processing streams, reflecting multiple uses for 3D shape representation in perception, recognition, and action.

Object-completion effects in the human lateral occipital complex

The ability of the human visual system to recognize partially occluded objects is a striking feat, which has received extensive psychophysical documentation. Here we studied the manifestation of completion effects in the functional magnetic resonance imaging (fMRI) activation of high-order object areas (the lateral occipital complex - LOC). Subjects were presented with three types of images: (i) whole line drawings of animal or unfamiliar shapes ('whole'); (ii) the same shapes, occluded by parallel stripes which occupied roughly half of the surface area of the images ('grid'); and (iii) the same stripes, 'scrambled' so that the relative position of the regions between the stripes was changed while the local feature structure remained intact. Behavioral measurements showed a high degree of object completion in the 'grid' condition, but not in the 'scrambled' condition. The fMRI results show a significantly higher activation to the 'grid' images compared to the 'scrambled' images. This enhanced activation indicates the operation of non-local completion effects, since the local features in both sets of images were the same. The cortical regions showing the highest 'completion' effects co-localized with regions in the LOC which showed the highest activation to the 'whole' images compared to the 'scrambled' images. Activation in early retinotopic areas was similar in both the 'grid' and the 'scrambled' conditions. Our results point to the LOC as a central site in which object completion effects are manifested.

Are subitizing and counting implemented as separate or functionally overlapping processes?

Enumeration of small groups of four or fewer objects is very fast and accurate (often called "subitizing"), but gets slower and more error prone for more than four items ("counting"). Many theories have been proposed to account for this dichotomy, most suggesting that "subitizing" and "counting" are two qualitatively different and separable processes. Others, in contrast, have proposed that the two operations reflect two different levels along a continuum of complexity. In this paper we present a PET study that attempts to characterize subitizing and counting at a neural level in order to investigate whether they are implemented as separate or functionally overlapping processes. Subjects performed an enumeration task on visual arrays of dots that varied in numerosity (1-4 and 6-9 dots) and spatial arrangement (canonical and random). The results demonstrated a common network for subitizing and counting that comprises extrastriate middle occipital and intraparietal areas. The intensity and spatial extent of this network were modulated by the number of dots and their spatial arrangement: activation increased as the number of items in the visual array increased, reaching maximum peak and extent for counting 6-9 randomly arranged items. Direct comparison between subitizing and counting showed that counting, relative to subitizing, was correlated with increased activity in this occipitoparietal network, while subitizing did not show areas of increased activation with respect to counting. Results speak against the idea of the two processes being implemented in separable neural systems.

Object-selective responses in the human motion area MT/MST

The perception of moving objects and our successful interaction with them entail that the visual system integrates shape and motion information about objects. However, neuroimaging studies have implicated different human brain regions in the analysis of visual motion (medial temporal cortex; MT/MST) and shape (lateral occipital complex; LOC), consistent with traditional approaches in visual processing that attribute shape and motion processing to anatomically and functionally separable neural mechanisms. Here we demonstrate object-selective fMRI responses (higher responses for intact than for scrambled images of objects) in MT/MST, and especially in a ventral subregion of MT/MST, suggesting that human brain regions involved mainly in the processing of visual motion are also engaged in the analysis of object shape.

Adaptive changes in early and late blind: a fMRI study of Braille reading

Braille reading depends on remarkable adaptations that connect the somatosensory system to language. We hypothesized that the pattern of cortical activations in blind individuals reading Braille would reflect these adaptations. Activations in visual (occipital-temporal), frontal-language, and somatosensory cortex in blind individuals reading Braille were examined for evidence of differences relative to previously reported studies of sighted subjects reading print or receiving tactile stimulation. Nine congenitally blind and seven late-onset blind subjects were studied with fMRI as they covertly performed verb generation in response to reading Braille embossed nouns. The control task was reading the nonlexical Braille string "######". This study emphasized image analysis in individual subjects rather than pooled data. Group differences were examined by comparing magnitudes and spatial extent of activated regions first determined to be significant using the general linear model. The major adaptive change was robust activation of visual cortex despite the complete absence of vision in all subjects. This included foci in peri-calcarine, lingual, cuneus and fusiform cortex, and in the lateral and superior occipital gyri encompassing primary (V1), secondary (V2), and higher tier (VP, V4v, LO and possibly V3A) visual areas previously identified in sighted subjects. Subjects who never had vision differed from late blind subjects in showing even greater activity in occipital-temporal cortex, provisionally corresponding to V5/MT and V8. In addition, the early blind had stronger activation of occipital cortex located contralateral to the hand used for reading Braille. Responses in frontal and parietal cortex were nearly identical in both subject groups. There was no evidence of modifications in frontal cortex language areas (inferior frontal gyrus and dorsolateral prefrontal cortex). Surprisingly, there was also no evidence of an adaptive expansion of the somatosensory or primary motor cortex dedicated to the Braille reading finger(s). Lack of evidence for an expected enlargement of the somatosensory representation may have resulted from balanced tactile stimulation and gross motor demands during Braille reading of nouns and the control fields. Extensive engagement of visual cortex without vision is discussed in reference to the special demands of Braille reading. It is argued that these responses may represent critical language processing mechanisms normally present in visual cortex.

Emotion-perception interplay in the visual cortex: "the eyes follow the heart"

Emotive aspects of stimuli have been shown to modulate perceptual thresholds. Lately, studies using functional Magnetic Resonance Imaging (fMRI) showed that emotive aspects of visual stimuli activated not only canonical limbic regions, but also sensory areas in the cerebral cortex. However, it is still arguable to what extent such emotive, related activation in sensory areas of the cortex are affected by physical characteristic or attribute difference of stimuli. To manipulate valence of stimuli while keeping visual features largely unchanged, we took advantage of the Expressional Transfiguration (ET) of faces. In addition, to explore the sensitivity of high level visual regions, we compared repeated with unrepeated (i.e. different) stimuli presentations (fMR adaptation). Thus, the dynamics of brain responses was determined according to the relative signal reduction during "repeated" relative to "different" presentations ("adaptation ratio"). Our results showed, for the first time, that emotional valence produced significant differences in fMR adaptation, but not in overall levels of activation of lateral occipital complex (LOC). We then asked whether this emotion modulation on sensory cortex could be related to previous personal experience that attached negative attributes of stimuli. To clarify this, we investigated Posttraumatic Stress Disorder (PTSD) and non-PTSD veterans. PTSD is characterized by recurrent revival of trauma-related sensations. Such phenomena have been attributed to a disturbed processing of trauma-related stimuli, either at the perceptual level or at the cognitive level. We assumed that PTSD veterans would differ from non-PTSD veterans (who have similar combat experience) in their high order visual cortex responses to combat-related visual stimuli that are associated with their traumatic experience. An fMRI study measured the cerebral activation of subjects while viewing pictures with and without combat content, in "repeated" or "different" presentation conditions. The emotive effect on the visual cortex was found, again, only in the fMR-adaptation paradigm. Visual cortical regions showed significant differences between PTSD and non-PTSD veterans only in "repeated" presentations of trauma-related stimuli (i.e. combat). In these regions, PTSD veterans showed less decrease in signal with repeated presentations of the same combat-related stimuli. This finding points to the possibility that traumatic experience modulates brain activity at the level of sensory cortex itself.

Feeling or features: different sensitivity to emotion in high-order visual cortex and amygdala

Emotionally loaded visual stimuli have shown increased activation in visual and cortex limbic areas. However, differences in visual features of such images could confound these findings. In order to manipulate valence of stimuli while keeping visual features largely unchanged, we took advantage of an "expressional transfiguration" (ET) effect of faces. In addition, we used repetition effects, which enabled us to test more incisively the impact of the ET effect. Using the ET manipulation, we have shown that the activation in lateral occipital complex (LOC) was unaffected by valence attributes, but produced significant modulation of fMR adaptation. Contrary to LOC, amygdala activation was increased by ET manipulation unrelated to the adaptation. A correlation between amygdala and LOC adaptation points to a possible modulatory role of the amygdala upon visual cortex short-term plasticity.

Shape-selective stereo processing in human object-related visual areas

Object related areas in the human ventral stream were previously shown to be activated, in a shape-selective manner, by luminance, motion, and texture cues. We report on the preferential activation of these areas by stereo cues defining shape. To assess the relationship of this activation to object recognition, we employed a perceptual stereo effect, which profoundly affects object recognition. The stimuli consisted of stereo-defined line drawings of objects that either protruded in front of a flat background ("front"), or were sunk into the background ("back"). Despite the similarity in the local feature structure of the two conditions, object recognition was superior in the "front" compared to the "back" configuration. We measured both recognition rates and fMRI signal from the human visual cortex while subjects viewed these stimuli. The results reveal shape selective activation from images of objects defined purely by stereoscopic cues in the human ventral stream. Furthermore, they show a significant correlation between recognition and fMRI signal in the object-related occipito-temporal cortex (lateral occipital complex).

Event-related functional magnetic resonance imaging study of the extrastriate cortex response to a categorically ambiguous stimulus primed by letters and familiar geometric figures

Functional neuroimaging studies have suggested a specific role of the extrastriate cortex in letter string and visual word form processing. However, this region has been shown to be involved in object recognition and its specificity for the processing of linguistic stimuli may be questioned. The authors used an event-related functional magnetic resonance imaging design with category priming to record the response elicited by the passive viewing of single letters, geometric figures, and of the categorically ambiguous stimulus "O" that pertains to both sets of familiar symbols. Bilateral activations in the extrastriate cortex were found, with a left predominance particularly pronounced for the ambiguous stimulus. Individual analysis of spatial extent and signal intensity showed a priming x stimulus x hemisphere interaction. When primed by the congruous categoric set, a bilateral decrease in activation was observed for letters and geometric figures. The ambiguous stimulus behaved as a letter for the left hemisphere, with decreased activation when primed by letters, whereas in the right hemisphere, an adaptation effect occurred when primed by geometric figures. These priming effects suggest that, for the ambiguous stimulus, letter processing was systematically involved in the left extrastriate cortex. The current results support the existence of a neural substrate for the abstract category of letters.

How does the brain discriminate familiar and unfamiliar faces?: a PET study of face categorical perception

Where and how does the brain discriminate familiar and unfamiliar faces? This question has not been answered yet by neuroimaging studies partly because different tasks were performed on familiar and unfamiliar faces, or because familiar faces were associated with semantic and lexical information. Here eight subjects were trained during 3 days with a set of 30 faces. The familiarized faces were morphed with unfamiliar faces. Presented with continua of unfamiliar and familiar faces in a pilot experiment, a group of eight subjects presented a categorical perception of face familiarity: there was a sharp boundary in percentage of familiarity decisions between 40% and 60% faces. In the main experiment, subjects were scanned (PET) on the fourth day (after 3 days of training) in six conditions, all requiring a sex classification task. Completely novel faces (0%) were presented in Condition 1 and familiar faces (100%) in Condition 6, while faces of steps of 20% in the continuum of familiarity were presented in Conditions 2 to 5 (20% to 80%). A principal component analysis (PCA) indicated that most variations in neural responses were related to the dissociation between faces perceived as familiar (60% to 100%) and faces perceived as unfamiliar (0 to 40%). Subtraction analyses did not disclose any increase of activation for faces perceived as familiar while there were large relative increases for faces perceived as unfamiliar in several regions of the right occipito-temporal visual pathway. These changes were all categorical and were observed mainly in the right middle occipital gyrus, the right posterior fusiform gyrus, and the right inferotemporal cortex. These results show that (1) the discrimination between familiar and unfamiliar faces is related to relative increases in the right ventral pathway to unfamiliar/novel faces; (2) familiar and unfamiliar faces are discriminated in an all-or-none fashion rather than proportionally to their resemblance to stored representations; and (3) categorical perception of faces is associated with abrupt changes of brain activity in the regions that discriminate the two extremes of the multidimensional continuum.

A cortical area selective for visual processing of the human body

Despite extensive evidence for regions of human visual cortex that respond selectively to faces, few studies have considered the cortical representation of the appearance of the rest of the human body. We present a series of functional magnetic resonance imaging (fMRI) studies revealing substantial evidence for a distinct cortical region in humans that responds selectively to images of the human body, as compared with a wide range of control stimuli. This region was found in the lateral occipitotemporal cortex in all subjects tested and apparently reflects a specialized neural system for the visual perception of the human body.

Functional neuroanatomy of biological motion perception in humans

We used whole brain functional MRI to investigate the neural network specifically engaged in the recognition of "biological motion" defined by point-lights attached to the major joints and head of a human walker. To examine the specificity of brain regions responsive to biological motion, brain activations obtained during a "walker vs. non-walker" discrimination task were compared with those elicited by two other tasks: (i) non-rigid motion (NRM), involving the discrimination of overall motion direction in the same "point-lights" display, and (ii) face-gender discrimination, involving the discrimination of gender in briefly presented photographs of men and women. Brain activity specific to "biological motion" recognition arose in the lateral cerebellum and in a region in the lateral occipital cortex presumably corresponding to the area KO previously shown to be particularly sensitive to kinetic contours. Additional areas significantly activated during the biological motion recognition task involved both, dorsal and ventral extrastriate cortical regions. In the ventral regions both face-gender discrimination and biological motion recognition elicited activation in the lingual and fusiform gyri and in the Brodmann areas 22 and 38 in superior temporal sulcus (STS). Along the dorsal pathway, both biological motion recognition and non-rigid direction discrimination gave rise to strong responses in several known motion sensitive areas. These included Brodmann areas 19/37, the inferior (Brodmann Area 39), and superior parietal lobule (Brodmann Area 7). Thus, we conjecture that, whereas face (and form) stimuli activate primarily the ventral system and motion stimuli primarily the dorsal system, recognition of biological motion stimuli may activate both systems as well as their confluence in STS. This hypothesis is consistent with our findings in stroke patients, with unilateral brain lesions involving at least one of these areas, who, although correctly reporting the direction of the point-light walker, fail on the biological motion task.

The representation of objects in the human occipital and temporal cortex

Recently, we identified, using fMRI, three bilateral regions in the ventral temporal cortex that responded preferentially to faces, houses, and chairs [Ishai, A., Ungerleider, L. G., Martin, A., Schouten, J. L., & Haxby, J. V. (1999). Distributed representation of objects in the human ventral visual pathway. Proceedings of the National Academy of Sciences, U.S.A., 96, 9379--9384]. Here, we report differential patterns of activation, similar to those seen in the ventral temporal cortex, in bilateral regions of the ventral occipital cortex. We also found category-related responses in the dorsal occipital cortex and in the superior temporal sulcus. Moreover, rather than activating discrete, segregated areas, each category was associated with its own differential pattern of response across a broad expanse of cortex. The distributed patterns of response were similar across tasks (passive viewing, delayed matching) and presentation formats (photographs, line drawings). We propose that the representation of objects in the ventral visual pathway, including both occipital and temporal regions, is not restricted to small, highly selective patches of cortex but, instead, is a distributed representation of information about object form. Within this distributed system, the representation of faces appears to be less extensive as compared to the representations of nonface objects.

Transperceptual encoding and retrieval processes in memory: a PET study of visual and haptic objects

An important objective of functional neuroimaging research is to identify neuroanatomical correlates of memory processes such as encoding and retrieval. In typical studies directed at this goal, however, the to-be-remembered information has been presented in a single perceptual modality. Under these conditions it is not known whether the observed brain activity reflects the studied memory process as such or only the memory process in the given modality. The positron emission tomography (PET) study reported here was designed to identify brain regions involved in encoding and retrieval processes specific to visual and haptic modalities, as well as those common to the two modalities. These latter, common regions, were assumed to be associated with "transperceptual" encoding and retrieval processes. Abstract three-dimensional objects, difficult to describe verbally, served as to-be-remembered materials. A multivariate partial least squares analysis of the PET data revealed that transperceptual encoding processes activated right medial temporal lobe, superior prefrontal cortex bilaterally, and posterior inferior temporal gyrus bilaterally. Transperceptual recognition activations were observed in two right orbitofrontal regions and in anterior cingulate. These results provide initial evidence that some processes involved in memory encoding and retrieval operate beyond perceptual processes and in that sense are transperceptual.

Shape-coding in IT cells generalizes over contrast and mirror reversal, but not figure-ground reversal

We assessed how the visual shape preferences of neurons in the inferior temporal cortex of awake, behaving monkeys generalized across three different stimulus transformations. Stimulus-preferences of particular cells among different polygon displays were correlated across reversed contrast polarity or mirror reversal, but not across figure-ground reversal. This corresponds with psychological findings on human shape judgments. Our results imply that neurons in inferior temporal cortex respond to components of visual shape derived only after figure-ground assignment of contours, not to the contours themselves.

Representation of perceived object shape by the human lateral occipital complex

The human lateral occipital complex (LOC) has been implicated in object recognition, but it is unknown whether this region represents low-level image features or perceived object shape. We used an event-related functional magnetic resonance imaging adaptation paradigm in which the response to pairs of successively presented stimuli is lower when they are identical than when they are different. Adaptation across a change between the two stimuli in a pair provides evidence for a common neural representation invariant to that change. We found adaptation in the LOC when perceived shape was identical but contours differed, but not when contours were identical but perceived shape differed. These data indicate that the LOC represents not simple image features, but rather higher level shape information.

Vase or face? A neural correlate of shape-selective grouping processes in the human brain

Recent neuroimaging studies have described a differential activation pattern associated with specific object images (e.g., face-related and building-related activation) in human occipito-temporal cortex. However, it is as yet unclear to what extent this selectivity is due to differences in the statistics of local object features present in the different object categories, and to what extent it reflects holistic grouping processes operating across the entire object image. To resolve this question it is essential to use images in which identical sets of local features elicit the perception of different object categories. The classic Rubin vase-face illusion provides an excellent experimental set to test this question. In the illusion, the same local contours lead to the perception of different objects (vase or face). Here we employed a modified Rubin vase-face illusion to explore to what extent the activation in face-related regions is attributable to the presence of local face features, or is due to a more holistic grouping process that involves the entire face figure. Biasing cues (gratings and color) were used to control the perceptual state of the observer. We found enhanced activation in face-related regions during the "face profile" perceptual state compared to the "vase" perceptual state. Control images ruled out the involvement of the biasing cues in the effect. Thus, object-selective activation in human face-related regions entails global grouping processes that go beyond the local processing of stimulus features.

Auditory triggered mental imagery of shape involves visual association areas in early blind humans

Previous neuroimaging studies identified a large network of cortical areas involved in visual imagery in the human brain, which includes occipitotemporal and visual associative areas. Here we test whether the same processes can be elicited by tactile and auditory experiences in subjects who became blind early in life. Using positron emission tomography, regional cerebral blood flow was assessed in six right-handed early blind and six age-matched control volunteers during three conditions: resting state, passive listening to noise sounds, and mental imagery task (imagery of object shape) triggered by the sound of familiar objects. Activation foci were found in occipitotemporal and visual association areas, particularly in the left fusiform gyrus (Brodmann areas 19-37), during mental imagery of shape by both groups. Since shape imagery by early blind subjects does involve similar visual structures as controls at an adult age, it indicates their developmental crossmodal reorganization to allow perceptual representation in the absence of vision.

Cortical correlates of gesture processing: clues to the cerebral mechanisms underlying apraxia during the imitation of meaningless gestures

The clinical test of imitation of meaningless gestures is highly sensitive in revealing limb apraxia after dominant left brain damage. To relate lesion locations in apraxic patients to functional brain activation and to reveal the neuronal network subserving gesture representation, repeated H2(15O)-PET measurements were made in seven healthy subjects during a gesture discrimination task. Observing paired images of either meaningless hand or meaningless finger gestures, subjects had to indicate whether they were identical or different. As a control condition subjects simply had to indicate whether two portrayed persons were identical or not. Brain activity during the discrimination of hand gestures was strongly lateralized to the left hemisphere, a prominent peak activation being localized within the inferior parietal cortex (BA40). The discrimination of finger gestures induced a more symmetrical activation and rCBF peaks in the right intraparietal sulcus and in medial visual association areas (BA18/19). Two additional foci of prominent rCBF increase were found. One focus was located at the left lateral occipitotemporal junction (BA 19/37) and was related to both tasks; the other in the pre-SMA was particularly related to hand gestures. The pattern of task-dependent activation corresponds closely to the predictions made from the clinical findings, and underlines the left brain dominance for meaningless hand gestures and the critical involvement of the parietal cortex. The lateral visual association areas appear to support first stages of gesture representation, and the parietal cortex is part of the dorsal action stream. Finger gestures may require in addition precise visual analysis and spatial attention enabled by occipital and right intraparietal activity. Pre-SMA activity during the perception of hand gestures may reflect engagement of a network that is intimately related to gesture execution.

Transient interhemispheric neuronal synchrony correlates with object recognition

Object recognition might be achieved by the recreation of a meaningful internal image from visual fragments. This recreation might be achieved by neuronal synchronization that has been proposed as a solution for the perceptual binding problem. In this study, we evaluated synchronization between the occipitotemporal regions bilaterally using electroencephalograms during several visual recognition tasks. Conscious recognition of familiar objects spanning the visual midline induced transient interhemispheric electroencephalographic coherence in the alpha band, which did not occur with meaningless objects or with passive viewing. Moreover, there was no interhemispheric coherence when midline objects were not recognized as meaningful or when familiar objects were presented in one visual hemifield. These data suggest a close link between site-specific interregional synchronization and object recognition.

The lateral occipital complex and its role in object recognition

Here we review recent findings that reveal the functional properties of extra-striate regions in the human visual cortex that are involved in the representation and perception of objects. We characterize both the invariant and non-invariant properties of these regions and we discuss the correlation between activation of these regions and recognition. Overall, these results indicate that the lateral occipital complex plays an important role in human object recognition.

Sustained extrastriate cortical activation without visual awareness revealed by fMRI studies of hemianopic patients

Patients with lesions in the primary visual cortex (V1) may show processing of visual stimuli presented in their field of cortical blindness even when they report being unaware of the stimuli. To elucidate the neuroanatomical basis of their residual visual functions, we used functional magnetic resonance imaging in two hemianopic patients, FS and GY. In the first experiment, a rotating spiral stimulus was used to assess the responsiveness of dorsal stream areas. Although no response was detectable within denervated or destroyed early visual cortex, motion-sensitive areas (hMT+/V5) ipsilateral to the lesion showed a strong sustained hemodynamic response. In GY, this activation was at least as strong as that of his contralesional hMT+/V5 to the stimulus in the normal hemifield. In the second experiment, coloured images of natural objects were used to assess the responsiveness of ventral stream areas. Again, no activity was detectable in ipsilesional early visual areas, but extrastriate areas in the lateral occipital cortex (hMT+/V5 and LO) and within the posterior fusiform gyrus (V4/V8) showed a robust sustained hemodynamic response. In both experiments, we observed that ipsilesional areas responded to stimuli presented in either hemifield, whereas the normal hemisphere responded preferentially to stimuli in the sighted hemifield. As only one subject occasionally noticed the onset of stimulation in the impaired field, the unexpectedly strong sustained activity in ipsilesional dorsal and ventral cortical areas appears to be insufficient to generate conscious vision.

Brain activity evoked by inverted and imagined biological motion

Previous imaging research has identified an area on the human posterior superior temporal sulcus (STS) activated upon viewing biological motion. The current experiments explore the relationship between neural activity within this region and perceptual experience. Biological motion perception is orientation dependent: inverting point-light animations make them more difficult to see. We measured activity levels within this region as observers viewed inverted point-light animations. We also measured neural activity while observers imagined biological motion and compared it to that measured while observers viewed the animations. In both experiments we found that the BOLD response was modulated with perceptual experience. Viewing inverted biological motion activated posterior STS more than scrambled motion, but less than upright biological motion. Mental imagery of biological motion was also sufficient to activate this region in most of our observers, but the level of activity was weaker than during actual viewing of the motion animations.

Transient interhemispheric neuronal synchrony correlates with object recognition

Object recognition might be achieved by the recreation of a meaningful internal image from visual fragments. This recreation might be achieved by neuronal synchronization that has been proposed as a solution for the perceptual binding problem. In this study, we evaluated synchronization between the occipitotemporal regions bilaterally using electroencephalograms during several visual recognition tasks. Conscious recognition of familiar objects spanning the visual midline induced transient interhemispheric electroencephalographic coherence in the alpha band, which did not occur with meaningless objects or with passive viewing. Moreover, there was no interhemispheric coherence when midline objects were not recognized as meaningful or when familiar objects were presented in one visual hemifield. These data suggest a close link between site-specific interregional synchronization and object recognition.

Center-periphery organization of human object areas

The organizing principles that govern the layout of human object-related areas are largely unknown. Here we propose a new organizing principle in which object representations are arranged according to a central versus peripheral visual field bias. The proposal is based on the finding that building-related regions overlap periphery-biased visual field representations, whereas face-related regions are associated with center-biased representations. Furthermore, the eccentricity maps encompass essentially the entire extent of object-related occipito-temporal cortex, indicating that most object representations are organized with respect to retinal eccentricity. A control experiment ruled out the possibility that the results are due exclusively to unequal feature distribution in these images. We hypothesize that brain regions representing object categories that rely on detailed central scrutiny (such as faces) are more strongly associated with processing of central information, compared to representations of objects that may be recognized by more peripheral information (such as buildings or scenes).

Activation reduction in anterior temporal cortices during repeated recognition of faces of personal acquaintances

Repeated recognition of the face of a familiar individual is known to show semantic repetition priming effect. In this study, normal subjects were repeatedly presented faces of their colleagues, and the effect of repetition on the regional cerebral blood flow change was measured using positron emission tomography. They repeated a set of three tasks: the familiar-face detection (F) task, the facial direction discrimination (D) task, and the perceptual control (C) task. During five repetitions of the F task, familiar faces were presented six times from different views in a pseudorandom order. Activation reduction through the repetition of the F tasks was observed in the bilateral anterior (anterolateral to the polar region) temporal cortices which are suggested to be involved in the access to the long-term memory concerning people. The bilateral amygdala, the hypothalamus, and the medial frontal cortices, were constantly activated during the F tasks, and considered to be associated with the behavioral significance of the presented familiar faces. Constant activation was also observed in the bilateral occipitotemporal regions and fusiform gyri and the right medial temporal regions during perception of the faces, and in the left medial temporal regions during the facial familiarity detection task, which are consistent with the results of previous functional brain imaging studies. The results have provided further information about the functional segregation of the anterior temporal regions in face recognition and long-term memory.

Does perception of biological motion rely on specific brain regions?

Perception of biological motions plays a major adaptive role in identifying, interpreting, and predicting the actions of others. It may therefore be hypothesized that the perception of biological motions is subserved by a specific neural network. Here we used fMRI to verify this hypothesis. In a group of 10 healthy volunteers, we explored the hemodynamic responses to seven types of visual motion displays: drifting random dots, random dot cube, random dot cube with masking elements, upright point-light walker, inverted point-light walker, upright point-light walker display with masking elements, and inverted point-light walker display with masking elements. A gradient in activation was observed in the occipitotemporal junction. The responses to rigid motion were localized posteriorly to those responses elicited by nonrigid motions. Our results demonstrate that in addition to the posterior portion of superior temporal sulcus, the left intraparietal cortex is involved in the perception of nonrigid biological motions.

Visual motion and the human brain: what has neuroimaging told us?

Recently, neuroimaging techniques have been applied to the study of human motion perception, complementing established techniques such as psychophysics, neurophysiology and neuropsychology. Because vision, particularly motion perception, has been studied relatively extensively, it provides an interesting case study to examine the contributions and limitations of neuroimaging to cognitive neuroscience. We suggest that in the domain of motion perception neuroimaging has: (1) revealed an extensive network of motion areas throughout the human brain, in addition to the well-studied motion complex (MT+); (2) verified and extended findings from other techniques; (3) suggested extensive top-down influences on motion perception; and (4) allowed experimenters to examine the neural correlates of awareness. We discuss these contributions, along with limitations and future directions for the neuroimaging of motion.

Can neuroimaging really tell us what the human brain is doing? The relevance of indirect measures of population activity

Neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) give an indication towards the localization of mental representations and processes in the human brain. It is not clear to what extent such global measures of neuronal activity, pooling across large populations of neurons, can reveal how certain computations are implemented by the neurons in such population ('computational neuroimaging'). Population activity is related tightly to single-cell activity when all neurons in the population have similar response properties. We describe some evidence from single-cell recordings in monkeys that indicates that neurons with similar response properties are not scattered randomly throughout the visual cortex. Notwithstanding this clustering, populations of nearby neurons are still rather heterogeneous, requiring some prudence in deriving single-cell response properties from population activity. The following review of recent neuroimaging studies of the visual system describes to what degree inferences about computations and representations can be drawn from these studies.

fMR-adaptation: a tool for studying the functional properties of human cortical neurons

The invariant properties of human cortical neurons cannot be studied directly by fMRI due to its limited spatial resolution. One voxel obtained from a fMRI scan contains several hundred thousands neurons. Therefore, the fMRI signal may average out a heterogeneous group of highly selective neurons. Here, we present a novel experimental paradigm for fMRI, functional magnetic resonance-adaptation (fMR-A), that enables to tag specific neuronal populations within an area and investigate their functional properties. This approach contrasts with conventional mapping methods that measure the averaged activity of a region. The application of fMR-A to study the functional properties of cortical neurons proceeds in two stages: First, the neuronal population is adapted by repeated presentation of a single stimulus. Second, some property of the stimulus is varied and the recovery from adaptation is assessed. If the signal remains adapted, it will indicate that the neurons are invariant to that attribute. However, if the fMRI signal will recover from the adapted state it would imply that the neurons are sensitive to the property that was varied. Here, an application of fMR-A for studying the invariant properties of high-order object areas (lateral occipital complex--LOC) to changes in object size, position, illumination and rotation is presented. The results show that LOC is less sensitive to changes in object size and position compared to changes of illumination and viewpoint. fMR-A can be extended to other neuronal systems in which adaptation is manifested and can be used with event-related paradigms as well. By manipulating experimental parameters and testing recovery from adaptation it should be possible to gain insight into the functional properties of cortical neurons which are beyond the spatial resolution limits imposed by conventional fMRI.

Neural events and perceptual awareness

Neural correlates of perceptual awareness, until very recently an elusive quarry, are now almost commonplace findings. This article first describes a variety of neural correlates of perceptual awareness based on fMRI, ERPs, and single-unit recordings. It is then argued that our quest should ultimately focus not on mere correlates of awareness, but rather on the neural events that are both necessary and sufficient for perceptual awareness. Indeed, preliminary evidence suggests that although many of the neural correlates already reported may be necessary for the corresponding state of awareness, it is unlikely that they are sufficient for it. The final section considers three hypotheses concerning the possible sufficiency conditions for perceptual awareness.

Forming classes by stimulus frequency: behavior and theory

Visual classification is the way we relate to different images in our environment as if they were the same, while relating differently to other collections of stimuli (e.g., human vs. animal faces). It is still not clear, however, how the brain forms such classes, especially when introduced with new or changing environments. To isolate a perception-based mechanism underlying class representation, we studied unsupervised classification of an incoming stream of simple images. Classification patterns were clearly affected by stimulus frequency distribution, although subjects were unaware of this distribution. There was a common bias to locate class centers near the most frequent stimuli and their boundaries near the least frequent stimuli. Responses were also faster for more frequent stimuli. Using a minimal, biologically based neural-network model, we demonstrate that a simple, self-organizing representation mechanism based on overlapping tuning curves and slow Hebbian learning suffices to ensure classification. Combined behavioral and theoretical results predict large tuning overlap, implicating posterior infero-temporal cortex as a possible site of classification.

Visuo-haptic object-related activation in the ventral visual pathway

The ventral pathway is involved in primate visual object recognition. In humans, a central stage in this pathway is an occipito-temporal region termed the lateral occipital complex (LOC), which is preferentially activated by visual objects compared to scrambled images or textures. However, objects have characteristic attributes (such as three-dimensional shape) that can be perceived both visually and haptically. Therefore, object-related brain areas may hold a representation of objects in both modalities. Using fMRI to map object-related brain regions, we found robust and consistent somatosensory activation in the occipito-temporal cortex. This region showed clear preference for objects compared to textures in both modalities. Most somatosensory object-selective voxels overlapped a part of the visual object-related region LOC. Thus, we suggest that neuronal populations in the occipito-temporal cortex may constitute a multimodal object-related network.

'Where' depends on 'what': a differential functional anatomy for position discrimination in one- versus two-dimensions

Line bisection is widely used as a clinical test of spatial cognition in patients with left visuospatial neglect after right hemisphere lesion. Surprisingly, many neglect patients who show severe impairment on marking the center of horizontal lines can accurately mark the center of squares. That these patients with left neglect are also typically poor at judging whether lines are correctly prebisected implies that the deficit can be perceptual rather than motoric. These findings suggest a differential neural basis for one- and two-dimensional visual position discrimination that we investigated with functional neuroimaging (fMRI). Normal subjects judged whether, in premarked lines or squares, the mark was placed centrally. Line center judgements differentially activated right parietal cortex, while square center judgements differentially activated the lingual gyrus bilaterally. These distinct neural bases for one- and two-dimensional visuospatial judgements help explain the observed clinical dissociations by showing that as a stimulus becomes a better, more 'object-like' gestalt, the ventral visuoperceptive route assumes more responsibility for assessing position within the object.

Visual perceptual learning in human object recognition areas: a repetition priming study using high-density electrical mapping

It is often the case that only partial or degraded views of an object are available to an observer, and yet in many of these cases, object recognition is accomplished with surprising ease. The perceptual filling-in or "closure" that makes this possible has been linked to a group of object recognition areas in the human brain, the lateral occipital (LO) complex, and has been shown to have a specific electrophysiological correlate, the N(cl) component of the event related potential. Perceptual closure presumably occurs because repeated and varied exposure to different classes of objects has caused the brain to undergo "perceptual learning," which promotes a robust mnemonic representation, accessible under partial information circumstances. The present study examined the impact of perceptual learning on closure-related brain processes. Fragmented pictures of common objects were presented, such that information content was incrementally increased until just enough information was present to permit closure and object recognition. Periodic repetition of a subset of these picture sequences was used to induce repetition priming due to perceptual learning. This priming has an electrophysiological signature that is putatively generated in the LO complex, but significantly precedes the electrophysiological correlate of closure. The temporal progression of priming- and closure-related activity in the LO complex supports the view that sensory processing entails multiple reentrant stages of activity within processing modules of the visual hierarchy. That the earliest priming-related activity occurs over LO complex, suggests that the sensory trace itself may reside in these object recognition areas.

Cortical mechanisms specific to explicit visual object recognition

The cortical mechanisms associated with conscious object recognition were studied using functional magnetic resonance imaging (fMRI). Participants were required to recognize pictures of masked objects that were presented very briefly, randomly and repeatedly. This design yielded a gradual accomplishment of successful recognition. Cortical activity in a ventrotemporal visual region was linearly correlated with perception of object identity. Therefore, although object recognition is rapid, awareness of an object's identity is not a discrete phenomenon but rather associated with gradually increasing cortical activity. Furthermore, the focus of the activity in the temporal cortex shifted anteriorly as subjects reported an increased knowledge regarding identity. The results presented here provide new insights into the processes underlying explicit object recognition, as well as the analysis that takes place immediately before and after recognition is possible.

Imaging image processing in the human brain

Functional imaging in humans reveals the interplay of the many components of the human visual system: how they process the various types of information contained in the image to recover characteristics of the three-dimensional world surrounding us, but also how, in the course of this process, the retinal image is gradually integrated with non-retinal signals to provide information about the outside world in a format useful to other non-visual brain regions.