Functional magnetic resonance imaging of human visual cortex during face matching: a comparison with positron emission tomography

A tale of two recognition systems: implications of the fusiform face area and the visual word form area for lateralized object recognition models

Two areas of current intense interest in the neuroimaging literature are that of the visual word form area (VWFA) and of the fusiform face area (FFA) and their roles in word and face perception, respectively. These two areas are of particular relevance to laterality research because visual word identification and face identification have long been shown to be especially lateralized to the left hemisphere and the right hemisphere, respectively. This review therefore seeks to evaluate their significance for the broader understanding of lateralization of object recognition. A multi-level model of lateralized object recognition is proposed based on a combination of behavioral and neuroimaging findings. Rather than seek to characterize hemispheric asymmetries according to a single principle (e.g., serial-parallel), it is suggested that current observations can be understood in terms of three asymmetric levels of processing, using the framework of the Janus model of hemispheric function. It is suggested that the left hemisphere represents features using an abstract-category code whereas the RH utilizes a specific-exemplar code. The relationships between these features are also coded asymmetrically, with the LH relying on associative co-occurrence values and the RH relying on spatial metrics. Finally, the LH controlled selection system focuses on isolating features and the RH focuses on conjoining features. It is suggested that each hemisphere utilizes efficient (apparently parallel) processing when stimuli are congruent with its preferred processing style and inefficient (apparently serial) processing when they are not, resulting in the typical left-lateralization for orthographic analysis and right-lateralization for face analysis.

MEG correlates of bimodal encoding of faces and persons' names

Learning associations between people's faces and names is a universal cognitive function with important social implications. The goal of the present study was to examine brain activity patterns associated with cross-modal encoding of names and faces. Learning face-name pairs was compared to unimodal learning tasks using the same visual and auditory stimuli. Spatiotemporal brain activation profiles were obtained with magnetoencephalography using an automated source estimation method. Results showed activation foci in left (for names) and right (for faces) temporal lobe perisylvian cortices, predominantly right-hemisphere occipital and occipitotemporal regions (for faces), and right hemisphere dorsolateral prefrontal regions during the encoding phase for both types of stimuli presented in isolation. Paired (face-name) stimulus presentation elicited bilateral prefrontal and temporal lobe perisylvian activity for faces and enhanced visual cortex activation in response to names (compared to names in the unpaired condition). These findings indicate distinct patterns of brain activation during the formation of associations between meaningful visual and auditory stimuli.

Disturbed holistic processing in autism spectrum disorders verified by two cognitive tasks requiring perception of complex visual stimuli

Central coherence is a key concept in research on autism spectrum disorders (ASD). It refers to the process in which diverse information is integrated and higher meaning is constructed in context. A malfunction in this process could result in abnormal attention to partial information in preference to the whole. To verify this hypothesis, we studied the performance of two visual tasks by 10 patients with autistic disorder or Asperger's disorder and by 26 (experiment 1) or 25 (experiment 2) normal subjects. In experiment 1, the subjects memorized pictures, some pictures with a change related to the main theme (D1) and others with a change not related to the main theme (D2); then the same pictures were randomly presented to the subjects who were asked to find the change. In experiment 2, the subjects were presented pictures of a normal (N) or a Thatcherized (T) face arranged side by side inversely (I) or uprightly (U) and to judge them as the same or different. In experiment 1, ASD subjects exhibited significantly lower rates of correct responses in D1 but not in D2. In experiment 2, ASD subjects exhibited significantly longer response times in NT-U but not in TN-I. These results showed a deficit in holistic processing, which is consistent with weak central coherence in ASD.

Face Processing is Gated by Visual Spatial Attention

Human perception of faces is widely believed to rely on automatic processing by a domain-specific, modular component of the visual system. Scalp-recorded event-related potential (ERP) recordings indicate that faces receive special stimulus processing at around 170 ms poststimulus onset, in that faces evoke an enhanced occipital negative wave, known as the N170, relative to the activity elicited by other visual objects. As predicted by modular accounts of face processing, this early face-specific N170 enhancement has been reported to be largely immune to the influence of endogenous processes such as task strategy or attention. However, most studies examining the influence of attention on face processing have focused on non-spatial attention, such as object-based attention, which tend to have longer-latency effects. In contrast, numerous studies have demonstrated that visual spatial attention can modulate the processing of visual stimuli as early as 80 ms poststimulus – substantially earlier than the N170. These temporal characteristics raise the question of whether this initial face-specific processing is immune to the influence of spatial attention. This question was addressed in a dual-visual-stream ERP study in which the influence of spatial attention on the face-specific N170 could be directly examined. As expected, early visual sensory responses to all stimuli presented in an attended location were larger than responses evoked by those same stimuli when presented in an unattended location. More importantly, a significant face-specific N170 effect was elicited by faces that appeared in an attended location, but not in an unattended one. In summary, early face-specific processing is not automatic, but rather, like other objects, strongly depends on endogenous factors such as the allocation of spatial attention. Moreover, these findings underscore the extensive influence that top-down attention exercises over the processing of visual stimuli, including those of high natural salience.

Brain activation during eye gaze discrimination in stable schizophrenia

OBJECTIVE

Earlier studies described gaze discrimination impairment in schizophrenia. The purpose of this study was to compare gaze discrimination abilities and associated brain activation in persons with stable schizophrenia and matched controls.

METHODS

13 schizophrenia and 12 healthy participants underwent a gaze discrimination task with face stimuli rotated at 0, 4 and 8 degrees deviation. During fMRI with BOLD imaging, subjects were asked to identify whether a face was making eye contact. Subject-level parameter estimates for BOLD signal change were entered into an orientation by group mixed effect repeated measures ANOVA.

RESULTS

Gaze discrimination performance did not differ between groups. Patients showed decreased activation in areas of bilateral inferior frontal and occipital areas, and select temporo-limbic regions, including amygdala. Groups differed by activation patterns according to gaze deviation. In controls, faces with 4 degrees deviation produced higher activation in frontal and temporal regions. In patients, 0 degrees deviation produced increased activation in amygdala and areas of temporal neocortex.

CONCLUSIONS

Despite similar gaze discrimination abilities, schizophrenia patients exhibit decreased brain activation in areas associated with executive, emotional and visual processing. Controls exhibited increased activation associated with the more difficult task in select frontal and temporal regions. Patients exhibited increased activation associated with direct gaze in temporal regions, which may relate to common symptoms.

Designing care environments for persons with Alzheimer's disease: visuoperceptual considerations

This article provides information about the projected need for specialist dementia care environments in the United Kingdom. It summarizes the adverse effects of poorly designed environments and acknowledges that, despite a range of residential models, none has been shown or agreed to be the best. It considers current efforts in the UK that might influence future care environments positively.

The perception of emotion-free faces in schizophrenia: a magneto-encephalography study

OBJECTIVE

To analyze how patients suffering from schizophrenia perceive faces of unknown individuals that show no actual emotions in order to investigate the attribution of meanings to a relatively non-significant but complex sensory experience.

DESIGN

Analysis of baseline and poststimulation magneto-encephalographic recordings. The stimuli consisted of four pictures with neutral emotional expression of male and female faces of Spanish individuals unknown to research subjects.

PARTICIPANTS

Twelve right-handed patients suffering from schizophrenia (DSM IV-TR criteria), age 18-65, with active delusional activity (SAPS score in delusions above 39) and 15 right-handed sex- and age-matched control subjects.

RESULTS

Compared to controls patients have a significant higher activity of both hemispheres (0-700 ms) being the activity in the right hemisphere (RH) higher than in the left hemisphere (LH). Patients also have a higher activity on the middle fusiform gyrus (BA 37) in the LH (200-300 ms), on the superior temporal areas (BA 22, 41 and 42) in both hemispheres (100-700 ms) and on the temporal pole (BA 38) in the RH (300-400 ms) and a lower activity in the LH of the latter.

CONCLUSIONS

The areas that are more activated in our study are those involved in the process of thinking, in attributing meanings to perceptions and in activities such as theory of mind, which are essential for social interaction. The anterior temporal areas less activated indicate a reduced semantic memory for faces that could explain the social withdrawal of schizophrenia. These alterations are suggestive of a dysfunction of left hemisphere neuronal networks.

Guided saccades modulate object and face-specific activity in the fusiform gyrus

We investigated the influence of saccadic eye movements on the magnitude of functional MRI (fMRI) activation in brain regions known to participate in object and face perception. In separate runs, subjects viewed a static image of a uniform gray field, a face, or a flower. Every 500 ms a small fixation cross made a discrete jump within the image and subjects were required to make a saccade and fixate the cross at its new location. Each run consisted of alternating blocks in which the subject was guided to make small and large saccades. A comparison of large vs. small saccade blocks revealed robust activity in the oculomotor system, particularly within the frontal eye fields (FEF), intraparietal sulcus (IPS), and superior colliculi regardless of the background image. Activity within portions of the ventral occipitotemporal cortex (VOTC) including the lingual and fusiform gyri was also modulated by saccades, but here saccade-related activity was strongly influenced by the background image. Activity within the VOTC was strongest when large saccadic eye movements were made over an image of a face or a flower compared to a uniform gray image. Of most interest was activity in the functionally predefined face-specific region of the fusiform gyrus, where large saccades made over a face increased activity, but where similar large saccades made over a flower or a uniform gray field did not increase activity. These results demonstrate the potentially confounding influence of uncontrolled eye movements for neuroimaging studies of face and object perception.

Processing the socially relevant parts of faces

Faces are processed by a distributed neural system in the visual as well as in the non-visual cortex [the "core" and the "extended" systems, J.V. Haxby, E.A. Hoffman, M.I. Gobbini, The distributed human neural system for face perception, Trends Cogn. Sci. 4 (2000) 223-233]. Yet, the functions of the different brain regions included in the face processing system are far from clear. On the basis of the case study of a patient unable to recognize fearful faces, Adolphs et al. [R. Adolphs, F. Gosselin, T.W. Buchanan, D. Tranel, P. Schyns, A.R. Damasio, A mechanism for impaired fear recognition after amygdala damage, Nature 433 (2005) 68-72] suggested that the amygdala might play a role in orienting attention towards the eyes, i.e. towards the region of face conveying most information about fear. In a functional magnetic resonance (fMRI) study comparing patterns of activation during observation of whole faces and parts of faces displaying neutral expressions, we evaluated the neural systems for face processing when only partial information is provided, as well as those involved in processing two socially relevant facial areas (the eyes and the mouth). Twenty-four subjects were asked to perform a gender decision task on pictures showing whole faces, upper faces (eyes and eyebrows), and lower faces (mouth). Our results showed that the amygdala was activated more in response to the whole faces than to parts of faces, indicating that the amygdala is involved in orienting attention toward eye and mouth. Processing of parts of faces in isolation was found to activate other regions within both the "core" and the "extended" systems, as well as structures outside this network, thus suggesting that these structures are involved in building up the representation of the whole face from its parts.

Face processing without awareness in the right fusiform gyrus

We investigated brain activity evoked by faces which were not consciously perceived by subjects. Subdural electrophysiological recordings and functional neuroimaging studies have each demonstrated face-specific processing in the fusiform gyrus (FFG) of humans. Using pattern masks, a stimulus can be presented but not consciously perceived, and thus can be used to assay obligatory or automatic processes. Here, using event-related functional magnetic resonance imaging and pattern masking, we observed that masked faces but not masked objects activated the right FFG. Other regions activated by consciously perceived unmasked faces were not activated when faces were masked. These data provide strong evidence for an automatic face-processing region in the right FFG.

The other-race effect for face perception: an event-related potential study

It is well known that a recognition bias can be observed whenever subjects have to decide whether they have seen a person before that belongs to a different ethnical group. Although this "other-race effect" is well documented on a behavioural level, its underlying mechanisms remain unclear. One plausible explanation might be that cortical areas involved in face processing are not as effective for other-race faces due to a missing experience with individuals from other ethnical groups. This interpretation is strongly supported by a functional magnetic resonance imaging study showing decreased brain activity on other-race faces. Furthermore, two event-related potential studies revealed differences in brain activity in the first 250 ms after face presentation, but with inconsistent results. Therefore, we investigated 12 Caucasian subjects, showing them faces of Asian and Caucasian subjects in a perceptual priming paradigm and measured the event-related brain potentials. On a behavioural level we found slower reaction times to Asian faces compared to Caucasian faces in the unprimed condition, reflecting a deficit for Caucasian subjects to process other-race faces. In accordance with these behavioural data we see a significantly reduced late N250r amplitude in the unprimed condition to the Asian faces compared to the Caucasian faces. These results clearly indicate that the other-race effect was present in our sample and very specific only in the unprimed condition around 350-450 ms after stimulus onset.

Face- and gaze-sensitive neural responses in children with autism: a magnetoencephalographic study

Face and gaze processing were studied using magnetoencephalography in 10 children with autism and 10 normally developing children, aged between 7 and 12 years. The children performed two tasks in which they had to discriminate whether images of faces presented sequentially in pairs were identical. The images showed four different categories of gaze: direct gaze, eyes averted (left or right) and closed eyes but there was no instruction to focus on the direction of gaze. Images of motorbikes were used as control stimuli. Faces evoked strong activity over posterior brain regions at about 100 ms in both groups of children. A response at 140 ms to faces observed over extrastriate cortices, thought to be homologous to the N170 in adults, was weak and bilateral in both groups and somewhat weaker (approaching significance) in the children with autism than in the control children. The response to motorbikes differed between the groups at 100 and 140 ms. Averted eyes evoked a strong right lateralized component at 240 ms in the normally developing children that was weak in the clinical group. By contrast, direct gaze evoked a left lateralized component at 240 ms only in children with autism. The findings suggest that face and gaze processing in children with autism follows a trajectory somewhat similar to that seen in normal development but with subtle differences. There is also a possibility that other categories of object may be processed in an unusual way. The inter-relationships between these findings remain to be elucidated.

Cerebral lateralisation for facial processing: Gender-related cognitive styles determined using Fourier analysis of mean cerebral blood flow velocity in the middle cerebral arteries

Facial processing was studied in 16 (eight men and eight women) right-handed healthy participants using a new functional transcranial Doppler technique called functional transcranial Doppler spectroscopy (fTCDS). MFV was recorded simultaneously in both right and left middle cerebral arteries in dark condition and during visual processing of object and facial tasks. fTCDS used Fourier analysis of mean flow velocity (MFV) time series to derive spectral density estimates that correlate with expected mental activity. Men were right lateralised for object and facial perception, while women were left lateralised for facial tasks but showed a right tendency or no lateralisation for object perception. For facial perception, men used a category-specific process-mapping system for right cognitive style, but women used same for the left.

Psychometric properties of an abbreviated instrument of the five-factor model

Brief measures of the five-factor model (FFM) have been developed but none include an assessment of facets within each domain. The purpose of this study was to examine the validity of a simple, one-page, facet-level description of the FFM. Five data collections were completed to assess the reliability and the convergent and discriminant validity of the rating form with other measures of the FFM and to replicate correlations with measures of maladaptive personality functioning that have been obtained with more extensive measures. Results appeared to support the validity of the FFM rating form (FFMRF) because it obtained relatively good internal consistency, convergent validity, and discriminant validity. In addition, self-descriptions of persons in terms of the FFMRF related to maladaptive personality traits in a manner that was consistent with theoretical expectations. Negative findings and limitations of the rating form also are discussed.

Developmental neural networks in children performing a Categorical N-Back Task

The prefrontal and temporal networks subserving object working memory tasks in adults have been reported as immature in young children; yet children are adequately capable of performing such tasks. We investigated the basis of this apparent contradiction using a complex object working memory task, a Categorical n-back (CN-BT). We examined whether the neural networks engaged by the CN-BT in children consist of the same brain regions as those in adults, but with a different magnitude of activation, or whether the networks are qualitatively different. Event-related fMRI was used to study differences in brain activation between healthy children ages 6 and 10 years, and young adults (20-28 years). Performance accuracy and RTs in 10-year-olds and adults were comparable, but the performance in 6-year-olds was lower. In adults, the CN-BT was highly effective in engaging the bilateral (L>R) ventral prefrontal cortex, the bilateral fusiform gyrus, posterior cingulate and precuneus, thus suggesting an involvement of the ventral visual stream, with related feature extraction and semantic labeling strategies. In children, the brain networks were distinctly different. They involved the premotor and parietal cortex, anterior insula, caudate/putamen, and the cerebellum, thus suggesting a predominant involvement of the visual dorsal and sensory-motor pathways, with related visual-spatial and action cognitive strategies. The findings indicate engagement of developmental networks in children reflecting task-effective brain activation. The age-related pattern of fMRI activation suggests a working hypothesis of a developmental shift from reliance on the dorsal visual stream and premotor/striatal/cerebellar networks in young children to reliance on the ventral prefrontal and inferior temporal networks in adults.

Transient functional suppression and facilitation of Japanese ideogram writing induced by repetitive transcranial magnetic stimulation of posterior inferior temporal cortex

The Japanese writing system is unique in that it is composed of two different orthographies: kanji (morphograms) and kana (syllabograms). The retrieval of the visual orthographic representations of Japanese kanji is crucial to the process of writing in Japanese. We used low-frequency repetitive transcranial magnetic stimulation (rTMS) to clarify the functional relevance of the left and right posterior inferior temporal cortex (PITC) to this process in native Japanese speakers. The experimental paradigms included the mental recall of kanji, kana-to-kanji transcription, semantic judgment, oral reading, and copying of kana and kanji. The first two tasks require the visualization of the kanji image of the word. We applied 0.9 Hz rTMS (600 total pulses) over individually determined left or right PITC to suppress cortical activity and measured subsequent task performance. In the mental recall of kanji and kana-to-kanji transcription, rTMS over the left PITC prolonged reaction times (RTs), whereas rTMS over the right PITC reduced RTs. In the other tasks, which do not involve the mental visualization of kanji, rTMS over the left or right PITC had no effect on performance. These results suggest that the left PITC is crucial for the retrieval of the visual graphic representation of kanji. Furthermore, the right PITC may work to suppress the dominant left PITC in the neural network for kanji writing, which involves visual word recognition.

Task-related temporal and topographical changes of cortical activity during ultra-rapid visual categorization

The aim of our study was to provide electrophysiological evidence about the modulation of the categorization process by task requirements in the human brain. Event-related potentials (ERP) were recorded during three different categorization tasks using matched stimulus sets. In all cases, the subjects were required to differentiate between "animal" and "non-animal" stimuli. In the first task (two-choice task), they were asked to press corresponding buttons to each stimulus types. The second task was a go/no-go paradigm, only animal stimuli required motor response. The third task was a counting task; participants had to count the animal stimuli without any motor response. The reaction times in the go/no-go paradigm were significantly shorter. ERP differences between animal and non-animal pictures in the go/no-go task also appeared earlier and were localized at more posterior scalp positions compared to the two-choice task. Comparing animal responses in the two-choice task and in the go/no-go paradigm, we found a significant difference in the 130- to 170-ms time window over the fronto-central, centro-parietal regions. Similar differences were found between the responses to animal pictures in the two-choice task and in the counting paradigm. We used brain electric source analysis (BESA) algorithm on difference waves to localize the best fitting dipoles and determine the localization of brain areas contributing to scalp potential differences. The results show that different task requirements evoke different activity in the medial part of the temporal pole. The data we provided here draw attention to the careful handling of results obtained from categorization experiments, because different task requirements can affect the early categorization process itself.

Face and gaze processing in normally developing children: a magnetoencephalographic study

Magnetoencephalography (MEG) was used to study the neural mechanisms underlying face and gaze processing in ten normally developing boys aged between 8 and 11 years and 12 adult males. The participants performed two tasks in which they had to decide whether images presented sequentially in pairs, depicted the same person or the same motorbike. In the first task, the participants saw pictures of faces in which the eyes were either open or shut and pictures of motorbikes. In the second task, participants saw pairs of faces with gaze averted to the left or right. In children there was no evidence of the face sensitive, low amplitude short latency (30-60 ms) activity seen previously in adults. A strong, midline posterior response at approximately 100 ms was observed in children, which was earlier and somewhat stronger to faces than to motorbikes; in adults the signal at this latency was weak. A clear face sensitive response was seen in adults at 135 ms, predominantly over the right inferior occipito-temporal regions. Although activity was observed in the children at the same latency, it was less prominent, not lateralized and was evoked similarly by faces and motorbikes. Averted gaze conditions evoked strong right-lateralized activity at approximately 245 ms in children only. These findings indicate that even in middle childhood the neural mechanisms underlying face processing are less specialized than in adults, with greater early activation of posterior occipital cortices and less specific activation of ventral occipito-temporal cortex.

Functional connectivity of the fusiform gyrus during a face-matching task in subjects with mild cognitive impairment

Cognitive function requires a high level of functional interaction between regions of a network supporting cognition. Assuming that brain activation changes denote an advanced state of disease progression, changes in functional connectivity may precede changes in brain activation. The objective of this study was to investigate changes in functional connectivity of the right middle fusiform gyrus (FG) in subjects with mild cognitive impairment (MCI) during performance of a face-matching task. The right middle FG is a key area for processing face stimuli. Brain activity was measured using functional MRI. There were 16 MCI subjects and 19 age-matched healthy controls. The linear correlation coefficient was utilized as a measure of functional connectivity between the right middle FG and all other voxels in the brain. There were no statistical differences found in task performance or activation between groups. The right middle FG of the healthy control and MCI groups showed strong bilateral positive linear correlation with the visual cortex, inferior and superior parietal lobules, dorsolateral prefrontal cortex (DLPFC) and anterior cingulate. The healthy controls showed higher positive linear correlation of the right middle FG to the visual cortex, parietal lobes and right DLPFC than the MCI group, whereas the latter had higher positive linear correlation in the left cuneus. In the healthy controls, the right middle FG had negative linear correlation with right medial frontal gyrus and superior temporal gyrus and with left inferior parietal lobule (IPL), angular gyrus, superior frontal gyrus and anterior cingulate gyrus, but the MCI group had negative linear correlation with the left IPL, angular gyrus, precuneus, anterior cingulate, and to right middle temporal gyrus and posterior cingulate gyrus. In the negatively linearly correlated regions, the MCI group had reduced functional connectivity to the frontal areas, right superior temporal gyrus and left IPL. Different regions of the cuneus and IPL had increased functional connectivity in either group. The putative presence of Alzheimer's disease neuropathology in MCI affects functional connectivity from the right middle FG to the visual areas and medial frontal areas. In addition, higher linear correlation in the MCI group in the parietal lobe may indicate the initial appearance of compensatory processes. The results demonstrate that functional connectivity can be an effective marker for the detection of changes in brain function in MCI subjects.

Source Localization of Early Stages of Face Processing

Recent studies using ERPs in face recognition revealed that face processing starts around 100 ms after stimulus onset, 70 ms earlier than suggested before. While the neural sources of the N 170 component have repeatedly been found to be localized in the gyrus fusiformis and the inferior occipital cortex, sources have not yet been investigated for the P100 component during face processing. Therefore, we measured the ERPs elicited by faces and control stimuli in 72 subjects in order to localize the neural sources of both the P100 and the N 170 component. We observed significantly higher P100 and N 170 amplitudes to faces compared to control stimuli. LORETA source localization revealed significantly higher brain activity in the left and right gyrus fusiformis for the N 170 component, with additional regions of increased brain activation in a parieto-temporal-occipital network. For the P100, faces activated the left and right gyrus fusiformis significantly stronger than control stimuli. This study reveals that the first step of face processing (about 100 ms after stimulus presentation) is localized in the gyrus fusiformis. The second step of face processing around 170 ms involves the gyrus fusiformis, with additional activation in a more distributed network, including the occipital cortex.

Task difficulty in a simultaneous face matching task modulates activity in face fusiform area

The level of difficulty of a task can alter the neural network that activates for performance of the task. Previous studies have shown increased activation with task difficulty in the frontal lobes while the effects in the extrastriate visual areas have been unclear. We hypothesized that the face fusiform area (FFA), an area specialized for face processing, would increase activation as task difficulty increased in a face matching task. The difficulty level was increased by degrading the quality of the images. The degradation levels were 10%, 20%, 40% and 60%. Based on the correct response rate, the data were divided into a baseline level (composed of non-degraded and 10% degraded images) and a difficult level (composed of the 20%, 40% and 60% degraded images). Brain activation was measured using functional magnetic resonance imaging. The baseline face matching task activated a wide network of regions that included bilaterally the occipital, temporal and parietal lobes and the right frontal lobe. A novel behavioral finding was that task difficulty did not linearly increase with image degradation. The novel brain imaging finding was that the FFA is modulated by task difficulty and performance in the task was linearly correlated to activation in FFA. In addition, we found that activation in the dorsolateral prefrontal cortex (DLPFC) had increased activation as task difficulty increased. When adding the response time as a covariate, the differences in the DLPFC did not remain statistically significant. Increased task difficulty also led to a decrease in activation of visual areas in the extrastriate cortex. Task difficulty increased activation in the FFA to enhance the face processing and suppressed activation in visual extrastriate areas that processed low level properties of the stimuli. Task difficulty led to enhanced response in the FFA and suppressed response in other visual areas.

Detailed exploration of face-related processing in congenital prosopagnosia: 2. Functional neuroimaging findings

Specific regions of the human occipito-temporal cortex are consistently activated in functional imaging studies of face processing. To understand the contribution of these regions to face processing, we examined the pattern of fMRI activation in four congenital prosopagnosic (CP) individuals who are markedly impaired at face processing despite normal vision and intelligence, and with no evidence of brain damage. These individuals evinced a normal pattern of fMRI activation in the fusiform gyrus (FFA) and in other ventral occipito-temporal areas, in response to faces, buildings, and other objects, shown both as line drawings in detection and discrimination tasks and under more naturalistic testing conditions when no task was required. CP individuals also showed normal adaptation levels in a block-design adaptation experiment and, like control subjects, exhibited evidence of global face representation in the FFA. The absence of a BOLD-behavioral correlation (profound behavioral deficit, normal face-related activation in the ventral occipito-temporal cortex) challenges existing accounts of face representation, and suggests that activation in these cortical regions per se is not sufficient to ensure intact face processing.

Dynamic brain activation patterns for face recognition: a magnetoencephalography study

The present study used magnetoencephalography (MEG) to investigate the spatiotemporal profile of neurophysiological activity associated with recognition of recently encountered human faces in seventeen healthy right-handed adults. Activity sources modeled as instantaneous equivalent current dipoles were found in ventral occipito-temporal regions during the early stages of stimulus processing and in lateral temporal cortices during later stages. Hemispheric asymmetries in regional activity were restricted to ventral occipitotemporal areas. The magnitude of magnetic flux originating in these regions was greater in the right hemisphere during the first 350 ms post-stimulus onset. In addition, the duration of neurophysiological activity was greater in the right hemisphere after 600 ms post-stimulus onset. The results indicate right hemisphere predominance in the degree of engagement of neurophysiological processes involved in both the pre- and post-recognition phases of face processing.

Mining the posterior cingulate: Segregation between memory and pain components

We present a general method for automatic meta-analyses in neuroscience and apply it on text data from published functional imaging studies to extract main functions associated with a brain area-the posterior cingulate cortex (PCC). Abstracts from PubMed are downloaded, words extracted and converted to a bag-of-words matrix representation. The combined data are analyzed with hierarchical non-negative matrix factorization. We find that the prominent themes in the PCC corpus are episodic memory retrieval and pain. We further characterize the distribution in PCC of the Talairach coordinates available in some of the articles. This shows a tendency to functional segregation between memory and pain components where memory activations are predominantly in the caudal part and pain in the rostral part of PCC.

Electrophysiological correlates of facial decision: Insights from upright and upside-down Mooney-face perception

We investigated the ERP correlates of the subjective perception of upright and upside-down ambiguous pictures as faces using two-tone Mooney stimuli in an explicit facial decision task (deciding whether a face is perceived or not in the display). The difficulty in perceiving upside-down Mooneys as faces was reflected by both lower rates of "Face" responses and delayed "Face" reaction times for upside-down relative to upright stimuli. The N170 was larger for the stimuli reported as "faces". It was also larger for the upright than the upside-down stimuli only when they were reported as faces. Furthermore, facial decision as well as stimulus orientation effects spread from 140-190 ms to 390-440 ms. The behavioural delay in 'Face' responses to upside-down stimuli was reflected in ERPs by later effect of facial decision for upside-down relative to upright Mooneys over occipito-temporal electrodes. Moreover, an orientation effect was observed only for the stimuli reported as faces; it yielded a marked hemispheric asymmetry, lasting from 140-190 ms to 390-440 ms post-stimulus onset in the left hemisphere and from 340-390 to 390-440 ms only in the right hemisphere. Taken together, the results supported a preferential involvement of the right hemisphere in the detection of faces, whatever their orientation. By contrast, the early orientation effect in the left hemisphere suggested that upside-down Mooney stimuli were processed as non face objects until facial decision was reached in this hemisphere. The present data show that face perception involves not only spatially but also temporally distributed activities in occipito-temporal regions.

Abnormal activation of face processing systems at early and intermediate latency in individuals with autism spectrum disorder: a magnetoencephalographic study

The neurological basis of developmental psychopathology in autism is a matter of intense debate. Magnetoencephalography (MEG) was used to study the neuronal responses associated with the processing of faces in 12 able adults with autism spectrum disorders (ASD), performing image categorization and image identification tasks. The neuromagnetic data were analysed using nonparametric time-series analysis and equivalent current dipole estimation. Comparison data were obtained from 22 normally developing adults. In individuals with ASD, the neural responses to images of faces, observed in right extrastriate cortices at approximately 145 ms after stimulus onset, were significantly weaker, less lateralized and less affected by stimulus repetition than in control subjects. Early latency (30-60 ms) responses to face images, over right anterior temporal regions, differed significantly between the two subject groups in the image identification task. No such difference was observed for images of mugs or meaningless geometrical patterns. These findings suggest that, during the course of development in individuals with ASD, the cortical activity associated with the processing of human faces assumes a different-from-normal localization in extrastriate brain regions. This abnormal localization may be associated with unusual, but nevertheless face-specific, fast processing pathways.

Idiosyncratic initiation of saccadic face exploration in humans

Visual processing and subsequent action are limited by the effectiveness of eye movement control: where the eyes fixate determines what part of the visual environment is seen in detail. Visual exploration consists of stereotypical sequences of saccadic eye movements which are known to depend upon both external factors, such as visual stimulus features, and internal cognition-related factors, such as attention and memory. However, how these two factors are balanced is unknown. One determinant might be the familiarity or ecological importance of the visual stimulus being explored. Recordings of saccades for human face stimuli revealed that their exploration was subject to strong individual biases for the initial saccade direction: subjects tended to look first to one particular side. We attribute this to internal factors. In contrast, exploration of landscapes, fractals or inverted faces showed no significant direction bias for initial saccades, suggesting more externally driven exploration patterns. Thus the balance between external and internal factors in scene exploration depends on stimulus type. An analysis of saccade latencies suggested that this individual preference for first saccade direction during face exploration leads to higher effectiveness through automation. The findings have implications for the understanding of both normal and abnormal eye movements.

Functional MRI study of diencephalic amnesia in Wernicke–Korsakoff syndrome

Anterograde amnesia in Wernicke-Korsakoff syndrome is associated with diencephalic lesions, mainly in the anterior thalamic nuclei. Whether diencephalic and temporal lobe amnesias are distinct entities is still not clear. We investigated episodic memory for faces using functional MRI (fMRI) in eight controls and in a 34-year-old man with Wernicke-Korsakoff syndrome and diencephalic lesions but without medial temporal lobe (MTL) involvement at MRI. fMRI was performed with a 1.5 tesla unit. Three dual-choice tasks were employed: (i) face encoding (18 faces were randomly presented three times and subjects were asked to memorize the faces); (ii) face perception (subjects indicated which of two faces matched a third face); and (iii) face recognition (subjects indicated which of two faces belonged to the group they had been asked to memorize during encoding). All activation was greater in the right hemisphere. In controls both the encoding and recognition tasks activated two hippocampal regions (anterior and posterior). The anterior hippocampal region was more activated during recognition. Activation in the prefrontal cortex was greater during recognition. In the subject with Wernicke-Korsakoff syndrome, fMRI did not show hippocampal activation during either encoding or recognition. During recognition, although behavioural data showed defective retrieval, the prefrontal regions were activated as in controls, except for the ventrolateral prefrontal cortex. fMRI activation of the visual cortices and the behavioural score on the perception task indicated that the subject with Wernicke-Korsakoff syndrome perceived the faces, paid attention to the task and demonstrated accurate judgement. In the subject with Wernicke-Korsakoff syndrome, although the anatomical damage does not involve the MTL, the hippocampal memory encoding has been lost, possibly as a consequence of the hippocampal-anterior thalamic axis involvement. Anterograde amnesia could therefore be the expression of damage to an extended hippocampal system, and the distinction between temporal lobe and diencephalic amnesia has limited value. In the subject with Wernicke-Korsakoff syndrome, the preserved dorsolateral prefrontal cortex activation during incorrect recognition suggests that this region is more involved in either the orientation or attention at retrieval than in retrieval. The lack of activation of the prefrontal ventrolateral cortex confirms the role of this area in episodic memory formation.

An fMRI study of the cerebral macro network involved in 'cue invariant' form perception and how it is influenced by stimulus complexity

We investigated the influence of stimulus complexity on the macro network of visual areas involved in 'cue invariant' form perception. Functional MRI imaging on 14 healthy, adult volunteers was performed during a two alternative forced choice (2-AFC) form discrimination task. The functional load imposed onto the visual system was varied by using simple and complex shapes. The figures were defined using a luminance, a chromatic or a motion contrast cue. The three cues activated the same visual areas in the ventral pathway, including area 'LO'. Activation of visual area 'V3v' but not area 'KO' in the dorsal pathway was observed to the motion contrast cue. The simple shapes induced a larger BOLD response in BA18 than the complex shapes, reflecting the selectivity of this region for the features in the stimuli such as edges and vertices. The brain regions yielding a larger BOLD signal to the complex shapes were areas know to be selective to the orthographic content of our complex stimuli. The processing requirement was assessed by comparing the subjects' reaction time. We found no significant difference in the reaction times to the simple and complex shapes. The reaction times to the luminance contrast cue and the chromatic contrast cue were identical but that to the motion contrast cue were 200 ms longer. This finding concurs with neurophysiological studies, reporting a longer onset latency for motion contrast stimuli. It further lends support to the idea that the motion contrast cue requires auxiliary processing by the visual areas of the dorsal pathway before entry into the ventral pathway.

An experiment of nature: brain anatomy parallels cognition and behavior in Williams syndrome

Williams syndrome (WS) is a neurogenetic-neurodevelopmental disorder characterized by a highly variable and enigmatic profile of cognitive and behavioral features. Relative to overall intellect, affected individuals demonstrate disproportionately severe visual-spatial deficits and enhanced emotionality and face processing. In this study, high-resolution magnetic resonance imaging data were collected from 43 individuals with WS and 40 age- and gender-matched healthy controls. Given the distinct cognitive-behavioral dissociations associated with this disorder, we hypothesized that neuroanatomical integrity in WS would be diminished most in regions comprising the visual-spatial system and most "preserved" or even augmented in regions involved in emotion and face processing. Both volumetric analysis and voxel-based morphometry were used to provide convergent approaches for detecting the hypothesized WS neuroanatomical profile. After adjusting for overall brain volume, participants with WS showed reduced thalamic and occipital lobe gray matter volumes and reduced gray matter density in subcortical and cortical regions comprising the human visual-spatial system compared with controls. The WS group also showed disproportionate increases in volume and gray matter density in several areas known to participate in emotion and face processing, including the amygdala, orbital and medial prefrontal cortices, anterior cingulate, insular cortex, and superior temporal gyrus. These findings point to specific neuroanatomical correlates for the unique topography of cognitive and behavioral features associated with this disorder.

Functional topography of working memory for face or voice identity

We used functional magnetic resonance imaging (fMRI) to investigate whether the neural systems for nonspatial visual and auditory working memory exhibits a functional dissociation. The subjects performed a delayed recognition task for previously unfamiliar faces and voices and an audiovisual sensorimotor control task. During the initial sample and subsequent test stimulus presentations, activation was greater for the face than for the voice identity task bilaterally in the occipitotemporal cortex and, conversely, greater for voices than for faces bilaterally in the superior temporal sulcus/gyrus (STS/STG). Ventral prefrontal regions were activated by both memory delays in comparison with the control delays, and there was no significant difference in direct voxelwise comparisons between the tasks. However, further analyses showed that there was a subtle difference in the functional topography for two delay types within the ventral prefrontal cortex. Face delays preferentially activate the dorsal part of the ventral prefrontal cortex (BA 44/45) while voice delays preferentially activate the inferior part (BA 45/47), indicating a ventral/dorsal auditory/visual topography within the ventral prefrontal cortex. The results confirm that there is a modality-specific attentional modulation of activity in visual and auditory sensory areas during stimulus presentation. Moreover, within the nonspatial information-type domain, there is a subtle across-modality dissociation within the ventral prefrontal cortex during working memory maintenance of faces and voices.

Face recognition and cortical responses show similar sensitivity to noise spatial frequency

To find cortical correlates of face recognition, we manipulated the recognizability of face images in a parametric manner by masking them with narrow-band spatial noise. Face recognition performance was best at the lowest and highest noise spatial frequencies (NSFs, 2 and 45 c/image, respectively), and degraded gradually towards central NSFs (11-16 c/image). The strength of the 130-180 ms neuromagnetic response (M170) in the temporo-occipital cortex paralleled the recognition performance, whereas the mid-occipital response at 70-120 ms acted in the opposite manner, being strongest for the central NSFs. To noise stimuli without faces, M170 was small and rather insensitive to NSF, whereas the mid-occipital responses resembled closely the responses to the combined face and noise stimuli. These results suggest that the 100 ms mid-occipital response is sensitive to the central spatial frequencies that are critical for face recognition, whereas the M170 response is sensitive to the visibility of a face and closely related to face recognition.

Emotional attribution in high-functioning individuals with autistic spectrum disorder: a functional imaging study

OBJECTIVE

To determine whether expertise in the attribution of emotion from basic facial expressions in high-functioning individuals with autistic spectrum disorder (ASD) is supported by the amygdala, fusiform, and prefrontal regions of interest (ROI) and is comparable to that of typically developing individuals.

METHOD

Functional magnetic resonance imaging scans were acquired from 14 males with ASD and 10 matched adolescent controls while performing emotion match (EM) (perceptual), emotion label (EL) (linguistic), and control tasks. Accuracy, response time, and average activation were measured for each ROI.

RESULTS

There was no significant difference in accuracy, response time, or ROI activation between groups performing the EL task. The ASD group was as accurate as the control group performing the EM task but had a significantly longer response time and lower average fusiform activation.

CONCLUSIONS

Expertise in the attribution of emotion from basic facial expressions was task-dependent in the high-functioning ASD group. The hypothesis that the high-functioning ASD group would be less expert and would have reduced fusiform activation was supported in the perceptual task but not the linguistic task. The reduced fusiform activation in the perceptual task was not explained by reduced expertise; it is therefore concluded that reduced fusiform activation is associated with the diagnosis of ASD.

Differential neural responses to overt and covert presentations of facial expressions of fear and disgust

There is debate in cognitive neuroscience whether conscious versus unconscious processing represents a categorical or a quantitative distinction. The purpose of the study was to explore this matter using functional magnetic resonance imaging (fMRI). We first established objective thresholds of the critical temporal parameters for overt and covert presentations of fear and disgust. Next we applied these stimulus parameters in an fMRI experiment to determine whether non-consciously perceived (covert) facial expressions of fear and disgust show the same double dissociation (amygdala response to fear, insula to disgust) observed with consciously perceived (overt) stimuli. A backward masking paradigm was used. In the psychophysics experiment, the following parameters were established: 30-ms target duration for the covert condition, and 170-ms target duration for the overt condition. Results of the block-design fMRI study indicated substantial differences underlying the perception of fearful and disgusted facial expressions, with significant effects of both emotion and target duration. Findings for the overt condition (170 ms) confirm previous evidence of amygdala activation to fearful faces, and insula activation to disgusted faces, and a double dissociation between these two emotions. In the covert condition (30 ms), the amygdala was not activated to fear, nor was the insula activated to disgust. Overall, findings demonstrate significant differences between the neural responses to fear and to disgust, and between the covert presentations of these two emotions. These results therefore suggest distinct neural correlates of conscious and unconscious emotion perception.

Visual processing of coherent rotation in the central visual field: an fMRI study

Functional magnetic resonance imaging was used to determine the brain areas that process coherent motion. To reduce the activity related to eye-movement planning and self-motion perception, rotation was used as coherent motion and the stimulus was restricted to the central visual field. Coherent rotation relative to incoherent random-dot motion resulted in consistent activation in the superior parietal lobule (SPL), in the lateral occipital gyrus (presumptive kinetic occipital region, KO), and in the fusiform gyrus (FG). The main novel finding in present study is the bilateral SPL activation, which has not been found in any previous study contrasting coherent and incoherent motion. It is suggested that the SPL activation is related to form-from-motion processing. The stimulus modification that prevented abrupt appearances of dots at the borders of the stimulus field increased the strength of rolling disk-like percept of the coherent stimulus. This perception of form may also be at least partly responsible for the activation in KO and FG. With this explanation, our three consistent activation areas are in line with previous findings. Furthermore, these results demonstrate that even delicate changes in some stimulus aspects can lead to significant changes in the activation of the brain.

Attention to single letters activates left extrastriate cortex

Brain imaging studies examining the component processes of reading using words, non-words, and letter strings frequently report task-related activity in the left extrastriate cortex. Processing of these linguistic materials involves varying degrees of semantic, phonological, and orthographic analysis that are sensitive to individual differences in reading skill and history. In contrast, single letter processing becomes automatized early in life and is not modulated by later linguistic experience to the same degree as are words. In this study, skilled readers attended to different aspects (single letters, symbols, and colors) of an identical stimulus set during separate sessions of functional magnetic resonance imaging (fMRI). Whereas activation in some portions of ventral extrastriate cortex was shared by attention to both alphabetic and non-alphabetic features, a letter-specific area was identified in a portion of left extrastriate cortex (Brodmann's Area 37), lateral to the visual word form area. Our results demonstrate that while minimizing activity related to word-level lexical properties, cortical responses to letter recognition can be isolated from figural and color characteristics of simple stimuli. The practical utility of this finding is discussed in terms of early identification of reading disability.

Looking for faces: Attention modulates early occipitotemporal object processing

Looking for somebody's face in a crowd is one of the most important examples of visual search. For this goal, attention has to be directed to a well-defined perceptual category. When this categorically selective process starts is, however, still unknown. To this end, we used magnetoencephalography (MEG) recorded over right human occipitotemporal cortex to investigate the time course of attentional modulation of perceptual processes elicited by faces and by houses. The first face-distinctive MEG response was observed at 160-170 ms (M170). Nevertheless, attention did not start to modulate face processing before 190 ms. The first house-distinctive MEG activity was also found around 160-170 ms. However, house processing was not modulated by attention before 280 ms (90 ms later than face processing). Further analysis revealed that the attentional modulation of face processing is not due to later, for example, back-propagated activation of the M170 generator. Rather, subsequent stages of occipitotemporal object processing were modulated in a category-specific manner and with preferential access to face processing.

Processing faces and facial expressions

This paper reviews processing of facial identity and expressions. The issue of independence of these two systems for these tasks has been addressed from different approaches over the past 25 years. More recently, neuroimaging techniques have provided researchers with new tools to investigate how facial information is processed in the brain. First, findings from "traditional" approaches to identity and expression processing are summarized. The review then covers findings from neuroimaging studies on face perception, recognition, and encoding. Processing of the basic facial expressions is detailed in light of behavioral and neuroimaging data. Whereas data from experimental and neuropsychological studies support the existence of two systems, the neuroimaging literature yields a less clear picture because it shows considerable overlap in activation patterns in response to the different face-processing tasks. Further, activation patterns in response to facial expressions support the notion of involved neural substrates for processing different facial expressions.

A modulatory role for facial expressions in prosopagnosia

Brain-damaged patients experience difficulties in recognizing a face (prosopagnosics), but they can still recognize its expression. The dissociation between these two face-related skills has served as a keystone of models of face processing. We now report that the presence of a facial expression can influence face identification. For normal viewers, the presence of a facial expression influences performance negatively, whereas for prosopagnosic patients, it improves performance dramatically. Accordingly, although prosopagnosic patients show a failure to process the facial configuration in the interest of face identification, that ability returns when the face shows an emotional expression. Accompanying brain-imaging results indicate activation in brain areas (amygdala, superior temporal sulcus, parietal cortex) outside the occipitotemporal areas normally activated for face identification and lesioned in these patients. This finding suggests a modulatory role of these areas in face identification that is independent of occipitotemporal face areas.

Effect of head orientation on gaze processing in fusiform gyrus and superior temporal sulcus

We used functional MRI with an event-related design to dissociate the brain activation in the fusiform gyrus (FG) and posterior superior temporal sulcus (STS) for multiple face and gaze orientations. The event-related design allowed for concurrent behavioral analysis, which revealed a significant effect of both head and gaze orientation on the speed of gaze processing, with the face and gaze forward condition showing the fastest reaction times. In conjunction with this behavioral finding, the FG responded with the greatest activation to face and gaze forward, perhaps reflecting the unambiguous social salience of congruent face and gaze directed toward the viewer. Random effects analysis showed greater activation in both the FG and posterior STS when the subjects viewed a direct face compared to an angled face, regardless of gaze direction. Additionally, the FG showed greater activation for forward gaze compared to angled gaze, but only when the face was forward. Together, these findings suggest that head orientation has a significant effect on gaze processing and these effects are manifest not only in the STS, but also the FG.

Spatial vs. object specific attention in high-order visual areas

Recently we reported that the topographic organization of visual field eccentricity in human visual cortex extends into high-order, ventral occipitotemporal (VOT) cortex. Within this cortex, regions that respond preferentially to faces and buildings have specific eccentricity biases, suggesting that this category-eccentricity association may reflect differential needs of recognition processes. However, it is still not clear to what extent this center/periphery differentiation within high-order occipitotemporal cortex depends on immediate, moment-to-moment, task demands. Previous attention studies were confined either to exploring the visual field topography (spatial attention) or to object identity (object-based attention). Here, we combined the investigation of these two different attentional mechanisms in the same study. We found that the main source of attentional modulation in occipitotemporal cortex was object-based attention. Shifting attention to different object categories (buildings, faces, and arrows) substantially modulated the object-related activations. The differential activation to each object category in occipitotemporal object areas was maintained, albeit at a reduced level, even when attention was focused on different spatial locations. A slight eccentricity-related attentional differentiation was observed in the more dorsal lateral occipital region, but not in the VOT cortex. These results argue against the possibility that the source of the eccentricity differentiation in VOT cortex is due solely to moment-to-moment shifts in spatial attention mechanism and supports the notion that the eccentricity-biased maps found in this region are due to built-in shape selectivity established over long-term processes.

Human brain regions required for the dividing and switching of attention between two features of a single object

This combined PET and ERP study was designed to identify the brain regions activated in switching and divided attention between different features of a single object using matched sensory stimuli and motor response. The ERP data have previously been reported in this journal [64]. We now present the corresponding PET data. We identified partially overlapping neural networks with paradigms requiring the switching or dividing of attention between the elements of complex visual stimuli. Regions of activation were found in the prefrontal and temporal cortices and cerebellum. Each task resulted in different prefrontal cortical regions of activation lending support to the functional subspecialisation of the prefrontal and temporal cortices being based on the cognitive operations required rather than the stimuli themselves.

Neural correlates of anxiety associated with obsessive-compulsive symptom dimensions in normal volunteers

BACKGROUND

The neural correlates of anxiety associated with obsessive-compulsive symptomlike provocation in normal volunteers are unknown.

METHODS

Ten healthy volunteers participated in four functional magnetic resonance experiments. Subjects were scanned while viewing alternating blocks of emotional (normally aversive, washing-relevant, checking-relevant, or hoarding-relevant pictures) and neutral pictures, and imagining scenarios related to the content of each picture type. Nonparametric brain mapping analyses were used.

RESULTS

In response to the provocative pictures in all experiments, increases in subjective anxiety and activation in bilateral ventral prefrontal, limbic, dorsal prefrontal, and visual regions were demonstrated. Anxiety related to different symptom dimensions was associated with different patterns of activation: provocation of washing-relevant anxiety predominantly activated dorsal and ventral prefrontal regions; checking-relevant anxiety predominantly activated dorsal prefrontal regions; and hoarding-relevant anxiety predominantly activated ventral prefrontal regions and the left amygdala.

CONCLUSIONS

Our findings support a dimensional model of obsessive-compulsive disorder (OCD) whereby 1) the brain systems implicated in the mediation of anxiety in response to symptom-related material in normal subjects are similar to those identified in OCD patients during symptom provocation, and 2) anxiety associated with different symptom dimensions is associated with differential patterns of activation of these neural systems. Further investigation of the neural basis of OCD symptom dimensions is required.

Long-latency ERPs and recognition of facial identity

N400 brain event-related potential (ERP) is a mismatch negativity originally found in response to semantic incongruences of a linguistic nature and is used paradigmatically to investigate memory organization in various domains of information, including that of faces. In the present study, we analyzed different mismatch negativities evoked in N400-like paradigms related to recognition of newly learned faces with or without associated verbal information. ERPs were compared in the following conditions: (1) mismatching features (eyes-eyebrows) using a facial context corresponding to the faces learned without associated verbal information ("pure" intradomain facial processing); (2) mismatching features using a facial context corresponding to the faces learned with associated occupations and proper names ("nonpure" intradomain facial processing); (3) mismatching occupations using a facial context (cross-domain processing); and (4) mismatching names using an occupation context (intradomain verbal processing). Results revealed that mismatching stimuli in the four conditions elicited a mismatch negativity analogous to N400 but with different timing and topographical patterns. The onset of the mismatch negativity occurred earliest in Conditions 1 and 2, followed by Condition 4, and latest in Condition 3. The negativity had the shortest duration in Task 1 and the longest duration in Task 3. Bilateral parietal activity was confirmed in all conditions, in addition to a predominant right posterior temporal localization in Condition 1, a predominant right frontal localization in Condition 2, an occipital localization in Condition 3, and a more widely distributed (although with posterior predominance) localization in Condition 4. These results support the existence of multiple N400, and particularly of a nonlinguistic N400 related to purely visual information, which can be evoked by facial structure processing in the absence of verbal-semantic information.

Cerebral correlates of selective attention in schizophrenic patients with formal thought disorder: a controlled H2 15O-PET study

There is a widespread belief that formal thought disorders may be associated with disturbed selective attention in schizophrenia. Two hypotheses are derived: (1) patients with slightly pronounced formal thought disorders should differ from those with severely expressed formal thought disorders in terms of selective attention; and (2) the cerebral correlates of selective attention should be organised differently in mildly versus severely thought-disordered patients. We compared 20 female schizophrenic patients, one-half with mild, one-half with obvious formal thought disorders, and 10 control subjects on a neuropsychological battery and a cognitive activation task for selective attention (Go/NoGo) for the assessment of rCBF using H2 15O-PET. While the first hypothesis has not been confirmed, we found that the cerebral regions activated by selective attention in the two patient groups showed completely differing organisations. Low degrees of formal thought disorders were associated with significant activations in frontal superior gyrus and ventral anterior thalamic nucleus whereas high degrees of formal thought disorders were accompanied by significant activations in fusiform gyrus and precuneus. We suggest that differing task-solving strategies are applied by both clinical subgroups to achieve comparable results on the selective attention paradigm.

Orthogonal polynomial regression for the detection of response variability in event-related fMRI

Previous studies using event-related potentials (ERPs) have identified a variety of brain regions that respond to rare nontarget distractor stimuli presented in the visual oddball task. By contrast, event-related functional magnetic resonance imaging (ER-fMRI) studies using similar stimuli have found little or no response in these same regions, suggesting that ER-fMRI may be less sensitive than ERPs for detecting stimulus-evoked activity. It was hypothesized here that variations in ER-fMRI response amplitude evoked by successive stimuli may have reduced detection sensitivity in these previous studies. Multiple regression with orthogonal polynomials (OPR) was used to increase detection sensitivity by employing orthogonal polynomial equations to model such variations in response amplitude. ER-fMRI data was collected from 17 subjects during performance of the visual oddball task, which included frequent nontarget, rare nontarget distractor, and rare target block letter stimuli, to which subjects made a speeded button press response. When compared with multiple regression using main effect regressors alone, OPR identified an increased volume of significant target and distractor evoked main effect response due to reduced error variance. In addition, distractor-evoked activity was found to correlate with orthogonal polynomial regressors but not main effect regressors across a large volume of prefrontal and paralimbic brain regions including dorsal-lateral prefrontal, inferior-lateral prefrontal, and cingulate cortex. These results illustrate that considerable variability is present in ER-fMRI responses evoked by rare distractor stimuli in the oddball task. Such variability can be modeled using OPR, leading to increased detection sensitivity and better anatomical correspondence between the findings of ER-fMRI and ERP studies.

Dynamics of visual feature analysis and object-level processing in face versus letter-string perception

Neurones in the human inferior occipitotemporal cortex respond to specific categories of images, such as numbers, letters and faces, within 150-200 ms. Here we identify the locus in time when stimulus-specific analysis emerges by comparing the dynamics of face and letter-string perception in the same 10 individuals. An ideal paradigm was provided by our previous study on letter-strings, in which noise-masking of stimuli revealed putative visual feature processing at 100 ms around the occipital midline followed by letter-string-specific activation at 150 ms in the left inferior occipitotemporal cortex. In the present study, noise-masking of cartoon-like faces revealed that the response at 100 ms increased linearly with the visual complexity of the images, a result that was similar for faces and letter-strings. By 150 ms, faces and letter-strings had entered their own stimulus-specific processing routes in the inferior occipitotemporal cortex, with identical timing and large spatial overlap. However, letter-string analysis lateralized to the left hemisphere, whereas face processing occurred more bilaterally or with right-hemisphere preponderance. The inferior occipitotemporal activations at approximately 150 ms, which take place after the visual feature analysis at approximately 100 ms, are likely to represent a general object-level analysis stage that acts as a rapid gateway to higher cognitive processing.

The topography of high-order human object areas

Cortical topography is one of the most fundamental organizing principles of cortical areas. One such topography - eccentricity mapping - is present even in high-order, ventral stream visual areas. Within these areas, different object categories have specific eccentricity biases. In particular, faces, letters and words appear to be associated with central visual-field bias, whereas buildings are associated with a peripheral one. We propose that resolution needs are an important factor in organizing object representations: objects whose recognition depends on analysis of fine detail will be associated with central-biased representations, whereas objects whose recognition entails large-scale integration will be more peripherally biased.