Face-selective cells in the temporal cortex of monkeys

Information in the first spike, the order of spikes, and the number of spikes provided by neurons in the inferior temporal visual cortex

Information theoretic analyses showed that for single inferior temporal neurons and neuronal populations, more information was encoded in 20 or more ms by all the spikes available than just by the first spike in the same time window about which of 20 objects or faces was shown. Further, the temporal order in which the first spike arrived from different simultaneously recorded neurons did not encode more information than was present in the first spike or the spike counts. Thus information transmission in the inferior temporal cortex by the number of spikes in even short time windows is fast, and provides more information than only the first spike, or the spike order from different neurons.

Spatial vs temporal continuity in view invariant visual object recognition learning

We show in a 4-layer competitive neuronal network that continuous transformation learning, which uses spatial correlations and a purely associative (Hebbian) synaptic modification rule, can build view invariant representations of complex 3D objects. This occurs even when views of the different objects are interleaved, a condition where temporal trace learning fails. Human psychophysical experiments showed that view invariant object learning can occur when spatial but not temporal continuity applies because of interleaving of stimuli, although sequential presentation, which produces temporal continuity, can facilitate learning. Thus continuous transformation learning is an important principle that may contribute to view invariant object recognition.

Neural dynamics of autistic behaviors: cognitive, emotional, and timing substrates

What brain mechanisms underlie autism, and how do they give rise to autistic behavioral symptoms? This article describes a neural model, called the Imbalanced Spectrally Timed Adaptive Resonance Theory (iSTART) model, that proposes how cognitive, emotional, timing, and motor processes that involve brain regions such as the prefrontal and temporal cortex, amygdala, hippocampus, and cerebellum may interact to create and perpetuate autistic symptoms. These model processes were originally developed to explain data concerning how the brain controls normal behaviors. The iSTART model shows how autistic behavioral symptoms may arise from prescribed breakdowns in these brain processes, notably a combination of underaroused emotional depression in the amygdala and related affective brain regions, learning of hyperspecific recognition categories in the temporal and prefrontal cortices, and breakdowns of adaptively timed attentional and motor circuits in the hippocampal system and cerebellum. The model clarifies how malfunctions in a subset of these mechanisms can, through a systemwide vicious circle of environmentally mediated feedback, cause and maintain problems with them all.

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.

A biologically plausible model of human radial frequency perception

Several recent studies have used radial frequency patterns to investigate intermediate-level shape perception, a critical precursor to object recognition. Here, we developed the first neural model of RF perception based on known V4 properties that exhibits many of the characteristics of human RF perception. The model is composed of two main parts: (1) recovery of object position using large-scale non-Fourier V4-like concentric units that respond at the center of concentric contour segments across orientations, and (2) curvature detectors that encode local shape information. Each curvature mechanism combines multiplicatively the responses of three oriented filters, the positions and orientation preferences of which determine the curvature mechanism's tuning properties for position, orientation, and degree of curvature. When responding to RF patterns, peak responses occur at points of maximum curvature. Shape is represented as curvature responses as a function of orientation around the object center, and the cross-correlation of that function with a sine wave peaks when the frequency of the sine wave matches the number of peaks in the stimulus. Cross-correlation strength can be used to model human performance. Model and human performance are comparable for detection, identification, and lateral masking tasks. Moreover, the model also shows size invariance of detection performance due to scaling of the curvature mechanisms. The model is then used to make novel predictions.

Evaluation of a shape-based model of human face discrimination using FMRI and behavioral techniques

Understanding the neural mechanisms underlying object recognition is one of the fundamental challenges of visual neuroscience. While neurophysiology experiments have provided evidence for a "simple-to-complex" processing model based on a hierarchy of increasingly complex image features, behavioral and fMRI studies of face processing have been interpreted as incompatible with this account. We present a neurophysiologically plausible, feature-based model that quantitatively accounts for face discrimination characteristics, including face inversion and "configural" effects. The model predicts that face discrimination is based on a sparse representation of units selective for face shapes, without the need to postulate additional, "face-specific" mechanisms. We derive and test predictions that quantitatively link model FFA face neuron tuning, neural adaptation measured in an fMRI rapid adaptation paradigm, and face discrimination performance. The experimental data are in excellent agreement with the model prediction that discrimination performance should asymptote as faces become dissimilar enough to activate different neuronal populations.

Face and gaze processing in normally developing children: a magnetoencephalographic study

Magnetoencephalography (MEG) was used to study the neural mechanisms underlying face and gaze processing in ten normally developing boys aged between 8 and 11 years and 12 adult males. The participants performed two tasks in which they had to decide whether images presented sequentially in pairs, depicted the same person or the same motorbike. In the first task, the participants saw pictures of faces in which the eyes were either open or shut and pictures of motorbikes. In the second task, participants saw pairs of faces with gaze averted to the left or right. In children there was no evidence of the face sensitive, low amplitude short latency (30-60 ms) activity seen previously in adults. A strong, midline posterior response at approximately 100 ms was observed in children, which was earlier and somewhat stronger to faces than to motorbikes; in adults the signal at this latency was weak. A clear face sensitive response was seen in adults at 135 ms, predominantly over the right inferior occipito-temporal regions. Although activity was observed in the children at the same latency, it was less prominent, not lateralized and was evoked similarly by faces and motorbikes. Averted gaze conditions evoked strong right-lateralized activity at approximately 245 ms in children only. These findings indicate that even in middle childhood the neural mechanisms underlying face processing are less specialized than in adults, with greater early activation of posterior occipital cortices and less specific activation of ventral occipito-temporal cortex.

Dynamically modulated spike correlation in monkey inferior temporal cortex depending on the feature configuration within a whole object

The mechanism underlying the processing of spatially separated multiple local features to form a unique whole object is an important issue in visual object recognition. We tested whether, in behaving monkeys, the spike correlation between pairs of inferior temporal (IT) neurons dynamically changes depending on the spatial configuration of the local features within a whole object. We prepared more than 60,000 face-like objects (FOs) and their corresponding non-face-like objects (NFOs) that consisted of random arrangements of the same set of local features as those in FOs. The spike correlation between a pair of neurons was quantified by the peak height of the shift predictor-subtracted cross-correlogram. For both neurons of the pair, the local features in a whole object were determined so that they elicited as high a response as possible to enable a reliable cross-correlation analysis. We found that the FOs thus constructed elicited neuronal activities that were more strongly correlated than the corresponding NFOs. Firing rates of the same neurons did not show such a consistent bias depending on the feature configuration. Furthermore, receiver operating characteristic analysis revealed that this FO dominance of spike correlation was robust enough to discriminate between different feature configurations at the population level. Spike correlation of the cell pairs exhibited significant FO dominance within 300 ms after stimulus onset. The present results suggest that feature configuration within a unique whole object can be reflected in the rapid modulation of spike correlation among a population of neurons in the IT cortex.

Brain activation during sight gags and language-dependent humor

Humor is a hallmark of human discourse. People use it to relieve stress and to facilitate social bonding, as well as for pure enjoyment in the absence of any apparent adaptive value. Although recent studies have revealed that humor acts as an intrinsic reward, which explains why people actively seek to experience and create humor, few have addressed the cognitive aspects of humor. We used event-related functional magnetic resonance imaging to differentiate brain activity induced by the hedonic similarities and cognitive differences inherent in 2 kinds of humor: visual humor (sight gags) and language-based humor. Our findings indicate that the brain networks recruited during a humorous experience differ according to the type of humor being processed, with high-level visual areas activated during visual humor and classic language areas activated during language-dependent humor. Our results additionally highlight a common network activated by both types of humor that includes the amygdalar and midbrain regions, which presumably reflect the euphoric component of humor. Furthermore, we found that humor activates anterior cingulate cortex and frontoinsular cortex, 2 regions in the brain that are known to have phylogenetically recent neuronal circuitry. These results suggest that humor may have coevolved with another cognitive specialization of the great apes and humans: the ability to navigate through a shifting and complex social space.

Learning invariant object recognition in the visual system with continuous transformations

The cerebral cortex utilizes spatiotemporal continuity in the world to help build invariant representations. In vision, these might be representations of objects. The temporal continuity typical of objects has been used in an associative learning rule with a short-term memory trace to help build invariant object representations. In this paper, we show that spatial continuity can also provide a basis for helping a system to self-organize invariant representations. We introduce a new learning paradigm "continuous transformation learning" which operates by mapping spatially similar input patterns to the same postsynaptic neurons in a competitive learning system. As the inputs move through the space of possible continuous transforms (e.g. translation, rotation, etc.), the active synapses are modified onto the set of postsynaptic neurons. Because other transforms of the same stimulus overlap with previously learned exemplars, a common set of postsynaptic neurons is activated by the new transforms, and learning of the new active inputs onto the same postsynaptic neurons is facilitated. We demonstrate that a hierarchical model of cortical processing in the ventral visual system can be trained with continuous transform learning, and highlight differences in the learning of invariant representations to those achieved by trace learning.

Chapter 11 Visual masking approaches to visual awareness

In visual masking, visible targets are rendered invisible by modifying the context in which they are presented, but not by modifying the targets themselves. Here I summarize a decade of experimentation using visual masking illusions in which my colleagues and I have begun to establish the minimal set of conditions necessary to maintain the awareness of the visibility of simple unattended stimuli. We have established that spatiotemporal edges must be present for targets to be visible. These spatiotemporal edges must be encoded by transient bursts of spikes in the early visual system. If these bursts are inhibited, visibility fails. Target-correlated activity must rise within the visual hierarchy at least to the level of V3, and be processed within the occipital lobe, to achieve visibility. The specific circuits that maintain visibility are not yet known, but we have deduced that lateral inhibition plays a critical role in sculpting our perception of visibility, both by causing interactions between stimuli positioned across space, and also by shaping the responses to stimuli across time. Further, the studies have served to narrow the number of possible theories to explain visibility and visual masking. Finally, we have discovered that lateral inhibition builds iteratively in strength throughout the visual hierarchy, for both monoptic and dichoptic stimuli. Since binocular information is not integrated until inputs from the two eyes reach the primary visual cortex, it follows that the early visual areas contain differential levels of monoptic and dichoptic lateral inhibitions. We exploited this fact to discover that excitatory integration of binocular inputs occurs at an earlier level than interocular suppression. These findings are potentially fundamental to our understanding of all forms of binocular vision and to determining the role of binocular rivalry in visual awareness.

Novel visual stimuli activate a population of neurons in the primate orbitofrontal cortex

Neurons were found in the rhesus macaque anterior orbitofrontal cortex that respond to novel but not to familiar visual stimuli. Some of these neurons responded to all novel stimuli, and others to only a subset (e.g., to novel faces). The neurons have no responses to familiar reward- or punishment-associated visual stimuli, nor to taste, olfactory or somatosensory inputs. The responses of the neurons typically habituated with repeated presentations of a novel stimulus, and five presentations each 1s was the median number for the response to reach half-maximal. The neurons did not respond to stimuli which had been novel and shown a few times on the previous day, indicating that the neurons were involved in long-term memory. The median latency of the neuronal responses was 120 ms. The median spontaneous firing rate was 1.3 spikes/s, and the median response to novel visual stimuli was 6.0 spikes/s. These findings indicate that the long-term memory for visual stimuli is information that is represented in a region of the primate anterior orbitofrontal cortex.

Scene perception: inferior temporal cortex neurons encode the positions of different objects in the scene

Inferior temporal cortex (IT) neurons have reduced receptive field sizes in complex natural scenes. This facilitates the read-out of information about individual objects from IT, but raises the question of whether more than the single object present at the fovea is represented by the firing of IT neurons, as would be important for whole scene perception in which several objects may be located without eye movements. Recordings from IT neurons with five simultaneously presented objects, each subtending 7 degrees , with one object at the fovea and the other four centred 10 degrees eccentrically in the parafovea, showed that although 38 IT neurons had their best response to an effective stimulus at the fovea, eight IT neurons had their best response to an object when it was located in one or more of the parafoveal positions. Moreover, of 54 neurons tested for asymmetric parafoveal receptive fields, 35 (65%) had significantly different responses for different parafoveal positions. The asymmetry was partly related to competition within the receptive fields, as only 21% of the neurons had significant asymmetries when tested with just one object present located at the same parafoveal positions. The findings thus show that some evidence is conveyed by a population of IT neurons about the relative positions of several simultaneously presented objects in a scene extending well into the parafovea during a single fixation, and this is likely to be important in whole scene perception with multiple objects, including specifying the relative positions of different objects in a scene.

Visibility, visual awareness, and visual masking of simple unattended targets are confined to areas in the occipital cortex beyond human V1/V2

In visual masking, visible targets are rendered invisible by modifying the context in which they are presented, but not by modifying the targets themselves. Here, we localize the neuronal correlates of visual awareness in the human brain by using visual masking illusions. We compare monoptic visual masking activation, which we find within all retinotopic visual areas, with dichoptic masking activation, which we find only in those retinotopic areas downstream of V2. Because monoptic and dichoptic masking are equivalent in magnitude perceptually, the present results establish a lower bound for maintenance of visual awareness of simple unattended targets. Moreover, we find that awareness-correlated circuits for simple targets are restricted to the occipital lobe. This finding provides evidence of an upper boundary in the visual hierarchy for visual awareness of simple unattended targets, thus constraining the location of circuits that maintain the visibility of simple targets to occipital areas beyond V1/V2.

Stimulus selectivity of figural aftereffects for faces

Viewing a distorted face induces large aftereffects in the appearance of an undistorted face. The authors examined the processes underlying this adaptation by comparing how selective the aftereffects are for different dimensions of the images including size, spatial frequency content, contrast, and color. Face aftereffects had weaker selectivity for changes in the size, contrast, or color of the images and stronger selectivity for changes in contrast polarity or spatial frequency. This pattern could arise if the adaptation is contingent on the perceived similarity of the stimuli as faces. Consistent with this, changing contrast polarity or spatial frequency had larger effects on the perceived identity of a face, and aftereffects were also selective for different individual faces. These results suggest that part of the sensitivity changes underlying the adaptation may arise at visual levels closely associated with the representation of faces.

Recovery from adaptation to facial identity is larger for upright than inverted faces in the human occipito-temporal cortex

Human faces look more similar to each other when they are presented upside-down, leading to an increase of error rates and response times during individual face discrimination tasks. Here we used functional magnetic resonance imaging (fMRI) to test the hypothesis that this perceived similarity leads to a lower recovery from identity adaptation for inverted faces than for upright faces in face-sensitive areas of the occipito-temporal cortex. Ten subjects were presented with blocks of upright and inverted faces, with the same face identity repeated consecutively in half of the blocks, and different facial identities repeated in the other blocks. When face stimuli were presented upright, the percent signal change in the bilateral middle fusiform gyrus (MFG) was larger for different faces as compared to same faces, replicating previous observations of a recovery from facial identity adaptation in this region. However, there was no significant recovery from adaptation when different inverted faces were presented. Most interestingly, the difference in activation between upright and inverted faces increased progressively during a block when different facial identities were presented. A similar pattern of activation was found in the left middle fusiform gyrus, but was less clear-cut in bilateral face-sensitive areas of the inferior occipital cortex. These findings show that the differential level of activation to upright and inverted faces in the fusiform gyrus is mainly due to a difference in recovery from adaptation, and they explain the discrepancies in the results reported in previous fMRI studies which compared the processing of upright and inverted faces. The lack of recovery from adaptation for inverted faces in the fusiform gyrus may underlie the face inversion effect (FIE), which takes place during perceptual encoding of individual face representations.

fMRI evidence for the neural representation of faces

fMRI (functional magnetic resonance imaging) studies on humans have shown a cortical area, the fusiform face area, that is specialized for face processing. An important question is how faces are represented within this area. This study provides direct evidence for a representation in which individual faces are encoded by their direction (facial identity) and distance (distinctiveness) from a prototypical (mean) face. When facial geometry (head shape, hair line, internal feature size and placement) was varied, the fMRI signal increased with increasing distance from the mean face. Furthermore, adaptation of the fMRI signal showed that the same neural population responds to faces falling along single identity axes within this space.

Functional consequences of perceiving facial expressions of emotion without awareness

A substantial body of research has established that even when we are not consciously aware of the faces of others we are nevertheless sensitive to, and impacted by their facial expression. In this paper, we consider this body of research from a new perspective by examining the functions of unconscious perception revealed by these studies. A consideration of the literature from this perspective highlights that existing research methods are limited when it comes to revealing possible functions of unconscious perception. The critical shortcoming is that in all of the methods, the perceived facial expression remains outside of awareness. This is a problem because there are good reasons to believe that one important function of unconsciously perceived negative faces is to attract attention so that they are consciously perceived; such conscious perception, however, is never allowed with existing methodologies. We discuss recent studies of emotional face perception under conditions of visual search that address this issue directly. Further, we suggest that methodologies that do not examine cognitive processes as they occur in more natural settings may result in fundamental misunderstandings of human cognition.

Configural masking of faces: Evidence for high-level interactions in face perception

The perception of a stimulus can be impaired when presented in the context of a masking pattern. To determine the timing and the nature of face processing, the effect of various masks on the discriminability of faces was investigated. Results reveal a strong configural effect: the magnitude of masking depends on the similarity between mask and target. Masking is absent for non-face masks (noise, houses), modest for scrambled and inverted faces and strongest for upright faces, even when they differ in size, gender or viewpoint from the targets. This suggests an extra-striate location for the masking (possibly FFA). Reduced but significant masking for isolated face parts (internal features or head shape) is consistent with holistic computations in face perception. The duration over which a face mask can impair face discrimination (130 ms) is markedly longer than previously assumed and is sufficient for iterative and feedback computations to be part of face processing.

The psychobiology of neglect

Child neglect, the most prevalent form of child maltreatment, is associated with adverse psychological and educational outcomes. It is hypothesized that these outcomes may be caused by adverse brain development. However, there are very few published cross-sectional studies and no prospective studies that examine the neurodevelopmental consequences of neglect. In this article, the author comprehensively outlines the issues involved in the psychobiological research of child neglect. Pre-clinical and clinical studies will be reviewed. Throughout the article, suggestions for future research opportunities and novel ways to address methodological difficulties inherent in this field of study are offered. The results of recent neuroimaging studies of maltreated children may provide a basis for understanding the early effects of neglect on childhood brain development. The author is comprehensively examining these issues as part of the Federal Child Neglect Consortium.

Activation in posterior superior temporal sulcus parallels parameter inducing the percept of animacy

An essential, evolutionarily stable feature of brain function is the detection of animate entities, and one of the main cues to identify them is their movement. We developed a model of a simple interaction between two objects, in which an increase of the correlation between their movements varied the amount of interactivity and animacy observers attributed to them. Functional magnetic resonance imaging revealed that activation in the posterior superior temporal sulcus and gyrus (pSTS/pSTG) increased in relation to the degree of correlated motion between the two objects. This activation increase was not different when subjects performed an explicit or implicit task while observing these interacting objects. These data suggest that the pSTS and pSTG play a role in the automatic identification of animate entities, by responding directly to an objective movement characteristic inducing the percept of animacy, such as the amount of interactivity between two moving objects.

Sistema visual humano: evidência psicofísica para filtros de freqüência angular baixa

O objetivo deste trabalho foi mensurar curvas de resposta ao contraste para os filtros de freqüências angulares de banda estreita de 1, 2, 3 e 4 ciclos/360º. Foram estimadas nove curvas para cada filtro com o método psicofísico de somação de resposta de supralimiar aliado ao método da escolha forçada. Tomaram parte neste experimento cinco participantes adultos com acuidade visual normal ou corrigida. Os resultados demonstraram somações máximas de limiar de contraste na freqüência de teste dos filtros de 1, 2, 3 e 4 ciclos/360º circundadas por inibições nas freqüências vizinhas às freqüências angulares de teste de cada filtro. Estes resultados são consistentes com a existência de filtros de freqüências angulares de banda estreita operando no sistema visual humano através do processo de somação ou inibição na faixa de freqüências angular baixa.

Stability criteria for unsupervised temporal association networks

A biologically realizable, unsupervised learning rule is described for the online extraction of object features, suitable for solving a range of object recognition tasks. Alterations to the basic learning rule are proposed which allow the rule to better suit the parameters of a given input space. One negative consequence of such modifications is the potential for learning instability. The criteria for such instability are modeled using digital filtering techniques and predicted regions of stability and instability tested. The result is a family of learning rules which can be tailored to the specific environment, improving both convergence times and accuracy over the standard learning rule, while simultaneously insuring learning stability.

Is the fusiform face area specialized for faces, individuation, or expert individuation?

Several brain imaging studies have identified a region of fusiform gyrus (FG) that responds more strongly to faces than common objects. The precise functional role of this fusiform face area (FFA) is, however, a matter of dispute. We sought to distinguish among three hypotheses concerning FFA function: face specificity, individuation, and expert individuation. According to the face-specificity hypothesis, the FFA is specialized for face processing. Alternatively, the FFA may be specialized for individuating visually similar items within a category (the individuation hypothesis) or for individuating within categories with which a person has expertise (the expert-individuation hypothesis). Our results from two experiments supported the face-specificity hypothesis. Greater FFA activation to faces than Lepidoptera, another homogeneous object class, occurred during both free viewing and individuation, with similar FFA activation to Lepidoptera and common objects (Experiment 1). Furthermore, during individuation of Lepidoptera, 83% of activated FG voxels were outside the face FG region and only 15% of face FG voxels were activated. This pattern of results suggests that distinct areas may individuate faces and Lepidoptera. In Experiment 2, we tested Lepidoptera experts using the same experimental design. Again, the results supported the face-specificity hypothesis. Activation to faces in the FFA was greater than to both Lepidoptera and objects with little overlap between FG areas activated by faces and Lepidoptera. Our results suggest that distinct populations of neurons in human FG may be tuned to the features needed to individuate the members of different object classes, as has been reported in monkey inferotemporal cortex, and that the FFA contains neurons tuned for individuating faces.

An information-processing analysis of the functional architecture of the primate neocortex

Working at the systems level of analysis, we will use the term functional architecture to concern what processing components exist, how they are interconnected, and what information-processing functions each is involved in. In this paper, experimental evidence for the primate neocortex is analysed for conclusions concerning the existence of neural areas, for corticocortical connectivity among neural areas, and for the involvement of each cortical neural area in the functioning of the brain. We characterize the information-processing function for each neural area in terms of the types of information it is associated with, and conceive of its activity as processing, storage and transmission of data of the corresponding types for that area. We also adapt concepts of goal, plan, sequence, event and context for the description of information processing in the neocortex. This analysis shows that the primate neocortex consists in the main of a perception hierarchy, an action hierarchy and connections between them. In other words, from an information-processing point of view, the primate neocortex has a hierarchical perception-action architecture.

Illusions of face memory: Clarity breeds familiarity

When people perform a recognition memory task, they may avail themselves of different forms of information. For example, they may recall specific learning episodes, or rely on general feelings of familiarity. Although subjective familiarity is often valid, it can make people vulnerable to memory illusions. Research using verbal materials has shown that "old" responses are often increased by enhancing perceptual fluency, as when selected words are shown with relatively higher contrast on a computer. Conversely, episodic memory can create an erroneous sense of perceptual advantages for recently studied words. In this investigation, symmetric fluency effects were tested in face memory, a domain that is often considered neurologically and psychologically unique. In eight experiments involving over 800 participants, we found consistent memorial and perceptual illusions-fluency created feelings of familiarity, and familiarity created feelings of fluency. In both directions, these effects were manifested as response biases, suggesting effects based on memorial and perceptual attributions.

Processing faces and facial expressions

This paper reviews processing of facial identity and expressions. The issue of independence of these two systems for these tasks has been addressed from different approaches over the past 25 years. More recently, neuroimaging techniques have provided researchers with new tools to investigate how facial information is processed in the brain. First, findings from "traditional" approaches to identity and expression processing are summarized. The review then covers findings from neuroimaging studies on face perception, recognition, and encoding. Processing of the basic facial expressions is detailed in light of behavioral and neuroimaging data. Whereas data from experimental and neuropsychological studies support the existence of two systems, the neuroimaging literature yields a less clear picture because it shows considerable overlap in activation patterns in response to the different face-processing tasks. Further, activation patterns in response to facial expressions support the notion of involved neural substrates for processing different facial expressions.

A direct measure of human lateral temporal lobe neurons responsive to face matching

Do the human cerebral hemispheres process faces differently? Clinical lesion observations and primate studies suggest that the right temporal lobe is critical in face processing. Yet, the nature of this relationship remains unclear. Recording from single neurons during a visuospatial (VS)-matching paradigm, we found that 100% of significantly active neurons discriminated matching from perception, bilaterally. Lateralized differences in the nature and timing of responses revealed that the right hemisphere neurons responded earlier, and with uniform frequency reductions. Additional lateralized differences favoring the right hemisphere neurons were found when subjects matched intact faces compared to scrambled faces or complex objects. We conclude that widely distributed neural ensembles are involved in 'lateralized' behaviors, but cerebral specialization of face processing is as much a function of the nature and timing of neuronal activity as anatomic location.

Estradiol selectively affects processing of conspecifics' faces in female rhesus monkeys

Estrogen deficiency following ovariectomy or menopause increases the risk of developing diseases such as osteoporosis and may also lead to memory impairment. Although estrogen replacement therapy (ERT) alleviates many symptoms associated with estrogen loss, it is not clear whether it also benefits cognitive function. The effect of estrogens upon cognition can best be studied in an animal model of human menopause, in which estrogen levels can be experimentally manipulated. Six young ovariectomized female rhesus monkeys (6-9 years old) were tested on a battery of touchscreen-based cognitive tasks, including the Matching-to-Sample (MTS) task with mixed delays and the spatial, object, and face conditions of the Delayed Recognition Span Test (DRST). Monkeys were tested 5 days a week, one task per week, for a total of 8 months, while undergoing treatments with placebo and ethinyl estradiol (EE2) in alternating 28-days blocks. Blood samples were collected to verify EE2 levels. We also observed the monkeys by video monitor during test sessions and recorded locomotor activity and response topology. Performance on the face-DRST, a task that involved selecting the new face in an increasing array of rhesus monkey faces, was impaired by EE2 treatment, as compared to placebo. Other tasks were unaffected by EE2. There was no clear evidence of EE2 effects upon motor activity or anxiety. In order to test the reliability of our findings, we conducted an additional experiment in which the monkeys were again given the face-DRST with different categories of face stimuli for 4 months, while receiving placebo and EE2 in alternating 7-days blocks. They performed each task 4-5 days/week for 4 weeks with (1) the same rhesus monkey faces as in the first experiment, (2) human faces, (3) chimpanzee faces, and (4) novel rhesus monkey faces. Face-DRST performance did not vary as a function of treatment when human or chimpanzee faces were used as stimuli. In contrast, periods of EE2 treatment were associated with a lower performance for both sets of rhesus monkey faces. These findings suggest that EE2 treatment has a detrimental effect on processing faces of conspecifics by female rhesus monkeys. We speculate that estrogens may produce this effect by enhancing emotional reactivity to socially relevant stimuli.

Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli

Although the emotional expression of faces is believed to be accessed rapidly, previous ERP studies hardly found correlates of these processes. Here, we report findings from a study that investigated dichoptic binocular interaction using emotional face stimuli. Thirty-one subjects were briefly presented with schematic normal and scrambled faces (of neutral, positive, or negative expression) that occurred simultaneously in the left and right visual fields. Stimuli for both eyes could be congruent (control) or incongruent (dichoptic). Subjects decided which of the superimposed images in both hemi-fields appeared more "face-like" and during this task, the EEG was recorded from 30 channels. VEPs were analysed topographically according to the influence of the different experimental conditions (defined by presentation form, emotional expression, and location). Behavioural responses to the ambiguous dichoptic stimuli demonstrated a functional eye dominance not related to visual acuity and conventional eye preference. Electrophysiological data revealed three components with mean latencies of 85, 160, and 310 ms. Topography of the second component (equivalent to the face-related N170) differed in left-right and anterior-posterior direction compared with simple checkerboard stimuli. Dichoptic presentation caused reduced field strength of all three, and increased latency of the first component. Faces with negative expression yielded largest field strength of the second and third components. Besides that, emotional expression affected topography not only of late, but also the first component. This provides new evidence about the timing of perceptual processes related to facial expression, indicating that already VEP components occurring at 80-90 ms are sensitive to emotional content.

Implicit face perception in a patient with visual agnosia? Evidence from behavioural and eye-tracking analyses

This paper investigates face perception in a visual agnosic and prosopagnosic patient (SB). Despite very extensive lesions of visual areas, SB remains capable of some visual processing [Brain 125 (2002) 58]. However, in everyday situations SB does not exhibit signs of specific face recognition. To investigate how SB may process faces, we tested two hypotheses. According to the 'spared module hypothesis,' SBs abilities come from spared modules of implicit face processing. According to the 'general strategy hypothesis,' SB may have developed some deliberate compensatory strategies. A two-session experimental design was constructed. In both sessions, face and non-face pictures were shown to participants. In Session 1 (implicit condition), participants had to decide whether each picture was a vegetable. In Session 2 (explicit condition), participants had to decide whether each picture was a face. Verbal reports showed that SB was not aware of faces in Session 1. However, behavioural results showed that (1). SB could process faces; (2). even when SB was not aware of faces, he processed them differently than non-faces; (3). when knowing the presence of faces, he did not process faces better. In addition, eye-tracking data suggested that SB did not change the nature of his processing from Sessions 1 to 2. Pupil diameters showed that fixated facial features were processed similarly as in control participants. Together, these results are not compatible with a general compensatory strategy hypothesis and suggest sparing of an implicit face processing module in SB.

What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience

Both developmental and neurophysiological research suggest a common coding between perceived and generated actions. This shared representational network is innately wired in humans. We review psychological evidence concerning the imitative behaviour of newborn human infants. We suggest that the mechanisms involved in infant imitation provide the foundation for understanding that others are 'like me' and underlie the development of theory of mind and empathy for others. We also analyse functional neuroimaging studies that explore the neurophysiological substrate of imitation in adults. We marshal evidence that imitation recruits not only shared neural representations between the self and the other but also cortical regions in the parietal cortex that are crucial for distinguishing between the perspective of self and other. Imitation is doubly revealing: it is used by infants to learn about adults, and by scientists to understand the organization and functioning of the brain.

Electrophysiology and brain imaging of biological motion

The movements of the faces and bodies of other conspecifics provide stimuli of considerable interest to the social primate. Studies of single cells, field potential recordings and functional neuroimaging data indicate that specialized visual mechanisms exist in the superior temporal sulcus (STS) of both human and non-human primates that produce selective neural responses to moving natural images of faces and bodies. STS mechanisms also process simplified displays of biological motion involving point lights marking the limb articulations of animate bodies and geometrical shapes whose motion simulates purposeful behaviour. Facial movements such as deviations in eye gaze, important for gauging an individual's social attention, and mouth movements, indicative of potential utterances, generate particularly robust neural responses that differentiate between movement types. Collectively such visual processing can enable the decoding of complex social signals and through its outputs to limbic, frontal and parietal systems the STS may play a part in enabling appropriate affective responses and social behaviour.

Face versus non-face object perception and the 'other-race' effect: a spatio-temporal event-related potential study

OBJECTIVE

To investigate a modulation of the N170 face-sensitive component related to the perception of other-race (OR) and same-race (SR) faces, as well as differences in face and non-face object processing, by combining different methods of event-related potential (ERP) signal analysis.

METHODS

Sixty-two channel ERPs were recorded in 12 Caucasian subjects presented with Caucasian and Asian faces along with non-face objects. Surface data were submitted to classical waveforms and ERP map topography analysis. Underlying brain sources were estimated with two inverse solutions (BESA and LORETA).

RESULTS

The N170 face component was identical for both race faces. This component and its topography revealed a face specific pattern regardless of race. However, in this time period OR faces evoked significantly stronger medial occipital activity than SR faces. Moreover, in terms of maps, at around 170 ms face-specific activity significantly preceded non-face object activity by 25 ms. These ERP maps were followed by similar activation patterns across conditions around 190-300 ms, most likely reflecting the activation of visually derived semantic information.

CONCLUSIONS

The N170 was not sensitive to the race of the faces. However, a possible pre-attentive process associated to the relatively stronger unfamiliarity for OR faces was found in medial occipital area. Moreover, our data provide further information on the time-course of face and non-face object processing.

Abrupt onsets and gaze direction cues trigger independent reflexive attentional effects

The present study investigated whether the direction of visual signals is influenced independently by two automatic visual orienting phenomena: orienting to a gazed-at location and inhibition of return (IOR) to the location of an abrupt onset. A schematic face served as both a nonpredictive gaze direction cue and an abrupt onset cue. Results indicated that target detection was facilitated at the gazed-at location, and that it was inhibited at the abrupt onset location. Importantly, these two different reflexive attention effects were triggered by the same event and exhibited overlapping time courses. Moreover, the IOR effect did not vary as a function of the facilitatory effect of gaze. These findings strongly suggest that reflexive attention to gaze direction and reflexive inhibition to an abrupt onset are independent processes, and that gaze direction does not produce IOR at the gazed-at location.

Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions

Facial expressions of emotion powerfully influence social behavior. The distributed network of brain regions thought to decode these social signals has been empirically defined using static, usually photographic, displays of such expressions. Facial emotional expressions are however highly dynamic signals that encode the emotion message in facial action patterns. This study sought to determine whether the encoding of facial expressions of emotion by static or dynamic displays is associated with different neural correlates for their decoding. We used positron emission tomography to compare patterns of brain activity in healthy men and women during the explicit judgment of emotion intensity in static and dynamic facial expressions of anger and happiness. Compared to judgments of spatial orientation for moving neutral facial expressions, the judgment of anger in dynamic expressions was associated with increased right-lateralized activity in the medial, superior, middle, and inferior frontal cortex and cerebellum, while judgments of happiness were associated with relative activation of the cuneus, temporal cortex, and the middle, medial, and superior frontal cortex. In contrast, the perception of anger or happiness in static facial expressions activated a motor, prefrontal, and parietal cortical network previously shown to be involved in motor imagery. The direct contrast of dynamic and static expressions indicated differential activation of visual area V5, superior temporal sulcus, periamygdaloid cortex, and cerebellum for dynamic angry expressions and differential activation of area V5, extrastriate cortex, brain stem, and middle temporal cortical activations for dynamic happy expressions. Thus, a distribution of neural activations is related to the analysis of emotion messages in the nearly constant biological motion of the face and differ for angry and happy expressions. Static displays of facial emotional expression may represent noncanonical stimuli that are processed for emotion content by mental strategies and neural events distinct from their more ecologically relevant dynamic counterparts.

Synthetic faces, face cubes, and the geometry of face space

To simplify the study of visual face processing, we introduce a novel class of synthetic face stimuli based upon 37 measurements (head shape, feature locations, etc.) extracted from individual face photographs in both frontal and 20 degrees side views. Synthetic faces are bandpass filtered optimally for face perception and include both line and edge information. Pilot experiments establish that subjects are extremely accurate in matching a synthetic face with the original grayscale photograph, even across views. To determine the perceptual metric of face space, we introduce face cubes in which the geometric differences between any faces in a four-dimensional face subspace can be precisely determined. Experiments on face discrimination using face cubes establish the metric of synthetic face space as locally Euclidean, with discrimination thresholds representing 4-6% total geometric variation (as a percent of mean head radius) between faces. Discrimination thresholds are lowest for face cubes constructed around the average face, thus indicating that the mean face for each gender represents a natural origin for face space. Finally, synthetic faces exhibit a pronounced inversion effect for 20 degrees side views and a characteristic "Thatcher effect" for inverted front views. Synthetic faces and face cubes thus provide a useful new quantitative approach to the study of face perception and face space.

Category-sensitive excitatory and inhibitory processes in human extrastriate cortex

Single-cell recordings from the temporal lobe of monkeys viewing stimuli show that cells may be highly selective, responding for example to particular objects such as faces. However, stimulus-selective cells may be inhibited by nonpreferred stimuli. Can such inhibitory mechanisms be detected in human visual cortex? In previous recordings from the surface of human ventral extrastriate cortex, we found that specific categories of stimuli such as faces and words generate category-specific negative event-related potentials (ERPs) with a peak latency of about 200 ms (N200). Laminar recordings in animal cortex suggest that the human N200 reflects excitatory depolarizing potentials in apical dendrites of pyramidal cells. In this study we found that, at about half of word-specific N200 sites, faces generated a positive ERP (P200); conversely, at about half of face-specific sites, words generated P200s. The electrogenesis of N200 implies that P200 ERPs reflect hyperpolarizing inhibition of apical dendrites. These recordings, together with the prior animal recordings, provide strong circumstantial evidence that in human cortex populations of cells responsive to one stimulus category (such as faces) inhibit cells responsive to another category (such as words), probably by a type of lateral inhibition. Of the stimulus categories studied quantitatively, face-specific cells are maximally inhibited by words and vice versa, but other categories of stimuli may generate smaller P200s, suggesting that inhibition of category-specific cells by nonpreferred stimuli is a general feature of human extrastriate cortex involved in object recognition.

Invariant object recognition in the visual system with novel views of 3D objects

To form view-invariant representations of objects, neurons in the inferior temporal cortex may associate together different views of an object, which tend to occur close together in time under natural viewing conditions. This can be achieved in neuronal network models of this process by using an associative learning rule with a short-term temporal memory trace. It is postulated that within a view, neurons learn representations that enable them to generalize within variations of that view. When three-dimensional (3D) objects are rotated within small angles (up to, e.g., 30 degrees), their surface features undergo geometric distortion due to the change of perspective. In this article, we show how trace learning could solve the problem of in-depth rotation-invariant object recognition by developing representations of the transforms that features undergo when they are on the surfaces of 3D objects. Moreover, we show that having learned how features on 3D objects transform geometrically as the object is rotated in depth, the network can correctly recognize novel 3D variations within a generic view of an object composed of a new combination of previously learned features. These results are demonstrated in simulations of a hierarchical network model (VisNet) of the visual system that show that it can develop representations useful for the recognition of 3D objects by forming perspective-invariant representations to allow generalization within a generic view.

Contrast sensitivity to radial frequencies modulated by Jn and jn Bessel profiles

We measured human contrast sensitivity to radial frequencies modulated by cylindrical (Jo) and spherical (jo) Bessel profiles. We also measured responses to profiles of jo, j1, j2, j4, j8, and j16. Functions were measured three times by at least three of eight observers using a forced-choice method. The results conform to our expectations that sensitivity would be higher for cylindrical profiles. We also observed that contrast sensitivity is increased with the j n order for n greater than zero, having distinct orderly effects at the low and high frequency ends. For n = 0, 1, 2, and 4 sensitivity tended to occur around 0.8-1.0 cpd while for n = 8 and 16 it seemed to shift gradually to 0.8-3.0 cpd. We interpret these results as being consistent with the possibility that spatial frequency processing by the human visual system can be defined a priori in terms of polar coordinates and discuss its application to study face perception.

Genealogy of the "grandmother cell"

A "grandmother cell" is a hypothetical neuron that responds only to a highly complex, specific, and meaningful stimulus, such as the image of one's grandmother. The term originated in a parable Jerry Lettvin told in 1967. A similar concept had been systematically developed a few years earlier by Jerzy Konorski who called such cells "gnostic" units. This essay discusses the origin, influence, and current status of these terms and of the alternative view that complex stimuli are represented by the pattern of firing across ensembles of neurons.

Visual processing and neuropsychological function in schizophrenia and schizoaffective disorder

Persons with schizophrenia and schizoaffective disorder exhibit deficits in both visual processing and neuropsychological tasks. Little is known, however, about whether these deficits are related to one another. We administered psychophysical tests of visual discrimination and recognition, and neuropsychological tests of abstract flexibility, verbal learning, visual memory, working memory and attention to 42 outpatients with stable but chronic schizophrenia or schizoaffective disorder. Multiple regression analyses were performed to determine the relationship between these measures of neuropsychological function and visual psychophysical performance. Results indicated that motion perception was associated with working memory, and that the addition of a memory component to motion perception (motion recognition) was associated with both working memory and visual memory. Visual performance was not associated with symptom severity as measured by the PANSS. These results suggest that psychophysical tests of visual processing may contribute to deficits on neuropsychological tests of visual cognition, and may also reflect cross-modal disturbances of working memory function.

A quantitative morphometric comparative analysis of the primate temporal lobe

Given their importance in language comprehension, the human temporal lobes and/or some of their component structures might be expected to be larger than allometric predictions for a nonhuman anthropoid brain of human size. Whole brain, T1-weighted MRI scans were collected from 44 living anthropoid primates spanning 11 species. Easyvision software (Philips Medical Systems, The Netherlands) was used to measure the volume of the entire brain, the temporal lobes, the superior temporal gyri, and the temporal lobe white matter. The surface areas of both the entire temporal lobe and the superior temporal gyrus were also measured, as was temporal cortical gyrification. Allometric regressions of temporal lobe structures on brain volume consistently showed apes and monkeys to scale along different trajectories, with the monkeys typically lying at a higher elevation than the apes. Within the temporal lobe, overall volume, surface area, and white matter volume were significantly larger in humans than predicted by the ape regression lines. The largest departure from allometry in humans was for the temporal lobe white matter volume which, in addition to being significantly larger than predicted for brain size, was also significantly larger than predicted for temporal lobe volume. Among the nonhuman primate sample, Cebus have small temporal lobes for their brain size, and Macaca and Papio have large superior temporal gyri for their brain size. The observed departures from allometry might reflect neurobiological adaptations supporting species-specific communication in both humans and old world monkeys.

Superior temporal gyrus volumes in pediatric generalized anxiety disorder

BACKGROUND

The essential symptoms of generalized anxiety disorder (GAD) are intrusive worry about everyday life circumstances and social competence, and associated autonomic hyperarousal. The amygdala, a brain region involved in fear and fear-related behaviors in animals, and its projections to the superior temporal gyrus (STG), thalamus, and to the prefrontal cortex are thought to comprise the neural basis of our abilities to interpret social behaviors. Larger amygdala volumes were previously reported in pediatric GAD; however, the brain regions involved in social intelligence were not examined in this pilot study.

METHODS

Magnetic resonance imaging (MRI) was used to measure the STG, thalamus, and prefrontal volumes in 13 medically healthy child and adolescent subjects with generalized anxiety disorder (GAD) and 98 comparison subjects, who were at low familial risk for mood and psychotic disorders. Groups were similar in age, gender, height, weight, handedness, socioeconomic status, and full-scale IQ.

RESULTS

The total, white matter, and gray matter STG volumes were significantly larger in GAD subjects compared with control subjects. Thalamus and prefrontal lobe volumes did not differ between groups. Findings of significant side-by-diagnosis interactions for STG and STG white matter volumes suggest that there is a more pronounced right > left asymmetry in total and STG white matter volumes in pediatric GAD subjects compared with control subjects. A significant correlation between the STG white matter percent asymmetry index with the child report of the Screen for Child Anxiety Related Emotional Disorders Scale was seen.

CONCLUSIONS

These data agree with previous work implicating posterior right-hemispheric regions in anxiety disorders and may suggest developmental alterations in pediatric GAD.

Neural mechanisms of object recognition

Single-unit recordings from behaving monkeys and human functional magnetic resonance imaging studies have continued to provide a host of experimental data on the properties and mechanisms of object recognition in cortex. Recent advances in object recognition, spanning issues regarding invariance, selectivity, representation and levels of recognition have allowed us to propose a putative model of object recognition in cortex.