Selective attention modulates face-specific induced gamma oscillations recorded from ventral occipitotemporal cortex

Uncovering the mechanisms of conscious face perception: a single-trial study of the n170 responses

When a face is flashed to an observer, a large negative component is elicited in the occipitotemporal cortex at ∼170 ms from the onset of presentation (N170). Previous studies have shown that the average N170 is correlated with conscious face perception; however, the single-trial mechanisms underlying such modulation remain largely unexplored. Here, we studied in human subjects the average and the single-trial N170 responses to briefly flashed faces, coupled with backward masking and varying degrees of Gaussian noise. In the average evoked responses we observed that, at fixed levels of noise, supraliminal faces exhibited significantly larger N170 amplitudes than subliminal faces. Moreover, the average N170 amplitude decreased with noise level both for the perceived and the nonperceived faces. At the single-trial level, the N170 amplitude was modulated by conscious recognition, which allowed predicting the subjects' perceptual responses above chance. In contrast, the single-trial N170 amplitudes were not modulated by the amount of noise and the effect found in the average responses was due to different latency jitters, as confirmed with latency-corrected averages. Altogether, these results suggest that conscious face perception is correlated with a boost in the activity of face-selective neural assemblies, whereas the stimulus uncertainty introduced by the added noise decreases the timing consistency (but not the amplitude) of this activation.

Exemplar selectivity reflects perceptual similarities in the human fusiform cortex

While brain imaging studies emphasized the category selectivity of face-related areas, the underlying mechanisms of our remarkable ability to discriminate between different faces are less understood. Here, we recorded intracranial local field potentials from face-related areas in patients presented with images of faces and objects. A highly significant exemplar tuning within the category of faces was observed in high-Gamma (80-150 Hz) responses. The robustness of this effect was supported by single-trial decoding of face exemplars using a minimal (n = 5) training set. Importantly, exemplar tuning reflected the psychophysical distance between faces but not their low-level features. Our results reveal a neuronal substrate for the establishment of perceptual distance among faces in the human brain. They further imply that face neurons are anatomically grouped according to well-defined functional principles, such as perceptual similarity.

Two critical and functionally distinct stages of face and body perception

Cortical regions that respond preferentially to particular object categories, such as faces and bodies, are essential for visual perception of these object categories. However, precisely when these regions play a causal role in recognition of their preferred categories is unclear. Here we addressed this question using transcranial magnetic stimulation (TMS). Across a series of experiments, TMS was delivered over the functionally localized right occipital face area (rOFA) or right extrastriate body area (rEBA) at different latencies, up to 150 ms, after stimulus onset while adult human participants performed delayed match-to-sample tasks on face and body stimuli. Results showed that TMS disrupted task performance during two temporally distinct time periods after stimulus onset, the first at 40/50 ms and the second at 100/110 ms. These two time periods exhibited functionally distinct patterns of impairment: TMS delivered during the early time period (at 40/50 ms) disrupted task performance for both preferred (faces at rOFA and bodies at rEBA) and nonpreferred (bodies at rOFA and faces at rEBA) categories. In contrast, TMS delivered during the later time period (at 100/110 ms) disrupted task performance for the preferred category only of each area (faces at rOFA and bodies at rEBA). These results indicate that category-selective cortical regions are critical for two functionally distinct stages of visual object recognition: an early, presumably preparatory stage that is not category selective occurring almost immediately after stimulus onset, followed by a later stage of category-specific perceptual processing.

Intracranial EEG surface renderings: new insights into normal and abnormal brain function

Intracranial electro-encephalography (icEEG) provides a unique opportunity to record directly from the human brain and is clinically important for planning epilepsy surgery. However, traditional visual analysis of icEEG is often challenging. The typical simultaneous display of multiple electrode channels can prevent an in-depth understanding of the spatial-time course of brain activity. In recent decades, advances in the field of neuroimaging have provided powerful new tools for the analysis and display of signals in the brain. These methods can now be applied to icEEG to map electrical signal information onto a three-dimensional rendering of a patient's cortex and graphically observe the changes in voltage over time. This approach provides rapid visualization of seizures and normal activity propagating over the brain surface and can also illustrate subtle changes that might be missed by traditional icEEG analysis. In addition, the direct mapping of signal information onto accurate anatomical structures can assist in the precise targeting of sites for epilepsy surgery and help correlate electrical activity with behavior. Bringing icEEG data into a standardized anatomical space will also enable neuroimaging methods of statistical analysis to be applied. As new technologies lead to a dramatic increase in the rate of data acquisition, these novel visualization and analysis techniques will play an important role in processing the valuable information obtained through icEEG.

A magnetoencephalographic study of face processing: M170, gamma-band oscillations and source localization

EEG studies suggested that the N170 ERP and Gamma-band responses to faces reflect early and later stages of a multiple-level face-perception mechanism, respectively. However, these conclusions should be considered cautiously because EEG-recorded Gamma may be contaminated by noncephalic activity such as microsaccades. Moreover, EEG studies of Gamma cannot easily reveal its intracranial sources. Here we recorded MEG rather than EEG, assessed the sources of the M170 and Gamma oscillations using beamformer, and explored the sensitivity of these neural manifestations to global, featural and configural information in faces. The M170 was larger in response to faces and face components than in response to watches. Scrambling the configuration of the inner components of the face even if presented without the face contour reduced and delayed the M170. The amplitude of MEG Gamma oscillations (30-70 Hz) was higher than baseline during an epoch between 230-570 ms from stimulus onset and was particularly sensitive to the configuration of the stimuli, regardless of their category. However, in the lower part of this frequency range (30-40 Hz) only physiognomic stimuli elevated the MEG above baseline. Both the M170 and Gamma were generated in a posterior-ventral network including the fusiform, inferior-occipital and lingual gyri, all in the right hemisphere. The generation of Gamma involved additional sources in the visual system, bilaterally. We suggest that the evoked M170 manifests a face-perception mechanism based on the global characteristics of face, whereas the induced Gamma oscillations are associated with the integration of visual input into a pre-existent coherent perceptual representation.

On the neural mechanisms subserving consciousness and attention

Consciousness, as described in the experimental literature, is a multi-faceted phenomenon, that impinges on other well-studied concepts such as attention and control. Do consciousness and attention refer to different aspects of the same core phenomenon, or do they correspond to distinct functions? One possibility to address this question is to examine the neural mechanisms underlying consciousness and attention. If consciousness and attention pertain to the same concept, they should rely on shared neural mechanisms. Conversely, if their underlying mechanisms are distinct, then consciousness and attention should be considered as distinct entities. This paper therefore reviews neurophysiological facts arguing in favor or against a tight relationship between consciousness and attention. Three neural mechanisms that have been associated with both attention and consciousness are examined (neural amplification, involvement of the fronto-parietal network, and oscillatory synchrony), to conclude that the commonalities between attention and consciousness at the neural level may have been overestimated. Last but not least, experiments in which both attention and consciousness were probed at the neural level point toward a dissociation between the two concepts. It therefore appears from this review that consciousness and attention rely on distinct neural properties, although they can interact at the behavioral level. It is proposed that a “cumulative influence model,” in which attention and consciousness correspond to distinct neural mechanisms feeding a single decisional process leading to behavior, fits best with available neural and behavioral data. In this view, consciousness should not be considered as a top-level executive function but should rather be defined by its experiential properties.

Explaining how brain stimulation can evoke memories

An unexplained phenomenon in neuroscience is the discovery that electrical stimulation in temporal neocortex can cause neurosurgical patients to spontaneously experience memory retrieval. Here we provide the first detailed examination of the neural basis of stimulation-induced memory retrieval by probing brain activity in a patient who reliably recalled memories of his high school (HS) after stimulation at a site in his left temporal lobe. After stimulation, this patient performed a customized memory task in which he was prompted to retrieve information from HS and non-HS topics. At the one site where stimulation evoked HS memories, remembering HS information caused a distinctive pattern of neural activity compared with retrieving non-HS information. Together, these findings suggest that the patient had a cluster of neurons in his temporal lobe that help represent the "high school-ness" of the current cognitive state. We believe that stimulation here evoked HS memories because it altered local neural activity in a way that partially mimicked the normal brain state for HS memories. More broadly, our findings suggest that brain stimulation can evoke memories by recreating neural patterns from normal cognition.

Human intracranial recordings and cognitive neuroscience

The ultimate goal of neuroscience research is to understand the operating mechanism of the human brain and to exploit this understanding to devise methods for repair when it malfunctions. A key feature of this operating mechanism is electrical activity of single brain cells and cell assemblies. For obvious ethical reasons, scientists rely mostly on animal research in the study of such signals. Research in humans is often limited to electrical signals that can be recorded at the scalp or to surrogates of electrical activity, namely magnetic source imaging and measures of regional blood flow and metabolism. Invasive brain recordings performed in patients during various clinical procedures provide a unique opportunity to record high-resolution signals in vivo from the human brain-data that are otherwise unavailable. Of special value are the rare opportunities to record in awake humans the activity of single brain cells and small cellular assemblies. These recordings provide a unique view on aspects of human cognition that are impossible to study in animals, including language, imagery, episodic memory, volition, and even consciousness. In the current review we discuss the unique contribution of invasive recordings from patients to the field of cognitive neuroscience.

Combined effects of attention and inversion on event-related potentials to human bodies and faces

We investigated effects of attentional load and inversion on event-related potentials to body or face distractors. Participants performed demanding (high load) or less demanding (low load) unrelated letter-search tasks. Bodies and faces were intact (Experiment 1) or without heads or eyes (Experiment 2). We measured prominent P100, N170, and late occipito-temporal negative (LNC) components. N170 to bodies had smaller and more anterior maxima than faces. N170 to intact bodies and faces was increased by inversion, relatively independently of load. Inversion effects were dramatically reduced for headless bodies, and even reversed for eyeless faces. Load effects were most prominent in LNC, with enhanced negativity under low load. We suggest that N170 reflects mandatory, category-specific initial distractor encoding in body- or face-sensitive cortical areas, a process which may depend on interactive encoding of hierarchical cues (bodies, heads, eyes). By contrast, LNC mainly reflects residual capacity allocated to extended processing of task-irrelevant distractors.

The fMRI BOLD signal tracks electrophysiological spectral perturbations, not event-related potentials

Functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) are primary tools of the psychological neurosciences. It is therefore important to understand the relationship between hemodynamic and electrophysiological responses. An early study by Huettel and colleagues found that the coupling of fMRI blood-oxygen-level-dependent signal (BOLD) and subdurally-recorded signal-averaged event-related potentials (ERPs) was not consistent across brain regions. Instead, a growing body of evidence now indicates that hemodynamic changes measured by fMRI reflect non-phase-locked changes in high frequency power rather than the phase-locked ERP. Here, we revisit the data from Huettel and colleagues and measure event-related spectral perturbations (ERSPs) to examine the time course of frequency changes. We found that, unlike the ERP, γ-ERSP power was consistently coupled with the hemodynamic response across three visual cortical regions. Stimulus duration modulated the BOLD signal and the γ-ERSP in the peri-calcarine and fusiform cortices, whereas there was no such modulation of either physiological signal in the lateral temporal-occipital cortex. This finding reconciles the original report with the more recent literature and demonstrates that the ERP and ERSP reflect dissociable aspects of neural activity.

Role of temporal processing stages by inferior temporal neurons in facial recognition

In this review, we focus on the role of temporal stages of encoded facial information in the visual system, which might enable the efficient determination of species, identity, and expression. Facial recognition is an important function of our brain and is known to be processed in the ventral visual pathway, where visual signals are processed through areas V1, V2, V4, and the inferior temporal (IT) cortex. In the IT cortex, neurons show selective responses to complex visual images such as faces, and at each stage along the pathway the stimulus selectivity of the neural responses becomes sharper, particularly in the later portion of the responses. In the IT cortex of the monkey, facial information is represented by different temporal stages of neural responses, as shown in our previous study: the initial transient response of face-responsive neurons represents information about global categories, i.e., human vs. monkey vs. simple shapes, whilst the later portion of these responses represents information about detailed facial categories, i.e., expression and/or identity. This suggests that the temporal stages of the neuronal firing pattern play an important role in the coding of visual stimuli, including faces. This type of coding may be a plausible mechanism underlying the temporal dynamics of recognition, including the process of detection/categorization followed by the identification of objects. Recent single-unit studies in monkeys have also provided evidence consistent with the important role of the temporal stages of encoded facial information. For example, view-invariant facial identity information is represented in the response at a later period within a region of face-selective neurons. Consistent with these findings, temporally modulated neural activity has also been observed in human studies. These results suggest a close correlation between the temporal processing stages of facial information by IT neurons and the temporal dynamics of face recognition.

Category-selective background connectivity in ventral visual cortex

Ventral visual cortex contains specialized regions for particular object categories, but little is known about how these regions interact during object recognition. Here we examine how the face-selective fusiform gyrus (FG) and the scene-selective parahippocampal cortex (PHC) interact with each other and with the rest of the brain during different visual tasks. To assess these interactions, we developed a novel approach for identifying patterns of connectivity associated with specific task sets, independent of stimulus-evoked responses. We tested whether this "background connectivity" between the FG and PHC was modulated when subjects engaged in face and scene processing tasks. In contrast to what would be predicted from biased competition or intrinsic activity accounts, we found that the strength of FG-PHC background connectivity depended on which category was task relevant: connectivity increased when subjects attended to scenes (irrespective of whether a competing face was present) and decreased when subjects attended to faces (irrespective of competing scenes). We further discovered that posterior occipital cortex was correlated selectively with the FG during face tasks and the PHC during scene tasks. These results suggest that category specificity exists not only in which regions respond most strongly but also in how these and other regions interact.

Category-Specific Visual Responses: An Intracranial Study Comparing Gamma, Beta, Alpha, and ERP Response Selectivity

The specificity of neural responses to visual objects is a major topic in visual neuroscience. In humans, functional magnetic resonance imaging (fMRI) studies have identified several regions of the occipital and temporal lobe that appear specific to faces, letter strings, scenes, or tools. Direct electrophysiological recordings in the visual cortical areas of epileptic patients have largely confirmed this modular organization, using either single-neuron peri-stimulus time-histogram or intracerebral event-related potentials (iERP). In parallel, a new research stream has emerged using high-frequency gamma-band activity (50–150 Hz) (GBR) and low-frequency alpha/beta activity (8–24 Hz) (ABR) to map functional networks in humans. An obvious question is now whether the functional organization of the visual cortex revealed by fMRI, ERP, GBR, and ABR coincide. We used direct intracerebral recordings in 18 epileptic patients to directly compare GBR, ABR, and ERP elicited by the presentation of seven major visual object categories (faces, scenes, houses, consonants, pseudowords, tools, and animals), in relation to previous fMRI studies. Remarkably both GBR and iERP showed strong category-specificity that was in many cases sufficient to infer stimulus object category from the neural response at single-trial level. However, we also found a strong discrepancy between the selectivity of GBR, ABR, and ERP with less than 10% of spatial overlap between sites eliciting the same category-specificity. Overall, we found that selective neural responses to visual objects were broadly distributed in the brain with a prominent spatial cluster located in the posterior temporal cortex. Moreover, the different neural markers (GBR, ABR, and iERP) that elicit selectivity toward specific visual object categories present little spatial overlap suggesting that the information content of each marker can uniquely characterize high-level visual information in the brain.

The relationship of γ oscillations and face-specific ERPs recorded subdurally from occipitotemporal cortex

The perception of faces evokes characteristic electrophysiological responses at discrete loci in human fusiform gyrus and adjacent ventral occipitotemporal cortical sites. Prominent among these responses are a surface-negative potential at ∼200-ms postonset (face-N200) and face-induced spectral perturbations in the gamma band (face-γERSP). The degree to which these responses represent activity in the same cortical loci and the degree to which they are influenced by the same perceptual and task variables are unknown. We evaluated this anatomical colocalization and functional correlation in 2 experiments in which the electrocorticogram was recorded from subdural electrodes in 51 participants. Experiment 1 investigated the category specificity of the γERSP and its colocalization with the face-N200. Experiment 2 examined differences in face-N200 and face-γERSP to face stimuli that varied in featural complexity. We found that γERSP is a category-specific phenomenon with separate, though overlapping, category sensitivities as the N200. Further, the presence of face-γERSP at an electrode site significantly predicted the presence and amplitude of face-N200 at that site. However, the converse was not true in that face-N200 was evoked by impoverished face stimuli that did not induce face-γERSP. These results demonstrate that these electrophysiological responses reflect separate components of the brain's face processing system.