Effects of face contour and features on early occipitotemporal activity when viewing eye movement

Human Face Perception Using Electroencephalography and Magnetoencephalography

The face has a large amount of information that is useful for humans in social communication. Recently, non-invasive methods have been used to investigate human brain activity related to perception and cognition processes. Electroencephalography (EEG) and magnetoencephalography (MEG) have excellent temporal resolution and reasonably good spatial resolution. Therefore, they are useful to investigate time sequences of human brain activity related to the face perception process. In this review, we introduce our previous EEG and MEG studies of human face perception that demonstrated the following characteristics of face perception processing: (1) Event-related components in the temporal area related to the activity in the inferior temporal (IT) area, corresponding to the fusiform face area (FFA), are evoked approximately 180 msec after the presentation of a face. The activity in the IT area plays an important role in the detection processing of a face, and the contours of a face affect the activity in the IT areas. (2) Event-related components in the temporal area related to the superior temporal sulcus (STS) activity are larger when eyes are averted than when directly looking into the eyes. (3) The direction of features of a face affects the face perception processing in the right hemisphere. On the other hand, the matching of the direction between the contours and features of a face affects the processing in the left hemisphere. (4) Random dots blinking (RDB), which uses temporal changes in patterns of many small dots to present stimuli without a change in luminance during the presentation of a face, is a useful visual stimulus method to investigate the brain activity related to face perception processing in the IT area using EEG and MEG.

Modulation of Neural Oscillatory Activity during Dynamic Face Processing

Various neuroimaging and neurophysiological methods have been used to examine neural activation patterns in response to faces. However, much of previous research has relied on static images of faces, which do not allow a complete description of the temporal structure of face-specific neural activities to be made. More recently, insights are emerging from fMRI studies about the neural substrates that underpin our perception of naturalistic dynamic face stimuli, but the temporal and spectral oscillatory activity associated with processing dynamic faces has yet to be fully characterized. Here, we used MEG and beamformer source localization to examine the spatiotemporal profile of neurophysiological oscillatory activity in response to dynamic faces. Source analysis revealed a number of regions showing enhanced activation in response to dynamic relative to static faces in the distributed face network, which were spatially coincident with regions that were previously identified with fMRI. Furthermore, our results demonstrate that perception of realistic dynamic facial stimuli activates a distributed neural network at varying time points facilitated by modulations in low-frequency power within alpha and beta frequency ranges (8-30 Hz). Naturalistic dynamic face stimuli may provide a better means of representing the complex nature of perceiving facial expressions in the real world, and neural oscillatory activity can provide additional insights into the associated neural processes.

Magnetoencephalographic study on facial movements

In this review, we introduced our three studies that focused on facial movements. In the first study, we examined the temporal characteristics of neural responses elicited by viewing mouth movements, and assessed differences between the responses to mouth opening and closing movements and an averting eyes condition. Our results showed that the occipitotemporal area, the human MT/V5 homologue, was active in the perception of both mouth and eye motions. Viewing mouth and eye movements did not elicit significantly different activity in the occipitotemporal area, which indicated that perception of the movement of facial parts may be processed in the same manner, and this is different from motion in general. In the second study, we investigated whether early activity in the occipitotemporal region evoked by eye movements was influenced by the facial contour and/or features such as the mouth. Our results revealed specific information processing for eye movements in the occipitotemporal region, and this activity was significantly influenced by whether movements appeared with the facial contour and/or features, in other words, whether the eyes moved, even if the movement itself was the same. In the third study, we examined the effects of inverting the facial contour (hair and chin) and features (eyes, nose, and mouth) on processing for static and dynamic face perception. Our results showed the following: (1) In static face perception, activity in the right fusiform area was affected more by the inversion of features while that in the left fusiform area was affected more by a disruption in the spatial relationship between the contour and features; and (2) In dynamic face perception, activity in the right occipitotemporal area was affected by the inversion of the facial contour.

Temporal dynamics of neural activity underlying unconscious processing of manipulable objects

The primate visual system is assumed to comprise two main pathways: a ventral pathway for shape and color perception and a dorsal pathway for spatial processing and visuomotor control. Previous studies consistently reported strong activation in the dorsal pathway(especially in the inferior parietal region) induced by manipulable object images such as tools. However, it is controversial whether the dorsal pathway retains this preferential activity to tool images under unconscious perception. In the present study, we used magnetoencephalography (MEG) and investigated spatio-temporal dynamics of neural responses to visible and invisible tool images. A presentation of visible tool images elicited a strong neural response over the parietal regions in the left hemisphere peaking at 400 msec. This response unique to the processing of tool information in the left parietal regions was still observed when conscious perception of tool images was inhibited by interocular suppression. Furthermore, analyses of neural oscillation signals revealed a suppression of m rhythm (8-13 Hz), a neural index of movement execution or imagery,induced by both visible and invisible tools. Those results indicated that the neural circuit to process the tool information was preserved under unconscious perception, highlighting an implicit aspect of the dorsal pathway.

Effects of inverting contour and features on processing for static and dynamic face perception: an MEG study

We investigated the effects of inverting facial contour (hair and chin) and features (eyes, nose and mouth) on processing for static and dynamic face perception using magnetoencephalography (MEG). We used apparent motion, in which the first stimulus (S1) was replaced by a second stimulus (S2) with no interstimulus interval and subjects perceived visual motion, and presented three conditions as follows: (1) U&U: Upright contour and Upright features, (2) U&I: Upright contour and Inverted features, and (3) I&I: Inverted contour and Inverted features. In static face perception (S1 onset), the peak latency of the fusiform area's activity, which was related to static face perception, was significantly longer for U&I and I&I than for U&U in the right hemisphere and for U&I than for U&U and I&I in the left. In dynamic face perception (S2 onset), the strength (moment) of the occipitotemporal area's activity, which was related to dynamic face perception, was significantly larger for I&I than for U&U and U&I in the right hemisphere, but not the left. These results can be summarized as follows: (1) in static face perception, the activity of the right fusiform area was more affected by the inversion of features while that of the left fusiform area was more affected by the disruption of the spatial relation between the contour and features, and (2) in dynamic face perception, the activity of the right occipitotemporal area was affected by the inversion of the facial contour.

Effect of configural distortion on a face-related ERP evoked by random dots blinking

Using random dots blinking (RDB), which reflects the activity of the higher visual area related to face perception, the following stimuli were presented. (1) Upright: a schematic face; (2) Inverted: the Upright stimulus inverted; and (3) Scrambled: the same contour and features as in Upright but with the spatial relation distorted. Clear negative components (N-ERP250) were identified at approximately 250 ms after stimulus onset. At the T5 and T6 electrodes, the peak latency was significantly longer for Inverted and Scrambled than for Upright. At the P4 electrode, the maximum amplitude was significantly larger for Scrambled than for Upright and Inverted. These results indicate that the delayed latency for Inverted and Scrambled reflects the involvement of the additional analytic processing caused by the configural distortion, and that the increase in amplitude for Scrambled indicates the existence of further processing caused by the distortion of the spatial relationship between the contour and features.

Enhanced activation in the extrastriate body area by goal-directed actions

AIM

Neuroimaging studies on biological motion have established the view that the posterior superior temporal sulcus (pSTS) is involved in detecting intention of others. Those studies have consistently reported other regions such as body-selective extrastriate body area (EBA) and motion-sensitive middle temporal, in close proximity to pSTS. Whether EBA responds only to static body parts or has a more extended role as part of a system for inferring intention of others has remained an elusive issue. The aim of the present study was to investigate the role of EBA in processing goal-directed actions.

METHODS

Twelve healthy volunteers participated in the present study. Using sports-related motions as visual stimuli, brain activations were examined during observation of goal-directed actions and non-goal-directed actions on functional magnetic resonance imaging.

RESULTS

Compared to non-goal-directed actions, goal-directed actions produced greater activations in EBA along with the mirror neuron system.

CONCLUSIONS

EBA might contribute to understanding others' actions by representing the dynamic aspects of human motions.