Visual Object Categorization in the Brain: What Can We Really Learn from ERP Peaks?

Mass-univariate analysis of scalp ERPs reveals large effects of gaze fixation location during face processing that only weakly interact with face emotional expression

Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content.

The early processing of fearful and happy facial expressions is independent of task demands - Support from mass univariate analyses

Most ERP studies on facial expressions of emotion have yielded inconsistent results regarding the time course of emotion effects and their possible modulation by task demands. Most studies have used classical statistical methods with a high likelihood of type I and type II errors, which can be limited with Mass Univariate statistics. FMUT and LIMO are currently the only two available toolboxes for Mass Univariate analysis of ERP data and use different fundamental statistics. Yet, no direct comparison of their output has been performed on the same dataset. Given the current push to transition to robust statistics to increase results replicability, here we compared the output of these toolboxes on data previously analyzed using classic approaches (Itier & Neath-Tavares, 2017). The early (0-352 ms) processing of fearful, happy, and neutral faces was investigated under three tasks in a within-subject design that also controlled gaze fixation location. Both toolboxes revealed main effects of emotion and task but neither yielded an interaction between the two, confirming the early processing of fear and happy expressions is largely independent of task demands. Both toolboxes found virtually no difference between neutral and happy expressions, while fearful (compared to neutral and happy) expressions modulated the N170 and EPN but elicited maximum effects after the N170 peak, around 190 ms. Similarities and differences in the spatial and temporal extent of these effects are discussed in comparison to the published classical analysis and the rest of the ERP literature.

The cerebral correlates of subliminal emotions: an eleoencephalographic study with emotional hybrid faces

In a high-resolution electroencephalographic study, participants evaluated the friendliness level of upright and inverted 'hybrid faces', i.e. facial photos containing a subliminal emotional core in the low spatial frequencies (< 6 cycles/image), superimposed on a neutral expression in the rest of the spatial frequencies. Upright happy and angry faces were judged as more friendly or less friendly than neutral faces, respectively. We observed the time course of cerebral correlates of these stimuli with event-related potentials (ERPs), confirming that hybrid faces elicited the posterior emotion-related and face-related components (P1, N170 and P2), previously shown to be engaged by non-subliminal emotional stimuli. In addition, these components were stronger in the right hemisphere and were both enhanced and delayed by face inversion. A frontal positivity (210-300 ms) was stronger for emotional than for neutral faces, and for upright than for inverted faces. Hence, hybrid faces represent an original approach in the study of subliminal emotions, which appears promising for investigating their electrophysiological correlates.

A wavelet based algorithm for the identification of oscillatory event-related potential components

Event related potentials (ERPs) are very feeble alterations in the ongoing electroencephalogram (EEG) and their detection is a challenging problem. Based on the unique time-based parameters derived from wavelet coefficients and the asymmetry property of wavelets a novel algorithm to separate ERP components in single-trial EEG data is described. Though illustrated as a specific application to N170 ERP detection, the algorithm is a generalized approach that can be easily adapted to isolate different kinds of ERP components. The algorithm detected the N170 ERP component with a high level of accuracy. We demonstrate that the asymmetry method is more accurate than the matching wavelet algorithm and t-CWT method by 48.67 and 8.03 percent, respectively. This paper provides an off-line demonstration of the algorithm and considers issues related to the extension of the algorithm to real-time applications.

Speed of human biological form and motion processing

Recent work suggests that biological motion processing can begin within ~110 ms of stimulus onset, as indexed by the P1 component of the event-related potential (ERP). Here, we investigated whether modulation of the P1 component reflects configural processing alone, rather than the processing of both configuration and motion cues. A three-stimulus oddball task was employed to evaluate bottom-up processing of biological motion. Intact point-light walkers (PLWs) or scrambled PLWs served as distractor stimuli, whereas point-light displays of tool motion served as standard and target stimuli. In a second experiment, the same design was used, but the dynamic stimuli were replaced with static point-light displays. The first experiment revealed that dynamic PLWs elicited a larger P1 as compared to scrambled PLWs. A similar P1 increase was also observed for static PLWs in the second experiment, indicating that these stimuli were more salient than static, scrambled PLWs. These findings suggest that the visual system can rapidly extract global form information from static PLWs and that the observed P1 effect for dynamic PLWs is not dependent on the presence of motion cues. Finally, we found that the N1 component was sensitive to dynamic, but not static, PLWs, suggesting that this component reflects the processing of both form and motion information. The sensitivity of P1 to static PLWs has implications for dynamic form models of biological motion processing that posit temporal integration of configural cues present in individual frames of PLW animations.

Piecing it together: infants' neural responses to face and object structure

Integration of local elements into a coherent global form is a fundamental aspect of visual object recognition. How the different hierarchically organized stages of visual analysis develop in order to support object representation in infants remains unknown. The aim of this study was to investigate structural encoding of natural images in 4- to 6-month-old infants and adults. We used the steady-state visual evoked potential (ssVEP) technique to measure cortical responses specific to the global structure present in object and face images, and assessed whether differential responses were present for these image categories. This study is the first to apply the ssVEP method to high-level vision in infants. Infants and adults responded to the structural relations present in both image categories, and topographies of the responses differed based on image category. However, while adult responses to face and object structure were localized over occipitotemporal scalp areas, only infant face responses were distributed over temporal regions. Therefore, both infants and adults show object category specificity in their neural responses. The topography of the infant response distributions indicates that between 4 and 6 months of age, structure encoding of faces occurs at a higher level of processing than that of objects.