Low-frequency oscillations employ a general coding of the spatio-temporal similarity of dynamic faces

EEG correlates of static and dynamic face perception: the role of naturalistic motion

Much of our understanding of how the brain processes dynamic faces comes from research that compares static photographs to dynamic morphs, which exhibit simplified, computer-generated motion. By comparing static, video recorded, and dynamic morphed expressions, we aim to identify the neural correlates of naturalistic facial dynamism, using time-domain and time-frequency analysis. Dynamic morphs were made from the neutral and peak frames of video recorded transitions of happy and fearful expressions, which retained expression change and removed asynchronous and non-linear features of naturalistic facial motion. We found that dynamic morphs elicited increased N400 amplitudes and lower LPP amplitudes compared to other stimulus types. Video recordings elicited higher LPP amplitudes and greater frontal delta activity compared to other stimuli. Thematic analysis of participant interviews using a large language model revealed that participants found it difficult to assess the genuineness of morphed expressions, and easier to analyse the genuineness of happy compared to fearful expressions. Our findings suggest that animating real faces with artificial motion may violate expectations (N400) and reduce the social salience (LPP) of dynamic morphs. Results also suggest that delta oscillations in the frontal region may be involved with the perception of naturalistic facial motion in happy and fearful expressions. Overall, our findings highlight the sensitivity of neural mechanisms required for face perception to subtle changes in facial motion characteristics, which has important implications for neuroimaging research using faces with simplified motion.

Large-scale cortico-cerebellar computations for horizontal and vertical vergence in humans

Horizontal and vertical vergence eye movements play a central role in binocular coordination. Neurophysiological studies suggest that cortical and subcortical regions in animals and humans are involved in horizontal vergence. However, little is known about the extent to which the neural mechanism underlying vertical vergence overlaps with that of horizontal vergence. In this study, to explore neural computation for horizontal and vertical vergence, we simultaneously recorded electrooculography (EOG) and whole-head magnetoencephalography (MEG) while presenting large-field stereograms for 29 healthy human adults. The stereograms were designed to produce vergence responses by manipulating horizontal and vertical binocular disparities. A model-based approach was used to assess neural sensitivity to horizontal and vertical disparities via MEG source estimation and the theta-band (4 Hz) coherence between brain activity and EOG vergence velocity. We found similar time-locked neural responses to horizontal and vertical disparity in cortical and cerebellar areas at around 100–250 ms after stimulus onset. In contrast, the low-frequency oscillatory neural activity associated with the execution of vertical vergence differed from that of horizontal vergence. These findings indicate that horizontal and vertical vergence involve partially shared but distinct computations in large-scale cortico-cerebellar networks.

Developmental Differences in Neuromagnetic Cortical Activation and Phase Synchrony Elicited by Scenes with Faces during Movie Watching

The neural underpinnings of humans’ ability to process faces and how it changes over typical development have been extensively studied using paradigms where face stimuli are oversimplified, isolated, and decontextualized. The prevalence of this approach, however, has resulted in limited knowledge of face processing in ecologically valid situations, in which faces are accompanied by contextual information at multiple time scales. In the present study, we use a naturalistic movie paradigm to investigate how neuromagnetic activation and phase synchronization elicited by faces from movie scenes in humans differ between children and adults. We used MEG data from 22 adults (6 females, 3 left handed; mean age, 27.7 ± 5.28 years) and 20 children (7 females, 1 left handed; mean age, 9.5 ± 1.52 years) collected during movie viewing. We investigated neuromagnetic time-locked activation and phase synchronization elicited by movie scenes containing faces in contrast to other movie scenes. Statistical differences between groups were tested using a multivariate data-driven approach. Our results revealed lower face-elicited activation and theta/alpha phase synchrony between 120 and 330 ms in children compared with adults. Reduced connectivity in children was observed between the primary visual areas as well as their connections with higher-order frontal and parietal cortical areas. This is the first study to map neuromagnetic developmental changes in face processing in a time-locked manner using a naturalistic movie paradigm. It supports and extends the existing evidence of core face-processing network maturation accompanied by the development of an extended system of higher-order cortical areas engaged in face processing.

Caricatured facial movements enhance perception of emotional facial expressions

Although faces “in the wild” constantly undergo complicated movements, humans adeptly perceive facial identity and expression. Previous studies, focusing mainly on identity, used photographic caricature to show that distinctive form increases perceived dissimilarity. We tested whether distinctive facial movements showed similar effects, and we focussed on both perception of expression and identity. We caricatured the movements of an animated computer head, using physical motion metrics extracted from videos. We verified that these “ground truth” metrics showed the expected effects: Caricature increased physical dissimilarity between faces differing in expression and those differing in identity. Like the ground truth dissimilarity, participants’ dissimilarity perception was increased by caricature when faces differed in expression. We found these perceived dissimilarities to reflect the “representational geometry” of the ground truth. However, neither of these findings held for faces differing in identity. These findings replicated across two paradigms: pairwise ratings and multiarrangement. In a final study, motion caricature did not improve recognition memory for identity, whether manipulated at study or test. We report several forms of converging evidence for spatiotemporal caricature effects on dissimilarity perception of different expressions. However, more work needs to be done to discover what identity-specific movements can enhance face identification.

Neurobiological Responses towards Stimuli Depicting Aggressive Interactions in Delinquent Young Adults and Controls: No Relation to Reactive and Proactive Aggression

Neurobiological measures underlying aggressive behavior have gained attention due to their potential to inform risk assessment and treatment interventions. Aberrations in responsivity of the autonomic nervous system and electrophysiological responses to arousal-inducing stimuli have been related to emotional dysregulation and aggressive behavior. However, studies have often been performed in community samples, using tasks that induce arousal but not specifically depict aggression. In this study, we examined differences in psychophysiological (i.e., heart rate, respiratory sinus arrhythmia, skin conductance level) and electrophysiological responses (i.e., P3, late positive potential, mu suppression) to aggressive versus neutral scenes in a sample of 118 delinquent young adults and 25 controls (all male, aged 18–27). With respect to group differences, we only found significant higher SCL reactivity during the task in the delinquent group compared to controls, but this was irrespective of condition (aggressive and neutral interactions). Within the delinquent group, we also examined associations between the neurobiological measures and reactive and proactive aggression. No significant associations were found. Therefore, although we found some indication of emotional dysregulation in these delinquent young adults, future studies should further elucidate the neurobiological mechanisms underlying emotional dysregulation in relation to different types of aggression.

Emotion and Brain Oscillations: High Arousal is Associated with Decreases in Alpha- and Lower Beta-Band Power

The study of brain oscillations associated with emotional picture processing has revealed conflicting findings. Although many studies observed a decrease in power in the alpha- and lower beta band, some studies observed an increase. Accordingly, the main aim of the present research series was to further elucidate whether emotional stimulus processing is related to an increase or decrease in alpha/beta power. In Study 1, participants (N = 16) viewed briefly presented (150 ms) high-arousing erotic and low-arousing people pictures. Picture presentation included a passive viewing condition and an active picture categorization task. Study 2 (N = 16) replicated Study 1 with negative valence stimuli (mutilations). In Study 3 (N = 18), stimulus materials of Study 1 and 2 were used. The main finding is that high-arousing pictures (erotica and mutilations) are associated with a decrease of power in the alpha/beta band across studies and task conditions. The effect peaked in occipitoparietal sensors between 400 and 800 ms after stimulus onset. Furthermore, a late (>1000 ms) alpha/beta power increase to mutilation pictures was observed, possibly reflecting top-down inhibitory control processes. Overall, these findings suggest that brain oscillations in the alpha/beta-band may serve as a useful measure of emotional stimulus processing.

Posterior Fusiform and Midfusiform Contribute to Distinct Stages of Facial Expression Processing

Though the fusiform is well-established as a key node in the face perception network, its role in facial expression processing remains unclear, due to competing models and discrepant findings. To help resolve this debate, we recorded from 17 subjects with intracranial electrodes implanted in face sensitive patches of the fusiform. Multivariate classification analysis showed that facial expression information is represented in fusiform activity and in the same regions that represent identity, though with a smaller effect size. Examination of the spatiotemporal dynamics revealed a functional distinction between posterior fusiform and midfusiform expression coding, with posterior fusiform showing an early peak of facial expression sensitivity at around 180 ms after subjects viewed a face and midfusiform showing a later and extended peak between 230 and 460 ms. These results support the hypothesis that the fusiform plays a role in facial expression perception and highlight a qualitative functional distinction between processing in posterior fusiform and midfusiform, with each contributing to temporally segregated stages of expression perception.

Spectral fingerprints of facial affect processing bias in major depression disorder

In major depressive disorder (MDD), processing of facial affect is thought to reflect a perceptual bias (toward negative emotion, away from positive emotion, and interpretation of neutral as emotional). However, it is unclear to what extent and which specific perceptual bias is represented in MDD at the behavior and neuronal level. The present report examined 48 medication naive MDD patients and 41 healthy controls (HCs) performing a facial affect judgment task while magnetoencephalography was recorded. MDD patients were characterized by overall slower response times and lower perceptual judgment accuracies. In comparison with HC, MDD patients exhibited less somatosensory beta activity (20–30 Hz) suppression, more visual gamma activity (40–80 Hz) modulation and somatosensory beta and visual gamma interaction deficit. Moreover, frontal gamma activity during positive facial expression judgment was found to be negatively correlated with depression severity. Present findings suggest that perceptual bias in MDD is associated with distinct spatio-spectral manifestations on the neural level, which potentially establishes aberrant pathways during facial emotion processing and contributes to MDD pathology.

Short-range and long-range neuronal oscillatory coupling in multiple frequency bands during face perception

Neuronal oscillatory activity has been considered to play a key role in face processing through its functional effect on information flow and exchange in human brain. Specifically, most neuronal oscillatory activity is measured in different rhythm based on the electrophysiological signal at single channel level. Although, the neuronal oscillatory coupling between neuronal assembles is associated with the information flow and exchange between brain regions, few studies focus on this type of neuronal oscillatory activity in face processing. In this study, the neuronal oscillatory coupling was investigated based on electroencephalographic (EEG) data of 20 participants, which were recorded when the participants were in a face/non-face perceptual task. The phase lag index (PLI) was used to assess the neuronal oscillatory coupling between brain regions in typical frequency bands. Enhanced short-range coupling was observed in theta (4-8 Hz) and alpha (8-12 Hz) band over the frontal region, in gamma1 (30-49 Hz) band over the left posterior and occipito-temporal regions, and in gamma2 (51-75 Hz) over the right temporal region during face perception compared with non-face perception. Long-range coupling was increased in theta and gamma band over the right hemisphere during face perception. Moreover, increased long-range coupling was observed in alpha band over the left and right hemisphere respectively during face perception. The results suggested that frequency-specific neuronal oscillatory coupling within and between regions of frontal cortex and the ventral visual pathway played an important role in face perception, which might reflect underlying neural mechanism of face perception.

Specific Neuronal Oscillatory Coupling over Frontal and Occipito-temporal Regions during Face Perception

Specific neuronal oscillatory activity had been considered as the underling mechanism for face processing. However, few studies focused on the neuronal oscillatory coupling between neuronal assembles during face perception. In this study, we investigated the neuronal oscillatory coupling when human was in a face/non-face perceptual task. Nine normal individuals were included in the study, electroencephalogram (EEG) was recorded and the phase lagged index (PLI) was used to assess the neuronal oscillatory coupling. Compared with non-face stimuli, for face stimuli, enhanced neuronal oscillatory coupling was observed in theta (4-8 Hz) and alpha (8-12 Hz) band over the left frontal region, in gamma1 (30-49 Hz) band over the left posterior and occipito-temporal regions, and in gamma2 (51-75 Hz) over the right temporal region. The results suggested that more top-down control process and information integration were included during face perception than non-face perception.

Affective picture processing: Alpha- and lower beta-band desynchronization reflects emotional arousal

EEG power analysis is firmly established in the cognitive domain. This contrasts with emotional stimulus processing, which thus far has yielded a complex and ambiguous pattern of findings. To further advance understanding, the present study examined emotional stimulus processing in the context of task variations and baseline activity, which included several manipulation checks as well as internal replication of findings across conditions. Participants (N = 16) viewed erotic and romantic pictures, differing in stimulus arousal. Pictures were presented briefly (120 ms), and intertrial interval was systematically varied (~1 vs. ~8 s). In one condition, participants passively viewed the pictures, in the other, they performed an active picture categorization task. The processing of erotic compared to romantic images was associated with a decrease in power in the alpha and lower beta band in posterior and anterior sensor clusters between 600-1,000 ms poststimulus. The finding was robust and confirmed across conditions, different quantifications, and independent from baseline activity. Furthermore, key findings regarding explicit task effects as well as ERPs sensitive to emotional arousal were replicated. Results are discussed with respect to the hypothesis that alpha- and lower beta-band activity may reflect cortical activation associated with emotional stimulus significance.

Spatial frequency supports the emergence of categorical representations in visual cortex during natural scene perception

In navigating our environment, we rapidly process and extract meaning from visual cues. However, the relationship between visual features and categorical representations in natural scene perception is still not well understood. Here, we used natural scene stimuli from different categories and filtered at different spatial frequencies to address this question in a passive viewing paradigm. Using representational similarity analysis (RSA) and cross-decoding of magnetoencephalography (MEG) data, we show that categorical representations emerge in human visual cortex at ∼180 ms and are linked to spatial frequency processing. Furthermore, dorsal and ventral stream areas reveal temporally and spatially overlapping representations of low and high-level layer activations extracted from a feedforward neural network. Our results suggest that neural patterns from extrastriate visual cortex switch from low-level to categorical representations within 200 ms, highlighting the rapid cascade of processing stages essential in human visual perception.