Theta- and Gamma-Band Activity Discriminates Face, Body and Object Perception

Gamma (60 Hz) auditory stimulation improves intrusions but not recall and working memory in healthy adults

Gamma-band (> 30 Hz) brain oscillations (γ) play a crucial role in memory and long-term potentiation, and their disruptions have been consistently documented in patients with Alzheimer's Disease (AD). Gamma-band oscillation entrainment through 60 Hz transcranial alternating stimulation (tACS) and 40 Hz tACS/sensory stimulation has been shown to enhance memory performance in healthy adults and patients with AD, respectively. However, the impact of gamma auditory stimulation on healthy adults' memory remains uncertain. In this balanced crossover study, 36 healthy subjects (27 Females) underwent three auditory stimulation conditions: no auditory stimulation (NO_AS), 40 Hz, and 60 Hz. Long-term verbal memory (LTM) and verbal working memory (WM) were assessed using, respectively, the Ray Auditory Verbal Test (RAVLT) and Digit Span Backward test (DS-B). We hypothesized that 60 Hz would improve LTM (as compared to NO_AS), but not WM; no specific effects were hypothesized for 40 Hz. We found that gamma-band auditory stimulation (40 Hz and 60 Hz) did not significantly affect RAVLT recall or WM. However, 60 Hz stimulation reduced RAVLT immediate recall intrusion; this outcome negatively correlated with DS-B performance, suggesting a positive impact of 60 Hz on executive functions. In summary, gamma-band auditory stimulation did not enhance memory in healthy adults, but 60 Hz stimulation potentially benefits executive functions. Further investigation is needed to understand gamma oscillation's role in cognitive processes for both healthy and clinical populations.

Reinvestigation of the Psychological Mechanisms of Construction Experience on Hazard Recognition Performance

OBJECTIVE

The study aimed to reinvestigate psychological mechanisms of the influence of construction workers' experience on hazard recognition performance, with signal detection theory (SDT) and electroencephalogram (EEG) readings.

BACKGROUND

Existing evidence regarding the effect of experience on hazard recognition performance in the construction industry remains inconsistent. Behavior-wise, identification of dominant hazard recognition factors (sensitivity or response bias, or both) would help determine appropriate training strategies to improve hazard recognition. In terms of neuro-responses, induced gamma-band activity was expected to reflect the cognitive functions mediating the psychological effects of experience.

METHOD

Seventy-seven construction workers participated in a predesigned hazard recognition task, in which participants judged whether a hazard was present from a series of construction scenario pictures. We computed and compared the sensitivity and response bias of SDT and time-frequency representations of recorded EEG signals of the two experience-level groups.

RESULTS

Novice workers had higher hazard recognition rates. Behavior-wise, novices were more sensitive than more experienced workers. Compared with experienced workers, novices showed stronger gamma-band difference power (hazardous minus safe) in the left frontal and right posterior parietal areas during the hazard recognition process.

CONCLUSION

Novices performed better at hazard recognition, indicating their sensitivity to the hazards without a clear difference in response bias. Based on the EEG data, novices' sensitivity may be attributed to more efficient working memory and attentional control.

APPLICATION

There is a need for continuous refreshment of hazard recognition skills for experienced workers for safety interventions.

Using multi-modal neuroimaging to characterise social brain specialisation in infants

The specialised regional functionality of the mature human cortex partly emerges through experience-dependent specialisation during early development. Our existing understanding of functional specialisation in the infant brain is based on evidence from unitary imaging modalities and has thus focused on isolated estimates of spatial or temporal selectivity of neural or haemodynamic activation, giving an incomplete picture. We speculate that functional specialisation will be underpinned by better coordinated haemodynamic and metabolic changes in a broadly orchestrated physiological response. To enable researchers to track this process through development, we develop new tools that allow the simultaneous measurement of coordinated neural activity (EEG), metabolic rate, and oxygenated blood supply (broadband near-infrared spectroscopy) in the awake infant. In 4- to 7-month-old infants, we use these new tools to show that social processing is accompanied by spatially and temporally specific increases in coupled activation in the temporal-parietal junction, a core hub region of the adult social brain. During non-social processing, coupled activation decreased in the same region, indicating specificity to social processing. Coupling was strongest with high-frequency brain activity (beta and gamma), consistent with the greater energetic requirements and more localised action of high-frequency brain activity. The development of simultaneous multimodal neural measures will enable future researchers to open new vistas in understanding functional specialisation of the brain.

Face motion form at learning influences the time course of face spatial frequency processing during test

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Posterior theta activity reveals an early signal of self-face recognition

Self-related visual information, especially one's own face and name, are processed in a specific, prioritized way. However, the spatio-temporal brain dynamics of self-prioritization have remained elusive. Moreover, it has been unclear whether this prioritization is an effect of enhancement and amplification, or rather a facilitating automatization of processing self-referential information. In this EEG study, 25 married women (who changed their surnames after marriage, so that their past and present surnames could be used as stimuli) performed a detection task with faces and names from five categories: self, self from the past, friend, famous, and unknown person. The aim was to determine the temporal and spatial characteristics of early electrophysiological markers of self-referential processing. We report results of event-related component (ERP) and time-frequency analyses. In the ERPs, the earliest self-relevance effect was displayed only 300 ms after stimulus onset in the midfrontal N2, and later in the parietal P3b, independently of the stimulus type. No self-relevance effect was found on the N170 component. However, local theta power at the occipito-temporal (visual) areas and inter-regional theta phase coherence between the visual and midfrontal areas showed that self-relevance differentiation of faces began already about 100-300 ms after stimulus onset. No such early effects were found for names. The results are discussed in terms of the time-course, functional localization, stimulus-specificity, and automatization of self-prioritization.

Deep learning applied to EEG source-data reveals both ventral and dorsal visual stream involvement in holistic processing of social stimuli

Perception of social stimuli (faces and bodies) relies on "holistic" (i.e., global) mechanisms, as supported by picture-plane inversion: perceiving inverted faces/bodies is harder than perceiving their upright counterpart. Albeit neuroimaging evidence suggested involvement of face-specific brain areas in holistic processing, their spatiotemporal dynamics and selectivity for social stimuli is still debated. Here, we investigate the spatiotemporal dynamics of holistic processing for faces, bodies and houses (adopted as control non-social category), by applying deep learning to high-density electroencephalographic signals (EEG) at source-level. Convolutional neural networks were trained to classify cortical EEG responses to stimulus orientation (upright/inverted), separately for each stimulus type (faces, bodies, houses), resulting to perform well above chance for faces and bodies, and close to chance for houses. By explaining network decision, the 150-200 ms time interval and few visual ventral-stream regions were identified as mostly relevant for discriminating face and body orientation (lateral occipital cortex, and for face only, precuneus cortex, fusiform and lingual gyri), together with two additional dorsal-stream areas (superior and inferior parietal cortices). Overall, the proposed approach is sensitive in detecting cortical activity underlying perceptual phenomena, and by maximally exploiting discriminant information contained in data, may reveal spatiotemporal features previously undisclosed, stimulating novel investigations.

Face pareidolia is enhanced by 40 Hz transcranial alternating current stimulation (tACS) of the face perception network

Pareidolia refers to the perception of ambiguous sensory patterns as carrying a specific meaning. In its most common form, pareidolia involves human-like facial features, where random objects or patterns are illusionary recognized as faces. The current study investigated the neurophysiological correlates of face pareidolia via transcranial alternating current stimulation (tACS). tACS was delivered at gamma (40 Hz) frequency over critical nodes of the "face perception" network (i.e., right lateral occipito-temporal and left prefrontal cortex) of 75 healthy participants while completing four face perception tasks ('Mooney test' for faces, 'Toast test', 'Noise pareidolia test', 'Pareidolia task') and an object perception task ('Mooney test' for objects). In this single-blind, sham-controlled between-subjects study, participants received 35 min of either Sham, Online, (40Hz-tACS_ON), or Offline (40Hz-tACS_PRE) stimulation. Results showed that face pareidolia was causally enhanced by 40Hz-tACS_PRE in the Mooney test for faces in which, as compared to sham, participants more often misperceived scrambled stimuli as faces. In addition, as compared to sham, participants receiving 40Hz-tACS_PRE showed similar reaction times (RTs) when perceiving illusory faces and correctly recognizing noise stimuli in the Toast test, thus not exhibiting hesitancy in identifying faces where there were none. Also, 40Hz-tACS_ON induced slower rejections of face pareidolia responses in the Noise pareidolia test. The current study indicates that 40 Hz tACS can enhance pareidolic illusions in healthy individuals and, thus, that high frequency (i.e., gamma band) oscillations are critical in forming coherent and meaningful visual perception.

Face memory and facial expression recognition are both affected by wearing disposable surgical face masks

Faces are fundamental stimuli for social interactions since they provide significant information about people's identity and emotional states. With the outburst of the COVID-19 pandemic, global use of preventive measures, such as disposable surgical face masks (DSFMs), has been imposed. The massive use of DSFMs covering a large part of the face could interfere with identity and emotion recognition. Thus, the main aim of the current study was (i) to assess how DSFMs affect identity recognition (Experiment 1), (ii) how DSFMs affect emotion recognition (Experiment 2), and (iii) whether individual empathy levels correlate with emotion recognition with DSFMs. The potential relation between identity and emotion recognition with and without DSFMs was also investigated. Two tasks were administered to 101 healthy participants: (i) the Old-new face memory task aimed to assess whether the learning context (i.e., DSFMs on/off) affects recognition performance, whereas (ii) the Facial affect task explored DSFMs' effect on emotion recognition. Results from the former showed that the stimuli's features in the learning stage affect recognition performances; that is, faces wearing DSFMs were better recognized if wearing DSFMs at first exposure and vice versa. Results from the Facial affect task showed that DSFMs lead to reduced disgust, happiness, and sadness recognition. No significant correlation emerged between identity and emotion recognition. The Interpersonal Reactivity Index (IRI) was administered to assess affective and cognitive empathy; however, IRI scores did not correlate with either face memory recognition or facial affect recognition. Overall, our results demonstrate (a) a "context effect" for face memory with and without DSFMs; (b) a disruptive effect of DSFMs depending on the expressed emotion; and (c) no correlation between empathy and emotion recognition with DSFMs.

Time-frequency analysis of brain activity in response to directional and non-directional visual stimuli: an event related spectral perturbations (ERSP) study

Objective.A large part of the cerebral cortex is dedicated to the processing of visual stimuli and there is still much to understand about such processing modalities and hierarchies. The main aim of the present study is to investigate the differences between directional visual stimuli (DS) and non-directional visual stimuli (n-DS) processing by time-frequency analysis of brain electroencephalographic activity during a visuo-motor task. Electroencephalography (EEG) data were divided into four regions of interest (ROIs) (frontal, central, parietal, occipital).Approach.The analysis of the visual stimuli processing was based on the combination of electroencephalographic recordings and time-frequency analysis. Event related spectral perturbations (ERSPs) were computed with spectrum analysis that allow to obtain the average time course of relative changes induced by the stimulus presentation in spontaneous EEG amplitude spectrum.Main results.Visual stimuli processing enhanced the same pattern of spectral modulation in all investigated ROIs with differences in amplitudes and timing. Additionally, statistically significant differences in occipital ROI between the DS and n-DS visual stimuli processing in theta, alpha and beta bands were found.Significance.These evidences suggest that ERSPs could be a useful tool to investigate the encoding of visual information in different brain regions. Because of their simplicity and their capability in the representation of brain activity, the ERSPs might be used as biomarkers of functional recovery for example in the rehabilitation of visual dysfunction and motor impairment following a stroke, as well as diagnostic tool of anomalies in brain functions in neurological diseases tailored to personalized treatments in clinical environment.

A multilevel Bayesian meta-analysis of the body inversion effect: Evaluating controversies over headless and sexualized bodies

Face and body perception rely on specialized processing mechanisms to interpret social information efficiently. The body inversion effect (BIE), refers to an inversion effect for bodies, such that recognition of bodies is impaired by inversion. The BIE, like the face inversion effect (FIE), is particularly important because a disproportionate BIE relative to inversion effects for objects could be interpreted in much the same way as the disproportionate FIE has often been characterized; that is, as evidence of specialized, configural processing. However, research supporting the BIE is marked by methodological heterogeneity and mixed findings. Our multilevel Bayesian meta-analysis addresses inconsistencies in the literature by pooling data from numerous studies to estimate the magnitude of the BIE across various methodological and stimulus properties. We included 180 effect sizes from 41 empirical articles representing data from 2,274 participants. Overall, we found that the BIE was moderate-large in magnitude (Hedges' g = 0.75). Importantly, the inversion effect was larger for bodies than objects (b = 0.42); however, the inversion effect for faces was larger than for bodies (b = 0.34). We tested the role of discrimination dimension, stimulus type, face/head inclusion, stimulus sexualization, and sexualized stimulus sex as moderators of the BIE. We found that the BIE was moderated by discrimination dimension, stimulus type, stimulus sexualization, and sexualized stimulus sex. By synthesizing the existing literature, we provide a better theoretical understanding of how underlying visual processing mechanisms may differ for different types of social information (i.e., bodies vs. faces).

Perception of Dynamic Point Light Facial Expression

This study uses point light displays both to investigate the roles of global and local motion analyses in the perception of dynamic facial expressions and to measure the information threshold for reliable recognition of emotions. We videotaped the faces of actors wearing black makeup with white dots while they dynamically produced each of 6 basic Darwin/Ekman emotional expressions. The number of point lights was varied to systematically manipulate amount of information available. For all but one of the expressions, discriminability (d′) increased approximately linearly with number of point lights, with most remaining largely discriminable with as few as only 6 point lights. This finding supports reliance on global motion patterns produced by facial muscles. However, discriminability for the happy expression was notably higher and largely unaffected by number of point lights and thus appears to rely on characteristic local motion, probably the unique upward curvature of the mouth. The findings indicate that recognition of facial expression is not a unitary process and that different expressions may be conveyed by different perceptual information, but in general, basic facial emotional expressions typically remain largely discriminable with as few as 6 dynamic point lights.

An Effortful Approach to Social Affiliation in Schizophrenia: Preliminary Evidence of Increased Theta and Alpha Connectivity during a Live Social Interaction

People with schizophrenia often experience a profound lack of motivation for social affiliation—a facet of negative symptoms that detrimentally impairs functioning. However, the mechanisms underlying social affiliative deficits remain poorly understood, particularly under realistic social contexts. Here, we investigated subjective reports and electroencephalography (EEG) functional connectivity in schizophrenia during a live social interaction. Individuals with schizophrenia (n = 16) and healthy controls (n = 29) completed a face-to-face interaction with a confederate while having EEG recorded. Participants were randomly assigned to either a Closeness condition designed to elicit feelings of closeness through self-disclosure or a Small-Talk condition with minimal disclosure. Compared to controls, patients reported lower positive emotional experiences and feelings of closeness across conditions, but they showed comparably greater subjective affiliative responses for the Closeness (vs. Small-Talk) condition. Additionally, patients in the Closeness (vs. Small-Talk) condition displayed a global increase in connectivity in theta and alpha frequency bands that was not observed for controls. Importantly, greater theta and alpha connectivity was associated with greater subjective affiliative responding, greater negative symptoms, and lower disorganized symptoms in patients. Collectively, findings indicate that patients, because of pronounced negative symptoms, utilized a less efficient, top-down mediated strategy to process social affiliation.

Neural Mechanism of Noise Affecting Face Recognition

Face recognition is one of the most important cognitive functions for humans in social activities. The ability will be negatively affected when the face images deteriorate. However, the neural process of extracting facial information under challenging conditions is still poorly understood. Therefore, it is necessary to further understand the neurophysiological relevance of this effect. We examined patients with multiple subdural electrodes (ECoG) monitored for clinical purposes. During the experimental task, the patients were presented with face and house images with different noise levels and were asked to recognize the faces. We found a striking increase in high gamma band power (HGP; 60-160 Hz) when face images were shown. We localized the face-specific electrodes to the fusiform gyrus (FG) and surrounding cortices. For each subject, the behavioral performance and magnitudes of the HGP for the face-specific sites significantly both fit a sigmoid function and showed similar changes. Additionally, the curve profile of the average HGP magnitude across the face-specific sites was almost equal to the average behavior curve; the former could precisely track the behavioral performance. In general, these results suggest that the HGP in the FG is closely related to the performance of face image recognition.

Special Patterns of Dynamic Brain Networks Discriminate Between Face and Non-face Processing: A Single-Trial EEG Study

Face processing is a spatiotemporal dynamic process involving widely distributed and closely connected brain regions. Although previous studies have examined the topological differences in brain networks between face and non-face processing, the time-varying patterns at different processing stages have not been fully characterized. In this study, dynamic brain networks were used to explore the mechanism of face processing in human brain. We constructed a set of brain networks based on consecutive short EEG segments recorded during face and non-face (ketch) processing respectively, and analyzed the topological characteristic of these brain networks by graph theory. We found that the topological differences of the backbone of original brain networks (the minimum spanning tree, MST) between face and ketch processing changed dynamically. Specifically, during face processing, the MST was more line-like over alpha band in 0–100 ms time window after stimuli onset, and more star-like over theta and alpha bands in 100–200 and 200–300 ms time windows. The results indicated that the brain network was more efficient for information transfer and exchange during face processing compared with non-face processing. In the MST, the nodes with significant differences of betweenness centrality and degree were mainly located in the left frontal area and ventral visual pathway, which were involved in the face-related regions. In addition, the special MST patterns can discriminate between face and ketch processing by an accuracy of 93.39%. Our results suggested that special MST structures of dynamic brain networks reflected the potential mechanism of face processing in human brain.