Neural dynamics associated with semantic and episodic memory for faces: evidence from multiple frequency bands

Exploring the potential of combining transcranial magnetic stimulation and electroencephalography to investigate mild cognitive impairment and Alzheimer's disease: a systematic review

Transcranial magnetic stimulation (TMS) and electroencephalography (EEG) are non-invasive techniques used for neuromodulation and recording brain electrical activity, respectively. The integration of TMS-EEG has emerged as a valuable tool for investigating the complex mechanisms involved in age-related disorders, such as mild cognitive impairment (MCI) and Alzheimer's disease (AD). By systematically synthesizing TMS-EEG studies, this review aims to shed light on the neurophysiological mechanisms underlying MCI and AD, while also exploring the practical applications of TMS-EEG in clinical settings. PubMed, ScienceDirect, and PsychInfo were selected as the databases for this review. The 22 eligible studies included a total of 592 individuals with MCI or AD as well as 301 cognitively normal adults. TMS-EEG assessments unveiled specific patterns of corticospinal excitability, plasticity, and brain connectivity that distinguished individuals on the AD spectrum from cognitively normal older adults. Moreover, the TMS-induced EEG features were observed to be correlated with cognitive performance and the presence of AD pathological biomarkers. The comprehensive examination of the existing studies demonstrates that the combination of TMS and EEG has yielded valuable insights into the neurophysiology of MCI and AD. This integration shows great potential for early detection, monitoring disease progression, and anticipating response to treatment. Future research is of paramount importance to delve into the potential utilization of TMS-EEG for treatment optimization in individuals with MCI and AD.

Review of EEG Affective Recognition with a Neuroscience Perspective

Emotions are a series of subconscious, fleeting, and sometimes elusive manifestations of the human innate system. They play crucial roles in everyday life-influencing the way we evaluate ourselves, our surroundings, and how we interact with our world. To date, there has been an abundance of research on the domains of neuroscience and affective computing, with experimental evidence and neural network models, respectively, to elucidate the neural circuitry involved in and neural correlates for emotion recognition. Recent advances in affective computing neural network models often relate closely to evidence and perspectives gathered from neuroscience to explain the models. Specifically, there has been growing interest in the area of EEG-based emotion recognition to adopt models based on the neural underpinnings of the processing, generation, and subsequent collection of EEG data. In this respect, our review focuses on providing neuroscientific evidence and perspectives to discuss how emotions potentially come forth as the product of neural activities occurring at the level of subcortical structures within the brain's emotional circuitry and the association with current affective computing models in recognizing emotions. Furthermore, we discuss whether such biologically inspired modeling is the solution to advance the field in EEG-based emotion recognition and beyond.

Posterior theta activity reveals an early signal of self-face recognition

Self-related visual information, especially one's own face and name, are processed in a specific, prioritized way. However, the spatio-temporal brain dynamics of self-prioritization have remained elusive. Moreover, it has been unclear whether this prioritization is an effect of enhancement and amplification, or rather a facilitating automatization of processing self-referential information. In this EEG study, 25 married women (who changed their surnames after marriage, so that their past and present surnames could be used as stimuli) performed a detection task with faces and names from five categories: self, self from the past, friend, famous, and unknown person. The aim was to determine the temporal and spatial characteristics of early electrophysiological markers of self-referential processing. We report results of event-related component (ERP) and time-frequency analyses. In the ERPs, the earliest self-relevance effect was displayed only 300 ms after stimulus onset in the midfrontal N2, and later in the parietal P3b, independently of the stimulus type. No self-relevance effect was found on the N170 component. However, local theta power at the occipito-temporal (visual) areas and inter-regional theta phase coherence between the visual and midfrontal areas showed that self-relevance differentiation of faces began already about 100-300 ms after stimulus onset. No such early effects were found for names. The results are discussed in terms of the time-course, functional localization, stimulus-specificity, and automatization of self-prioritization.

EEG theta and N400 responses to congruent versus incongruent brand logos

Neuroimaging and behavioral studies have shown that brands convey meaning to consumers. To investigate the immediate reactions of the brain to brand logos, followed either by congruent or incongruent pictorial brand-related cues, can deepen understanding of the semantic processing of brands, and perhaps how consolidated the logo is in consumers’ minds. Participants were exposed to different brand-related image sets, that were either congruent (a match between brand-related images and brand logo) or incongruent (a mismatch between brand-related images and brand logo) while having their brain signals recorded. Event-related potential and EEG time–frequency domain features were extracted from the signals of the target image (brand logo). The results showed significantly larger N400 peak and relative theta power increase for incongruent compared to congruent logos, which could be attributed to an error-monitoring process. Thus, we argue that brands are encoded deeply in consumers’ minds, and cognitive processing of mismatched (vs matched) brand logos is more difficult, leading to greater error monitoring. The results were mostly consistent with previous studies investigating semantic incongruences in the linguistic field. Therefore, the error-monitoring process could be extended beyond linguistic forms, for example to images and brands.

Social appropriateness perception of dynamic interactions

The current study explored the judgement of communicative appropriateness while processing a dialogue between two individuals. All stimuli were presented as audio-visual as well as audio-only vignettes and 24 young adults reported their social impression (appropriateness) of literal, blunt, sarcastic, and teasing statements. On average, teasing statements were rated as more appropriate when processing audiovisual statements compared to the audio-only version of a stimuli, while sarcastic statements were judged as less appropriate with additional visual information. These results indicate a rejection of the Tinge Hypothesis for audio-visual vignettes while confirming it for the reduced, audio-only counterparts. We also analyzed time-frequency EEG data of four frequency bands that have been related to language processing: alpha, beta, theta and low gamma. We found desynchronization in the alpha band literal versus nonliteral items, confirming the assumption that the alpha band reflects stimulus complexity. The analysis also revealed a power increase in the theta, beta and low gamma band, especially when comparing blunt and nonliteral statements in the audio-only condition. The time-frequency results corroborate the prominent role of the alpha and theta bands in language processing and offer new insights into the neural correlates of communicative appropriateness and social aspects of speech perception.

Alpha-to-beta- and gamma-band activity reflect predictive coding in affective visual processing

Processing of negative affective pictures typically leads to desynchronization of alpha-to-beta frequencies (ERD) and synchronization of gamma frequencies (ERS). Given that in predictive coding higher frequencies have been associated with prediction errors, while lower frequencies have been linked to expectations, we tested the hypothesis that alpha-to-beta ERD and gamma ERS induced by aversive pictures are associated with expectations and prediction errors, respectively. We recorded EEG while volunteers were involved in a probabilistically cued affective picture task using three different negative valences to produce expectations and prediction errors. Our data show that alpha-to-beta band activity after stimulus presentation was related to the expected valence of the stimulus as predicted by a cue. The absolute mismatch of the expected and actual valence, which denotes an absolute prediction error was related to increases in alpha, beta and gamma band activity. This demonstrates that top-down predictions and bottom-up prediction errors are represented in typical spectral patterns associated with affective picture processing. This study provides direct experimental evidence that negative affective picture processing can be described by neuronal predictive coding computations.

Causal roles of prefrontal cortex during spontaneous perceptual switching are determined by brain state dynamics

The prefrontal cortex (PFC) is thought to orchestrate cognitive dynamics. However, in tests of bistable visual perception, no direct evidence supporting such presumable causal roles of the PFC has been reported except for a recent work. Here, using a novel brain-state-dependent neural stimulation system, we identified causal effects on percept dynamics in three PFC activities—right frontal eye fields, dorsolateral PFC (DLPFC), and inferior frontal cortex (IFC). The causality is behaviourally detectable only when we track brain state dynamics and modulate the PFC activity in brain-state-/state-history-dependent manners. The behavioural effects are underpinned by transient neural changes in the brain state dynamics, and such neural effects are quantitatively explainable by structural transformations of the hypothetical energy landscapes. Moreover, these findings indicate distinct functions of the three PFC areas: in particular, the DLPFC enhances the integration of two PFC-active brain states, whereas IFC promotes the functional segregation between them. This work resolves the controversy over the PFC roles in spontaneous perceptual switching and underlines brain state dynamics in fine investigations of brain-behaviour causality.

A cube that seems to shift its spatial arrangement as you keep looking; the elegant silhouette of a pirouetting dancer, which starts to spin in the opposite direction the more you stare at it; an illustration that shows two profiles – or is it a vase? These optical illusions are examples of bistable visual perception. Beyond their entertaining aspect, they provide a way for scientists to explore the dynamics of human consciousness, and the neural regions involved in this process.

Some studies show that bistable visual perception is associated with the activation of the prefrontal cortex, a brain area involved in complex cognitive processes. However, it is unclear whether this region is required for the illusions to emerge. Some research has showed that even if sections of the prefrontal cortex are temporally deactivated, participants can still experience the illusions.

Instead, Takamitsu Watanabe proposes that bistable visual perception is a process tied to dynamic brain states – that is, that distinct regions of the prefontal cortex are required for this fluctuating visual awareness, depending on the state of the whole brain. Such causal link cannot be observed if brain activity is not tracked closely.

To investigate this, the brain states of 65 participants were recorded as individuals were experiencing the optical illusions; the activity of their various brain regions could therefore be mapped, and then areas of the prefrontal cortex could precisely be inhibited at the right time using transcranial magnetic stimulation. This revealed that, indeed, prefrontal cortex regions were necessary for bistable visual perception, but not in a simple way. Instead, which ones were required and when depended on activity dynamics taking place in the whole brain. Overall, these results indicate that monitoring brain states is necessary to better understand – and ultimately, control – the neural pathways underlying perception and behaviour.

EEG theta responses induced by emoji semantic violations

This study investigated emoji semantic processing by measuring changes in event-related electroencephalogram (EEG) power. The last segment of experimental sentences was designed as either words or emojis consistent or inconsistent with the sentential context. The results showed that incongruent emojis led to a conspicuous increase of theta power (4–7 Hz), while incongruent words induced a decrease. Furthermore, the theta power increase was observed at midfrontal, occipital and bilateral temporal lobes with emojis. This suggests a higher working memory load for monitoring errors, difficulty of form recognition and concept retrieval in emoji semantic processing. It implies different neuro-cognitive processes involved in the semantic processing of emojis and words.

Racial Ingroup Bias and Efficiency Consideration Influence Distributive Decisions: A Dynamic Analysis of Time Domain and Time Frequency

Although previous studies have demonstrated that identity had effect on justice norms and behavioral decisions, the neural mechanism of that effect remains unclear. In this study, the subjects made their distributive decisions on the trade-off between equity and efficiency among Chinese and foreign children and their scalp potentials were recorded. Behavioral results showed that efficiency consideration played an important part in the distribution task. Meanwhile, participants gave preferential treatment to same-race children. Relative to the distribution within ingroup children, the distribution involving outgroup children induced higher N170 amplitude. The distribution involving outgroup children also elicited weakened P300 amplitude and enhanced delta response than the distribution within ingroup children when subjects are facing the conflict between equality and efficiency. In other words, ingroup bias affected the neural process of the trade-off between equality and efficiency. The combination of time-domain and time-frequency analyses provided spatiotemporal and spectral results for a better understanding of racial ingroup favoritism on distributive justice.

The Effects of Dynamic and Static Emotional Facial Expressions of Humans and Their Avatars on the EEG: An ERP and ERD/ERS Study

This study aimed to examine whether the cortical processing of emotional faces is modulated by the computerization of face stimuli ("avatars") in a group of 25 healthy participants. Subjects were passively viewing 128 static and dynamic facial expressions of female and male actors and their respective avatars in neutral or fearful conditions. Event-related potentials (ERPs), as well as alpha and theta event-related synchronization and desynchronization (ERD/ERS), were derived from the EEG that was recorded during the task. All ERP features, except for the very early N100, differed in their response to avatar and actor faces. Whereas the N170 showed differences only for the neutral avatar condition, later potentials (N300 and LPP) differed in both emotional conditions (neutral and fear) and the presented agents (actor and avatar). In addition, we found that the avatar faces elicited significantly stronger reactions than the actor face for theta and alpha oscillations. Especially theta EEG frequencies responded specifically to visual emotional stimulation and were revealed to be sensitive to the emotional content of the face, whereas alpha frequency was modulated by all the stimulus types. We can conclude that the computerized avatar faces affect both, ERP components and ERD/ERS and evoke neural effects that are different from the ones elicited by real faces. This was true, although the avatars were replicas of the human faces and contained similar characteristics in their expression.

Time to Face Language: Embodied Mechanisms Underpin the Inception of Face-Related Meanings in the Human Brain

In construing meaning, the brain recruits multimodal (conceptual) systems and embodied (modality-specific) mechanisms. Yet, no consensus exists on how crucial the latter are for the inception of semantic distinctions. To address this issue, we combined electroencephalographic (EEG) and intracranial EEG (iEEG) to examine when nouns denoting facial body parts (FBPs) and nonFBPs are discriminated in face-processing and multimodal networks. First, FBP words increased N170 amplitude (a hallmark of early facial processing). Second, they triggered fast (~100 ms) activity boosts within the face-processing network, alongside later (~275 ms) effects in multimodal circuits. Third, iEEG recordings from face-processing hubs allowed decoding ~80% of items before 200 ms, while classification based on multimodal-network activity only surpassed ~70% after 250 ms. Finally, EEG and iEEG connectivity between both networks proved greater in early (0–200 ms) than later (200–400 ms) windows. Collectively, our findings indicate that, at least for some lexico-semantic categories, meaning is construed through fast reenactments of modality-specific experience.

Early-life education may help bolster declarative memory in old age, especially for women

Although declarative memory declines with age, sex and education might moderate these weaknesses. We investigated effects of sex and education on nonverbal declarative (recognition) memory in 704 older adults (aged 58-98, 0-17 years of education). Items were drawings of real and made-up objects. Age negatively impacted declarative memory, though this age effect was moderated by sex and object-type: it was steeper for males than females, but only for real objects. Education was positively associated with memory, but also interacted with sex and object-type: education benefited women more than men (countering the age effects, especially for women), and remembering real more than made-up objects. The findings suggest that nonverbal memory in older adults is associated negatively with age but positively with education; both effects are modulated by sex, and by whether learning relates to preexisting or new information. The study suggests downstream benefits from education, especially for girls.

The modulation of event-related alpha rhythm during the time course of anticipation

Anticipation is the ability to accurately predict future actions or events ahead of the act itself. When attempting to anticipate, researchers have identified that at least two broad sources of information are used: contextual information relating to the situation in question; and biological motion from postural cues. However, the neural correlates associated with the processing of these different sources of information across groups varying in expertise has yet to be examined empirically. We compared anticipation performance and electrophysiological activity in groups of expert (n = 12) and novice (n = 15) performers using a video-based task. Participants made anticipation judgements after being presented information under three conditions: contextual information only; kinematic information only; and both sources of information combined. The experts responded more accurately across all three conditions. Stronger alpha event-related desynchronization over occipital and frontocentral sites occurred in experts compared to the novices when anticipating. The experts relied on stronger preparatory attentional mechanisms when they processed contextual information. When kinematic information was available, the domain specific motor representations built up over many years of practice likely underpinned expertise. Our findings have implications for those interested in identifying and subsequently, enhancing the neural mechanisms involved in anticipation.

Directional coupling of slow and fast hippocampal gamma with neocortical alpha/beta oscillations in human episodic memory

Episodic memories hinge upon our ability to process a wide range of multisensory information and bind this information into a coherent, memorable representation. On a neural level, these 2 processes are thought to be supported by neocortical alpha/beta desynchronization and hippocampal theta/gamma synchronization, respectively. Intuitively, these 2 processes should couple to successfully create and retrieve episodic memories, yet this hypothesis has not been tested empirically. We address this by analyzing human intracranial electroencephalogram data recorded during 2 associative memory tasks. We find that neocortical alpha/beta (8 to 20 Hz) power decreases reliably precede and predict hippocampal "fast" gamma (60 to 80 Hz) power increases during episodic memory formation; during episodic memory retrieval, however, hippocampal "slow" gamma (40 to 50 Hz) power increases reliably precede and predict later neocortical alpha/beta power decreases. We speculate that this coupling reflects the flow of information from the neocortex to the hippocampus during memory formation, and hippocampal pattern completion inducing information reinstatement in the neocortex during memory retrieval.

Co-localization of theta-band activity and hemodynamic responses during face perception: simultaneous electroencephalography and functional near-infrared spectroscopy recordings

Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems. Using a multimodal imaging approach, including electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), simultaneous signals were acquired during face and object picture viewing. As expected for face processing, hemodynamic activity in the right occipital face area (OFA) increased during face viewing compared to object viewing, and in a subset of participants, the expected N170 EEG response was observed for faces. Based on recently reported associations between the theta band and visual processing, we hypothesized that increased hemodynamic activity in a face processing area would also be associated with greater theta-band activity originating in the same area. Consistent with our hypothesis, theta-band oscillations were also localized to the right OFA for faces, whereas alpha- and beta-band oscillations were not. Together, these findings suggest that theta-band oscillations originating in the OFA may be part of the distributed face-specific processing mechanism.

Alpha Oscillations during Incidental Encoding Predict Subsequent Memory for New "Foil" Information

People can employ adaptive strategies to increase the likelihood that previously encoded information will be successfully retrieved. One such strategy is to constrain retrieval toward relevant information by reimplementing the neurocognitive processes that were engaged during encoding. Using EEG, we examined the temporal dynamics with which constraining retrieval toward semantic versus nonsemantic information affects the processing of new “foil” information encountered during a memory test. Time–frequency analysis of EEG data acquired during an initial study phase revealed that semantic compared with nonsemantic processing was associated with alpha decreases in a left frontal electrode cluster from around 600 msec after stimulus onset. Successful encoding of semantic versus nonsemantic foils during a subsequent memory test was related to decreases in alpha oscillatory activity in the same left frontal electrode cluster, which emerged relatively late in the trial at around 1000–1600 msec after stimulus onset. Across participants, left frontal alpha power elicited by semantic processing during the study phase correlated significantly with left frontal alpha power associated with semantic foil encoding during the memory test. Furthermore, larger left frontal alpha power decreases elicited by semantic foil encoding during the memory test predicted better subsequent semantic foil recognition in an additional surprise foil memory test, although this effect did not reach significance. These findings indicate that constraining retrieval toward semantic information involves reimplementing semantic encoding operations that are mediated by alpha oscillations and that such reimplementation occurs at a late stage of memory retrieval, perhaps reflecting additional monitoring processes.

Brain Networks Related to Beta Oscillatory Activity during Episodic Memory Retrieval

Evidence from fMRI has consistently located a widespread network of frontal, parietal, and temporal lobe regions during episodic retrieval. However, the temporal limitations of the fMRI methodology have made it difficult to assess the transient network dynamics by which these distributed regions coordinate activity. Recent evidence suggests that beta oscillations (17-20 Hz) are important for top-down control for memory suppression. However, the spatial limitations of the EEG methodology make it difficult to assess the relationship between these oscillatory signals and the distributed networks identified with fMRI. This study used simultaneous EEG/fMRI to identify networks related to beta oscillations during episodic retrieval. Participants studied adjectives and either imagined a scene (Place Task) or judged its pleasantness (Pleasant Task). During the recognition test, participants decided which task was performed with each word ("Old Place Task" or "Old Pleasant Task") or "New." EEG results revealed that posterior beta power was greater for new than old words. fMRI results revealed activity in a frontal, parietal network that was greater for old than new words, consistent with prior studies. Although overall beta power increases correlated with decreased activity within a predominantly parietal network, within the right dorsolateral and ventrolateral pFC, beta power correlated with BOLD activity more under conditions requiring more cognitive control and EEG/fMRI effects in the right frontal cortex correlated with BOLD activity in a frontoparietal network. Therefore, using simultaneous EEG and fMRI, the present results suggest that beta oscillations are related to postretrieval control operations in the right frontal cortex and act within a broader postretrieval control network.

Analysis of functional brain connections for positive-negative emotions using phase locking value

In this study, we investigate the brain networks during positive and negative emotions for different types of stimulus (audio only, video only and audio + video) in [Formula: see text], and [Formula: see text] bands in terms of phase locking value, a nonlinear method to study functional connectivity. Results show notable hemispheric lateralization as phase synchronization values between channels are significant and high in right hemisphere for all emotions. Left frontal electrodes are also found to have control over emotion in terms of functional connectivity. Besides significant inter-hemisphere phase locking values are observed between left and right frontal regions, specifically between left anterior frontal and right mid-frontal, inferior-frontal and anterior frontal regions; and also between left and right mid frontal regions. ANOVA analysis for stimulus types show that stimulus types are not separable for emotions having high valence. PLV values are significantly different only for negative emotions or neutral emotions between audio only/video only and audio only/audio + video stimuli. Finding no significant difference between video only and audio + video stimuli is interesting and might be interpreted as that video content is the most effective part of a stimulus.

Age-related changes in neural oscillations supporting context memory retrieval

Recent evidence suggests that directing attention toward single item-context associations during encoding improves young and older adults' context memory performance and reduces demands on executive functions during retrieval. In everyday situations, there are many event features competing for our attention, and our ability to successfully recover those details may depend on our ability to ignore others. Failures of selective attention may contribute to older adults' context memory impairments. In the current electroencephalogram (EEG) study, we assessed the effects of age on processes supporting successful context memory retrieval of selectively attended features as indexed by neural oscillations. During encoding, young and older adults were directed to attend to a picture of an object and its relationship to one of two concurrently presented contextual details: a color or scene. At retrieval, we tested their memory for the object, its attended and unattended context features, and their confidence for both the attended and unattended features. Both groups showed greater memory for attended than unattended contextual features. However, older adults showed evidence of hyper-binding between attended and unattended context features while the young adults did not. EEG results in the theta band suggest that young and older adults recollect similar amounts of information but brain-behavior correlations suggest that this information was supportive of contextual memory performance, particularly for young adults. By contrast, sustained beta desynchronization, indicative of sensory reactivation and episodic reconstruction, was correlated with contextual memory performance for older adults only. We conclude that older adults' inhibition deficits during encoding reduced the selectivity of their contextual memories, which led to reliance on executive functions like episodic reconstruction to support successful memory retrieval.

Task-specific Aspects of Goal-directed Word Generation Identified via Simultaneous EEG–fMRI

Generating words according to a given rule relies on retrieval-related search and postretrieval control processes. Using fMRI, we recently characterized neural patterns of word generation in response to episodic, semantic, and phonemic cues by comparing free recall of wordlists, category fluency, and letter fluency [Shapira-Lichter, I., Oren, N., Jacob, Y., Gruberger, M., & Hendler, T. Portraying the unique contribution of the default mode network to internally driven mnemonic processes. Proceedings of the National Academy of Sciences, U.S.A., 110, 4950–4955, 2013]. Distinct selectivity for each condition was evident, representing discrete aspects of word generation-related memory retrieval. For example, the precuneus, implicated in processing spatiotemporal information, emerged as a key contributor to the episodic condition, which uniquely requires this information. Gamma band is known to play a central role in memory, and increased gamma power has been observed before word generation. Yet, gamma modulation in response to task demands has not been investigated. To capture the task-specific modulation of gamma power, we analyzed the EEG data recorded simultaneously with the aforementioned fMRI, focusing on the activity locked to and immediately preceding word articulation. Transient increases in gamma power were identified in a parietal electrode immediately before episodic and semantic word generation, however, within a different time frame relative to articulation. Gamma increases were followed by an alpha-theta decrease in the episodic condition, a gamma decrease in the semantic condition. This pattern indicates a task-specific modulation of the gamma signal corresponding to the specific demands of each word generation task. The gamma power and fMRI signal from the precuneus were correlated during the episodic condition, implying the existence of a common cognitive construct uniquely required for this task, possibly the reactivation or processing of spatiotemporal information.

The Temporal Signature of Memories: Identification of a General Mechanism for Dynamic Memory Replay in Humans

Reinstatement of dynamic memories requires the replay of neural patterns that unfold over time in a similar manner as during perception. However, little is known about the mechanisms that guide such a temporally structured replay in humans, because previous studies used either unsuitable methods or paradigms to address this question. Here, we overcome these limitations by developing a new analysis method to detect the replay of temporal patterns in a paradigm that requires participants to mentally replay short sound or video clips. We show that memory reinstatement is accompanied by a decrease of low-frequency (8 Hz) power, which carries a temporal phase signature of the replayed stimulus. These replay effects were evident in the visual as well as in the auditory domain and were localized to sensory-specific regions. These results suggest low-frequency phase to be a domain-general mechanism that orchestrates dynamic memory replay in humans.

Dysfunctional Patterns of Gamma-Band Activity in Response to Human Faces Compared to Non-Facial Stimuli in Patients with Schizophrenia

OBJECTIVE

Healthy individuals show stronger gamma-band activities (GBAs) for socially relevant stimuli (human faces) than for non-relevant ones. This study aimed to examine whether this gamma-band preference occurs in patients with schizophrenia.

METHODS

EEG was recorded for 24 patients with schizophrenia and 23 healthy controls while they viewed pictures of human faces, chairs, and nature scenes. The spectral powers of high-beta (20-30 Hz) and gamma (30-80 Hz) frequencies were analyzed along 3 midline cortical regions, and phase synchronization was calculated.

RESULTS

Compared to the response to non-facial stimuli, higher event related deactivation to facial stimuli was observed for the high-beta frequency across groups. For the gamma frequency, early-stage GBA was increased and late-stage GBA was decreased for all 3 stimuli in patients with schizophrenia compared to healthy controls. Preferential GBA patterns (100-200 and 200-300 ms) were found in healthy controls, but not in patients with schizophrenia. Significant correlation existed between negative symptoms and GBA in the frontal region for chair and scene stimuli. There was no significant intergroup difference in phase synchronization pattern.

CONCLUSION

Our results suggest that patients with schizophrenia have deficits in the preferential pattern of GBA for human faces and the deficits in the preferential pattern were mainly influenced by over-response to socially non-relevant stimuli.

Modulation of Alpha Oscillations in the Human EEG with Facial Preference

Facial preference that results from the processing of facial information plays an important role in social interactions as well as the selection of a mate, friend, candidate, or favorite actor. However, it still remains elusive which brain regions are implicated in the neural mechanisms underlying facial preference, and how neural activities in these regions are modulated during the formation of facial preference. In the present study, we investigated the modulation of electroencephalography (EEG) oscillatory power with facial preference. For the reliable assessments of facial preference, we designed a series of passive viewing and active choice tasks. In the former task, twenty-four face stimuli were passively viewed by participants for multiple times in random order. In the latter task, the same stimuli were then evaluated by participants for their facial preference judgments. In both tasks, significant differences between the preferred and non-preferred faces groups were found in alpha band power (8-13 Hz) but not in other frequency bands. The preferred faces generated more decreases in alpha power. During the passive viewing task, significant differences in alpha power between the preferred and non-preferred face groups were observed at the left frontal regions in the early (0.15-0.4 s) period during the 1-s presentation. By contrast, during the active choice task when participants consecutively watched the first and second face for 1 s and then selected the preferred one, an alpha power difference was found for the late (0.65-0.8 s) period over the whole brain during the first face presentation and over the posterior regions during the second face presentation. These results demonstrate that the modulation of alpha activity by facial preference is a top-down process, which requires additional cognitive resources to facilitate information processing of the preferred faces that capture more visual attention than the non-preferred faces.

Characterizing donation behavior from psychophysiological indices of narrative experience

Research on narrative persuasion has yet to investigate whether this process influences behavior. The current study explored whether: (1) a narrative could persuade participants to donate to a charity, a prosocial, behavioral decision; (2) psychophysiological metrics can delineate the differences between donation/non-donation behaviors; and (3) donation behavior can be correlated with measures of psychophysiology, self-reported reactions to the narrative, and intrinsic characteristics. Participants (n = 49) completed personality/disposition questionnaires, viewed one of two versions of a narrative while EEG and ECG were recorded, completed a questionnaire regarding their reactions to the narrative, and were given an opportunity to donate to a charity related to the themes of the narrative. Results showed that: (1) 34.7% of participants donated; (2) psychophysiological metrics successfully delineated between donation behaviors and the effects of narrative version; and (3) psychophysiology and reactions to the narrative were better able to explain the variance (88 and 65%, respectively) in the amount donated than all 3 metrics combined as well as any metric alone. These findings demonstrate the promise of narrative persuasion for influencing prosocial, behavioral decisions. Our results also illustrate the utility of the previously stated metrics for understanding and possibly even manipulating behaviors resulting from narrative persuasion.

Neural dynamics underlying attentional orienting to auditory representations in short-term memory

Sounds are ephemeral. Thus, coherent auditory perception depends on "hearing" back in time: retrospectively attending that which was lost externally but preserved in short-term memory (STM). Current theories of auditory attention assume that sound features are integrated into a perceptual object, that multiple objects can coexist in STM, and that attention can be deployed to an object in STM. Recording electroencephalography from humans, we tested these assumptions, elucidating feature-general and feature-specific neural correlates of auditory attention to STM. Alpha/beta oscillations and frontal and posterior event-related potentials indexed feature-general top-down attentional control to one of several coexisting auditory representations in STM. Particularly, task performance during attentional orienting was correlated with alpha/low-beta desynchronization (i.e., power suppression). However, attention to one feature could occur without simultaneous processing of the second feature of the representation. Therefore, auditory attention to memory relies on both feature-specific and feature-general neural dynamics.

When problem size matters: differential effects of brain stimulation on arithmetic problem solving and neural oscillations

The problem size effect is a well-established finding in arithmetic problem solving and is characterized by worse performance in problems with larger compared to smaller operand size. Solving small and large arithmetic problems has also been shown to involve different cognitive processes and distinct electroencephalography (EEG) oscillations over the left posterior parietal cortex (LPPC). In this study, we aimed to provide further evidence for these dissociations by using transcranial direct current stimulation (tDCS). Participants underwent anodal (30min, 1.5 mA, LPPC) and sham tDCS. After the stimulation, we recorded their neural activity using EEG while the participants solved small and large arithmetic problems. We found that the tDCS effects on performance and oscillatory activity critically depended on the problem size. While anodal tDCS improved response latencies in large arithmetic problems, it decreased solution rates in small arithmetic problems. Likewise, the lower-alpha desynchronization in large problems increased, whereas the theta synchronization in small problems decreased. These findings reveal that the LPPC is differentially involved in solving small and large arithmetic problems and demonstrate that the effects of brain stimulation strikingly differ depending on the involved neuro-cognitive processes.

High gamma oscillations in medial temporal lobe during overt production of speech and gestures

The study of the production of co-speech gestures (CSGs), i.e., meaningful hand movements that often accompany speech during everyday discourse, provides an important opportunity to investigate the integration of language, action, and memory because of the semantic overlap between gesture movements and speech content. Behavioral studies of CSGs and speech suggest that they have a common base in memory and predict that overt production of both speech and CSGs would be preceded by neural activity related to memory processes. However, to date the neural correlates and timing of CSG production are still largely unknown. In the current study, we addressed these questions with magnetoencephalography and a semantic association paradigm in which participants overtly produced speech or gesture responses that were either meaningfully related to a stimulus or not. Using spectral and beamforming analyses to investigate the neural activity preceding the responses, we found a desynchronization in the beta band (15-25 Hz), which originated 900 ms prior to the onset of speech and was localized to motor and somatosensory regions in the cortex and cerebellum, as well as right inferior frontal gyrus. Beta desynchronization is often seen as an indicator of motor processing and thus reflects motor activity related to the hand movements that gestures add to speech. Furthermore, our results show oscillations in the high gamma band (50-90 Hz), which originated 400 ms prior to speech onset and were localized to the left medial temporal lobe. High gamma oscillations have previously been found to be involved in memory processes and we thus interpret them to be related to contextual association of semantic information in memory. The results of our study show that high gamma oscillations in medial temporal cortex play an important role in the binding of information in human memory during speech and CSG production.

Face the hierarchy: ERP and oscillatory brain responses in social rank processing

Recognition of social hierarchy is a key feature that helps us navigate through our complex social environment. Neuroimaging studies have identified brain structures involved in the processing of hierarchical stimuli but the precise temporal dynamics of brain activity associated with such processing remains largely unknown. Here, we used electroencephalography to examine the effect of social hierarchy on neural responses elicited by faces. In contrast to previous studies, the key manipulation was that a hierarchical context was constructed, not by varying facial expressions, but by presenting neutral-expression faces in a game setting. Once the performance-based hierarchy was established, participants were presented with high-rank, middle-rank and low-rank player faces and had to evaluate the rank of each face with respect to their own position. Both event-related potentials and task-related oscillatory activity were investigated. Three main findings emerge from the study. First, the experimental manipulation had no effect on the early N170 component, which may suggest that hierarchy did not modulate the structural encoding of neutral-expression faces. Second, hierarchy significantly modulated the amplitude of the late positive potential (LPP) within a 400-700 ms time-window, with more a prominent LPP occurring when the participants processed the face of the highest-rank player. Third, high-rank faces were associated with the highest reduction of alpha power. Taken together these findings provide novel electrophysiological evidence for enhanced allocation of attentional resource in the presence of high-rank faces. At a broader level, this study brings new insights into the neural processing underlying social categorization.

Event-related alpha suppression in response to facial motion

While biological motion refers to both face and body movements, little is known about the visual perception of facial motion. We therefore examined alpha wave suppression as a reduction in power is thought to reflect visual activity, in addition to attentional reorienting and memory processes. Nineteen neurologically healthy adults were tested on their ability to discriminate between successive facial motion captures. These animations exhibited both rigid and non-rigid facial motion, as well as speech expressions. The structural and surface appearance of these facial animations did not differ, thus participants decisions were based solely on differences in facial movements. Upright, orientation-inverted and luminance-inverted facial stimuli were compared. At occipital and parieto-occipital regions, upright facial motion evoked a transient increase in alpha which was then followed by a significant reduction. This finding is discussed in terms of neural efficiency, gating mechanisms and neural synchronization. Moreover, there was no difference in the amount of alpha suppression evoked by each facial stimulus at occipital regions, suggesting early visual processing remains unaffected by manipulation paradigms. However, upright facial motion evoked greater suppression at parieto-occipital sites, and did so in the shortest latency. Increased activity within this region may reflect higher attentional reorienting to natural facial motion but also involvement of areas associated with the visual control of body effectors.

EEG theta and Mu oscillations during perception of human and robot actions

The perception of others' actions supports important skills such as communication, intention understanding, and empathy. Are mechanisms of action processing in the human brain specifically tuned to process biological agents? Humanoid robots can perform recognizable actions, but can look and move differently from humans, and as such, can be used in experiments to address such questions. Here, we recorded EEG as participants viewed actions performed by three agents. In the Human condition, the agent had biological appearance and motion. The other two conditions featured a state-of-the-art robot in two different appearances: Android, which had biological appearance but mechanical motion, and Robot, which had mechanical appearance and motion. We explored whether sensorimotor mu (8-13 Hz) and frontal theta (4-8 Hz) activity exhibited selectivity for biological entities, in particular for whether the visual appearance and/or the motion of the observed agent was biological. Sensorimotor mu suppression has been linked to the motor simulation aspect of action processing (and the human mirror neuron system, MNS), and frontal theta to semantic and memory-related aspects. For all three agents, action observation induced significant attenuation in the power of mu oscillations, with no difference between agents. Thus, mu suppression, considered an index of MNS activity, does not appear to be selective for biological agents. Observation of the Robot resulted in greater frontal theta activity compared to the Android and the Human, whereas the latter two did not differ from each other. Frontal theta thus appears to be sensitive to visual appearance, suggesting agents that are not sufficiently biological in appearance may result in greater memory processing demands for the observer. Studies combining robotics and neuroscience such as this one can allow us to explore neural basis of action processing on the one hand, and inform the design of social robots on the other.

A review of gamma oscillations in healthy subjects and in cognitive impairment

This review describes a wide range of functional correlates of gamma oscillations in whole-brain work, in neuroethology, sensory-cognitive dynamics, emotion, and cognitive impairment. This survey opens a new window towards understanding the brain's gamma activity. Gamma responses are selectively distributed in the whole brain, and do not reflect only a unique, specific function of the nervous system. Sensory responses from cortex, thalamus, hippocampus, and reticular formations in animal and human brains, and also cognitive responses, were described by several authors. According to reviewed results, it becomes obvious that cognitive disorders, and medication-which influence the transmitter release-change entirely the understanding of the big picture in cognitive processes. Gamma activity is evoked or induced by different sensory stimuli or cognitive tasks. Thus, it is argued that gamma-band synchronization is an elementary and fundamental process in whole-brain operation. In conclusion, reasoning and suggestions for understanding gamma activity are highlighted.

Electrophysiological correlates of processing own- and other-race faces

Most adults have more experience in identifying faces of their own race than in identifying faces from another race, and thus may be considered as own-race face experts. This effect was investigated by recording and analyzing ERPs as well as induced gamma oscillations. The race modulation occurred post the stage of structural processing revealed by N170. Larger P2 component and induced gamma activity for own-race than other-race faces could be associated with more elaborate processing on the basis of configural computation due to more experience that we have for own-race faces.

Why it's easier to remember seeing a face we already know than one we don't: preexisting memory representations facilitate memory formation

In two experiments, we provided support for the hypothesis that stimuli with preexisting memory representations (e.g., famous faces) are easier to associate to their encoding context than are stimuli that lack long-term memory representations (e.g., unknown faces). Subjects viewed faces superimposed on different backgrounds (e.g., the Eiffel Tower). Face recognition on a surprise memory test was better when the encoding background was reinstated than when it was swapped with a different background; however, the reinstatement advantage was modulated by how many faces had been seen with a given background, and reinstatement did not improve recognition for unknown faces. The follow-up experiment added a drug intervention that inhibited the ability to form new associations. Context reinstatement did not improve recognition for famous or unknown faces under the influence of the drug. The results suggest that it is easier to associate context to faces that have a preexisting long-term memory representation than to faces that do not.

Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis

The traditional belief is that brain oscillations are important for human long-term memory, because they induce synchronized firing between cell assemblies which shapes synaptic plasticity. Therefore, most prior studies focused on the role of synchronization for episodic memory, as reflected in theta (∼5 Hz) and gamma (>40 Hz) power increases. These studies, however, neglect the role that is played by neural desynchronization, which is usually reflected in power decreases in the alpha and beta frequency band (8-30 Hz). In this paper we present a first idea, derived from information theory that gives a mechanistic explanation of how neural desynchronization aids human memory encoding and retrieval. Thereby we will review current studies investigating the role of alpha and beta power decreases during long-term memory tasks and show that alpha and beta power decreases play an important and active role for human memory. Applying mathematical models of information theory, we demonstrate that neural desynchronization is positively related to the richness of information represented in the brain, thereby enabling encoding and retrieval of long-term memories. This information via desynchronization hypothesis makes several predictions, which can be tested in future experiments.

Behavioural and magnetoencephalographic evidence for the interaction between semantic and episodic memory in healthy elderly subjects

The relationship between episodic and semantic memory systems has long been debated. Some authors argue that episodic memory is contingent on semantic memory (Tulving 1984), while others postulate that both systems are independent since they can be selectively damaged (Squire 1987). The interaction between these memory systems is particularly important in the elderly, since the dissociation of episodic and semantic memory defects characterize different aging-related pathologies. Here, we investigated the interaction between semantic knowledge and episodic memory processes associated with faces in elderly subjects using an experimental paradigm where the semantic encoding of famous and unknown faces was compared to their episodic recognition. Results showed that the level of semantic awareness of items affected the recognition of those items in the episodic memory task. Event-related magnetic fields confirmed this interaction between episodic and semantic memory: ERFs related to the old/new effect during the episodic task were markedly different for famous and unknown faces. The old/new effect for famous faces involved sustained activities maximal over right temporal sensors, showing a spatio-temporal pattern partly similar to that found for famous versus unknown faces during the semantic task. By contrast, an old/new effect for unknown faces was observed on left parieto-occipital sensors. These findings suggest that the episodic memory for famous faces activated the retrieval of stored semantic information, whereas it was based on items' perceptual features for unknown faces. Overall, our results show that semantic information interfered markedly with episodic memory processes and suggested that the neural substrates of these two memory systems overlap.

A magnetoencephalographic study of face processing: M170, gamma-band oscillations and source localization

EEG studies suggested that the N170 ERP and Gamma-band responses to faces reflect early and later stages of a multiple-level face-perception mechanism, respectively. However, these conclusions should be considered cautiously because EEG-recorded Gamma may be contaminated by noncephalic activity such as microsaccades. Moreover, EEG studies of Gamma cannot easily reveal its intracranial sources. Here we recorded MEG rather than EEG, assessed the sources of the M170 and Gamma oscillations using beamformer, and explored the sensitivity of these neural manifestations to global, featural and configural information in faces. The M170 was larger in response to faces and face components than in response to watches. Scrambling the configuration of the inner components of the face even if presented without the face contour reduced and delayed the M170. The amplitude of MEG Gamma oscillations (30-70 Hz) was higher than baseline during an epoch between 230-570 ms from stimulus onset and was particularly sensitive to the configuration of the stimuli, regardless of their category. However, in the lower part of this frequency range (30-40 Hz) only physiognomic stimuli elevated the MEG above baseline. Both the M170 and Gamma were generated in a posterior-ventral network including the fusiform, inferior-occipital and lingual gyri, all in the right hemisphere. The generation of Gamma involved additional sources in the visual system, bilaterally. We suggest that the evoked M170 manifests a face-perception mechanism based on the global characteristics of face, whereas the induced Gamma oscillations are associated with the integration of visual input into a pre-existent coherent perceptual representation.

Induced gamma band responses in human EEG after the control of miniature saccadic artifacts

Induced gamma band responses (iGBRs) in the human electroencephalogram (EEG) have been ascribed to the activation of cortical object representations. Recently, this claim was challenged and it was stated that iGBRs occurring in the time window between 200 and 350 ms after stimulus onset are, to a great extent, generated by an electromyogenic artifact caused by miniature saccades (MS). In the present paper we focus on the characterization of iGBRs during the activation of cortical object representations, when recordings have been controlled for saccade-related transient potentials. For this we present an algorithm for the correction of saccade-related transient potentials (COSTRAP) which identifies and notably suppresses transient spike potentials (TSPs) that are likely to be linked to MSs. Furthermore, we conducted an EEG study to demonstrate (1) the feasibility of the algorithm, (2) the cortical origin iGBRs and (3) their relation to cortical object representations. Our results revealed that (i) it is possible to isolate TSPs, (ii) the morphology of the cleansed iGBR cannot be explained by an underlying myogenic artifact and (iii) the remaining iGBRs are sensitive to object recognition. Therefore we conclude that, with saccadic artifacts being controlled, high-frequency oscillations in human EEG are reliable electrophysiological correlates of cognitive processes.