The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity

Differentiating neural sensitivity and bias during face-emotion processing in youth: a computational approach

The ability to interpret face-emotion displays is critical for the development of adaptive social interactions. Using a novel variant of a computational model and fMRI data, we examined behavioral and neural associations between two metrics of face-emotion labeling (sensitivity and bias) and age in youth. Youth and adults (n = 44, M age = 20.02, s.d. = 7.44, range = 8-36) completed an explicit face-emotion labeling fMRI task including happy to angry morphed face emotions. A drift-diffusion model was applied to choice and reaction time distributions to examine sensitivity and bias in interpreting face emotions. Model fit and reliability of parameters were assessed on adult data (n = 42). Linear and quadratic slopes modeled brain activity associated with dimensions of face-emotion valence and ambiguity during interpretation. Behaviorally, age was associated with sensitivity. The bilateral anterior insula exhibited a more pronounced neural response to ambiguity with older age. Associations between sensitivity and bias metrics and activation patterns indicated that systems encoding face-emotion valence and ambiguity both contribute to the ability to discriminate face emotions. The current study provides evidence for age-related improvement in perceptual sensitivity to facial affect across adolescence and young adulthood.

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross-modal association of social audio-visual stimuli based on meaning

Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio-visual information is essential to the processing of species-specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross-modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio-visual processing of species-specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio-visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task-dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. SIGNIFICANCE STATEMENT: Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures-dorsolateral amygdala, claustrum and pulvinar-that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task-dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

Amygdala and cortical gamma-band responses to emotional faces are modulated by attention to valence

The amygdala might support an attentional bias for emotional faces. However, whether and how selective attention toward a specific valence modulates this bias is not fully understood. Likewise, it is unclear whether amygdala and cortical signals respond to emotion and attention in a similar way. We recorded gamma-band activity (GBA, > 30 Hz) intracranially in the amygdalae of 11 patients with epilepsy and collected scalp recordings from 19 healthy participants. We presented angry, neutral, and happy faces randomly, and we denoted one valence as the target. Participants detected happy targets most quickly and accurately. In the amygdala, during attention to negative faces, low gamma-band activity (LGBA, < 90 Hz) increased for angry compared with happy faces from 160 ms. From 220 ms onward, amygdala high gamma-band activity (HGBA, > 90 Hz) was higher for angry and neutral faces than for happy ones. Monitoring neutral faces increased amygdala HGBA for emotions compared with neutral faces from 40 ms. Expressions were not differentiated in GBA while monitoring positive faces. On the scalp, only threat monitoring resulted in expression differentiation. Here, posterior LGBA was increased selectively for angry targets from 60 ms. The data show that GBA differentiation of emotional expressions is modulated by attention to valence: Top-down-controlled threat vigilance coordinates widespread GBA in favor of angry faces. Stimulus-driven emotion differentiation in amygdala GBA occurs during a neutral attentional focus. These findings align with a multi-pathway model of emotion processing and specify the role of GBA in this process.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Encoding of Visual Objects in the Human Medial Temporal Lobe

The human medial temporal lobe (MTL) plays a crucial role in recognizing visual objects, a key cognitive function that relies on the formation of semantic representations. Nonetheless, it remains unknown how visual information of general objects is translated into semantic representations in the MTL. Furthermore, the debate about whether the human MTL is involved in perception has endured for a long time. To address these questions, we investigated three distinct models of neural object coding-semantic coding, axis-based feature coding, and region-based feature coding-in each subregion of the human MTL, using high-resolution fMRI in two male and six female participants. Our findings revealed the presence of semantic coding throughout the MTL, with a higher prevalence observed in the parahippocampal cortex (PHC) and perirhinal cortex (PRC), while axis coding and region coding were primarily observed in the earlier regions of the MTL. Moreover, we demonstrated that voxels exhibiting axis coding supported the transition to region coding and contained information relevant to semantic coding. Together, by providing a detailed characterization of neural object coding schemes and offering a comprehensive summary of visual coding information for each MTL subregion, our results not only emphasize a clear role of the MTL in perceptual processing but also shed light on the translation of perception-driven representations of visual features into memory-driven representations of semantics along the MTL processing pathway.

Individual differences in the evaluation of ambiguous visual and auditory threat-related expressions

This study investigated the neural correlates of the judgement of auditory and visual ambiguous threat-related information, and the influence of state anxiety on this process. Healthy subjects were scanned using a fast, high-resolution functional magnetic resonance imaging (fMRI) multiband sequence while they performed a two-alternative forced-choice emotion judgement task on faces and vocal utterances conveying explicit anger or fear, as well as ambiguous ones. Critically, the latter was specific to each subject, obtained through a morphing procedure and selected prior to scanning following a perceptual decision-making task. Behavioural results confirmed a greater task-difficulty for subject-specific ambiguous stimuli and also revealed a judgement bias for visual fear, and, to a lesser extent, for auditory anger. Imaging results showed increased activity in regions of the salience and frontoparietal control networks (FPCNs) and deactivation in areas of the default mode network for ambiguous, relative to explicit, expressions. In contrast, the right amygdala (AMG) responded more strongly to explicit stimuli. Interestingly, its response to the same ambiguous stimulus depended on the subjective judgement of the expression. Finally, we found that behavioural and neural differences between ambiguous and explicit expressions decreased as a function of state anxiety scores. Taken together, our results show that behavioural and brain responses to emotional expressions are determined not only by emotional clarity but also modality and the subjects' subjective perception of the emotion expressed, and that some of these responses are modulated by state anxiety levels.

Facing emotions: real-time fMRI-based neurofeedback using dynamic emotional faces to modulate amygdala activity

Introduction

Maladaptive functioning of the amygdala has been associated with impaired emotion regulation in affective disorders. Recent advances in real-time fMRI neurofeedback have successfully demonstrated the modulation of amygdala activity in healthy and psychiatric populations. In contrast to an abstract feedback representation applied in standard neurofeedback designs, we proposed a novel neurofeedback paradigm using naturalistic stimuli like human emotional faces as the feedback display where change in the facial expression intensity (from neutral to happy or from fearful to neutral) was coupled with the participant's ongoing bilateral amygdala activity.

Methods

The feasibility of this experimental approach was tested on 64 healthy participants who completed a single training session with four neurofeedback runs. Participants were assigned to one of the four experimental groups (n = 16 per group), i.e., happy-up, happy-down, fear-up, fear-down. Depending on the group assignment, they were either instructed to "try to make the face happier" by upregulating (happy-up) or downregulating (happy-down) the amygdala or to "try to make the face less fearful" by upregulating (fear-up) or downregulating (fear-down) the amygdala feedback signal.

Results

Linear mixed effect analyses revealed significant amygdala activity changes in the fear condition, specifically in the fear-down group with significant amygdala downregulation in the last two neurofeedback runs as compared to the first run. The happy-up and happy-down groups did not show significant amygdala activity changes over four runs. We did not observe significant improvement in the questionnaire scores and subsequent behavior. Furthermore, task-dependent effective connectivity changes between the amygdala, fusiform face area (FFA), and the medial orbitofrontal cortex (mOFC) were examined using dynamic causal modeling. The effective connectivity between FFA and the amygdala was significantly increased in the happy-up group (facilitatory effect) and decreased in the fear-down group. Notably, the amygdala was downregulated through an inhibitory mechanism mediated by mOFC during the first training run.

Discussion

In this feasibility study, we intended to address key neurofeedback processes like naturalistic facial stimuli, participant engagement in the task, bidirectional regulation, task congruence, and their influence on learning success. It demonstrated that such a versatile emotional face feedback paradigm can be tailored to target biased emotion processing in affective disorders.

Multimodal investigations of emotional face processing and social trait judgment of faces

Faces are among the most important visual stimuli that humans perceive in everyday life. While extensive literature has examined emotional processing and social evaluations of faces, most studies have examined either topic using unimodal approaches. In this review, we promote the use of multimodal cognitive neuroscience approaches to study these processes, using two lines of research as examples: ambiguity in facial expressions of emotion and social trait judgment of faces. In the first set of studies, we identified an event-related potential that signals emotion ambiguity using electroencephalography and we found convergent neural responses to emotion ambiguity using functional neuroimaging and single-neuron recordings. In the second set of studies, we discuss how different neuroimaging and personality-dimensional approaches together provide new insights into social trait judgments of faces. In both sets of studies, we provide an in-depth comparison between neurotypicals and people with autism spectrum disorder. We offer a computational account for the behavioral and neural markers of the different facial processing between the two groups. Finally, we suggest new practices for studying the emotional processing and social evaluations of faces. All data discussed in the case studies of this review are publicly available.

A uniform human multimodal dataset for emotion perception and judgment

Face perception is a fundamental aspect of human social interaction, yet most research on this topic has focused on single modalities and specific aspects of face perception. Here, we present a comprehensive multimodal dataset for examining facial emotion perception and judgment. This dataset includes EEG data from 97 unique neurotypical participants across 8 experiments, fMRI data from 19 neurotypical participants, single-neuron data from 16 neurosurgical patients (22 sessions), eye tracking data from 24 neurotypical participants, behavioral and eye tracking data from 18 participants with ASD and 15 matched controls, and behavioral data from 3 rare patients with focal bilateral amygdala lesions. Notably, participants from all modalities performed the same task. Overall, this multimodal dataset provides a comprehensive exploration of facial emotion perception, emphasizing the importance of integrating multiple modalities to gain a holistic understanding of this complex cognitive process. This dataset serves as a key missing link between human neuroimaging and neurophysiology literature, and facilitates the study of neuropsychiatric populations.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

Human and machine recognition of dynamic and static facial expressions: prototypicality, ambiguity, and complexity

A growing body of research suggests that movement aids facial expression recognition. However, less is known about the conditions under which the dynamic advantage occurs. The aim of this research was to test emotion recognition in static and dynamic facial expressions, thereby exploring the role of three featural parameters (prototypicality, ambiguity, and complexity) in human and machine analysis. In two studies, facial expression videos and corresponding images depicting the peak of the target and non-target emotion were presented to human observers and the machine classifier (FACET). Results revealed higher recognition rates for dynamic stimuli compared to non-target images. Such benefit disappeared in the context of target-emotion images which were similarly well (or even better) recognised than videos, and more prototypical, less ambiguous, and more complex in appearance than non-target images. While prototypicality and ambiguity exerted more predictive power in machine performance, complexity was more indicative of human emotion recognition. Interestingly, recognition performance by the machine was found to be superior to humans for both target and non-target images. Together, the findings point towards a compensatory role of dynamic information, particularly when static-based stimuli lack relevant features of the target emotion. Implications for research using automatic facial expression analysis (AFEA) are discussed.

Silence and its effects on the autonomic nervous system: A systematic review

This systematic review explores the influence of silence on the autonomic nervous system. The Polyvagal Theory has been used as a reference model to describe the autonomic nervous system by explaining its role in emotional regulation, social engagement, and adaptive physiological responses. PubMed, Scopus, PsycInfo, EMBASE, and Google Scholar were systematically searched up until July 2023 for relevant studies. The literature search yielded 511 results, and 37 studies were eventually included in this review. Silence affects the autonomic nervous system differently based on whether it is inner or outer silence. Inner silence enhances activity of the ventral vagus, favoring social engagement, and reducing sympathetic nervous system activity and physiological stress. Outer silence, conversely, can induce a heightened state of alertness, potentially triggering vagal brake removal and sympathetic nervous system activation, though with training, it can foster inner silence, preventing such activation. The autonomic nervous system response to silence can also be influenced by other factors such as context, familiarity with silence, presence and quality of outer noise, and empathy.

Single-neuron mechanisms of neural adaptation in the human temporal lobe

A central function of the human brain is to adapt to new situations based on past experience. Adaptation is reflected behaviorally by shorter reaction times to repeating or similar stimuli, and neurophysiologically by reduced neural activity in bulk-tissue measurements with fMRI or EEG. Several potential single-neuron mechanisms have been hypothesized to cause this reduction of activity at the macroscopic level. We here explore these mechanisms using an adaptation paradigm with visual stimuli bearing abstract semantic similarity. We recorded intracranial EEG (iEEG) simultaneously with spiking activity of single neurons in the medial temporal lobes of 25 neurosurgical patients. Recording from 4917 single neurons, we demonstrate that reduced event-related potentials in the macroscopic iEEG signal are associated with a sharpening of single-neuron tuning curves in the amygdala, but with an overall reduction of single-neuron activity in the hippocampus, entorhinal cortex, and parahippocampal cortex, consistent with fatiguing in these areas.

Conceptualisation of Uncertainty in Decision Neuroscience Research: Do We Really Know What Types of Uncertainties The Measured Neural Correlates Relate To?

In the article "What are neural correlates neural correlates of?" published in the journal BioSocieties, Gabriel Abend points out that neuroscientists cannot avoid philosophical questions concerning the conceptualization and operationalization of social-psychological phenomena they deal with at the physiological level. In this article, we build on Abend's thesis and, through a systematic literature review of decision neuroscience studies, test it with the example of the social-psychological phenomenon of uncertainty in decision making. In this paper, we provide an overview of studies that appropriately attempt to conceptualise uncertainty, and then use these studies to analyse papers looking for neural correlates of uncertainty. Based on a systematic review of studies, we investigate what types of uncertainty authors in the field of decision neuroscience address and define, what criteria they use to distinguish between these types, what problems are associated with their conceptualization, and whether the neural correlates of different types of uncertainty can be accurately identified. The paper concludes that, particularly in the economic context, a collaboration between the natural and social sciences works well, and neuroscience studies use economic conceptualizations of uncertainty that are further developed by sophisticated decision tasks. However, the paper also highlights problematic aspects that obscure the understanding of the phenomena under study. These include the lack of criteria for distinguishing between different types of phenomena, the unclear use of the general concept of uncertainty, and the confusion of phenomena or their erroneous synonymous use.

A context-dependent switch from sensing to feeling in the primate amygdala

The skin transmits affective signals that integrate into our social vocabulary. As the socio-affective aspects of touch are likely processed in the amygdala, we compare neural responses to social grooming and gentle airflow recorded from the amygdala and the primary somatosensory cortex of non-human primates. Neurons in the somatosensory cortex respond to both types of tactile stimuli. In the amygdala, however, neurons do not respond to individual grooming sweeps even though grooming elicits autonomic states indicative of positive affect. Instead, many show changes in baseline firing rates that persist throughout the grooming bout. Such baseline fluctuations are attributed to social context because the presence of the groomer alone can account for the observed changes in baseline activity. It appears, therefore, that during grooming, the amygdala stops responding to external inputs on a short timescale but remains responsive to social context (or the associated affective states) on longer time scales.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

Significance Statement

A large number of different brain regions participate in emotion processing. However, it remains elusive how these brain regions interact and coordinate with each other and collectively encode emotions, especially when the task requires orchestration between different brain areas. In this study, we employed multimodal approaches that well complemented each other to comprehensively study the neural mechanisms of emotion ambiguity. Our results provided a systematic understanding of the amygdala-PFC network underlying emotion ambiguity with fMRI-based connectivity, EEG coordination of cortical regions, synchronization of brain rhythms, directed information flow of the source signals, and latency of single-neuron responses. Our results further shed light on neuropsychiatric patients who have abnormal amygdala-PFC connectivity.

Investigating form and content of emotional and non-emotional laughing

As cold actions (i.e. actions devoid of an emotional content), also emotions are expressed with different vitality forms. For example, when an individual experiences a positive emotion, such as laughing as expression of happiness, this emotion can be conveyed to others by different intensities of face expressions and body postures. In the present study, we investigated whether the observation of emotions, expressed with different vitality forms, activates the same neural structures as those involved in cold action vitality forms processing. To this purpose, we carried out a functional magnetic resonance imaging study in which participants were tested in 2 conditions: emotional and non-emotional laughing both conveying different vitality forms. There are 3 main results. First, the observation of emotional and non-emotional laughing conveying different vitality forms activates the insula. Second, the observation of emotional laughing activates a series of subcortical structures known to be related to emotions. Furthermore, a region of interest analysis carried out in these structures reveals a significant modulation of the blood-oxygen-leveldependent (BOLD) signal during the processing of different vitality forms exclusively in the right amygdala, right anterior thalamus/hypothalamus, and periaqueductal gray. Third, in a subsequent electromyography study, we found a correlation between the zygomatic muscles activity and BOLD signal in the right amygdala only.

Encoding of Race Categories by Single Neurons in the Human Brain

Previous research has suggested that race-specific features are automatically processed during face perception, often with out-group faces treated categorically. Functional imaging has illuminated the hemodynamic correlates of this process, with fewer studies examining single-neuron responses. In the present experiment, epilepsy patients undergoing microwire recordings in preparation for surgical treatment were shown realistic computer-generated human faces, which they classified according to the emotional expression shown. Racial categories of the stimulus faces varied independently of the emotion shown, being irrelevant to the patients’ primary task. Nevertheless, we observed race-driven changes in neural firing rates in the amygdala, anterior cingulate cortex, and hippocampus. These responses were broadly distributed, with the firing rates of 28% of recorded neurons in the amygdala and 45% in the anterior cingulate cortex predicting one or more racial categories. Nearly equal proportions of neurons responded to White and Black faces (24% vs. 22% in the amygdala and 26% vs. 28% in the anterior cingulate cortex). A smaller fraction (12%) of race-responsive neurons in the hippocampus predicted only White faces. Our results imply a distributed representation of race in brain areas involved in affective judgments, decision making, and memory. They also support the hypothesis that race-specific cues are perceptually coded even when those cues are task-irrelevant.

A neuronal social trait space for first impressions in the human amygdala and hippocampus

People instantaneously evaluate faces with significant agreement on evaluations of social traits. However, the neural basis for such rapid spontaneous face evaluation remains largely unknown. Here, we recorded from 490 neurons in the human amygdala and hippocampus and found that the neuronal activity was associated with the geometry of a social trait space. We further investigated the temporal evolution and modulation on the social trait representation, and we employed encoding and decoding models to reveal the critical social traits for the trait space. We also recorded from another 938 neurons and replicated our findings using different social traits. Together, our results suggest that there exists a neuronal population code for a comprehensive social trait space in the human amygdala and hippocampus that underlies spontaneous first impressions. Changes in such neuronal social trait space may have implications for the abnormal processing of social information observed in some neurological and psychiatric disorders.

Subliminal Emotional Faces Elicit Predominantly Right-Lateralized Amygdala Activation: A Systematic Meta-Analysis of fMRI Studies

Prior research suggests that conscious face processing occurs preferentially in right hemisphere occipito-parietal regions. However, less is known about brain regions associated with non-conscious processing of faces, and whether a right-hemispheric dominance persists in line with specific affective responses. We aim to review the neural responses systematically, quantitatively, and qualitatively underlying subliminal face processing. PubMed was searched for Functional Magnetic Resonance Imaging (fMRI) publications assessing subliminal emotional face stimuli up to March 2022. Activation Likelihood Estimation (ALE) meta-analyses and narrative reviews were conducted on all studies that met ALE requirements. Risk of bias was assessed using the AXIS tool. In a meta-analysis of all 22 eligible studies (merging clinical and non-clinical populations, whole brain and region of interest analyses), bilateral amygdala activation was reported in the left (x = −19.2, y = 1.5, z = −17.1) in 59% of studies, and in the right (x = 24.4, y = −1.7, z = −17.4) in 68% of studies. In a second meta-analysis of non-clinical participants only (n = 18), bilateral amygdala was again reported in the left (x = −18, y = 3.9, z = −18.4) and right (x = 22.8, y = −0.9, z = −17.4) in 56% of studies for both clusters. In a final meta-analysis of whole-brain studies only (n=14), bilateral amygdala was also reported in the left (x = −20.2, y = 2.9, z = −17.2) in 64% of studies, and right (x = 24.2, y = −0.7, z = −17.8) in 71% of studies. The findings suggest that non-consciously detected emotional faces may influence amygdala activation, especially right-lateralized (a higher percentage of convergence in studies), which are integral for pre-conscious affect and long-term memory processing.

Mirror neurons 30 years later: implications and applications

Mirror neurons (MNs) were first described in a seminal paper in 1992 as a class of monkey premotor cells discharging during both action execution and observation. Despite their debated origin and function, recent studies in several species, from birds to humans, revealed that beyond MNs properly so called, a variety of cell types distributed among multiple motor, sensory, and emotional brain areas form a 'mirror mechanism' more complex and flexible than originally thought, which has an evolutionarily conserved role in social interaction. Here, we trace the current limits and envisage the future trends of this discovery, showing that it inspired translational research and the development of new neurorehabilitation approaches, and constitutes a point of no return in social and affective neuroscience.

A human single-neuron dataset for face perception

The human amygdala and hippocampus have long been associated with face perception. Here, we present a dataset of single-neuron activity in the human amygdala and hippocampus during face perception. We recorded 2082 neurons from the human amygdala and hippocampus when neurosurgical patients with intractable epilepsy performed a one-back task using natural face stimuli, which mimics natural face perception. Specifically, our data include (1) single-neuron activity from the amygdala (996 neurons) and hippocampus (1086 neurons), (2) eye movements (gaze position and pupil), (3) psychological assessment of the patients, and (4) social trait judgment ratings from a subset of patients and a large sample of participants from the general population. Together, our comprehensive dataset with a large population of neurons can facilitate multifaceted investigation of face perception with the highest spatial and temporal resolution currently available in humans.

Cortical-subcortical structural connections support transcranial magnetic stimulation engagement of the amygdala

The amygdala processes valenced stimuli, influences emotion, and exhibits aberrant activity across anxiety disorders, depression, and PTSD. Interventions modulating amygdala activity hold promise as transdiagnostic psychiatric treatments. In 45 healthy participants, we investigated whether transcranial magnetic stimulation (TMS) elicits indirect changes in amygdala activity when applied to ventrolateral prefrontal cortex (vlPFC), a region important for emotion regulation. Harnessing in-scanner interleaved TMS/functional MRI (fMRI), we reveal that vlPFC neurostimulation evoked acute and focal modulations of amygdala fMRI BOLD signal. Larger TMS-evoked changes in the amygdala were associated with higher fiber density in a vlPFC-amygdala white matter pathway when stimulating vlPFC but not an anatomical control, suggesting this pathway facilitated stimulation-induced communication between cortex and subcortex. This work provides evidence of amygdala engagement by TMS, highlighting stimulation of vlPFC-amygdala circuits as a candidate treatment for transdiagnostic psychopathology. More broadly, it indicates that targeting cortical-subcortical structural connections may enhance the impact of TMS on subcortical neural activity and, by extension, subcortex-subserved behaviors.

A Computational Probe into the Behavioral and Neural Markers of Atypical Facial Emotion Processing in Autism

Despite ample behavioral evidence of atypical facial emotion processing in individuals with autism spectrum disorder (ASD), the neural underpinnings of such behavioral heterogeneities remain unclear. Here, I have used brain-tissue mapped artificial neural network (ANN) models of primate vision to probe candidate neural and behavior markers of atypical facial emotion recognition in ASD at an image-by-image level. Interestingly, the image-level behavioral patterns of the ANNs better matched the neurotypical subjects 'behavior than those measured in ASD. This behavioral mismatch was most remarkable when the ANN behavior was decoded from units that correspond to the primate inferior temporal (IT) cortex. ANN-IT responses also explained a significant fraction of the image-level behavioral predictivity associated with neural activity in the human amygdala (from epileptic patients without ASD), strongly suggesting that the previously reported facial emotion intensity encodes in the human amygdala could be primarily driven by projections from the IT cortex. In sum, these results identify primate IT activity as a candidate neural marker and demonstrate how ANN models of vision can be used to generate neural circuit-level hypotheses and guide future human and nonhuman primate studies in autism.SIGNIFICANCE STATEMENT Moving beyond standard parametric approaches that predict behavior with high-level categorical descriptors of a stimulus (e.g., level of happiness/fear in a face image), in this study, I demonstrate how an image-level probe, using current deep-learning-based ANN models, allows identification of more diagnostic stimuli for autism spectrum disorder enabling the design of more powerful experiments. This study predicts that IT cortex activity is a key candidate neural marker of atypical facial emotion processing in people with ASD. Importantly, the results strongly suggest that ASD-related atypical facial emotion intensity encodes in the human amygdala could be primarily driven by projections from the IT cortex.

Face identity coding in the deep neural network and primate brain

A central challenge in face perception research is to understand how neurons encode face identities. This challenge has not been met largely due to the lack of simultaneous access to the entire face processing neural network and the lack of a comprehensive multifaceted model capable of characterizing a large number of facial features. Here, we addressed this challenge by conducting in silico experiments using a pre-trained face recognition deep neural network (DNN) with a diverse array of stimuli. We identified a subset of DNN units selective to face identities, and these identity-selective units demonstrated generalized discriminability to novel faces. Visualization and manipulation of the network revealed the importance of identity-selective units in face recognition. Importantly, using our monkey and human single-neuron recordings, we directly compared the response of artificial units with real primate neurons to the same stimuli and found that artificial units shared a similar representation of facial features as primate neurons. We also observed a region-based feature coding mechanism in DNN units as in human neurons. Together, by directly linking between artificial and primate neural systems, our results shed light on how the primate brain performs face recognition tasks.

Novel Cerebello-Amygdala Connections Provide Missing Link Between Cerebellum and Limbic System

The cerebellum is emerging as a powerful regulator of cognitive and affective processing and memory in both humans and animals and has been implicated in affective disorders. How the cerebellum supports affective function remains poorly understood. The short-latency (just a few milliseconds) functional connections that were identified between the cerebellum and amygdala—a structure crucial for the processing of emotion and valence—more than four decades ago raise the exciting, yet untested, possibility that a cerebellum-amygdala pathway communicates information important for emotion. The major hurdle in rigorously testing this possibility is the lack of knowledge about the anatomy and functional connectivity of this pathway. Our initial anatomical tracing studies in mice excluded the existence of a direct monosynaptic connection between the cerebellum and amygdala. Using transneuronal tracing techniques, we have identified a novel disynaptic circuit between the cerebellar output nuclei and the basolateral amygdala. This circuit recruits the understudied intralaminar thalamus as a node. Using ex vivo optophysiology and super-resolution microscopy, we provide the first evidence for the functionality of the pathway, thus offering a missing mechanistic link between the cerebellum and amygdala. This discovery provides a connectivity blueprint between the cerebellum and a key structure of the limbic system. As such, it is the requisite first step toward obtaining new knowledge about cerebellar function in emotion, thus fundamentally advancing understanding of the neurobiology of emotion, which is perturbed in mental and autism spectrum disorders.

Widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks

Social gaze interaction powerfully shapes interpersonal communication. However, compared with social perception, very little is known about the neuronal underpinnings of real-life social gaze interaction. Here, we studied a large number of neurons spanning four regions in primate prefrontal-amygdala networks and demonstrate robust single-cell foundations of interactive social gaze in the orbitofrontal, dorsomedial prefrontal, and anterior cingulate cortices, in addition to the amygdala. Many neurons in these areas exhibited high temporal heterogeneity for social discriminability, with a selectivity bias for looking at a conspecific compared with an object. Notably, a large proportion of neurons in each brain region parametrically tracked the gaze of self or other, providing substrates for social gaze monitoring. Furthermore, several neurons displayed selective encoding of mutual eye contact in an agent-specific manner. These findings provide evidence of widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks during social gaze interaction.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

Reduced Pupil Oscillation During Facial Emotion Judgment in People with Autism Spectrum Disorder

People with autism spectrum disorder (ASD) show abnormal face perception and emotion recognition. However, it remains largely unknown whether these differences are associated with abnormal physiological responses when viewing faces. In this study, we employed a sensitive emotion judgment task and conducted a detailed investigation of pupil dilation/constriction and oscillation in high-functioning adult participants with ASD and matched controls. We found that participants with ASD showed normal pupil constriction to faces; however, they demonstrated reduced pupil oscillation, which was independent of stimulus properties and participants' perception of the emotion. Together, our results have revealed an abnormal physiological response to faces in people with ASD, which may in turn be associated with impaired face perception previously found in many studies.

Orienting to fear under transient focal disruption of the human amygdala

Responding to threat is under strong survival pressure, promoting the evolution of systems highly optimized for the task. Though the amygdala is implicated in 'detecting' threat, its role in the action that immediately follows-'orienting'-remains unclear. Critical to mounting a targeted response, such early action requires speed, accuracy, and resilience optimally achieved through conserved, parsimonious, dedicated systems, insured against neural loss by a parallelized functional organization. These characteristics tend to conceal the underlying substrate not only from correlative methods but also from focal disruption over time scales long enough for compensatory adaptation to take place. In a study of six patients with intracranial electrodes temporarily implanted for the clinical evaluation of focal epilepsy, we investigated gaze orienting to fear during focal, transient, unilateral direct electrical disruption of the amygdala. We showed that the amygdala is necessary for rapid gaze shifts towards faces presented in the contralateral hemifield regardless of their emotional expression, establishing its functional lateralization. Behaviourally dissociating the location of presented fear from the direction of the response, we implicated the amygdala not only in detecting contralateral faces, but also in automatically orienting specifically towards fearful ones. This salience-specific role was demonstrated within a drift-diffusion model of action to manifest as an orientation bias towards the location of potential threat. Pixel-wise analysis of target facial morphology revealed scleral exposure as its primary driver, and induced gamma oscillations-obtained from intracranial local field potentials-as its time-locked electrophysiological correlate. The amygdala is here reconceptualized as a functionally lateralized instrument of early action, reconciling previous conflicting accounts confined to detection, and revealing a neural organisation analogous to the superior colliculus, with which it is phylogenetically kin. Greater clarity on its role has the potential to guide therapeutic resection, still frequently complicated by impairments of cognition and behaviour related to threat, and inform novel focal stimulation techniques for the management of neuropsychiatric conditions.

Task Modulation of Single-Neuron Activity in the Human Amygdala and Hippocampus

The human amygdala and hippocampus are critically involved in various processes in face perception. However, it remains unclear how task demands or evaluative contexts modulate processes underlying face perception. In this study, we employed two task instructions when participants viewed the same faces and recorded single-neuron activity from the human amygdala and hippocampus. We comprehensively analyzed task modulation for three key aspects of face processing and we found that neurons in the amygdala and hippocampus (1) encoded high-level social traits such as perceived facial trustworthiness and dominance and this response was modulated by task instructions; (2) encoded low-level facial features and demonstrated region-based feature coding, which was not modulated by task instructions; and (3) encoded fixations on salient face parts such as the eyes and mouth, which was not modulated by task instructions. Together, our results provide a comprehensive survey of task modulation of neural processes underlying face perception at the single-neuron level in the human amygdala and hippocampus.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

Theory of mind and facial emotion recognition in adults with temporal lobe epilepsy: A meta-analysis

BACKGROUND

Mounting studies have investigated impairments in social cognitive domains (including theory of mind [ToM] and facial emotion recognition [FER] in adult patients with temporal lobe epilepsy (TLE). However, to date, inconsistent findings remain.

METHODS

A search of PubMed, Web of Science, and Embase databases was conducted until December 2021. Hedges g effect sizes were computed with a random-effects model. Meta-regressions were used to assess the potential confounding factors of between-study variability in effect sizes.

RESULTS

The meta-analysis included 41 studies, with a combined sample of 1,749 adult patients with TLE and 1,324 healthy controls (HCs). Relative to HCs, adult patients with TLE showed large impairments in ToM (g = -0.92) and cognitive ToM (g = -0.92), followed by medium impairments in affective ToM (g = -0.79) and FER (g = -0.77). Besides, no (statistically) significant differences were observed between the magnitude of social cognition impairment in adult with TLE who underwent and those who did not undergo epilepsy surgery. Meta-regressions exhibited that greater severity of executive functioning was associated with more severe ToM defects, and older age was associated with more severe FER defects.

CONCLUSIONS

Results of this meta-analysis suggest that adult patients with TLE show differential impairments in the core aspects of social cognitive domains (including ToM and FER), which may help in planning individualized treatment with appropriate cognitive and behavioral interventions.

The efficacy and safety of Jin's three-needle therapy vs. placebo acupuncture on anxiety symptoms in patients with post-stroke anxiety: A study protocol for a randomized controlled trial

BACKGROUND

A large number of clinical RCTs have verified that Jin's three-needle therapy (JTNT) has a great contribution to promoting the function of paralyzed limbs and relieving anxiety disorders for patients with post-stroke anxiety (PSA). However, there is still a lack of sham needle control, and its placebo effect cannot be ruled out. This study firstly verifies the real effectiveness of JTNT. Besides, the changes in serum indexes on the hypothalamic-pituitary-adrenal axis (HPA axis) are observed dynamically by the Enzyme-Linked ImmunoSorbent Assay (ELISA). The activation of different brain regions by JTNT is recorded using resting functional magnetic resonance imaging (rs-fMRI). Therefore, we can provide more practical and powerful evidence-based medical evidence for clinical decisions.

METHOD

This is a 16 week parallel, single-blind, random, controlled trial, including baseline, 4 weeks of treatment, and 12 weeks of follow-up. A total of 114 participants will be randomly divided into three groups in the proportion of 1:1:1. Participants will receive Jin's three-needle therapy in the active acupuncture group and accept sham needle treatment in the sham acupuncture group. In the waitlist control group, patients will not receive any acupuncture treatment. Outcomes cover three types of indicators, including scale indicators, serum indicators, and imaging indicators. The primary outcome is the change in the performance of anxiety symptoms, which is estimated by the 14-item Hamilton Anxiety Rating Scale (HAMA-14) and the 7-item Generalized Anxiety Disorder scale (GAD-7). Secondary outcomes are physical recovery and daily quality of life, which are evaluated by the National Institute of Health stroke scale (NIHSS) and the Modified Barthel Index Score (MBI Scale). Therefore, the assessment of the scale is carried out at baseline, 2nd, 4th, 8, 12, and 16 weeks. Adrenocorticotropin and cortisol will be quantitatively detected by ELISA at baseline and 4 weeks after treatment. In addition, regional homogeneity analysis (ReHo) will be used to record the activity of brain regions at baseline and 4 weeks after intervention.

DISCUSSION

The study aims to provide high-quality clinical evidence on the effectiveness and safety of JTNT for patients with PSA. In addition, this trial explores a possible mechanism of JTNT for patients with PSA.

CLINICAL TRIAL REGISTRATION

Chinese Clinical Trial Registry, identifier [ChiCTR2200058992].

Encoding of facial features by single neurons in the human amygdala and hippocampus

Faces are salient social stimuli that attract a stereotypical pattern of eye movement. The human amygdala and hippocampus are involved in various aspects of face processing; however, it remains unclear how they encode the content of fixations when viewing faces. To answer this question, we employed single-neuron recordings with simultaneous eye tracking when participants viewed natural face stimuli. We found a class of neurons in the human amygdala and hippocampus that encoded salient facial features such as the eyes and mouth. With a control experiment using non-face stimuli, we further showed that feature selectivity was specific to faces. We also found another population of neurons that differentiated saccades to the eyes vs. the mouth. Population decoding confirmed our results and further revealed the temporal dynamics of face feature coding. Interestingly, we found that the amygdala and hippocampus played different roles in encoding facial features. Lastly, we revealed two functional roles of feature-selective neurons: 1) they encoded the salient region for face recognition, and 2) they were related to perceived social trait judgments. Together, our results link eye movement with neural face processing and provide important mechanistic insights for human face perception.

Perigenual and Subgenual Anterior Cingulate Afferents Converge on Common Pyramidal Cells in Amygdala Subregions of the Macaque

The subgenual (sgACC) and perigenual (pgACC) anterior cingulate are important afferents of the amygdala, with different cytoarchitecture, connectivity, and function. The sgACC is associated with arousal mechanisms linked to salient cues, whereas the pgACC is engaged in conflict decision-making, including in social contexts. After placing same-size, small volume tracer injections into sgACC and pgACC of the same hemisphere in male macaques, we examined anterogradely labeled fiber distribution to understand how these different functional systems communicate in the main amygdala nuclei at both mesocopic and cellular levels. The sgACC has broad-based termination patterns. In contrast, the pgACC has a more restricted pattern, which was always nested in sgACC terminals. Terminal overlap occurred in subregions of the accessory basal and basal nuclei, which we termed "hotspots." In triple-labeling confocal studies, the majority of randomly selected CaMKIIα-positive cells (putative amygdala glutamatergic neurons) in hotspots received dual contacts from the sgACC and pgACC. The ratio of dual contacts occurred over a surprisingly narrow range, suggesting a consistent, tight balance of afferent contacts on postsynaptic neurons. Large boutons, which are associated with greater synaptic strength, were ∼3 times more frequent on sgACC versus pgACC axon terminals in hotspots, consistent with a fast "driver" function. Together, the results reveal a nested interaction in which pgACC ("conflict/social monitoring") terminals converge with the broader sgACC ("salience") terminals at both the mesoscopic and cellular level. The presynaptic organization in hotspots suggests that shifts in arousal states can rapidly and flexibly influence decision-making functions in the amygdala.SIGNIFICANCE STATEMENT The subgenual (sgACC) and perigenual cingulate (pgACC) have distinct structural and functional characteristics and are important afferent modulators of the amygdala. The sgACC is critical for arousal, whereas the pgACC mediates conflict-monitoring, including in social contexts. Using dual tracer injections in the same monkey, we found that sgACC inputs broadly project in the main amygdala nuclei, whereas pgACC inputs were more restricted and nested in zones containing sgACC terminals (hotspots). The majority of CaMKIIα + (excitatory) amygdala neurons in hotspots received converging contacts, which were tightly balanced. pgACC and sgACC afferent streams are therefore highly interdependent in these specific amygdala subregions, permitting "internal arousal" states to rapidly shape responses of amygdala neurons involved in conflict and social monitoring networks.

BNCPL: Brain-Network-based Convolutional Prototype Learning for Discriminating Depressive Disorders

Deep learning has shown great potential to adaptively learn hidden patterns from high dimensional neuroimaging data, so as to extract subtle group differences. Motivated by the convolutional neural networks and prototype learning, we developed a brain-network-based convolutional prototype learning model (BNCPL), which can learn representations that simultaneously maximize inter-class separation while minimize within-class distance. When applying BNCPL to distinguish 208 depressive disorders from 210 healthy controls using resting-state functional connectivity (FC), we achieved an accuracy of 71.0% in multi-site pooling classification (3 sites), with 2.4-7.2% accuracy increase compared to 3 traditional classifiers and 2 alternative deep neural networks. Saliency map was also used to examine the most discriminative FCs learned by the model; the prefrontal-subcortical circuits were identified, which were also correlated with disease severity and cognitive ability. In summary, by integrating convolutional prototype learning and saliency map, we improved both the model interpretability and classification performance, and found that the dysregulation of the functional prefrontal-subcortical circuit may play a pivotal role in discriminating depressive disorders from healthy controls.

The neuroscience of emotional disorders

Emotions can be defined as states elicited by rewards or punishments, and indeed the neurology of emotional disorders can be understood in terms of this foundation. The orbitofrontal cortex in humans and other primates is a critical area in emotion processing, determining the value of stimuli and whether they are rewarding or nonrewarding. The cortical processing that occurs before the orbitofrontal cortex primarily involves defining the identity of stimuli, i.e., "what" is present and not reward value. There is evidence that this holds true for taste, visual, somatosensory, and olfactory stimuli. The human medial orbitofrontal cortex is important in processing many different types of reward, and the lateral orbitofrontal cortex in processing nonreward and punishment. Humans with damage to the orbitofrontal cortex have an impaired ability to identify facial and voice expressions of emotions, and impaired subjective experience of emotion. They can have an altered personality and be impulsive because they are impaired at processing failures to receive expected rewards and at processing punishments. In humans, the role of the amygdala in the processing of emotions is reduced because of the great evolutionary development of the orbitofrontal cortex: amygdala damage has much less effect on emotion than does orbitofrontal cortex damage. The orbitofrontal cortex projects reward value information to the anterior cingulate cortex, which is involved in learning those actions required to obtain rewards and avoid punishments. The cingulate cortex thus provides an output route for emotional behavior. In depression, the medial orbitofrontal cortex has decreased connectivity and sensitivity to reward, and the lateral orbitofrontal cortex has increased connectivity and sensitivity to nonreward. The orbitofrontal cortex has major projections to the anterior cingulate cortex, including its subcommissural region, and the anterior cingulate cortex is also implicated in depression.

Toward a holistic view of value and social processing in the amygdala: Insights from primate behavioral neurophysiology

Located medially within the temporal lobes, the amygdala is a formation of heterogenous nuclei that has emerged as a target for investigations into the neural bases of both primitive and complex behaviors. Although modern neuroscience has eschewed the practice of assigning broad functions to distinct brain regions, the amygdala has classically been associated with regulating negative emotional processes (such as fear or aggression), primarily through research performed in rodent models. Contemporary studies, particularly those in non-human primate models, have provided evidence for a role of the amygdala in other aspects of cognition such as valuation of stimuli or shaping social behaviors. Consequently, many modern perspectives now also emphasize the amygdala's role in processing positive affect and social behaviors. Importantly, several recent experiments have examined the intersection of two seemingly autonomous domains; how both valence/value and social stimuli are simultaneously represented in the amygdala. Results from these studies suggest that there is an overlap between valence/value processing and the processing of social behaviors at the level of single neurons. These findings have prompted researchers investigating the neurophysiological mechanisms underlying social interactions to question what contributions reward-related processes in the amygdala make in shaping social behaviors. In this review, we will examine evidence, primarily from primate neurophysiology, suggesting that value-related processes in the amygdala interact with the processing of social stimuli, and explore holistic hypotheses about how these amygdalar interactions might be instantiated.

Levels of naturalism in social neuroscience research

In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.

A short review on emotion processing: a lateralized network of neuronal networks

Emotions are valenced mental responses and associated physiological reactions that occur spontaneously and automatically in response to internal or external stimuli, and can influence our behavior, and can themselves be modulated to a certain degree voluntarily or by external stimuli. They are subserved by large-scale integrated neuronal networks with epicenters in the amygdala and the hippocampus, and which overlap in the anterior cingulate cortex. Although emotion processing is accepted as being lateralized, the specific role of each hemisphere remains an issue of controversy, and two major hypotheses have been proposed. In the right-hemispheric dominance hypothesis, all emotions are thought to be processed in the right hemisphere, independent of their valence or of the emotional feeling being processed. In the valence lateralization hypothesis, the left is thought to be dominant for the processing of positively valenced stimuli, or of stimuli inducing approach behaviors, whereas negatively valenced stimuli, or stimuli inducing withdrawal behaviors, would be processed in the right hemisphere. More recent research points at the existence of multiple interrelated networks, each associated with the processing of a specific component of emotion generation, i.e., its generation, perception, and regulation. It has thus been proposed to move from hypotheses supporting an overall hemispheric specialization for emotion processing toward dynamic models incorporating multiple interrelated networks which do not necessarily share the same lateralization patterns.

How Our Caregivers Shape Who We Are: The Seven Dimensions of Attachment at the Core of Personality

Psychology defines personality as the stable traits of an individual, and cognitive research suggests that a set of core beliefs is at the root of these traits. From this perspective, two major questions remain unanswered: (1) What are the core beliefs that make up personality? (2) How are they acquired? An interesting answer is provided by attachment theory, according to which attachment is at the basis of personality. The current theoretical formulation, however, does not sufficiently clarify the relationship between the two. Adopting a cognitive-clinical approach, we put forward a novel version of attachment theory, arguing that it can better account for the relationship between attachment and personality, thereby providing more convincing answers to questions (1) and (2). In particular, we propose that: (A) attachment information is acquired over seven dimensions; (B) the acquisition of each dimension is induced by a specific caregiving feature and (C) realized through a specific acquisition mechanism - imprinting. In a nutshell, we propose an Attachment-Personality Model (APM) according to which seven attachment dimensions constitute the knowledge core of personality. We finally discuss the significant implications of the model, especially its clinical application in terms of conception, assessment, and treatment of mental disorders. The model can be empirically tested, and we suggest three ways to do that.

Better the devil you know than the devil you don't: Neural processing of risk and ambiguity

Risk and ambiguity are inherent in virtually all human decision-making. Risk refers to a situation in which we know the precise probability of potential outcomes of each option, whereas ambiguity refers to a situation in which outcome probabilities are not known. A large body of research has shown that individuals prefer known risks to ambiguity, a phenomenon known as ambiguity aversion. One heated debate concerns whether risky and ambiguous decisions rely on the same or distinct neural circuits. In the current meta-analyses, we integrated the results of neuroimaging research on decision-making under risk (n = 69) and ambiguity (n = 31). Our results showed that both processing of risk and ambiguity showed convergence in anterior insula, indicating a key role of anterior insula in encoding uncertainty. Risk additionally engaged dorsomedial prefrontal cortex (dmPFC) and ventral striatum, whereas ambiguity specifically recruited the dorsolateral prefrontal cortex (dlPFC), inferior parietal lobe (IPL) and right anterior insula. Our findings demonstrate overlapping and distinct neural substrates underlying different types of uncertainty, guiding future neuroimaging research on risk-taking and ambiguity aversion.

HOG-ESRs Face Emotion Recognition Algorithm Based on HOG Feature and ESRs Method

As we all know, there are many ways to express emotions. Among them, facial emotion recognition, which is widely used in human–computer interaction, psychoanalysis of mental patients, multimedia retrieval, and other fields, is still a challenging task. At present, although convolutional neural network has achieved great success in face emotion recognition algorithms, it has a rising space in effective feature extraction and recognition accuracy. According to a large number of literature studies, histogram of oriented gradient (HOG) can effectively extract face features, and ensemble methods can effectively improve the accuracy and robustness of the algorithm. Therefore, this paper proposes a new algorithm, HOG-ESRs, which improves the traditional ensemble methods to the ensembles with shared representations (ESRs) method, effectively reducing the residual generalization error, and then combining HOG features with ESRs. The experimental results on the FER2013 dataset show that the new algorithm can not only effectively extract features and reduce the residual generalization error, but also improve the accuracy and robustness of the algorithm, the purpose of the study being achieved. The application of HOG-ESRs in facial emotion recognition is helpful to solve the symmetry of edge detection and the deficiency of related methods in an outdoor lighting environment.

Social processing by the primate medial frontal cortex

The primate medial frontal cortex is comprised of several brain regions that are consistently implicated in regulating complex social behaviors. The medial frontal cortex is also critically involved in many non-social behaviors, such as those involved in reward, affective, and decision-making processes, broadly implicating the fundamental role of the medial frontal cortex in internally guided cognition. An essential question therefore is what unique contributions, if any, does the medial frontal cortex make to social behaviors? In this chapter, we outline several neural algorithms necessary for mediating adaptive social interactions and discuss selected evidence from behavioral neurophysiology experiments supporting the role of the medial frontal cortex in implementing these algorithms. By doing so, we primarily focus on research in nonhuman primates and examine several key attributes of the medial frontal cortex. Specifically, we review neuronal substrates in the medial frontal cortex uniquely suitable for enabling social monitoring, observational and vicarious learning, as well as predicting the behaviors of social partners. Moreover, by utilizing the three levels of organization in information processing systems proposed by Marr (1982) and recently adapted by Lockwood, Apps, and Chang (2020) for social information processing, we survey selected social functions of the medial frontal cortex through the lens of socially relevant algorithms and implementations. Overall, this chapter provides a broad overview of the behavioral neurophysiology literature endorsing the importance of socially relevant neural algorithms implemented by the primate medial frontal cortex for regulating social interactions.

Prefrontal-amygdala circuits in social decision-making

An increasing amount of research effort is being directed toward investigating the neural bases of social cognition from a systems neuroscience perspective. Evidence from multiple animal species is beginning to provide a mechanistic understanding of the substrates of social behaviors at multiple levels of neurobiology, ranging from those underlying high-level social constructs in humans and their more rudimentary underpinnings in monkeys to circuit-level and cell-type-specific instantiations of social behaviors in rodents. Here we review literature examining the neural mechanisms of social decision-making in humans, non-human primates and rodents, focusing on the amygdala and the medial and orbital prefrontal cortical regions and their functional interactions. We also discuss how the neuropeptide oxytocin impacts these circuits and their downstream effects on social behaviors. Overall, we conclude that regulated interactions of neuronal activity in the prefrontal-amygdala pathways critically contribute to social decision-making in the brains of primates and rodents.

Effect of Electroacupuncture on Pain Perception and Pain-Related Affection: Dissociation or Interaction Based on the Anterior Cingulate Cortex and S1

Electroacupuncture (EA) can effectively modulate pain perception and pain-related negative affect; however, we do not know whether the effect of EA on sensation and affect is parallel, or dissociated, interactional. In this study, we observed the effects of the anterior cingulate cortex (ACC) lesion and the primary somatosensory cortex (S1) activation on pain perception, pain-related affection, and neural oscillation in S1. ACC lesions did not affect pain perception but relieved pain-paired aversion. S1 activation increased pain perception and anxious behavior. EA can mitigate pain perception regardless of whether there is an ACC lesion. Chronic pain may increase the delta and theta band oscillatory activity in the S1 brain region and decrease the oscillatory activity in the alpha, beta, and gamma bands. EA intervention may inhibit the oscillatory activity of the alpha and beta bands. These results suggest that EA may mitigate chronic pain by relieving pain perception and reducing pain-related affection through different mechanisms. This evidence builds upon findings from previous studies of chronic pain and EA treatment.

Identification of White Matter Networks Engaged in Object (Face) Recognition Showing Differential Responses to Modulated Stimulus Strength

Blood-oxygenation-level-dependent (BOLD) signals in magnetic resonance imaging indirectly reflect neural activity in cortex, but they are also detectable in white matter (WM). BOLD signals in WM exhibit strong correlations with those in gray matter (GM) in a resting state, but their interpretation and relationship to GM activity in a task are unclear. We performed a parametric visual object recognition task designed to modulate the BOLD signal response in GM regions engaged in higher order visual processing, and measured corresponding changes in specific WM tracts. Human faces embedded in different levels of random noise have previously been shown to produce graded changes in BOLD activation in for example, the fusiform gyrus, as well as in electrophysiological (N170) evoked potentials. The magnitudes of BOLD responses in both GM regions and selected WM tracts varied monotonically with the stimulus strength (noise level). In addition, the magnitudes and temporal profiles of signals in GM and WM regions involved in the task coupled strongly across different task parameters. These findings reveal the network of WM tracts engaged in object (face) recognition and confirm that WM BOLD signals may be directly affected by neural activity in GM regions to which they connect.

A Flexible Neural Representation of Faces in the Human Brain

An important question in human face perception research is to understand whether the neural representation of faces is dynamically modulated by context. In particular, although there is a plethora of neuroimaging literature that has probed the neural representation of faces, few studies have investigated what low-level structural and textural facial features parametrically drive neural responses to faces and whether the representation of these features is modulated by the task. To answer these questions, we employed 2 task instructions when participants viewed the same faces. We first identified brain regions that parametrically encoded high-level social traits such as perceived facial trustworthiness and dominance, and we showed that these brain regions were modulated by task instructions. We then employed a data-driven computational face model with parametrically generated faces and identified brain regions that encoded low-level variation in the faces (shape and skin texture) that drove neural responses. We further analyzed the evolution of the neural feature vectors along the visual processing stream and visualized and explained these feature vectors. Together, our results showed a flexible neural representation of faces for both low-level features and high-level social traits in the human brain.

Multicentric evidence of emotional impairments in hypertensive heart disease

The mechanisms underlying emotional alterations constitute a key research target in neuroscience. Emerging evidence indicates that these disruptions can be related to abnormal interoception (i.e., the sensing of visceral feelings), as observed in patients with cardiodynamic deficits. To directly assess these links, we performed the first multicenter study on emotion recognition and interoception in patients with hypertensive heart disease (HHD). Participants from two countries completed a facial emotion recognition test, and a subsample additionally underwent an interoception protocol based on a validated heartbeat detection task. HHD patients from both countries presented deficits in the recognition of overall and negative emotions. Moreover, interoceptive performance was impaired in the HHD group. In addition, a significant association between interoceptive performance and emotion recognition was observed in the control group, but this relation was abolished in the HHD group. All results survived after covariance with cognitive status measures, suggesting they were not biased by general cognitive deficits in the patients. Taken together, these findings suggest that emotional recognition alterations could represent a sui generis deficit in HHD, and that it may be partially explained by the disruption of mechanisms subserving the integration of neuro-visceral signals.