The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity

The Role of Amygdala in Self-Conscious Emotions in a Patient With Acquired Bilateral Damage

Shame plays a fundamental role in the regulation of our social behavior. One intriguing question is whether amygdala might play a role in processing this emotion. In the present single-case study, we tested a patient with acquired damage of bilateral amygdalae and surrounding areas as well as healthy controls on shame processing and other social cognitive tasks. Results revealed that the patient's subjective experience of shame, but not of guilt, was more reduced than in controls, only when social standards were violated, while it was not different than controls in case of moral violations. The impairment in discriminating between normal social situations and violations also emerged. Taken together, these findings suggest that the role of the amygdala in processing shame might reflect its relevance in resolving ambiguity and uncertainty, in order to correctly detect social violations and to generate shame feelings.

Value-Related Neuronal Responses in the Human Amygdala during Observational Learning

The amygdala plays an important role in many aspects of social cognition and reward learning. Here, we aimed to determine whether human amygdala neurons are involved in the computations necessary to implement learning through observation. We performed single-neuron recordings from the amygdalae of human neurosurgical patients (male and female) while they learned about the value of stimuli through observing the outcomes experienced by another agent interacting with those stimuli. We used a detailed computational modeling approach to describe patients' behavior in the task. We found a significant proportion of amygdala neurons whose activity correlated with both expected rewards for oneself and others, and in tracking outcome values received by oneself or other agents. Additionally, a population decoding analysis suggests the presence of information for both observed and experiential outcomes in the amygdala. Encoding and decoding analyses suggested observational value coding in amygdala neurons occurred in a different subset of neurons than experiential value coding. Collectively, these findings support a key role for the human amygdala in the computations underlying the capacity for learning through observation.SIGNIFICANCE STATEMENT Single-neuron studies of the human brain provide a unique window into the computational mechanisms of cognition. In this study, epilepsy patients implanted intracranially with hybrid depth electrodes performed an observational learning (OL) task. We measured single-neuron activity in the amygdala and found a representation for observational rewards as well as observational expected reward values. Additionally, distinct subsets of amygdala neurons represented self-experienced and observational values. This study provides a rare glimpse into the role of human amygdala neurons in social cognition.

Emotional Interference in Early Adolescence: Positive Reinforcement Modulates the Behavioral and Neural Effects of Negative Emotional Distracters

Limited research has examined functioning within fronto-limbic systems subserving the resistance to emotional interference in adolescence despite evidence indicating that alterations in these systems are implicated in the developmental trajectories of affective disorders. This study examined the functioning of fronto-limbic systems subserving emotional interference in early adolescence and whether positive reinforcement could modulate these systems to promote resistance to emotional distraction. Fifty healthy early adolescents (10-13 years old) completed an emotional delayed working memory (WM) paradigm in which no distractors (fixation crosshair) and emotional distracters (neutral and negative images) were presented with and without positive reinforcement for correct responses. WM accuracy decreased with negative distracters relative to neutral distracters and no distracters, and activation increased in amygdala and prefrontal cortical (PFC) regions (ventrolateral, dorsomedial, ventromedial, and subgenual anterior cingulate) with negative distracters compared with those with no distracters. Reinforcement improved performance and reduced activation in the amygdala, dorsomedial PFC, and ventrolateral PFC. Decreases in amygdala activation to negative distracters due to reinforcement mediated observed decreases in reaction times. These findings demonstrate that healthy adolescents recruit similar fronto-limbic systems subserving emotional interference as adults and that positive reinforcement can modulate fronto-limbic systems to promote resistance to emotional distraction.

Perceiving facial affective ambiguity: A behavioral and neural comparison of adolescents and adults

The current study examined perceptual differences between adults and youth in perceiving ambiguous facial expressions. We estimated individuals' internal representation for facial expressions and compared it between age groups (adolescents: N = 108, Mage = 13.04 years, 43.52% female; adults: N = 81, Mage = 31.54, 65.43% female). We found that adolescents' perceptual representation for facial emotion is broader than that of adults', such that adolescents experience more difficulty in identifying subtle configurational differences of facial expressions. At the neural level, perceptual uncertainty in face-selective regions (e.g., fusiform face area, occipital face area) were significantly higher for adolescents than for adults, suggesting that adolescents' brains more similarly represent lower intensity emotional faces than do adults'. Our results provide evidence for age-related differences concerning psychophysical differences in perceptual representation of emotional faces at the neural and behavioral level. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The neural and computational systems of social learning

Learning the value of stimuli and actions from others - social learning - adaptively contributes to individual survival and plays a key role in cultural evolution. We review research across species targeting the neural and computational systems of social learning in both the aversive and appetitive domains. Social learning generally follows the same principles as self-experienced value-based learning, including computations of prediction errors and is implemented in brain circuits activated across task domains together with regions processing social information. We integrate neural and computational perspectives of social learning with an understanding of behaviour of varying complexity, from basic threat avoidance to complex social learning strategies and cultural phenomena.

Stimulus arousal drives amygdalar responses to emotional expressions across sensory modalities

The factors that drive amygdalar responses to emotionally significant stimuli are still a matter of debate - particularly the proneness of the amygdala to respond to negatively-valenced stimuli has been discussed controversially. Furthermore, it is uncertain whether the amygdala responds in a modality-general fashion or whether modality-specific idiosyncrasies exist. Therefore, the present functional magnetic resonance imaging (fMRI) study systematically investigated amygdalar responding to stimulus valence and arousal of emotional expressions across visual and auditory modalities. During scanning, participants performed a gender judgment task while prosodic and facial emotional expressions were presented. The stimuli varied in stimulus valence and arousal by including neutral, happy and angry expressions of high and low emotional intensity. Results demonstrate amygdalar activation as a function of stimulus arousal and accordingly associated emotional intensity regardless of stimulus valence. Furthermore, arousal-driven amygdalar responding did not depend on the visual and auditory modalities of emotional expressions. Thus, the current results are consistent with the notion that the amygdala codes general stimulus relevance across visual and auditory modalities irrespective of valence. In addition, whole brain analyses revealed that effects in visual and auditory areas were driven mainly by high intense emotional facial and vocal stimuli, respectively, suggesting modality-specific representations of emotional expressions in auditory and visual cortices.

Altered Prefrontal Theta and Gamma Activity during an Emotional Face Processing Task in Parkinson Disease

Patients with Parkinson disease (PD) often experience nonmotor symptoms including cognitive deficits, depression, and anxiety. Cognitive and affective processes are thought to be mediated by prefrontal cortico-basal ganglia circuitry. However, the topography and neurophysiology of prefrontal cortical activity during complex tasks are not well characterized. We used high-resolution electrocorticography in pFC of patients with PD and essential tremor, during implantation of deep brain stimulator leads in the awake state, to understand disease-specific changes in prefrontal activity during an emotional face processing task. We found that patients with PD had less task-related theta-alpha power and greater task-related gamma power in the dorsolateral pFC, inferior frontal cortex, and lateral OFC. These findings support a model of prefrontal neurophysiological changes in the dopamine-depleted state, in which focal areas of hyperactivity in prefrontal cortical regions may compensate for impaired long-range interactions mediated by low-frequency rhythms. These distinct neurophysiological changes suggest that nonmotor circuits undergo characteristic changes in PD.

Multivoxel Pattern Analysis Reveals a Neural Phenotype for Trust Bias in Adolescents

The extent to which individuals are inclined to judge unfamiliar others as trustworthy can have important implications for social functioning. Using multivariate pattern analysis, a neural phenotype of trust bias was identified in 48 human adolescents (ages 14-18 years, 26 female). Adolescents who exhibited more similar brain response to faces at the extremes of a trustworthy gradient were more likely to rate neutral faces as trustworthy. This relation between neural pattern representation and trust bias was evinced in the amygdala. Amygdala-insula connectivity dissimilarity to faces at the extremes of the trustworthy gradient was associated with greater trust bias to neutral faces, serving as a distinct circuit-level contributor to decision-making over and above of amygdala pattern similarity. These findings aid understanding of neural mechanisms contributing to individual differences in social evaluations of ambiguity.

Simultaneous Eye Tracking and Single-Neuron Recordings in Human Epilepsy Patients

Intracranial recordings from patients with intractable epilepsy provide a unique opportunity to study the activity of individual human neurons during active behavior. An important tool for quantifying behavior is eye tracking, which is an indispensable tool for studying visual attention. However, eye tracking is challenging to use concurrently with invasive electrophysiology and this approach has consequently been little used. Here, we present a proven experimental protocol to conduct single-neuron recordings with simultaneous eye tracking in humans. We describe how the systems are connected and the optimal settings to record neurons and eye movements. To illustrate the utility of this method, we summarize results that were made possible by this setup. This data shows how using eye tracking in a memory-guided visual search task allowed us to describe a new class of neurons called target neurons, whose response was reflective of top-down attention to the current search target. Lastly, we discuss the significance and solutions to potential problems of this setup. Together, our protocol and results suggest that single-neuron recordings with simultaneous eye tracking in humans are an effective method to study human brain function. It provides a key missing link between animal neurophysiology and human cognitive neuroscience.

Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings

The amygdala is crucially implicated in processing emotional information from various sensory modalities. However, there is dearth of knowledge concerning the integration and relative time-course of its responses across different channels, i.e., for auditory, visual, and audiovisual input. Functional neuroimaging data in humans point to a possible role of this region in the multimodal integration of emotional signals, but direct evidence for anatomical and temporal overlap of unisensory and multisensory-evoked responses in amygdala is still lacking. We recorded event-related potentials (ERPs) and oscillatory activity from 9 amygdalae using intracranial electroencephalography (iEEG) in patients prior to epilepsy surgery, and compared electrophysiological responses to fearful, happy, or neutral stimuli presented either in voices alone, faces alone, or voices and faces simultaneously delivered. Results showed differential amygdala responses to fearful stimuli, in comparison to neutral, reaching significance 100-200 ms post-onset for auditory, visual and audiovisual stimuli. At later latencies, ∼400 ms post-onset, amygdala response to audiovisual information was also amplified in comparison to auditory or visual stimuli alone. Importantly, however, we found no evidence for either super- or subadditivity effects in any of the bimodal responses. These results suggest, first, that emotion processing in amygdala occurs at globally similar early stages of perceptual processing for auditory, visual, and audiovisual inputs; second, that overall larger responses to multisensory information occur at later stages only; and third, that the underlying mechanisms of this multisensory gain may reflect a purely additive response to concomitant visual and auditory inputs. Our findings provide novel insights on emotion processing across the sensory pathways, and their convergence within the limbic system.

Neural mechanisms of face emotion processing in youths and adults with bipolar disorder

OBJECTIVES

Little is known about potential differences in the pathophysiology of bipolar disorder (BD) across development. The present study aimed to characterize age-related neural mechanisms of BD.

METHODS

Youths and adults with and without BD (N = 108, age range = 9.8-55.9 years) completed an emotional face labeling task during fMRI acquisition. We leveraged three different fMRI analytic tools to identify age-related neural mechanisms of BD, investigating (a) change in neural responses over the course of the task, (b) neural activation averaged across the entire task, and (c) amygdala functional connectivity.

RESULTS

We found converging Age Group × Diagnosis patterns across all three analytic methods. Compared to healthy youths vs adults, youths vs adults with BD show an altered pattern in response to repeated presentation of emotional faces in medial prefrontal, amygdala, and temporoparietal regions, as well as amygdala-temporoparietal connectivity. Specifically, medial prefrontal and lingual activation decreases over the course of repeated emotional face presentations in healthy youths vs adults but increases in youths with BD compared to adults with BD. Moreover, youths vs adults with BD show less medial prefrontal activation and amygdala-temporoparietal junction connectivity averaged over the task, but this difference is not found for healthy youths vs adults.

CONCLUSION

Although longitudinal confirmation and replication will be necessary, these findings suggest that neural development may be aberrant in BD and that some neural mechanisms mediating BD may differ in adults vs children with the illness.

Testing Models of Human Declarative Memory at the Single-Neuron Level

Deciphering the mechanisms of declarative memory is a major goal of neuroscience. While much theoretical progress has been made, it has proven difficult to experimentally verify key predictions of some foundational models of memory. Recently, single-neuron recordings in human patients have started to provide direct experimental verification of some theories, including mnemonic evidence accumulation, balance-of-evidence for confidence judgments, sparse coding, contextual reinstatement, and the ventral tegmental area (VTA)-hippocampus loop model. Here, we summarize the cell types that have been described in the medial temporal lobe and posterior parietal cortex, discuss their properties, and reflect on how these findings inform theoretical work. This body of work exemplifies the scientific power of a synergistic combination of modeling and human single-neuron recordings to advance cognitive neuroscience.

Neural bases of social communicative intentions in speech

Our ability to understand others’ communicative intentions in speech is key to successful social interaction. Indeed, misunderstanding an ‘excuse me’ as apology, while meant as criticism, may have important consequences. Recent behavioural studies have provided evidence that prosody, that is, vocal tone, is an important indicator for speakers’ intentions. Using a novel audio-morphing paradigm, the present functional magnetic resonance imaging study examined the neurocognitive mechanisms that allow listeners to ‘read’ speakers’ intents from vocal prosodic patterns. Participants categorized prosodic expressions that gradually varied in their acoustics between criticism, doubt, and suggestion. Categorizing typical exemplars of the three intentions induced activations along the ventral auditory stream, complemented by amygdala and mentalizing system. These findings likely depict the stepwise conversion of external perceptual information into abstract prosodic categories and internal social semantic concepts, including the speaker’s mental state. Ambiguous tokens, in turn, involved cingulo-opercular areas known to assist decision-making in case of conflicting cues. Auditory and decision-making processes were flexibly coupled with the amygdala, depending on prosodic typicality, indicating enhanced categorization efficiency of overtly relevant, meaningful prosodic signals. Altogether, the results point to a model in which auditory prosodic categorization and socio-inferential conceptualization cooperate to translate perceived vocal tone into a coherent representation of the speaker’s intent.

Alternations in functional connectivity of amygdalar subregions under acute social stress

The amygdala has long been considered a vital region involved in acute and chronic stress responses. Extensive evidences from animal and human studies suggest that the functional connectivity of amygdalar subnuclei (basolateral amygdala (BLA), centromedial amygdala (CMA) and superficial amygdala (SFA)) undergo specific alterations in stress-related psychopathology. However, whether and how intrinsic functional connectivity within the amygdalar subcomponents is differently altered in the aftermath of an acute stressor remains unknown. In the present study, using a within-subject design, we examined the impact of acute psychological social stress on the functional connectivity of amygdalar subregions at rest. Results showed that stress mainly affected the connectivity pattern of CMA. In particular, in the stress condition compared with the control, the connectivity of CMA to left posterior cingulate cortex and right thalamus was decreased under stress, while the connectivity of CMA to left caudate connectivity was increased at rest post-stressor. The findings suggest that healthy individuals may adapt to threatening surroundings by reducing threatening information input, and shifting to well-learned procedural behaviors.

Safety and Utility of Hybrid Depth Electrodes for Seizure Localization and Single-Unit Neuronal Recording

BACKGROUND

Invasive electrode monitoring provides more precise localization of epileptogenic foci in patients with medically refractory epilepsy. The use of hybrid depth electrodes that include microwires for simultaneous single-neuron monitoring is becoming more widespread.

OBJECTIVE

To determine the safety and utility of hybrid depth electrodes for intracranial monitoring of medically refractory epilepsy.

METHODS

We reviewed the medical charts of 53 cases of medically refractory epilepsy operated on from 2006 to 2017, where both non-hybrid and hybrid microwire depth electrodes were used for intracranial monitoring. We assessed the localization accuracy and complications that arose to assess the relative safety and utility of hybrid depth electrodes compared with standard electrodes.

RESULTS

A total of 555 electrodes were implanted in 52 patients. The overall per-electrode complication rate was 2.3%, with a per-case complication rate of 20.8%. There were no infections or deaths. Serious or hemorrhagic complications occurred in 2 patients (0.4% per-electrode risk). Complications did not correlate with the use of any particular electrode type, and hybrids were equally as reliable as standard electrodes in localizing seizure onset zones.

CONCLUSIONS

Hybrid depth electrodes appear to be as safe and effective as standard depth electrodes for intracranial monitoring and provide unique opportunities to study the human brain at single-neuron resolution.

Encoding of Target Detection during Visual Search by Single Neurons in the Human Brain

Neurons in the primate medial temporal lobe (MTL) respond selectively to visual categories such as faces, contributing to how the brain represents stimulus meaning. However, it remains unknown whether MTL neurons continue to encode stimulus meaning when it changes flexibly as a function of variable task demands imposed by goal-directed behavior. While classically associated with long-term memory, recent lesion and neuroimaging studies show that the MTL also contributes critically to the online guidance of goal-directed behaviors such as visual search. Do such tasks modulate responses of neurons in the MTL, and if so, do their responses mirror bottom-up input from visual cortices or do they reflect more abstract goal-directed properties? To answer these questions, we performed concurrent recordings of eye movements and single neurons in the MTL and medial frontal cortex (MFC) in human neurosurgical patients performing a memory-guided visual search task. We identified a distinct population of target-selective neurons in both the MTL and MFC whose response signaled whether the currently fixated stimulus was a target or distractor. This target-selective response was invariant to visual category and predicted whether a target was detected or missed behaviorally during a given fixation. The response latencies, relative to fixation onset, of MFC target-selective neurons preceded those in the MTL by ∼200 ms, suggesting a frontal origin for the target signal. The human MTL thus represents not only fixed stimulus identity, but also task-specified stimulus relevance due to top-down goal relevance.

A high-resolution probabilistic in vivo atlas of human subcortical brain nuclei

Recent advances in magnetic resonance imaging methods, including data acquisition, pre-processing and analysis, have benefited research on the contributions of subcortical brain nuclei to human cognition and behavior. At the same time, these developments have led to an increasing need for a high-resolution probabilistic in vivo anatomical atlas of subcortical nuclei. In order to address this need, we constructed high spatial resolution, three-dimensional templates, using high-accuracy diffeomorphic registration of T₁- and T₂- weighted structural images from 168 typical adults between 22 and 35 years old. In these templates, many tissue boundaries are clearly visible, which would otherwise be impossible to delineate in data from individual studies. The resulting delineations of subcortical nuclei complement current histology-based atlases. We further created a companion library of software tools for atlas development, to offer an open and evolving resource for the creation of a crowd-sourced in vivo probabilistic anatomical atlas of the human brain.

Behavioral and Neural Adaptation in Approach Behavior

People often make approachability decisions based on perceived facial trustworthiness. However, it remains unclear how people learn trustworthiness from a population of faces and whether this learning influences their approachability decisions. Here we investigated the neural underpinning of approach behavior and tested two important hypotheses: whether the amygdala adapts to different trustworthiness ranges and whether the amygdala is modulated by task instructions and evaluative goals. We showed that participants adapted to the stimulus range of perceived trustworthiness when making approach decisions and that these decisions were further modulated by the social context. The right amygdala showed both linear response and quadratic response to trustworthiness level, as observed in prior studies. Notably, the amygdala's response to trustworthiness was not modulated by stimulus range or social context, a possible neural dynamic adaptation. Together, our data have revealed a robust behavioral adaptation to different trustworthiness ranges as well as a neural substrate underlying approach behavior based on perceived facial trustworthiness.

Face size biases emotion judgment through eye movement

Faces are the most commonly used stimuli to study emotions. Researchers often manipulate the emotion contents and facial features to study emotion judgment, but rarely manipulate low-level stimulus features such as face sizes. Here, I investigated whether a mere difference in face size would cause differences in emotion judgment. Subjects discriminated emotions in fear-happy morphed faces. When subjects viewed larger faces, they had an increased judgment of fear and showed a higher specificity in emotion judgment, compared to when they viewed smaller faces. Concurrent high-resolution eye tracking further provided mechanistic insights: subjects had more fixations onto the eyes when they viewed larger faces whereas they had a wider dispersion of fixations when they viewed smaller faces. The difference in eye movement was present across fixations in serial order but independent of morph level, ambiguity level, or behavioral judgment. Together, this study not only suggested a link between emotion judgment and eye movement, but also showed importance of equalizing stimulus sizes when comparing emotion judgments.

Experiences of Discrimination Are Associated With Greater Resting Amygdala Activity and Functional Connectivity

BACKGROUND

Social discrimination, a type of psychological stressor, is associated with poorer physical and mental health outcomes, yet we have little understanding of how discrimination affects neural functions in marginalized populations. By contrast, the effects of psychological stress on neural functions are well documented, with evidence of significant effects on the amygdala-a neural region that is central to psychosocial functions. Accordingly, we conducted an examination of the relation between self-reported discrimination exposure and amygdala activity in a diverse sample of adults.

METHODS

Seventy-four adults (43% women; 72% African American; 23% Hispanic; 32% homosexual/bisexual) completed self-report ratings of discrimination exposure. Spontaneous amygdala activity and functional connectivity were assessed during resting-state functional magnetic resonance imaging.

RESULTS

Greater discrimination exposure was associated with higher levels of spontaneous amygdala activity. Increases in discrimination were also associated with stronger functional connectivity between the amygdala and several neural regions (e.g., anterior insula, putamen, caudate, anterior cingulate, medial frontal gyrus), with the most robust effects observed in the thalamus. These effects were independent of several demographic (e.g., race, ethnicity, sex) and psychological (e.g., current stress, depression, anxiety) factors.

CONCLUSIONS

Collectively, our findings provide the first evidence that social discrimination is independently associated with elevations in intrinsic amygdala activity and functional connectivity, thus revealing clear parallels between the neural substrates of discrimination and psychological stressors of other origins. Such results should spur future investigations of amygdala-based networks as potential etiological factors linking discrimination exposure to adverse physical and mental health outcomes.

A Neural Signature Encoding Decisions under Perceptual Ambiguity

People often make perceptual decisions with ambiguous information, but it remains unclear whether the brain has a common neural substrate that encodes various forms of perceptual ambiguity. Here, we used three types of perceptually ambiguous stimuli as well as task instructions to examine the neural basis for both stimulus-driven and task-driven perceptual ambiguity. We identified a neural signature, the late positive potential (LPP), that encoded a general form of stimulus-driven perceptual ambiguity. In addition to stimulus-driven ambiguity, the LPP was also modulated by ambiguity in task instructions. To further specify the functional role of the LPP and elucidate the relationship between stimulus ambiguity, behavioral response, and the LPP, we employed regression models and found that the LPP was specifically associated with response latency and confidence rating, suggesting that the LPP encoded decisions under perceptual ambiguity. Finally, direct behavioral ratings of stimulus and task ambiguity confirmed our neurophysiological findings, which could not be attributed to differences in eye movements either. Together, our findings argue for a common neural signature that encodes decisions under perceptual ambiguity but is subject to the modulation of task ambiguity. Our results represent an essential first step toward a complete neural understanding of human perceptual decision making.

Decision ambiguity is mediated by a late positive potential originating from cingulate cortex

People often make decisions in the face of ambiguous information, but it remains unclear how ambiguity is represented in the brain. We used three types of ambiguous stimuli and combined EEG and fMRI to examine the neural representation of perceptual decisions under ambiguity. We identified a late positive potential, the LPP, which differentiated levels of ambiguity, and which was specifically associated with behavioral judgments about choices that were ambiguous, rather than passive perception of ambiguous stimuli. Mediation analyses together with two further control experiments confirmed that the LPP was generated only when decisions are made (not during mere perception of ambiguous stimuli), and only when those decisions involved choices on a dimension that is ambiguous. A further control experiment showed that a stronger LPP arose in the presence of ambiguous stimuli compared to when only unambiguous stimuli were present. Source modeling suggested that the LPP originated from multiple loci in cingulate cortex, a finding we further confirmed using fMRI and fMRI-guided ERP source prediction. Taken together, our findings argue for a role of an LPP originating from cingulate cortex in encoding decisions based on task-relevant perceptual ambiguity, a process that may in turn influence confidence judgment, response conflict, and error correction.