Perceiving emotion: There's more than meets the eye

Who are you after psychedelics? A systematic review and a meta-analysis of the magnitude of long-term effects of serotonergic psychedelics on cognition/creativity, emotional processing and personality

This systematic review and a meta-analysis synthesised the results from contemporary, randomized and non-randomized controlled studies to assess lasting (one week minimum) changes on cognition/creativity, emotional processing and personality from serotonergic psychedelics. PubMed, Embase and PsycInfo were searched in July 2022. Risk of bias was assessed using Rob 2.0 and ROBINS-I. Ten studies met the eligibility criteria which involved 304 participants. No statistically significant effects were found for the majority outcome measures across the three constructs. A meta-analysis of emotional recognition outcomes found an overall significant effect for faster reaction times in the active treatment groups for disgust (SMD=-0.63, 95% CI=[-1.01 to -0.25], I2 = 65%) and sadness (SMD=-0.45, 95% CI=[-0.85 to -0.06], I2 = 60%). Future research should include larger samples, better control conditions, standardized doses and longer follow-up periods to confirm these preliminary findings.

Language and affective facial expression in children with perinatal stroke

Children with perinatal stroke (PS) provide a unique opportunity to understand developing brain-behavior relations. Previous research has noted distinctive differences in behavioral sequelae between children with PS and adults with acquired stroke: children fare better, presumably due to the plasticity of the developing brain for adaptive reorganization. Whereas we are beginning to understand language development, we know little about another communicative domain, emotional expression. The current study investigates the use and integration of language and facial expression during an interview. As anticipated, the language performance of the five and six year old PS group is comparable to their typically developing (TD) peers, however, their affective profiles are distinctive: those with right hemisphere injury are less expressive with respect to affective language and affective facial expression than either those with left hemisphere injury or TD group. The two distinctive profiles for language and emotional expression in these children suggest gradients of neuroplasticity in the developing brain.

Recognition of facial emotions and identity in patients with mesial temporal lobe and idiopathic generalized epilepsy: an eye-tracking study

PURPOSE

To describe visual scanning pattern for facial identity recognition (FIR) and emotion recognition (FER) in patients with idiopathic generalized (IGE) and mesial temporal lobe epilepsy (MTLE). Secondary endpoint was to correlate the results with cognitive function.

METHODS

Benton Facial Recognition Test (BFRT) and Ekman&Friesen series were performed for FIR and FER respectively in 23 controls, 20 IGE and 19 MTLE patients. Eye movements were recorded by a Hi-Speed eye-tracker system. Neuropsychological tools explored cognitive function.

RESULTS

Correct FIR rate was 78% in controls, 70.7% in IGE and 67.4% (p=0.009) in MTLE patients. FER hits reached 82.7% in controls, 74.3% in IGE (p=0.006) and 73.4% in MTLE (p=0.002) groups. IGE patients failed in disgust (p=0.005) and MTLE ones in fear (p=0.009) and disgust (p=0.03). FER correlated with neuropsychological scores, particularly verbal fluency (r=0.542, p<0.001). Eye-tracking revealed that controls scanned faces more diffusely than IGE and MTLE patients for FIR, who tended to top facial areas. A longer scanning of the top facial area was found in the three groups for FER. Gap between top and bottom facial region fixation time decreased in MTLE patients, with more but shorter fixations in bottom facial region. However, none of these findings were statistically significant.

CONCLUSION

FIR was impaired in MTLE patients, and FER in both IGE and MTLE, particularly for fear and disgust. Although not statistically significant, those with impaired FER tended to perform more diffuse eye-tracking over the faces and have cognitive dysfunction.

Emotional processing in bipolar disorder: behavioural and neuroimaging findings

Existing studies revealed that bipolar patients show an altered identification of emotional stimuli (e.g. facial expressions), however, so far modifications in early emotional processes and the regulation of emotions are less clear. In response to emotional stimuli bipolar patients show a dysfunction in a ventral-limbic brain network including the amygdala, insula, striatum, subgenual cingulate cortex, ventrolateral prefrontal cortex and orbitofrontal cortex. In most studies, a relative hypoactivity of dorsal brain structures, including the dorsolateral prefrontal cortex, the dorsal anterior cingulate and the posterior cingulate cortex, has been reported in bipolar patients. This imbalance between the two networks has been proposed to underlie deficient emotion regulation in bipolar disorder.

Friend or foe? Brain systems involved in the perception of dynamic signals of menacing and friendly social approaches

During every social approach, humans must assess each other's intentions. Facial expressions provide cues to assist in these assessments via associations with emotion, the likelihood of affiliation, and personality. In this functional magnetic resonance imaging (fMRI) study, participants viewed animated male characters approaching them in a hallway and making either a happy or an angry facial expression. An expected increase in amygdala and superior temporal sulcus activation to the expression of anger was found. Notably, two other social brain regions also had an increased hemodynamic response to anger relative to happiness, including the lateral fusiform gyrus and a region centered in the middle temporal gyrus. Other brain regions showed little differentiation or an increased level of activity to the happy stimuli. These findings provide insight into the brain mechanisms involved in reading the intentions of other human beings in an overtly social context. In particular, they demonstrate brain regions sensitive to social signals of dominance and affiliation.

Time course of the involvement of the right anterior superior temporal gyrus and the right fronto-parietal operculum in emotional prosody perception

In verbal communication, not only the meaning of the words convey information, but also the tone of voice (prosody) conveys crucial information about the emotional state and intentions of others. In various studies right frontal and right temporal regions have been found to play a role in emotional prosody perception. Here, we used triple-pulse repetitive transcranial magnetic stimulation (rTMS) to shed light on the precise time course of involvement of the right anterior superior temporal gyrus and the right fronto-parietal operculum. We hypothesized that information would be processed in the right anterior superior temporal gyrus before being processed in the right fronto-parietal operculum. Right-handed healthy subjects performed an emotional prosody task. During listening to each sentence a triplet of TMS pulses was applied to one of the regions at one of six time points (400-1900 ms). Results showed a significant main effect of Time for right anterior superior temporal gyrus and right fronto-parietal operculum. The largest interference was observed half-way through the sentence. This effect was stronger for withdrawal emotions than for the approach emotion. A further experiment with the inclusion of an active control condition, TMS over the EEG site POz (midline parietal-occipital junction), revealed stronger effects at the fronto-parietal operculum and anterior superior temporal gyrus relative to the active control condition. No evidence was found for sequential processing of emotional prosodic information from right anterior superior temporal gyrus to the right fronto-parietal operculum, but the results revealed more parallel processing. Our results suggest that both right fronto-parietal operculum and right anterior superior temporal gyrus are critical for emotional prosody perception at a relatively late time period after sentence onset. This may reflect that emotional cues can still be ambiguous at the beginning of sentences, but become more apparent half-way through the sentence.

Genetic influences on the neural basis of social cognition

The neural basis of social cognition has been the subject of intensive research in both human and non-human primates. Exciting, provocative and yet consistent findings are emerging. A major focus of interest is the role of efferent and afferent connectivity between the amygdala and the neocortical brain regions, now believed to be critical for the processing of social and emotional perceptions. One possible component is a subcortical neural pathway, which permits rapid and preconscious processing of potentially threatening stimuli, and it leads from the retina to the superior colliculus, to the pulvinar nucleus of the thalamus and then to the amygdala. This pathway is activated by direct eye contact, one of many classes of potential threat, and may be particularly responsive to the 'whites of the eyes'. In humans, autonomic arousal evoked by this stimulus is associated with the activity in specific cortical regions concerned with processing visual information from faces. The integrated functioning of these pathways is modulated by one or more X-linked genes, yet to be identified. The emotional responsiveness of the amygdala, and its associated circuits, to social threat is also influenced by functional polymorphisms in the promoter of the serotonin transporter gene. We still do not have a clear account of how specific allelic variation, in candidate genes, increases susceptibility to developmental disorders, such as autism, or psychiatric conditions, such as anxiety or depressive illness. However, the regulation of emotional responsiveness to social cues lies at the heart of the problem, and recent research indicates that we may be nearing a deeper and more comprehensive understanding.

Human and computer recognition of facial expressions of emotion

Neuropsychological and neuroimaging evidence suggests that the human brain contains facial expression recognition detectors specialized for specific discrete emotions. However, some human behavioral data suggest that humans recognize expressions as similar and not discrete entities. This latter observation has been taken to indicate that internal representations of facial expressions may be best characterized as varying along continuous underlying dimensions. To examine the potential compatibility of these two views, the present study compared human and support vector machine (SVM) facial expression recognition performance. Separate SVMs were trained to develop fully automatic optimal recognition of one of six basic emotional expressions in real-time with no explicit training on expression similarity. Performance revealed high recognition accuracy for expression prototypes. Without explicit training of similarity detection, magnitude of activation across each emotion-specific SVM captured human judgments of expression similarity. This evidence suggests that combinations of expert classifiers from separate internal neural representations result in similarity judgments between expressions, supporting the appearance of a continuous underlying dimensionality. Further, these data suggest similarity in expression meaning is supported by superficial similarities in expression appearance.

Les visages et leurs émotions

In this second part, we address particularly the question of the neural mechanisms and structures involved in the recognition of facial emotional expressions that are crucial in social cognition. Emotion recognition in others can be critically impaired in some neurodegenerative and neurovascular diseases. That dysfunction sometimes correlated to disabling behavioural disorders and interpersonal communication impairment must be further understood. The results of a series of scalp and intracranial event related potential recordings, as well as recent advances in the literature, are reported. ERPs to facial emotional expressions were thus recorded in multiple subcortical and cortical areas in drug refractory epileptical patients implanted with depth electrodes. The roles of amygdala, insula and prefrontal cortex located at crossroads between perceptive analysis and emotional conceptual knowledge are particularly underlined. Altogether, these studies demonstrate that facial expressions are widely processed in space and time, some structures reacting very early and automatically, others providing a sustained reaction depending on the attention.

Autism and the development of face processing

Autism is a pervasive developmental condition, characterized by impairments in non-verbal communication, social relationships and stereotypical patterns of behavior. A large body of evidence suggests that several aspects of face processing are impaired in autism, including anomalies in gaze processing, memory for facial identity and recognition of facial expressions of emotion. In search of neural markers of anomalous face processing in autism, much interest has focused on a network of brain regions that are implicated in social cognition and face processing. In this review, we will focus on three such regions, namely the STS for its role in processing gaze and facial movements, the FFA in face detection and identification and the amygdala in processing facial expressions of emotion. Much evidence suggests that a better understanding of the normal development of these specialized regions is essential for discovering the neural bases of face processing anomalies in autism. Thus, we will also examine the available literature on the normal development of face processing. Key unknowns in this research area are the neuro-developmental processes, the role of experience and the interactions among components of the face processing system in shaping each of the specialized regions for processing faces during normal development and in autism.

Animal studies of amygdala function in fear and uncertainty: relevance to human research

This article reviews research in both animals and humans on the considerable progress made in elucidating a brain circuitry of fear, particularly the importance of the amygdala in fear conditioning. While there is considerable agreement about the participation of the amygdala in fear in both animals and humans, there are several issues about the function of the amygdala raised by the human research that have not been addressed by or may be answered by animal research. Three of these are addressed in this article: (1) is the amygdala involved in or necessary for both fear learning and unconditioned fear? (2) Does the amygdala code for intensity of fear? (3) Is the amygdala preferentially involved in fear, or is it also activated when there are no overt fear or aversive stimuli, but where the situation can be described as uncertain? We present evidence indicating that the rodent amygdala is involved in some types of fear (conditioned fear), but not all types (unconditioned fear), and may therefore have significance for a differential neurobiology of certain anxiety disorders in humans. Further, similar to the human amygdala, the rodent amygdala responds to varying intensities of aversive stimulation. Finally, it is suggested that, similar to humans, the rodent amygdala is involved in the evaluation of uncertainty. We conclude that progress on elucidating the role of the amygdala in fear is facilitated by corroboration of findings from both animal and human research.

Emotion and Cognition: Insights from Studies of the Human Amygdala

Traditional approaches to the study of cognition emphasize an information-processing view that has generally excluded emotion. In contrast, the recent emergence of cognitive neuroscience as an inspiration for understanding human cognition has highlighted its interaction with emotion. This review explores insights into the relations between emotion and cognition that have resulted from studies of the human amygdala. Five topics are explored: emotional learning, emotion and memory, emotion's influence on attention and perception, processing emotion in social stimuli, and changing emotional responses. Investigations into the neural systems underlying human behavior demonstrate that the mechanisms of emotion and cognition are intertwined from early perception to reasoning. These findings suggest that the classic division between the study of emotion and cognition may be unrealistic and that an understanding of human cognition requires the consideration of emotion.

What is said or how it is said makes a difference: role of the right fronto-parietal operculum in emotional prosody as revealed by repetitive TMS

Emotional signals in spoken language can be conveyed by semantic as well as prosodic cues. We investigated the role of the fronto-parietal operculum, a somatosensory area where the lips, tongue and jaw are represented, in the right hemisphere to detection of emotion in prosody vs. semantics. A total of 14 healthy volunteers participated in the present experiment, which involved transcranial magnetic stimulation (TMS) in combination with frameless stereotaxy. As predicted, compared with sham stimulation, TMS over the right fronto-parietal operculum differentially affected the reaction times for detection of emotional prosody vs. emotional semantics, showing that there is a dissociation at a neuroanatomical level. Detection of withdrawal emotions (fear and sadness) in prosody was delayed significantly by TMS. No effects of TMS were observed for approach emotions (happiness and anger). We propose that the right fronto-parietal operculum is not globally involved in emotion evaluation, but sensitive to specific forms of emotional discrimination and emotion types.

Functional dissociation of amygdala-modulated arousal and cognitive appraisal, in Turner syndrome

The amygdala is preferentially activated by facial expressions of fear. Right and left amygdala are hypothesized to play distinct, but complementary, roles that influence somatic and cognitive responses to facial expressions. Right amygdala activation is linked to autonomic arousal, and thus indirectly influences left hemisphere cognitive processing centres. Left amygdala activation is more closely associated with cognitive processing and differentiation of facial emotions. A double-dissociation between the functions of left and right amygdala is implied by lesion studies but supportive evidence is inconsistent, partly because patients with structural anteromedial temporal anomalies have experienced variable surgical procedures. A functional dissociation can be demonstrated between arousal and the cognitive appraisal of fearful faces in the condition of X-monosomy or Turner syndrome. Previous research found Turner syndrome women of normal verbal intelligence are seriously impaired in their ability cognitively to differentiate fearful from other facial expressions but they acquire fear conditioning normally, with enhanced autonomic responses. These findings supported the dissociation hypothesis, which was formally tested in a study of 12 X-monosomic and 12 control females who participated in functional magnetic resonance imaging during which simultaneous skin conductance recordings were acquired. Faces depicting fear or neutral emotions were presented to both case and control subjects in random order. Arousal to (fearful-neutral) faces was associated with transiently increased skin conductance responses and bilateral amygdala activation in both groups, but X-monosomic females had proportionately greater--and more persistent--right amygdala activation than controls. In both groups, cognitive accuracy correlated positively with differential activity of left fusiform gyrus. There was a significant correlation between the left fusiform and left medial amygdala activation only in normal females, and only in them did differential SCRs (to fearful-neutral faces) correlate positively with left fusiform responses. Arousal and cognitive appraisal functions of the amygdala can thus be functionally dissociated. X-monosomy selectively impairs explicit recognition of fearful faces in the presence of normal or enhanced autonomic reactivity, and is associated with a functional dissociation of activity in left amygdala and left fusiform gyrus. These findings imply X-linked genes are essential for binding somatic responses to the cognitive appraisal of emotional stimuli.

Amygdalar interhemispheric functional connectivity differs between the non-depressed and depressed human brain

The amygdalae are important, if not critical, brain regions for many affective, attentional and memorial processes, and dysfunction of the amygdalae has been a consistent finding in the study of clinical depression. Theoretical models of the functional neuroanatomy of both normal and psychopathological affective processes which posit cortical hemispheric specialization of functions have been supported by both lesion and functional neuroimaging studies in humans. Results from human neuroimaging studies in support of amygdalar hemispheric specialization are inconsistent. However, recent results from human lesion studies are consistent with hemispheric specialization. An important, yet largely ignored, feature of the amygdalae in the primate brain--derived from both neuroanatomical and electrophysiological data--is that there are virtually no direct interhemispheric connections via the anterior commissure (AC). This feature stands in stark contrast to that of the rodent brain wherein virtually all amygdalar nuclei have direct interhemispheric connections. We propose this feature of the primate brain, in particular the human brain, is a result of influences from frontocortical hemispheric specialization which have developed over the course of primate brain evolution. Results consistent with this notion were obtained by examining the nature of human amygdalar interhemispheric connectivity using both functional magnetic resonance imaging (FMRI) and positron emission tomography (PET). We found modest evidence of amygdalar interhemispheric functional connectivity in the non-depressed brain, whereas there was strong evidence of functional connectivity in the depressed brain. We interpret and discuss the nature of this connectivity in the depressed brain in the context of dysfunctional frontocortical-amygdalar interactions which accompany clinical depression.

Is the human amygdala critical for the subjective experience of emotion? Evidence of intact dispositional affect in patients with amygdala lesions

It is thought that the human amygdala is a critical component of the neural substrates of emotional experience, involved particularly in the generation of fear, anxiety, and general negative affectivity. Although many neuroimaging studies demonstrate findings consistent this notion, little evidence of altered emotional experience following amygdala damage has been gathered in humans. In a preliminary test of the amygdala's role in phenomenal affective states, we assessed the extent of experienced positive and negative affective states in patients with amygdala damage and age-, sex-, and education-matched controls. To assess chronic changes in experienced affect, all groups were administered the Positive and Negative Affect Schedules (PANAS, Watson, Clark, & Tellegen, 1988). In the first study, we examined the effects of amygdala lesions on affective traits in 10 left and 10 right amygdala-damaged patients, 1 patient with bilateral amygdala damage (SP), and 20 control subjects. Subjects were asked to indicate the typicality of different experiential states of positive (e.g., inspired, excited) and negative (e.g., afraid, nervous) valence. In a second study, we examined more closely the effects of bilateral amygdala damage on the day-to-day generation of affective states by administering the PANAS daily for a 30-day period to patient SP and age-, sex-, and education-matched controls. In both experiments, no differences in the magnitude and frequency of self-reported positive or negative affect were found between control subjects and patients with amygdala damage. Moreover, principal components analyses of the covariation among different affects (across individuals in Study 1 and within individuals across days in Study 2) confirmed a two-factor (positive vs. negative) description of experienced affect in controls. A highly similar two-factor description of experienced affect was found in patients with amygdala lesions. This suggests that the underlying structure of affective states was intact following amygdala damage. It is concluded that the human amygdala may be recruited during phenomenal affective states in the intact brain, but is not necessary for the production of these states.

The classification of 'fear' from faces is associated with face recognition skill in women

Two experiments were conducted to explore the relationship between the discrimination of the facial expression of 'fear' in faces and facial recognition. On the basis of the reported role of the amygdala in both processes in patients, we hypothesised that the two skills would be correlated in normal adults. In Experiment 1, a series of tests of facial expression categorisation, of face matching and of familiar and unfamiliar face recognition was conducted on normal young women, for whom psychometric scores were also obtained (n=23). Accuracy of categorisation of fear from faces predicted variance in face recognition accuracy-especially in tasks of unfamiliar face recognition (immediate old-new discrimination). No other correlations between face processing and expression classification were significant. Experiment 2 repeated the expression classification tests and an unfamiliar face recognition test on a new sample of men (n=13) and women (n=16). While there were no sex differences in face recognition, the correlation between 'fear' and face recognition was replicated only for women. These data indicate that the amygdala supports both the specific apprehension of fear in faces and face recognition in adult human females, but that the association may not hold for men. Sex differences in the structure of the amygdala-hippocampal complex suggest a likely cortical substrate for the observed differences. We speculate that social learning, which involves identifying the faces of potentially salient others, and also their attitude to the observer, engages the amygdala more readily in women than in men.