Dynamic Interactions between Emotion Perception and Action Preparation for Reacting to Social Threat: A Combined cTBS-fMRI Study

Emotion regulation from an action-control perspective

Despite increasing interest in emotional processes in cognitive science, theories on emotion regulation have remained rather isolated, predominantly focused on cognitive regulation strategies such as reappraisal. However, recent neurocognitive evidence suggests that early emotion regulation may involve sensorimotor control in addition to other emotion-regulation processes. We propose an action-oriented view of emotion regulation, in which feedforward predictions develop from action-selection mechanisms. Those can account for acute emotional-action control as well as more abstract instances of emotion regulation such as cognitive reappraisal. We argue the latter occurs in absence of overt motor output, yet in the presence of full-blown autonomic, visceral, and subjective changes. This provides an integrated framework with testable neuro-computational predictions and concrete starting points for intervention to improve emotion control in affective disorders.

Brain responses to the vicarious facilitation of pain by facial expressions of pain and fear

Observing pain in others facilitates self-pain in the observer. Vicarious pain facilitation mechanisms are poorly understood. We scanned 21 subjects while they observed pain, fear and neutral dynamic facial expressions. In 33% of the trials, a noxious electrical stimulus was delivered. The nociceptive flexion reflex (NFR) and pain ratings were recorded. Both pain and fear expressions increased self-pain ratings (fear > pain) and the NFR amplitude. Enhanced response to self-pain following pain and fear observation involves brain regions including the insula (INS) (pain > fear in anterior part), amygdala, mid-cingulate cortex (MCC), paracentral lobule, precuneus, supplementary motor area and pre-central gyrus. These results are consistent with the motivational priming account where vicarious pain facilitation involves a global enhancement of pain-related responses by negatively valenced stimuli. However, a psychophysiological interaction analysis centered on the left INS revealed increased functional connectivity with the aMCC in response to the painful stimulus following pain observation compared to fear. The opposite connectivity pattern (fear > pain) was observed in the fusiform gyrus, cerebellum (I-IV), lingual gyrus and thalamus, suggesting that pain and fear expressions influence pain-evoked brain responses differentially. Distinctive connectivity patterns demonstrate a stronger effect of pain observation in the cingulo-insular network, which may reflect partly overlapping networks underlying the representation of pain in self and others.

Mirror neurons 30 years later: implications and applications

Mirror neurons (MNs) were first described in a seminal paper in 1992 as a class of monkey premotor cells discharging during both action execution and observation. Despite their debated origin and function, recent studies in several species, from birds to humans, revealed that beyond MNs properly so called, a variety of cell types distributed among multiple motor, sensory, and emotional brain areas form a 'mirror mechanism' more complex and flexible than originally thought, which has an evolutionarily conserved role in social interaction. Here, we trace the current limits and envisage the future trends of this discovery, showing that it inspired translational research and the development of new neurorehabilitation approaches, and constitutes a point of no return in social and affective neuroscience.

Simulated proximity enhances perceptual and physiological responses to emotional facial expressions

Physical proximity is important in social interactions. Here, we assessed whether simulated physical proximity modulates the perceived intensity of facial emotional expressions and their associated physiological signatures during observation or imitation of these expressions. Forty-four healthy volunteers rated intensities of dynamic angry or happy facial expressions, presented at two simulated locations, proximal (0.5 m) and distant (3 m) from the participants. We tested whether simulated physical proximity affected the spontaneous (in the observation task) and voluntary (in the imitation task) physiological responses (activity of the corrugator supercilii face muscle and pupil diameter) as well as subsequent ratings of emotional intensity. Angry expressions provoked relative activation of the corrugator supercilii muscle and pupil dilation, whereas happy expressions induced a decrease in corrugator supercilii muscle activity. In proximal condition, these responses were enhanced during both observation and imitation of the facial expressions, and were accompanied by an increase in subsequent affective ratings. In addition, individual variations in condition related EMG activation during imitation of angry expressions predicted increase in subsequent emotional ratings. In sum, our results reveal novel insights about the impact of physical proximity in the perception of emotional expressions, with early proximity-induced enhancements of physiological responses followed by an increased intensity rating of facial emotional expressions.

Incongruence effects in cross-modal emotional processing in autistic traits: An fMRI study

In everyday life, emotional information is often conveyed by both the face and the voice. Consequently, information presented by one source can alter the way in which information from the other source is perceived, leading to emotional incongruence. Here, we used functional magnetic resonance imaging (fMRI) to examine neutral correlates of two different types of emotional incongruence in audiovisual processing, namely incongruence of emotion-valence and incongruence of emotion-presence. Participants were in two groups, one group with a low Autism Quotient score (LAQ) and one with a high score (HAQ). Each participant experienced emotional (happy, fearful) or neutral faces or voices while concurrently being exposed to emotional (happy, fearful) or neutral voices or faces. They were instructed to attend to either the visual or auditory track. The incongruence effect of emotion-valence was characterized by activation in a wide range of brain regions in both hemispheres involving the inferior frontal gyrus, cuneus, superior temporal gyrus, and middle frontal gyrus. The incongruence effect of emotion-presence was characterized by activation in a set of temporal and occipital regions in both hemispheres, including the middle occipital gyrus, middle temporal gyrus and inferior temporal gyrus. In addition, the present study identified greater recruitment of the right inferior parietal lobule in perceiving audio-visual emotional expressions in HAQ individuals, as compared to the LAQ individuals. Depending on face or voice-to-be attended, different patterns of emotional incongruence were found between the two groups. Specifically, the HAQ group tend to show more incidental processing to visual information whilst the LAQ group tend to show more incidental processing to auditory information during the crossmodal emotional incongruence decoding. These differences might be attributed to different attentional demands and different processing strategies between the two groups.

Decoding the difference between explicit and implicit body expression representation in high level visual, prefrontal and inferior parietal cortex

Recent studies provide an increasing understanding of how visual objects categories like faces or bodies are represented in the brain and also raised the question whether a category based or more dynamic network inspired models are more powerful. Two important and so far sidestepped issues in this debate are, first, how major category attributes like the emotional expression directly influence category representation and second, whether category and attribute representation are sensitive to task demands. This study investigated the impact of a crucial category attribute like emotional expression on category area activity and whether this varies with the participants' task. Using (fMRI) we measured BOLD responses while participants viewed whole body expressions and performed either an explicit (emotion) or an implicit (shape) recognition task. Our results based on multivariate methods show that the type of task is the strongest determinant of brain activity and can be decoded in EBA, VLPFC and IPL. Brain activity was higher for the explicit task condition in VLPFC and was not emotion specific. This pattern suggests that during explicit recognition of the body expression, body category representation may be strengthened, and emotion and action related activity suppressed. Taken together these results stress the importance of the task and of the role of category attributes for understanding the functional organization of high level visual cortex.

Angry facial expressions bias towards aversive actions

Social interaction requires fast and efficient processing of another person's intentions. In face-to-face interactions, aversive or appetitive actions typically co-occur with emotional expressions, allowing an observer to anticipate action intentions. In the present study, we investigated the influence of facial emotions on the processing of action intentions. Thirty-two participants were presented with video clips showing virtual agents displaying a facial emotion (angry vs. happy) while performing an action (punch vs. fist-bump) directed towards the observer. During each trial, video clips stopped at varying durations of the unfolding action, and participants had to recognize the presented action. Naturally, participants' recognition accuracy improved with increasing duration of the unfolding actions. Interestingly, while facial emotions did not influence accuracy, there was a significant influence on participants' action judgements. Participants were more likely to judge a presented action as a punch when agents showed an angry compared to a happy facial emotion. This effect was more pronounced in short video clips, showing only the beginning of an unfolding action, than in long video clips, showing near-complete actions. These results suggest that facial emotions influence anticipatory processing of action intentions allowing for fast and adaptive responses in social interactions.

The Peripersonal Space in a social world

The PeriPersonal Space (PPS) has been defined as the space surrounding the body, where physical interactions with elements of the environment take place. As our world is social in nature, recent evidence revealed the complex modulation of social factors onto PPS representation. In light of the growing interest in the field, in this review we take a close look at the experimental approaches undertaken to assess the impact of social factors onto PPS representation. Our social world also influences the personal space (PS), a concept stemming from social psychology, defined as the space we keep between us and others to avoid discomfort. Here we analytically compare PPS and PS with the aim of understanding if and how they relate to each other. At the behavioral level, the multiplicity of experimental methodologies, whether well-established or novel, lead to somewhat divergent results and interpretations. Beyond behavior, we review physiological and neural signatures of PPS representation to discuss how interoceptive signals could contribute to PPS representation, as well as how these internal signals could shape the neural responses of PPS representation. In particular, by merging exteroceptive information from the environment and internal signals that come from the body, PPS may promote an integrated representation of the self, as distinct from the environment and the others. We put forward that integrating internal and external signals in the brain for perception of proximal environmental stimuli may also provide us with a better understanding of the processes at play during social interactions. Adopting such an integrative stance may offer novel insights about PPS representation in a social world. Finally, we discuss possible links between PPS research and social cognition, a link that may contribute to the understanding of intentions and feelings of others around us and promote appropriate social interactions.

Difficulties in Recognising Dynamic but not Static Emotional Body Movements in Autism Spectrum Disorder

In this study, we investigated whether the difficulties in body motion (BM) perception may led to deficit in emotion recognition in Autism spectrum disorder (ASD). To this aim, individuals with high-functioning ASD were asked to recognise fearful, happy, and neutral BM depicted as static images or dynamic point-light and full-light displays. Results showed slower response times in participants with ASD only in recognising dynamic stimuli, but no group differences in accuracy. This suggests that i) a deficit in action chaining mechanism in ASD may prevent the recognition of dynamic BM automatically and rapidly, ii) individuals with ASD and high cognitive resources can develop alternative—but equally successful—strategies to recognise emotional body expressions. Implications for treatment are discussed

Neural Mechanisms Underlying the Auditory Looming Bias

Our auditory system constantly keeps track of our environment, informing us about our surroundings and warning us of potential threats. The auditory looming bias is an early perceptual phenomenon, reflecting higher alertness of listeners to approaching auditory objects, rather than to receding ones. Experimentally, this sensation has been elicited by using both intensity-varying stimuli, as well as spectrally varying stimuli with constant intensity. Following the intensity-based approach, recent research delving into the cortical mechanisms underlying the looming bias argues for top-down signaling from the prefrontal cortex to the auditory cortex in order to prioritize approaching over receding sonic motion. We here test the generalizability of that finding to spectrally induced looms by re-analyzing previously published data. Our results indicate the promoted top-down projection but at time points slightly preceding the motion onset and thus considered to reflect a bias driven by anticipation. At time points following the motion onset, our findings show a bottom-up bias along the dorsal auditory pathway directed toward the prefrontal cortex.

Hyperscanning EEG and Classification Based on Riemannian Geometry for Festive and Violent Mental State Discrimination

Interactions between two brains constitute the essence of social communication. Daily movements are commonly executed during social interactions and are determined by different mental states that may express different positive or negative behavioral intent. In this context, the effective recognition of festive or violent intent before the action execution remains crucial for survival. Here, we hypothesize that the EEG signals contain the distinctive features characterizing movement intent already expressed before movement execution and that such distinctive information can be identified by state-of-the-art classification algorithms based on Riemannian geometry. We demonstrated for the first time that a classifier based on covariance matrices and Riemannian geometry can effectively discriminate between neutral, festive, and violent mental states only on the basis of non-invasive EEG signals in both the actor and observer participants. These results pave the way for new electrophysiological discrimination of mental states based on non-invasive EEG recordings and cutting-edge machine learning techniques.

Computation-Based Feature Representation of Body Expressions in the Human Brain

Humans and other primate species are experts at recognizing body expressions. To understand the underlying perceptual mechanisms, we computed postural and kinematic features from affective whole-body movement videos and related them to brain processes. Using representational similarity and multivoxel pattern analyses, we showed systematic relations between computation-based body features and brain activity. Our results revealed that postural rather than kinematic features reflect the affective category of the body movements. The feature limb contraction showed a central contribution in fearful body expression perception, differentially represented in action observation, motor preparation, and affect coding regions, including the amygdala. The posterior superior temporal sulcus differentiated fearful from other affective categories using limb contraction rather than kinematics. The extrastriate body area and fusiform body area also showed greater tuning to postural features. The discovery of midlevel body feature encoding in the brain moves affective neuroscience beyond research on high-level emotion representations and provides insights in the perceptual features that possibly drive automatic emotion perception.

A sensorimotor control framework for understanding emotional communication and regulation

Our research team was asked to consider the relationship of the neuroscience of sensorimotor control to the language of emotions and feelings. Actions are the principal means for the communication of emotions and feelings in both humans and other animals, and the allostatic mechanisms controlling action also apply to the regulation of emotional states by the self and others. We consider how motor control of hierarchically organised, feedback-based, goal-directed action has evolved in humans, within a context of consciousness, appraisal and cultural learning, to serve emotions and feelings. In our linguistic analysis, we found that many emotion and feelings words could be assigned to stages in the sensorimotor learning process, but the assignment was often arbitrary. The embodied nature of emotional communication means that action words are frequently used, but that the meanings or senses of the word depend on its contextual use, just as the relationship of an action to an emotion is also contextually dependent.

Social perceptions of warmth and competence influence behavioral intentions and neural processing

Perceptions of the primary social dimensions, warmth and competence, determine how we view and relate to social targets. To discern how warmth and competence might affect neural processing and its downstream behavioral consequences, we manipulated impressions of targets' warmth and competence and then measured intentions toward the target and motor resonance, a neural process previously linked to social processing. While EEG was recorded, 66 participants watched videos of people performing a simple motor activity and completed a measure of hypothetical intentions to help or harm. Both perceptions of warmth and competence predicted an increase in helping intentions. Moreover, participants showed the least motor resonance with high competence-medium warmth targets, suggesting the importance of both social dimensions in driving neural simulation of targets' actions. Perceptions of a person's warmth and competence can affect not only how others might intend to treat them, but also how they might process their basic experiences on a neural level.

Recognition of emotions conveyed by facial expression and body postures in myotonic dystrophy (DM)

INTRODUCTION

Neuromuscular diseases may be of neuropsychological interest insofar as they may affect representations based on embodied cognition theories. Previous studies have shown impaired ability to recognize facial emotions and an association between facial emotion recognition and visuospatial abilities in myotonic dystrophy type 1 (DM1) patients. Here we examined the ability of both DM1 and DM2 patients to recognize emotions expressed by body postures and its relation, and their association with cognitive performance.

METHODS

Participants included 34 DM1 patients, 8 DM2 patients, and 24 healthy control subjects. Emotional recognition ability was assessed through two computerized matching tasks (face and bodies). A neuropsychological battery was used to measure cognition in three domains and global cognition. We used univariate and adjusted linear regression models to investigate the association between cognition and emotion recognition performance.

RESULTS

DM patients (combined DM1 and DM2) performed worse on emotional facial expression (p = .006) and body posture (p = .004) accuracy measures than healthy controls. In linear regression models, DM patients' facial expression accuracy was associated with executive function (p = .013) and visuospatial (p < .001) z-scores. Body posture accuracy was associated with visuospatial (p = .001) and memory (p = .012) z-scores. There were no associations among controls or between cognition and reaction time.

DISCUSSION

These findings suggest that impaired emotional recognition among DM patients is also extended to emotions conveyed by body postures. Consistent with embodied cognition theories, people affected in their body and its movement may have impaired sensorimotor representation in ways that have yet to be fully understood.

Gaze patterns in viewing static and dynamic body expressions

Evidence for the importance of bodily cues for emotion recognition has grown over the last two decades. Despite this growing literature, it is underspecified how observers view whole bodies for body expression recognition. Here we investigate to which extent body-viewing is face- and context-specific when participants are categorizing whole body expressions in static (Experiment 1) and dynamic displays (Experiment 2). Eye-movement recordings showed that observers viewed the face exclusively when visible in dynamic displays, whereas viewing was distributed over head, torso and arms in static displays and in dynamic displays with faces not visible. The strong face bias in dynamic face-visible expressions suggests that viewing of the body responds flexibly to the informativeness of facial cues for emotion categorisation. However, when facial expressions are static or not visible, observers adopt a viewing strategy that includes all upper body regions. This viewing strategy is further influenced by subtle viewing biases directed towards emotion-specific body postures and movements to optimise recruitment of diagnostic information for emotion categorisation.

Beyond Emotions: Oscillations of the Amygdala and Their Implications for Electrical Neuromodulation

The amygdala is a structure involved in emotions, fear, learning and memory and is highly interconnected with other brain regions, for example the motor cortex and the basal ganglia that are often targets of treatments involving electrical stimulation. Deep brain stimulation of the basal ganglia is successfully used to treat movement disorders, but can carry along non-motor side effects. The origin of these non-motor side effects is not fully understood yet, but might be altered oscillatory communication between specific motor areas and the amygdala. Oscillations in various frequency bands have been detected in the amygdala during cognitive and emotional tasks, which can couple with oscillations in cortical regions or the hippocampus. However, data on oscillatory coupling between the amygdala and motor areas are still lacking. This review provides a summary of oscillation frequencies measured in the amygdala and their possible functional relevance in different species, followed by evidence for connectivity between the amygdala and motor areas, such as the basal ganglia and the motor cortex. We hypothesize that the amygdala could communicate with motor areas through coherence of low frequency bands in the theta-alpha range. Furthermore, we discuss a potential role of the amygdala in therapeutic approaches based on electrical stimulation.

Neural Underpinnings of the Perception of Emotional States Derived From Biological Human Motion: A Review of Neuroimaging Research

Research on the perception of biological human motion shows that people are able to infer emotional states by observing body movements. This article reviews the methodology applied in fMRI research on the neural representation of such emotion perception. Specifically, we ask how different stimulus qualities of bodily expressions, individual emotional valence, and task instructions may affect the neural representation of an emotional scene. The review demonstrates the involvement of a variety of brain areas, thereby indicating how well the human brain is adjusted to navigate in multiple social situations. All stimulus categories (i.e., full-light body displays, point-light displays, and avatars) can induce an emotional percept and are associated with increased activation in an extensive neural network. This network seems to be organized around areas belonging to the so-called action observation network (PMC, IFG, and IPL) and the mentalizing network (TPJ, TP, dmPFC, and lOFC) as well as areas processing body form and motion (e.g., EBA, FBA, and pSTS). Furthermore, emotion-processing brain sites such as the amygdala and the hypothalamus seem to play an important role during the observation of emotional body expressions. Whereas most brain regions clearly display an increased response to emotional body movements in general, some structures respond selectively to negative valence. Moreover, neural activation seems to depend on task characteristics, indicating that certain structures are activated even when attention is shifted away from emotional body movements.

Neural Integration in Body Perception

The perception of other people is instrumental in guiding social interactions. For example, the appearance of the human body cues a wide range of inferences regarding sex, age, health, and personality, as well as emotional state and intentions, which influence social behavior. To date, most neuroscience research on body perception has aimed to characterize the functional contribution of segregated patches of cortex in the ventral visual stream. In light of the growing prominence of network architectures in neuroscience, the current article reviews neuroimaging studies that measure functional integration between different brain regions during body perception. The review demonstrates that body perception is not restricted to processing in the ventral visual stream but instead reflects a functional alliance between the ventral visual stream and extended neural systems associated with action perception, executive functions, and theory of mind. Overall, these findings demonstrate how body percepts are constructed through interactions in distributed brain networks and underscore that functional segregation and integration should be considered together when formulating neurocognitive theories of body perception. Insight from such an updated model of body perception generalizes to inform the organizational structure of social perception and cognition more generally and also informs disorders of body image, such as anorexia nervosa, which may rely on atypical integration of body-related information.