Right brain, left brain; left face, right face: hemisphericity and the expression of facial emotion

The Spatiotemporal Dynamics of Facial Movements Reveals the Left Side of a Posed Smile

Humans can recombine thousands of different facial expressions. This variability is due to the ability to voluntarily or involuntarily modulate emotional expressions, which, in turn, depends on the existence of two anatomically separate pathways. The Voluntary (VP) and Involuntary (IP) pathways mediate the production of posed and spontaneous facial expressions, respectively, and might also affect the left and right sides of the face differently. This is a neglected aspect in the literature on emotion, where posed expressions instead of genuine expressions are often used as stimuli. Two experiments with different induction methods were specifically designed to investigate the unfolding of spontaneous and posed facial expressions of happiness along the facial vertical axis (left, right) with a high-definition 3-D optoelectronic system. The results showed that spontaneous expressions were distinguished from posed facial movements as revealed by reliable spatial and speed key kinematic patterns in both experiments. Moreover, VP activation produced a lateralization effect: compared with the felt smile, the posed smile involved an initial acceleration of the left corner of the mouth, while an early deceleration of the right corner occurred in the second phase of the movement, after the velocity peak.

Differential Hemispheric Lateralization of Emotions and Related Display Behaviors: Emotion-Type Hypothesis

There are two well-known hypotheses regarding hemispheric lateralization of emotions. The Right Hemisphere Hypothesis (RHH) postulates that emotions and associated display behaviors are a dominant and lateralized function of the right hemisphere. The Valence Hypothesis (VH) posits that negative emotions and related display behaviors are modulated by the right hemisphere and positive emotions and related display behaviors are modulated by the left hemisphere. Although both the RHH and VH are supported by extensive research data, they are mutually exclusive, suggesting that there may be a missing factor in play that may provide a more accurate description of how emotions are lateralization in the brain. Evidence will be presented that provides a much broader perspective of emotions by embracing the concept that emotions can be classified into primary and social types and that hemispheric lateralization is better explained by the Emotion-type Hypothesis (ETH). The ETH posits that primary emotions and related display behaviors are modulated by the right hemisphere and social emotions and related display behaviors are modulated by the left hemisphere.

Neurophysiology of spontaneous facial expressions: II. Motor control of the right and left face is partially independent in adults

Facial expressions are described traditionally as monolithic or unitary entities. However, humans have the capacity to produce facial blends of emotion in which the upper and lower face simultaneously display different expressions. Recent neuroanatomical studies in monkeys have demonstrated that there are separate cortical motor areas for controlling the upper and lower face in each hemisphere that, presumably, also occur in humans. Using high-speed videography, we began measuring the movement dynamics of spontaneous facial expressions, including facial blends, to develop a more complete understanding of the neurophysiology underlying facial expressions. In our part 1 publication in Cortex (2016), we found that hemispheric motor control of the upper and lower face is overwhelmingly independent; 242 (99%) of the expressions were classified as demonstrating independent hemispheric motor control whereas only 3 (1%) were classified as demonstrating dependent hemispheric motor control. In this companion paper (part 2), 251 unitary facial expressions that occurred on either the upper or lower face were analyzed. 164 (65%) expressions demonstrated dependent hemispheric motor control whereas 87 (35%) expressions demonstrated independent or dual hemispheric motor control, indicating that some expressions represent facial blends of emotion that occur across the vertical facial axis. These findings also support the concepts that 1) spontaneous facial expressions are organized predominantly across the horizontal facial axis and secondarily across the vertical facial axis and 2) facial expressions are complex, multi-component, motoric events. Based on the Emotion-type hypothesis of cerebral lateralization, we propose that facial expressions modulated by a primary-emotional response to an environmental event are initiated by the right hemisphere on the left side of the face whereas facial expressions modulated by a social-emotional response to an environmental event are initiated by the left hemisphere on the right side of the face.

Altered saccadic targets when processing facial expressions under different attentional and stimulus conditions

Depending on a subject's attentional bias, robust changes in emotional perception occur when facial blends (different emotions expressed on upper/lower face) are presented tachistoscopically. If no instructions are given, subjects overwhelmingly identify the lower facial expression when blends are presented to either visual field. If asked to attend to the upper face, subjects overwhelmingly identify the upper facial expression in the left visual field but remain slightly biased to the lower facial expression in the right visual field. The current investigation sought to determine whether differences in initial saccadic targets could help explain the perceptual biases described above. Ten subjects were presented with full and blend facial expressions under different attentional conditions. No saccadic differences were found for left versus right visual field presentations or for full facial versus blend stimuli. When asked to identify the presented emotion, saccades were directed to the lower face. When asked to attend to the upper face, saccades were directed to the upper face. When asked to attend to the upper face and try to identify the emotion, saccades were directed to the upper face but to a lesser degree. Thus, saccadic behavior supports the concept that there are cognitive-attentional pre-attunements when subjects visually process facial expressions. However, these pre-attunements do not fully explain the perceptual superiority of the left visual field for identifying the upper facial expression when facial blends are presented tachistoscopically. Hence other perceptual factors must be in play, such as the phenomenon of virtual scanning.

Facial Expressions are More Easily Produced on the Upper-Lower Compared to the Right-Left Hemiface

Clinical research has concentrated on differences in intensity of expression between the right and left hemiface as a means to assess hemispheric differences in motor control. However, observations by social psychologists suggest that control of facial expression may be organized predominantly across the upper-lower hemiface because during social interactions individuals may produce brief facial blends of emotions, in which the upper and lower face display a different emotion. Full facial versus upper/lower and right/left facial blends of emotion were posed by 20 subjects, 10 men and 10 women ranging in age from 20 to 37 years. The subjects rated the difficulty of each pose on a 5-point Likert scale. Digital photographs of the poses were taken and the full and half-facial poses were shown in random order to four judges who indicated what pose was being performed. The results were very robust and confirmed that facial blends of emotion are more easily and accurately posed on the upper-lower than on the right-left hemiface. Our results are consistent with recent anatomical studies showing separate cortical areas for motor control of the upper versus lower face in primates. Based on recent research exploring hemispheric differences in perceiving facial blends of emotion, the left hemisphere may be more involved with modulating lower facial expressions and the right hemisphere more involved with modulating upper facial expressions.

Decoding facial blends of emotion: visual field, attentional and hemispheric biases

Most clinical research assumes that modulation of facial expressions is lateralized predominantly across the right-left hemiface. However, social psychological research suggests that facial expressions are organized predominantly across the upper-lower face. Because humans learn to cognitively control facial expression for social purposes, the lower face may display a false emotion, typically a smile, to enable approach behavior. In contrast, the upper face may leak a person's true feeling state by producing a brief facial blend of emotion, i.e. a different emotion on the upper versus lower face. Previous studies from our laboratory have shown that upper facial emotions are processed preferentially by the right hemisphere under conditions of directed attention if facial blends of emotion are presented tachistoscopically to the mid left and right visual fields. This paper explores how facial blends are processed within the four visual quadrants. The results, combined with our previous research, demonstrate that lower more so than upper facial emotions are perceived best when presented to the viewer's left and right visual fields just above the horizontal axis. Upper facial emotions are perceived best when presented to the viewer's left visual field just above the horizontal axis under conditions of directed attention. Thus, by gazing at a person's left ear, which also avoids the social stigma of eye-to-eye contact, one's ability to decode facial expressions should be enhanced.

Posed versus spontaneous facial expressions are modulated by opposite cerebral hemispheres

Clinical research has indicated that the left face is more expressive than the right face, suggesting that modulation of facial expressions is lateralized to the right hemisphere. The findings, however, are controversial because the results explain, on average, approximately 4% of the data variance. Using high-speed videography, we sought to determine if movement-onset asymmetry was a more powerful research paradigm than terminal movement asymmetry. The results were very robust, explaining up to 70% of the data variance. Posed expressions began overwhelmingly on the right face whereas spontaneous expressions began overwhelmingly on the left face. This dichotomy was most robust for upper facial expressions. In addition, movement-onset asymmetries did not predict terminal movement asymmetries, which were not significantly lateralized. The results support recent neuroanatomic observations that upper versus lower facial movements have different forebrain motor representations and recent behavioral constructs that posed versus spontaneous facial expressions are modulated preferentially by opposite cerebral hemispheres and that spontaneous facial expressions are graded rather than non-graded movements.

Human Facial Expressions Are Organized Functionally Across the Upper-Lower Facial Axis

Most clinical research has focused on intensity differences of facial expressions between the right and left hemiface to explore lateralization of emotions in the brain. Observations by social psychologists, however, suggest that control of facial expression is organized predominantly across the upper-lower facial axis because of the phenomena of facial blends: simultaneous display of different emotions on the upper and lower face. Facial blends are related to social emotions and development of display rules that allow individuals to sculpt facial expressions for social and manipulative purposes. We have demonstrated that facial blends of emotion are more easily and accurately posed on the upper-lower than right-left hemiface, and that upper facial emotions are processed preferentially by the right hemisphere whereas lower facial emotions are processed preferentially by the left hemisphere. Based on these results, recent anatomical studies showing separate cortical areas for motor control of upper and lower face and the neurology of posed and spontaneous expressions of emotion, a functional-anatomic model of how the forebrain modulates facial expressions, is presented. The unique human ability to produce facial blends of emotion is, most likely, an adaptive modification linked to the evolution of speech and language. NEUROSCIENTIST 13(5):433—446, 2007.

Uncrossed cortico-muscular projections in humans are abundant to facial muscles of the upper and lower face, but may differ between sexes

It is a popular concept in clinical neurology that muscles of the lower face receive predominantly crossed cortico-bulbar motor input, whereas muscles of the upper face receive additional ipsilateral, uncrossed input. To test this notion, we used focal transcranial magnetic brain stimulation to quantify crossed and uncrossed cortico-muscular projections to 6 different facial muscles (right and left Mm. frontalis, nasalis, and orbicularis oris) in 36 healthy right-handed volunteers (15 men, 21 women, mean age 25 years). Uncrossed input was present in 78% to 92% of the 6 examined muscles. The mean uncrossed: crossed response amplitude ratios were 0.74/0.65 in right/left frontalis, 0.73/0.59 in nasalis, and 0.54/0.71 in orbicularis oris; ANOVA p>0.05). Judged by the sizes of motor evoked potentials, the cortical representation of the 3 muscles was similar. The amount of uncrossed projections was different between men and women, since men had stronger left-to-left projections and women stronger right-to-right projections. We conclude that the amount of uncrossed pyramidal projections is not different for muscles of the upper from those of the lower face. The clinical observation that frontal muscles are often spared in central facial palsies must, therefore, be explained differently. Moreover, gender specific lateralization phenomena may not only be present for higher level behavioural functions, but may also affect simple systems on a lower level of motor hierarchy.

Neuropsychological aspects of facial asymmetry during emotional expression: a review of the normal adult literature

This review focuses on facial asymmetries during emotional expression. Facial asymmetry is defined as the expression intensity or muscular involvement on one side of the face ("hemiface") relative to the other side and has been used as a behavioral index of hemispheric specialization for facial emotional expression. This paper presents a history of the neuropsychological study of facial asymmetry, originating with Darwin. Both quantitative and qualitative aspects of asymmetry are addressed. Next, neuroanatomical bases for facial expression are elucidated, separately for posed/voluntary and spontaneous/involuntary elicitation conditions. This is followed by a comprehensive review of 49 experiments of facial asymmetry in the adult literature, oriented around emotional valence (pleasantness/unpleasantness), elicitation condition, facial part, social display rules, and demographic factors. Results of this review indicate that the left hemiface is more involved than the right hemiface in the expression of facial emotion. From a neuropsychological perspective, these findings implicate the right cerebral hemisphere as dominant for the facial expression of emotion. In spite of the compelling evidence for right-hemispheric specialization, some data point to the possibility of differential hemispheric involvement as a function of emotional valence.

Laterality in facial expressions and its effect on attributions of emotion and personality: a reconsideration

Are there consistent differences between the emotions attributed to the right and left hemiface? Six studies investigated this old question, using a new technique of computerized image reconstruction that eliminates several confounding factors common in previous studies. Findings suggest that there are no consistent differences between the emotions and personality attributed to the right and the left hemiface. Nevertheless, when the two hemifaces were simultaneously compared on intensity, the left hemiface showed greater intensity in posed smiles. As a whole, the present study suggests the possibility of a slight inference of brain laterality in posed expressions, but not in resting faces.

Differential asymmetries for positive and negative emotion: hemisphere or stimulus effects?

Two experiments were carried out to determine whether expressive asymmetries in facial stimuli might underlie evidence of differential hemispheric responses to positive and negative emotion. Experiment 1 systematically varied stimulus orientation; Experiment 2 included both normally oriented and reversed (mirror-image) faces. We replicated previous reports of a left field advantage for happy faces and a right field superiority for sad faces only when normally oriented faces were used. Mirror-image stimuli tended to produce the opposite pattern of results, and a combination of the two (Exp. 2) eliminated the visual field differences for each emotion. The findings underscore the importance of controlling for stimulus asymmetries in visual laterality studies, and are discussed in terms of current notions about the lateralization of both the perception and expression of emotion.

Voluntary emotional facial expressions in patients with focal cerebral lesions

This study investigates the voluntary production of emotional facial expressions in 43 brain-damaged and 9 control subjects. The expressions of right- and left-hemisphere lesion groups did not differ significantly, but those of the anterior lesion group were impoverished relative to the posterior lesion and control groups. Deficits of voluntary expression were dissociable from impairments in "non-emotional" facial-motor functions, dysphasia, and unilateral neglect.

Hemisphericity and personality

Hemisphericity was originally defined with regard to cognitive processes only. This paper describes a brief personality questionnaire derived from work on personality changes in temporal lobe epilepsy as a method of demonstrating the existence of hemisphericity as a personality characteristic. A factor analysis of the Personal Inventory (Bear & Fedio, 1977) in a normal sample suggests the existence of a right and a left hemisphere component to the personality traits tapped by the scale. Three separate validity studies of a questionnaire developed from the factor analysis, utilizing cognitive, affective and general personality measures provide confirmation. Left hemisphericity types are characterized as possessing greater control over their impulses, experiencing less generalized tension, being more trusting and imaginative and viewing themselves in a positive light. Right hemisphericity types are characterized as possessing less control over their impulses, being tense, suspicious, shy and pragmatic and viewing themselves in a negative light.

What can asymmetry and laterality in EMG tell us about the face and brain?

This paper will review the use of the electromyographic (EMG) technique for studying asymmetry and laterality in facial behavior. My discussion will include several issues: (1) a review of the neurology of facial expression with respect to asymmetry/laterality; (2) a compendium of models of cerebral hemispheric participation in emotion and in facial motor control that imply asymmetry-laterality in facial behavior; (3) a summary of facial asymmetry-laterality findings to date; and (4) uses and abuses of EMG techniques in inferring asymmetry-laterality in facial behavior. I conclude with (5) recommendations for future facial asymmetry-laterality research in general.

Left-sided oral asymmetries in spontaneous but not posed smiles

To investigate possible facial asymmetries during the production of posed and spontaneous smiles, the displacement of various reference points on the mouth were measured as subjects produced both kinds of smiles. Strobe cameras were used in combination with a computer-based analysis to record the smiles of left- and right-handed males and females. The analysis revealed that the left side of the mouth moved more than the right side during spontaneous but not posed smiles, supporting the notion that the right hemisphere may play a special role in emotional expression. This asymmetry was most apparent in left-handed females and right-handed males. These sex and handedness differences are discussed with reference to apparent inconsistencies in previous research on asymmetries in emotional expression.

Reactions of patients with focal cerebral lesions to success or failure

Multiple measures were used to investigate emotional reactions to card sorting in patients with focal cerebral lesions and in matched non-brain-injured controls. Spontaneous facial expressions of patients with anterior lesions were impoverished, relative to the posterior group, on a quantitative index of facial movement. This deficit did not appear to be attributable to group differences on lesion variables, or degree of cognitive deficit. There were also indications that a "non-emotional" facial-motor deficit was not the primary cause. The marked anterior deficit for facial movement was not, however, associated with equally pronounced deficits on qualitative, self-report and heart rate indices of emotional response. Right hemisphere patients differed from left hemisphere patients on only one qualitative measure of emotional reaction, but this may have been due to the stronger negative reactions of dysphasic patients. Left unilateral neglect was not associated with reduced emotional response.

Hemispheric asymmetries in the perception of emotional and neutral faces

This study was designed to investigate hemispheric asymmetries in the perception of both positive and negative emotion, while minimizing extraneous factors known to favour right hemisphere processes. Pairs of faces (happy-neutral or sad-neutral) were presented, one to each visual field, and subjects responded to the face that made them feel either better or worse. Performance was superior when the emotional faces were presented to the left visual field-right hemisphere. This occurred in both the better and the worse conditions, and for both sexes. Indeed, the data indicate that all emotional stimuli were being processed by the right hemisphere, and that the effect for emotional faces is due to the expressions and not merely the faces themselves.

Cognitive task influence on relative hemispheric motor control: mouth asymmetry and lateral eye movements

While strictly verbal cognitive tasks showed a strong left-hemisphere dominance, the presence of visualization and emotion in cognitive tasks resulted in increased involvement of the right hemisphere in motor control of speech as measured by mouth asymmetry. Spontaneous smiles showed right-hemisphere dominance. Lateral eye movements showed an unexpected shift to left gaze during speech which may suggest a dual task interference between speech and gaze motor control.