Sensitivity to emotional expressions and situations in organic patients

Affective Prosody and Its Impact on the Neurology of Language, Depression, Memory and Emotions

Based on the seminal publications of Paul Broca and Carl Wernicke who established that aphasic syndromes (disorders of the verbal-linguistic aspects of communication) were predominantly the result of focal left-hemisphere lesions, "language" is traditionally viewed as a lateralized function of the left hemisphere. This, in turn, has diminished and delayed the acceptance that the right hemisphere also has a vital role in language, specifically in modulating affective prosody, which is essential for communication competency and psychosocial well-being. Focal lesions of the right hemisphere may result in disorders of affective prosody (aprosodic syndromes) that are functionally and anatomically analogous to the aphasic syndromes that occur following focal left-hemisphere lesions. This paper will review the deductive research published over the last four decades that has elucidated the neurology of affective prosody which, in turn, has led to a more complete and nuanced understanding of the neurology of language, depression, emotions and memory. In addition, the paper will also present the serendipitous clinical observations (inductive research) and fortuitous inter-disciplinary collaborations that were crucial in guiding and developing the deductive research processes that culminated in the concept that primary emotions and related display behaviors are a lateralized function of the right hemisphere and social emotions, and related display behaviors are a lateralized function of the left hemisphere.

The Analysis of Emotion Authenticity Based on Facial Micromovements

People tend to display fake expressions to conceal their true feelings. False expressions are observable by facial micromovements that occur for less than a second. Systems designed to recognize facial expressions (e.g., social robots, recognition systems for the blind, monitoring systems for drivers) may better understand the user's intent by identifying the authenticity of the expression. The present study investigated the characteristics of real and fake facial expressions of representative emotions (happiness, contentment, anger, and sadness) in a two-dimensional emotion model. Participants viewed a series of visual stimuli designed to induce real or fake emotions and were signaled to produce a facial expression at a set time. From the participant's expression data, feature variables (i.e., the degree and variance of movement, and vibration level) involving the facial micromovements at the onset of the expression were analyzed. The results indicated significant differences in the feature variables between the real and fake expression conditions. The differences varied according to facial regions as a function of emotions. This study provides appraisal criteria for identifying the authenticity of facial expressions that are applicable to future research and the design of emotion recognition systems.

At the Neural Intersection Between Language and Emotion

What role does language play in emotion? Behavioral research shows that emotion words such as "anger" and "fear" alter emotion experience, but questions still remain about mechanism. Here, we review the neuroscience literature to examine whether neural processes associated with semantics are also involved in emotion. Our review suggests that brain regions involved in the semantic processing of words: (i) are engaged during experiences of emotion, (ii) coordinate with brain regions involved in affect to create emotions, (iii) hold representational content for emotion, and (iv) may be necessary for constructing emotional experience. We relate these findings with respect to four theoretical relationships between language and emotion, which we refer to as "non-interactive," "interactive," "constitutive," and "deterministic." We conclude that findings are most consistent with the interactive and constitutive views with initial evidence suggestive of a constitutive view, in particular. We close with several future directions that may help test hypotheses of the constitutive view.

A conceptual critique of brain lateralization models in emotional face perception: Toward a hemispheric functional-equivalence (HFE) model

The present review proposes a novel dynamic model of brain lateralization of emotional (happy, surprised, fearful, sad, angry, and disgusted) and neutral face perception. Evidence to date suggests that emotional face perception is lateralized in the brain. At least five prominent hypotheses of the lateralization of emotional face perception have been previously proposed; the right-hemisphere hypothesis; the valence-specific hypothesis; the modified valence-specific hypothesis; the motivational hypothesis; and behavioral activation/inhibition system hypothesis. However, a growing number of recent replication studies exploring those hypotheses frequently provide inconsistent or even contradictory results. The latest neuroimaging and behavioral studies strongly demonstrate the functional capacity of both hemispheres to process emotions relatively successfully. Moreover, the flexibility of emotional brain-networks in both hemispheres is functionally high even to the extent of a possible reversed asymmetry of the left and the right hemisphere performance under altered neurophysiological and psychological conditions. The present review aims to a) provide a critical conceptual analysis of prior and current hypotheses of brain lateralization of emotional and neutral face perception; b) propose an integrative introduction of a novel hemispheric functional-equivalence (HFE) model in emotional and neutral face perception based on the evaluation of theoretical considerations, behavioral and neuroimaging studies: the brain is initially right-biased in emotional and neutral face perception by default; however, altered psychophysiological conditions (e.g., acute stress, a demanding emotional task) activate a distributed brain-network of both hemispheres toward functional equivalence that results in relatively equalized behavioral performance in emotional and neutral face perception. The proposed novel model may provide a practical tool in further experimental investigation of brain lateralization of emotional face perception.

Widespread and lateralized social brain activity for processing dynamic facial expressions

Dynamic facial expressions of emotions constitute natural and powerful means of social communication in daily life. A number of previous neuroimaging studies have explored the neural mechanisms underlying the processing of dynamic facial expressions, and indicated the activation of certain social brain regions (e.g., the amygdala) during such tasks. However, the activated brain regions were inconsistent across studies, and their laterality was rarely evaluated. To investigate these issues, we measured brain activity using functional magnetic resonance imaging in a relatively large sample (n = 51) during the observation of dynamic facial expressions of anger and happiness and their corresponding dynamic mosaic images. The observation of dynamic facial expressions, compared with dynamic mosaics, elicited stronger activity in the bilateral posterior cortices, including the inferior occipital gyri, fusiform gyri, and superior temporal sulci. The dynamic facial expressions also activated bilateral limbic regions, including the amygdalae and ventromedial prefrontal cortices, more strongly versus mosaics. In the same manner, activation was found in the right inferior frontal gyrus (IFG) and left cerebellum. Laterality analyses comparing original and flipped images revealed right hemispheric dominance in the superior temporal sulcus and IFG and left hemispheric dominance in the cerebellum. These results indicated that the neural mechanisms underlying processing of dynamic facial expressions include widespread social brain regions associated with perceptual, emotional, and motor functions, and include a clearly lateralized (right cortical and left cerebellar) network like that involved in language processing.

Effects of Repeated Concussions and Sex on Early Processing of Emotional Facial Expressions as Revealed by Electrophysiology

OBJECTIVES

Concussions affect the processing of emotional stimuli. This study aimed to investigate how sex interacts with concussion effects on early event-related brain potentials (ERP) measures (P1, N1) of emotional facial expressions (EFE) processing in asymptomatic, multi-concussion athletes during an EFE identification task.

METHODS

Forty control athletes (20 females and 20 males) and 43 multi-concussed athletes (22 females and 21 males), recruited more than 3 months after their last concussion, were tested. Participants completed the Beck Depression Inventory II, the Beck Anxiety Inventory, the Post-Concussion Symptom Scale, and an Emotional Facial Expression Identification Task. Pictures of male and female faces expressing neutral, angry, and happy emotions were randomly presented and the emotion depicted had to be identified as fast as possible during EEG acquisition.

RESULTS

Relative to controls, concussed athletes of both sex exhibited a significant suppression of P1 amplitude recorded from the dominant right hemisphere while performing the emotional face expression identification task. The present study also highlighted a sex-specific suppression of the N1 component amplitude after concussion which affected male athletes.

CONCLUSIONS

These findings suggest that repeated concussions alter the typical pattern of right-hemisphere response dominance to EFE in early stages of EFE processing and that the neurophysiological mechanisms underlying the processing of emotional stimuli are distinctively affected across sex. (JINS, 2018, 24, 673-683).

Emotions Are Rising: The Growing Field of Affect Neuropsychology

Thirty years ago, the neuropsychology of emotion started to emerge as a mainstream topic. Careful examination of individual patients showed that emotion, like memory, language, and so on, could be differentially affected by brain disorders, especially in the right hemisphere. Since then, there has been accelerating interest in uncovering the neural architecture of emotion, and the major steps in this process of discovery over the past 3 decades are detailed in this review. In the 1990s, magnetic resonance imaging (MRI) scans provided precise delineation of lesions in the amygdala, medial prefrontal cortex, insula and somatosensory cortex as underpinning emotion disorders. At the same time, functional MRI revealed activation that was bilateral and also lateralized according to task demands. In the 2000s, converging evidence suggested at least two routes to emotional responses: subcortical, automatic and autonomic responses and slower, cortical responses mediating cognitive processing. The discovery of mirror neurons in the 1990s reinvigorated older views that simulation was the means to recognize emotions and empathize with others. More recently, psychophysiological research, revisiting older Russian paradigms, has contributed new insights into how autonomic and other physiological indices contribute to decision making (the somatic marker theory), emotional simulation, and social cognition. Finally, this review considers the extent to which these seismic changes in understanding emotional processes in clinical disorders have been reflected in neuropsychological practice. (JINS, 2017, 23, 719-731).

Processing of Unattended Emotional Facial Expressions: Correlates of Visual Field Bias in Women

Lateralization in emotional processing is a matter of ongoing debate. Various factors can influence lateralized emotional processing, including stimulus location, emotional valence, and gender. In the present study, we aim to elucidate how unattended emotional facial expressions shown at different locations in the visual field influence behavioral responses, eye movement, and neural responses in a sample of healthy women. Our female participants viewed fearful, happy and neutral faces presented at central and peripheral (left or right) locations while keeping their gaze locked on a central fixation crosshairs and indicating stimulus location via button presses. Throughout the experiment, we monitored fixation and gaze shifts by means of eye tracking. We analyzed eye movements, neural and behavioral responses from n = 18 participants with excellent tracking and task performance. Face stimuli presented in the left hemifield entailed the fastest reactions irrespective of face valence. Unwarranted gaze shifts away from central fixation were rare and mainly directed at peripherally presented stimuli. A distributed neural network comprising the right amygdala, left temporal pole, left middle temporal gyrus, right superior frontal gyrus, and right posterior putamen differentially responded to centrally presented fearful faces, and to peripherally presented neutral and happy faces, especially when they appeared in the left hemifield. Our findings point to a visual field bias on the behavioral and neural level in our female sample. Reaction times, eye movements and neural activations varied according to stimulus location. An interactive effect of face location with face valence was present at the neural level but did not translate to behavioral or eye movement responses.

Narratives of focal brain injured individuals: A macro-level analysis

Focal brain injury can have detrimental effects on the pragmatics of communication. This study examined narrative production by unilateral brain damaged people (n=36) and healthy controls and focused on the complexity (content and coherence) and the evaluative aspect of their narratives to test the general hypothesis that the left hemisphere is biased to process microlinguistic information and the right hemisphere is biased to process macrolinguistic information. We found that people with left hemisphere damage's (LHD) narratives were less likely to maintain the overall theme of the story and produced fewer evaluative comments in their narratives. These deficits correlated with their performances on microlinguistic linguistic tasks. People with the right hemisphere damage (RHD) seemed to be preserved in expressing narrative complexity and evaluations as a group. Yet, single case analyses revealed that particular regions in the right hemisphere such as damage to the dorsolateral prefrontal cortex (DLPFC), the anterior and superior temporal gyrus, the middle temporal gyrus, and the supramarginal gyrus lead to problems in creating narratives. Our findings demonstrate that both hemispheres are necessary to produce competent narrative production. LHD people's poor production is related to their microlinguistic language problems whereas RHD people's impaired abilities can be associated with planning and working memory abilities required to relate events in a narrative.

Perception of Emotional Prosody: Moving Toward a Model That Incorporates Sex-Related Differences

The overall purpose of this article is to review the literature that addresses the theoretical models, neuroanatomical mechanisms, and sex-related differences in the perception of emotional prosody. Specifically, the article focuses on the right-hemisphere model of emotion processing as it pertains to the perception of emotional prosody. This article also reviews more recent research that implicates a role for the left hemisphere and subcortical structures in the perception of emotional prosody. The last major section of this article addresses sex-related differences and the potential influence of hormones on the perception of emotional prosody. The article concludes with a section that offers directions for future research.

Brain Lateralization of Emotional Processing: Historical Roots and a Future Incorporating “Dominance”

This article provides a review of research on the hemispheric specialization in emotional processing during the past 40 years and the theoretical models derived from the conceptual analysis of these results. The publications reviewed here were collected to better appreciate the cortical lateralization of emotional perception (visual and auditory), expression (facial and prosodic), and experience. Four major models of emotional processing are discussed—the Right Hemisphere, Valence, Approach-Withdrawal, and Behavioral Inhibition System–Behavioral Activation System models. Observing the relative merits and limitations of these models, a new direction for exploration is offered. Specifically, to better appreciate the strength and direction (i.e., approach versus withdrawal) of experienced emotions, it is recommended that state “dominance” be evaluated in the context of asymmetrical activation of left-frontal (dominance) versus right-frontal (submission) brain regions.

Are You Crying or Laughing? Emotion Recognition Deficits After Severe Traumatic Brain Injury

To date there has been little research concerning the neuropsychological mechanisms of emotion perception deficits following traumatic brain injury (TBI), although such deficits are well documented. This paper considers two major issues. First, are emotion-processing deficits found regardless of the media of presentation? In a recent study examining this issue, adults with severe TBI were found to have particular problems identifying emotions from conversational tone, as well as difficulties when presented with still photographs and audiovisual dynamic displays (videoed vignettes). They were relatively normal when asked to classify emotions on the basis of moving visual displays without sound. This may reflect the fact that the parietal cortices, important for processing movement, are relatively unscathed in TBI. The second issue concerns whether emotion recognition is facilitated by empathic emotional responses and whether these are diminished in people with TBI. Evidence is presented for a relation between subjective reports of diminished emotional experience and emotion recognition accuracy. Finally, preliminary data suggests that people with TBI may fail to have empathic reactions when asked to passively view emotional expressions.

Recognition of Natural Expressions of Emotion by CVA Patients with Damage to the Left or Right Hemisphere

The present study investigated the ability of cerebrovascular accident (CVA) patients to perceive emotions portrayed by realistic stimuli. Statistical analyses demonstrated that CVA patients with damage to either the right or left cerebral hemisphere performed, on average, as well as controls did in perceiving emotions. However, a case study of one patient suggested that there may be a subset of CVA patients with right parieto-occipital damage who have deficits in the perception of negative emotions. The performance of this participant also indicated that deficits in emotion perception are ameliorated to some extent when patients are provided with realistic, complex stimuli that include a range of auditory and visual cues.

Cerebral localization of functions and the neurology of language: fact versus fiction or is it something else?

Over the last 15 years there has been a burgeoning number of publications using functional brain imaging (>40,000 articles based on an ISI/Web of Science search) to localize behavioral and cognitive processes to specific areas in the human brain that are often not confirmed by traditional, lesion-based studies. Thus, there is a need to reassess what cerebral localization of functions is and is not. Otherwise, there is no rational way to interpret the escalating claims of localization in the functional imaging literature that is taking on the appearance of neurophysiologic "phrenology". This article will present arguments to suggest that functional localization in the brain is a robust but very dynamic, four-dimensional process. It is a learned phenomenon driven over time by large-scale, spatially distributed, neural networks seeking to efficiently maximize the processing, storage, and manipulation of information for cognitive and behavioral operations. Because of historical considerations and space limitations, the main focus will be on localization of language-related functions whose theoretical neurological basis can be generalized for any complex cognitive-behavioral function.

Temporal pole activity during perception of sad faces, but not happy faces, correlates with neuroticism trait

It is known that the temporal cortex is involved in perception of emotional facial expressions, and the involvement is relatively independent of the emotional valence of those expressions. The present study revealed a valence-dependent aspect of the temporal cortex through individual differences analyses involving the neuroticism trait, one of the representative affective personality traits. Functional MRI was administered while subjects classified expressions of faces, and neuroticism scores were obtained from individual subjects. Significant brain activity was observed in the temporal pole (TP) during perception of both happy and sad expressions relative to neutral expressions. Correlational analyses revealed that TP activity during perception of sad expressions, but not happy expressions, correlated with the neuroticism scores. These results demonstrate differential roles for the temporal cortex in perception of happy and sad faces, and suggest that TP recruitment during understanding of negative emotions is dependent on the personality of the individuals.

Neurology of affective prosody and its functional-anatomic organization in right hemisphere

Unlike the aphasic syndromes, the organization of affective prosody in brain has remained controversial because affective-prosodic deficits may occur after left or right brain damage. However, different patterns of deficits are observed following left and right brain damage that suggest affective prosody is a dominant and lateralized function of the right hemisphere. Using the Aprosodia Battery, which was developed to differentiate left and right hemisphere patterns of affective-prosodic deficits, functional-anatomic evidence is presented in patients with focal ischemic strokes to support the concepts that (1) affective prosody is a dominant and lateralized function of the right hemisphere, (2) the intrahemispheric organization of affective prosody in the right hemisphere, with the partial exception of Repetition, is analogous to the organization of propositional language in the left hemisphere and (3) the aprosodic syndromes are cortically based as part of evolutionary adaptations underlying human language and communication.

The representation of discourse in the two hemispheres: an individual differences investigation

Two experiments were conducted to investigate discourse representation in the two cerebral hemispheres as a function of reading skill. We used a lateralized visual-field procedure to compare left hemisphere (LH) and right hemisphere (RH) sensitivity to different discourse relations in readers with varying skill levels. In Experiment 1, we investigated two levels of discourse representation in memory: (a) the propositional representation and (b) the discourse model. We found that all readers were sensitive to propositional relations in the LH. In contrast, sensitivity to propositional relations in the RH increased as a function of reading skill. In addition, reading skill was positively related to topic relations in the LH, whereas it was negatively in the RH. In Experiment 2, we investigated propositional relations of different distances and again found that all readers were sensitive to propositional relations in the LH, whereas sensitivity to propositional relations in the RH was negatively related to reading skill. In general, reading skill appears to be associated with left-lateralized discourse representations.

Disordered emotional processing in schizophrenia and one-sided brain damage

The work concentrates on the problem of human emotions in healthy and pathologically changed brains, mainly in persons afflicted with schizophrenia or with organic impairments localized in one of the cerebral hemispheres. This chapter presents the state of current knowledge concerning the hemispheric lateralization of emotions among healthy people, psychiatric patients, and patients with one-sided brain lesion, on the basis of clinical observations, the results of experimental work, and the newest neuroimaging techniques. The numerous experiments and scientific methods used to assess the hemispheric lateralization of emotions and the discrepancies in their results point toward a lack of consistent theory in the field of hemispheric specialization in the regulation of emotional processes. Particular scientific interest was taken in the emotions of persons afflicted with schizophrenia, either in its early or late stages. This was inspired by the emotional behavior of schizophrenic patients on a psychiatric ward and their ability to perceive and express emotions during various stages of the schizophrenic process. In order to examine the cerebral manifestations of emotional deficits and the specialization of cerebral hemispheres for emotional processes, the author has described the emotional behavior of patients with unilateral cerebral stroke, i.e., patients with damage to the right or left cerebral hemisphere. Overall, the inferior performance of emotional tasks by right-hemisphere-damaged patients compared to other groups might support right-hemisphere superiority for affect perception despite variations in the stimuli used.

Social cognition and epilepsy surgery

Human social behavior depends on a set of perceptive, mnemonic, and interpretive abilities that together may be termed social cognition. Lesion and functional imaging studies of social cognitive functions implicate the temporal lobes (in particular, the nondominant temporal lobe) and mesial temporal structures as critical at the front end of social cognitive processes. The frontal lobes, in turn, function to interpret and to modulate these processes via top-down control. Damage to frontal regions is associated with specific derangements in social behavior. Chronic focal-onset epilepsy and its surgical treatment commonly affect these neuroanatomic regions and might therefore impact social function. Postoperative social function helps determine quality of life for both patients and families. There is some evidence that resective seizure surgery affects social cognition, but there are significant weaknesses in our current knowledge that can be overcome with comprehensive longitudinal research.

Differential impairment in recognition of emotion across different media in people with severe traumatic brain injury

Recent evidence suggests that there may be dissociable systems for recognizing emotional expressions from different media including audio and visual channels, and still versus moving displays. In this study, 34 adults with severe traumatic brain injuries (TBI) and 28 adults without brain injuries were assessed for their capacity to recognize emotional expressions from dynamic audiovisual displays, conversational tone alone, moving facial displays, and still photographs. The TBI group were significantly impaired in their interpretation of both audio and audiovisual displays. In addition, eight of the 34 were significantly impaired in their capacity to recognize still facial expressions. In contrast, only one individual was impaired in the recognition of moving visual displays. Information processing speed was not found to play a significant role in producing problems with dynamic emotional expression. Instead the results suggest that visual moving displays may enlist different brain systems to those engaged with still displays, for example, the parietal cortices. Problems with the processing of affective prosody, while present, were not clearly related to other emotion processing problems. While this may attest to the independence of the auditory affective system, it may also reflect problems with the dual demands of listening to conversational meaning and affective tone.

Asymmetric bias in perception of facial affect among Roman and Arabic script readers

The asymmetric chimeric faces test is used frequently as an indicator of right hemisphere involvement in the perception of facial affect, as the test is considered free of linguistic elements. Much of the original research with the asymmetric chimeric faces test was conducted with subjects reading left-to-right Roman script, i.e., English. As readers of right-to-left scripts, such as Arabic, demonstrated a mixed or weak rightward bias in judgements of facial affect, the influence of habitual scanning direction was thought to intersect with laterality. We administered the asymmetric chimeric faces test to 1239 adults who represented a range of script experience, i.e., Roman script readers (English and French), Arabic readers, bidirectional readers of Roman and Arabic scripts, and illiterates. Our findings supported the hypothesis that the bias in facial affect judgement is rooted in laterality, but can be influenced by script direction. Specifically, right-handed readers of Roman script demonstrated the greatest mean leftward score, and mixed-handed Arabic script readers demonstrated the greatest mean rightward score. Biliterates showed a gradual shift in asymmetric perception, as their scores fell between those of Roman and Arabic script readers, basically distributed in the order expected by their handedness and most often used script. Illiterates, whose only directional influence was laterality, showed a slight leftward bias.

Impact of right hemispheric damage on a hierarchy of complexity evidenced in young normal subjects

The occurrence of a right-hemisphere lesion can interfere with pragmatic abilities and particularly with the processing of non-literal speech acts in which the listener has to identify the speaker's intention. The aim of this study was to test RHD subjects' ability to process non-literal speech acts. A chronometric approach to RHD and matched control performance showed that RHD subjects are impaired in the processing of non-literal speech, though they are also sensitive to the hierarchy of complexity among types. Only the processing of indirect speech acts was not shown to differ from that of normals, probably because the stimuli were of the conventional type. These results show the relevancy of a chronometric approach. They also emphasize the importance of further studying RHD subjects' ability to attribute intentions to protagonists in a short story.

Face and facial expression memory in temporal lobe epilepsy patients: preliminary results

Right temporal lobe structures are involved in face and facial expression processing and in mnestic functions. Face and facial expression memory was investigated in 15 patients with left (LTLE) and 18 patients with right (RTLE) temporal lobe epilepsy as well as 13 healthy controls. Pairs of pictures combining four faces and four emotions had to be matched according to face identity or facial expression. In the memory tasks, the two pictures of a pair were divided by a memory interval of 2000 milliseconds, whereas in the perception tasks (control condition) both pictures were presented simultaneously. RTLE patients had significantly lower scores than healthy controls in face memory. LTLE patients had significantly lower scores than healthy controls in face and facial expression memory. The data confirm impaired face memory in RTLE patients and show that LTLE patients display deficits in face as well as in facial expression memory. Results are discussed according to functional reorganization, memory strategies, perception performance, naming problems, and group characteristics.

Emotional processing deficits in individuals with unilateral brain damage

This article presents a review of the neural mechanisms underlying emotional processing deficits (EPDs) in individuals with unilateral brain damage. First, key theoretical issues pertaining to the neuropsychology of emotion are presented. These include parameters of emotional processing, the componential approach, emotional domains, and hypotheses regarding hemispheric specialization for emotion. Second, the literature on hemispheric asymmetries for emotion is reviewed in terms of processing mode (perception and expression) and communication channel (facial, prosodic-intonational, and lexical-verbal). Studies involving normal adults and individuals with right- or left-sided brain damage are reviewed. Third, recent findings identifying the role of the right hemisphere in emotional processing are described. The article is concluded by aligning these new data with findings from the general literature, providing added support for the right-hemisphere emotion hypothesis.

Visual scanning of faces in autism

The visual scanpaths of five high-functioning adult autistic males and five adult male controls were recorded using an infrared corneal reflection technique as they viewed photographs of human faces. Analyses of the scanpath data revealed marked differences in the scanpaths of the two groups. The autistic participants viewed nonfeature areas of the faces significantly more often and core feature areas of the faces (i.e., eyes, nose, and mouth) significantly less often than did control participants. Across both groups of participants, scanpaths generally did not differ as a function of the instructions given to the participants (i.e., "Please look at the faces in any manner you wish." vs. "Please identify the emotions portrayed in these faces."). Autistic participants showed a deficit in emotion recognition, but this effect was driven primarily by deficits in the recognition of fear. Collectively, these results indicate disorganized processing of face stimuli in autistic individuals and suggest a mechanism that may subserve the social information processing deficits that characterize autism spectrum disorders.

Discourse representation in the two cerebral hemispheres

Readers construct at least two interrelated representations when they comprehend a text: (a) a propositional representation containing the individual ideas that are derived from each sentence and the relations among them and (b) a discourse model, a representation of the context or situation to which the text refers. We used a paradigm called "item priming in recognition" to examine how these representations are stored in the cerebral hemispheres. In Experiment 1, the priming paradigm was used in combination with a lateralized visual field (VF) procedure. We found evidence that readers' representations were structured according to propositional relations, but only in the left hemisphere. Item recognition was facilitated when a concept was preceded by another concept from the same proposition when targets were presented to the left, but not to the right, hemisphere. We found priming in both hemispheres, however, when targets were context-appropriate senses of ambiguous words or topics of passages. In Experiment 2, we replicated the priming effects in three callosotomy patients. We argue that the distinction between a propositional representation and a discourse model is important with respect to how discourse is represented in the brain. The propositional representation appears to reside in the left hemisphere, whereas aspects of the discourse model appear to be represented in both hemispheres.

Sources of performance on theory of mind tasks in right hemisphere-damaged patients

Patients with right hemisphere (RHD) or left hemisphere brain damage (LHD) were tested on Theory of Mind (ToM) tasks presented with visual aids that illustrated the relevant premises. As a measure of pragmatic ability, patients were also asked to judge replies in conversation that violated Gricean maxims. Both RHD and LHD patients performed well on the ToM tasks presented with visual aids, but RHD patients displayed difficulty when the same tasks were presented only verbally. In addition, RHD patients showed reduced sensitivity to pragmatic violations. These findings point to the role of right hemisphere structures in processing information relevant to conversations. They indicate that a crucial source of RHD patients' errors in ToM tasks may involve difficulties in utterance interpretation owing to impairments of visuospatial processing required for the representation of textual information.

Cerebral laterality for famous proper nouns: visual recognition by normal subjects

Lexical processing has long been associated with left-hemisphere function, especially for infrequently occurring words. Recently, however, persons with severe aphasia, including word-recognition deficits, were observed to recognize familiar proper nouns. Further, some patients suffering right-hemisphere damage were poorer at identifying famous names than left-hemisphere-damaged subjects. These observations point to the possibility that some property of the right hemisphere provides an advantage for the processing of familiar or personally relevant stimuli. To investigate this possibility, we conducted split-visual-field studies in which we manipulated stimulus sets, recognition task, and exposure duration. Greater accuracy in the right visual field was found for common nouns and unknown proper nouns, and famous proper nouns were overall more accurately recognized. Performance for famous nouns in the two visual fields was not significantly different when the task required categorization into famous or nonfamous and when stimuli most highly rated as familiar were used. These findings support our proposals that (1) both hemispheres can process famous proper nouns and (2) the right hemisphere is specialized for personal relevance.

Visual-field bias in the judgment of facial expression of emotion

The left and right hemispheres of the brain are differentially related to the processing of emotions. Although there is little doubt that the right hemisphere is relatively superior for processing negative emotions, controversy exists over the hemispheric role in the processing of positive emotions. Eighty right-handed normal male participants were examined for visual-field (left-right) differences in the perception of facial expressions of emotion. Facial composite (RR, LL) and hemifacial (R, L) sets depicting emotion expressions of happiness and sadness were prepared. Pairs of such photographs were presented bilaterally for 150 ms, and participants were asked to select the photographs that looked more expressive. A left visual-field superiority (a right-hemisphere function) was found for sad facial emotion. A hemispheric advantage in the perception of happy expression was not found.

A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents

Quantitative and qualitative reviews of the literature on sex differences in facial expression processing (FEP) have yielded conflicting findings regarding children. This study was designed to review quantitatively the literature on sex differences in FEP from infancy through adolescence and to evaluate consistency between the course of FEP development and predictions derived from preliminary theoretical models. Results, which indicate a female advantage at FEP, are consistent with predictions derived from an integrated neurobehavioral/social constructivist model. These findings suggest a need for research examining both neurological maturation and socialization as important factors in the development of sex differences in FEP and related skills. Possible directions for future study are discussed, with emphasis on the need to integrate the infant literature with research focused on older children and adults.

Expletives: neurolinguistic and neurobehavioral perspectives on swearing

Severe aphasia, adult left hemispherectomy, Gilles de la Tourette syndrome (GTS), and other neurological disorders have in common an increased use of swearwords. There are shared linguistic features in common across these language behaviors, as well as important differences. We explore the nature of swearing in normal human communication, and then compare the clinical presentations of selectively preserved, impaired and augmented swearing. These neurolinguistic observations, considered along with related neuroanatomical and neurochemical information, provide the basis for considering the neurobiological foundation of various types of swearing behaviors.

Effects of lesion variables and emotion type on the perception of facial emotion

The purpose of this study was to consider the effects of valence, motoric direction (i.e., approach/withdrawal), and arousal on the perception of facial emotion in patients with unilateral cortical lesions. We also examined the influence of lesion side, site, and size on emotional perception. Subjects were 30 right-hemisphere-damaged (RHD) and 30 left-hemisphere-damaged (LHD) male patients with focal lesions restricted primarily to the frontal, temporal, or parietal lobe. Patient groups were comparable on demographic and clinical neurological variables. Subjects were tested for their ability to match photographs of four facial emotional expressions: happiness, sadness, fear, and anger. Overall, RHD patients were significantly more impaired than LHD patients in perceiving facial emotion. Lesion side, but not site, was associated with motoric direction and valence dimensions. RHD patients had specific deficits relative to LHD patients in processing negative and withdrawal emotions; there were no group differences for positive/approach emotions. Lesion size was not significantly correlated with accuracy of emotional perception.

Impairments in judgment of chimeric faces by schizophrenic and affective patients

The hypothesis that schizophrenic and affective patients have differential impairments in judgment of facial emotional expressions was tested on 55 right-handed patients: 15 in each of two groups of schizophrenic patients, with positive and negative symptoms; and 10 in each of two groups of bipolar affective patients, in manic and depressive states. In addition, 37 normal control subjects were also tested. The subjects were presented with eight schematic drawings of chimeric faces (each depicting a positive emotion in a given hemiface, and a negative emotion in the other hemiface), as well as with two drawings of composite faces (each depicting either a positive or a negative emotion). Subjects judged the emotions depicted by the facial expressions, as well as their intensity. The data, analyzed by analyses of variance, showed that normals judged the chimeric expressions on the basis of the emotions depicted by the left hemifaces. This tendency was weaker among the psychiatric patients. Schizophrenics with negative symptoms judged positive expressions in the left hemifaces as depicting negative emotions, and negative expressions as depicting positive emotions. Schizophrenics with positive symptoms and manic patients judged all expressions as depicting positive emotions. Depressive patients showed a stronger tendency to judge negative expressions as depicting negative emotions than positive expressions as depicting positive emotions. No significant group differences appeared in judgment of composite faces (except for schizophrenic with negative symptoms who were more accurate in judging positive than negative expressions). Patients performances were interpreted in terms of differential dysfunctions in posterior areas of the right cerebral hemisphere which might be associated with bilateral effects of dysfunctions in anterior cerebral areas.

Acquired 'theory of mind' impairments following stroke

The ability to attribute thoughts and feelings to self and others ('theory of mind') has been hypothesised to have an innate neural basis and a dedicated cognitive mechanism. Evidence in favour of this proposal has come from autism; a brain-based developmental disorder which appears to be characterised by impaired theory of mind, despite sometimes good general reasoning skills/IQ. To date no case of specific acquired theory of mind impairment has been reported. The present study examined theory of mind in adults who had suffered right hemisphere stroke, a group known to show pragmatic and social difficulties. In one study using story materials and two using cartoons, patients' understanding of materials requiring attribution of mental states (e.g. ignorance, false belief) was significantly worse than their understanding of non-mental control materials. Data from healthy elderly subjects, and a small group of left hemisphere patients (who received the tasks in modified form), suggest that this impairment on mental state tasks is not a function of task difficulty. The findings support the notion of a dedicated cognitive system for theory of mind, and suggest a role for the healthy right hemisphere in the attribution of mental states.

Cortical influences in emotion

Emotions may be classified into two major divisions: experience and behavior. Because the brain is critical for mediating emotional experience and behavior, diseases of the brain may induce changes in emotional behavior and experience. Disorders of almost all portions of the cerebral hemisphere, including the cortex, limbic system, and basal ganglia, have been associated with changes of emotional experience and behavior. Dysfunction of the cerebral cortex may be associated with disorders of emotional communication. Whereas deficits of the left hemisphere appear to impair the comprehension and expression of propositional language, deficits of the right hemisphere may be associated with an impaired ability to comprehend and express emotional gestures such as facial expression and emotional prosody. Some patients have either prosodic or facial emotional deficits. Some have only expressive or receptive deficits. However, others may be globally impaired, either within or across modalities. The posterior portions of the neocortex appear to be important for comprehension and the anterior for expression of both emotional prosody and faces. Injury and dysfunction of the limbic system may also alter emotional communication and experience. For example, damage to the amygdala may be associated with an impaired ability to recognized emotional faces and a reduction of affect, especially anger, rage, and fear. In contrast, lesions of the septal region may be associated with increased ragelike behaviors. Seizures frequently emanate from the limbic system, and seizures that start in the amygdala can induce fear and perhaps even rage. Disorders of the basal ganglia may also be associated with defects of emotional communication and experience. Patients with Parkinson's disease not only may be impaired at communicating emotions with both expressive and receptive deficits but also are often depressed and anxious. Patients with Huntington's disease may have emotional comprehension deficits with an impaired ability to recognize emotional faces and prosody. Patients with Huntington's disease may have mood changes even before motor dysfunction becomes manifest. Many of the defects in emotional experience may be related to the associated changes in neurotransmitter systems. Unfortunately, how alteration of neurotransmitters induce mood changes remains unknown. In this chapter we review the feedback and central theories of emotional experience. Although we argue against the postulates that feedback is critical to the experience of emotions, we do suspect that feedback may influence emotions. Emotions may be conditioned and may use thalamic-limbic circuits, as proposed by LeDoux. However, most emotional behaviors and experiences are induced by complex stimuli that an isolated thalamus could not interpret. The cerebral cortex of humans has complex modular systems that analyze stimuli, develop percepts, and interpret meaning. We discuss the proposal that the experience of emotions is dimensional. Almost all primary emotions can be described with two or three factors, including valence, arousal, and motor activation.

Faces and emotions: brain electric field sources during covert emotional processing

Covert brain activity related to task-free, spontaneous (i.e. unrequested), emotional evaluation of human face images was analysed in 27-channel averaged event-related potential (ERP) map series recorded from 18 healthy subjects while observing random sequences of face images without further instructions. After recording, subjects self-rated each face image on a scale from "liked" to "disliked". These ratings were used to dichotomize the face images into the affective evaluation categories of "liked" and "disliked" for each subject and the subjects into the affective attitudes of "philanthropists" and "misanthropists" (depending on their mean rating across images). Event-related map series were averaged for "liked" and "disliked" face images and for "philanthropists" and "misanthropists". The spatial configuration (landscape) of the electric field maps was assessed numerically by the electric gravity center, a conservative estimate of the mean location of all intracerebral, active, electric sources. Differences in electric gravity center location indicate activity of different neuronal populations. The electric gravity center locations of all event-related maps were averaged over the entire stimulus-on time (450 ms). The mean electric gravity center for disliked faces was located (significant across subjects) more to the right and somewhat more posterior than for liked faces. Similar differences were found between the mean electric gravity centers of misanthropists (more right and posterior) and philanthropists. Our neurophysiological findings are in line with neuropsychological findings, revealing visual emotional processing to depend on affective evaluation category and affective attitude, and extending the conclusions to a paradigm without directed task.

Right hemisphere damage impairs the ability to process emotional expressions of unusual faces

Patients with focal brain damage, right and left hemisphere damage, and nonpatient controls were asked to match photographs of emotion expressions that were depicted in unusual (line drawings, strange, and schematic) and normal (usual) representations of faces with the target emotion expressions of normal face. Nonpatient controls were significantly superior to right hemisphere damaged patients in matching photographs of emotion expressions that were depicted in line drawings of normal face and schematic face.

The decoding of emotional concepts in patients with focal cerebral lesions

The effects of focal brain lesions on the decoding of emotional concepts in facial expressions were investigated. Facial emotions are hierarchically organized patterns comprising (1) structural surface features, (2) discrete (primary) emotional categories and (3) secondary dimensions, such as valence and arousal. Categorical decoding was measured using (1) selection of category labels and selection of the named emotion category; (2) matching one facial expression with two choice expressions. Dimensional decoding was assessed by matching one face with two different expressions with regard to valence or arousal. 70 patients with well documented cerebral lesions and 15 matched hospital controls participated in the study. 27 had left brain damage (LBD; 10 frontal, 10 temporal, 7 parietal); 37 had right brain damage (RBD; 15 frontal, 11 temporal, 11 parietal). Six additional patients had lesions involving both frontal lobes. Right temporal and parietal lesioned patients were markedly impaired in the decoding of primary emotions. The same patients also showed a reduced arousal decoding. In contrast to several patients with frontal and left hemisphere lesions, emotional conceptualization and face discrimination was not independent in these groups. No group differences were observed in valence decoding. However, right frontal lesions appeared to interfere with the discrimination of negative valence. Moreover, a distraction by structural features was noted in RBD when facial identities were varied across stimulus and response pictures in matching tasks with differing conceptual load. Our results suggest that focal brain lesions differentially affect the comprehension of emotional meaning in faces depending on the level of conceptual load and interference of structural surface features.

Hemispheric asymmetry in the recognition of emotional attitude conveyed by facial expression, prosody and propositional speech

In this study 27 patients with right hemisphere lesions, 25 patients with left hemisphere lesions and 26 normal control subjects were investigated for unimodal and simultaneous multimodal recognition of emotional attitude. All subjects were shown 330 videotaped items of 4 seconds duration, each of which was to be judged in terms of facial expression, emotional prosody and the emotional meaning of the underlying spoken sentence. In a preceding experiment comparable unimodal emotional stimuli were applied. The results suggest (a) right hemisphere superiority for recognition of emotions conveyed by facial and prosodic information, (b) a right hemisphere dominance for the recognition of fear and (c) no significant enhancement of right hemisphere superiority under multimodal presentation of emotional stimuli.

The effects of right-hemisphere brain damage on patients' use of terms of personal reference

Successful communication depends on social as well as linguistic factors. In conversation, for example, a speaker must often refer to another person. Choosing an appropriate term of personal reference requires a speaker to consider several features of the discourse context, including properties of the persons being referred to and what knowledge is shared between the speaker and his or her addressee. In a pair of similar studies, we examined how right-hemisphere brain-damaged (RHD) patients and nonbrain-damaged control subjects use these different kinds of information in choosing formal (e.g., "Mr. Harding") versus informal ("Oliver") terms of reference for an absent third person. Stimulus vignettes manipulated three variables: the occupational status of the referent, the speaker's familiarity with the referent (i.e., the degree to which the speaker and referent were personally acquainted), and the addressee's familiarity (i.e., the degree to which the addressee and referent were personally acquainted). Relative to the control subjects, the RHD patients showed decreased use of both familiarity variables when choosing formal over informal labels, but apparently preserved sensitivity to the status variable. These results suggest how decreased use of the knowledge shared between a speaker and addressee disrupts RHD patients' discourse and thus contributes to these patients' aberrant interpersonal behavior. In addition. In addition, the results from the second study demonstrated an asymmetry in how female versus male subjects responded to the status manipulation.

Rags to riches: our increasing appreciation of cognitive and communicative abilities of the human right cerebral hemisphere

Studies of right hemisphere abilities have grown from focusing on visuospatial and facial recognition in the 1950s to covering a broad spectrum of human behavior. The emergence of better understanding of auditory specializations, affective/emotional functions, personal relevance, idiosyncratic lexical organization, and the various aspects of language use--communicative pragmatics--is briefly reviewed.

Referential cohesion and logical coherence of narration after right hemisphere stroke

A group with right hemisphere dysfunction was compared to neurologically intact controls regarding the referential cohesion and logical coherence of narrative production. A somewhat varied sample of six stories was obtained with tasks of cartoon-elicited story-telling and auditory-oral retelling. We found deficits in the patient group with respect to referential cohesion, logical coherence, and accuracy of narration, but the occurrence of deficits depended on the condition in which narration was produced and, to some extent, on the particular story used in each condition. The primary implications of this study pertain to the attention given by researchers to the feature of discourse production being studied.

Effect of visual and inferential variables on scene descriptions by right-hemisphere-damaged and non-brain-damaged adults

This study investigated the effects of visual and inferential complexity on the pictured scene descriptions of right-hemisphere-damaged (RHD) and non-brain-damaged (NBD) adults. The number and accuracy of noun phrases generated by both groups were significantly affected by the inferential complexity of pictured scenes, but not by their visual complexity (as measured by the number of objects and amount of object embedding in the scenes). RHD subjects, particularly those with high levels of neglect, were significantly impaired relative to the NBD subjects in generating accurate inferences from the pictures, but not in their ability to recognize and identify pictured elements.