Between- and within-ear congruency and laterality effects in an auditory semantic/emotional prosody conflict task

Emotional prosody Stroop effect in Hindi: An event related potential study

Prosody processing is an important aspect of language comprehension. Previous research on emotional word-prosody conflict has shown that participants are worse when emotional prosody and word meaning are incongruent. Studies with event-related potentials have shown a congruency effect in N400 component. There has been no study on emotional processing in Hindi language in the context of conflict between emotional word meaning and prosody. We used happy and angry words spoken using happy and angry prosody. Participants had to identify whether the word had a happy or angry word meaning. The results showed a congruency effect with worse performance in incongruent trials indicating an emotional Stroop effect in Hindi. The ERP results showed that prosody information is detected very early, which can be seen in the N1 component. In addition, there was a congruency effect in N400. The results show that prosody is processed very early and emotional meaning-prosody congruency effect is obtained with Hindi. Further studies would be needed to investigate similarities and differences in cognitive control associated with language processing.

Emotional speech processing at the intersection of prosody and semantics

The ability to accurately perceive emotions is crucial for effective social interaction. Many questions remain regarding how different sources of emotional cues in speech (e.g., prosody, semantic information) are processed during emotional communication. Using a cross-modal emotional priming paradigm (Facial affect decision task), we compared the relative contributions of processing utterances with single-channel (prosody-only) versus multi-channel (prosody and semantic) cues on the perception of happy, sad, and angry emotional expressions. Our data show that emotional speech cues produce robust congruency effects on decisions about an emotionally related face target, although no processing advantage occurred when prime stimuli contained multi-channel as opposed to single-channel speech cues. Our data suggest that utterances with prosodic cues alone and utterances with combined prosody and semantic cues both activate knowledge that leads to emotional congruency (priming) effects, but that the convergence of these two information sources does not always heighten access to this knowledge during emotional speech processing.

Emotional speech processing: disentangling the effects of prosody and semantic cues

To inform how emotions in speech are implicitly processed and registered in memory, we compared how emotional prosody, emotional semantics, and both cues in tandem prime decisions about conjoined emotional faces. Fifty-two participants rendered facial affect decisions (Pell, 2005a), indicating whether a target face represented an emotion (happiness or sadness) or not (a facial grimace), after passively listening to happy, sad, or neutral prime utterances. Emotional information from primes was conveyed by: (1) prosody only; (2) semantic cues only; or (3) combined prosody and semantic cues. Results indicated that prosody, semantics, and combined prosody-semantic cues facilitate emotional decisions about target faces in an emotion-congruent manner. However, the magnitude of priming did not vary across tasks. Our findings highlight that emotional meanings of prosody and semantic cues are systematically registered during speech processing, but with similar effects on associative knowledge about emotions, which is presumably shared by prosody, semantics, and faces.

The sad, the angry, and the asymmetrical brain: dichotic listening studies of negative affect and depression

Dichotic Listening (DL) is a valuable tool to study emotional brain lateralization. Regarding the perception of sadness and anger through affective prosody, the main finding has been a left ear advantage (LEA) for the sad but contradictory data for the anger prosody. Regarding an induced mood in the laboratory, its consequences upon DL were a diminished right ear advantage (REA) for the induction of sadness and an increased REA for the induction of anger. The global results fit with the approach-withdrawal motivational model of emotional processing, pointing to sadness as a right hemisphere emotion but anger processed bilaterally or even in the left hemisphere, depending on the subject's preferred mode of expression. On the other hand, the study of DL in clinically depressed patients found an abnormally larger REA in verbal DL tasks which was predictive of therapeutic pharmacological response. However, the mobilization of the available left hemisphere resources in these responders (reflected in a higher REA) would indicate a remission of the episode but would not assure the absence of new relapses.