Conceptual knowledge of emotions includes somatosensory component: Evidence from modality-switch cost effect

The modality switching costs of Chinese-English bilinguals in the processing of L1 and L2

Modality switching cost indicates that people's performance becomes worse when they judge sequential information that is related to different sensory modalities than judging information that is related to the same modality. In this study, we conducted three experiments on proficient and non-proficient bilingual individuals to investigate the modality switching costs in L1 and L2 processing separately. In Experiment 1, materials were L1 and L2 words that were either conceptually related to a visual modality (e.g., light) or related to an auditory modality (e.g., song). The modality switching costs were investigated in a lexical decision task in both L1 and L2. Experiment 2 further explored the modality switching costs while weakening the activation level of the perceptual modality by adding a set of fillers. Experiment 3 used a word-naming task to explore the modality switching effect in language production in L1 and L2. Results of these experiments showed that the modality switching costs appeared in both language comprehension and production in L1 and L2 conditions. The magnitude of the modality switching costs was conditionally modulated by the L2 proficiency level, such as in the L2 condition in Experiment 1 and in both L1 and L2 conditions in Experiment 3. These results suggest that sensorimotor simulation is involved in not only language comprehension but also language production. The sensorimotor simulation that is acquired in L1 can be transferred to L2.

Cross-modal metaphorical mapping of spoken emotion words onto vertical space

From the field of embodied cognition, previous studies have reported evidence of metaphorical mapping of emotion concepts onto a vertical spatial axis. Most of the work on this topic has used visual words as the typical experimental stimuli. However, to our knowledge, no previous study has examined the association between affect and vertical space using a cross-modal procedure. The current research is a first step toward the study of the metaphorical mapping of emotions onto vertical space by means of an auditory to visual cross-modal paradigm. In the present study, we examined whether auditory words with an emotional valence can interact with the vertical visual space according to a 'positive-up/negative-down' embodied metaphor. The general method consisted in the presentation of a spoken word denoting a positive/negative emotion prior to the spatial localization of a visual target in an upper or lower position. In Experiment 1, the spoken words were passively heard by the participants and no reliable interaction between emotion concepts and bodily simulated space was found. In contrast, Experiment 2 required more active listening of the auditory stimuli. A metaphorical mapping of affect and space was evident but limited to the participants engaged in an emotion-focused task. Our results suggest that the association of affective valence and vertical space is not activated automatically during speech processing since an explicit semantic and/or emotional evaluation of the emotionally valenced stimuli was necessary to obtain an embodied effect. The results are discussed within the framework of the embodiment hypothesis.