What's up? Emotion-specific activation of vertical space during language processing

Modal and amodal cognition: an overarching principle in various domains of psychology

Accounting for how the human mind represents the internal and external world is a crucial feature of many theories of human cognition. Central to this question is the distinction between modal as opposed to amodal representational formats. It has often been assumed that one but not both of these two types of representations underlie processing in specific domains of cognition (e.g., perception, mental imagery, and language). However, in this paper, we suggest that both formats play a major role in most cognitive domains. We believe that a comprehensive theory of cognition requires a solid understanding of these representational formats and their functional roles within and across different domains of cognition, the developmental trajectory of these representational formats, and their role in dysfunctional behavior. Here we sketch such an overarching perspective that brings together research from diverse subdisciplines of psychology on modal and amodal representational formats so as to unravel their functional principles and their interactions.

Sentence-based mental simulations: Evidence from behavioral experiments using garden-path sentences

Language comprehenders activate mental representations of sensorimotor experiences related to the content of utterances they process. However, it is still unclear whether these sensorimotor simulations are driven by associations with words or by a more complex process of meaning composition into larger linguistic expressions, such as sentences. In two experiments, we investigated whether comprehenders indeed create sentence-based simulations. Materials were constructed such that simulation effects could only emerge from sentence meaning and not from word-based associations alone. We additionally asked when during sentence processing these simulations are constructed, using a garden-path paradigm. Participants read either a garden-path sentence (e.g., "As Mary ate the egg was in the fridge") or a corresponding unambiguous control with the same meaning and words (e.g., "The egg was in the fridge as Mary ate"). Participants then judged whether a depicted entity was mentioned in the sentence or not. In both experiments, picture response times were faster when the picture was compatible (vs. incompatible) with the sentence-based interpretation of the target entity (e.g., both for garden-path and control sentence: an unpeeled egg), suggesting that participants created simulations based on the sentence content and only operating over the sentence as a whole.

Replacing vertical actions by mouse movements: a web-suited paradigm for investigating vertical spatial associations

The number of web-based studies in experimental psychology has been growing tremendously throughout the last few years. However, a straightforward web-based implementation does not exist for all types of experimental paradigms. In the current paper, we focus on how vertical response movements-which play a crucial role in spatial cognition and language research-can be translated into a web-based setup. Specifically, we introduce a web-suited counterpart of the vertical Stroop task (e.g., Fox & Shor, in Bull Psychon Soc 7:187-189, 1976; Lachmair et al., in Psychon Bull Rev 18:1180-1188, 2011; Thornton et al., in J Exp Psychol Hum Percept Perform 39:964-973, 2013). We employed nouns referring to entities typically located in lower or upper vertical space (e.g., "worm" and "bird", respectively) in Experiments 1 and 2, and emotional valence words associated with a crouched or an upward bodily posture (e.g., "sadness" and "excitement", respectively) in Experiment 3. Depending on the font color, our participants used their mouse to drag the words to the lower or upper screen location. Across all experiments, we consistently observed congruency effects analogous to those obtained with the lab paradigm using actual vertical arm movements. Consequently, we conclude that our web-suited paradigm establishes a reliable approach to examining vertical spatial associations.

Up right, not right up: Primacy of verticality in both language and movement

When describing motion along both the horizontal and vertical axes, languages from different families express the elements encoding verticality before those coding for horizontality (e.g., going up right instead of right up). In light of the motor grounding of language, the present study investigated whether the prevalence of verticality in Path expression also governs the trajectory of arm biological movements. Using a 3D virtual-reality setting, we tracked the kinematics of hand pointing movements in five spatial directions, two of which implied the vertical and horizontal vectors equally (i.e., up right +45° and bottom right −45°). Movement onset could be prompted by visual or auditory verbal cues, the latter being canonical in French (“en haut à droite”/up right) or not (“à droite en haut”/right up). In two experiments, analyses of the index finger kinematics revealed a significant effect of gravity, with earlier acceleration, velocity, and deceleration peaks for upward (+45°) than downward (−45°) movements, irrespective of the instructions. Remarkably, confirming the linguistic observations, we found that vertical kinematic parameters occurred earlier than horizontal ones for upward movements, both for visual and congruent verbal cues. Non-canonical verbal instructions significantly affected this temporal dynamic: for upward movements, the horizontal and vertical components temporally aligned, while they reversed for downward movements where the kinematics of the vertical axis was delayed with respect to that of the horizontal one. This temporal dynamic is so deeply anchored that non-canonical verbal instructions allowed for horizontality to precede verticality only for movements that do not fight against gravity. Altogether, our findings provide new insights into the embodiment of language by revealing that linguistic path may reflect the organization of biological movements, giving priority to the vertical axis.

Associations Between Abstract Concepts: Investigating the Relationship Between Deictic Time and Valence

The present study examines whether deictic time and valence are mentally associated, with a link between future and positive valence and a link between past and negative valence. We employed a novel paradigm, the two-choice-sentence-completion paradigm, to address this issue. Participants were presented with an initial sentence fragment that referred to an event that was either located in time (future or past) or of different valence (positive or negative). Participants chose between two completion phrases. When the given dimension in the initial fragment was time, the two completion phrase alternatives differed in valence (positive vs. negative). However, when the given dimension in the initial fragment was valence, the two completion phrase alternatives differed in time (future vs. past). As expected, participants chose completion phrases consistent with the proposed association between time and valence. Additional analyses involving individual differences concerning optimism/pessimism revealed that this association is particularly pronounced for people with an optimistic attitude.

The influence of congruency proportion, target eccentricity, and valence strength on the spatial-valence metaphoric congruency effect in a word valence judgment task

In a word valence judgment task, positive words (e.g., excellence) are judged faster when presented at the top (congruent position) than at the bottom of the screen (incongruent position), whereas the opposite pattern occurs for negative words (e.g., disaster). This spatial-valence metaphoric congruency effect reflects top-positive/bottom-negative metaphoric association and may be attributed to at least three possible mechanisms: spreading activation between spatial and valence concepts (activation account), epistemic function that a conceptual metaphor serves to reduce the uncertainty associated with valence concepts (epistemic account), and/or the extent to which spatial-valence metaphoric association is relevant to task demand (relevance account). In three experiments, we manipulated congruency proportion, target eccentricity, and valence strength in a word valence judgment task to test these three possible accounts. Results showed that the metaphoric congruency effect was larger when a high (vs. equal) proportion of targets appears in congruent, relative to incongruent, position, and for targets with strong (vs. weak) valence. However, the effect in reaction time measure was not modulated by whether the target appeared in the position being near vs. far away from the center of the screen. The overall findings are better accommodated by the relevance account. The implications of the current findings on other theoretical accounts, such as Conceptual Metaphor Theory and polarity correspondence account, are also discussed.

Bliss is blue and bleak is grey: Abstract word-colour associations influence objective performance even when not task relevant

Humans associate abstract words with physical stimulus dimensions, such as linking upward locations with positive concepts (e.g., happy = up). These associations manifest both via subjective reports of associations and on objective performance metrics. Humans also report subjective associations between colours and abstract words (e.g., joy is linked to yellow). Here we tested whether such associations manifest on objective task performance, even when not task-relevant. Across three experiments, participants were presented with abstract words in physical colours that were either congruent with previously-reported subjective word-colour associations (e.g., victory in red and unhappy in blue), or were incongruent (e.g., victory in blue and unhappy in red). In Experiment 1, participants' task was to identify the valence of words. This congruency manipulation systematically affected objective task performance. In Experiment 2, participants completed two blocks, a valence-identification and a colour-identification task block. Both tasks produced congruency effects on performance, however, the results of the colour identification block could have reflected learning effects (i.e., associating the more common congruent colour with the word). This issue was rectified in Experiment 3, whereby participants completed the same two tasks as Experiment 2, but now matched congruent and incongruent pairs were used for both tasks. Again, both tasks produced reliable congruency effects. Item analyses in each experiment revealed that these effects demonstrated a degree of item specificity. Overall, there was clear evidence that at least some abstract word-colour pairings can systematically affect behaviour.

Nodding and shaking of the head as simulated approach and avoidance responses

Our recent study within the embodiment perspective showed that the evaluation of true and false information activates the simulation of vertical and horizontal head movements involved in nodding and shaking of the head (Moretti & Greco, 2018). This result was found in an explicit evaluation task where motion detection software was deployed to enable participants to assess a series of objectively true or false statements by moving them with the head vertically and horizontally on a computer screen, under conditions of compatibility and incompatibility between simulated and performed action. This study replicated that experiment, but with subjective statements about liked and disliked food, in both explicit and implicit evaluation tasks. Two experiments, plus one control experiment, were devised to test the presence of a motor-affective compatibility effect (vertical-liked; horizontal-disliked) and whether the motor-semantic compatibility found with objective statements (vertical-true; horizontal-false) could be a sub-effect of a more general and automatic association (vertical-accepted; horizontal-refused). As expected, response times were shorter when statements about liked foods and disliked foods were moved vertically and horizontally respectively by making head movements, even when participants were not explicitly required to evaluate them. In contrast, the truth compatibility effect only occurred in the explicit evaluation task. Overall results support the idea that head-nodding and shaking are simulated approach-avoidance responses. Different aspects of the meaning of these gestures and the practical implications of the study for cognitive and social research are discussed.

Moved by Emotions: Affective Concepts Representing Personal Life Events Induce Freely Performed Steps in Line With Combined Sagittal and Lateral Space-Valence Associations

Embodiment approaches to cognition and emotion have put forth the idea that the way we think and talk about affective events often recruits spatial information that stems, to some extent, from our bodily experiences. For example, metaphorical expressions such as "being someone's right hand" or "leaving something bad behind" convey affectivity associated with the lateral and sagittal dimensions of space. Action tendencies associated with affect such as the directional fluency of hand movements (dominant right hand-side - positive; non-dominant left hand-side - negative) and approach-avoidance behaviors (forward - positive; backwards - negative) might be mechanisms supporting such associations. Against this background, experimental research has investigated whether positive and negative words are freely allocated into space (e.g., close or far from one's body) or resonate with congruent (vs. incongruent) predefined manual actions usually performed by joysticks or button presses (e.g., positive - right; negative - left, or vice versa). However, to date, it is unclear how the processing of affective concepts resonate with directional actions of the whole body, the more if such actions are performed freely within a context enabling both, lateral and sagittal movements. Accordingly, 67 right-handed participants were to freely step on an 8-response pad (front, back, right, left, front-right, front-left, back-right, or back-left) after being presented in front of them valence-laden personal life-events submitted before the task (e.g., words or sentences such as "graduation" or "birth of a child"). The most revealing finding of this study indicates that approach-avoidance behaviors and space-valence associations across laterality are interwoven during whole body step actions: Positive events induced steps highly biased to front-right whereas negative events induced steps highly biased to back-left.

Positive self-perception and corticospinal excitability: Recalling positive behavior expands peripersonal space boundaries

Converging evidence suggests that peripersonal space has dynamic properties, that can be influenced by motor and cognitive factors. Here, we investigated whether changes in self-perception may impact upon peripersonal representation. Specifically, employing non-invasive brain stimulation, we tested whether corticospinal excitability elicited by objects placed in the vertical peripersonal vs extrapersonal space can be influenced by changes in self-perception after recalling a personal experience inducing the feeling of high power (vs. positivity vs. low power). In a preliminary study (Study 1, N = 39) participants were presented with an object, whose position was manipulated in the horizontal vs vertical space. We assessed corticospinal excitability by measuring Motor Evoked Potentials (MEPs) using Transcranial Magnetic Stimulation with Electromyography co-registration (TMS-EMG). In the horizontal condition, we replicated the well-known motor facilitation induced by objects falling in the peri vs extrapersonal space, while in the vertical dimension MEPs were higher in the extrapersonal space. In the main experiment (Study 2), participants (N = 55) were randomly assigned to feel high power, low power, or a general positive emotion and were asked to observe the same object positioned either in the peripersonal or in the extrapersonal vertical space. Results showed that in the low power condition MEPs were higher in the extrapersonal vs peripersonal, as in Study 1, while in high power and positive conditions MEPs were not influenced by distance. Taken together, our findings suggest a dissociable pattern of motor facilitation underlying vertical vs horizontal space perception and, crucially, that changes in self-perception can influence such a representation.

Dynamic grounding of emotion concepts

Emotion concepts are important. They help us to understand, experience and predict human behaviour. Emotion concepts also link the realm of the abstract with the realm of bodily experience and actions. Accordingly, the key question is how such concepts are created, represented and used. Embodied cognition theories hold that concepts are grounded in neural systems that produce experiential and motor states. Concepts are also contextually situated and thus engage sensorimotor resources in a dynamic, flexible way. Finally, on that framework, conceptual understanding unfolds in time, reflecting embodied as well as linguistic and cultural influences. In this article, we review empirical work on emotion concepts and show how it highlights their grounded, yet dynamic and context-sensitive nature. The conclusions are consistent with recent developments in embodied cognition that allow concepts to be linked to sensorimotor systems, yet be flexibly sensitive to current representational and action needs.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Vertical Head Movements Influence Memory Performance for Words With Emotional Content

Numerous studies have found an association between valence and the vertical dimension of space (good-up, bad-down). This association has also been linked to sensorimotor experiences (e.g., body movements). In this study, we investigated whether body movements along the vertical plane play an active role in the retrieval of positive and negative words (as well as words with a more explicit association with up and down). Twenty-five participants were presented with a list of nouns associated with space (e.g., satellite, underground) and a list of nouns associated with emotions (e.g., joy, war). Subsequently, they had to retrieve the words while performing vertical head movements. We found a vertical effect in that participants retrieved more positive words when moving their head upward and more negative words when moving the head downward. These results illustrate that overt body movements are indeed associated with emotional information and can thereby influence what we remember. We conclude that abstract concepts such as emotional representations are inherently linked to motor action and are grounded in space.

The N400/FN400 and Lateralized Readiness Potential Neural Correlates of Valence and Origin of Words' Affective Connotations in Ambiguous Task Processing

Recent behavioral studies revealed an interesting phenomenon concerning the influence of affect on the interpretation of ambiguous stimuli. In a paradigm, where the participants' task was to read a word, remember its meaning for a while, and then choose one of two pictorial-alphabet-like graphical signs best representing the word sense, we observed that the decisions involving trials with reflective-originated verbal stimuli were performed significantly longer than decisions concerning other stimuli (i.e., automatic-originated). The origin of an affective reaction is a dimension which allows speaking of an affect as automatic (you feel it in your guts) or reflective (you feel it comes from your mind). The automatic affective reaction represents the immediate and inescapable as opposed to the reflective, i.e., the delayed and controllable affective responses to stimuli. In the current experiment, we investigated the neural correlates of performance in an QR-signs-selection ambiguous task. We found the effects of valence and origin in the N400/FN400 potential by means of a stimuli-locked analysis of the initial part of the task, that is, the remembering of a certain word stimulus in a working memory. The N400/FN400 effects were separated in space on scalp distribution. Reflective originated stimuli elicited more negative FN400 than other conditions, which means that such stimuli indeed are associated with conceptual incongruence or higher affective complexity of meaning, but distinct from purely cognitive concreteness. Moreover, the amplitude of the potential preceding the decision, analyzed in the response-locked way, was shaped by the origin of an affective state but not valence. Trials involving decisions concerning reflective-originated words were characterized by a more negative amplitude than trials involving automatic-originated and control word stimuli. This corresponds to the observed pattern of response latencies, where we found that latencies for reflective stimuli were longer than for automatic originated or control ones. Additionally, this study demonstrates that the proposed new ambiguous paradigm is useful in studies concerning the influence of affect on decisions.

Logical Connectives Modulate Attention to Simulations Evoked by the Constituents They Link Together

In previous studies investigating logical-connectives simulations, participants focused their attention on verifying truth-condition satisfaction for connective expressions describing visual stimuli (e.g., Dumitru, 2014; Dumitru and Joergensen, 2016). Here, we sought to replicate and extend the findings that conjunction and disjunction simulations are structured as one and two Gestalts, respectively, by using language - picture matching tasks where participants focused their attention exclusively on stimuli visuospatial properties. Three studies evaluated perceptual compatibility effects between visual displays varying stimuli direction, size, and orientation, and basic sentences featuring the logical connectives AND, OR, BUT, IF, ALTHOUGH, BECAUSE, and THEREFORE (e.g., "There is blue AND there is red"). Response times highlight correlations between the Gestalt arity of connective simulations and visual attention patterns, such that words referring to constituents in the same Gestalt were matched faster to visual stimuli displayed sequentially rather than alternatively, having the same size rather than different sizes, and being oriented along axes other than horizontal. The results also highlight attentional patterns orthogonal to Gestalt arity: visual stimuli corresponding to simulation constituents were processed faster when they appeared onscreen from left to right than from right to left, when they were emphasized or de-emphasized together (i.e., faster processing of all-small or all-large stimuli pairs), and when they formed a downward-oriented diagonal, which signals a simulation boundary. More generally, our findings suggest that logical connectives rapidly evoke simulations that trigger top-down attention patterns over the grouping and properties of visual stimuli corresponding to the constituents they link together.

Valence-space associations in touchscreen interactions: Valence match between emotional pictures and their vertical touch location leads to pictures' positive evaluation

Embodied cognition research suggests that bodily experiences might ground mental representations of emotional valence in the vertical dimension of space (i.e., positive is up and negative is down). Accordingly, recent studies show that upward and downward arm movements may also influence the evaluation of valence-laden stimuli, suggesting that upward (downwards) movements lead to more positive (negative) evaluations. Interestingly, these studies typically did not investigate paradigms that require a direct hand interaction with the stimuli. With the advent of touchscreen devices and their use for experimental environments, however, a direct and more natural hand interaction with the stimuli has come to the fore. In this regard, the goal of the present study is to examine how direct hand interaction with valence-laden stimuli on a touchscreen monitor affects their perceived valence. To do so, participants evaluated emotional pictures after touching and moving them either upwards or downwards across a vertically mounted touchscreen. In contrast to previous findings, the results suggest that positive pictures were evaluated as more positive after downward movements while negative pictures were evaluated as less negative following upward movements. This finding may indicate that a matching between the pictures’ valence and the valence associated with their vertical touch location leads to more positive evaluations. Thus, the present study extends earlier results by an important point: Touching the emotional pictures during movement may influence their valence processing.

Truth is in the head. A nod and shake compatibility effect

Studies from the embodiment perspective on language processing have shown facilitation or interference effects depending on the compatibility between verbal contents, concrete or abstract, and the motion of various parts of the body. The aim of the present study was to test whether such compatibility effects can be found when a higher cognitive process like truth evaluation is accomplished with head movements. Since nodding is a vertical head gesture typically performed with positive and affirmative responses, and shaking is a horizontal head gesture associated with negative and dissenting contents, faster response times can be expected when true information is evaluated by making a vertical head movement and false information by making a horizontal head movement. Three experiments were designed in order to test this motor compatibility effect. In the first experiment a series of very simple sentences were asked to be evaluated as true or false by dragging them vertically and horizontally with the head. It resulted that truth-value was assessed faster when it was compatible with the direction of the head movement, compared to when it was incompatible. In the second experiment participants were asked to evaluate the same sentences as the first experiment but by moving them with the mouse. In the third experiment, a non-evaluative classification task was given, where sentences concerning animals or objects were to be dragged by vertical and horizontal head movements. In the second and third experiment no compatibility effect was observed. Overall results support the hypothesis of an embodiment effect between the abstract processing of truth evaluation and the direction of the two head movements of nodding and shaking. Cultural aspects, cognitive implications, and the limits of these findings are discussed.

How do German bilingual schoolchildren process German prepositions? - A study on language-motor interactions

While much support is found for embodied language processing in a first language (L1), evidence for embodiment in second language (L2) processing is rather sparse. In a recent study, we found support for L2 embodiment, but also an influence of L1 on L2 processing in adult learners. In the present study, we compared bilingual schoolchildren who speak German as one of their languages with monolingual German schoolchildren. We presented the German prepositions auf (on), über (above), and unter (under) in a Stroop-like task. Upward or downward responses were made depending on the font colour, resulting in compatible and incompatible trials. We found compatibility effects for all children, but in contrast to the adult sample, there were no processing differences between the children depending on the nature of their other language, suggesting that the processing of German prepositions of bilingual children is embodied in a similar way as in monolingual German children.

Activating concepts by activating experiential traces: investigations with a series of anagram solution tasks

According to the experiential-simulations view of language, words automatically activate experiential traces that stem from the reader’s interactions with their referents. Here, we focus on the corresponding influence in the opposite direction. By means of an anagram-solving task we investigated whether activating spatial experiential traces would activate the corresponding concepts, which in turn facilitates access to associated words. Participants solved anagrams of nouns associated with the ocean or the sky (e.g. dolphin = “ dplhion” or cloud = “ cdulo”). In six experiments we provided additional context information such as positional information (presenting the anagram at the top or the bottom of the screen), or pictorial information that either matched the ocean and sky theme or not, or both positional and pictorial information. Anagrams were solved faster when the position of the anagram was congruent with the location of the noun’s referent in the real world, but only when presented on the background of an ocean-sky picture. Thus, activating experiential traces indeed seems to activate related concepts but positional information alone is not enough to find facilitation in an anagram solving task. Rather what is needed is a whole set of traces that sufficiently narrow down the number of related concepts.

Die Beziehung zwischen sprachlicher und nicht-sprachlicher Kognition

Zusammenfassung. Die Beziehung zwischen sprachlicher und nicht-sprachlicher Kognition ist wenig verstanden. In der Vergangenheit wurden einige Arbeiten veröffentlicht, deren Ergebnisse in der Regel so interpretiert wurden, dass die sprachliche Kognition kaum oder gar nicht die nicht-sprachliche Kognition beeinflusst. Dies hat unseres Erachtens in der Vergangenheit dazu geführt, dass sprachliche und nicht-sprachliche Kognition eher separat beforscht wurden und zu der Vorstellung beigetragen, dass Sprache ein eigenständiges Modul innerhalb des kognitiven Systems besitzt, das funktional unabhängig von nicht-sprachlichen Prozessen ist. In jüngerer Zeit werden diese beiden Bereiche der Kognition im Rahmen des Grounded-Cognition-Ansatzes zusammengeführt, wobei allerdings linguistische Gesichtspunkte unberücksichtigt bleiben (z. B. die kompositionale Struktur sprachlicher Bedeutung). Daher sind die theoretischen Grenzen dieses Ansatzes als umfassendes Modell des menschlichen Sprachverstehens schon jetzt erkennbar. Nicht ganz unabhängig davon, erlebt die Forschung über das Verhältnis von Sprache und Denken in den letzten Jahren eine Wiederbelebung, die im Gegensatz zum Grounded-Cognition-Ansatz eher für die Vorstellung einer funktionalen Trennung von sprachlicher und nicht-sprachlicher Kognition spricht. Wir vertreten hier die These, dass das Verhältnis von sprachlicher und nicht-sprachlicher Kognition stark davon abhängt, welche Repräsentationsformen die beiden Bereiche involvieren. Wir diskutieren dabei zwei Sichtweisen (eine Zwei-Format-Sichtweise und eine Ein-Format-Sichtweise) und analysieren deren Implikationen für das theoretische Verständnis über den Zusammenhang von und sprachlicher und nicht-sprachlicher Kognition. Wir verdeutlichen diese Konzepte anhand aktueller Forschungsergebnisse. Unserer Meinung nach generiert die Ein–Format-Hypothese derzeit mehr Fragen als sie beantwortet. Im Gegensatz dazu erscheint uns die Zwei-Format-Hypothese als Forschungsansatz für die Kognitionspsychologie vielversprechender.

Language use statistics and prototypical grapheme colours predict synaesthetes' and non-synaesthetes' word-colour associations

Synaesthesia is the neuropsychological phenomenon in which individuals experience unusual sensory associations, such as experiencing particular colours in response to particular words. While it was once thought the particular pairings between stimuli were arbitrary and idiosyncratic to particular synaesthetes, there is now growing evidence for a systematic psycholinguistic basis to the associations. Here we sought to assess the explanatory value of quantifiable lexical association measures (via latent semantic analysis; LSA) in the pairings observed between words and colours in synaesthesia. To test this, we had synaesthetes report the particular colours they experienced in response to given concept words, and found that language association between the concept and colour words provided highly reliable predictors of the reported pairings. These results provide convergent evidence for a psycholinguistic basis to synaesthesia, but in a novel way, showing that exposure to particular patterns of associations in language can predict the formation of particular synaesthetic lexical-colour associations. Consistent with previous research, the prototypical synaesthetic colour for the first letter of the word also played a role in shaping the colour for the whole word, and this effect also interacted with language association, such that the effect of the colour for the first letter was stronger as the association between the concept word and the colour word in language increased. Moreover, when a group of non-synaesthetes were asked what colours they associated with the concept words, they produced very similar reports to the synaesthetes that were predicted by both language association and prototypical synaesthetic colour for the first letter of the word. This points to a shared linguistic experience generating the associations for both groups.

Reading sentences describing high- or low-pitched auditory events: only pianists show evidence for a horizontal space-pitch association

This study explored differences between pianists and non-musicians during reading of sentences describing high- or low-pitched auditory events. Based on the embodied model of language comprehension, it was hypothesized that the experience of playing the piano encourages a corresponding association between high-pitched sounds and the right and low-pitched sounds and the left. This pitch-space association is assumed to become elicited during understanding of sentences describing either a high- or low-pitched auditory event. In this study, pianists and non-musicians were tested based on the hypothesis that only pianists show a compatibility effect between implied pitch height and horizontal space, because only pianists have the corresponding experience with the piano keyboard. Participants read pitch-related sentences (e.g., the bear growls deeply, the soprano singer sings an aria) and judged whether the sentence was sensible or not by pressing either a left or right response key. The results indicated that only the pianists showed the predicted compatibility effect between implied pitch height and response location. Based on the results, it can be inferred that the experience of playing the piano led to an association between horizontal space and pitch height in pianists, while no such spatial association was elicited in non-musicians.

Emotion biases voluntary vertical action only with visible cues

Emotional information influences our bodily experiences according to the space-valence metaphor (positive/negative is up/down). In the present study, we examined whether visible and invisible emotional stimuli could also modulate voluntary action. After observing an emotional image (e.g., positive, neutral, or negative), participants used a joystick to arbitrarily position a dot stimulus in a display. The emotional image was either masked (masked condition) or not (unmasked condition) via a continuous flash suppression technique, i.e., dynamic interocular masking. We found that in the unmasked condition, the placed position of the dot was significantly higher after observing the positive image compared with the negative image, but this difference was not present in the masked condition. Our findings suggest that conscious emotional information is necessary for activating sensorimotor representations of vertical directions, and voluntary action is performed based on these activations.

Cross-modal metaphorical mapping of spoken emotion words onto vertical space

From the field of embodied cognition, previous studies have reported evidence of metaphorical mapping of emotion concepts onto a vertical spatial axis. Most of the work on this topic has used visual words as the typical experimental stimuli. However, to our knowledge, no previous study has examined the association between affect and vertical space using a cross-modal procedure. The current research is a first step toward the study of the metaphorical mapping of emotions onto vertical space by means of an auditory to visual cross-modal paradigm. In the present study, we examined whether auditory words with an emotional valence can interact with the vertical visual space according to a 'positive-up/negative-down' embodied metaphor. The general method consisted in the presentation of a spoken word denoting a positive/negative emotion prior to the spatial localization of a visual target in an upper or lower position. In Experiment 1, the spoken words were passively heard by the participants and no reliable interaction between emotion concepts and bodily simulated space was found. In contrast, Experiment 2 required more active listening of the auditory stimuli. A metaphorical mapping of affect and space was evident but limited to the participants engaged in an emotion-focused task. Our results suggest that the association of affective valence and vertical space is not activated automatically during speech processing since an explicit semantic and/or emotional evaluation of the emotionally valenced stimuli was necessary to obtain an embodied effect. The results are discussed within the framework of the embodiment hypothesis.

The embodied dynamics of perceptual causality: a slippery slope?

In Michotte's launching displays, while the launcher (object A) seems to move autonomously, the target (object B) seems to be displaced passively. However, the impression of A actively launching B does not persist beyond a certain distance identified as the "radius of action" of A over B. If the target keeps moving beyond the radius of action, it loses its passivity and seems to move autonomously. Here, we manipulated implied friction by drawing (or not) a surface upon which A and B are traveling, and by varying the inclination of this surface in screen- and earth-centered reference frames. Among 72 participants (n = 52 in Experiment 1; n = 20 in Experiment 2), we show that both physical embodiment of the event (looking straight ahead at a screen displaying the event on a vertical plane vs. looking downwards at the event displayed on a horizontal plane) and contextual information (objects moving along a depicted surface or in isolation) affect interpretation of the event and modulate the radius of action of the launcher. Using classical mechanics equations, we show that representational consistency of friction from radius of action responses emphasizes the embodied nature of frictional force in our cognitive architecture.

Re-examining the automaticity and directionality of the activation of the spatial-valence "good is up" metaphoric association

According to the Conceptual Metaphor Theory, people understand abstract concepts depending on the activation of more concrete concepts, but not vice versa. The present research aims to investigate the role of directionality and automaticity regarding the activation of the conceptual metaphor "good is up". Experiment 1 tested the automaticity of the spatial-to-valence metaphoric congruency effect by having participants judge the valence of a positive or negative word that appeared either at the top or at the bottom of the screen. They performed the task concurrently with a 6-digit verbal rehearsal task in the working-memory-load (WML) blocks and without this task in the non-WML blocks. The spatial-to-valence metaphoric congruency effect occurred for the positive words in the non-WML blocks (i.e., positive words are judged more quickly when they appeared at the top than at the bottom of the screen), but not in the WML blocks, suggesting that this metaphoric association might not be activated automatically. Experiments 2-6 investigated the valence-to-spatial metaphoric association and its automaticity. Participants processed a positive or negative prime, which appeared at the center of the screen, and then identified a letter (p/q) that subsequently appeared at the top or bottom of the screen. The valence-to-spatial metaphoric congruency effect did not occur in the WML (6-digit verbal rehearsal) or non-WML blocks, whether response modality to the prime was key-press or vocal, or whether the prime was a word or a picture. The effect only unexpectedly occurred when the task was simultaneously performed with a 4-dot-position visuospatial rehearsal task. Nevertheless, the data collapsed across multiple experiments showed a null valence-to-spatial metaphoric congruency effect, suggesting the absence of the valence-to-spatial metaphoric association in general. The implications of the current findings for the Conceptual Metaphor Theory and its alternatives are discussed.

Starting off on the right foot: strong right-footers respond faster with the right foot to positive words and with the left foot to negative words

Recent studies have provided evidence for an association between valence and left/right modulated by handedness, which is predicted by the body-specificity hypothesis (Casasanto, 2009) and also reflected in response times. We investigated whether such a response facilitation can also be observed with foot responses. Right-footed participants classified positive and negative words according to their valence by pressing a key with their left or right foot. A significant interaction between valence and foot only emerged in the by-items analysis. However, when dividing participants into two groups depending on the strength of their footedness, an interaction between valence and left/right was observed for strong right-footers, who responded faster with the right foot to positive words, and with the left foot to negative words. No interaction emerged for weak right-footers. The results strongly support the assumption that fluency lies at the core of the association between valence and left/right.

Musical metaphors: evidence for a spatial grounding of non-literal sentences describing auditory events

This study investigated whether the spatial terms high and low, when used in sentence contexts implying a non-literal interpretation, trigger similar spatial associations as would have been expected from the literal meaning of the words. In three experiments, participants read sentences describing either a high or a low auditory event (e.g., The soprano sings a high aria vs. The pianist plays a low note). In all Experiments, participants were asked to judge (yes/no) whether the sentences were meaningful by means of up/down (Experiments 1 and 2) or left/right (Experiment 3) key press responses. Contrary to previous studies reporting that metaphorical language understanding differs from literal language understanding with regard to simulation effects, the results show compatibility effects between sentence implied pitch height and response location. The results are in line with grounded models of language comprehension proposing that sensory motor experiences are being elicited when processing literal as well as non-literal sentences.