Testing the involvement of low-level visual representations during spoken word processing with non-Western students and meditators practicing Sudarshan Kriya Yoga

Previous studies, using the Continuous Flash Suppression (CFS) paradigm, observed that (Western) university students are better able to detect otherwise invisible pictures of objects when they are presented with the corresponding spoken word shortly before the picture appears. Here we attempted to replicate this effect with non-Western university students in Goa (India). A second aim was to explore the performance of (non-Western) meditators practicing Sudarshan Kriya Yoga in Goa in the same task. Some previous literature suggests that meditators may excel in some tasks that tap visual attention, for example by exercising better endogenous and exogenous control of visual awareness than non-meditators. The present study replicated the finding that congruent spoken cue words lead to significantly higher detection sensitivity than incongruent cue words in non-Western university students. Our exploratory meditator group also showed this detection effect but both frequentist and Bayesian analyses suggest that the practice of meditation did not modulate it. Overall, our results provide further support for the notion that spoken words can activate low-level category-specific visual features that boost the basic capacity to detect the presence of a visual stimulus that has those features. Further research is required to conclusively test whether meditation can modulate visual detection abilities in CFS and similar tasks.

Experiential traces first: Does holding a location in visuospatial working memory affect the processing of space-associated words?

This study aimed to systematically examine whether actively maintaining a visual location in working memory can influence the processing of spatially related words. In five experiments, we asked participants to maintain either the location or the shape of a visually presented stimulus in working memory so that it could later be compared with a test stimulus concerning the relevant target features. In between, we presented participants with words that refer to objects typically encountered in the upper or lower vertical space (roof vs. root, respectively). The task participants performed as a response to these words differed between experiments. In Experiments 1-3, participants performed a lexical decision task, in Experiment 4 they performed a semantic task (deciding whether the word refers to an occupation), and in Experiment 5 they performed a spatial task (deciding whether the word refers to something in the upper or lower visual field.) Only in Experiment 5 did we observe an interaction between the position of the visual stimulus held in working memory (up vs. down) and the meaning of the spatial words (associated with up vs. down). Our results therefore suggest that actively maintaining a stimulus location in working memory does not automatically affect the processing of spatially related words, but does so if the relevant spatial dimension is made highly salient by the task. The results are thus in line with studies showing a strong context-dependency of embodiment effects and thus allow the conclusion that language processing proper is not operating on a sensorimotor representational format.

No support for a causal role of primary motor cortex in construing meaning from language: An rTMS study

Embodied cognition theories predict a functional involvement of sensorimotor processes in language understanding. In a preregistered experiment, we tested this idea by investigating whether interfering with primary motor cortex (M1) activation can change how people construe meaning from action language. Participants were presented with sentences describing actions (e.g., "turning off the light") and asked to choose between two interpretations of their meaning, one more concrete (e.g., "flipping a switch") and another more abstract (e.g., "going to sleep"). Prior to this task, participants' M1 was disrupted using repetitive transcranial magnetic stimulation (rTMS). The results yielded strong evidence against the idea that M1-rTMS affects meaning construction (BF01 > 30). Additional analyses and control experiments suggest that the absence of effect cannot be accounted for by failure to inhibit M1, lack of construct validity of the task, or lack of power to detect a small effect. In sum, these results do not support a causal role for primary motor cortex in building meaning from action language.

Do linguistic stimuli activate experiential colour traces related to the entities they refer to and, if so, under what circumstances?

The simulation view of language comprehension holds that lexical-semantic access prompts the re-enactment of sensorimotor experiences that regularly accompany word use. For the colour domain, this suggests that reading about a stop sign reactivates experiences involving the perception of the stop sign and hence experiences involving the colour red. However, it is still not clear what circumstances would limit reactivation of colour experiences during comprehension, if the activation takes place. To address this question, we varied in our study the conditions in which the target colour stimuli appeared. The experimental stimuli were individual words (Experiment (Exp.) 1, Exp. 7, 8) or sentences (Exp. 2-6) referring to objects with a typical colour of either green or red (e.g., cucumber or raspberry). Across experiments, we manipulated the presence of fillers (present or not), and whether fillers referred to objects with other colour (e.g., honey) or objects without any particular colour (e.g., car). The stimuli were presented along with two clickable "yes" and "no" buttons, one of which was red and the other green. Location and button colour varied from trial to trial. The tasks were lexical decision (Exp. 1, Exp. 7-8) and sensibility judgement (Exp. 2-6). We observed faster response times in the match vs mismatch condition in all word-based experiments, but only in those sentence-based experiments that did not have fillers. This suggests that comprehenders indeed reactivate colour experiences when processing linguistic stimuli referring to objects with a typical colour, but this activation seems to occur only under certain circumstances.

The influence of sentence focus on mental simulation: A possible cause of ACE instability

Recent studies have revealed the instability of the action-sentence compatibility effect (ACE). The current study was designed to demonstrate the hypothesis that the instability of the ACE may be attributed to the instability of focused information in a sentence. A pilot study indicated that the focused information of sentences was relatively stable in the sentence-picture verification task but exhibited significant interindividual variability in the action-sentence compatibility paradigm in previous studies. Experiments 1 and 2 examined the effect of sentence focus on the shape match effect and the ACE by manipulating the focused information of sentences using the focus marker word "" (is). Experiment 1 found that the shape match effect occurred in the original sentence, while it disappeared when the word "" (is) was used to make an object noun no longer the focus of a sentence. Experiment 2 failed to observe the ACE regardless of whether the sentence focus was on the action information. Experiment 3 modified the focus manipulation to observe its impact on the ACE using different fonts and underlines to highlight the focused information. The results indicated that the ACE only occurred when the action information was the sentence focus. These findings suggest that sentence focus influences mental simulation, and the instability of the ACE is likely to be associated with the instability of sentence focus in previous studies. This outcome highlights the crucial role of identifying specific information as the critical element expressed in the current linguistic context for successful simulation.

Modal and amodal cognition: an overarching principle in various domains of psychology

Accounting for how the human mind represents the internal and external world is a crucial feature of many theories of human cognition. Central to this question is the distinction between modal as opposed to amodal representational formats. It has often been assumed that one but not both of these two types of representations underlie processing in specific domains of cognition (e.g., perception, mental imagery, and language). However, in this paper, we suggest that both formats play a major role in most cognitive domains. We believe that a comprehensive theory of cognition requires a solid understanding of these representational formats and their functional roles within and across different domains of cognition, the developmental trajectory of these representational formats, and their role in dysfunctional behavior. Here we sketch such an overarching perspective that brings together research from diverse subdisciplines of psychology on modal and amodal representational formats so as to unravel their functional principles and their interactions.

The influence of sentence focus on motor system activity in language comprehension and its temporal dynamics: Preliminary evidence from sEMG

Previous research has shown that individual experiences and experimental tasks can influence the occurrence of mental simulation during sentence comprehension. However, little research has focused on the effect of sentence focus on mental simulation and its temporal dynamics. Sentence focus refers to the hierarchical structure of information within a sentence, where focused information represents the most prominent and essential information. In contrast, nonfocused information provides a background for the focused information. The present study investigated whether sentence focus would affect the activity of the motor system in language comprehension and at which stage the effect of sentence focus occurred. We measured spontaneous arm muscle electrical activity by surface electromyography (sEMG) while participants read action-focused, nonaction-focused, and control sentences. We observed greater spontaneous muscle electrical activity in the flexor common muscle of the fingers when participants read action-focused sentences compared to nonaction-focused and control sentences. Additionally, there was an interactive trend between sentence type and time, spontaneous muscle electrical activity while reading action-focused sentences was observed in both early (1 ms to 300 ms after the presentation of the action phrase) and late time windows (901 ms to 1500 ms after the action phrase). The findings suggest that the motor system exhibits flexible engagement during language comprehension and the impact of sentence focus on motor system activity may be throughout both the lexical-semantic retrieval and sentence-meaning integration stages.

Word-association norms for 1,100 French words with varying levels of concreteness

The organisation of concepts in the mental lexicon is a widely studied research topic in experimental psychology. For instance, several studies have shown that whereas concrete concepts are organised according to semantic similarity, abstract concepts are organised according to verbal association. However, these results are not systematically replicated, mainly due to a lack of normative database especially in French. To that end, we introduce a French word-association database for 1,100 cues with varying levels of concreteness from abstract to concrete concepts. Analyses from the word-association task revealed stronger association strength for concrete concepts compared with abstract concepts. Additional results showed that cues tend to elicit responses of a similar level of concreteness. The database will be useful for investigators interested in French verbal associations for abstract and concrete concepts. The data (available on OSF https://osf.io/dhuqs/) introduce responses organised according to association strength and provides cue concreteness.

Embodied Processing at Six Linguistic Granularity Levels: A Consensus Paper

Language processing is influenced by sensorimotor experiences. Here, we review behavioral evidence for embodied and grounded influences in language processing across six linguistic levels of granularity. We examine (a) sub-word features, discussing grounded influences on iconicity (systematic associations between word form and meaning); (b) words, discussing boundary conditions and generalizations for the simulation of color, sensory modality, and spatial position; (c) sentences, discussing boundary conditions and applications of action direction simulation; (d) texts, discussing how the teaching of simulation can improve comprehension in beginning readers; (e) conversations, discussing how multi-modal cues improve turn taking and alignment; and (f) text corpora, discussing how distributional semantic models can reveal how grounded and embodied knowledge is encoded in texts. These approaches are converging on a convincing account of the psychology of language, but at the same time, there are important criticisms of the embodied approach and of specific experimental paradigms. The surest way forward requires the adoption of a wide array of scientific methods. By providing complimentary evidence, a combination of multiple methods on various levels of granularity can help us gain a more complete understanding of the role of embodiment and grounding in language processing.

Grounded Cognition Entails Linguistic Relativity: A Neglected Implication of a Major Semantic Theory

According to the popular Grounded Cognition Model (GCM), the sensory and motor features of concepts, including word meanings, are stored directly within neural systems for perception and action. More precisely, the core claim is that these concrete conceptual features reuse some of the same modality-specific representations that serve to categorize experiences involving the relevant kinds of objects and events. Research in semantic typology, however, has shown that word meanings vary significantly across the roughly 6500 languages in the world. I argue that this crosslinguistic semantic diversity has significant yet previously unrecognized theoretical consequences for the GCM. In particular, to accommodate the typological data, the GCM must assume that the concrete features of word meanings are not merely stored within sensory/motor brain systems, but are represented there in ways that are, to a nontrivial degree, language-specific. Moreover, it must assume that these conceptual representations are also activated during the nonlinguistic processing of the relevant kinds of objects and events (e.g., during visual perception and action planning); otherwise, they would not really be grounded, which is to say, embedded inside sensory/motor systems. Crucially, however, such activations would constitute what is traditionally called linguistic relativity-that is, the influence of language-specific semantic structures on other forms of cognition. The overarching aim of this paper is to elaborate this argument more fully and explore its repercussions. To that end, I discuss in greater detail the key aspects of the GCM, the evidence for crosslinguistic semantic diversity, pertinent work on linguistic relativity, the central claim that the GCM entails linguistic relativity, some initial supporting results, and some important limitations and future directions.

Losing the sense of smell does not disrupt processing of odor words

Whether language is grounded in action and perception has been a key question in cognitive science, yet little attention has been given to the sense of smell. We directly test whether smell is necessary for comprehension of odor language, by comparing language processing in a group of participants with no sense of smell (anosmics) to a group of control participants. We found no evidence for a difference in online comprehension of odor and taste language between anosmics and controls using a lexical decision task and a semantic similarity judgment task, suggesting olfaction is not critical to the comprehension of odor language. Contrary to predictions, anosmics were better at remembering odor words, and rated odor and taste words as more positively valenced than control participants. This study finds no detriment to odor language after losing the sense of smell, supporting the proposal that odor language is not grounded in odor perception.

Motor features of abstract verbs determine their representations in the motor system

Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.

Does the involvement of motor cortex in embodied language comprehension stand on solid ground? A p-curve analysis and test for excess significance of the TMS and tDCS evidence

According to the embodied cognition view, comprehending action-related language requires the participation of sensorimotor processes. A now sizeable literature has tested this proposal by stimulating (with TMS or tDCS) motor brain areas during the comprehension of action language. To assess the evidential value of this body of research, we exhaustively searched the literature and submitted the relevant studies (N = 43) to p-curve analysis. While most published studies concluded in support of the embodiment hypothesis, our results suggest that we cannot yet assert beyond reasonable doubt that they explore real effects. We also found that these studies are quite underpowered (estimated power < 30%), which means that a large percentage of them would not replicate if repeated identically. Additional tests for excess significance show signs of publication bias within this literature. In sum, extant brain stimulation studies testing the grounding of action language in the motor cortex do not stand on solid ground. We provide recommendations that will be important for future research on this topic.

Abstract concepts: external influences, internal constraints, and methodological issues

There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.

Look at what I can do: Object affordances guide visual attention while speakers describe potential actions

As we act on the world around us, our eyes seek out objects we plan to interact with. A growing body of evidence suggests that overt visual attention selects objects in the environment that could be interacted with, even when the task precludes physical interaction. In previous work, objects that afford grasping interactions influenced attention when static scenes depicted reachable spaces, and attention was otherwise better explained by general informativeness. Because grasping is but one of many object interactions, previous work may have downplayed the influence of object affordances on attention. The current study investigated the relationship between overt visual attention and object affordances versus broadly construed semantic information in scenes as speakers describe or memorize scenes. In addition to meaning and grasp maps-which capture informativeness and grasping object affordances in scenes, respectively-we introduce interact maps, which capture affordances more broadly. In a mixed-effects analysis of 5 eyetracking experiments, we found that meaning predicted fixated locations in a general description task and during scene memorization. Grasp maps marginally predicted fixated locations during action description for scenes that depicted reachable spaces only. Interact maps predicted fixated regions in description experiments alone. Our findings suggest observers allocate attention to scene regions that could be readily interacted with when talking about the scene, while general informativeness preferentially guides attention when the task does not encourage careful consideration of objects in the scene. The current study suggests that the influence of object affordances on visual attention in scenes is mediated by task demands.

The Postural Effect on the Memory of Manipulable Objects

The grounded cognition approach posits the involvement of sensory-motor processes in the representation of knowledge. However, the functional impact of these processes on cognition has been questioned, and some authors have explored the effect of motor interference on memory to test causally this hypothesis. In a seminal study, Dutriaux and Gyselinck (2016) showed that keeping the hands behind the back during learning decreases the memory of manipulable objects, but not the memory of nonmanipulable objects. The aim of this paper is to shed light on the mechanism behind the effect of posture in memory observed by Dutriaux and Gyselinck. The present experiment replicated the posture manipulation during learning but asked participants to keep their hands behind the back during recall. Results showed a similar detrimental effect of the hands behind the back specific to manipulable objects. This shows that the mechanism behind this effect arises from postural interference rather than from a compatibility between the posture during learning and the posture during recall and adds new evidence in favor of the sensory-motor grounding of knowledge.

The limits of automatic sensorimotor processing during word processing: investigations with repeated linguistic experience, memory consolidation during sleep, and rich linguistic learning contexts

While a number of studies have repeatedly demonstrated an automatic activation of sensorimotor experience during language processing in the form of action-congruency effects, as predicted by theories of grounded cognition, more recent research has not found these effects for words that were just learned from linguistic input alone, without sensorimotor experience with their referents. In the present study, we investigate whether this absence of effects can be attributed to a lack of repeated experience and consolidation of the associations between words and sensorimotor experience in memory. To address these issues, we conducted four experiments in which (1 and 2) participants engaged in two separate learning phases in which they learned novel words from language alone, with an intervening period of memory-consolidating sleep, and (3 and 4) we employed familiar words whose referents speakers have no direct experience with (such as plankton). However, we again did not observe action-congruency effects in subsequent test phases in any of the experiments. This indicates that direct sensorimotor experience with word referents is a necessary requirement for automatic sensorimotor activation during word processing.

Is rushing always faster than strolling? A reaction time study on the processing of sentences containing manner of motion verbs

In the context of the embodied cognition debate, an effect of motion verb associated speed information has previously been detected using eye-tracking, functional magnetic resonance imaging (fMRI), and reaction times (RT). The latter, for instance, was implemented by Wender and Weber (1982), who observed that participants were faster in detecting motion in sentences associated with fast motion compared to sentences associated with slow motion after having formed mental images of the sentences' content. It remains open whether the reported effects of speed are associated with automatic lexical-semantic retrieval processes or whether they reflect higher top-down cognitive processes. To answer this question, the paradigm by Wender and Weber (1982) was adopted and further elaborated in the present study. In Experiment 1 visualization instructions were eliminated. Additionally, the stimulus material was manipulated in regards to the agent of the described movement (human vs. object motion) in order to determine the representation's modality (visual vs. motoric). In Experiment 2, the task to detect motion was replaced by the task to judge sensicality. The results suggest that the prompt to perform mental imagery is not a precondition for the engagement of modal representations in this speed of motion paradigm and that the involved representations' modality is visual rather than motoric. However, the modal representations' involvement is dependent on the task. They thus do not seem to be part of the invariant semantic representation of manner of motion verbs.

Emotional Valence Precedes Semantic Maturation of Words: A Longitudinal Computational Study of Early Verbal Emotional Anchoring

We present a longitudinal computational study on the connection between emotional and amodal word representations from a developmental perspective. In this study, children's and adult word representations were generated using the latent semantic analysis (LSA) vector space model and Word Maturity methodology. Some children's word representations were used to set a mapping function between amodal and emotional word representations with a neural network model using ratings from 9-year-old children. The neural network was trained and validated in the child semantic space. Then, the resulting neural network was tested with adult word representations using ratings from an adult data set. Samples of 1210 and 5315 words were used in the child and the adult semantic spaces, respectively. Results suggested that the emotional valence of words can be predicted from amodal vector representations even at the child stage, and accurate emotional propagation was found in the adult word vector representations. In this way, different propagative processes were observed in the adult semantic space. These findings highlight a potential mechanism for early verbal emotional anchoring. Moreover, different multiple linear regression and mixed-effect models revealed moderation effects for the performance of the longitudinal computational model. First, words with early maturation and subsequent semantic definition promoted emotional propagation. Second, an interaction effect between age of acquisition and abstractness was found to explain model performance. The theoretical and methodological implications are discussed.

Comprensión de oraciones de esfuerzo en jóvenes y adultos mayores desde una perspectiva corpórea

Actualmente se desconoce la validez de las propuestas de la cognición corpórea y su relación con el lenguaje de los adultos mayores. Para responder a esto realizamos un experimento con los factores Esfuerzo, Imaginabilidad y Contexto Lingüístico. 50 adultos mayores (M= 66.18 años, DE= 4.39, 22 mujeres y 28 hombres) y 43 jóvenes (M= 21.28 años, DE= 1.08, 36 mujeres y 7 hombres) leyeron oraciones en la pantalla de un computador, presionando la barra espaciadora para decidir luego si una palabra se hallaba o no en la frase recién leída. Los resultados muestran efectos principales para los factores Imaginabilidad (β = 0.309; p < 0.05) y Contexto (β = -0.856; p < 0.001) en los tiempos de lectura del objeto directo, dos efectos de interacción Imaginabilidad-Esfuerzo (β = -0.732; p < 0.01) e Imaginabilidad-Contexto (β = 0.611; p < 0.05) para el complemento circunstancial y un efecto interactivo Imaginabilidad-Contexto (β = 0.727; p < 0.05) para la palabra de activación. Los resultados respaldan una visión de corporeidad débil con integración interactiva de las propiedades corpóreas y simbólicas de los textos. Es necesario ampliar la investigación a otros parámetros corpóreos, edades y lenguas para contrastar estos resultados.

No fruits without color: Cross-modal priming and EEG reveal different roles for different features across semantic categories

Category-specific impairments witnessed in patients with semantic deficits have broadly dissociated into natural and artificial kinds. However, how the category of food (more specifically, fruits and vegetables) fits into this distinction has been difficult to interpret, given a pattern of deficit that has inconsistently mapped onto either kind, despite its intuitive membership to the natural domain. The present study explores the effects of a manipulation of a visual sensory (i.e., color) or functional (i.e., orientation) feature on the consequential semantic processing of fruits and vegetables (and tools, by comparison), first at the behavioral and then at the neural level. The categorization of natural (i.e., fruits/vegetables) and artificial (i.e., utensils) entities was investigated via cross-modal priming. Reaction time analysis indicated a reduction in priming for color-modified natural entities and orientation-modified artificial entities. Standard event-related potentials (ERP) analysis was performed, in addition to linear classification. For natural entities, a N400 effect at central channel sites was observed for the color-modified condition compared relative to normal and orientation conditions, with this difference confirmed by classification analysis. Conversely, there was no significant difference between conditions for the artificial category in either analysis. These findings provide strong evidence that color is an integral property to the categorization of fruits/vegetables, thus substantiating the claim that feature-based processing guides as a function of semantic category.

Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes

Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension ('grounding'). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling.

Crossing hands behind your back reduces recall of manual action sentences and alters brain dynamics

The embodied meaning approach posits that understanding action-related language recruits motor processes in the brain. However, the functional impact of these motor processes on cognition has been questioned. The present study aims to provide new electrophysiological (EEG) evidence concerning the role of motor processes in the comprehension and memory of action language. Participants read lists of sentences including manual-action or attentional verbs, while keeping their hands either in front of them or crossing them behind their back. Results showed that posture impacted selectively the processing of manual action sentence, and not of attentional sentences, in three different ways: 1) EEG fronto-central beta rhythms, a signature of motor processes, were desynchronized while reading action sentences in the hands-in-front posture compared to the hands-behind posture. The estimated source was the posterior cingulate cortex, involved in proprioceptive regulation. 2) Recall of nouns associated with manual sentences decreased when learning occurred in the hands-behind posture. 3) ERPs analysis revealed that the initial posture at learning modulates neural processes during subsequent recall of manual sentences in the left superior frontal gyrus, which is related to motor processes. These results provide decisive evidence for the functional involvement of embodied simulations in the encoding and retrieval of action-related language.

Exocentric coding of the mapping between valence and regions of space: Implications for embodied cognition

Converging evidence has established that positive concepts presented on a computer screen are associated with upper regions of space, and negative concepts with a lower region of space. One explanation for this is that understanding positive or negative concepts requires the re-experiencing of direction, whereby “happy is up” and “sad is down.” However, it is unclear how the regions of space are encoded in these paradigms, space can be encoded in relation to oneself (egocentrically) or in object centred coordinates that are independent of oneself (exocentrically). The current study compares exocentric and egocentric coding of space, using a variation of the Meier and Robinson (2004) paradigm. Participants were asked to evaluate valenced concepts in either the upper or lower half of the screen. Spatial primes were used such that the concepts were preceded by either an upwards or a downwards eye movement. Exocentric coding of space in this paradigm was the computer screen, whilst egocentric coding was the eye movement used to access the top or bottom of the screen. It was proposed that egocentric coding of space, being coded in the body, provides evidence of a stronger relationship between the original bodily state of ‘up’ or ‘down’ and subsequent simulation. However, significant results supported an exocentric coding of space, with faster responses to positive concepts in the upper half of the screen, and to negative concepts in the lower half, irrespective of the direction of the eye movement preceding it. The implications of this for embodied cognition are discussed.

Two Challenges to "Embodied Cognition" Research And How to Overcome Them

From the time the notion "embodied cognition" has entered the field, researchers have been concerned about its meaning. Does the term refer to a coherent theoretical framework? Despite these concerns, use of the term "embodied cognition" has increased over the years to plateau in recent years. I will argue that the best way forward is not to search for evidence for or against some vague label but rather to systematically, in large-scale projects, address a series of questions that focus on well-defined cognitive tasks. Such projects ought involve preregistration, replication, and open materials, code, and data. For this enterprise to take off, it is important that incentives in the field be aligned with the goal to increase the reliability and validity of our research. There is reason to be optimistic that such an alignment will occur in the near future.

Mental Simulations of Phonological Representations Are Causally Linked to Silent Reading of Direct Versus Indirect Speech

Embodied theories propose that language is understood via mental simulations of sensory states related to perception and action. Given that direct speech (e.g., She says, "It's a lovely day!") is perceived to be more vivid than indirect speech (e.g., She says (that) it's a lovely day) in perception, recent research shows in silent reading that more vivid speech representations are mentally simulated for direct speech than for indirect speech. This 'simulated' speech is found to contain suprasegmental prosodic representations (e.g., speech prosody) but its phonological detail and its causal role in silent reading of direct speech remain unclear. Here in three experiments, I explored the phonological aspect and the causal role of speech simulations in silent reading of tongue twisters in direct speech, indirect speech and non-speech sentences. The results demonstrated greater visual tongue-twister effects (phonemic interference) during silent reading (Experiment 1) but not oral reading (Experiment 2) of direct speech as compared to indirect speech and non-speech. The tongue-twister effects in silent reading of direct speech were selectively disrupted by phonological interference (concurrent articulation) as compared to manual interference (finger tapping) (Experiment 3). The results replicated more vivid speech simulations in silent reading of direct speech, and additionally extended them to the phonological dimension. Crucially, they demonstrated a causal role of phonological simulations in silent reading of direct speech, at least in tongue-twister reading. The findings are discussed in relation to multidimensionality and task dependence of mental simulation and its mechanisms.

A Future of Words: Language and the Challenge of Abstract Concepts

The paper outlines one of the most important challenges that embodied and grounded theories need to face, i.e., that to explain how abstract concepts (abstractness) are acquired, represented, and used. I illustrate the view according to which abstract concepts are grounded not only in sensorimotor experiences, like concrete concepts, but also and to a greater extent in linguistic, social, and inner experiences. Specifically, I discuss the role played by metacognition, inner speech, social metacognition, and interoception. I also present evidence showing that the weight of linguistic, social, and inner experiences varies depending on the considered sub-kind of abstract concepts (e.g., mental states and spiritual concepts, numbers, emotions, social concepts). I argue that the challenge to explain abstract concepts representation implies the recognition of: a. the role of language, intended as inner and social tool, in shaping our mind; b. the importance of differences across languages; c. the existence of different kinds of abstract concepts; d. the necessity to adopt new paradigms, able to capture the use of abstract concepts in context and interactive situations. This challenge should be addressed with an integrated approach that bridges developmental, anthropological, and neuroscientific studies. This approach extends embodied and grounded views incorporating insights from distributional statistics views of meaning, from pragmatics and semiotics.

Towards Understanding the Task Dependency of Embodied Language Processing: The Influence of Colour During Language-Vision Interactions

A main challenge for theories of embodied cognition is to understand the task dependency of embodied language processing. One possibility is that perceptual representations (e.g., typical colour of objects mentioned in spoken sentences) are not activated routinely but the influence of perceptual representation emerges only when context strongly supports their involvement in language. To explore this question, we tested the effects of colour representations during language processing in three visual-world eye-tracking experiments. On critical trials, participants listened to sentence-embedded words associated with a prototypical colour (e.g., ‘…spinach…’) while they inspected a visual display with four printed words (Experiment 1), coloured or greyscale line drawings (Experiment 2) and a ‘blank screen’ after a preview of coloured or greyscale line drawings (Experiment 3). Visual context always presented a word/object (e.g., frog) associated with the same prototypical colour (e.g. green) as the spoken target word and three distractors. When hearing spinach participants did not prefer the written word frog compared to other distractor words (Experiment 1). In Experiment 2, colour competitors attracted more overt attention compared to average distractors, but only for the coloured condition and not for greyscale trials. Finally, when the display was removed at the onset of the sentence, and in contrast to the previous blank-screen experiments with semantic competitors, there was no evidence of colour competition in the eye-tracking record (Experiment 3). These results fit best with the notion that the main role of perceptual representations in language processing is to contextualize language in the immediate environment.

Semantic similarity and associated abstractness norms for 630 French word pairs

The representation of abstract concepts remains a challenge, justifying the need for further experimental investigation. To that end, we introduce a normative database for 630 semantically similar French word pairs and associated levels of abstractness for 1260 isolated words based on data from 900 subjects. The semantic similarity and abstractness norms were obtained in two studies using 7-point scales. The database is organised according to word-pair semantic similarity, abstractness, and associated lexical variables such as word length (in number of letters), word frequency, and other lexical variables to allow for matching of experimental material. The associated variables were obtained by cross-referencing our database with other known psycholinguistic databases including Lexique (New et al., 2004), the French Lexicon Project (Ferrand et al., 2010), Wordlex (Gimenes & New, 2016), and MEGALEX (Ferrand et al., 2018). We introduced sufficient diversity to allow researchers to select pairs with varying levels of semantic similarity and abstractness. In addition, it is possible to use these data as continuous or discrete variables. The full data are available in the supplementary materials as well as on OSF ( https://osf.io/qsd4v/ ).

Is Complex Visual Information Implicated During Language Comprehension? The Case of Cast Shadows

Previous research showed that sensorimotor information affects the perception of properties associated with implied perceptual context during language comprehension. Three experiments addressed a novel question of whether perceptual context may contribute to a simulation of information about such out-of-sight objects as cast shadows. In Experiment 1, participants read a sentence that implied a particular shadow cast on a target (blinds vs. an open window) and then verified the picture of the object onto which a shadow was cast. Responses were faster when the shadow of blinds cast on the object matched that implied by the sentence. However, the data did not show the same matching effect for pictures with cast shadows from an open window. In Experiments 2 and 3, we found that verification times for pictures with no cast shadows were faster when preceded by an "open window" sentence, thus suggesting that reading the sentence does not elicit a visual simulation of any specific shadow. Experiment 3 showed that the objects superimposed with a cast shadow of the blinds and blinds themselves were verified faster after reading a "blinds" sentence. However, the results of an order analysis showed the temporal stability of the "blinds shadows" effect, but the disappearance of the "blinds" effect in the second half of the data. We conclude that the results are compatible, to a lesser or greater extent, with multiple accounts, and discuss our findings in the context of a mental imagery view, a mental simulation view, and an amodal representation view.

Does Object Size Matter With Regard to the Mental Simulation of Object Orientation?

Abstract. Language comprehenders have been arguing to mentally represent the implied orientation of objects. However, compared to the effects of shape, size, and color, the effect of orientation is rather small. We examined a potential explanation for the relatively low magnitude of the orientation effect: Object size moderates the orientation effect. Theoretical considerations led us to predict a smaller orientation effect for small objects than for large objects in a sentence–picture verification task. We furthermore investigated whether this pattern generalizes across languages (Chinese, Dutch, and English) and tasks (picture-naming task). The results of the verification task show an orientation effect overall, which is not moderated by object size (contrary to our hypothesis) and language (consistent with our hypothesis). Meanwhile, the preregistered picture–picture verification task showed the predicted interaction between object size and orientation effect. We conducted exploratory analyses to address additional questions.