Perception, action, and word meanings in the human brain: the case from action verbs

Shared representations of human actions across vision and language

Humans can recognize and communicate about many actions performed by others. How are actions organized in the mind, and is this organization shared across vision and language? We collected similarity judgments of human actions depicted through naturalistic videos and sentences, and tested four models of action categorization, defining actions at different levels of abstraction ranging from specific (action verb) to broad (action target: whether an action is directed towards an object, another person, or the self). The similarity judgments reflected a shared organization of action representations across videos and sentences, determined mainly by the target of actions, even after accounting for other semantic features. Furthermore, language model embeddings predicted the behavioral similarity of action videos and sentences, and captured information about the target of actions alongside unique semantic information. Together, our results show that action concepts are similarly organized in the mind across vision and language, and that this organization reflects socially relevant goals.

What we mean when we say semantic: Toward a multidisciplinary semantic glossary

Tulving characterized semantic memory as a vast repository of meaning that underlies language and many other cognitive processes. This perspective on lexical and conceptual knowledge galvanized a new era of research undertaken by numerous fields, each with their own idiosyncratic methods and terminology. For example, "concept" has different meanings in philosophy, linguistics, and psychology. As such, many fundamental constructs used to delineate semantic theories remain underspecified and/or opaque. Weak construct specificity is among the leading causes of the replication crisis now facing psychology and related fields. Term ambiguity hinders cross-disciplinary communication, falsifiability, and incremental theory-building. Numerous cognitive subdisciplines (e.g., vision, affective neuroscience) have recently addressed these limitations via the development of consensus-based guidelines and definitions. The project to follow represents our effort to produce a multidisciplinary semantic glossary consisting of succinct definitions, background, principled dissenting views, ratings of agreement, and subjective confidence for 17 target constructs (e.g., abstractness, abstraction, concreteness, concept, embodied cognition, event semantics, lexical-semantic, modality, representation, semantic control, semantic feature, simulation, semantic distance, semantic dimension). We discuss potential benefits and pitfalls (e.g., implicit bias, prescriptiveness) of these efforts to specify a common nomenclature that other researchers might index in specifying their own theoretical perspectives (e.g., They said X, but I mean Y).

The label-feedback effect is influenced by target category in visual search

The label-feedback hypothesis states that language can modulate visual processing. In particular, hearing or reading aloud target names (labels) speeds up performance in visual search tasks by facilitating target detection and such advantage is often measured against a condition where the target name is shown visually (i.e. via the same modality as the search task). The current study conceptually complements and expands previous investigations. The effect of a multimodal label presentation (i.e., an audio+visual, AV, priming label) in a visual search task is compared to that of a multimodal (i.e. white noise+visual, NV, label) and two unimodal (i.e. audio, A, label or visual, V, label) control conditions. The name of a category (i.e. a label at the superordinate level) is used as a cue, instead of the more commonly used target name (a basic level label), with targets belonging to one of three categories: garments, improper weapons, and proper weapons. These categories vary for their structure, improper weapons being an ad hoc category (i.e. context-dependent), unlike proper weapons and garments. The preregistered analysis shows an overall facilitation of visual search performance in the AV condition compared to the NV condition, confirming that the label-feedback effect may not be explained away by the effects of multimodal stimulation only and that it extends to superordinate labels. Moreover, exploratory analyses show that such facilitation is driven by the garments and proper weapons categories, rather than improper weapons. Thus, the superordinate label-feedback effect is modulated by the structural properties of a category. These findings are consistent with the idea that the AV condition prompts an "up-regulation" of the label, a requirement for enhancing the label's beneficial effects, but not when the label refers to an ad hoc category. They also highlight the peculiar status of the category of improper weapons and set it apart from that of proper weapons.

The language network as a natural kind within the broader landscape of the human brain

Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.

Grounded Cognition Entails Linguistic Relativity: A Neglected Implication of a Major Semantic Theory

According to the popular Grounded Cognition Model (GCM), the sensory and motor features of concepts, including word meanings, are stored directly within neural systems for perception and action. More precisely, the core claim is that these concrete conceptual features reuse some of the same modality-specific representations that serve to categorize experiences involving the relevant kinds of objects and events. Research in semantic typology, however, has shown that word meanings vary significantly across the roughly 6500 languages in the world. I argue that this crosslinguistic semantic diversity has significant yet previously unrecognized theoretical consequences for the GCM. In particular, to accommodate the typological data, the GCM must assume that the concrete features of word meanings are not merely stored within sensory/motor brain systems, but are represented there in ways that are, to a nontrivial degree, language-specific. Moreover, it must assume that these conceptual representations are also activated during the nonlinguistic processing of the relevant kinds of objects and events (e.g., during visual perception and action planning); otherwise, they would not really be grounded, which is to say, embedded inside sensory/motor systems. Crucially, however, such activations would constitute what is traditionally called linguistic relativity-that is, the influence of language-specific semantic structures on other forms of cognition. The overarching aim of this paper is to elaborate this argument more fully and explore its repercussions. To that end, I discuss in greater detail the key aspects of the GCM, the evidence for crosslinguistic semantic diversity, pertinent work on linguistic relativity, the central claim that the GCM entails linguistic relativity, some initial supporting results, and some important limitations and future directions.

Integration of event experiences to build relational knowledge in the human brain

We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic memory area important for temporal relations, anterior-lateral entorhinal cortex, and a semantic memory area important for action concepts, middle temporal gyrus, to understand how and when these areas contribute to these processes. Participants underwent functional magnetic resonance imaging while learning and recalling temporal relations among novel events over two sessions 1 week apart. Across distinct contexts, individual temporal relations among events could either be consistent or inconsistent with each other. Within each context, during the recall phase, we measured associative coding as the difference of multivoxel correlations among related vs unrelated pairs of events. Neural regions that form integrative representations should exhibit stronger associative coding in the consistent than the inconsistent contexts. We found evidence of integrative representations that emerged quickly in anterior-lateral entorhinal cortex (at session 1), and only subsequently in middle temporal gyrus, which showed a significant change across sessions. A complementary pattern of findings was seen with signatures during learning. This suggests that integrative representations are established early in anterior-lateral entorhinal cortex and may be a pathway to the later emergence of semantic knowledge in middle temporal gyrus.

A data-driven investigation of human action representations

Understanding actions performed by others requires us to integrate different types of information about people, scenes, objects, and their interactions. What organizing dimensions does the mind use to make sense of this complex action space? To address this question, we collected intuitive similarity judgments across two large-scale sets of naturalistic videos depicting everyday actions. We used cross-validated sparse non-negative matrix factorization to identify the structure underlying action similarity judgments. A low-dimensional representation, consisting of nine to ten dimensions, was sufficient to accurately reconstruct human similarity judgments. The dimensions were robust to stimulus set perturbations and reproducible in a separate odd-one-out experiment. Human labels mapped these dimensions onto semantic axes relating to food, work, and home life; social axes relating to people and emotions; and one visual axis related to scene setting. While highly interpretable, these dimensions did not share a clear one-to-one correspondence with prior hypotheses of action-relevant dimensions. Together, our results reveal a low-dimensional set of robust and interpretable dimensions that organize intuitive action similarity judgments and highlight the importance of data-driven investigations of behavioral representations.

Verb and sentence processing with TMS: A systematic review and meta-analysis

Transcranial magnetic stimulation (TMS) has provided relevant evidence regarding the neural correlates of language. The aim of the present study is to summarize and assess previous findings regarding linguistic levels (i.e., semantic and morpho-syntactic) and brain structures utilized during verb and sentence processing. To do that, we systematically reviewed TMS research on verb and sentence processing in healthy speakers, and meta-analyzed TMS-induced effects according to the region of stimulation and experimental manipulation. Findings from 45 articles show that approximately half of the reviewed work focuses on the embodiment of action verbs. The majority of studies (60%) target only one cortical region in relation to a specific linguistic process. Frontal areas are most frequently stimulated in connection to morphosyntactic processes and action verb semantics, and temporoparietal regions in relation to integration of sentential meaning and thematic role assignment. A meta-analysis of 72 effect sizes of the reviewed papers indicates that TMS has a small overall effect size, but effect sizes for anterior compared to posterior regions do not differ for semantic or morphosyntactic contrasts. Our findings stress the need to increase the number of targeted areas, while using the same linguistic contrasts in order to disentangle the contributions of different cortical regions to distinct linguistic processes.

Representation of motion concepts in occipitotemporal cortex: fMRI activation, decoding and connectivity analyses

Embodied theories of semantic cognition predict that brain regions involved in motion perception are engaged when people comprehend motion concepts expressed in language. Left lateral occipitotemporal cortex (LOTC) is implicated in both motion perception and motion concept processing but prior studies have produced mixed findings on which parts of this region are engaged by motion language. We scanned participants performing semantic judgements about sentences describing motion events and static events. We performed univariate analyses, multivariate pattern analyses (MVPA) and psychophysiological interaction (PPI) analyses to investigate the effect of motion on activity and connectivity in different parts of LOTC. In multivariate analyses that decoded whether a sentence described motion or not, the middle and posterior parts of LOTC showed above-chance level performance, with performance exceeding that of other brain regions. Univariate ROI analyses found the middle part of LOTC was more active for motion events than static ones. Finally, PPI analyses found that when processing motion events, the middle and posterior parts of LOTC (overlapping with motion perception regions), increased their connectivity with cognitive control regions. Taken together, these results indicate that the more posterior parts of LOTC, including motion perception cortex, respond differently to motion vs. static events. These findings are consistent with embodiment accounts of semantic processing, and suggest that understanding verbal descriptions of motion engages areas of the occipitotemporal cortex involved in perceiving motion.

Neural correlates of embodied action language processing: a systematic review and meta-analytic study

The neural correlates of action language processing are still debated within embodied cognition research and little is known about the flexible involvement of modality-specific pre-motor system and multimodal high-level temporo-parietal regions as a function of explicit and implicit tasks. A systematic review and the Activation likelihood estimation (ALE) meta-analyses on functional neuroimaging studies were performed to identify neural correlates of action language processing activated during explicit and implicit tasks. The contrast ALE meta-analysis revealed activation of modality-specific premotor area and inferior frontal areas during explicit action language tasks while a greater activation of posterior temporo-occipital areas emerged for implicit tasks. The conjunction analysis revealed overlap in the temporo-parietal multimodal high-level regions for both types of tasks. Functional specialization of the middle temporal gyrus was found where the more posterior-occipital part resulted activated during implicit action language tasks whereas the antero-lateral part was involved in explicit tasks. Our findings were discussed within a conceptual flexibility perspective about the involvement of both the modality-specific and multimodal brain system during action language processing depending on different types of tasks.

Social-affective features drive human representations of observed actions

Humans observe actions performed by others in many different visual and social settings. What features do we extract and attend when we view such complex scenes, and how are they processed in the brain? To answer these questions, we curated two large-scale sets of naturalistic videos of everyday actions and estimated their perceived similarity in two behavioral experiments. We normed and quantified a large range of visual, action-related, and social-affective features across the stimulus sets. Using a cross-validated variance partitioning analysis, we found that social-affective features predicted similarity judgments better than, and independently of, visual and action features in both behavioral experiments. Next, we conducted an electroencephalography experiment, which revealed a sustained correlation between neural responses to videos and their behavioral similarity. Visual, action, and social-affective features predicted neural patterns at early, intermediate, and late stages, respectively, during this behaviorally relevant time window. Together, these findings show that social-affective features are important for perceiving naturalistic actions and are extracted at the final stage of a temporal gradient in the brain.

Behavioral and neural representations en route to intuitive action understanding

When we observe another person's actions, we process many kinds of information - from how their body moves to the intention behind their movements. What kinds of information underlie our intuitive understanding about how similar actions are to each other? To address this question, we measured the intuitive similarities among a large set of everyday action videos using multi-arrangement experiments, then used a modeling approach to predict this intuitive similarity space along three hypothesized properties. We found that similarity in the actors' inferred goals predicted the intuitive similarity judgments the best, followed by similarity in the actors' movements, with little contribution from the videos' visual appearance. In opportunistic fMRI analyses assessing brain-behavior correlations, we found suggestive evidence for an action processing hierarchy, in which these three kinds of action similarities are reflected in the structure of brain responses along a posterior-to-anterior gradient on the lateral surface of the visual cortex. Altogether, this work joins existing literature suggesting that humans are naturally tuned to process others' intentions, and that the visuo-motor cortex computes the perceptual precursors of the higher-level representations over which intuitive action perception operates.

Is rushing always faster than strolling? A reaction time study on the processing of sentences containing manner of motion verbs

In the context of the embodied cognition debate, an effect of motion verb associated speed information has previously been detected using eye-tracking, functional magnetic resonance imaging (fMRI), and reaction times (RT). The latter, for instance, was implemented by Wender and Weber (1982), who observed that participants were faster in detecting motion in sentences associated with fast motion compared to sentences associated with slow motion after having formed mental images of the sentences' content. It remains open whether the reported effects of speed are associated with automatic lexical-semantic retrieval processes or whether they reflect higher top-down cognitive processes. To answer this question, the paradigm by Wender and Weber (1982) was adopted and further elaborated in the present study. In Experiment 1 visualization instructions were eliminated. Additionally, the stimulus material was manipulated in regards to the agent of the described movement (human vs. object motion) in order to determine the representation's modality (visual vs. motoric). In Experiment 2, the task to detect motion was replaced by the task to judge sensicality. The results suggest that the prompt to perform mental imagery is not a precondition for the engagement of modal representations in this speed of motion paradigm and that the involved representations' modality is visual rather than motoric. However, the modal representations' involvement is dependent on the task. They thus do not seem to be part of the invariant semantic representation of manner of motion verbs.

Structural and functional motor-network disruptions predict selective action-concept deficits: Evidence from frontal lobe epilepsy

Built on neurodegenerative lesions models, the disrupted motor grounding hypothesis (DMGH) posits that motor-system alterations selectively impair action comprehension. However, major doubts remain concerning the dissociability, neural signatures, and etiological generalizability of such deficits. Few studies have compared action-concept outcomes between disorders affecting and sparing motor circuitry, and none has examined their multimodal network predictors via data-driven approaches. Here, we first assessed action- and object-concept processing in patients with frontal lobe epilepsy (FLE), patients with posterior cortex epilepsy (PCE), and healthy controls. Then, we examined structural and functional network signatures via diffusion tensor imaging and resting-state connectivity measures. Finally, we used these measures to predict behavioral performance with an XGBoost machine learning regression algorithm. Relative to controls, FLE (but not PCE) patients exhibited selective action-concept deficits together with structural and functional abnormalities along motor networks. The XGBoost model reached a significantly large effect size only for action-concept outcomes in FLE, mainly predicted by structural (cortico-spinal tract, anterior thalamic radiation, uncinate fasciculus) and functional (M1-parietal/supramarginal connectivity) motor networks. These results extend the DMGH, suggesting that action-concept deficits are dissociable markers of frontal/motor (relative to posterior) disruptions, directly related to the structural and functional integrity of motor networks, and traceable beyond canonical movement disorders.

Inflection across Categories: Tracking Abstract Morphological Processing in Language Production with MEG

Coherent language production requires that speakers adapt words to their grammatical contexts. A fundamental challenge in establishing a functional delineation of this process in the brain is that each linguistic process tends to correlate with numerous others. Our work investigated the neural basis of morphological inflection by measuring magnetoencephalography during the planning of inflected and uninflected utterances that varied across several linguistic dimensions. Results reveal increased activity in the left lateral frontotemporal cortex when inflection is planned, irrespective of phonological specification, syntactic context, or semantic type. Additional findings from univariate and connectivity analyses suggest that the brain distinguishes between different types of inflection. Specifically, planning noun and verb utterances requiring the addition of the suffix -s elicited increased activity in the ventral prefrontal cortex. A broadly distributed effect of syntactic context (verb vs. noun) was also identified. Results from representational similarity analysis indicate that this effect cannot be explained in terms of word meaning. Together, these results 1) offer evidence for a neural representation of abstract inflection that separates from other stimulus properties and 2) challenge theories that emphasize semantic content as a source of verb/noun processing differences.

Knowing how to do it or doing it? A double dissociation between tool-gesture production and tool-gesture knowledge

Deciding how to manipulate an object to fulfill a goal requires accessing different types of object-related information. How these different types of information are integrated and represented in the brain is still an open question. Here, we focus on examining two types of object-related information-tool-gesture knowledge (i.e., how to manipulate an object), and tool-gesture production (i.e., the actual manipulation of an object). We show a double dissociation between tool-gesture knowledge and tool-gesture production: Patient FP presents problems in pantomiming tool use in the context of a spared ability to perform judgments about an object's manipulation, whereas Patient LS can pantomime tool use, but is impaired at performing manipulation judgments. Moreover, we compared the location of the lesions in FP and LS with those sustained by two classic ideomotor apraxic patients (IMA), using a cortical thickness approach. Patient FP presented lesions in common with our classic IMA that included the left inferior parietal lobule (IPL), and specifically the supramarginal gyrus, the left parietal operculum, the left premotor cortex and the left inferior frontal gyrus, whereas Patient LS and our classic IMA patients presented common lesions in regions of the superior parietal lobule (SPL), motor areas (as primary somatosensory cortex, premotor cortex and primary motor cortex), and frontal areas. Our results show that tool-gesture production and tool-gesture knowledge can be behaviorally and neurally doubly dissociated and put strong constraints on extant theories of action and object recognition and use.

ColorWatch: Color Perceptual Spatial Tactile Interface for People with Visual Impairments

Tactile perception enables people with visual impairments (PVI) to engage with artworks and real-life objects at a deeper abstraction level. The development of tactile and multi-sensory assistive technologies has expanded their opportunities to appreciate visual arts. We have developed a tactile interface based on the proposed concept design under considerations of PVI tactile actuation, color perception, and learnability. The proposed interface automatically translates reference colors into spatial tactile patterns. A range of achromatic colors and six prominent basic colors with three levels of chroma and values are considered for the cross-modular association. In addition, an analog tactile color watch design has been proposed. This scheme enables PVI to explore artwork or real-life object color by identifying the reference colors through a color sensor and translating them to the tactile interface. The color identification tests using this scheme on the developed prototype exhibit good recognition accuracy. The workload assessment and usability evaluation for PVI demonstrate promising results. This suggest that the proposed scheme is appropriate for tactile color exploration.

Time to Face Language: Embodied Mechanisms Underpin the Inception of Face-Related Meanings in the Human Brain

In construing meaning, the brain recruits multimodal (conceptual) systems and embodied (modality-specific) mechanisms. Yet, no consensus exists on how crucial the latter are for the inception of semantic distinctions. To address this issue, we combined electroencephalographic (EEG) and intracranial EEG (iEEG) to examine when nouns denoting facial body parts (FBPs) and nonFBPs are discriminated in face-processing and multimodal networks. First, FBP words increased N170 amplitude (a hallmark of early facial processing). Second, they triggered fast (~100 ms) activity boosts within the face-processing network, alongside later (~275 ms) effects in multimodal circuits. Third, iEEG recordings from face-processing hubs allowed decoding ~80% of items before 200 ms, while classification based on multimodal-network activity only surpassed ~70% after 250 ms. Finally, EEG and iEEG connectivity between both networks proved greater in early (0-200 ms) than later (200-400 ms) windows. Collectively, our findings indicate that, at least for some lexico-semantic categories, meaning is construed through fast reenactments of modality-specific experience.

Sociality and interaction envelope organize visual action representations

Humans observe a wide range of actions in their surroundings. How is the visual cortex organized to process this diverse input? Using functional neuroimaging, we measured brain responses while participants viewed short videos of everyday actions, then probed the structure in these responses using voxel-wise encoding modeling. Responses are well fit by feature spaces that capture the body parts involved in an action and the action’s targets (i.e. whether the action was directed at an object, another person, the actor, and space). Clustering analyses reveal five large-scale networks that summarize the voxel tuning: one related to social aspects of an action, and four related to the scale of the interaction envelope, ranging from fine-scale manipulations directed at objects, to large-scale whole-body movements directed at distant locations. We propose that these networks reveal the major representational joints in how actions are processed by visual regions of the brain.

How is action perception organized in the brain? Here, the authors report evidence for five networks tuned to actions’ social content and the scale of their effect on the world and propose that sociality and interaction envelope are organizing dimensions of visual action representation.

A Double Dissociation in Sensitivity to Verb and Noun Semantics Across Cortical Networks

What is the neural organization of the mental lexicon? Previous research suggests that partially distinct cortical networks are active during verb and noun processing, but what information do these networks represent? We used multivoxel pattern analysis (MVPA) to investigate whether these networks are sensitive to lexicosemantic distinctions among verbs and among nouns and, if so, whether they are more sensitive to distinctions among words in their preferred grammatical class. Participants heard 4 types of verbs (light emission, sound emission, hand-related actions, mouth-related actions) and 4 types of nouns (birds, mammals, manmade places, natural places). As previously shown, the left posterior middle temporal gyrus (LMTG+), and inferior frontal gyrus (LIFG) responded more to verbs, whereas the inferior parietal lobule (LIP), precuneus (LPC), and inferior temporal (LIT) cortex responded more to nouns. MVPA revealed a double-dissociation in lexicosemantic sensitivity: classification was more accurate among verbs than nouns in the LMTG+, and among nouns than verbs in the LIP, LPC, and LIT. However, classification was similar for verbs and nouns in the LIFG, and above chance for the nonpreferred category in all regions. These results suggest that the lexicosemantic information about verbs and nouns is represented in partially nonoverlapping networks.

Language and perception: Introduction to the Special Issue “Speakers and Listeners in the Visual World”

Language and perception are two central cognitive systems. Until relatively recently, however, the interaction between them has been examined only partially and not from an over-arching theoretical perspective. Yet it has become clear that linguistic and perceptual interactions are essential to understanding both typical and atypical human behaviour. In this editorial, we examine the link between language and perception across three domains. First, we present a brief review of work investigating the importance of perceptual features, particularly shape bias, when learning names for novel objects—a critical skill acquired during language development. Second, we describe the Visual World Paradigm, an experimental method uniquely suited to investigate the language-perception relationship. Studies using the Visual World Paradigm demonstrate that the relationship between linguistic and perceptual information during processing is both intricate and bi-directional: linguistic cues guide interpretation of visual scenes, while perceptual information shapes interpretation of linguistic input. Finally, we turn to a discussion of co-speech gesture focusing on iconic gestures which depict aspects of the visual world (e.g., motion, shape). The relationship between language and these semantically-meaningful gestures is likewise complex and bi-directional. However, more research is needed to illuminate the exact circumstances under which iconic gestures shape language production and comprehension. In conclusion, although strong evidence exists supporting a critical relationship between linguistic and perceptual systems, the exact levels at which these two systems interact, the time-course of the interaction, and what is driving the interaction, remain largely open questions in need of future research.

Dissociable electrophysiological correlates of semantic access of motor and non-motor concepts

The notion of semantic embodiment posits that concepts are represented in the same neural sensorimotor systems that were involved in their acquisition. However, evidence in support of embodied semantics – in particular the hypothesised contribution of motor and premotor cortex to the representation of action concepts – is varied. Here, we tested the hypothesis that, consistent with semantic embodiment, sensorimotor cortices will rapidly become active while healthy participants access the meaning of visually-presented motor and non-motor action verbs. Event-related potentials revealed early differential processing of motor and non-motor verbs (164–203 ms) within distinct regions of cortex likely reflecting rapid cortical activation of differentially distributed semantic representations. However, we found no evidence for a specific role of sensorimotor cortices in supporting these representations. Moreover, we observed a later modulation of the alpha band (8–12 Hz) from 555–785 ms over central electrodes, with estimated generators within the left superior parietal lobule, which may reflect post-lexical activation of the object-directed features of the motor action concepts. In conclusion, we find no evidence for a specific role of sensorimotor cortices when healthy participants judge the meaning of visually-presented action verbs. However, the relative contribution of sensorimotor cortices to action comprehension may vary as a function of task goals.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

Neural representation of visual concepts in people born blind

How do we represent information without sensory features? How are abstract concepts like “freedom”, devoid of external perceptible referents, represented in the brain? Here, to address the role of sensory information in the neural representation of concepts, we used fMRI to investigate how people born blind process concepts whose referents are imperceptible to them because of their visual nature (“rainbow”, “red”). Activity for these concepts was compared to that of sensorially-perceptible referents (“rain”), classical abstract concepts (“justice”) and concrete concepts (“cup”), providing a gradient between fully concrete and fully abstract concepts in the blind. We find that anterior temporal lobe (ATL) responses track concept perceptibility and objecthood: preference for imperceptible object concepts was found in dorsal ATL, for abstract (non-object, non-referential) concepts in lateral ATL, and for perceptible concepts in medial ATL. These findings point to a new division-of-labor among aspects of ATL in representing conceptual properties that are abstract in different ways.

How are abstract, imperceptible concepts such as ‘freedom’ represented in the brain? Here, the authors use fMRI in people born blind to compare the neural responses for abstract concepts, concrete concepts like ‘rainbow’ which in blind people lack sensory qualities, and concrete concepts sensorily accessible to the blind.

Negation markers inhibit motor routines during typing of manual action verbs

We explored whether negation markers recruit inhibitory mechanisms during keyboard-based action-verb typing. In each trial, participants read two sentences: the first featured a context (There is a contract) and the second ended with a relevant verb which had to be immediately typed. Crucially, the verb could describe manual actions, non-manual actions or non-motor processes, with either affirmative (You do sign it) or negative (You don't sign it) polarity. We assessed the impact of verb type and polarity on two typing dimensions: motor programming (lapse between target onset and first keystroke) and motor execution (lapse between first and last keystroke). Negation yielded no effect on motor planning, but it selectively delayed typing execution for manual-action verbs, irrespective of the subjects' typing skills. This suggests that processing negations during comprehension of manual-action sentences recruits inhibitory mechanisms acting on same-effector movements. Our novel finding extends embodied models of language and effector-specific motor-language integration.

High-level language processing regions are not engaged in action observation or imitation

A set of left frontal, temporal, and parietal brain regions respond robustly during language comprehension and production (e.g., Fedorenko E, Hsieh PJ, Nieto-Castañón A, Whitfield-Gabrieli S, Kanwisher N. J Neurophysiol 104: 1177-1194, 2010; Menenti L, Gierhan SM, Segaert K, Hagoort P. Psychol Sci 22: 1173-1182, 2011). These regions have been further shown to be selective for language relative to other cognitive processes, including arithmetic, aspects of executive function, and music perception (e.g., Fedorenko E, Behr MK, Kanwisher N. Proc Natl Acad Sci USA 108: 16428-16433, 2011; Monti MM, Osherson DN. Brain Res 1428: 33-42, 2012). However, one claim about overlap between language and nonlinguistic cognition remains prominent. In particular, some have argued that language processing shares computational demands with action observation and/or execution (e.g., Rizzolatti G, Arbib MA. Trends Neurosci 21: 188-194, 1998; Koechlin E, Jubault T. Neuron 50: 963-974, 2006; Tettamanti M, Weniger D. Cortex 42: 491-494, 2006). However, the evidence for these claims is indirect, based on observing activation for language and action tasks within the same broad anatomical areas (e.g., on the lateral surface of the left frontal lobe). To test whether language indeed shares machinery with action observation/execution, we examined the responses of language brain regions, defined functionally in each individual participant (Fedorenko E, Hsieh PJ, Nieto-Castañón A, Whitfield-Gabrieli S, Kanwisher N. J Neurophysiol 104: 1177-1194, 2010) to action observation ( experiments 1, 2, and 3a) and action imitation ( experiment 3b). With the exception of the language region in the angular gyrus, all language regions, including those in the inferior frontal gyrus (within "Broca's area"), showed little or no response during action observation/imitation. These results add to the growing body of literature suggesting that high-level language regions are highly selective for language processing (see Fedorenko E, Varley R. Ann NY Acad Sci 1369: 132-153, 2016 for a review). NEW & NOTEWORTHY Many have argued for overlap in the machinery used to interpret language and others' actions, either because action observation was a precursor to linguistic communication or because both require interpreting hierarchically-structured stimuli. However, existing evidence is indirect, relying on group analyses or reverse inference. We examined responses to action observation in language regions defined functionally in individual participants and found no response. Thus language comprehension and action observation recruit distinct circuits in the modern brain.

Neural representation of word categories is distinct in the temporal lobe: An activation likelihood analysis

The distinction between nouns and verbs is a language universal. Yet, functional neuroimaging studies comparing noun and verb processing have yielded inconsistent findings, ranging from a complete frontal(verb)-temporal(noun) dichotomy to a complete overlap in activation patterns. The current study addressed the debate about neural distinctions between nouns and verbs by conducting an activation likelihood estimation (ALE) meta-analysis of probabilistic cytoarchitectonic maps. Two levels of analysis were conducted: simple effects (Verbs vs. Baseline, Nouns vs. Baseline), and direct comparisons (Verbs vs. Nouns, Nouns vs. Verbs). Nouns were uniquely associated with a left medial temporal cluster (BA37). Activation foci for verbs included extensive inferior frontal (BA44-47) and mid-temporal (BA22, 21) regions in the left hemisphere. These findings confirm that the two grammatical classes have distinct neural architecture in supra-modal brain regions. Further, nouns and verbs overlapped in a small left lateral inferior temporal activation cluster (BA37), which is a region for modality-independent, grammatical class-independent lexical representations. These findings are most consistent with the view that as one acquires language, linguistic representations for a lexical category shift from the modality specific cortices which represent prototypical members of that category (e.g., motion for verbs) to abstract amodal representations in close proximity to modality specific cortices.

Task- and domain-specific modulation of functional connectivity in the ventral and dorsal object-processing pathways

A whole-brain network of regions collectively supports the ability to recognize and use objects-the Tool Processing Network. Little is known about how functional interactions within the Tool Processing Network are modulated in a task-dependent manner. We designed an fMRI experiment in which participants were required to either generate object pantomimes or to carry out a picture matching task over the same images of tools, while holding all aspects of stimulus presentation constant across the tasks. The Tool Processing Network was defined with an independent functional localizer, and functional connectivity within the network was measured during the pantomime and picture matching tasks. Relative to tool picture matching, tool pantomiming led to an increase in functional connectivity between ventral stream regions and left parietal and frontal-motor areas; in contrast, the matching task was associated with an increase in functional connectivity among regions in ventral temporo-occipital cortex, and between ventral temporal regions and the left inferior parietal lobule. Graph-theory analyses over the functional connectivity data indicated that the left premotor cortex and left lateral occipital complex were hub-like (exhibited high betweenness centrality) during tool pantomiming, while ventral stream regions (left medial fusiform gyrus and left posterior middle temporal gyrus) were hub-like during the picture matching task. These results demonstrate task-specific modulation of functional interactions among a common set of regions, and indicate dynamic coupling of anatomically remote regions in task-dependent manner.

Object-action dissociation: A voxel-based lesion-symptom mapping study on 102 patients after glioma removal

Data concerning the neural basis of noun and verb processing are inconsistent. Some authors assume that action-verb processing is based on frontal areas while nouns processing relies on temporal regions; others argue that the circuits processing verbs and nouns are closely interconnected in a predominantly left-lateralized fronto-temporal-parietal network; yet, other researchers consider that the primary motor cortex plays a crucial role in processing action verbs. In the present study, one hundred and two patients with a tumour either in the right or left hemisphere were submitted to picture naming of objects and actions before and after surgery. To test the effect of specific brain regions in object and action naming, patients' lesions were mapped and voxel-lesion-symptom mapping (VLSM) was computed. Behavioural results showed that left-brain damaged patients were significantly more impaired than right brain-damaged patients. The VLSM showed that these two grammatical classes are segregated in the left hemisphere. In particular, scores in naming of objects correlated with damage to the anterior temporal region, while scores in naming of actions correlated with lesions in the parietal areas and in the posterior temporal cortex. In addition, VLSM analyses carried out on non-linguistic tasks were not significant, confirming that the regions associated with deficits in object and action naming were not generally engaged in all cognitive tasks. Finally, the involvement of subcortical pathways was investigated and the inferior longitudinal fasciculus proved to play a role in object naming, while no specific bundle was identified for actions.

For a cognitive neuroscience of concepts: Moving beyond the grounding issue

Cognitive neuroscience research on conceptual knowledge often is discussed with respect to "embodiment" or "grounding." We tried to disentangle at least three distinct claims made using these terms. One of these, the view that concepts are entirely reducible to sensory-motor representations, is untenable and diminishing in the literature. A second is the view that concepts and sensory-motor representations "interact," and a third view addresses the question of how concepts are neurally organized-the neural partitions among concepts of different kinds, and where these partitions are localized in cortex. We argue that towards the second and third issues, much fruitful research can be pursued, but that no position on them is specifically related to "grounding." Furthermore, to move forward on them, it is important to precisely distinguish different kinds of representations-conceptual vs. sensory-motor-from each other theoretically and empirically. Neuroimaging evidence often lacks such specificity. We take an approach that distinguishes conceptual from sensory-motor representations by virtue of two properties: broad generality and tolerance to the absence of sensory-motor associations. We review three of our recent experiments that employ these criteria in order to localize neural representations of several specific kinds of nonsensory attributes: functions, intentions, and belief traits. Building on past work, we find that neuroimaging evidence can be used fruitfully to distinguish interesting hypotheses about neural organization. On the other hand, most such evidence does not speak to any clear notion of "grounding" or "embodiment," because these terms do not make clear, specific, empirical predictions. We argue that cognitive neuroscience will proceed most fruitfully by relinquishing these terms.

Neural reuse of action perception circuits for language, concepts and communication

Neurocognitive and neurolinguistics theories make explicit statements relating specialized cognitive and linguistic processes to specific brain loci. These linking hypotheses are in need of neurobiological justification and explanation. Recent mathematical models of human language mechanisms constrained by fundamental neuroscience principles and established knowledge about comparative neuroanatomy offer explanations for where, when and how language is processed in the human brain. In these models, network structure and connectivity along with action- and perception-induced correlation of neuronal activity co-determine neurocognitive mechanisms. Language learning leads to the formation of action perception circuits (APCs) with specific distributions across cortical areas. Cognitive and linguistic processes such as speech production, comprehension, verbal working memory and prediction are modelled by activity dynamics in these APCs, and combinatorial and communicative-interactive knowledge is organized in the dynamics within, and connections between APCs. The network models and, in particular, the concept of distributionally-specific circuits, can account for some previously not well understood facts about the cortical 'hubs' for semantic processing and the motor system's role in language understanding and speech sound recognition. A review of experimental data evaluates predictions of the APC model and alternative theories, also providing detailed discussion of some seemingly contradictory findings. Throughout, recent disputes about the role of mirror neurons and grounded cognition in language and communication are assessed critically.

Pupillary Responses to Words That Convey a Sense of Brightness or Darkness

Theories about embodiment of language hold that when you process a word’s meaning, you automatically simulate associated sensory input (e.g., perception of brightness when you process lamp) and prepare associated actions (e.g., finger movements when you process typing). To test this latter prediction, we measured pupillary responses to single words that conveyed a sense of brightness (e.g., day) or darkness (e.g., night) or were neutral (e.g., house). We found that pupils were largest for words conveying darkness, of intermediate size for neutral words, and smallest for words conveying brightness. This pattern was found for both visually presented and spoken words, which suggests that it was due to the words’ meanings, rather than to visual or auditory properties of the stimuli. Our findings suggest that word meaning is sufficient to trigger a pupillary response, even when this response is not imposed by the experimental task, and even when this response is beyond voluntary control.

Mapping nouns and finite verbs in left hemisphere tumors: a direct electrical stimulation study

Neurosurgical mapping studies with nouns and finite verbs are scarce and subcortical data are nonexistent. We used a new task that uses finite verbs in six Italian-speaking patients with gliomas in the left language-dominant hemisphere. Language-relevant positive areas were detected only with nouns in four patients, with both tasks yet in distinct cortical areas in one patient, and only with finite verbs in another patient. Positive areas and types of errors varied across participants. Finite verbs provide complementary information to nouns, and permit more accurate mapping of language production when nouns are unaffected by electrical stimulation.

Feature-Specific Event-Related Potential Effects to Action- and Sound-Related Verbs during Visual Word Recognition

Grounded cognition theories suggest that conceptual representations essentially depend on modality-specific sensory and motor systems. Feature-specific brain activation across different feature types such as action or audition has been intensively investigated in nouns, while feature-specific conceptual category differences in verbs mainly focused on body part specific effects. The present work aimed at assessing whether feature-specific event-related potential (ERP) differences between action and sound concepts, as previously observed in nouns, can also be found within the word class of verbs. In Experiment 1, participants were visually presented with carefully matched sound and action verbs within a lexical decision task, which provides implicit access to word meaning and minimizes strategic access to semantic word features. Experiment 2 tested whether pre-activating the verb concept in a context phase, in which the verb is presented with a related context noun, modulates subsequent feature-specific action vs. sound verb processing within the lexical decision task. In Experiment 1, ERP analyses revealed a differential ERP polarity pattern for action and sound verbs at parietal and central electrodes similar to previous results in nouns. Pre-activation of the meaning of verbs in the preceding context phase in Experiment 2 resulted in a polarity-reversal of feature-specific ERP effects in the lexical decision task compared with Experiment 1. This parallels analogous earlier findings for primed action and sound related nouns. In line with grounded cognitions theories, our ERP study provides evidence for a differential processing of action and sound verbs similar to earlier observation for concrete nouns. Although the localizational value of ERPs must be viewed with caution, our results indicate that the meaning of verbs is linked to different neural circuits depending on conceptual feature relevance.

The dissociability of lexical retrieval and morphosyntactic processes for nouns and verbs: A functional and anatomoclinical study

Nouns and verbs can dissociate following brain damage, at both lexical retrieval and morphosyntactic processing levels. In order to document the range and the neural underpinnings of behavioral dissociations, twelve aphasics with disproportionate difficulty naming objects or actions were asked to apply phonologically identical morphosyntactic transformations to nouns and verbs. Two subjects with poor object naming and 2/10 with poor action naming made no morphosyntactic errors at all. Six of 10 subjects with poor action naming showed disproportionate or no morphosyntactic difficulties for verbs. Morphological errors on nouns and verbs correlated at the group level, but in individual cases a selective impairment of verb morphology was observed. Poor object and action naming with spared morphosyntax were associated with non-overlapping lesions (inferior occipitotemporal and fronto-temporal, respectively). Poor verb morphosyntax was observed with frontal-temporal lesions affecting white matter tracts deep to the insula, possibly disrupting the interaction of nodes in a fronto-temporal network.

Somatotopic Semantic Priming and Prediction in the Motor System

The recognition of action-related sounds and words activates motor regions, reflecting the semantic grounding of these symbols in action information; in addition, motor cortex exerts causal influences on sound perception and language comprehension. However, proponents of classic symbolic theories still dispute the role of modality-preferential systems such as the motor cortex in the semantic processing of meaningful stimuli. To clarify whether the motor system carries semantic processes, we investigated neurophysiological indexes of semantic relationships between action-related sounds and words. Event-related potentials revealed that action-related words produced significantly larger stimulus-evoked (Mismatch Negativity-like) and predictive brain responses (Readiness Potentials) when presented in body-part-incongruent sound contexts (e.g., “kiss” in footstep sound context; “kick” in whistle context) than in body-part-congruent contexts, a pattern reminiscent of neurophysiological correlates of semantic priming. Cortical generators of the semantic relatedness effect were localized in areas traditionally associated with semantic memory, including left inferior frontal cortex and temporal pole, and, crucially, in motor areas, where body-part congruency of action sound–word relationships was indexed by a somatotopic pattern of activation. As our results show neurophysiological manifestations of action-semantic priming in the motor cortex, they prove semantic processing in the motor system and thus in a modality-preferential system of the human brain.

Fronto-temporal regions encode the manner of motion in spatial language

When describing spatial events, dynamic actions can be decomposed into the path of motion (where the object moves), and the manner of motion (how the object moves). These components may be instantiated in two processing streams in the human brain, wherein dorsal parietal areas process path-related information, while ventral temporal regions process manner information. Previous research showed this pattern during the observation of videos showing animate characters in motion [15]. It is unknown whether reading language describing path and manner information - a level of abstraction beyond the perception of visual motion - relies on similar mechanisms. Here, we use functional neuroimaging to show that the left pMTG processes the manner of motion during reading. We also demonstrate the involvement of other ventral fronto-temporal regions in the understanding of manner of motion in spatial language.

Is the Motor System Necessary for Processing Action and Abstract Emotion Words? Evidence from Focal Brain Lesions

Neuroimaging and neuropsychological experiments suggest that modality-preferential cortices, including motor- and somatosensory areas, contribute to the semantic processing of action related concrete words. Still, a possible role of sensorimotor areas in processing abstract meaning remains under debate. Recent fMRI studies indicate an involvement of the left sensorimotor cortex in the processing of abstract-emotional words (e.g., "love") which resembles activation patterns seen for action words. But are the activated areas indeed necessary for processing action-related and abstract words? The current study now investigates word processing in two patients suffering from focal brain lesion in the left frontocentral motor system. A speeded Lexical Decision Task on meticulously matched word groups showed that the recognition of nouns from different semantic categories - related to food, animals, tools, and abstract-emotional concepts - was differentially affected. Whereas patient HS with a lesion in dorsolateral central sensorimotor systems next to the hand area showed a category-specific deficit in recognizing tool words, patient CA suffering from lesion centered in the left supplementary motor area was primarily impaired in abstract-emotional word processing. These results point to a causal role of the motor cortex in the semantic processing of both action-related object concepts and abstract-emotional concepts and therefore suggest that the motor areas previously found active in action-related and abstract word processing can serve a meaning-specific necessary role in word recognition. The category-specific nature of the observed dissociations is difficult to reconcile with the idea that sensorimotor systems are somehow peripheral or 'epiphenomenal' to meaning and concept processing. Rather, our results are consistent with the claim that cognition is grounded in action and perception and based on distributed action perception circuits reaching into modality-preferential cortex.

Contributions to a neurophysiology of meaning: the interpretation of written messages could be an automatic stimulus-reaction mechanism before becoming conscious processing of information

Background. Even though the interpretation of natural language messages is generally conceived as the result of a conscious processing of the message content, the influence of unconscious factors is also well known. What is still insufficiently known is the way such factors work. We have tackled interpretation assuming it is a process, whose basic features are the same for the whole humankind, and employing a naturalistic approach (careful observation of phenomena in conditions the closest to "natural" ones, and precise description before and independently of data statistical analysis). Methodology. Our field research involved a random sample of 102 adults. We presented them with a complete real world-like case of written communication using unabridged message texts. We collected data (participants' written reports on their interpretations) in controlled conditions through a specially designed questionnaire (closed and opened answers); then, we treated it through qualitative and quantitative methods. Principal Findings. We gathered some evidence that, in written message interpretation, between reading and the attribution of conscious meaning, an intermediate step could exist (we named it "disassembling") which looks like an automatic reaction to the text words/expressions. Thus, the process of interpretation would be a discontinuous sequence of three steps having different natures: the initial "decoding" step (i.e., reading, which requires technical abilities), disassembling (the automatic reaction, an unconscious passage) and the final conscious attribution of meaning. If this is true, words and expressions would firstly function like physical stimuli, before being taken into account as symbols. Such hypothesis, once confirmed, could help explaining some links between the cultural (human communication) and the biological (stimulus-reaction mechanisms as the basis for meanings) dimension of humankind.

Neuronal bases of structural coherence in contemporary dance observation

The neuronal processes underlying dance observation have been the focus of an increasing number of brain imaging studies over the past decade. However, the existing literature mainly dealt with effects of motor and visual expertise, whereas the neural and cognitive mechanisms that underlie the interpretation of dance choreographies remained unexplored. Hence, much attention has been given to the action observation network (AON) whereas the role of other potentially relevant neuro-cognitive mechanisms such as mentalizing (theory of mind) or language (narrative comprehension) in dance understanding is yet to be elucidated. We report the results of an fMRI study where the structural coherence of short contemporary dance choreographies was manipulated parametrically using the same taped movement material. Our participants were all trained dancers. The whole-brain analysis argues that the interpretation of structurally coherent dance phrases involves a subpart (superior parietal) of the AON as well as mentalizing regions in the dorsomedial prefrontal cortex. An ROI analysis based on a similar study using linguistic materials (Pallier et al., 2011) suggests that structural processing in language and dance might share certain neural mechanisms.

Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text

Embodiment theory predicts that mental imagery of object words recruits neural circuits involved in object perception. The degree of visual imagery present in routine thought and how it is encoded in the brain is largely unknown. We test whether fMRI activity patterns elicited by participants reading objects' names include embodied visual-object representations, and whether we can decode the representations using novel computational image-based semantic models. We first apply the image models in conjunction with text-based semantic models to test predictions of visual-specificity of semantic representations in different brain regions. Representational similarity analysis confirms that fMRI structure within ventral-temporal and lateral-occipital regions correlates most strongly with the image models and conversely text models correlate better with posterior-parietal/lateral-temporal/inferior-frontal regions. We use an unsupervised decoding algorithm that exploits commonalities in representational similarity structure found within both image model and brain data sets to classify embodied visual representations with high accuracy (8/10) and then extend it to exploit model combinations to robustly decode different brain regions in parallel. By capturing latent visual-semantic structure our models provide a route into analyzing neural representations derived from past perceptual experience rather than stimulus-driven brain activity. Our results also verify the benefit of combining multimodal data to model human-like semantic representations.

The origin of word-related motor activity

Conceptual processing of verbs consistently recruits the left posterior middle temporal gyrus (lpMTG). The left precentral motor cortex also responds to verbs, with higher activity for action than nonaction verbs. The early timing of this effect has suggested that motor features of words' meaning are accessed directly, bypassing access to conceptual representations in lpMTG. An alternative hypothesis is that the retrieval of conceptual representations in lpMTG is necessary to drive more specific, motor-related representations in the precentral gyrus. To test these hypotheses, we first showed that repetitive transcranial magnetic stimulation (rTMS) applied to the verb-preferring lpMTG site selectively impoverished the semantic processing of verbs. In a second experiment, rTMS perturbation of lpMTG, relative to no stimulation (no-rTMS), eliminated the action-nonaction verb distinction in motor activity, as indexed by motor-evoked potentials induced in peripheral muscles with single-pulse TMS over the left primary motor cortex. rTMS pertubation of an occipital control site, relative to no-rTMS, did not affect the action-nonaction verb distinction in motor activity, but the verb contrast did not differ reliably from the lpMTG effect. The results show that lpMTG carries core semantic information necessary to drive the activation of specific (motor) features in the precentral gyrus.

What is embodied about cognition?

It is currently debated whether the meanings of words and objects are represented, in whole or in part, in a modality-specific format-the embodied cognition hypothesis. I argue that the embodied/disembodied cognition debate is either largely resolved in favor of the view that concepts are represented in an amodal format, or at a point where the embodied and disembodied approaches are no longer coherently distinct theories. This merits reconsideration of what the available evidence can tell us about the structure of the conceptual system. We know that the conceptual system engages, online, with sensory and motor content. This frames a new question: How is it that the human conceptual system is able to disengage from the sensorimotor system? Answering this question would say something about how the human mind is able to detach from the present and extrapolate from finite experience to hypothetical states of how the world could be. It is the independence of thought from perception and action that makes human cognition special-and that independence is guaranteed by the representational distinction between concepts and sensorimotor representations.

Influence of biological kinematics on abstract concept processing

During a random number generation task, human beings tend to produce more small numbers than large numbers. However, this small number bias is modulated when motor behaviour, such as a turn of the head, is performed during the random number generation task. This result fits with the finding that number representation is linked to laterally oriented actions, with small- and large-magnitude numbers generally linked to movement towards the left or the right side of space, respectively. To test whether this number-space association is specific to human motor behaviours or extends to any type of laterally oriented movements, we assessed whether the presentation of biological or nonbiological leftward or rightward movement affected a subsequent random number generation task. Biological and nonbiological movements were obtained by varying the kinematic parameters of the movements. Biological kinematics represented the tangential velocity actually observed in a human pointing movement; nonbiological kinematics represented equivalent movements but with an inverse tangential velocity along the path. The results show that only the observation of biological movements induces a space-number bias whereas observing nonbiological movements does not. This finding is the first evidence of a link between a biological marker and the semantic representation of a concept as abstract as number.