Neural evidence for the interplay between language, gesture, and action: a review

Manual praxis in stone tool manufacture: implications for language evolution

Alternative functions of the left-hemisphere dominant Broca's region have induced hypotheses regarding the evolutionary parallels between manual praxis and language in humans. Many recent studies on Broca's area reveal several assumptions about the cognitive mechanisms that underlie both functions, including: (1) an accurate, finely controlled body schema, (2) increasing syntactical abilities, particularly for goal-oriented actions, and (3) bilaterality and fronto-parietal connectivity. Although these characteristics are supported by experimental paradigms, many researchers have failed to acknowledge a major line of evidence for the evolutionary development of these traits: stone tools. The neuroscience of stone tool manufacture is a viable proxy for understanding evolutionary aspects of manual praxis and language, and may provide key information for evaluating competing hypotheses on the co-evolution of these cognitive domains in our species.

Contribution of motor representations to action verb processing

Electrophysiological and brain imaging studies show a somatotopic activation of the premotor cortex while subjects process action verbs. This somatotopic motor activation has been taken as an indication that the meaning of action verbs is embedded in motor representations. However, discrepancies in the literature led to the alternative hypothesis that motor representations are activated during the course of a mental imagery process emerging only after the meaning of the action has been accessed. In order to address this issue, we asked participants to decide whether a visually presented verb was concrete or abstract by pressing a button or a pedal (primary task) and then to provide a distinct vocal response to low and high sounds played soon after the verb display (secondary task). Manipulations of the visual display (lower vs. uppercase), verb imageability (concrete vs. abstract), verb meaning (hand vs. foot-related), and response effector (hand vs. foot) allowed us to trace the perceptual, semantic and response stages of verb processing. We capitalized on the psychological refractory period (PRP), which implies that the initiation of the secondary task should be delayed only by those factors that slow down the central decision process in the primary task. In line with this prediction, our results showed that the time cost resulting from the processing of abstract verbs, when compared to concrete verbs, was still observed in the subsequent response to the sounds, whereas the overall advantage of hand over foot responses did not influence sound judgments. Crucially, we also observed a verb-effector compatibility effect (i.e., foot-related verbs are responded faster with the foot and hand-related verbs with the hand) that contaminated the performance of the secondary task, providing clear evidence that motor interference from verb meaning occurred during the central decision stage. These results cannot be explained by a mental imagery process that would deploy only during the execution of the response to verb judgments. They rather indicate that the motor activation induced by action verbs accompanies the lexico-semantic processes leading to response selection.

The missing link in the embodiment of syntax: prosody

Neurolinguistic theories are challenged by the amodal abstract representations assumed by linguists. Embodied linguistics offers a conceptualization of the relationship between linguistic representation, experience, and the brain. Findings correlating brain activation patterns with referential features of words (e.g., body parts), suggest that the mechanism underlying linguistic embodiment is an "action-perception simulation". This mechanism accounts for embodied representation of words, but is harder to adapt to syntactic abstractions. We suggest that prosody is the missing link. Prosody is a sensory-motor phenomenon that can evoke an "action-perception simulation" that underpins the syntax-experience-brain association. Our review discusses different embodiment models and then integrates psycholinguistic and neurocognitive studies into a new approach to linguistic embodiment. We propose a novel implementation of the syntax-experience-brain relationship via the mapping between the temporo-spectral aspects of speech prosody and temporo-spectral patterns of synchronized behavior of neural populations. We discuss the potential implications for psycho- and neuro-linguistic research.

Transcranial direct current stimulation of the primary motor cortex improves word-retrieval in older adults

Language facilitation by transcranial direct current stimulation (tDCS) in healthy individuals has generated hope that tDCS may also allow improving language impairment after stroke (aphasia). However, current stimulation protocols have yielded variable results and may require identification of residual language cortex using functional magnetic resonance imaging (fMRI), which complicates incorporation into clinical practice. Based on previous behavioral studies that demonstrated improved language processing by motor system pre-activation, the present study assessed whether tDCS administered to the primary motor cortex (M1) can enhance language functions. This proof-of-concept study employed a sham-tDCS controlled, cross-over, within-subject design and assessed the impact of unilateral excitatory (anodal) and bihemispheric (dual) tDCS in 18 healthy older adults during semantic word-retrieval and motor speech tasks. Simultaneous fMRI scrutinized the neural mechanisms underlying tDCS effects. Both active tDCS conditions significantly improved word-retrieval compared to sham-tDCS. The direct comparison of activity elicited by word-retrieval vs. motor-speech trials revealed bilateral frontal activity increases during both anodal- and dual-tDCS compared to sham-tDCS. This effect was driven by more pronounced deactivation of frontal regions during the motor-speech task, while activity during word-retrieval trials was unaffected by the stimulation. No effects were found in M1 and secondary motor regions. Our results show that tDCS administered to M1 can improve word-retrieval in healthy individuals, thereby providing a rationale to explore whether M1-tDCS may offer a novel approach to improve language functions in aphasia. Functional magnetic resonance imaging revealed neural facilitation specifically during motor speech trials, which may have reduced switching costs between the overlapping neural systems for lexical retrieval and speech processing, thereby resulting in improved performance.

The origin of human multi-modal communication

One reason for the apparent gulf between animal and human communication systems is that the focus has been on the presence or the absence of language as a complex expressive system built on speech. But language normally occurs embedded within an interactional exchange of multi-modal signals. If this larger perspective takes central focus, then it becomes apparent that human communication has a layered structure, where the layers may be plausibly assigned different phylogenetic and evolutionary origins--especially in the light of recent thoughts on the emergence of voluntary breathing and spoken language. This perspective helps us to appreciate the different roles that the different modalities play in human communication, as well as how they function as one integrated system despite their different roles and origins. It also offers possibilities for reconciling the 'gesture-first hypothesis' with that of gesture and speech having evolved together, hand in hand--or hand in mouth, rather--as one system.

Limb apraxia and verb processing in Alzheimer's disease

OBJECTIVE

The present research investigates language and praxis abilities in patients with Alzheimer's disease in order to study the relationship between these two cognitive domains.

METHOD

The experimental evaluation of patients and control group performance was designed to permit a direct comparison of linguistic abilities (i.e., verb and noun naming and sentence comprehension) and praxic abilities (i.e., gesture execution for complex movements). Moreover, for the first time, action comprehension was explored using the Action Sequence Comprehension.

RESULTS AND CONCLUSION

Analyses of variance (ANOVAs) and correlational analyses showed that a direct relationship may exist between language impairment and apraxia in patients with Alzheimer's disease. In addition, the production and comprehension of both language and action were equally impaired in patients, providing further evidence for a spectrum of concomitant linguistic and praxis deficits in Alzheimer's disease. Finally, the ability to correctly comprehend action semantics was related more directly to verb production ability than to noun production.

Exploring the role of hand gestures in learning novel phoneme contrasts and vocabulary in a second language

Co-speech hand gestures are a type of multimodal input that has received relatively little attention in the context of second language learning. The present study explored the role that observing and producing different types of gestures plays in learning novel speech sounds and word meanings in an L2. Naïve English-speakers were taught two components of Japanese—novel phonemic vowel length contrasts and vocabulary items comprised of those contrasts—in one of four different gesture conditions: Syllable Observe, Syllable Produce, Mora Observe, and Mora Produce. Half of the gestures conveyed intuitive information about syllable structure, and the other half, unintuitive information about Japanese mora structure. Within each Syllable and Mora condition, half of the participants only observed the gestures that accompanied speech during training, and the other half also produced the gestures that they observed along with the speech. The main finding was that participants across all four conditions had similar outcomes in two different types of auditory identification tasks and a vocabulary test. The results suggest that hand gestures may not be well suited for learning novel phonetic distinctions at the syllable level within a word, and thus, gesture-speech integration may break down at the lowest levels of language processing and learning.

Action and language integration: from humans to cognitive robots

The topic is characterized by a highly interdisciplinary approach to the issue of action and language integration. Such an approach, combining computational models and cognitive robotics experiments with neuroscience, psychology, philosophy, and linguistic approaches, can be a powerful means that can help researchers disentangle ambiguous issues, provide better and clearer definitions, and formulate clearer predictions on the links between action and language. In the introduction we briefly describe the papers and discuss the challenges they pose to future research. We identify four important phenomena the papers address and discuss in light of empirical and computational evidence: (a) the role played not only by sensorimotor and emotional information but also of natural language in conceptual representation; (b) the contextual dependency and high flexibility of the interaction between action, concepts, and language; (c) the involvement of the mirror neuron system in action and language processing; (d) the way in which the integration between action and language can be addressed by developmental robotics and Human-Robot Interaction.

Co-occurring development of early childhood communication and motor skills: results from a population-based longitudinal study

BACKGROUND

Communicative and motor development is frequently found to be associated. In the current study we investigate to what extent communication and motor skills at 1½ years predict skills in the same domains at 3 years of age.

METHODS

This study is based on the Norwegian Mother and Child Cohort Study (MoBa) conducted by the Norwegian Institute of Public Heath. Data stem from 62,944 children and their mothers. Mothers completed questionnaires on their child's communication and motor skills at ages 1½ and 3. Associations between communication and motor skills were estimated in a cross-lagged model with latent variables.

RESULTS

Early communication skills were correlated with early motor skills (0.72). Stability was high (0.81) across time points for motor skills and somewhat lower (0.40) for communication skills. Early motor skills predicted later communication skills (0.38) whereas early communication skills negatively predicted later motor skills (-0.14).

CONCLUSION

Our findings provide support for the hypothesis that these two difficulties are not symptoms of separate disorders, but might rather be different manifestations of a common underlying neurodevelopmental weakness. However, there also seem to be specific developmental pathways for each domain. Besides theoretical interest, more knowledge about the relationship between these early skills might shed light upon early intervention strategies and preventive efforts commonly used with children with problems in these areas. Our findings suggest that the relationship between language and motor skills is not likely to be simple and directional but rather to be complex and multifaceted.

How are the motor system activity and functional connectivity between the cognitive and sensorimotor systems modulated by athletic expertise?

Expertise offers a unique insight into how our brain functions. The purpose of this experiment was to determine if motor system activity and functional connectivity between the cognitive system and sensorimotor system is differentially modulated by an individual's level of expertise. This goal was achieved through the acquisition of functional neuroimaging data in 10 expert volleyball players and 10 novice individuals who were presented with a series of sentences describing possible technical volleyball-specific motor acts and acts that cannot be performed as positive ("Do …!") or negative ("Don't …") commands, while they were silently reading them and deciding whether the actions were technically feasible or not. Compared with novices, experts' activity in the left primary motor cortex hand area (M1) and in the left premotor cortex (Pm) was decreased by impossible actions presented as positive commands. Sensorimotor activation in response to action-related stimuli is not that automatic as held since we found that these areas were deactivated during the task, and their functional connectivity to the primary visual cortex was strengthened for possible actions presented as positive commands, reflecting the neural processes underlying the interaction between motor and visual imagery. These results suggest that the neural activity within the key areas implicitly triggered by motor simulation is a function of the expertise, action feasibility, and context.

The motor system contributes to comprehension of abstract language

If language comprehension requires a sensorimotor simulation, how can abstract language be comprehended? We show that preparation to respond in an upward or downward direction affects comprehension of the abstract quantifiers "more and more" and "less and less" as indexed by an N400-like component. Conversely, the semantic content of the sentence affects the motor potential measured immediately before the upward or downward action is initiated. We propose that this bidirectional link between motor system and language arises because the motor system implements forward models that predict the sensory consequences of actions. Because the same movement (e.g., raising the arm) can have multiple forward models for different contexts, the models can make different predictions depending on whether the arm is raised, for example, to place an object or raised as a threat. Thus, different linguistic contexts invoke different forward models, and the predictions constitute different understandings of the language.

Supramodal neural processing of abstract information conveyed by speech and gesture

Abstractness and modality of interpersonal communication have a considerable impact on comprehension. They are relevant for determining thoughts and constituting internal models of the environment. Whereas concrete object-related information can be represented in mind irrespective of language, abstract concepts require a representation in speech. Consequently, modality-independent processing of abstract information can be expected. Here we investigated the neural correlates of abstractness (abstract vs. concrete) and modality (speech vs. gestures), to identify an abstractness-specific supramodal neural network. During fMRI data acquisition 20 participants were presented with videos of an actor either speaking sentences with an abstract-social [AS] or concrete-object-related content [CS], or performing meaningful abstract-social emblematic [AG] or concrete-object-related tool-use gestures [CG]. Gestures were accompanied by a foreign language to increase the comparability between conditions and to frame the communication context of the gesture videos. Participants performed a content judgment task referring to the person vs. object-relatedness of the utterances. The behavioral data suggest a comparable comprehension of contents communicated by speech or gesture. Furthermore, we found common neural processing for abstract information independent of modality (AS > CS ∩ AG > CG) in a left hemispheric network including the left inferior frontal gyrus (IFG), temporal pole, and medial frontal cortex. Modality specific activations were found in bilateral occipital, parietal, and temporal as well as right inferior frontal brain regions for gesture (G > S) and in left anterior temporal regions and the left angular gyrus for the processing of speech semantics (S > G). These data support the idea that abstract concepts are represented in a supramodal manner. Consequently, gestures referring to abstract concepts are processed in a predominantly left hemispheric language related neural network.

Effect of action verbs on the performance of a complex movement

The interaction between language and motor action has been approached by studying the effect of action verbs, kinaesthetic imagery and mental subtraction upon the performance of a complex movement, the squat vertical jump (SVJ). The time of flight gave the value of the height of the SVJ and was measured with an Optojump® and a Myotest® apparatuses. The results obtained by the effects of the cognitive stimuli showed a statistically significant improvement of the SVJ performance after either loudly or silently pronouncing, hearing or reading the verb saute (jump in French language). Action verbs specific for other motor actions (pince = pinch, lèche = lick) or non-specific (bouge = move) showed no or little effect. A meaningless verb for the French subjects (tiáo = jump in Chinese) showed no effect as did rêve (dream), tombe (fall) and stop. The verb gagne (win) improved significantly the SVJ height, as did its antonym perds (lose) suggesting a possible influence of affects in the subjects' performance. The effect of the specific action verb jump upon the heights of SVJ was similar to that obtained after kinaesthetic imagery and after mental subtraction of two digits numbers from three digits ones; possibly, in the latter, because of the intervention of language in calculus. It appears that the effects of the specific action verb jump did seem effective but not totally exclusive for the enhancement of the SVJ performance. The results imply an interaction among language and motor brain areas in the performance of a complex movement resulting in a clear specificity of the corresponding action verb. The effect upon performance may probably be influenced by the subjects' intention, increased attention and emotion produced by cognitive stimuli among which action verbs.

Neural integration of speech and gesture in schizophrenia: evidence for differential processing of metaphoric gestures

Gestures are an important component of interpersonal communication. Especially, complex multimodal communication is assumed to be disrupted in patients with schizophrenia. In healthy subjects, differential neural integration processes for gestures in the context of concrete [iconic (IC) gestures] and abstract sentence contents [metaphoric (MP) gestures] had been demonstrated. With this study we wanted to investigate neural integration processes for both gesture types in patients with schizophrenia. During functional magnetic resonance imaging-data acquisition, 16 patients with schizophrenia (P) and a healthy control group (C) were shown videos of an actor performing IC and MP gestures and associated sentences. An isolated gesture (G) and isolated sentence condition (S) were included to separate unimodal from bimodal effects at the neural level. During IC conditions (IC > G ∩ IC > S) we found increased activity in the left posterior middle temporal gyrus (pMTG) in both groups. Whereas in the control group the left pMTG and the inferior frontal gyrus (IFG) were activated for the MP conditions (MP > G ∩ MP > S), no significant activation was found for the identical contrast in patients. The interaction of group (P/C) and gesture condition (MP/IC) revealed activation in the bilateral hippocampus, the left middle/superior temporal and IFG. Activation of the pMTG for the IC condition in both groups indicates intact neural integration of IC gestures in schizophrenia. However, failure to activate the left pMTG and IFG for MP co-verbal gestures suggests a disturbed integration of gestures embedded in an abstract sentence context. This study provides new insight into the neural integration of co-verbal gestures in patients with schizophrenia.

How the development of handedness could contribute to the development of language

We propose a developmental process which may link the development of handedness with the development of hemispheric specialization for speech processing. Using Arbib's proposed sequence of sensorimotor development of manual skills and gestures (that he considers to be the basis of speech gestures and proto-language), we show how the development of hand-use preferences in proto-reaching skills concatenate into object acquisition skills and eventually into role-differentiated bimanual manipulation skills (that reflect interhemispheric communication and coordination). These latter sensorimotor skills might facilitate the development of speech processing via their influence on the development of tool-using and object management abilities.

Seeking a bridge between language and motor cortices: a PPI study

The relation between the sensorimotor cortex and the language network has been widely discussed but still remains controversial. Two independent theories compete to explain how this area is involved during action-related verbs processing. The embodied view assumes that action word representations activate sensorimotor representations which are accessed when an action word is processed or when an action is observed. The abstract hypothesis states that the mental representations of words are abstract and independent of the objects' sensorimotor properties they refer to. We combined neuropsychological and fMRI-PPI connectivity data, to address action-related verbs processing in neurosurgical patients with lesions involving (N = 5) or sparing (N = 5) the primary motor cortex and healthy controls (N = 12). A lack of significant changes in the functional coupling between the left M1 cortex and functional nodes of the linguistic network during the verb generation task was found for all the groups. In addition, we found that the ability to perform an action verb naming task was not related to a damaged M1. These data showed that there was not a task-specific functional interaction active between M1 and the inferior frontal gyrus. We will discuss how these findings indicate that action words do not automatically activate the M1 cortex; we suggest rather that its enrolment could be related to other not strictly linguistic processing.

Motor activation in literal and non-literal sentences: does time matter?

Despite the impressive amount of evidence showing involvement of the sensorimotor systems in language processing, important questions remain unsolved among which the relationship between non-literal uses of language and sensorimotor activation. The literature did not yet provide a univocal answer on whether the comprehension of non-literal, abstract motion sentences engages the same neural networks recruited for literal sentences. A previous TMS study using the same experimental materials of the present study showed activation for literal, fictive and metaphoric motion sentences but not for idiomatic ones. To evaluate whether this may depend on insufficient time for elaborating the idiomatic meaning, we conducted a behavioral experiment that used a sensibility judgment task performed by pressing a button either with a hand finger or with a foot. Motor activation is known to be sensitive to the action-congruency of the effector used for responding. Therefore, all other things being equal, significant differences between response emitted with an action-congruent or incongruent effector (foot vs. hand) may be attributed to motor activation. Foot-related action verbs were embedded in sentences conveying literal motion, fictive motion, metaphoric motion or idiomatic motion. Mental sentences were employed as a control condition. foot responses were significantly faster than finger responses but only in literal motion sentences. We hypothesize that motor activation may arise in early phases of comprehension processes (i.e., upon reading the verb) for then decaying as a function of the strength of the semantic motion component of the verb.

Naming and gesturing spatial relations: evidence from focal brain-injured individuals

Spatial language helps us to encode relations between objects and organize our thinking. Little is known about the neural instantiations of spatial language. Using voxel-lesion symptom mapping (VLSM), we tested the hypothesis that focal brain injured patients who had damage to left frontal-parietal peri-Sylvian regions would have difficulty in naming spatial relations between objects. We also investigated the relationship between impaired verbalization of spatial relations and spontaneous gesture production. Patients with left or right hemisphere damage and elderly control participants were asked to name static (e.g., an apple on a book) and dynamic (e.g., a pen moves over a box) locative relations depicted in brief video clips. The correct use of prepositions in each task and gestures that represent the spatial relations were coded. Damage to the left posterior middle frontal gyrus, the left inferior frontal gyrus, and the left anterior superior temporal gyrus were related to impairment in naming spatial relations. Production of spatial gestures negatively correlated with naming accuracy, suggesting that gestures might help or compensate for difficulty with lexical access. Additional analyses suggested that left hemisphere patients who had damage to the left posterior middle frontal gyrus and the left inferior frontal gyrus gestured less than expected, if gestures are used to compensate for impairments in retrieving prepositions.

The embodied mind extended: using words as social tools

The extended mind view and the embodied-grounded view of cognition and language are typically considered as rather independent perspectives. In this paper we propose a possible integration of the two views and support it proposing the idea of “Words As social Tools” (WAT). In this respect, we will propose that words, also due to their social and public character, can be conceived as quasi-external devices that extend our cognition. Moreover, words function like tools in that they enlarge the bodily space of action thus modifying our sense of body. To support our proposal, we review the relevant literature on tool-use and on words as tools and report recent evidence indicating that word use leads to an extension of space close to the body. In addition, we outline a model of the neural processes that may underpin bodily space extension via word use and may reflect possible effects on cognition of the use of words as external means. We also discuss how reconciling the two perspectives can help to overcome the limitations they encounter if considered independently.

An investigation of semantic similarity judgments about action and non-action verbs in Parkinson's disease: implications for the Embodied Cognition Framework

The Embodied Cognition Framework maintains that understanding actions requires motor simulations subserved in part by premotor and primary motor regions. This hypothesis predicts that disturbances to these regions should impair comprehension of action verbs but not non-action verbs. We evaluated the performances of 10 patients with Parkinson's disease (PD) and 10 normal comparison (NC) participants on a semantic similarity judgment task (SSJT) that included four classes of action verbs and two classes of non-action verbs. The patients were tested both ON and OFF medication. The most salient results involved the accuracies and reaction times (RTs) for the action verbs taken as a whole and the non-action verbs taken as a whole. With respect to accuracies, the patients did not perform significantly worse than the NC participants for either the action verbs or the non-action verbs, regardless of whether they were ON or OFF their medication. And with respect to RTs, although the patients' responses were significantly slower than those of the NC participants for the action verbs, comparable processing delays were also observed for the non-action verbs; moreover, there was again no notable influence of medication. The major dissociation was therefore not between action and non-action verbs, but rather between accuracies (relatively intact) and RTs (relatively delayed). Overall, the data suggest that semantic similarity judgments for both action and non-action verbs are correct but slow in individuals with PD. These results provide new insights about language processing in PD, and they raise important questions about the explanatory scope of the Embodied Cognition Framework.

Evolutionary origins of human handedness: evaluating contrasting hypotheses

Variation in methods and measures, resulting in past dispute over the existence of population handedness in nonhuman great apes, has impeded progress into the origins of human right-handedness and how it relates to the human hallmark of language. Pooling evidence from behavioral studies, neuroimaging and neuroanatomy, we evaluate data on manual and cerebral laterality in humans and other apes engaged in a range of manipulative tasks and in gestural communication. A simplistic human/animal partition is no longer tenable, and we review four (nonexclusive) possible drivers for the origin of population-level right-handedness: skilled manipulative activity, as in tool use; communicative gestures; organizational complexity of action, in particular hierarchical structure; and the role of intentionality in goal-directed action. Fully testing these hypotheses will require developmental and evolutionary evidence as well as modern neuroimaging data.

Visual word recognition in deaf readers: lexicality is modulated by communication mode

Evidence indicates that adequate phonological abilities are necessary to develop proficient reading skills and that later in life phonology also has a role in the covert visual word recognition of expert readers. Impairments of acoustic perception, such as deafness, can lead to atypical phonological representations of written words and letters, which in turn can affect reading proficiency. Here, we report an experiment in which young adults with different levels of acoustic perception (i.e., hearing and deaf individuals) and different modes of communication (i.e., hearing individuals using spoken language, deaf individuals with a preference for sign language, and deaf individuals using the oral modality with less or no competence in sign language) performed a visual lexical decision task, which consisted of categorizing real words and consonant strings. The lexicality effect was restricted to deaf signers who responded faster to real words than consonant strings, showing over-reliance on whole word lexical processing of stimuli. No effect of stimulus type was found in deaf individuals using the oral modality or in hearing individuals. Thus, mode of communication modulates the lexicality effect. This suggests that learning a sign language during development shapes visuo-motor representations of words, which are tuned to the actions used to express them (phono-articulatory movements vs. hand movements) and to associated perceptions. As these visuo-motor representations are elicited during on-line linguistic processing and can overlap with the perceptual-motor processes required to execute the task, they can potentially produce interference or facilitation effects.

N400 ERPs for actions: building meaning in context

Converging neuroscientific evidence suggests the existence of close links between language and sensorimotor cognition. Accordingly, during the comprehension of meaningful actions, our brain would recruit semantic-related operations similar to those associated with the processing of language information. Consistent with this view, electrophysiological findings show that the N400 component, traditionally linked to the semantic processing of linguistic material, can also be elicited by action-related material. This review outlines recent data from N400 studies that examine the understanding of action events. We focus on three specific domains, including everyday action comprehension, co-speech gesture integration, and the semantics involved in motor planning and execution. Based on the reviewed findings, we suggest that both negativities (the N400 and the action-N400) reflect a common neurocognitive mechanism involved in the construction of meaning through the expectancies created by previous experiences and current contextual information. To shed light on how this process is instantiated in the brain, a testable contextual fronto-temporo-parietal model is proposed.

The disembodiment effect of negation: negating action-related sentences attenuates their interference on congruent upper limb movements

Human languages can express opposite propositions by means of the negative operator "not," which turns affirmative sentences into negative ones. Psycholinguistic research has indicated that negative meanings are formed by transiently reducing the access to mental representations of negated conceptual information. Neuroimaging studies have corroborated these findings, showing reduced activation of concept-specific embodied neural systems by negative versus affirmative sentences. This "disembodiment effect" of sentential negation should have two distinct consequences: first, the embodied systems should be computationally more free to support concurrent tasks when processing negative than affirmative sentences; second, the computational interference should only be reduced when there is a strict semantic congruency between the negated concept and the referent targeted by concurrent tasks. We tested these two predictions in two complementary experiments involving the comprehension of action-related sentences and kinematic measurements of its effects on concurrent, congruent actions. Sentences referred to actions involving either proximal or distal arm musculature. In experiment 1, requiring a proximal arm movement, we found interference reduction for negative proximal sentences. In experiment 2, requiring a distal arm movement, we found interference reduction for negative distal sentences. This dissociation provides the first conclusive evidence in support of a disembodiment theory of negation. We conclude that the computational cost resulting from the insertion of an additional lexical item ("not") in negative sentences is compensated by solely storing a concept in affirmative form in semantic memory, since its negative counterpart can be produced by transiently reducing the access to such stored semantic information.

Multiple trajectories in the developmental psychobiology of human handedness

We show that handedness is a product of a multifaceted biosocial developmental process that begins prenatally and continues into adulthood. Although right-handedness predominates, handedness varies continuously across the population. Therefore, our phrase "multiple trajectories"refers to both differences in developmental pathways that can lead to similarities in handedness and similarities in pathways that can lead to differences in handedness. The task for the researcher is to identify how, when, and for what actions the trajectory of handedness development can be maintained or changed for an individual. Given the complexity of these developmental pathways, it is likely that the asymmetric sensorimotor activity that occurs during the development of handedness influences other hemispheric variations in neural processing. Indeed, researchers have investigated how handedness relates to cognitive, social, and emotional functioning because handedness represents different patterns of hemispheric specialization. Although the story of handedness development is not complete, it is well worth pursuing because it makes the development of brain-behavior relations more transparent, especially for hemispheric differences in function.

Learning by doing? The effect of gestures on implicit retrieval of newly acquired words

Meaningful gestures enhance speech comprehensibility. However, their role during novel-word acquisition remains elusive. Here we investigate how meaningful versus meaningless gestures impact on novel-word learning and contrast these conditions to a purely verbal training. After training, neuronal processing of the novel words was assessed by blood-oxygen-level-dependent functional magnetic resonance imaging (BOLD-fMRI), disclosing that networks affording retrieval differ depending on the training condition. Over 3 days participants learned pseudowords for common objects (e.g., /klira/ -cap). For training they repeated the novel word while performing (i) an iconic, (ii) a grooming or (iii) no gesture. For the two conditions involving gestures, these were either actively repeated or passively observed during training. Behaviorally no substantial differences between the five different training conditions were found while fMRI disclosed differential networks affording implicit retrieval of the learned pseudowords depending on the training procedure. Most notably training with actively performed iconic gestures yielded larger activation in a semantic network comprising left inferior frontal (BA47) and inferior temporal gyri. Additionally hippocampal activation was stronger for all trained compared to unknown pseudowords of identical structure. The behavioral results challenge the generality of an 'enactment-effect' for single word learning. Imaging results, however, suggest that actively performed meaningful gestures lead to a deeper semantic encoding of novel words. The findings are discussed regarding their implications for theoretical accounts and for empirical approaches of gesture-based strategies in language (re)learning.

Is it just a brick wall or a sign from the universe? An fMRI study of supernatural believers and skeptics

We examined with functional magnetic resonance imaging the brain activity of 12 supernatural believers and 11 skeptics who first imagined themselves in critical life situations (e.g. problems in intimate relationships) and then watched emotionally charged pictures of lifeless objects and scenery (e.g. two red cherries bound together). Supernatural believers reported seeing signs of how the situations were going to turn out in the pictures more often than skeptics did. Viewing the pictures activated the same brain regions among all participants (e.g. the left inferior frontal gyrus, IFG). However, the right IFG, previously associated with cognitive inhibition, was activated more strongly in skeptics than in supernatural believers, and its activation was negatively correlated to sign seeing in both participant groups. We discuss the implications of these findings for research on the universal processes that may underlie supernatural beliefs and the role of cognitive inhibition in explaining individual differences in such beliefs.

Behavioral patterns and lesion sites associated with impaired processing of lexical and conceptual knowledge of actions

To further investigate the neural substrates of lexical and conceptual knowledge of actions, we administered a battery of six tasks to 226 brain-damaged patients with widely distributed lesions in the left and right cerebral hemispheres. The tasks probed lexical and conceptual knowledge of actions in a variety of verbal and non-verbal ways, including naming, word-picture matching, attribute judgments involving both words and pictures, and associative comparisons involving both words and pictures. Of the 226 patients who were studied, 61 failed one or more of the six tasks, with four patients being impaired on the entire battery, and varied numbers of patients being impaired on varied combinations of tasks. Overall, the 61 patients manifested a complex array of associations and dissociations across the six tasks. The lesion sites of 147 of the 226 patients were also investigated, using formal methods for lesion-deficit statistical mapping and power analysis of lesion overlap maps. Significant effects for all six tasks were found in the following left-hemisphere regions: the inferior frontal gyrus; the ventral precentral gyrus, extending superiorly into what are likely to be hand-related primary motor and premotor areas; and the anterior insula. In addition, significant effects for 4-5 tasks were found in not only the regions just mentioned, but also in several other left-hemisphere areas: the ventral postcentral gyrus; the supramarginal gyrus; and the posterior middle temporal gyrus. These results converge with previous research on the neural underpinnings of action words and concepts. However, the current study goes considerably beyond most previous investigations by providing extensive behavioral and lesion data for an unusually large and diverse sample of brain-damaged patients, and by incorporating multiple measures of verb comprehension. Regarding theoretical implications, the study provides new support for the Embodied Cognition Framework, which maintains that conceptual knowledge is grounded in sensorimotor systems.

Toward a neural basis of interactive alignment in conversation

The interactive-alignment account of dialogue proposes that interlocutors achieve conversational success by aligning their understanding of the situation under discussion. Such alignment occurs because they prime each other at different levels of representation (e.g., phonology, syntax, semantics), and this is possible because these representations are shared across production and comprehension. In this paper, we briefly review the behavioral evidence, and then consider how findings from cognitive neuroscience might lend support to this account, on the assumption that alignment of neural activity corresponds to alignment of mental states. We first review work supporting representational parity between production and comprehension, and suggest that neural activity associated with phonological, lexical, and syntactic aspects of production and comprehension are closely related. We next consider evidence for the neural bases of the activation and use of situation models during production and comprehension, and how these demonstrate the activation of non-linguistic conceptual representations associated with language use. We then review evidence for alignment of neural mechanisms that are specific to the act of communication. Finally, we suggest some avenues of further research that need to be explored to test crucial predictions of the interactive alignment account.

How to achieve synergy between medical education and cognitive neuroscience? An exercise on prior knowledge in understanding

A major challenge in contemporary research is how to connect medical education and cognitive neuroscience and achieve synergy between these domains. Based on this starting point we discuss how this may result in a common language about learning, more educationally focused scientific inquiry, and multidisciplinary research projects. As the topic of prior knowledge in understanding plays a strategic role in both medical education and cognitive neuroscience it is used as a central element in our discussion. A critical condition for the acquisition of new knowledge is the existence of prior knowledge, which can be built in a mental model or schema. Formation of schemas is a central event in student-centered active learning, by which mental models are constructed and reconstructed. These theoretical considerations from cognitive psychology foster scientific discussions that may lead to salient issues and questions for research with cognitive neuroscience. Cognitive neuroscience attempts to understand how knowledge, insight and experience are established in the brain and to clarify their neural correlates. Recently, evidence has been obtained that new information processed by the hippocampus can be consolidated into a stable, neocortical network more rapidly if this new information fits readily into a schema. Opportunities for medical education and medical education research can be created in a fruitful dialogue within an educational multidisciplinary platform. In this synergetic setting many questions can be raised by educational scholars interested in evidence-based education that may be highly relevant for integrative research and the further development of medical education.

Early speech-language development in females with Rett syndrome: focusing on the preserved speech variant

AIM

Our aim was to contribute new findings related to the pre-regressional verbal development of females with a variant of Rett syndrome (RTT) as the loss of spoken language is one of the key clinical features of RTT, and it would be of particular interest to study the early speech-language development of females who are considered to have preserved some speech-language abilities.

METHOD

We analysed 461 minutes of audio-video recordings containing play situations and the daily routines of six females (aged 7 to 24 months; mean birthweight 3057g, SD 195g) with the preserved speech variant (PSV) of RTT. All videos were recorded by parents and analysed retrospectively after the diagnosis PSV was made.

RESULTS

From the age of 7 months onwards, we observed two types of vocalizations, appearing intermittently: (1) apparently normal sequences; and (2) atypical (i.e. inhalatory, pressed, or high-pitched crying-like) vocalizations. Some participants failed to reach the milestone of canonical babbling. We observed a limited phonological and lexical complexity and a restricted compositional variability. Volubility was reduced during the whole period under observation. Hand stereotypies with simultaneous atypical vocalizations appeared only during the second year of life.

INTERPRETATION

The intermittent character of normal versus abnormal verbal behaviours might contribute to an early identification of children with a possible genetic mutation, and provides evidence that speech-language functions are abnormal from the very beginning.

A neuroanatomical examination of embodied cognition: semantic generation to action-related stimuli

The theory of embodied cognition postulates that the brain represents semantic knowledge as a function of the interaction between the body and the environment. The goal of our research was to provide a neuroanatomical examination of embodied cognition using action-related pictures and words. We used functional magnetic resonance imaging (fMRI) to examine whether there were shared and/or unique regions of activation between an ecologically valid semantic generation task and a motor task in the parietal-frontocentral network (PFN), as a function of stimulus format (pictures versus words) for two stimulus types (hand and foot). Unlike other methods for neuroimaging analyses involving subtractive logic or conjoint analyses, this method first isolates shared and unique regions of activation within-participants before generating an averaged map. The results demonstrated shared activation between the semantic generation and motor tasks, which was organized somatotopically in the PFN, as well as unique activation for the semantic generation tasks in proximity to the hand or foot motor cortex. We also found unique and shared regions of activation in the PFN as a function of stimulus format (pictures versus words). These results further elucidate embodied cognition in that they show that brain regions activated during actual motor movements were also activated when an individual verbally generates action-related semantic information. Disembodied cognition theories and limitations are also discussed.

A neuropsychological perspective on the link between language and praxis in modern humans

Hypotheses about the emergence of human cognitive abilities postulate strong evolutionary links between language and praxis, including the possibility that language was originally gestural. The present review considers functional and neuroanatomical links between language and praxis in brain-damaged patients with aphasia and/or apraxia. The neural systems supporting these functions are predominantly located in the left hemisphere. There are many parallels between action and language for recognition, imitation and gestural communication suggesting that they rely partially on large, common networks, differentially recruited depending on the nature of the task. However, this relationship is not unequivocal and the production and understanding of gestural communication are dependent on the context in apraxic patients and remains to be clarified in aphasic patients. The phonological, semantic and syntactic levels of language seem to share some common cognitive resources with the praxic system. In conclusion, neuropsychological observations do not allow support or rejection of the hypothesis that gestural communication may have constituted an evolutionary link between tool use and language. Rather they suggest that the complexity of human behaviour is based on large interconnected networks and on the evolution of specific properties within strategic areas of the left cerebral hemisphere.

Event-related potentials reveal early activation of body part representations in action concept comprehension

With tasks involving action concept comprehension, many fMRI studies have reported brain activations in sensori-motor regions specific to effectors of the referent action. There is relatively less evidence whether such activations reflect early semantic access or late conceptual re-processing. Here we recorded event-related potentials when participants recognized noun-verb pairs. For Congruent pairs, the verb was the one most commonly associated with the noun (e.g., football-kick). Compared with a control condition, verbs in Congruent pairs showed priming effects in the time windows of 100-150 ms and 210-260 ms. Such activation seems to be specific to body part but not other aspects of the action as similar priming effect was also found when the noun and verb involved different actions though sharing the same body part (e.g., football-jump), documenting for the first time the early activation of body part representations in action concept comprehension.

Motor-language coupling: direct evidence from early Parkinson's disease and intracranial cortical recordings

Language and action systems are functionally coupled in the brain as demonstrated by converging evidence using Functional magnetic resonance imaging (fMRI), electroencephalography (EEG), transcranial magnetic stimulation (TMS), and lesion studies. In particular, this coupling has been demonstrated using the action-sentence compatibility effect (ACE) in which motor activity and language interact. The ACE task requires participants to listen to sentences that described actions typically performed with an open hand (e.g., clapping), a closed hand (e.g., hammering), or without any hand action (neutral); and to press a large button with either an open hand position or closed hand position immediately upon comprehending each sentence. The ACE is defined as a longer reaction time (RT) in the action-sentence incompatible conditions than in the compatible conditions. Here we investigated direct motor-language coupling in two novel and uniquely informative ways. First, we measured the behavioural ACE in patients with motor impairment (early Parkinson's disease - EPD), and second, in epileptic patients with direct electrocorticography (ECoG) recordings. In experiment 1, EPD participants with preserved general cognitive repertoire, showed a much diminished ACE relative to non-EPD volunteers. Moreover, a correlation between ACE performance and action-verb processing (kissing and dancing test - KDT) was observed. Direct cortical recordings (ECoG) in motor and language areas (experiment 2) demonstrated simultaneous bidirectional effects: motor preparation affected language processing (N400 at left inferior frontal gyrus and middle/superior temporal gyrus), and language processing affected activity in movement-related areas (motor potential at premotor and M1). Our findings show that the ACE paradigm requires ongoing integration of preserved motor and language coupling (abolished in EPD) and engages motor-temporal cortices in a bidirectional way. In addition, both experiments suggest the presence of a motor-language network which is not restricted to somatotopically defined brain areas. These results open new pathways in the fields of motor diseases, theoretical approaches to language understanding, and models of action-perception coupling.

The differentiation of iconic and metaphoric gestures: common and unique integration processes

Recent research on the neural integration of speech and gesture has examined either gesture in the context of concrete [iconic (IC) gestures] or abstract sentence content [metaphoric (MP) gestures]. However, there has not yet been a direct comparison of the processing of both gesture types. This study tested the theory that left posterior temporal and inferior frontal brain regions are each uniquely involved in the integration of IC and MP gestures. During fMRI-data acquisition, participants were shown videos of an actor performing IC and MP gestures and associated sentences. An isolated gesture (G) and isolated sentence condition (S) were included to separate unimodal from bimodal effects at the neural level. During IC conditions, we found increased activity in the left posterior middle temporal gyrus and its right hemispheric homologue. The same regions in addition to the left inferior frontal gyrus (IFG) were activated during MP conditions in contrast to the isolated conditions (G&S). These findings support the hypothesis that there are distinct integration processes for IC and MP gestures. In line with recent claims of the semantic unification theory, there seems to be a division between perceptual-matching processes within the posterior temporal lobe and higher-order relational processes within the IFG.