The primacy of experience in language processing: Semantic priming is driven primarily by experiential similarity

The organization of semantic memory, including memory for word meanings, has long been a central question in cognitive science. Although there is general agreement that word meaning representations must make contact with sensory-motor and affective experiences in a non-arbitrary fashion, the nature of this relationship remains controversial. One prominent view proposes that word meanings are represented directly in terms of their experiential content (i.e., sensory-motor and affective representations). Opponents of this view argue that the representation of word meanings reflects primarily taxonomic structure, that is, their relationships to natural categories. In addition, the recent success of language models based on word co-occurrence (i.e., distributional) information in emulating human linguistic behavior has led to proposals that this kind of information may play an important role in the representation of lexical concepts. We used a semantic priming paradigm designed for representational similarity analysis (RSA) to quantitatively assess how well each of these theories explains the representational similarity pattern for a large set of words. Crucially, we used partial correlation RSA to account for intercorrelations between model predictions, which allowed us to assess, for the first time, the unique effect of each model. Semantic priming was driven primarily by experiential similarity between prime and target, with no evidence of an independent effect of distributional or taxonomic similarity. Furthermore, only the experiential models accounted for unique variance in priming after partialling out explicit similarity ratings. These results support experiential accounts of semantic representation and indicate that, despite their good performance at some linguistic tasks, the distributional models evaluated here do not encode the same kind of information used by the human semantic system.

No support for a causal role of primary motor cortex in construing meaning from language: An rTMS study

Embodied cognition theories predict a functional involvement of sensorimotor processes in language understanding. In a preregistered experiment, we tested this idea by investigating whether interfering with primary motor cortex (M1) activation can change how people construe meaning from action language. Participants were presented with sentences describing actions (e.g., "turning off the light") and asked to choose between two interpretations of their meaning, one more concrete (e.g., "flipping a switch") and another more abstract (e.g., "going to sleep"). Prior to this task, participants' M1 was disrupted using repetitive transcranial magnetic stimulation (rTMS). The results yielded strong evidence against the idea that M1-rTMS affects meaning construction (BF01 > 30). Additional analyses and control experiments suggest that the absence of effect cannot be accounted for by failure to inhibit M1, lack of construct validity of the task, or lack of power to detect a small effect. In sum, these results do not support a causal role for primary motor cortex in building meaning from action language.

The Primacy of Experience in Language Processing: Semantic Priming Is Driven Primarily by Experiential Similarity

The organization of semantic memory, including memory for word meanings, has long been a central question in cognitive science. Although there is general agreement that word meaning representations must make contact with sensory-motor and affective experiences in a non-arbitrary fashion, the nature of this relationship remains controversial. One prominent view proposes that word meanings are represented directly in terms of their experiential content (i.e., sensory-motor and affective representations). Opponents of this view argue that the representation of word meanings reflects primarily taxonomic structure, that is, their relationships to natural categories. In addition, the recent success of language models based on word co-occurrence (i.e., distributional) information in emulating human linguistic behavior has led to proposals that this kind of information may play an important role in the representation of lexical concepts. We used a semantic priming paradigm designed for representational similarity analysis (RSA) to quantitatively assess how well each of these theories explains the representational similarity pattern for a large set of words. Crucially, we used partial correlation RSA to account for intercorrelations between model predictions, which allowed us to assess, for the first time, the unique effect of each model. Semantic priming was driven primarily by experiential similarity between prime and target, with no evidence of an independent effect of distributional or taxonomic similarity. Furthermore, only the experiential models accounted for unique variance in priming after partialling out explicit similarity ratings. These results support experiential accounts of semantic representation and indicate that, despite their good performance at some linguistic tasks, the distributional models evaluated here do not encode the same kind of information used by the human semantic system.

Presurgical Language Mapping: What Are We Testing?

Gliomas are brain tumors infiltrating healthy cortical and subcortical areas that may host cognitive functions, such as language. If these areas are damaged during surgery, the patient might develop word retrieval or articulation problems. For this reason, many glioma patients are operated on awake, while their language functions are tested. For this practice, quite simple tests are used, for example, picture naming. This paper describes the process and timeline of picture naming (noun retrieval) and shows the timeline and localization of the distinguished stages. This is relevant information for presurgical language testing with navigated Magnetic Stimulation (nTMS). This novel technique allows us to identify cortical involved in the language production process and, thus, guides the neurosurgeon in how to approach and remove the tumor. We argue that not only nouns, but also verbs should be tested, since sentences are built around verbs, and sentences are what we use in daily life. This approach’s relevance is illustrated by two case studies of glioma patients.

Gross, Fine and Visual-Motor Skills in Children with Language Disorder, Speech Sound Disorder and Their Combination

Increasing evidence shows that children with Communication Disorders (CDs) may show gross, fine, and visual-motor difficulties compared to children with typical development. Accordingly, the present study aims to characterize gross, fine and visual-motor skills in children with CDs, distinguishing children with CDs into three subgroups, i.e., with Language Disorders (LD), Speech Sound Disorders (SSD), and LD + SSD. In Experiment 1, around 60% of children with CDs (4 to 7 years; 21 with LD, 36 with SSD, and 90 with LD + SSD) showed clinical/borderline scores in balance skills, regardless of the type of communication deficit. However, children with LD, SSD, and LD + SSD did not differ in gross and fine motor skills. In Experiment 2, a higher percentage of children with CDs (4 to 7 years; 34 with LD, 62 with SSD, 148 with LD + SSD) obtained clinical/borderline scores in Visual Perception skills. Moreover, children with LD + SSD performed significantly worsen in Visual Perception and Fine Motor Coordination skills compared to children with SSD only. Our results underlined that CDs are generally associated with gross motor difficulties and that visual-motor difficulties are related to the type of communication deficit. Paying earlier attention to the motor skills of children with CDs could help clinicians design effective interventions.

Does the Motor Cortex Want the Full Story? The Influence of Sentence Context on Corticospinal Excitability in Action Language Processing

The reading of action verbs has been shown to activate motor areas, whereby sentence context may serve to either globally strengthen this activation or to selectively sharpen it. To investigate this issue, we manipulated the presence of manual actions and sentence context, assessing the level of corticospinal excitability by means of transcranial magnetic stimulation. We hypothesized that context would serve to sharpen the neural representation of the described actions in the motor cortex, reflected in context-specific modulation of corticospinal excitability. Participants silently read manual action verbs and non-manual verbs, preceded by a full sentence (rich context) or not (minimal context). Transcranial magnetic stimulation pulses were delivered at rest or shortly after verb presentation. The coil was positioned over the cortical representation of the right first dorsal interosseous (pointer finger). We observed a general increase of corticospinal excitability while reading both manual action and non-manual verbs in minimal context, whereas the modulation was action-specific in rich context: corticospinal excitability increased while reading manual verbs, but did not differ from baseline for non-manual verbs. These findings suggest that sentence context sharpens motor representations, activating the motor cortex when relevant and eliminating any residual motor activation when no action is present.

Neural correlates of embodied action language processing: a systematic review and meta-analytic study

The neural correlates of action language processing are still debated within embodied cognition research and little is known about the flexible involvement of modality-specific pre-motor system and multimodal high-level temporo-parietal regions as a function of explicit and implicit tasks. A systematic review and the Activation likelihood estimation (ALE) meta-analyses on functional neuroimaging studies were performed to identify neural correlates of action language processing activated during explicit and implicit tasks. The contrast ALE meta-analysis revealed activation of modality-specific premotor area and inferior frontal areas during explicit action language tasks while a greater activation of posterior temporo-occipital areas emerged for implicit tasks. The conjunction analysis revealed overlap in the temporo-parietal multimodal high-level regions for both types of tasks. Functional specialization of the middle temporal gyrus was found where the more posterior-occipital part resulted activated during implicit action language tasks whereas the antero-lateral part was involved in explicit tasks. Our findings were discussed within a conceptual flexibility perspective about the involvement of both the modality-specific and multimodal brain system during action language processing depending on different types of tasks.

Dissociation between function and manipulation in semantic representations of motor impaired subjects: A new test

A fundamental problem in semantic cognition is the representation of human concepts in the brain. Much of the knowledge acquired in the last decades comes from the study of dissociations found in patients with acquired difficulties in language, perception, and action. In particular, some deficits involve loss of knowledge about tools. The dissociation between two relevant aspects of tools, function and manipulation, has been the focus of several studies. In this paper, a new test designed to study the dissociation between function and manipulation is proposed and normative values for a control population are provided. This novel test was additionally administered to and evaluated in a group of Parkinson's disease patients. The Graded-Controlled Hub-and-Spoke model of Lambon Ralph, Jefferies, Patterson and Rogers was used as a theoretical guide to interpret the results.

Increased links between language and motor areas: A proof-of-concept study on resting-state functional connectivity following Personalized Observation, Execution and Mental imagery therapy in chronic aphasia

A tight coupling of language and motor processes has been established, which is consistent with embodied cognition theory. However, very few therapies have been designed to exploit the synergy between motor and language processes to help rehabilitate people with aphasia (PWA). Moreover, the underlying mechanisms supporting the efficacy of such approaches remain unknown. Previous work in our laboratory has demonstrated that personalized observation, execution, and mental imagery therapy (POEM)-a new therapy using three sensorimotor strategies to trigger action verb naming-leads to significant improvements in verb retrieval in PWA. Moreover, these improvements were supported by significant activations in language and sensorimotor processing areas, which further reinforce the role of both processes in language recovery (Durand et al., 2018). The present study investigates resting state functional connectivity (rsFC) changes following POEM in a pre-/post-POEM therapy design. A whole brain network functional connectivity approach was used to assess and describe changes in rsFC in a group of four PWA, who were matched and compared with four healthy controls (HC). Results showed increased rsFC in PWA within and between visuo-motor and language areas (right cuneal cortex-left supracalcarin (SCC) cortex/right precentral gyrus (PreCG)-left lingual gyrus (LG)) and between areas involved in action processing (right anterior parahippocampal gyrus (aPaHC)-left superior parietal lobule (SPL). In comparison to HC, the PWA group showed increased rsFC between the right inferior frontal gyrus (IFG) and left thalamus, which are areas involved in lexico-semantic processing. This proof-of-concept study suggests that the sensorimotor and language strategies used in POEM may induce modifications in large-scale networks, probably derived from the integration of visual and sensorimotor systems to sustain action naming, which is consistent with the embodied cognition theory.

A Sound Explanation for Motor Cortex Engagement during Action Word Comprehension

Comprehending action words often engages similar brain regions to those involved in perceiving and executing actions. This finding has been interpreted as support for grounding of conceptual processing in motor representations or that conceptual processing involves motor simulation. However, such demonstrations cannot confirm the nature of the mechanism(s) responsible, as word comprehension involves multiple processes (e.g., lexical, semantic, morphological, phonological). In this study, we tested whether this motor cortex engagement instead reflects processing of statistical regularities in sublexical phonological features. Specifically, we measured brain activity in healthy participants using functional magnetic resonance imaging while they performed an auditory lexical decision paradigm involving monosyllabic action words associated with specific effectors (face, arm, and leg). We show that nonwords matched to the action words in terms of their phonotactic probability elicit common patterns of activation. In addition, we show that a measure of the action words' phonological typicality, the extent to which a word's phonology is typical of other words in the grammatical category to which it belongs (i.e., more or less verb-like), is responsible for their activating a significant portion of primary and premotor cortices. These results indicate motor cortex engagement during action word comprehension is more likely to reflect processing of statistical regularities in sublexical phonological features than conceptual processing. We discuss the implications for current neurobiological models of language, all of which implicitly or explicitly assume that the relationship between the sound of a word and its meaning is arbitrary.

Electrifying discourse: Anodal tDCS of the primary motor cortex selectively reduces action appraisal in naturalistic narratives

Non-invasive stimulation of the primary motor cortex (M1) modulates processing of decontextualized action words and sentences (i.e., verbal units denoting bodily motion). This suggests that language comprehension hinges on brain circuits mediating the bodily experiences evoked by verbal material. Yet, despite its relevance to constrain mechanistic language models, such a finding fails to reveal whether and how relevant circuits operate in the face of full-blown, everyday texts. Using a novel naturalistic discourse paradigm, we examined whether direct modulation of M1 excitability influences the grasping of narrated actions. Following random group assignment, participants received anodal transcranial direct current stimulation over the left M1, or sham stimulation of the same area, or anodal stimulation of the left ventrolateral prefrontal cortex. Immediately afterwards, they listened to action-laden and neutral stories and answered questions on information realized by verbs (denoting action and non-action processes) and circumstances (conveying locative or temporal details). Anodal stimulation of the left M1 selectively decreased outcomes on action-relative to non-action information -a pattern that discriminated between stimulated and sham participants with 74% accuracy. This result was particular to M1 and held irrespective of the subjects' working memory and vocabulary skills, further attesting to its specificity. Our findings suggest that offline modulation of motor-network excitability might lead to transient unavailability of putative resources needed to evoke actions in naturalistic texts, opening promising avenues for the language embodiment framework.

Subthalamic nucleus activity in the processing of body and mental action verbs in people with Parkinson's disease

Local field potentials evoked by body action and mental action verbs were recorded in the subthalamic nucleus (STN) of 18 patients with Parkinson's disease through the electrodes implanted for deep brain stimulation. Compared with the medication on-condition, the medication off-condition showed a difference in activity in the early time segments, mainly in the right STN, with larger amplitudes for body action verbs. In the on-condition a similar pattern was detected in the left STN. These patterns of early differences in activity evoked by different types of verbs might indicate the potential of the STN to rapidly detect relevant behavioural clues in verbal content and to integrate these in subsequent cortico-subcortical interactions. In addition, these lateralizations allow speculations about shifts in processing activity correlating with dopaminergic denervation. Whether this detection relies on phonological, semantic or grammatical clues remains an open question.

Processing of Action and Sound Verbs in Context: An FMRI Study

Recent theories propose a flexible recruitment of sensory and motor brain regions during conceptual processing depending on context and task. The present functional magnetic resonance imaging study investigated the influence of context and task on conceptual processing of action and sound verbs. Participants first performed an explicit semantic context decision task, in which action and sound verbs were presented together with a context noun. The same verbs were repeatedly presented in a subsequent implicit lexical decision task together with new action and sound verbs. Thereafter, motor and acoustic localizer tasks were administered to identify brain regions involved in perception and action. During the explicit task, we found differential activations to action and sound verbs near corresponding sensorimotor brain regions. During the implicit lexical decision task, differences between action and sound verbs were absent. However, feature-specific repetition effects were observed near corresponding sensorimotor brain regions. The present results suggest flexible conceptual representations depending on context and task. Feature-specific effects were observed only near, but not within corresponding sensorimotor brain regions, as defined by the localizer tasks. Our results therefore only provide limited evidence in favor of grounded cognition theories assuming a close link between the conceptual and the sensorimotor systems.

Tonality Tunes the Statistical Characteristics in Music: Computational Approaches on Statistical Learning

Statistical learning is a learning mechanism based on transition probability in sequences such as music and language. Recent computational and neurophysiological studies suggest that the statistical learning contributes to production, action, and musical creativity as well as prediction and perception. The present study investigated how statistical structure interacts with tonalities in music based on various-order statistical models. To verify this in all 24 major and minor keys, the transition probabilities of the sequences containing the highest pitches in Bach's Well-Tempered Clavier, which is a collection of two series (No. 1 and No. 2) of preludes and fugues in all of the 24 major and minor keys, were calculated based on nth-order Markov models. The transition probabilities of each sequence were compared among tonalities (major and minor), two series (No. 1 and No. 2), and music types (prelude and fugue). The differences in statistical characteristics between major and minor keys were detected in lower- but not higher-order models. The results also showed that statistical knowledge in music might be modulated by tonalities and composition periods. Furthermore, the principal component analysis detected the shared components of related keys, suggesting that the tonalities modulate statistical characteristics in music. The present study may suggest that there are at least two types of statistical knowledge in music that are interdependent on and independent of tonality, respectively.

Depth and the Uncertainty of Statistical Knowledge on Musical Creativity Fluctuate Over a Composer's Lifetime

Brain models music as a hierarchy of dynamical systems that encode probability distributions and complexity (i.e., entropy and uncertainty). Through musical experience over lifetime, a human is intrinsically motivated in optimizing the internalized probabilistic model for efficient information processing and the uncertainty resolution, which has been regarded as rewords. Human's behavior, however, appears to be not necessarily directing to efficiency but sometimes act inefficiently in order to explore a maximum rewards of uncertainty resolution. Previous studies suggest that the drive for novelty seeking behavior (high uncertain phenomenon) reflects human's curiosity, and that the curiosity rewards encourage humans to create and learn new regularities. That is to say, although brain generally minimizes uncertainty of music structure, we sometimes derive pleasure from music with uncertain structure due to curiosity for novelty seeking behavior by which we anticipate the resolution of uncertainty. Few studies, however, investigated how curiosity for uncertain and novelty seeking behavior modulates musical creativity. The present study investigated how the probabilistic model and the uncertainty in music fluctuate over a composer's lifetime (all of the 32 piano sonatas by Ludwig van Beethoven). In the late periods of the composer's lifetime, the transitional probabilities (TPs) of sequential patterns that ubiquitously appear in all of his music (familiar phrase) were decreased, whereas the uncertainties of the whole structure were increased. Furthermore, these findings were prominent in higher-, rather than lower-, order models of TP distribution. This may suggest that the higher-order probabilistic model is susceptible to experience and psychological phenomena over the composer's lifetime. The present study first suggested the fluctuation of uncertainty of musical structure over a composer's lifetime. It is suggested that human's curiosity for uncertain and novelty seeking behavior may modulate optimization and creativity in human's brain.

Motor content norms for 4,565 verbs in Spanish

Embodiment theory suggests that, during the processing of words related to movement, as in the case of action verbs, somatotopic activation is produced in the motor and premotor cortices. In the same way, some studies have demonstrated that patients with frontal-lobe damage, such as Parkinson's patients, have difficulties processing that kind of stimulus. At the moment, no standardized data exist concerning the motor content of Spanish verbs. Therefore, the aim of the present research was to develop a database of 4,565 verbs in Spanish through a survey filled out by 152 university students. The value for the motor content was obtained by calculating the average value from the answers of the participants. In addition, the reliability of the results was estimated, as well as their convergent validity, using diverse correlation coefficients. The database and the raw responses of the participants can be downloaded from this website: https://inco.grupos.uniovi.es/enlaces.

Does TMS Disruption of the Left Primary Motor Cortex Affect Verb Retrieval Following Exposure to Pantomimed Gestures?

Previous research suggests that meaning-laden gestures, even when produced in the absence of language (i.e., pantomimed gestures), influence lexical retrieval. Yet, little is known about the neural mechanisms that underlie this process. Based on embodied cognition theories, many studies have demonstrated motor cortex involvement in the representation of action verbs and in the understanding of actions. The present study aimed to investigate whether the motor system plays a critical role in the behavioral influence of pantomimed gestures on action naming. Continuous theta burst stimulation (cTBS) was applied over the hand area of the left primary motor cortex and to a control site (occipital cortex). An action-picture naming task followed cTBS. In the naming task, participants named action pictures that were preceded by videos of congruent pantomimed gestures, unrelated pantomimed gestures or a control video with no movement (as a neutral, non-gestural condition). In addition to behavioral measures of performance, cTBS-induced changes in corticospinal activity were assessed. We replicated previous finding that exposure to congruent pantomimed gestures facilitates word production, compared to unrelated or neutral primes. However, we found no evidence that the left primary motor area is crucially involved in the mechanism underlying behavioral facilitation effects of gesture on verb production. Although, at the group level, cTBS induced motor cortex suppression, at the individual level we found remarkable variability of cTBS effects on the motor cortex. We found cTBS induction of both inhibition of corticospinal activity (with slower behavioral of responses) and enhancement (with faster behavioral responses). Our findings cast doubt on assumptions that the motor cortex is causally involved in the impact of gestures on action-word processing. Our results also highlight the importance of careful consideration of interindividual variability for the interpretation of cTBS effects.

Entropy, Uncertainty, and the Depth of Implicit Knowledge on Musical Creativity: Computational Study of Improvisation in Melody and Rhythm

Recent neurophysiological and computational studies have proposed the hypothesis that our brain automatically codes the nth-order transitional probabilities (TPs) embedded in sequential phenomena such as music and language (i.e., local statistics in nth-order level), grasps the entropy of the TP distribution (i.e., global statistics), and predicts the future state based on the internalized nth-order statistical model. This mechanism is called statistical learning (SL). SL is also believed to contribute to the creativity involved in musical improvisation. The present study examines the interactions among local statistics, global statistics, and different levels of orders (mutual information) in musical improvisation interact. Interactions among local statistics, global statistics, and hierarchy were detected in higher-order SL models of pitches, but not lower-order SL models of pitches or SL models of rhythms. These results suggest that the information-theoretical phenomena of local and global statistics in each order may be reflected in improvisational music. The present study proposes novel methodology to evaluate musical creativity associated with SL based on information theory.

Flexibility in Language Action Interaction: The Influence of Movement Type

Recent neuropsychological studies in neurological patients and healthy subjects suggest a close functional relationship between the brain systems for language and action. Facilitation and inhibition effects of motor system activity on language processing have been demonstrated as well as causal effects in the reverse direction, from language processes on motor excitability or performance. However, as the documented effects between motor and language systems were sometimes facilitatory and sometimes inhibitory, the “sign” of these effects still remains to be explained. In a previous study, we reported a word-category-specific differential impairment of verbal working memory for concordant arm- and leg-related action words brought about by complex sequential movements of the hands and feet. In this article, we seek to determine whether the sign of the functional interaction between language and action systems of the human brain can be changed in a predictable manner by changing movement type. We here report that the sign of the effect of motor movement on action word memory can be reversed from interference to facilitation if, instead of complex movement sequences, simple repetitive movements are performed. Specifically, when engaged in finger tapping, subjects were able to remember relatively more arm-related action words (as compared to control conditions), thus documenting an enhancement of working memory brought about by simple hand movements. In contrast, when performing complex sequences of finger movements, an effector-specific degradation of action word memory was found. By manipulating the sign of the effect in accord with theory-driven predictions, these findings provide support for shared neural bases for motor movement and verbal working memory for action-related words and strengthen the argument that motor systems play a causal and functionally relevant role in language processing semantically related to action.

Neurophysiological Markers of Statistical Learning in Music and Language: Hierarchy, Entropy, and Uncertainty

Statistical learning (SL) is a method of learning based on the transitional probabilities embedded in sequential phenomena such as music and language. It has been considered an implicit and domain-general mechanism that is innate in the human brain and that functions independently of intention to learn and awareness of what has been learned. SL is an interdisciplinary notion that incorporates information technology, artificial intelligence, musicology, and linguistics, as well as psychology and neuroscience. A body of recent study has suggested that SL can be reflected in neurophysiological responses based on the framework of information theory. This paper reviews a range of work on SL in adults and children that suggests overlapping and independent neural correlations in music and language, and that indicates disability of SL. Furthermore, this article discusses the relationships between the order of transitional probabilities (TPs) (i.e., hierarchy of local statistics) and entropy (i.e., global statistics) regarding SL strategies in human's brains; claims importance of information-theoretical approaches to understand domain-general, higher-order, and global SL covering both real-world music and language; and proposes promising approaches for the application of therapy and pedagogy from various perspectives of psychology, neuroscience, computational studies, musicology, and linguistics.

tDCS over the motor cortex improves lexical retrieval of action words in poststroke aphasia

One-third of stroke survivors worldwide suffer from aphasia. Speech and language therapy (SLT) is considered effective in treating aphasia, but because of time constraints, improvements are often limited. Noninvasive brain stimulation is a promising adjuvant strategy to facilitate SLT. However, stroke might render “classical” language regions ineffective as stimulation sites. Recent work showed the effectiveness of motor cortex stimulation together with intensive naming therapy to improve outcomes in aphasia (Meinzer et al. 2016). Although that study highlights the involvement of the motor cortex, the functional aspects by which it influences language remain unclear. In the present study, we focus on the role of motor cortex in language, investigating its functional involvement in access to specific lexico-semantic (object vs. action relatedness) information in poststroke aphasia. To this end, we tested effects of anodal transcranial direct current stimulation (tDCS) to the left motor cortex on lexical retrieval in 16 patients with poststroke aphasia in a sham-controlled, double-blind study design. Critical stimuli were action and object words, and pseudowords. Participants performed a lexical decision task, deciding whether stimuli were words or pseudowords. Anodal tDCS improved accuracy in lexical decision, especially for words with action-related content and for pseudowords with an “action-like” ending ( t15 = 2.65, P = 0.036), but not for words with object-related content and pseudowords with “object-like” characteristics. We show as a proof-of-principle that the motor cortex may play a specific role in access to lexico-semantic content. Thus motor-cortex stimulation may strengthen content-specific word-to-semantic concept associations during language treatment in poststroke aphasia.

NEW & NOTEWORTHY The role of motor cortex (MC) in language processing has been debated in both health and disease. Recent work has suggested that MC stimulation together with speech and language therapy enhances outcomes in aphasia. We show that MC stimulation has a differential effect on object- and action-word processing in poststroke aphasia. We propose that MC stimulation may specifically strengthen word-to-semantic concept association in aphasia. Our results potentially provide a way to tailor therapies for language rehabilitation.

A facilitating role for the primary motor cortex in action sentence processing

The involvement of the motor system in action language comprehension is a hotly debated topic in cognitive neuroscience and psychology. Recent studies suggest that primary motor cortex (M1) response to action language is context-sensitive rather than automatic and necessary. Specifically, semantic polarity (i.e. affirmative/negative valence) appears to modulate the intensity of this response, which is stronger for affirmative action sentences. The aim of our study was to examine further the context sensitivity of M1 response. More specifically, we aimed to determine whether M1 response follows semantic polarity or the core meaning of the sentence using two-part action sentences containing interacting polarities. Modulations of M1 activity were recorded using surface electromyography of the first dorsal interosseous muscle of the right hand in 22 healthy participants. Our results show an increase in M1 activity during the first part of the sentence, regardless of semantic polarity. This response was then modulated by the polarity of the second part of the sentence, which carried crucial information regarding the action. These observations suggest that M1 differentially responds to different aspects of action sentences, one response being automatic and the other following the core meaning of the sentence. Our results thus contribute to clarifying the nature of the motor response to action language, which is key to develop more comprehensive and plausible neurobiological models of language processing.

Role of medial premotor areas in action language processing in relation to motor skills

The literature reports that the supplementary motor area (SMA) and pre-supplementary motor area (pre-SMA) are involved in motor planning and execution, and in motor-related cognitive functions such as motor imagery. However, their specific role in action language processing remains unclear. In the present study, we investigated the impact of repetitive transcranial magnetic stimulation (rTMS) over SMA and pre-SMA during an action semantic analogy task (SAT) in relation with fine motor skills (i.e., manual dexterity) and motor imagery abilities in healthy non-expert adults. The impact of rTMS over SMA (but not pre-SMA) on reaction times (RT) during SAT was correlated with manual dexterity. Specifically, results show that rTMS over SMA modulated RT for those with lower dexterity skills. Our results therefore demonstrate a causal involvement of SMA in action language processing, as well as the existence of inter-individual differences in this involvement. We discuss these findings in light of neurolinguistic theories of language processing.

Neural reuse of action perception circuits for language, concepts and communication

Neurocognitive and neurolinguistics theories make explicit statements relating specialized cognitive and linguistic processes to specific brain loci. These linking hypotheses are in need of neurobiological justification and explanation. Recent mathematical models of human language mechanisms constrained by fundamental neuroscience principles and established knowledge about comparative neuroanatomy offer explanations for where, when and how language is processed in the human brain. In these models, network structure and connectivity along with action- and perception-induced correlation of neuronal activity co-determine neurocognitive mechanisms. Language learning leads to the formation of action perception circuits (APCs) with specific distributions across cortical areas. Cognitive and linguistic processes such as speech production, comprehension, verbal working memory and prediction are modelled by activity dynamics in these APCs, and combinatorial and communicative-interactive knowledge is organized in the dynamics within, and connections between APCs. The network models and, in particular, the concept of distributionally-specific circuits, can account for some previously not well understood facts about the cortical 'hubs' for semantic processing and the motor system's role in language understanding and speech sound recognition. A review of experimental data evaluates predictions of the APC model and alternative theories, also providing detailed discussion of some seemingly contradictory findings. Throughout, recent disputes about the role of mirror neurons and grounded cognition in language and communication are assessed critically.

Communicative knowledge pervasively influences sensorimotor computations

Referential pointing is a characteristically human behavior, which involves moving a finger through space to direct an addressee towards a desired mental state. Planning this type of action requires an interface between sensorimotor and conceptual abilities. A simple interface could supplement spatially-guided motor routines with communicative-ostensive cues. For instance, a pointing finger held still for an extended period of time could aid the addressee’s understanding, without altering the movement’s trajectory. A more complex interface would entail communicative knowledge penetrating the sensorimotor system and directly affecting pointing trajectories. We compare these two possibilities using motion analyses of referential pointing during multi-agent interactions. We observed that communicators produced ostensive cues that were sensitive to the communicative context. Crucially, we also observed pervasive adaptations to the pointing trajectories: they were tailored to the communicative context and to partner-specific information. These findings indicate that human referential pointing is planned and controlled on the basis of partner-specific knowledge, over and above the tagging of motor routines with ostensive cues.

Semantic word category processing in semantic dementia and posterior cortical atrophy

There is general agreement that perisylvian language cortex plays a major role in lexical and semantic processing; but the contribution of additional, more widespread, brain areas in the processing of different semantic word categories remains controversial. We investigated word processing in two groups of patients whose neurodegenerative diseases preferentially affect specific parts of the brain, to determine whether their performance would vary as a function of semantic categories proposed to recruit those brain regions. Cohorts with (i) Semantic Dementia (SD), who have anterior temporal-lobe atrophy, and (ii) Posterior Cortical Atrophy (PCA), who have predominantly parieto-occipital atrophy, performed a lexical decision test on words from five different lexico-semantic categories: colour (e.g., yellow), form (oval), number (seven), spatial prepositions (under) and function words (also). Sets of pseudo-word foils matched the target words in length and bi-/tri-gram frequency. Word-frequency was matched between the two visual word categories (colour and form) and across the three other categories (number, prepositions, and function words). Age-matched healthy individuals served as controls. Although broad word processing deficits were apparent in both patient groups, the deficit was strongest for colour words in SD and for spatial prepositions in PCA. The patterns of performance on the lexical decision task demonstrate (a) general lexicosemantic processing deficits in both groups, though more prominent in SD than in PCA, and (b) differential involvement of anterior-temporal and posterior-parietal cortex in the processing of specific semantic categories of words.

The effects of an action's "age-of-acquisition" on action-sentence processing

How does our brain allow us comprehend abstract/symbolic descriptions of human action? Whereas past research suggested that processing action language relies on sensorimotor brain regions, recent work suggests that sensorimotor activation depends on participants' task goals, such that focusing on abstract (vs. concrete) aspects of an action activates "default mode network" (rather than sensorimotor) regions. Following a Piagetian framework, we hypothesized that for actions acquired at an age wherein abstract/symbolic cognition is fully-developed, even when participants focus on the concrete aspects of an action, they should retrieve abstract-symbolic mental representations. In two studies, participants processed the concrete (i.e., "how") and abstract (i.e., "why") aspects of late-acquired and early-acquired actions. Consistent with previous research, focusing on the abstract (vs. concrete) aspects of an action resulted in greater activation in the "default mode network". Importantly, the activation in these regions was higher when processing later-acquired (vs. earlier acquired) actions-also when participants' goal was to focus on the concrete aspects of the action. We discuss the implications of the current findings to research on the involvement of concrete representations in abstract cognition.

An fMRI study of perception and action in deaf signers

Since the discovery of mirror neurons, there has been a great deal of interest in understanding the relationship between perception and action, and the role of the human mirror system in language comprehension and production. Two questions have dominated research. One concerns the role of Broca's area in speech perception. The other concerns the role of the motor system more broadly in understanding action-related language. The current study investigates both of these questions in a way that bridges research on language with research on manual actions. We studied the neural basis of observing and executing American Sign Language (ASL) object and action signs. In an fMRI experiment, deaf signers produced signs depicting actions and objects as well as observed/comprehended signs of actions and objects. Different patterns of activation were found for observation and execution although with overlap in Broca's area, providing prima facie support for the claim that the motor system participates in language perception. In contrast, we found no evidence that action related signs differentially involved the motor system compared to object related signs. These findings are discussed in the context of lesion studies of sign language execution and observation. In this broader context, we conclude that the activation in Broca's area during ASL observation is not causally related to sign language understanding.

Is the Motor System Necessary for Processing Action and Abstract Emotion Words? Evidence from Focal Brain Lesions

Neuroimaging and neuropsychological experiments suggest that modality-preferential cortices, including motor- and somatosensory areas, contribute to the semantic processing of action related concrete words. Still, a possible role of sensorimotor areas in processing abstract meaning remains under debate. Recent fMRI studies indicate an involvement of the left sensorimotor cortex in the processing of abstract-emotional words (e.g., "love") which resembles activation patterns seen for action words. But are the activated areas indeed necessary for processing action-related and abstract words? The current study now investigates word processing in two patients suffering from focal brain lesion in the left frontocentral motor system. A speeded Lexical Decision Task on meticulously matched word groups showed that the recognition of nouns from different semantic categories - related to food, animals, tools, and abstract-emotional concepts - was differentially affected. Whereas patient HS with a lesion in dorsolateral central sensorimotor systems next to the hand area showed a category-specific deficit in recognizing tool words, patient CA suffering from lesion centered in the left supplementary motor area was primarily impaired in abstract-emotional word processing. These results point to a causal role of the motor cortex in the semantic processing of both action-related object concepts and abstract-emotional concepts and therefore suggest that the motor areas previously found active in action-related and abstract word processing can serve a meaning-specific necessary role in word recognition. The category-specific nature of the observed dissociations is difficult to reconcile with the idea that sensorimotor systems are somehow peripheral or 'epiphenomenal' to meaning and concept processing. Rather, our results are consistent with the claim that cognition is grounded in action and perception and based on distributed action perception circuits reaching into modality-preferential cortex.

Premotor Cortex Activation Elicited during Word Comprehension Relies on Access of Specific Action Concepts

The relationship between the lexical-semantic and sensory-motor systems is an important topic in cognitive neuroscience. An important finding indicating that these two systems interact is that reading action verbs activates the motor system of the human brain. Two constraints have been proposed to modulate this activation: the effector information associated with the action concepts and statistical regularities between sublexical features and grammatical classes. Using fMRI, we examined whether these two types of information can activate the motor system in the absence of specific motor-semantic content by manipulating the existence of a sublexical cue, called the hand radical, which strongly indicates the semantic feature "hand-related" and grammatical class "verb." Although hand radical characters referring to specific manual actions evoked stronger activation in the premotor cortex than the control characters, hand radical pseudocharacters did not evoke specific activation within the motor system. These results indicated that activation of the premotor cortex during word reading relies on the access of specific action concepts.

Do we embody second language? Evidence for 'partial' simulation during processing of a second language

The present paper investigates whether the processing of emotion language in the context of a second language (L2) entails motor simulations and whether simulation models extend to negation also for L2. Participants were exposed to sentences in L2 describing emotional expressions while facial muscle activity was continuously measured. Sentences mapped either directly upon the zygomatic muscle (e.g., "I am smiling") or did not (e.g., "I am frowning"), and were presented in the affirmative and negative form. Similarly to studies involving first language (L1), the zygomatic muscle was activated when reading affirmative sentences relevant to the muscle. In contrast, and differently from what previously observed in L1, reading sentences in the negative form ("I am not smiling") did not lead to relaxation/inhibition of the zygomatic muscle. These results extend the simulation models to the comprehension of L2 but they also provide important constraints and contribute to the debate about grounding of the abstract and concrete concepts.

Statistical Learning is Related to Early Literacy-Related Skills

It has been demonstrated that statistical learning, or the ability to use statistical information to learn the structure of one's environment, plays a role in young children's acquisition of linguistic knowledge. Although most research on statistical learning has focused on language acquisition processes, such as the segmentation of words from fluent speech and the learning of syntactic structure, some recent studies have explored the extent to which individual differences in statistical learning are related to literacy-relevant knowledge and skills. The present study extends on this literature by investigating the relations between two measures of statistical learning and multiple measures of skills that are critical to the development of literacy-oral language, vocabulary knowledge, and phonological processing-within a single model. Our sample included a total of 553 typically developing children from prekindergarten through second grade. Structural equation modeling revealed that statistical learning accounted for a unique portion of the variance in these literacy-related skills. Practical implications for instruction and assessment are discussed.

How the brain processes different dimensions of argument structure complexity: evidence from fMRI

Verbs are central to sentence processing, as they encode argument structure (AS) information, i.e., information about the syntax and interpretation of the phrases accompanying them. The behavioral and neural correlates of AS processing have primarily been investigated in sentence-level tasks, requiring both verb processing and verb-argument integration. In the current functional magnetic resonance imaging (fMRI) study, we investigated AS processing using a lexical decision task requiring only verb processing. We examined three aspects of AS complexity: number of thematic roles, number of thematic options, and mapping (non)canonicity (unaccusative vs. unergative and transitive verbs). Increased number of thematic roles elicited greater activation in the left posterior perisylvian regions claimed to support access to stored AS representations. However, the number of thematic options had no neural effects. Further, unaccusative verbs elicited longer response times and increased activation in the left inferior frontal gyrus, reflecting the processing cost of unaccusative verbs and, more generally, supporting the role of the IFG in noncanonical argument mapping.

How do conceptual representations interact with processing demands: An fMRI study on action- and abstract-related words

This fMRI study investigated the functional mechanisms related to mental simulation of abstract- and action-related words and measured the effect of the type of stimulus (Abstract vs. action verbs) and the type of task (imagery vs. control task) to explore how conceptual representations interact with processing demands. A significant task by stimuli interaction showed that action-related words activated the left sensorimotor cortex during explicit imagery (as compared to the control task), whereas abstract-related verbs did not automatically activate this area. Rather, as we made sure that Abstract verbs were not associated with motor states (as tested in a rating study of our stimulus list), imagery elicited by abstract verb processing (as compared to Action verbs, and controlled for letter detection) differentially activated a right hemisphere neural network including the right supramarginal (SMG) gyrus and the precuneus which might be related to mental imagery of emotion-related scenes and not to the semantics of the stimuli per se. Our results confirmed the view that the activation of the sensorimotor cortex during language processing of abstract- and action-related words is strategy-dependent.

Grasping hand verbs: oscillatory beta and alpha correlates of action-word processing

The grounded cognition framework proposes that sensorimotor brain areas, which are typically involved in perception and action, also play a role in linguistic processing. We assessed oscillatory modulation during visual presentation of single verbs and localized cortical motor regions by means of isometric contraction of hand and foot muscles. Analogously to oscillatory activation patterns accompanying voluntary movements, we expected a somatotopically distributed suppression of beta and alpha frequencies in the motor cortex during processing of body-related action verbs. Magnetoencephalographic data were collected during presentation of verbs that express actions performed using the hands (H) or feet (F). Verbs denoting no bodily movement (N) were used as a control. Between 150 and 500 msec after visual word onset, beta rhythms were suppressed in H and F in comparison with N in the left hemisphere. Similarly, alpha oscillations showed left-lateralized power suppression in the H-N contrast, although at a later stage. The cortical oscillatory activity that typically occurs during voluntary movements is therefore found to somatotopically accompany the processing of body-related verbs. The combination of a localizer task with the oscillatory investigation applied to verb reading as in the present study provides further methodological possibilities of tracking language processing in the brain.

Nonmotor aspects of action concepts

Reading an action verb elicits the retrieval of its associated body movements as well as its typical goal-the outcome to which it is directed. Two fMRI experiments are reported in which retrieval of goal attributes was isolated from retrieval of motoric ones by contrasting actions that are either done intentionally (e.g., drink) and thus have associated goal information or by accident (e.g., hiccup). Orthogonally, the actions also varied in their motoricity (e.g., drink vs. imagine). Across both levels of motoricity, goal-directedness influenced the activity of a portion of left posterior inferior parietal lobe (pIPL). These effects were not explicable by the grammatical properties, imageability, or amount of body movement associated with these different types of verbs. In contrast, motoricity (across levels of goal-directedness) activated primarily the left middle temporal gyrus. Furthermore, pIPL was found to be distinct from the portion of left parietal lobe implicated in theory of mind, as localized in the same participants. This is consistent with the observation that pIPL contains many functionally distinct subregions and that some of these support conceptual knowledge. The present findings illustrate that, in particular, the pIPL is involved in representing attributes of intentional actions, likely their typical goals, but not their associated body movements. This result serves to describe an attribute-selective semantic subsystem for at least one type of nonmotor aspect of action knowledge.

Observing, performing, and understanding actions: revisiting the role of cortical motor areas in processing of action words

Language content and action/perception have been shown to activate common brain areas in previous neuroimaging studies. However, it is unclear whether overlapping cortical activation reflects a common neural source or adjacent, but distinct, sources. We address this issue by using multivoxel pattern analysis on fMRI data. Specifically, participants were instructed to engage in five tasks: (1) execute hand actions (AE), (2) observe hand actions (AO), (3) observe nonbiological motion (MO), (4) read action verbs, and (5) read nonaction verbs. A classifier was trained to distinguish between data collected from neural motor areas during (1) AE versus MO and (2) AO versus MO. These two algorithms were then used to test for a distinction between data collected during the reading of action versus nonaction verbs. The results show that the algorithm trained to distinguish between AE and MO distinguishes between word categories using signal recorded from the left parietal cortex and pre-SMA, but not from ventrolateral premotor cortex. In contrast, the algorithm trained to distinguish between AO and MO discriminates between word categories using the activity pattern in the left premotor and left parietal cortex. This shows that the sensitivity of premotor areas to language content is more similar to the process of observing others acting than to acting oneself. Furthermore, those parts of the brain that show comparable neural pattern for action execution and action word comprehension are high-level integrative motor areas rather than low-level motor areas.

Lesion symptom mapping of manipulable object naming in nonfluent aphasia: can a brain be both embodied and disembodied?

Embodied cognition offers an approach to word meaning firmly grounded in action and perception. A strong prediction of embodied cognition is that sensorimotor simulation is a necessary component of lexical-semantic representation. One semantic distinction where motor imagery is likely to play a key role involves the representation of manufactured artefacts. Many questions remain with respect to the scope of embodied cognition. One dominant unresolved issue is the extent to which motor enactment is necessary for representing and generating words with high motor salience. We investigated lesion correlates of manipulable relative to nonmanipulable name generation (e.g., name a school supply; name a mountain range) in patients with nonfluent aphasia (N = 14). Lesion volumes within motor (BA4, where BA = Brodmann area) and premotor (BA6) cortices were not predictive of category discrepancies. Lesion symptom mapping linked impairment for manipulable objects to polymodal convergence zones and to projections of the left, primary visual cortex specialized for motion perception (MT/V5+). Lesions to motor and premotor cortex were not predictive of manipulability impairment. This lesion correlation is incompatible with an embodied perspective premised on necessity of motor cortex for the enactment and subsequent production of motor-related words. These findings instead support a graded or "soft" approach to embodied cognition premised on an ancillary role of modality-specific cortical regions in enriching modality-neutral representations. We discuss a dynamic, hybrid approach to the neurobiology of semantic memory integrating both embodied and disembodied components.

Age-related vulnerability in the neural systems supporting semantic processing

Our ability to form abstract representations of objects in semantic memory is crucial to language and thought. The utility of this information relies both on the representations of sensory-motor feature knowledge stored in long-term memory and the executive processes required to retrieve, manipulate, and evaluate this semantic knowledge in a task-relevant manner. These complementary components of semantic memory can be differentially impacted by aging. We investigated semantic processing in normal aging using functional magnetic resonance imaging (fMRI). Young and older adults were asked to judge whether two printed object names match on a particular feature (for example, whether a tomato and strawberry have the same color). The task thus required both retrieval of relevant visual feature knowledge of object concepts and evaluating this information. Objects were drawn from either natural kinds or manufactured objects, and were queried on either color or shape in a factorial design. Behaviorally, all subjects performed well, but older adults could be divided into those whose performance matched that of young adults (better performers) and those whose performance was worse (poorer performers). All subjects activated several cortical regions while performing this task, including bilateral inferior and lateral temporal cortex and left frontal and prefrontal cortex. Better performing older adults showed increased overall activity in bilateral premotor cortex and left lateral occipital cortex compared to young adults, and increased activity in these brain regions relative to poorer performing older adults who also showed gray matter atrophy in premotor cortex. These findings highlight the contribution of domain-general executive processing brain regions to semantic memory, and illustrate differences in how these regions are recruited in healthy older adults.