Brain mechanisms linking language and action

Fine Motor Skills and Lexical Processing in Children and Adults

Children’s fine motor skills (FMS) link to cognitive development, however, research on their involvement in language processing, also with adults, is scarce. Lexical items are processed differently depending on the degree of sensorimotor information inherent in the words’ meanings, such as whether these imply a body-object interaction (BOI) or a body-part association (i.e., hand, arm, mouth, foot). Accordingly, three studies examined whether lexical processing was affected by FMS, BOIness, and body-part associations in children (study 1, n = 77) and adults (study 2, n = 80; study 3, n = 71). Analyses showed a differential link between FMS and lexical processing as a function of age. Whereas response latencies indicated that children’s FMS were associated with “hand” words, adults’ FMS linked to the broader concept of BOI. Findings have implications for shared activation theories positing that FMS support lexical processing.

Intangible features extraction in the processing of abstract concepts: Evidence from picture-word priming

Over the last decade, hypotheses ranging from linguistic symbol processing to embodiment have been formulated to account for the content and mechanisms responsible for the representation of abstract concepts. Results of recent studies have suggested that abstract concepts, just like concrete ones, can benefit from knowledge of real-world situational context, but that they can also be processed based on abstract pictures devoid of such situational features. This paper presents two semantic priming experiments to explore such mechanisms further. The first experiment replicates Kuipers, Jones, and Thierry (2018) in a cross-linguistic setting which shows that abstract concepts can be processed from abstract pictures devoid of tangible features. In the second experiment, we studied extraction mechanisms that come into play when participants are presented with abstract and concrete pictures that provide situational information to illustrate target abstract concepts. We expected this facilitatory effect to be limited to concrete picture primes. Our data analysed with both Bayesian and Frequentist tests showed however that even when presented with tangible situational information, the extraction of features still occurred for abstract pictures. We discuss the implications of this with respect to future avenues for studying the processing of abstract concepts.

Motor processing modulates word comprehension

We evaluated whether movement modulates the semantic processing of words. To this end, we used homograph words with two meanings, one associated with hand movements (e.g., 'abanico', 'fan' in Spanish) or foot movements ('bota', 'boot' in Spanish), and the other not associated with movement ('abanico', 'range' in Spanish; 'bota', 'wineskin' in Spanish). After the homograph, three words were presented, and participants were asked to choose the word related to one of the two homograph meanings. The words could be either related to the motor meaning of the homograph ('fan-heat'), to the non-motor meaning of the homograph ('range-possibility') or unrelated ('fan-phone'). The task was performed without movement (simple condition) or by performing hand (Experiment 1) and foot (Experiment 2) movements. Compared with the simple condition, the performance of movement oriented the preference towards the motor meaning of the homograph. This pattern of results confirms that movement modulates word comprehension.

Spatial and Motor Aspects in the "Action-Sentence Compatibility Effect"

The Action-sentence Compatibility Effect (ACE) is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal "simulation," i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to disentangle spatial and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility (i.e., differences in reaction times simultaneously coming from block order and opposite motion conditions). Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants' awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed.

The extreme capsule and aphasia: proof-of-concept of a new way relating structure to neurological symptoms

We present anatomy-based symptom-lesion mapping to assess the association between lesions of tracts in the extreme capsule and aphasia. The study cohort consisted of 123 patients with acute left-hemispheric stroke without a lesion of language-related cortical areas of the Stanford atlas of functional regions of interest. On templates generated through global fibre tractography, lesions of the extreme capsule and of the arcuate fascicle were quantified and correlated with the occurrence of aphasia (n = 18) as defined by the Token Test. More than 15% damage of the slice plane through the extreme capsule was a strong independent predictor of aphasia in stroke patients, odds ratio 16.37, 95% confidence interval: 3.11–86.16, P < 0.01. In contrast, stroke lesions of >15% in the arcuate fascicle were not associated with aphasia. Our results support the relevance of a ventral pathway in the language network running through the extreme capsule.

Does embodied cognition allow a better management of neurological diseases? A review on the link between cognitive language processing and motor function

Embodied cognition (EC) refers to the interplay occurring in thinking among individual's sensorimotor capacities (i.e., the ability of the body to respond to its senses with movement), the body itself, and the environment. The aim of the present narrative review is to provide an overall understanding of whether and how motor training could lead to language recovery, consistently with EC theories (action-perception cycle, mirror neuron systems -MNS-, and embodied semantics). We therefore reviewed the works dealing with EC in terms of the link between language processing, mirror neuron system (MNS), and motor function, evaluating the potential clinical implications for better managing neurological deficits. Connections between body and mind were found, as body states influence cognitive functions, such as perception and reasoning, as well as language processing, especially in neurological disorders. In fact, abnormalities in "embodied language" were found in movement disorders and neurodegenerative diseases, negatively affecting patients' rehabilitation outcomes. Understanding the link between language processing and motor outcomes is fundamental in the rehabilitation field, given that EC can be targeted to improve patients' functional recovery and quality of life.

White-Matter Neuroanatomical Predictors of Aphasic Verb Retrieval

Background: Current neurocognitive models of language function have been primarily built from evidence regarding object naming, and their hypothesized white-matter circuit mechanisms tend to be coarse grained. Methods: In this cross-sectional, observational study, we used novel correlational tractography to assess the white-matter circuit mechanism behind verb retrieval, measured through action picture-naming performance in adults with chronic aphasia. Results: The analysis identified tracts implicated in current neurocognitive dual-stream models of language function, including the left inferior fronto-occipital fasciculus, inferior longitudinal fasciculus, and arcuate fasciculus. However, the majority of tracts associated with verb retrieval were not ones included in dual-stream models of language function. Instead, they were projection pathways that connect frontal and parietal cortices to subcortical regions associated with motor functions, including the left corticothalamic pathway, frontopontine tract, parietopontine tract, corticostriatal pathway, and corticospinal tract. Conclusions: These results highlight that corticosubcortical projection pathways implicated in motor functions may be importantly related to language function. This finding is consistent with grounded accounts of cognition and may furthermore inform neurocognitive models. Impact statement This study suggests that in addition to traditional dual-stream language fiber tracts, the integrity of projection pathways that connect frontal and parietal cortices to subcortical motor regions may be critically associated with verb-retrieval impairments in adults with aphasia. This finding challenges neurological models of language function.

Language impairment in progressive supranuclear palsy and corticobasal syndrome

Although commonly known as movement disorders, progressive supranuclear palsy (PSP) and corticobasal syndrome (CBS) may present with changes in speech and language alongside or even before motor symptoms. The differential diagnosis of these two disorders can be challenging, especially in the early stages. Here we review their impact on speech and language. We discuss the neurobiological and clinical-phenomenological overlap of PSP and CBS with each other, and with other disorders including non-fluent agrammatic primary progressive aphasia and primary progressive apraxia of speech. Because language impairment is often an early and persistent problem in CBS and PSP, there is a need for improved methods for language screening in primary and secondary care, and more detailed language assessments in tertiary healthcare settings. Improved language assessment may aid differential diagnosis as well as inform clinical management decisions.

Increased links between language and motor areas: A proof-of-concept study on resting-state functional connectivity following Personalized Observation, Execution and Mental imagery therapy in chronic aphasia

A tight coupling of language and motor processes has been established, which is consistent with embodied cognition theory. However, very few therapies have been designed to exploit the synergy between motor and language processes to help rehabilitate people with aphasia (PWA). Moreover, the underlying mechanisms supporting the efficacy of such approaches remain unknown. Previous work in our laboratory has demonstrated that personalized observation, execution, and mental imagery therapy (POEM)-a new therapy using three sensorimotor strategies to trigger action verb naming-leads to significant improvements in verb retrieval in PWA. Moreover, these improvements were supported by significant activations in language and sensorimotor processing areas, which further reinforce the role of both processes in language recovery (Durand et al., 2018). The present study investigates resting state functional connectivity (rsFC) changes following POEM in a pre-/post-POEM therapy design. A whole brain network functional connectivity approach was used to assess and describe changes in rsFC in a group of four PWA, who were matched and compared with four healthy controls (HC). Results showed increased rsFC in PWA within and between visuo-motor and language areas (right cuneal cortex-left supracalcarin (SCC) cortex/right precentral gyrus (PreCG)-left lingual gyrus (LG)) and between areas involved in action processing (right anterior parahippocampal gyrus (aPaHC)-left superior parietal lobule (SPL). In comparison to HC, the PWA group showed increased rsFC between the right inferior frontal gyrus (IFG) and left thalamus, which are areas involved in lexico-semantic processing. This proof-of-concept study suggests that the sensorimotor and language strategies used in POEM may induce modifications in large-scale networks, probably derived from the integration of visual and sensorimotor systems to sustain action naming, which is consistent with the embodied cognition theory.

Modality-specific dysfunctional neural processing of social-abstract and non-social-concrete information in schizophrenia

Schizophrenia is characterized by marked communication dysfunctions encompassing potential impairments in the processing of social-abstract and non-social-concrete information, especially in everyday situations where multiple modalities are present in the form of speech and gesture. To date, the neurobiological basis of these deficits remains elusive. In a functional magnetic resonance imaging (fMRI) study, 17 patients with schizophrenia or schizoaffective disorder, and 18 matched controls watched videos of an actor speaking, gesturing (unimodal), and both speaking and gesturing (bimodal) about social or non-social events in a naturalistic way. Participants were asked to judge whether each video contains person-related (social) or object-related (non-social) information. When processing social-abstract content, patients showed reduced activation in the medial prefrontal cortex (mPFC) only in the gesture but not in the speech condition. For non-social-concrete content, remarkably, reduced neural activation for patients in the left postcentral gyrus and the right insula was observed only in the speech condition. Moreover, in the bimodal conditions, patients displayed improved task performance and comparable activation to controls in both social and non-social content. To conclude, patients with schizophrenia displayed modality-specific aberrant neural processing of social and non-social information, which is not present for the bimodal conditions. This finding provides novel insights into dysfunctional multimodal communication in schizophrenia, and may have potential therapeutic implications.

Investigation of Embodied Language Processing on Command-Swallow Performance in Healthy Participants

Purpose During videofluoroscopic examination of swallowing, patients commonly are instructed to hold a bolus in their mouth until they hear a verbal instruction to swallow, which usually consists of the word swallow and is commonly referred to as the command swallow condition. The language-induced motor facilitation theory suggests that linguistic processes associated with the verbal command to swallow should facilitate the voluntary component of swallowing. As such, the purpose of the study was to examine the linguistic influences of the verbal command on swallowing. Method Twenty healthy young adult participants held a 5-ml liquid bolus in their mouth and swallowed the bolus after hearing one of five acoustic stimuli presented randomly: congruent action word (swallow), incongruent action word (cough), congruent pseudoword (spallow), incongruent pseudoword (pough), and nonverbal stimulus (1000-Hz pure tone). Suprahyoid muscle activity during swallowing was measured via surface electromyography (sEMG). Results The onset and peak sEMG latencies following the congruent action word swallow were shorter than latencies following the pure tone and pseudowords but were not different from the incongruent action word. The lack of difference between swallow and cough did not negate the positive impact of real words on timing. In contrast to expectations, sEMG activity duration and rise time were longer following the word swallow than the pure tone and pseudowords but were not different from cough. No differences were observed for peak suprahyoid muscle activity amplitude and fall times. Conclusions Language facilitation was observed in swallowing. The clinical utility of the information obtained in the study may depend on the purposes for using the command swallow and the type of patient being assessed. However, linguistic processing under the command swallow condition may alter swallow behaviors and suggests that linguistic inducement could be useful as a compensatory technique for patients with difficulty initiating oropharyngeal swallows.

Towards Strong Inference in Research on Embodiment - Possibilities and Limitations of Causal Paradigms

A central question in the cognitive sciences is which role embodiment plays for high-level cognitive functions, such as conceptual processing. Here, we propose that one reason why progress regarding this question has been slow is a lacking focus on what Platt (1964) called “strong inference”. Strong inference is possible when results from an experimental paradigm are not merely consistent with a hypothesis, but they provide decisive evidence for one particular hypothesis compared to competing hypotheses. We discuss how causal paradigms, which test the functional relevance of sensory-motor processes for high-level cognitive functions, can move the field forward. In particular, we explore how congenital sensory-motor disorders, acquired sensory-motor deficits, and interference paradigms with healthy participants can be utilized as an opportunity to better understand the role of sensory experience in conceptual processing. Whereas all three approaches can bring about valuable insights, we highlight that the study of congenitally and acquired sensorimotor disorders is particularly effective in the case of conceptual domains with strong unimodal basis (e.g., colors), whereas interference paradigms with healthy participants have a broader application, avoid many of the practical and interpretational limitations of patient studies, and allow a systematic and step-wise progressive inference approach to causal mechanisms.

Images of the unseen: extrapolating visual representations for abstract and concrete words in a data-driven computational model

Theories of grounded cognition assume that conceptual representations are grounded in sensorimotor experience. However, abstract concepts such as jealousy or childhood have no directly associated referents with which such sensorimotor experience can be made; therefore, the grounding of abstract concepts has long been a topic of debate. Here, we propose (a) that systematic relations exist between semantic representations learned from language on the one hand and perceptual experience on the other hand, (b) that these relations can be learned in a bottom-up fashion, and (c) that it is possible to extrapolate from this learning experience to predict expected perceptual representations for words even where direct experience is missing. To test this, we implement a data-driven computational model that is trained to map language-based representations (obtained from text corpora, representing language experience) onto vision-based representations (obtained from an image database, representing perceptual experience), and apply its mapping function onto language-based representations for abstract and concrete words outside the training set. In three experiments, we present participants with these words, accompanied by two images: the image predicted by the model and a random control image. Results show that participants' judgements were in line with model predictions even for the most abstract words. This preference was stronger for more concrete items and decreased for the more abstract ones. Taken together, our findings have substantial implications in support of the grounding of abstract words, suggesting that we can tap into our previous experience to create possible visual representation we don't have.

Exploring the Co-occurrence of Manual Verbs and Actions in Early Mother-Child Communication

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines (free play, bathing, and dining) when children were 1 to 2 (Group 1) and 2 to 3 (Group 2) years old. Eight mother-child dyads were video-recorded in 3-month intervals across 12 months (27 recording hours), and the timing of verbs and manual actions (21,876 entries) were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher (0.80 and 0.77) than that of random co-occurrences (0.13 and 0.15) for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals (8% of the cases) and the shortest +5 s interval (40% of the cases). Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used (74%) those verbs they shared with their children's repertoire (31%). In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment.

Resting-state network dysconnectivity in ADHD: A system-neuroscience-based meta-analysis

OBJECTIVES

Neuroimaging studies report altered resting-state functional connectivity in attention deficit/hyperactivity disorder (ADHD) across multiple brain systems. However, there is inconsistency among individual studies.

METHODS

We meta-analyzed seed-based resting state studies of ADHD connectivity within and between four established resting state brain networks (default mode, cognitive control, salience, affective/motivational) using Multilevel Kernel Density Analysis method.

RESULTS

Twenty studies with 944 ADHD patients and 1121 controls were included in the analysis. Compared to controls, ADHD was associated with disrupted within-default mode network (DMN) connectivity - reduced in the core (i.e. posterior cingulate cortex seed) but elevated in the dorsal medial prefrontal cortex sub-system (i.e. temporal pole-inferior frontal gyrus). Connectivity was elevated between nodes in the cognitive control system. When the analysis was restricted to children and adolescents, additional reduced connectivity was detected between DMN and cognitive control and affective/motivational and salience networks.

CONCLUSIONS

Our data are consistent with the hypothesis that paediatric ADHD is a DMN-dysconnectivity disorder with reduced connectivity both within the core DMN sub-system and between that system and a broad set of nodes in systems involved in cognition and motivation.

A Sound Explanation for Motor Cortex Engagement during Action Word Comprehension

Comprehending action words often engages similar brain regions to those involved in perceiving and executing actions. This finding has been interpreted as support for grounding of conceptual processing in motor representations or that conceptual processing involves motor simulation. However, such demonstrations cannot confirm the nature of the mechanism(s) responsible, as word comprehension involves multiple processes (e.g., lexical, semantic, morphological, phonological). In this study, we tested whether this motor cortex engagement instead reflects processing of statistical regularities in sublexical phonological features. Specifically, we measured brain activity in healthy participants using functional magnetic resonance imaging while they performed an auditory lexical decision paradigm involving monosyllabic action words associated with specific effectors (face, arm, and leg). We show that nonwords matched to the action words in terms of their phonotactic probability elicit common patterns of activation. In addition, we show that a measure of the action words' phonological typicality, the extent to which a word's phonology is typical of other words in the grammatical category to which it belongs (i.e., more or less verb-like), is responsible for their activating a significant portion of primary and premotor cortices. These results indicate motor cortex engagement during action word comprehension is more likely to reflect processing of statistical regularities in sublexical phonological features than conceptual processing. We discuss the implications for current neurobiological models of language, all of which implicitly or explicitly assume that the relationship between the sound of a word and its meaning is arbitrary.

Absence of post-learning motor activity effects on memory for motor-related words

Drawing a hypothesis from embodied theories of memory, van Dam, Rueschemeyer, Bekkering and Lindemann [(2013). Embodied grounding of memory: Toward the effects of motor execution on memory consolidation. The Quarterly Journal of Experimental Psychology, 66(12), 2310-2328] showed that recognition performance for action words could be modulated by actions performed during the retention interval, suggesting that motor actions during the retention interval affect memory consolidation. The results of 4 experiments from two different laboratories, designed to replicate and extend the van Dam et al. motor consolidation effect, are presented here. Two of the experiments (n = 30 and n = 44) exactly and independently replicated the experimental design and conditions of the original experiment. Yes/No recognition scores plus additional analysis of response times showed no motor consolidation effects. A third experiment (n = 44) manipulating type of processing during encoding also failed to find significant motor consolidation effects. Finally, a fourth experiment (n = 120) following a more standard reconsolidation paradigm, involving 24-hour intervals between learning and motor behaviour, and a 24-hour delayed test, also found null effects. The absence of effects of motor execution on memory consolidation is discussed in terms of the implications of these findings for the embodiment approach to cognition.

Influences of task and attention on action verb congruence effects: How automatic are embodiment effects?

Three experiments investigated changes in the sizes of Stroop-like congruency effects of hand- and foot-related action verbs on the latencies of hand and foot motor responses. Congruency effects were present in all experiments, with faster responses for a verb associated with the responding limb than for a verb associated with the opposite limb (e.g., faster foot than hand responses in the presence of the verb "kick"). As compared with a task in which the verbs were completely irrelevant, this congruency effect was greatly increased when participants had to make lexical decisions about the verbs, and the effect was also increased-although to a lesser extent-when participants had to make physical (i.e., size) judgments about them. In some cases, the congruence effect was also larger when the hand/foot discrimination response was determined by a reading task than by a color discrimination task. We conclude that the Stroop-like congruence effects of action verbs do not result from fully automatic processing but instead depend on at least the duration and linguistic nature of verb processing.

Action fluency identifies different sex, age, global cognition, executive function and brain activation profile in non-demented patients with Parkinson's disease

Patients with Parkinson's disease (PD) have difficulties processing action words, which could be related to early cognitive decline. The action fluency test can be used to quickly and easily assess the processing of action words in PD. The goal of this study was to characterize how the action fluency test relates to personal characteristics, disease factors, cognition, and neural activity in PD. Forty-eight participants with PD (34 male, 14 female) and 35 control participants (16 male, 19 female) completed functional neuroimaging using a set-shifting task and a neuropsychological assessment including the action fluency test. PD participants with a score one standard deviation below the norm or lower on the action fluency test were identified. All PD participants with poor performance (PD-P, n = 15) were male. They were compared to male PD participants with scores within the normal range (PD-N, n = 19) and male healthy controls (HC, n = 16). PD-P were older, had lower global cognition scores, lower executive functions scores, and decreased activity in fronto-temporal regions compared with PD-N. There was no difference between the two PD groups in terms of the duration of the disease, dose of dopaminergic medication, and severity of motor symptoms. PD-N were younger than HC, but there was no other significant difference between these groups. The action fluency test identified a subgroup of PD patients with distinct sex, age, global cognition, executive functions, and brain activity characteristics. Implications for the evaluation of cognition are discussed.

Why Language Processing Recruits Modality Specific Brain Regions: It Is Not About Understanding Words, but About Modelling Situations

Whether language comprehension requires the participation of brain structures that evolved for perception and action has been a subject of intense debate. While brain-imaging evidence for the involvement of such modality-specific regions has grown, the fact that lesions to these structures do not necessarily erase word knowledge has invited the conclusion that language-induced activity in these structures might not be essential for word recognition. Why language processing recruits these structures remains unanswered, however. Here, we examine the original findings from a slightly different perspective. We first consider the 'original' function of structures in modality-specific brain regions that are recruited by language activity. We propose that these structures help elaborate 'internal forward models' in motor control (c.f. emulators). Emulators are brain systems that capture the relationship between an action and its sensory consequences. During language processing emulators could thus allow accessing associative memories. We further postulate the existence of a linguistic system that exploits, in a rule-based manner, emulators and other nonlinguistic brain systems, to gain complementary (and redundant) information during language processing. Emulators are therefore just one of several sources of information. We emphasize that whether a given word-form triggers activity in modality-specific brain regions depends on the linguistic context and not on the word-form as such. The role of modality-specific systems in language processing is thus not to help understanding words but to model the verbally depicted situation by supplying memorized context information. We present a model derived from these assumptions and provide predictions and perspectives for future research.

Challenges and Opportunities for Grounding Cognition

According to the grounded perspective, cognition emerges from the interaction of classic cognitive processes with the modalities, the body, and the environment. Rather than being an autonomous impenetrable module, cognition incorporates these other domains intrinsically into its operation. The Situated Action Cycle offers one way of understanding how the modalities, the body, and the environment become integrated to ground cognition. Seven challenges and opportunities are raised for this perspective: (1) How does cognition emerge from the Situated Action Cycle and in turn support it? (2) How can we move beyond simply equating embodiment with action, additionally establishing how embodiment arises in the autonomic, neuroendocrine, immune, cardiovascular, respiratory, digestive, and integumentary systems? (3) How can we better understand the mechanisms underlying multimodal simulation, its functions across the Situated Action Cycle, and its integration with other representational systems? (4) How can we develop and assess theoretical accounts of symbolic processing from the grounded perspective (perhaps using the construct of simulators)? (5) How can we move beyond the simplistic distinction between concrete and abstract concepts, instead addressing how concepts about the external and internal worlds pattern to support the Situated Action Cycle? (6) How do individual differences emerge from different populations of situational memories as the Situated Action Cycle manifests itself differently across individuals? (7) How can constructs from grounded cognition provide insight into the replication and generalization crises, perhaps from a quantum perspective on mechanisms (as exemplified by simulators).

Lexical processing in sign language: A visual mismatch negativity study

Event-related potential studies of spoken and written language show the automatic access of auditory and visual words, as indexed by mismatch negativity (MMN) or visual MMN (vMMN). The present study examined whether the same automatic lexical processing occurs in a visual-gestural language, i.e., Hong Kong Sign Language (HKSL). Using a classic visual oddball paradigm, deaf signers and hearing non-signers were presented with a sequence of static images representing HKSL lexical signs and non-signs. When compared with hearing non-signers, deaf signers exhibited an enhanced vMMN elicited by the lexical signs at around 230 ms, and a larger P1-N170 complex evoked by both lexical sign and non-sign standards at the parieto-occipital area in the early time window between 65 ms and 170 ms. These findings indicate that deaf signers implicitly process the lexical sign and that neural response differences between deaf signers and hearing non-signers occur at the early stage of sign processing.

From discourse to pathology: Automatic identification of Parkinson's disease patients via morphological measures across three languages

Embodied cognition research on Parkinson's disease (PD) points to disruptions of frontostriatal language functions as sensitive targets for clinical assessment. However, no existing approach has been tested for crosslinguistic validity, let alone by combining naturalistic tasks with machine-learning tools. To address these issues, we conducted the first classifier-based examination of morphological processing (a core frontostriatal function) in spontaneous monologues from PD patients across three typologically different languages. The study comprised 330 participants, encompassing speakers of Spanish (61 patients, 57 matched controls), German (88 patients, 88 matched controls), and Czech (20 patients, 16 matched controls). All subjects described the activities they perform during a regular day, and their monologues were automatically coded via morphological tagging, a computerized method that labels each word with a part-of-speech tag (e.g., noun, verb) and specific morphological tags (e.g., person, gender, number, tense). The ensuing data were subjected to machine-learning analyses to assess whether differential morphological patterns could classify between patients and controls and reflect the former's degree of motor impairment. Results showed robust classification rates, with over 80% of patients being discriminated from controls in each language separately. Moreover, the most discriminative morphological features were associated with the patients' motor compromise (as indicated by Pearson r correlations between predicted and collected motor impairment scores that ranged from moderate to moderate-to-strong across languages). Taken together, our results suggest that morphological patterning, an embodied frontostriatal domain, may be distinctively affected in PD across languages and even under ecological testing conditions.

An Electrophysiological Abstractness Effect for Metaphorical Meaning Making

Neuroimaging studies show that metaphors activate sensorimotor areas. These findings were interpreted as metaphors contributing to conceptual thought by mapping concrete, somatosensory information onto abstract ideas. But is sensorimotor information a necessary constituent of figurative meaning? The present study employed event-related potentials (ERPs) in a divided visual field paradigm with healthy adults to explore the role of sensorimotor feature processing in the comprehension of novel metaphors via the electrophysiological concreteness effect. Participants read French, novel adjective-noun expressions that were either metaphorical (“fat sentence”) or literal (“fat hip”). While literal expressions evoked a typical concreteness effect, an enhanced frontal negativity during right hemisphere (RH) as opposed to left hemisphere (LH) presentation, metaphors showed no such sign of sensorimotor feature processing. Relative to literals, they evoked a sustained frontal negativity during LH presentation and similar amplitudes during RH presentation, but both of these effects were the greater the more abstract the metaphors were. It is the first time such an electrophysiological abstractness effect is reported, just the opposite of a concreteness effect. It is particularly noteworthy that ERPs evoked by metaphors were not contingent on figurativeness, novelty, meaningfulness, imageability, emotional valence, or arousal, only on abstractness. When compared with similarly novel literal expressions, metaphors did not evoke a typical N400 and did not activate the RH either. The findings shed new light on the neurocognitive machinery of figurative meaning construction, pervasive in everyday communication. Contrary to embodied cognition, the conceptual system might be organized around abstract representations and not sensorimotor information, even for lush, metaphorical language.

Sensory Perception in Blind Bilinguals and Monolinguals

In blinds, the tactile sensations play a crucial role for various daily activities, in the all sense modalities tactile sensation is considered as major sense of perception. This study is conducted to investigate the tactile sensations in relation to Bilingual and Monolingual blinds using experimental comparative study design, divided into two groups. Self-paced reading task of a Braille scripted passage was used as a stimulus. Findings of this study reported that blind bilingual participants differ in the processing of language, the tactile sensations in the Bilinguals are better as compared to monolinguals.

Emotional Voice Intonation: A Communication Code at the Origins of Speech Processing and Word-Meaning Associations?

The aim of the present work is to investigate the facilitating effect of vocal emotional intonation on the evolution of the following processes involved in language: (a) identifying and producing phonemes, (b) processing compositional rules underlying vocal utterances, and (c) associating vocal utterances with meanings. To this end, firstly, I examine research on the presence of these abilities in animals, and the biologically ancient nature of emotional vocalizations. Secondly, I review research attesting to the facilitating effect of emotional voice intonation on these abilities in humans. Thirdly, building on these studies in animals and humans, and through taking an evolutionary perspective, I provide insights for future empirical work on the facilitating effect of emotional intonation on these three processes in animals and preverbal humans. In this work, I highlight the importance of a comparative approach to investigate language evolution empirically. This review supports Darwin’s hypothesis, according to which the ability to express emotions through voice modulation was a key step in the evolution of spoken language.

How words ripple through bilingual hands: Motor-language coupling during L1 and L2 writing

The speed of our hand movements can be affected by concurrent processing of manual action verbs (MaVs). Whereas this phenomenon is well established for native languages (L1s), it remains underexplored in late foreign languages (L2s), especially during highly automatized tasks. Here we timed keystroke activity while Spanish-English bilinguals copied MaVs, non-manual action verbs, and non-action verbs in their L1 and L2. Motor planning and execution dynamics were indexed by first-letter lag (the time-lapse between word presentation and first keystroke) and whole-word lag (the time-lapse between first and last keystroke), respectively. Despite yielding no effects on motor planning, MaVs facilitated typing execution in L1 but delayed it in L2, irrespective of the subjects' typing skills, age of L2 learning, and L2 competence. Therefore, motor-language coupling effects seem to be present in both languages though they can arise differently in each. These results extend language grounding models, illuminating the role of embodied mechanisms throughout life.

How Abstract (Non-embodied) Linguistic Representations Augment Cognitive Control

Recent scholarship emphasizes the scaffolding role of language for cognition. Language, it is claimed, is a cognition-enhancing niche (Clark, 2006), a programming tool for cognition (Lupyan and Bergen, 2016), even neuroenhancement (Dove, 2019) and augments cognitive functions such as memory, categorization, cognitive control, and meta-cognitive abilities ("thinking about thinking"). Yet, the notion that language enhances or augments cognition, and in particular, cognitive control does not easily fit in with embodied approaches to language processing, or so we will argue. Accounts aiming to explain how language enhances various cognitive functions often employ a notion of abstract representation. Yet, embodied approaches to language processing have it that language processing crucially, according to some accounts even exclusively, involves embodied, modality-specific, i.e., non-abstract representations. In coming to understand a particular phrase or sentence, a prior experience has to be simulated or reenacted. The representation thus activated is embodied (modality-specific) as sensorimotor regions of the brain are thereby recruited. In this paper, we will first discuss the notion of representation, clarify what it takes for a representation to be embodied or abstract, and distinguish between conceptual and (other) linguistic representations. We will then put forward a characterization of cognitive control and examine its representational infrastructure. The remainder of the paper will be devoted to arguing that language augments cognitive control. To that end, we will draw on two lines of research, which investigate how language augments cognitive control: (i) research on the availability of linguistic labels and (ii) research on the active usage of a linguistic code, specifically, in inner speech. Eventually, we will argue that the cognition-enhancing capacity of language can be explained once we assume that it provides us with (a) abstract, non-embodied representations and with (b) abstract, sparse linguistic representations that may serve as easy-to-manipulate placeholders for fully embodied or otherwise more detailed representations.

On the Boundaries between Decision and Action: Effector-selective Lateralization of Beta-frequency Power Is Modulated by the Lexical Frequency of Printed Words

Current computational and neuroscientific models of decision-making posit a discrete, serial processing distinction between upstream decisional stages and downstream processes of motor-response implementation. We investigated this framework in the context of two-alternative forced-choice tasks on linguistic stimuli, words and pseudowords. In two experiments, we assessed the impact of lexical frequency and action semantics on two effector-selective EEG indexes of motor-response activation: the lateralized readiness potential and the lateralization of beta-frequency power. This allowed us to track potentially continuous streams of processing progressively mapping the evaluation of linguistic stimuli onto corresponding response channels. Whereas action semantics showed no influence on EEG indexes of motor-response activation, lexical frequency affected the lateralization of response-locked beta-frequency power. We argue that these observations point toward a continuity between linguistic processing of word input stimuli and implementation of corresponding choice in terms of motor behavior. This interpretation challenges the commonly held assumption of a discrete processing distinction between decisional and motor-response processes in the context of decisions based on symbolic stimuli.

Positive effects of grasping virtual objects on memory for novel words in a second language

Theories of embodied cognition describe language processing and representation as inherently connected to the sensorimotor experiences collected during acquisition. While children grasp their world, collect bodily experiences and name them, in second language (L2), students learn bilingual word lists. Experimental evidence shows that embodiment by mean of gestures enhances memory for words in L2. However, no study has been conducted on the effects of grasping in L2. In a virtual scenario, we trained 46 participants on 18 two- and three-syllabic words of Vimmi, an artificial corpus created for experimental purposes. The words were assigned concrete meanings of graspable objects. Six words were learned audio-visually, by reading the words projected on the wall and by hearing them. Another 6 words were trained by observation of virtual objects. Another 6 words were learned by observation and additional grasping the virtual objects. Thereafter participants were subministered free, cued recall, and reaction time tests in order to assess the word retention and the word recognition. After 30 days, the recall tests were repeated remotely to assess the memory in the long term. The results show that grasping of virtual objects can lead to superior memory performance and to lower reaction times during recognition.

The link between language and action in aging

OBJECTIVE

Many studies have demonstrated the existence of a link between action verb processing and action. However, little is known about the changes in this relationship with aging.

METHOD

To assess this point, we compare the performances of younger and older people during a priming task consisting of judging whether an image contains a human after listening to an action verb.

RESULTS

In accordance with previous literature, the results showed that younger people were faster to detect the presence of a human in the image in congruent conditions, namely, when the action verb and the image refer to the same action. However, this effect was not present in older adults' participants.

CONCLUSION

These findings suggest that the link between action and language decreases with age. We discuss these findings in the context of the embodied view of cognition.

QSAR without borders

Prediction of chemical bioactivity and physical properties has been one of the most important applications of statistical and more recently, machine learning and artificial intelligence methods in chemical sciences. This field of research, broadly known as quantitative structure-activity relationships (QSAR) modeling, has developed many important algorithms and has found a broad range of applications in physical organic and medicinal chemistry in the past 55+ years. This Perspective summarizes recent technological advances in QSAR modeling but it also highlights the applicability of algorithms, modeling methods, and validation practices developed in QSAR to a wide range of research areas outside of traditional QSAR boundaries including synthesis planning, nanotechnology, materials science, biomaterials, and clinical informatics. As modern research methods generate rapidly increasing amounts of data, the knowledge of robust data-driven modelling methods professed within the QSAR field can become essential for scientists working both within and outside of chemical research. We hope that this contribution highlighting the generalizable components of QSAR modeling will serve to address this challenge.

Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing

Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual-motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks-lexical decision, sound judgment, and action judgment-on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual-motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.

Attributed social context and emotional content recruit frontal and limbic brain regions during virtual feedback processing

In communication, who is communicating can be just as important as what is said. However, sender identity in virtual communication is often inferred rather than perceived. Therefore, the present research investigates the brain structures activated by sender identity attributions and evaluative feedback processing during virtual communication. In a functional magnetic resonance imaging (fMRI) study, 32 participants were told that they would receive personality feedback, either sent from another human participant or from a randomly acting computer. In reality, both conditions contained random but counterbalanced feedback, automatically delivered by approving or denying negative, neutral, or positive adjectives. Although physically identical, feedback attributed to the "human" sender activated multiple regions within a "social brain" network, including the superior frontal, medial prefrontal, and orbitofrontal cortex, anterior and posterior parts of the cingulate cortex, and the bilateral insula. Regardless of attributed sender, positive feedback increased responses in the striatum and bilateral amygdalae, while negative compared to neutral feedback elicited stronger insula and somatosensory responses. These results reveal the recruitment of an extensive mentalizing and social brain network by mere sender attributions and the activation of brain structures related to reward and punishment by verbal feedback, demonstrating its embodied processing.

Feeling better: Tactile verbs speed up tactile detection

Embodiment of action-related language into the motor system has been extensively documented. Yet the case of sensory words, especially referring to touch, remains overlooked. We investigated the influence of verbs denoting tactile sensations on tactile perception. In Experiment 1, participants detected tactile stimulations on their forearm, preceded by tactile or non-tactile verbs by one of three delays (170, 350, 500 ms) reflecting different word processing stages. Results revealed shorter reaction times to tactile stimulations following tactile than non-tactile verbs, irrespective of delay. To ensure that priming pertained to tactile, and not motor, verb properties, Experiment 2 compared the impact of tactile verbs to both action and non-tactile verbs, while stimulations were delivered on the index finger. No priming emerged following action verbs, therefore not supporting the motor-grounded interpretation. Facilitation by tactile verbs was however not observed, possibly owing to methodological changes. Experiment 3, identical to Experiment 2 except that stimulation was delivered to participants' forearm, replicated the priming effect. Importantly, tactile stimulations were detected faster after tactile than after both non-tactile and action verbs, indicating that verbs' tactile properties engaged resources shared with sensory perception. Our findings suggest that language conveying tactile information can activate somatosensory representations and subsequently promote tactile detection.

Auditory cortex sensitivity to the loudness attribute of verbs

The auditory cortex was shown to be activated during the processing of words describing actions with acoustic features. The present study further examines whether processing visually presented action words characterized by different levels of loudness, i.e. "loud" (to shout) and "quiet" actions (to whisper), differentially engage the auditory cortex. Twenty healthy participants were measured with magnetoencephalography (MEG) while reading inflected verbs followed by a short tone and semantic tasks. Based on the results of a localizer task, loudness sensitive temporal Brodmann areas A22, A41/42, and pSTS were inspected in the word paradigm. "Loud" actions induced significantly stronger beta power suppression compared to "quiet" actions in the left hemisphere. Smaller N100m amplitude related to tones following "loud" compared to "quiet" actions confirmed that auditory cortex sensitivity was modulated by action words. Results point to possible selective auditory simulation mechanisms involved in verb processing and support embodiment theories.

The Nonverbal Processing of Actions Is an Area of Relative Strength in the Semantic Variant of Primary Progressive Aphasia

Purpose Better performance for actions compared to objects has been reported in the semantic variant of primary progressive aphasia (svPPA). This study investigated the influence of the assessment task (naming, semantic picture matching) over the dissociation between objects and actions. Method Ten individuals with svPPA and 17 matched controls completed object and action naming tests, and object and action semantic picture matching tests. Performance was compared between the svPPA and control groups, within the svPPA group, and for each participant with svPPA versus the control group individually. Results Compared to controls, participants with svPPA were impaired on object and action naming, and object and action semantic picture matching. As a group, participants with svPPA had an advantage for actions over objects and for semantic picture matching tests over naming tests. Eight participants had a better performance for actions compared to objects in naming, with three showing a significant difference. Nine participants had a better performance for actions compared to objects in semantic picture matching, with six showing a significant difference. For objects, semantic picture matching was better than naming in nine participants, with five showing a significant difference. For actions, semantic picture matching was better than naming in all 10 participants, with nine showing a significant difference. Conclusion The nonverbal processing of actions, as assessed with a semantic picture matching test, is an area of relative strength in svPPA. Clinical implications for assessment planning and interpretation and theoretical implications for current models of semantic cognition are discussed.

The development of dynamic perceptual simulations during sentence comprehension

Based on an embodied account of language comprehension, this study investigated the dynamic characteristics of children and adults’ perceptual simulations during sentence comprehension, using a novel paradigm to assess the perceptual simulation of objects moving up and down a vertical axis. The participants comprised adults (N = 40) and 6-, 8-, and 10-year-old children (N = 116). After listening in experimental trials to sentences implying that objects moved upward or downward, the participants were shown pictures and had to decide as quickly as possible whether the objects depicted had been mentioned in the sentences. The target pictures moved either up or down and then stopped in the middle of the screen. All age groups’ reaction times were found to be shorter when the objects moved in the directions that the sentences implied. Age exerted no developmental effect on reaction times. The findings suggest that dynamic perceptual simulations are fundamental to language comprehension in text recipients aged 6 and older.

The role of motor system in action-related language comprehension in L1 and L2: An fMRI study

The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.