Modulation of arm reaching movements during processing of arm/hand-related action verbs with and without emotional connotation

The role of motor inhibition in implicit negation processing: two Go/No-Go behavioral studies

Several studies demonstrated that explicit forms of negation processing (e.g., "I don't know") recruits motor inhibitory mechanisms. However, whether this is also true for implicit negation, in which the negative meaning is implicated but not explicitly lexicalized in the sentence (e.g., "I ignore"), has never been studied before. Two Go/No-Go studies, which differed only for the time-windows to respond to the Go stimulus, were carried out. In each, participants (N = 86 in experiment 1; N = 87 in experiment 2) respond to coloured circle while reading task-irrelevant affirmative, explicit negative and implicit negative sentences. We aimed to investigate whether: (i) the processing of implicit negations recruits inhibitory mechanisms; (ii) these inhibitory resources are differently modulated by implicit and explicit negations. Results show that implicit negative sentences recruit the inhibitory resources more strongly when compared to explicit ones, probably due to their inferential nature, likely requiring deeper processing of the negative meaning. Implicit and inferential meaning (i.e., pragmatic information) are grounded too in the same mechanisms that integrate action with perception. Such findings provide further evidence to the embodied account of language, showing that even abstract aspects, like implicit negation, are grounded in the sensory-motor system, by means of functional link between language and motor activity.

Is motor inhibition involved in the processing of sentential negation? An assessment via the Stop-Signal Task

In the last decades, the embodied approach to cognition and language gained momentum in the scientific debate, leading to evidence in different aspects of language processing. However, while the bodily grounding of concrete concepts seems to be relatively not controversial, abstract aspects, like the negation logical operator, are still today one of the main challenges for this research paradigm. In this framework, the present study has a twofold aim: (1) to assess whether mechanisms for motor inhibition underpin the processing of sentential negation, thus, providing evidence for a bodily grounding of this logic operator, (2) to determine whether the Stop-Signal Task, which has been used to investigate motor inhibition, could represent a good tool to explore this issue. Twenty-three participants were recruited in this experiment. Ten hand-action-related sentences, both in affirmative and negative polarity, were presented on a screen. Participants were instructed to respond as quickly and accurately as possible to the direction of the Go Stimulus (an arrow) and to withhold their response when they heard a sound following the arrow. This paradigm allows estimating the Stop Signal Reaction Time (SSRT), a covert reaction time underlying the inhibitory process. Our results show that the SSRT measured after reading negative sentences are longer than after reading affirmative ones, highlighting the recruitment of inhibitory mechanisms while processing negative sentences. Furthermore, our methodological considerations suggest that the Stop-Signal Task is a good paradigm to assess motor inhibition's role in the processing of sentence negation.

On the Embodiment of Negation in Italian Sign Language: An Approach Based on Multiple Representation Theories

Negation can be considered a shared social action that develops since early infancy with very basic acts of refusals or rejection. Inspired by an approach to the embodiment of concepts known as Multiple Representation Theories (MRT, henceforth), the present paper explores negation as an embodied action that relies on both sensorimotor and linguistic/social information. Despite the different variants, MRT accounts share the basic ideas that both linguistic/social and sensorimotor information concur to the processes of concepts formation and representation and that the balance between these components depends on the kind of concept, the context, or the performed task. In the present research we will apply the MRT framework for exploring negation in Italian sign language (LIS). The nature of negation in LIS has been explored in continuity with the co-speech gesture where negative elements are encoded through differentiated prosodic and gestural strategies across languages. Data have been collected in naturalistic settings that may allow a much wider understanding of negation both in speech and in spoken language with a semi-structured interview. Five LIS participants with age range 30–80 were recruited and interviewed with the aim of understanding the continuity between gesture and sign in negation. Results highlight that negation utterances mirror the functions of rejection, non-existence and denial that have been described in language acquisition both in deaf and hearing children. These different steps of acquisition of negation show a different balance between sensorimotor, linguistic and social information in the construction of negative meaning that the MRT is able to enlighten.

Assessment of Motor Planning and Inhibition Performance in Non-Clinical Sample-Reliability and Factor Structure of the Tower of London and Go/No Go Computerized Tasks

In two studies, we examine the test-retest reliability and factor structure of the computerized Tower of London (TOL) and Go/No Go (GNG). Before analyses, raw results of variables that were not normally distributed were transformed. Study 1 examined the reliability of a broad spectrum of indicators (Initial Time Thinking, ITT; Execution Time, ET; Full Time, FT; Extra Moves, EM; No Go Errors, NGE; Reaction Time for Go Responses, RTGR) across an eight-week delay in a sample of 20 young adults. After correction for multiple comparisons and correlations, our results demonstrate that the tasks have ambiguous test-retest reliability coefficients (non-significant r for all indicators, and interclass correlation (ICC) for TOL; significant ICC for GNG; show lack of reliable change over time for all indicators in both tasks); moreover, ITT exhibits strong practice effects. Study 2 investigated both tasks’ factor structure and conducted a more detailed analysis of indicators for each trial (ITT, ET, EM) in the TOL task in the group of 95 young adults. Results reveal a satisfactory 2-factor solution, with the first factor (planning inhibition) defined by ITT, NGE, and RTGR, and the second factor (move efficiency) defined by EM and ET. The detailed analysis identified a 6-factor solution with the first factor defined by ITT for more difficult trials and the remaining five factors defined by EM and ET for each trial, reflecting move efficiency for each trial separately.

The Neural Blending of Words and Movement: Event-Related Potential Signatures of Semantic and Action Processes during Motor-Language Coupling

Behavioral embodied research shows that words evoking limb-specific meanings can affect responses performed with the corresponding body part. However, no study has explored this phenomenon's neural dynamics under implicit processing conditions, let alone by disentangling its conceptual and motoric stages. Here, we examined whether the blending of hand actions and manual action verbs, relative to nonmanual action verbs and nonaction verbs, modulates electrophysiological markers of semantic integration (N400) and motor-related cortical potentials during a lexical decision task. Relative to both other categories, manual action verbs involved reduced posterior N400 amplitude and greater modulations of frontal motor-related cortical potentials. Such effects overlapped in a window of ∼380-440 msec after word presentation and ∼180 msec before response execution, revealing the possible time span in which both semantic and action-related stages reach maximal convergence. These results allow refining current models of motor-language coupling while affording new insights on embodied dynamics at large.

Motor processing modulates word comprehension

We evaluated whether movement modulates the semantic processing of words. To this end, we used homograph words with two meanings, one associated with hand movements (e.g., 'abanico', 'fan' in Spanish) or foot movements ('bota', 'boot' in Spanish), and the other not associated with movement ('abanico', 'range' in Spanish; 'bota', 'wineskin' in Spanish). After the homograph, three words were presented, and participants were asked to choose the word related to one of the two homograph meanings. The words could be either related to the motor meaning of the homograph ('fan-heat'), to the non-motor meaning of the homograph ('range-possibility') or unrelated ('fan-phone'). The task was performed without movement (simple condition) or by performing hand (Experiment 1) and foot (Experiment 2) movements. Compared with the simple condition, the performance of movement oriented the preference towards the motor meaning of the homograph. This pattern of results confirms that movement modulates word comprehension.

The Embodied Penman: Effector-Specific Motor-Language Integration During Handwriting

Several studies have illuminated how processing manual action verbs (MaVs) affects the programming or execution of concurrent hand movements. Here, to circumvent key confounds in extant designs, we conducted the first assessment of motor-language integration during handwriting-a task in which linguistic and motoric processes are co-substantiated. Participants copied MaVs, non-manual action verbs, and non-action verbs as we collected measures of motor programming and motor execution. Programming latencies were similar across conditions, but execution was faster for MaVs than for the other categories, regardless of whether word meanings were accessed implicitly or explicitly. In line with the Hand-Action-Network Dynamic Language Embodiment (HANDLE) model, such findings suggest that effector-congruent verbs can prime manual movements even during highly automatized tasks in which motoric and verbal processes are naturally intertwined. Our paradigm opens new avenues for fine-grained explorations of embodied language processes.

How words ripple through bilingual hands: Motor-language coupling during L1 and L2 writing

The speed of our hand movements can be affected by concurrent processing of manual action verbs (MaVs). Whereas this phenomenon is well established for native languages (L1s), it remains underexplored in late foreign languages (L2s), especially during highly automatized tasks. Here we timed keystroke activity while Spanish-English bilinguals copied MaVs, non-manual action verbs, and non-action verbs in their L1 and L2. Motor planning and execution dynamics were indexed by first-letter lag (the time-lapse between word presentation and first keystroke) and whole-word lag (the time-lapse between first and last keystroke), respectively. Despite yielding no effects on motor planning, MaVs facilitated typing execution in L1 but delayed it in L2, irrespective of the subjects' typing skills, age of L2 learning, and L2 competence. Therefore, motor-language coupling effects seem to be present in both languages though they can arise differently in each. These results extend language grounding models, illuminating the role of embodied mechanisms throughout life.

Altered speech-related cortical network in frontotemporal dementia

BACKGROUND

In healthy subjects (HS), transcranial magnetic stimulation (TMS) demonstrated an increase in motor-evoked potential (MEP) amplitudes during specific linguistic tasks. This finding indicates functional connections between speech-related cortical areas and the dominant primary motor cortex (M1).

OBJECTIVE

To investigate M1 function with TMS and the speech-related cortical network with neuroimaging measures in frontotemporal dementia (FTD), including the non-fluent variant of primary progressive aphasia (nfv-PPA) and the behavioral variant of FTD (bv-FTD).

METHODS

M1 excitability changes during specific linguistc tasks were examined using TMS in 24 patients (15 with nfv-PPA and 9 with bv-FTD) and in 18 age-matched HS. In the same patients neuroimaging was used to assess changes in specific white matter (WM) bundles and grey matter (GM) regions involved in language processing, with diffusion tensor imaging (DTI) and voxel-based morphometry (VBM).

RESULTS

During the linguistic task, M1 excitability increased in HS, whereas in FTD patients it did not. M1 excitability changes were comparable in nfv-PPA and bv-FTD. DTI revealed decreased fractional anisotropy in the superior and inferior longitudinal and uncinate fasciculi. Moreover, VBM disclosed GM volume loss in the left frontal operculum though not in the parietal operculum or precentral gyrus. Furthermore, WM and GM changes were comparable in nfv-PPA and bv-FTD. There was no correlation between neurophysiological and neuroimaging changes in FTD. Atrophy in the left frontal operculum correlated with linguistic dysfunction, assessed by semantic and phonemic fluency tests.

CONCLUSION

We provide converging neurophysiological and neuroimaging evidence of abnormal speech-related cortical network activation in FTD.

Too late to be grounded? Motor resonance for action words acquired after middle childhood

Though well established for languages acquired in infancy, the role of embodied mechanisms remains poorly understood for languages learned in middle childhood and adulthood. To bridge this gap, we examined 34 experiments that assessed sensorimotor resonance during processing of action-related words in real and artificial languages acquired since age 7 and into adulthood. Evidence from late bilinguals indicates that foreign-language action words modulate neural activity in motor circuits and predictably facilitate or delay physical movements (even in an effector-specific fashion), with outcomes that prove partly sensitive to language proficiency. Also, data from newly learned vocabularies suggest that embodied effects emerge after brief periods of adult language exposure, remain stable through time, and hinge on the performance of bodily movements (and, seemingly, on action observation, too). In sum, our work shows that infant language exposure is not indispensable for the recruitment of embodied mechanisms during language processing, a finding that carries non-trivial theoretical, pedagogical, and clinical implications for neurolinguistics, in general, and bilingualism research, in particular.

Motor resonance during linguistic processing as shown by EEG in a naturalistic VR environment

Embodied cognition studies have shown motor resonance during action language processing, indicating that linguistic representations are at least partially multimodal. However, constraints of this activation linked to linguistic and extra-linguistic context, function and timing have not yet been fully explored. Importantly, embodied cognition binds social and physical contexts to cognition, suggesting that more ecologically valid contexts will yield more valid measures of cognitive processing. Herein, we measured cortical motor activation during language processing in a fully immersive Cave automatic virtual environment (CAVE). EEG was recorded while participants engaged in a Go/No-Go task. They heard action verbs and, for Go trials, performed a corresponding action on a virtual object. ERSP (event-related spectral perturbation) was calculated during verb processing, corresponding to the pattern of power suppression (event-related desynchronization - ERD) and enhancement (event-related synchronization - ERS) relative to the reference interval. Significant ERD emerged during verb processing in both the µ (8-13 Hz) and beta band (20-30 Hz) for both Go and No-Go trials. µ ERD emerged in the 400-500 msec time window, associated with lexical-semantic processing. Greater µ ERD emerged for Go compared to No-Go trials. The present results provide compelling evidence in a naturalistic setting of how motor and linguistic processes interact.

Negation markers inhibit motor routines during typing of manual action verbs

We explored whether negation markers recruit inhibitory mechanisms during keyboard-based action-verb typing. In each trial, participants read two sentences: the first featured a context (There is a contract) and the second ended with a relevant verb which had to be immediately typed. Crucially, the verb could describe manual actions, non-manual actions or non-motor processes, with either affirmative (You do sign it) or negative (You don't sign it) polarity. We assessed the impact of verb type and polarity on two typing dimensions: motor programming (lapse between target onset and first keystroke) and motor execution (lapse between first and last keystroke). Negation yielded no effect on motor planning, but it selectively delayed typing execution for manual-action verbs, irrespective of the subjects' typing skills. This suggests that processing negations during comprehension of manual-action sentences recruits inhibitory mechanisms acting on same-effector movements. Our novel finding extends embodied models of language and effector-specific motor-language integration.

Emotions alter muscle proprioceptive coding of movements in humans

Emotions can evoke strong reactions that have profound influences, from gross changes in our internal environment to small fluctuations in facial muscles, and reveal our feelings overtly. Muscles contain proprioceptive afferents, informing us about our movements and regulating motor activities. Their firing reflects changes in muscle length, yet their sensitivity can be modified by the fusimotor system, as found in animals. In humans, the sensitivity of muscle afferents is modulated by cognitive processes, such as attention; however, it is unknown if emotional processes can modulate muscle feedback. Presently, we explored whether muscle afferent sensitivity adapts to the emotional situation. We recorded from single muscle afferents in the leg, using microneurography, and moved the ankle joint of participants, while they listened to evocative classical music to induce sad, neutral, or happy emotions, or sat passively (no music). We further monitored their physiological responses using skin conductance, heart rate, and electromyography measures. We found that muscle afferent firing was modified by the emotional context, especially for sad emotions, where the muscle spindle dynamic response increased. We suggest that this allows us to prime movements, where the emotional state prepares the body for consequent behaviour-appropriate reactions.

Sweet-cheeks vs. pea-brain: embodiment, valence, and task all influence the emotional salience of language

Previous research has found that more embodied insults (e.g. numbskull) are identified faster and more accurately than less embodied insults (e.g. idiot). The linguistic processing of embodied compliments has not been well explored. In the present study, participants completed two tasks where they identified insults and compliments, respectively. Half of the stimuli were more embodied than the other half. We examined the late positive potential (LPP) component of event-related potentials in early (400-500 ms), middle (500-600 ms), and late (600-700 ms) time windows. Increased embodiment resulted in improved response accuracy to compliments in both tasks, whereas it only improved accuracy for insults in the compliment detection task. More embodied stimuli elicited a larger LPP than less embodied stimuli in the early time window. Insults generated a larger LPP in the late time window in the insult task; compliments generated a larger LPP in the early window in the compliment task. These results indicate that electrophysiological correlates of emotional language perception are sensitive to both top-down and bottom-up processes.

Developmental Coordination Disorder Affects the Processing of Action-Related Verbs

Processing action-language affects the planning and execution of motor acts, which suggests that the motor system might be involved in action-language understanding. However, this claim is hotly debated. For the first time, we compared the processing of action-verbs in children with Developmental Coordination Disorder (DCD), a disease that specifically affects the motor system, with children with a typical development (TD). We administered two versions of a go/no-go task in which verbs expressing either hand, foot or abstract actions were presented. We found that only when the semantic content of a verb has to be retrieved, TD children showed an increase in reaction times if the verb involved the same effector used to give the response. In contrast, DCD patients did not show any difference between verb categories irrespective of the task. These findings suggest that the pathological functioning of the motor system in individuals with DCD also affects language processing.

Mirror Neurons System Engagement in Late Adolescents and Adults While Viewing Emotional Gestures

Observing others’ actions enhances muscle-specific cortico-spinal excitability, reflecting putative mirror neurons activity. The exposure to emotional stimuli also modulates cortico-spinal excitability. We investigated how those two phenomena might interact when they are combined, i.e., while observing a gesture performed with an emotion, and whether they change during the transition between adolescence and adulthood, a period of social and brain maturation. We delivered single-pulse transcranial magnetic stimulation (TMS) over the hand area of the left primary motor cortex of 27 healthy adults and adolescents and recorded their right first dorsal interossus (FDI) muscle activity (i.e., motor evoked potential – MEP), while they viewed either videos of neutral or angry hand actions and facial expressions, or neutral objects as a control condition. We reproduced the motor resonance and the emotion effects – hand-actions and emotional stimuli induced greater cortico-spinal excitability than the faces/control condition and neutral videos, respectively. Moreover, the influence of emotion was present for faces but not for hand actions, indicating that the motor resonance and the emotion effects might be non-additive. While motor resonance was observed in both groups, the emotion effect was present only in adults and not in adolescents. We discuss the possible neural bases of these findings.

Mental Reactivation and Pleasantness Judgment of Experience Related to Vision, Hearing, Skin Sensations, Taste and Olfaction

Language acquisition is based on our knowledge about the world and forms through multiple sensory-motor interactions with the environment. We link the properties of individual experience formed at different stages of ontogeny with the phased development of sensory modalities and with the acquisition of words describing the appropriate forms of sensitivity. To test whether early-formed experience related to skin sensations, olfaction and taste differs from later-formed experience related to vision and hearing, we asked Russian-speaking participants to categorize or to assess the pleasantness of experience mentally reactivated by sense-related adjectives found in common dictionaries. It was found that categorizing adjectives in relation to vision, hearing and skin sensations took longer than categorizing adjectives in relation to olfaction and taste. In addition, experience described by adjectives predominantly related to vision, hearing and skin sensations took more time for the pleasantness judgment and generated less intense emotions than that described by adjectives predominantly related to olfaction and taste. Interestingly the dynamics of skin resistance corresponded to the intensity and pleasantness of reported emotions. We also found that sense-related experience described by early-acquired adjectives took less time for the pleasantness judgment and generated more intense and more positive emotions than that described by later-acquired adjectives. Correlations were found between the time of the pleasantness judgment of experience, intensity and pleasantness of reported emotions, age of acquisition, frequency, imageability and length of sense-related adjectives. All in all these findings support the hypothesis that early-formed experience is less differentiated than later-formed experience.

A touch with words: Dynamic synergies between manual actions and language

Manual actions are a hallmark of humanness. Their underlying neural circuitry gives rise to species-specific skills and interacts with language processes. In particular, multiple studies show that hand-related expressions - verbal units evoking manual activity - variously affect concurrent manual actions, yielding apparently controversial results (interference, facilitation, or null effects) in varied time windows. Through a systematic review of 108 experiments, we show that such effects are driven by several factors, such as the level of verbal processing, action complexity, and the time-lag between linguistic and motor processes. We reconcile key empirical patterns by introducing the Hand-Action-Network Dynamic Language Embodiment (HANDLE) model, an integrative framework based on neural coupling dynamics and predictive-coding principles. To conclude, we assess HANDLE against the backdrop of other action-cognition theories, illustrate its potential applications to understand high-level deficits in motor disorders, and discuss key challenges for further development. In sum, our work aligns with the 'pragmatic turn', moving away from passive and static representationalist perspectives to a more dynamic, enactive, and embodied conceptualization of cognitive processes.

Hands typing what hands do: Action-semantic integration dynamics throughout written verb production

Processing action verbs, in general, and manual action verbs, in particular, involves activations in gross and hand-specific motor networks, respectively. While this is well established for receptive language processes, no study has explored action-semantic integration during written production. Moreover, little is known about how such crosstalk unfolds from motor planning to execution. Here we address both issues through our novel "action semantics in typing" paradigm, which allows to time keystroke operations during word typing. Specifically, we created a primed-verb-copying task involving manual action verbs, non-manual action verbs, and non-action verbs. Motor planning processes were indexed by first-letter lag (the lapse between target onset and first keystroke), whereas execution dynamics were assessed considering whole-word lag (the lapse between first and last keystroke). Each phase was differently delayed by action verbs. When these were processed for over one second, interference was strong and magnified by effector compatibility during programming, but weak and effector-blind during execution. Instead, when they were processed for less than 900ms, interference was reduced by effector compatibility during programming and it faded during execution. Finally, typing was facilitated by prime-target congruency, irrespective of the verbs' motor content. Thus, action-verb semantics seems to extend beyond its embodied foundations, involving conceptual dynamics not tapped by classical reaction-time measures. These findings are compatible with non-radical models of language embodiment and with predictions of event coding theory.