Physical and observational practices of unusual actions prime action verb processing

Flexible and fine-grained simulation of speed in language processing

According to the embodied cognition theory, language comprehension is achieved through mental simulation. This account is supported by a number of studies reporting action simulations during language comprehension. However, which details of sensory-motor experience are included in these simulations is still controversial. Here, three experiments were carried out to examine the simulation of speed in action language comprehension. Experiment 1 adopted a lexical decision task and a semantic similarity judgment task on isolated fast and slow action verbs. It has been shown that fast action verbs were processed significantly faster than slow action verbs when deep semantic processing is required. Experiment 2 and Experiment 3 investigated the contextual influence on the simulation of speed, showing that the processing of verbs, either depicting fast actions or neutral actions, would be slowed down when embedded in the slow action sentences. These experiments together demonstrate that the fine-gained information, speed, is an important part of action representation and can be simulated but may not in an automatic way. Moreover, the speed simulation is flexible and can be modulated by the context.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Point-light display: a new tool to improve verb recovery in patients with aphasia? A pilot study

Some studies have demonstrated that Action Observation (AO) could help patients with aphasia to recover use of verbs. However, the role of kinematics in this effect has remained unknown. The main aim was to assess the effectiveness of a complementary intervention based on the observation of action kinematics in patients with aphasia. Seven aphasic patients (3 males, 4 females) aged between 55 and 88 years participated in the studies. All patients received a classical intervention and an additional, specific intervention based on action observation. This consisted in visualizing a static image or a point-light sequence representing a human action and in trying to name the verb representing the action. In each session, 57 actions were visualized: 19 represented by a static drawing, 19 by a non-focalized point-light sequence, i.e., a point-light display with all dots in white, and 19 by a focalized point-light sequence, i.e., a point-light display (PLD) with the dots corresponding to the main limbs in yellow. Before (pre-test) and after (post-test) the intervention, each patient performed the same denomination task, in which all actions were presented in photographs. The results showed a significant improvement in performance between pre and post-test, but only when the actions were presented in focalized and non-focalized point-light sequences during the intervention. The presentation of action kinematics seems crucial in the recovery of verbs in patients with aphasia. This should be considered by speech therapists in their interventions.

PLAViMoP database: A new continuously assessed and collaborative 3D point-light display dataset

It was more than 45 years ago that Gunnar Johansson invented the point-light display technique. This showed for the first time that kinematics is crucial for action recognition, and that humans are very sensitive to their conspecifics' movements. As a result, many of today's researchers use point-light displays to better understand the mechanisms behind this recognition ability. In this paper, we propose PLAViMoP, a new database of 3D point-light displays representing everyday human actions (global and fine-motor control movements), sports movements, facial expressions, interactions, and robotic movements. Access to the database is free, at https://plavimop.prd.fr/en/motions . Moreover, it incorporates a search engine to facilitate action retrieval. In this paper, we describe the construction, functioning, and assessment of the PLAViMoP database. Each sequence was analyzed according to four parameters: type of movement, movement label, sex of the actor, and age of the actor. We provide both the mean scores for each assessment of each point-light display, and the comparisons between the different categories of sequences. Our results are discussed in the light of the literature and the suitability of our stimuli for research and applications.

Body into Narrative: Behavioral and Neurophysiological Signatures of Action Text Processing After Ecological Motor Training

Embodied cognition research indicates that sensorimotor training can influence action concept processing. Yet, most studies employ isolated (pseudo)randomized stimuli and require repetitive single-effector responses, thus lacking ecological validity. Moreover, the neural signatures of these effects remain poorly understood. Here, we examined whether immersive bodily training can modulate behavioral and functional connectivity correlates of action-verb processing in naturalistic narratives. The study involved three phases. First, in the Pre-training phase, 32 healthy persons listened to an action text (rich in movement descriptions) and a non-action text (focused on its characters' perceptual and mental processes), completed comprehension questionnaires, and underwent resting-state electroencephalogram (EEG) recordings. Second, in the four-day Training phase, half the participants completed an exergaming intervention (eliciting full-body movements for 60 min a day) while the remaining half played static videogames (requiring no bodily engagement other than button presses). Finally, in the Post-training phase, all participants repeated the Pre-training protocol with different action and non-action texts and a new EEG session. We found that exergaming selectively reduced action-verb outcomes and fronto-posterior functional connectivity in the motor-sensitive ∼ 10-20 Hz range, both patterns being positively correlated. Conversely, static videogame playing yielded no specific effect on any linguistic category and did not modulate functional connectivity. Together, these findings suggest that action-verb processing and key neural correlates can be focally influenced by full-body motor training in a highly ecological setting. Our study illuminates the role of situated experience and sensorimotor circuits in action-concept processing, addressing calls for naturalistic insights on language embodiment.

Does the Motor Cortex Want the Full Story? The Influence of Sentence Context on Corticospinal Excitability in Action Language Processing

The reading of action verbs has been shown to activate motor areas, whereby sentence context may serve to either globally strengthen this activation or to selectively sharpen it. To investigate this issue, we manipulated the presence of manual actions and sentence context, assessing the level of corticospinal excitability by means of transcranial magnetic stimulation. We hypothesized that context would serve to sharpen the neural representation of the described actions in the motor cortex, reflected in context-specific modulation of corticospinal excitability. Participants silently read manual action verbs and non-manual verbs, preceded by a full sentence (rich context) or not (minimal context). Transcranial magnetic stimulation pulses were delivered at rest or shortly after verb presentation. The coil was positioned over the cortical representation of the right first dorsal interosseous (pointer finger). We observed a general increase of corticospinal excitability while reading both manual action and non-manual verbs in minimal context, whereas the modulation was action-specific in rich context: corticospinal excitability increased while reading manual verbs, but did not differ from baseline for non-manual verbs. These findings suggest that sentence context sharpens motor representations, activating the motor cortex when relevant and eliminating any residual motor activation when no action is present.

Mapping relational links between motor imagery, action observation, action-related language, and action execution

Actions can be physically executed, observed, imagined, or simply thought about. Unifying mental processes, such as simulation, emulation, or predictive processing, are thought to underlie different action types, whether they are mental states, as in the case of motor imagery and action observation, or involve physical execution. While overlapping brain activity is typically observed across different actions which indicates commonalities, research interest is also concerned with investigating the distinct functional components of these action types. Unfortunately, untangling subtleties associated with the neurocognitive bases of different action types is a complex endeavour due to the high dimensional nature of their neural substrate (e.g., any action process is likely to activate multiple brain regions thereby having multiple dimensions to consider when comparing across them). This has impeded progress in action-related theorising and application. The present study addresses this challenge by using the novel approach of multidimensional modeling to reduce the high-dimensional neural substrate of four action-related behaviours (motor imagery, action observation, action-related language, and action execution), find the least number of dimensions that distinguish or relate these action types, and characterise their neurocognitive relational links. Data for the model comprised brain activations for action types from whole-brain analyses reported in 53 published articles. Eighty-two dimensions (i.e., 82 brain regions) for the action types were reduced to a three-dimensional model, that mapped action types in ordination space where the greater the distance between the action types, the more dissimilar they are. A series of one-way ANOVAs and post-hoc comparisons performed on the mean coordinates for each action type in the model showed that across all action types, action execution and concurrent action observation (AO)-motor imagery (MI) were most neurocognitively similar, while action execution and AO were most dissimilar. Most action types were similar on at least one neurocognitive dimension, the exception to this being action-related language. The import of the findings are discussed in terms of future research and implications for application.

Expert Event Segmentation of Dance Is Genre-Specific and Primes Verbal Memory

By chunking continuous streams of action into ordered, discrete, and meaningful units, event segmentation facilitates motor learning. While expertise in the observed repertoire reduces the frequency of event borders, generalization of this effect to unfamiliar genres of dance and among other sensorimotor experts (musicians, athletes) remains unknown, and was the first aim of this study. Due to significant overlap in visuomotor, language, and memory processing brain networks, the second aim of this study was to investigate whether visually priming expert motor schemas improves memory for words related to one’s expertise. A total of 112 participants in six groups (ballet, Bharatanatyam, and “other” dancers, athletes, musicians, and non-experts) segmented a ballet dance, a Bharatanatyam dance, and a non-dance control sequence. To test verbal memory, participants performed a retrieval-induced forgetting task between segmentation blocks. Dance, instrument, and sport word categories were included to probe the second study aim. Results of the event segmentation paradigm clarify that previously-established expert segmentation effects are specific to familiar genres of dance, and do not transfer between different types of experts or to non-dance sequences. Greater recall of dance category words among ballet and Bharatanatyam dancers provides novel evidence for improved verbal memory primed by activating familiar sensorimotor representations.