Embodied Simulations Are Modulated by Sentential Perspective

The influence of sentence focus on mental simulation: A possible cause of ACE instability

Recent studies have revealed the instability of the action-sentence compatibility effect (ACE). The current study was designed to demonstrate the hypothesis that the instability of the ACE may be attributed to the instability of focused information in a sentence. A pilot study indicated that the focused information of sentences was relatively stable in the sentence-picture verification task but exhibited significant interindividual variability in the action-sentence compatibility paradigm in previous studies. Experiments 1 and 2 examined the effect of sentence focus on the shape match effect and the ACE by manipulating the focused information of sentences using the focus marker word "" (is). Experiment 1 found that the shape match effect occurred in the original sentence, while it disappeared when the word "" (is) was used to make an object noun no longer the focus of a sentence. Experiment 2 failed to observe the ACE regardless of whether the sentence focus was on the action information. Experiment 3 modified the focus manipulation to observe its impact on the ACE using different fonts and underlines to highlight the focused information. The results indicated that the ACE only occurred when the action information was the sentence focus. These findings suggest that sentence focus influences mental simulation, and the instability of the ACE is likely to be associated with the instability of sentence focus in previous studies. This outcome highlights the crucial role of identifying specific information as the critical element expressed in the current linguistic context for successful simulation.

Flexible and fine-grained simulation of speed in language processing

According to the embodied cognition theory, language comprehension is achieved through mental simulation. This account is supported by a number of studies reporting action simulations during language comprehension. However, which details of sensory-motor experience are included in these simulations is still controversial. Here, three experiments were carried out to examine the simulation of speed in action language comprehension. Experiment 1 adopted a lexical decision task and a semantic similarity judgment task on isolated fast and slow action verbs. It has been shown that fast action verbs were processed significantly faster than slow action verbs when deep semantic processing is required. Experiment 2 and Experiment 3 investigated the contextual influence on the simulation of speed, showing that the processing of verbs, either depicting fast actions or neutral actions, would be slowed down when embedded in the slow action sentences. These experiments together demonstrate that the fine-gained information, speed, is an important part of action representation and can be simulated but may not in an automatic way. Moreover, the speed simulation is flexible and can be modulated by the context.

Embodiment and gestural realization of ergative verbs

In this study, we examined the gestural embodiment of active, passive, and active-form/passive-sense voices of ergative verbs in English. We analyzed gestures produced by presenters talking about a variety of subjects in a set of videos. We used several Chi-square tests to find out what type of gesture (representational, beat, and pointing gestures) co-occurred more frequently with active, passive, and active-form/passive-sense voices of ergative verbs. The results showed that representational gestures occurred more frequently with active than passive and active-form/passive-sense voices of ergative verbs. Furthermore, representational gestures occurred more frequently with active voices of ergative verbs having human subjects than non-human subjects. This was also the case with active-form/passive-sense sentences. Based on these results, it is suggested that form of a sentence is an influential factor in the process of embodying the situation that is described by that sentence. Active voice of an English ergative verb is more likely to be accompanied by representational gestures and is embodied more strongly than passive and active-form/passive-sense voices of that verb.

A Review of Studies Supporting Metaphorical Embodiment

This paper presents a review of studies that have provided evidence supporting metaphorical embodiment. These studies are divided into three categories of behavioral, neuroimaging, and corpus studies. After summing up the findings of these studies, it is concluded that metaphorical embodiment is supported by these three lines of research. This is followed by a review of a number of studies that have measured sensorimotor and action effector strengths of various concepts. Then, the idea of sensorimotor and action effector strength of concepts is linked to metaphorical embodiment to present the main idea of the paper. Based on the findings of studies that have measured sensorimotor and action effector strengths of concepts, it is suggested that the degree of involvement of sensorimotor systems in mental simulation of metaphoric actions may not be at the same level in all metaphors. It depends on the sensorimotor strength of the base of the metaphor in various modalities. If the base of a metaphor has a high degree of perceptual strength in a certain modality, that modality plays the most important role in the processing of that metaphor, while other modalities take less important roles. In other words, depending on the sensorimotor strengths of the base of a metaphor in various modalities, those modalities have various levels of importance in the processing of that metaphor. If the base of the metaphor is weak in all modalities, modal resources can come into play to process that metaphor.

Does the Motor Cortex Want the Full Story? The Influence of Sentence Context on Corticospinal Excitability in Action Language Processing

The reading of action verbs has been shown to activate motor areas, whereby sentence context may serve to either globally strengthen this activation or to selectively sharpen it. To investigate this issue, we manipulated the presence of manual actions and sentence context, assessing the level of corticospinal excitability by means of transcranial magnetic stimulation. We hypothesized that context would serve to sharpen the neural representation of the described actions in the motor cortex, reflected in context-specific modulation of corticospinal excitability. Participants silently read manual action verbs and non-manual verbs, preceded by a full sentence (rich context) or not (minimal context). Transcranial magnetic stimulation pulses were delivered at rest or shortly after verb presentation. The coil was positioned over the cortical representation of the right first dorsal interosseous (pointer finger). We observed a general increase of corticospinal excitability while reading both manual action and non-manual verbs in minimal context, whereas the modulation was action-specific in rich context: corticospinal excitability increased while reading manual verbs, but did not differ from baseline for non-manual verbs. These findings suggest that sentence context sharpens motor representations, activating the motor cortex when relevant and eliminating any residual motor activation when no action is present.

The action-sentence compatibility effect (ACE): Meta-analysis of a benchmark finding for embodiment

The embodied account of language comprehension has been one of the most influential theoretical developments in the recent decades addressing the question how humans comprehend and represent language. To examine its assumptions, many studies have made use of behavioral paradigms involving basic compatibility effects. The action-sentence compatibility effect (ACE) is one of the most influential of these compatibility effects and is the most widely cited evidence for the embodied account of language comprehension. However, recently there have been difficulties in extending or even in reliably replicating the ACE. The conflicting findings concerning the ACE and its extensions lead to the discussion of whether the ACE is indeed a reliable effect. In a first step we conducted a meta-analysis using a random-effects model. This analysis revealed a small but significant effect size of the ACE. Furthermore, the task-parameter Delay occurred as a factor of interest in whether the ACE appears with positive or negative effect direction. A second meta-analytic approach (Fisher's method) supports these findings. Additionally, an analysis of publication bias suggests that there is bias in the ACE literature. In post-hoc analyses of the recent multi-lab investigation of the ACE (Morey et al., 2021), evidence for individual differences in the ACE was found. However, further analyses indicate that these differences are likely due to item-specific variability and the specific way in which items were assigned to conditions in the counterbalancing lists.

Motor features of abstract verbs determine their representations in the motor system

Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.

Neurophysiological mechanisms of perspective-taking: An MEG investigation of agency

According to the embodied cognition framework, sensory and motor areas are recruited during language understanding through simulation processes. Behavioral and imaging findings point to a dependence of the latter on perspective-taking (e.g., first person "I" versus third person "s/he"). The current study aims at identifying possible neurophysiological correlates of perspective in a linguistic context. Twenty healthy participants were measured with magnetoencephalography (MEG) while semantically processing visually presented inflected German verbs in the first- and third-person perspective, simple present tense. Results show that the first-person perspective induces stronger beta (15-25 Hz) desynchronization in the right-hemispheric posterior superior temporal sulcus, ventral posterior cingulate gyrus, and V5/MT+ area; no modulation of sensorimotor cortex emerged. Moreover, a stronger event-related field (ERF) was observed for the first-person perspective at about 150 ms after pronoun-verb onset, originating in occipital and moving to central and left temporal cortical sites. No effect of perspective on sensory gating was found when targeting the N1 component related to tones following the linguistic stimuli. Results indicate an effect of linguistic perspective-taking on brain activation patterns. The contribution of the single brain areas and their role in self-other distinction is further discussed.

Talking with hands: body representation in British Sign Language users

Body representation (BR) refers to the mental representation of motor, sensory, emotional and semantic information about the physical body. This cognitive representation is used in our everyday life, continuously, even though most of the time we do not appreciate it consciously. In some cases, BR is vital to be able to communicate. A crucial feature of signed languages (SLs), for instance, is that body parts such as hands are used to communicate. Nevertheless, little is known about BR in SL: is the communicative function of the body overwriting the physical constraints? Here, we explored this question by comparing twelve British Sign Language (BSL) learners to seventeen tango dancers (body expertise but not for communication) and fourteen control subjects (no special body expertise). We administered the Body Esteem Scale (BES), the Hand Laterality Task (HLT) and the Mental Motor Chronometry (MMC). To control for visual imagery, we administered ad hoc control tasks. We did not identify parameters able to differentiate between SL users and the other groups, whereas the more implicit parameters distinguished clearly tango dancers from controls. Importantly, neither tasks on visual imagery nor the BES revealed differences. Our findings offer initial evidence that linguistic use of the body not necessarily influences the cognitive components we explored of body representation.