Comparable Mechanisms for Action and Language: Neural Systems Behind Intentions, Goals, and Means

Predictive Impact of Contextual Objects during Action Observation: Evidence from Functional Magnetic Resonance Imaging

The processing of congruent stimuli, such as an object or action in its typical location, is usually associated with reduced neural activity, probably due to facilitated recognition. However, in some situations, congruency increases neural activity—for example, when objects next to observed actions are likely versus unlikely to be involved in forthcoming action steps. Here, we investigated using fMRI whether the processing of contextual cues during action perception is driven by their (in)congruency and, thus, informative value to make sense of an observed scene. Specifically, we tested whether both highly congruent contextual objects (COs), which strongly indicate a future action step, and highly incongruent COs, which require updating predictions about possible forthcoming action steps, provide more anticipatory information about the action course than moderately congruent COs. In line with our hypothesis that especially the inferior frontal gyrus (IFG) subserves the integration of the additional information into the predictive model of the action, we found highly congruent and incongruent COs to increase bilateral activity in action observation nodes, that is, the IFG, the occipitotemporal cortex, and the intraparietal sulcus. Intriguingly, BA 47 was significantly stronger engaged for incongruent COs reflecting the updating of prediction in response to conflicting information. Our findings imply that the IFG reflects the informative impact of COs on observed actions by using contextual information to supply and update the currently operating predictive model. In the case of an incongruent CO, this model has to be reconsidered and extended toward a new overarching action goal.

A Connectomic Atlas of the Human Cerebrum-Chapter 2: The Lateral Frontal Lobe

In this supplement, we show a comprehensive anatomic atlas of the human cerebrum demonstrating all 180 distinct regions comprising the cerebral cortex. The location, functional connectivity, and structural connectivity of these regions are outlined, and where possible a discussion is included of the functional significance of these areas. In part 2, we specifically address regions relevant to the lateral frontal lobe.

A Connectomic Atlas of the Human Cerebrum-Chapter 14: Tractographic Description of the Frontal Aslant Tract

In this supplement, we show a comprehensive anatomic atlas of the human cerebrum demonstrating all 180 distinct regions comprising the cerebral cortex. The location, functional connectivity, and structural connectivity of these regions are outlined, and where possible a discussion is included of the functional significance of these areas. In this chapter, we specifically address the regions integrating to form the frontal aslant tract.

The Ontogenesis of Action Syntax

Language and action share similar organizational principles. Both are thought to be hierarchical and recursive in nature. Here we address the relationship between language and action from developmental and neurophysiological perspectives. We discuss three major aspects: The extent of the analogy between language and action; the necessity to extend research on the yet largely neglected aspect of action syntax; the positive contribution of a developmental approach to this topic. We elaborate on the claim that adding an ontogenetic approach will help to obtain a comprehensive picture about both the interplay between language and action and its development, and to answer the question whether the underlying mechanisms of detecting syntactic violations of action sequences are similar to or different from the processing of language syntactic violations.

When syntax meets action: Brain potential evidence of overlapping between language and motor sequencing

This study aims to extend the embodied cognition approach to syntactic processing. The hypothesis is that the brain resources to plan and perform motor sequences are also involved in syntactic processing. To test this hypothesis, Event-Related brain Potentials (ERPs) were recorded while participants read sentences with embedded relative clauses, judging for their acceptability (half of the sentences contained a subject-verb morphosyntactic disagreement). The sentences, previously divided into three segments, were self-administered segment-by-segment in two different sequential manners: linear or non-linear. Linear self-administration consisted of successively pressing three buttons with three consecutive fingers in the right hand, while non-linear self-administration implied the substitution of the finger in the middle position by the right foot. Our aim was to test whether syntactic processing could be affected by the manner the sentences were self-administered. Main results revealed that the ERPs LAN component vanished whereas the P600 component increased in response to incorrect verbs, for non-linear relative to linear self-administration. The LAN and P600 components reflect early and late syntactic processing, respectively. Our results convey evidence that language syntactic processing and performing non-linguistic motor sequences may share resources in the human brain.

Distinct brain signatures of content and structure violation during action observation

Sentences, musical phrases and goal-directed actions are composed of elements that are linked by specific rules to form meaningful outcomes. In goal-directed actions including a non-canonical element or scrambling the order of the elements alters the action's content and structure, respectively. In the present study we investigated event-related potentials of the electroencephalographic (EEG) activity recorded during observation of both alterations of the action content (obtained by violating the semantic components of an action, e.g. making coffee with cola) and alterations of the action structure (obtained by inverting the order of two temporally adjacent pictures of sequences depicting daily life actions) interfering with the normal flow of the motor acts that compose an action. Action content alterations elicited a bilateral posterior distributed EEG negativity, peaking at around 400 ms after stimulus onset similar to the ERPs evoked by semantic violations in language studies. Alteration of the action structure elicited an early left anterior negativity followed by a late left anterior positivity, which closely resembles the ERP pattern found in language syntax violation studies. Our results suggest a functional dissociation between the processing of action content and structure, reminiscent of a similar dissociation found in the language or music domains. Importantly, this study provides further support to the hypothesis that some basic mechanisms, such as the rule-based structuring of sequential events, are shared between different cognitive domains.

A rostro-caudal axis for language in the frontal lobe: the role of executive control in speech production

The present article promotes a formal executive model of frontal functions underlying speech production, bringing together hierarchical theories of adaptive behavior in the (pre-)frontal cortex (pFC) and psycho- and neurolinguistic approaches to spoken language within an information-theoretic framework. Its biological plausibility is revealed through two Activation Likelihood Estimation meta-analyses carried out on a total of 41 hemodynamic studies of overt word and continuous speech production respectively. Their principal findings, considered in light of neuropsychological evidence and earlier models of speech-related frontal functions, support the engagement of a caudal-to-rostral gradient of pFC activity operationalized by the nature and quantity of speech-related information conveyed by task-related external cues (i.e., cue codability) on the one hand, and the total informational content of generated utterances on the other. In particular, overt reading or repetition and picture naming recruit primarily caudal motor-premotor regions involved in the sensorimotor and phonological aspects of speech; word and sentence generation engage mid- ventro- and dorsolateral areas supporting its basic predicative and syntactic functions; finally, rostral- and fronto-polar cortices subsume domain-general strategic processes of discourse generation for creative speech. These different levels interact in a top-down fashion, ranging representationally and temporally from the most general and extended to the most specific and immediate. The end-result is an integrative theory of pFC as the main executive component of the language cortical network, which supports the existence of areas specialized for speech communication and articulation and regions subsuming internal reasoning and planning. Prospective avenues of research pertaining to this model's principal predictions are discussed.

Impairment of script comprehension in Lewy body spectrum disorders

A disabling impairment of higher-order language function can be seen in patients with Lewy body spectrum disorders such as Parkinson's disease (PD), Parkinson's disease dementia (PDD), and dementia with Lewy bodies (DLB). We focus on script comprehension in patients with Lewy body spectrum disorders. While scripts unfold sequentially, constituent events are thought to contain an internal organization. Executive dysfunction in patients with Lewy body spectrum disorders may interfere with comprehension of this internal structure. We examined 42 patients (30 non-demented PD and 12 mildly demented PDD/DLB patients) and 12 healthy seniors. We presented 22 scripts (e.g., "going fishing"), each consisting of six events. Pilot data from young controls provided the basis for organizing associated events into clusters and arranging them hierarchically into scripts. We measured accuracy and latency to judge the order of adjacent events in the same cluster versus adjacent events in different clusters. PDD/DLB patients were less accurate in their ordering judgments than PD patients and controls. Healthy seniors and PD patients were significantly faster to judge correctly the order of highly associated within-cluster event pairs relative to less closely associated different-cluster event pairs, while PDD/DLB patients did not consistently distinguish between these event-pair types. This relative insensitivity to the clustered-hierarchical organization of events was related to executive impairment and to frontal atrophy as measured by volumetric MRI. These findings extend prior work on script processing to patients with Lewy body spectrum disorders and highlight the potential impact of frontal/executive dysfunction on the daily lives of affected patients.

Hierarchical organization of scripts: converging evidence from FMRI and frontotemporal degeneration

The present study examined the organization of complex familiar activities, known as "scripts" (e.g., "going fishing"). We assessed whether events in a script are processed in a linear-sequential manner or clustered-hierarchical manner, and we evaluated the neural basis for this processing capacity. Converging evidence was obtained from functional neuroimaging in healthy young adults and from behavioral and structural magnetic resonance imaging (MRI) data in patients with focal neurodegenerative disease. In both studies, participants judged the order of consecutive event pairs taken from a script. Event pairs either were clustered together within a script or were from different clusters within the script. Controls judged events more accurately and quickly if taken from the same cluster within a script compared with different clusters, even though all event pairs were consecutive, consistent with the hierarchical organization of a script. Functional magnetic resonance imaging associated this with bilateral inferior frontal activation. Patients with progressive nonfluent aphasia or behavior-variant frontotemporal dementia did not distinguish between event pairs from the same cluster or from different clusters within a script. Structural MRI associated this deficit with significant frontal cortical atrophy. Our findings suggest that frontal cortex contributes to clustering events during script comprehension, underlining the role of frontal cortex in the hierarchical organization of a script.

Frontal lobe damage impairs process and content in semantic memory: evidence from category-specific effects in progressive non-fluent aphasia

Portions of left inferior frontal cortex have been linked to semantic memory both in terms of the content of conceptual representation (e.g., motor aspects in an embodied semantics framework) and the cognitive processes used to access these representations (e.g., response selection). Progressive non-fluent aphasia (PNFA) is a neurodegenerative condition characterized by progressive atrophy of left inferior frontal cortex. PNFA can, therefore, provide a lesion model for examining the impact of frontal lobe damage on semantic processing and content. In the current study we examined picture naming in a cohort of PNFA patients across a variety of semantic categories. An embodied approach to semantic memory holds that sensorimotor features such as self-initiated action may assume differential importance for the representation of manufactured artifacts (e.g., naming hand tools). Embodiment theories might therefore predict that patients with frontal damage would be differentially impaired on manufactured artifacts relative to natural kinds, and this prediction was borne out. We also examined patterns of naming errors across a wide range of semantic categories and found that naming error distributions were heterogeneous. Although PNFA patients performed worse overall on naming manufactured artifacts, there was no reliable relationship between anomia and manipulability across semantic categories. These results add to a growing body of research arguing against a purely sensorimotor account of semantic memory, suggesting instead a more nuanced balance of process and content in how the brain represents conceptual knowledge.

Integrating verbal and nonverbal communication in a dynamic neural field architecture for human-robot interaction

How do humans coordinate their intentions, goals and motor behaviors when performing joint action tasks? Recent experimental evidence suggests that resonance processes in the observer's motor system are crucially involved in our ability to understand actions of others’, to infer their goals and even to comprehend their action-related language. In this paper, we present a control architecture for human–robot collaboration that exploits this close perception-action linkage as a means to achieve more natural and efficient communication grounded in sensorimotor experiences. The architecture is formalized by a coupled system of dynamic neural fields representing a distributed network of neural populations that encode in their activation patterns goals, actions and shared task knowledge. We validate the verbal and nonverbal communication skills of the robot in a joint assembly task in which the human–robot team has to construct toy objects from their components. The experiments focus on the robot's capacity to anticipate the user's needs and to detect and communicate unexpected events that may occur during joint task execution.

Molecular mapping of movement-associated areas in the avian brain: a motor theory for vocal learning origin

Vocal learning is a critical behavioral substrate for spoken human language. It is a rare trait found in three distantly related groups of birds-songbirds, hummingbirds, and parrots. These avian groups have remarkably similar systems of cerebral vocal nuclei for the control of learned vocalizations that are not found in their more closely related vocal non-learning relatives. These findings led to the hypothesis that brain pathways for vocal learning in different groups evolved independently from a common ancestor but under pre-existing constraints. Here, we suggest one constraint, a pre-existing system for movement control. Using behavioral molecular mapping, we discovered that in songbirds, parrots, and hummingbirds, all cerebral vocal learning nuclei are adjacent to discrete brain areas active during limb and body movements. Similar to the relationships between vocal nuclei activation and singing, activation in the adjacent areas correlated with the amount of movement performed and was independent of auditory and visual input. These same movement-associated brain areas were also present in female songbirds that do not learn vocalizations and have atrophied cerebral vocal nuclei, and in ring doves that are vocal non-learners and do not have cerebral vocal nuclei. A compilation of previous neural tracing experiments in songbirds suggests that the movement-associated areas are connected in a network that is in parallel with the adjacent vocal learning system. This study is the first global mapping that we are aware for movement-associated areas of the avian cerebrum and it indicates that brain systems that control vocal learning in distantly related birds are directly adjacent to brain systems involved in movement control. Based upon these findings, we propose a motor theory for the origin of vocal learning, this being that the brain areas specialized for vocal learning in vocal learners evolved as a specialization of a pre-existing motor pathway that controls movement.

Neural evidence for the interplay between language, gesture, and action: a review

Co-speech gestures embody a form of manual action that is tightly coupled to the language system. As such, the co-occurrence of speech and co-speech gestures is an excellent example of the interplay between language and action. There are, however, other ways in which language and action can be thought of as closely related. In this paper we will give an overview of studies in cognitive neuroscience that examine the neural underpinnings of links between language and action. Topics include neurocognitive studies of motor representations of speech sounds, action-related language, sign language and co-speech gestures. It will be concluded that there is strong evidence on the interaction between speech and gestures in the brain. This interaction however shares general properties with other domains in which there is interplay between language and action.