Actions speak louder than functions: the importance of manipulability and action in tool representation

Organization of conceptual tool knowledge following left and right brain lesions: Evidence from neuropsychological dissociations and multivariate disconnectome symptom mapping

The aim of this work was to better understand the organization of conceptual tool knowledge following stroke. We explored specifically the link between manipulation kinematics and manipulation hand posture; and the link between manipulation kinematics and function relations in left brain-damaged (n = 30) and right brain-damaged (n = 30) patients. We examined the performance of brain-damaged patients in conceptual tool tasks using neuropsychological dissociations and disconnectome symptom mapping. Our results suggest that manipulation kinematics is more impaired than function relations, following left or right brain lesions. We also observed that manipulation kinematics and manipulation hand posture are dissociable dimensions but are still highly interrelated, particularly in left brain-damaged patients. We also found that the corpus callosum and bilateral superior longitudinal fasciculus are involved in action and semantic tool knowledge following left brain lesions. Our results provide evidence that the right hemisphere contains conceptual tool representations. Further studies are needed to better understand the mechanisms supporting the cognitive recovery of conceptual tool knowledge. An emerging hypothesis is that the right hemisphere may support functional recovery through interhemispheric transfer following a left hemisphere stroke.

How Time Pressure Modulates Individual Differences in the Functional Connectivity of Chunk Memory in Chess Games

Previous studies on the chess game demonstrated that chess experts strongly rely on the activation of memory chunks to manifest accurate decision-making. Although the chunk memory might be affected by temporal constraints, it is unclear why the performance of chess experts is not significantly dropped under time pressure. In this study, our objective is to examine the variations in cognitive neural mechanisms between chess experts and novices under time pressure. The underlying cognitive neural mechanism was carefully inspected by accessing the chess game performance between 20 local experienced and 20 inexperienced chess players with 1-minute and 5-minute time constraints. In addition, functional near-infrared spectroscopy (fNIRS) recordings were carried out for each individual from the two groups while playing a 1-minute or 5-minute chess game. It was discovered that under temporal constraints, players exhibited different patterns of functional connectivity in frontal-parietal regions, suggesting that temporal stress can enhance segmentation processes in chess games. In particular, the experienced group exhibited significantly enhanced functional connectivity networks under time pressure including the dorsolateral prefrontal cortex, inferior frontal gyrus, supramarginal gyrus, and postcentral gyrus, which demonstrated the important role of the segmentation process for experienced players under time pressure. Our study found that experienced players were able to enhance recall, reorganize, and integrate chunks to improve chess performance under time pressure.

Flexible Conceptual Representations

A view that has been gaining prevalence over the past decade is that the human conceptual system is malleable, dynamic, context-dependent, and task-dependent, that is, flexible. Within the flexible conceptual representation framework, conceptual representations are constructed ad hoc, forming a different, idiosyncratic instantiation upon each occurrence. In this review, we scrutinize the neurocognitive literature to better understand the nature of this flexibility. First, we identify some key characteristics of these representations. Next, we consider how these flexible representations are constructed by addressing some of the open questions in this framework: We review the age-old question of how to reconcile flexibility with the apparent need for shareable stable definitions to anchor meaning and come to mutual understanding, as well as some newer questions we find critical, namely, the nature of relations among flexible representations, the role of feature saliency in activation, and the viability of all-or-none feature activations. We suggest replacing the debate about the existence of a definitional stable core that is obligatorily activated with a question of the degree and probability of activation of the information constituting a conceptual representation. We rely on published works to suggest that (1) prior featural salience matters, (2) feature activation may be graded, and (3) Bayesian updating of prior information according to current demands offers a viable account of how flexible representations are constructed. This proposal provides a theoretical mechanism for incorporating a changing momentary context into a constructed representation, while still preserving some of the concept's constituent meaning.

Distinct brain network organizations between club players and novices under different difficulty levels

SIGNIFICANT

Chunk memory is one of the essential cognitive functions for high-expertise (HE) player to make efficient decisions. However, it remains unknown how the neural mechanisms of chunk memory processes mediate or alter chess players' performance when facing different opponents.

AIM

This study aimed at inspecting the significant brain networks associated with chunk memory, which would vary between club players and novices.

APPROACH

Functional networks and topological features of 20 club players (HE) and 20 novice players (LE) were compared at different levels of difficulty by means of functional near-infrared spectroscopy.

RESULTS

Behavioral performance indicated that the club player group was unaffected by differences in difficulty. Furthermore, the club player group demonstrated functional connectivity among the dorsolateral prefrontal cortex, the frontopolar cortex, the supramarginal gyrus, and the subcentral gyrus, as well as higher clustering coefficients and lower path lengths in the high-difficulty task.

CONCLUSIONS

The club player group illustrated significant frontal-parietal functional connectivity patterns and topological characteristics, suggesting enhanced chunking processes for improved chess performance.

Effect of Object on Kinesthetic Motor Imagery in Autism Spectrum Disorder: A Pilot Study Based on Eye-Tracking Methodology

Introduction

Social disturbance is a significant autism spectrum disorder (ASD) symptom. Action representation, which is a fundamental component of social interaction, can be investigated through kinesthetic motor imagery (KMI). KMI has been commonly studied with the well-developed laterality judgment paradigm, wherein participants are required to discriminate the laterality of a hand rotated by different angles along one or more axes. Here, we investigated the KMI processing in individuals with ASD by hand laterality judgment paradigm with eye-tracking methodology.

Methods

The current study included 22 participants with ASD and 22 typical developing (TD) peers matched for age, gender, and intelligence. Participants were asked to judge the laterality of hand-with-tooth brush images.

Results

Compared to the TD controls, individuals with ASD performed KMI with lower accuracy and longer response time in both correct and incorrect action conditions. The incorrect action representation had greater effect on KMI for individuals with ASD. Differences in eye-movement patterns were also observed, characterized by individuals with ASD were more focused on the object area while TD peers were more focused on the hand area.

Conclusion

Results suggest that while altered KMI performance was observed, the incorrect action representation elicited more engagement of KMI in both groups. The object-centered eye-movement pattern may contribute to the refine of motor simulation intervention for individuals with ASD.

Temporal differences and commonalities between hand and tool neural processing

Object recognition is a complex cognitive process that relies on how the brain organizes object-related information. While spatial principles have been extensively studied, less studied temporal dynamics may also offer valuable insights into this process, particularly when neural processing overlaps for different categories, as it is the case of the categories of hands and tools. Here we focus on the differences and/or similarities between the time-courses of hand and tool processing under electroencephalography (EEG). Using multivariate pattern analysis, we compared, for different time points, classification accuracy for images of hands or tools when compared to images of animals. We show that for particular time intervals (~ 136-156 ms and ~ 252-328 ms), classification accuracy for hands and for tools differs. Furthermore, we show that classifiers trained to differentiate between tools and animals generalize their learning to classification of hand stimuli between ~ 260-320 ms and ~ 376-500 ms after stimulus onset. Classifiers trained to distinguish between hands and animals, on the other hand, were able to extend their learning to the classification of tools at ~ 150 ms. These findings suggest variations in semantic features and domain-specific differences between the two categories, with later-stage similarities potentially related to shared action processing for hands and tools.

Left anterior supramarginal gyrus activity during tool use action observation after extensive tool use training

The advanced use of complex tools is considered a primary characteristic of human evolution and technological advancement. However, questions remain regarding whether humans possess unique underlying brain networks that support advanced tool-using abilities. Specifically, previous studies have demonstrated the presence of a structurally and functionally unique region in the left anterior supramarginal gyrus (aSMG), that is consistently active during tool use action observation. This region has been proposed as a primary hub for integrating semantic and technical information to form action plans with tools. However, it is still largely unknown how tool use motor learning affects left aSMG activation or connectivity with other brain regions. To address this, participants with little experience using chopsticks observed an experimenter using chopsticks to perform a novel task while undergoing two functional magnetic resonance imaging (fMRI) scans. Between the scans, participants underwent four weeks of behavioral training where they learned to use chopsticks and achieve proficiency in the observed task. Results demonstrated a significant change in effective connectivity between the left aSMG and the left anterior intraparietal sulcus (aIPS), a region involved in object affordances and planning grasping actions. These findings suggest that during unfamiliar tool use, the left aSMG integrates semantic and technical information to communicate with regions involved with grasp selection, such as the aIPS. This communication then allows appropriate grasps to be planned based on the physical properties of the objects involved and their potential interactions.

A shared neural code for the physics of actions and object events

Observing others' actions recruits frontoparietal and posterior temporal brain regions - also called the action observation network. It is typically assumed that these regions support recognizing actions of animate entities (e.g., person jumping over a box). However, objects can also participate in events with rich meaning and structure (e.g., ball bouncing over a box). So far, it has not been clarified which brain regions encode information specific to goal-directed actions or more general information that also defines object events. Here, we show a shared neural code for visually presented actions and object events throughout the action observation network. We argue that this neural representation captures the structure and physics of events regardless of animacy. We find that lateral occipitotemporal cortex encodes information about events that is also invariant to stimulus modality. Our results shed light onto the representational profiles of posterior temporal and frontoparietal cortices, and their roles in encoding event information.

fNIRS-Based Differences in Cortical Activation during Tool Use, Pantomimed Actions, and Meaningless Actions between Children with and without Autism Spectrum Disorder (ASD)

Children with autism spectrum disorder (ASD) have difficulties with tool use and pantomime actions. The current study utilized functional near-infrared spectroscopy (fNIRS) to examine the neural mechanisms underlying these gestural difficulties. Thirty-one children with and without ASD (age (mean ± SE) = 11.0 ± 0.6) completed a naturalistic peg-hammering task using an actual hammer (hammer condition), pantomiming hammering actions (pantomime condition), and performing meaningless actions with similar joint motions (meaningless condition). Children with ASD exhibited poor praxis performance (praxis error: TD = 17.9 ± 1.7; ASD = 27.0 ± 2.6, p < 0.01), which was significantly correlated with their cortical activation (R = 0.257 to 0.543). Both groups showed left-lateralized activation, but children with ASD demonstrated more bilateral activation during all gestural conditions. Compared to typically developing children, children with ASD showed hyperactivation of the inferior parietal lobe and hypoactivation of the middle/inferior frontal and middle/superior temporal regions. Our findings indicate intact technical reasoning (typical left-IPL activation) but atypical visuospatial and proprioceptive processing (hyperactivation of the right IPL) during tool use in children with ASD. These results have important implications for clinicians and researchers, who should focus on facilitating/reducing the burden of visuospatial and proprioceptive processing in children with ASD. Additionally, fNIRS-related biomarkers could be used for early identification through early object play/tool use and to examine neural effects following gesture-based interventions.

Dissociation between function and manipulation in semantic representations of motor impaired subjects: A new test

A fundamental problem in semantic cognition is the representation of human concepts in the brain. Much of the knowledge acquired in the last decades comes from the study of dissociations found in patients with acquired difficulties in language, perception, and action. In particular, some deficits involve loss of knowledge about tools. The dissociation between two relevant aspects of tools, function and manipulation, has been the focus of several studies. In this paper, a new test designed to study the dissociation between function and manipulation is proposed and normative values for a control population are provided. This novel test was additionally administered to and evaluated in a group of Parkinson's disease patients. The Graded-Controlled Hub-and-Spoke model of Lambon Ralph, Jefferies, Patterson and Rogers was used as a theoretical guide to interpret the results.

The Semantics of Natural Objects and Tools in the Brain: A Combined Behavioral and MEG Study

Current literature supports the notion that the recognition of objects, when visually presented, is sub-served by neural structures different from those responsible for the semantic processing of their nouns. However, embodiment foresees that processing observed objects and their verbal labels should share similar neural mechanisms. In a combined behavioral and MEG study, we compared the modulation of motor responses and cortical rhythms during the processing of graspable natural objects and tools, either verbally or pictorially presented. Our findings demonstrate that conveying meaning to an observed object or processing its noun similarly modulates both motor responses and cortical rhythms; being natural graspable objects and tools differently represented in the brain, they affect in a different manner both behavioral and MEG findings, independent of presentation modality. These results provide experimental evidence that neural substrates responsible for conveying meaning to objects overlap with those where the object is represented, thus supporting an embodied view of semantic processing.

Latent Semantic Structure of the WMS-III Verbal Paired-Associates

OBJECTIVE

To investigate the factor structure of the verbal paired-associates (VPA) subtest in the WMS-III using a theoretically driven model of semantic processing previously found to be well-fitting for the WMS-IV version of the test.

METHOD

Archival data were used from 267 heterogeneous neurosciences patients and 223 seizure disorder patients who completed the WMS-III as part of a standard neuropsychological evaluation. Confirmatory factor analysis was used to test theoretically driven models for VPA based on principles of semantic processing. Four nested models of different complexities were examined and compared for goodness-of-fit using chi-squared difference testing. Measurement invariance testing was conducted across heterogeneous neuroscience and seizure disorder samples to test generality of the factor model.

RESULTS

After removing items with limited variability (very easy or very hard; 12 of 40 items), a four-factor model was found to be best-fitting in the present patient samples. The four factors were "recreational", "functional", "material", and "symbolic", each representing semantic knowledge associated with the function of the target word referent. This model subsequently met the criteria for the strict measurement invariance, showing good overall fit when factor loadings, thresholds, and residuals were held to equality across samples.

CONCLUSIONS

The results of this study provide further evidence that "arbitrary" associations between word pairs in VPA items have an underlying semantic structure, challenging the idea that unrelated hard-pairs are semantic-free. These results suggest that a semantic-structure model may be implemented as an alternative scoring in future editions of the WMS to facilitate interpretation.

The Neural Basis of Semantic Prediction in Sentence Comprehension

Although prediction plays an important role in language comprehension, its precise neural basis remains unclear. This fMRI study investigated whether and how semantic-category-specific and common cerebral areas are recruited in predictive semantic processing during sentence comprehension. We manipulated the semantic constraint of sentence contexts, upon which a tool-related, a building-related, or no specific category of noun is highly predictable. This noun-predictability effect was measured not only over the target nouns but also over their preceding transitive verbs. Both before and after the appearance of target nouns, left anterior supramarginal gyrus was specifically activated for tool-related nouns and left parahippocampal place area was activated specifically for building-related nouns. The semantic-category common areas included a subset of left inferior frontal gyrus during the anticipation of incoming target nouns (activity enhancement for high predictability) and included a wide spread of areas (bilateral inferior frontal gyrus, left superior/middle temporal gyrus, left medial pFC, and left TPJ) during the integration of actually perceived nouns (activity reduction for high predictability). These results indicated that the human brain recruits fine divisions of cortical areas to distinguish different semantic categories of predicted words, and anticipatory semantic processing relies, at least partially, on top-down prediction conducted in higher-level cortical areas.

Category-specific activations depend on imaging mode, task demand, and stimuli modality: An ALE meta-analysis

The cortical organization of the semantic network has been examined extensively in neuropsychological and neuroimaging studies; however, after decades of research, several issues remain controversial. A comprehensive and systematic investigation is needed to characterize the consistent patterns of category-specific activations as well as to examine factors that contribute to the varying findings across numerous neuroimaging studies. In this study, we reviewed 113 published papers that reported category-specific activations for living or nonliving concepts from the past two decades. Using the Activation Likelihood Estimate (ALE) method, we characterized the brain regions associated with living and nonliving concepts and revealed how the observed patterns were heavily influenced by methodological factors including imaging mode, task demand, and stimuli modality. Our findings provided the most comprehensive summary of category-specific activations for living and nonliving concepts and critically revealed that these activation patterns are highly contextually dependent. This work advanced our knowledge about the organization of the cortical semantic network and provided important insights into theoretical accounts and future research directions.

Inflection across Categories: Tracking Abstract Morphological Processing in Language Production with MEG

Coherent language production requires that speakers adapt words to their grammatical contexts. A fundamental challenge in establishing a functional delineation of this process in the brain is that each linguistic process tends to correlate with numerous others. Our work investigated the neural basis of morphological inflection by measuring magnetoencephalography during the planning of inflected and uninflected utterances that varied across several linguistic dimensions. Results reveal increased activity in the left lateral frontotemporal cortex when inflection is planned, irrespective of phonological specification, syntactic context, or semantic type. Additional findings from univariate and connectivity analyses suggest that the brain distinguishes between different types of inflection. Specifically, planning noun and verb utterances requiring the addition of the suffix -s elicited increased activity in the ventral prefrontal cortex. A broadly distributed effect of syntactic context (verb vs. noun) was also identified. Results from representational similarity analysis indicate that this effect cannot be explained in terms of word meaning. Together, these results 1) offer evidence for a neural representation of abstract inflection that separates from other stimulus properties and 2) challenge theories that emphasize semantic content as a source of verb/noun processing differences.

Semantic and action tool knowledge in the brain: Identifying common and distinct networks

Most cognitive models of apraxia assume that impaired tool use results from a deficit occurring at the conceptual level, which contains dedicated information about tool use, namely, semantic and action tool knowledge. Semantic tool knowledge contains information about the prototypical use of familiar tools, such as function (e.g., a hammer and a mallet share the same purpose) and associative relations (e.g., a hammer goes with a nail). Action tool knowledge contains information about how to manipulate tools, such as hand posture and kinematics. The present review aimed to better understand the neural correlates of action and semantic tool knowledge, by focusing on activation, stimulation and patients' studies (left brain-damaged patients). We found that action and semantic tool knowledge rely upon a large brain network including temporal and parietal regions. Yet, while action tool knowledge calls into play the intraparietal sulcus, function relations mostly involve the anterior and posterior temporal lobe. Associative relations engaged the angular and the posterior middle temporal gyrus. Moreover, we found that hand posture and kinematics both tapped into the inferior parietal lobe and the lateral occipital temporal cortex, but no region specificity was found for one or the other representation. Our results point out the major role of both posterior middle temporal gyrus and inferior parietal lobe for action and semantic tool knowledge. They highlight the common and distinct brain networks involved in action and semantic tool networks and spur future directions on this topic.

Knowing how to do it or doing it? A double dissociation between tool-gesture production and tool-gesture knowledge

Deciding how to manipulate an object to fulfill a goal requires accessing different types of object-related information. How these different types of information are integrated and represented in the brain is still an open question. Here, we focus on examining two types of object-related information-tool-gesture knowledge (i.e., how to manipulate an object), and tool-gesture production (i.e., the actual manipulation of an object). We show a double dissociation between tool-gesture knowledge and tool-gesture production: Patient FP presents problems in pantomiming tool use in the context of a spared ability to perform judgments about an object's manipulation, whereas Patient LS can pantomime tool use, but is impaired at performing manipulation judgments. Moreover, we compared the location of the lesions in FP and LS with those sustained by two classic ideomotor apraxic patients (IMA), using a cortical thickness approach. Patient FP presented lesions in common with our classic IMA that included the left inferior parietal lobule (IPL), and specifically the supramarginal gyrus, the left parietal operculum, the left premotor cortex and the left inferior frontal gyrus, whereas Patient LS and our classic IMA patients presented common lesions in regions of the superior parietal lobule (SPL), motor areas (as primary somatosensory cortex, premotor cortex and primary motor cortex), and frontal areas. Our results show that tool-gesture production and tool-gesture knowledge can be behaviorally and neurally doubly dissociated and put strong constraints on extant theories of action and object recognition and use.

The contribution of object size, manipulability, and stability on neural responses to inanimate objects

In human occipitotemporal cortex, brain responses to depicted inanimate objects have a large-scale organization by real-world object size. Critically, the size of objects in the world is systematically related to behaviorally-relevant properties: small objects are often grasped and manipulated (e.g., forks), while large objects tend to be less motor-relevant (e.g., tables), though this relationship does not always have to be true (e.g., picture frames and wheelbarrows). To determine how these two dimensions interact, we measured brain activity with functional magnetic resonance imaging while participants viewed a stimulus set of small and large objects with either low or high motor-relevance. The results revealed that the size organization was evident for objects with both low and high motor-relevance; further, a motor-relevance map was also evident across both large and small objects. Targeted contrasts revealed that typical combinations (small motor-relevant vs. large non-motor-relevant) yielded more robust topographies than the atypical covariance contrast (small non-motor-relevant vs. large motor-relevant). In subsequent exploratory analyses, a factor analysis revealed that the construct of motor-relevance was better explained by two underlying factors: one more related to manipulability, and the other to whether an object moves or is stable. The factor related to manipulability better explained responses in lateral small-object preferring regions, while the factor related to object stability (lack of movement) better explained responses in ventromedial large-object preferring regions. Taken together, these results reveal that the structure of neural responses to objects of different sizes further reflect behavior-relevant properties of manipulability and stability, and contribute to a deeper understanding of some of the factors that help the large-scale organization of object representation in high-level visual cortex.

Overlapping but distinct: Distal connectivity dissociates hand and tool processing networks

The processes and organizational principles of information involved in object recognition have been a subject of intense debate. These research efforts led to the understanding that local computations and feedforward/feedback connections are essential to our representations and their organization. Recent data, however, has demonstrated that distal computations also play a role in how information is locally processed. Here we focus on how long-range connectivity and local functional organization of information are related, by exploring regions that show overlapping category-preferences for two categories and testing whether their connections are related with distal representations in a category-specific way. We used an approach that relates functional connectivity with distal areas to local voxel-wise category-preferences. Specifically, we focused on two areas that show an overlap in category-preferences for tools and hands-the inferior parietal lobule/anterior intraparietal sulcus (IPL/aIPS) and the posterior middle temporal gyrus/lateral occipital temporal cortex (pMTG/LOTC) - and how connectivity from these two areas relate to voxel-wise category-preferences in two ventral temporal regions dedicated to the processing of tools and hands separately-the left medial fusiform gyrus and the fusiform body area respectively-as well as across the brain. We show that the functional connections of the two overlap areas correlate with categorical preferences for each category independently. These results show that regions that process both tools and hands maintain object topography in a category-specific way. This potentially allows for a category-specific flow of information that is pertinent to computing object representations.

Chinese-English bilinguals show linguistic-perceptual links in the brain associating short spoken phrases with corresponding real-world natural action sounds by semantic category

Higher cognitive functions such as linguistic comprehension must ultimately relate to perceptual systems in the brain, though how and why this forms remains unclear. Different brain networks that mediate perception when hearing real-world natural sounds has recently been proposed to respect a taxonomic model of acoustic-semantic categories. Using functional magnetic resonance imaging (fMRI) with Chinese/English bilingual listeners, the present study explored whether reception of short spoken phrases, in both Chinese (Mandarin) and English, describing corresponding sound-producing events would engage overlapping brain regions at a semantic category level. The results revealed a double-dissociation of cortical regions that were preferential for representing knowledge of human versus environmental action events, whether conveyed through natural sounds or the corresponding spoken phrases depicted by either language. These findings of cortical hubs exhibiting linguistic-perceptual knowledge links at a semantic category level should help to advance neurocomputational models of the neurodevelopment of language systems.

Meta-Analyses Support a Taxonomic Model for Representations of Different Categories of Audio-Visual Interaction Events in the Human Brain

Our ability to perceive meaningful action events involving objects, people, and other animate agents is characterized in part by an interplay of visual and auditory sensory processing and their cross-modal interactions. However, this multisensory ability can be altered or dysfunctional in some hearing and sighted individuals, and in some clinical populations. The present meta-analysis sought to test current hypotheses regarding neurobiological architectures that may mediate audio-visual multisensory processing. Reported coordinates from 82 neuroimaging studies (137 experiments) that revealed some form of audio-visual interaction in discrete brain regions were compiled, converted to a common coordinate space, and then organized along specific categorical dimensions to generate activation likelihood estimate (ALE) brain maps and various contrasts of those derived maps. The results revealed brain regions (cortical "hubs") preferentially involved in multisensory processing along different stimulus category dimensions, including 1) living versus nonliving audio-visual events, 2) audio-visual events involving vocalizations versus actions by living sources, 3) emotionally valent events, and 4) dynamic-visual versus static-visual audio-visual stimuli. These meta-analysis results are discussed in the context of neurocomputational theories of semantic knowledge representations and perception, and the brain volumes of interest are available for download to facilitate data interpretation for future neuroimaging studies.

Absence of post-learning motor activity effects on memory for motor-related words

Drawing a hypothesis from embodied theories of memory, van Dam, Rueschemeyer, Bekkering and Lindemann [(2013). Embodied grounding of memory: Toward the effects of motor execution on memory consolidation. The Quarterly Journal of Experimental Psychology, 66(12), 2310-2328] showed that recognition performance for action words could be modulated by actions performed during the retention interval, suggesting that motor actions during the retention interval affect memory consolidation. The results of 4 experiments from two different laboratories, designed to replicate and extend the van Dam et al. motor consolidation effect, are presented here. Two of the experiments (n = 30 and n = 44) exactly and independently replicated the experimental design and conditions of the original experiment. Yes/No recognition scores plus additional analysis of response times showed no motor consolidation effects. A third experiment (n = 44) manipulating type of processing during encoding also failed to find significant motor consolidation effects. Finally, a fourth experiment (n = 120) following a more standard reconsolidation paradigm, involving 24-hour intervals between learning and motor behaviour, and a 24-hour delayed test, also found null effects. The absence of effects of motor execution on memory consolidation is discussed in terms of the implications of these findings for the embodiment approach to cognition.

Sociality and interaction envelope organize visual action representations

Humans observe a wide range of actions in their surroundings. How is the visual cortex organized to process this diverse input? Using functional neuroimaging, we measured brain responses while participants viewed short videos of everyday actions, then probed the structure in these responses using voxel-wise encoding modeling. Responses are well fit by feature spaces that capture the body parts involved in an action and the action’s targets (i.e. whether the action was directed at an object, another person, the actor, and space). Clustering analyses reveal five large-scale networks that summarize the voxel tuning: one related to social aspects of an action, and four related to the scale of the interaction envelope, ranging from fine-scale manipulations directed at objects, to large-scale whole-body movements directed at distant locations. We propose that these networks reveal the major representational joints in how actions are processed by visual regions of the brain.

How is action perception organized in the brain? Here, the authors report evidence for five networks tuned to actions’ social content and the scale of their effect on the world and propose that sociality and interaction envelope are organizing dimensions of visual action representation.

Multimodal feature binding in object memory retrieval using event-related potentials: Implications for models of semantic memory

To test the hypothesis that semantic processes are represented in multiple subsystems, we recorded electroencephalogram (EEG) as we elicited object memories using the modified Semantic Object Retrieval Test, during which an object feature, presented as a visual word [VW], an auditory word [AW], or a picture [Pic], was followed by a second feature always presented as a visual word. We performed both hypothesis-driven and data-driven analyses using event-related potentials (ERPs) time locked to the second stimulus. We replicated a previously reported left fronto-temporal ERP effect (750-1000 ms post-stimulus) in the VW task, and also found that this ERP component was only present during object memory retrieval in verbal (VW, AW) as opposed to non-verbal (Pic) stimulus types. We also found a right temporal ERP effect (850-1000 ms post-stimulus) that was present in auditory (AW) but not in visual (VW, Pic) stimulus types. In addition, we found an earlier left temporo-parietal ERP effect between 350 and 700 ms post-stimulus and a later midline parietal ERP effect between 700 and 1100 ms post-stimulus, present in all stimulus types, suggesting common neural mechanisms for object retrieval processes and object activation, respectively. These findings support multiple semantic subsystems that respond to varying stimulus modalities, and argue against an ultimate unitary amodal semantic analysis.

Evaluating Semantic Knowledge Through a Semantic Association Task in Individuals With Dementia

Conceptual knowledge is supported by multiple semantic systems that are specialized for the analysis of different properties associated with object concepts. Various types of semantic association between concrete concepts-categorical (CA), encyclopedic (EA), functional (FA), and visual-encyclopedic (VEA) associations-were tested through a new picture-to-picture matching task (semantic association task, SAT). Forty individuals with Alzheimer's disease (AD), 13 with behavioral variant of frontotemporal dementia (bv-FTD), 6 with primary progressive aphasia (PPA), and 37 healthy participants were tested with the SAT. Within-group comparisons highlighted a global impairment of all types of semantic association in bv-FTD individuals but a disproportionate impairment of EA and FA, with relative sparing of CA and VEA, in AD individuals. Single-case analyses detected dissociations in all dementia groups. Conceptual knowledge can be selectively impaired in various types of neurodegenerative disease on the basis of the specific cognitive process that is disrupted.

Coin, telephone, and handcuffs: Neural correlates of social knowledge of inanimate objects

A variety of objects are made to serve social functions. The use of these objects has greatly enriched and expanded our social behaviors. How do our brains represent the social knowledge of inanimate objects such as coins, telephones, and handcuffs? According to a recent version of the grounded theory, social knowledge of inanimate objects might be grounded in the mentalizing network, as the social functions of inanimate objects are closely associated with the intentions of the people using them. However, there is also evidence that the mentalizing network may only get activated when a human/mental agent is detected. Using fMRI, we explored the neural correlates of social knowledge of inanimate objects by comparing the brain activation evoked by high-sociality object nouns (e.g., banknote) with that evoked by low-sociality object nouns (e.g., battery). The left anterior superior temporal sulcus, a classic part of the mentalizing network, showed higher activation for the high-sociality inanimate object nouns than for the low-sociality ones in the whole-brain analysis. Several other areas of the mentalizing network showed sensitivity to object sociality in small volume correction and/or region-of-interest analyses. Our findings indicate that social knowledge of inanimate objects is supported by brain areas in the mentalizing network.

Domain-Specific Diaschisis: Lesions to Parietal Action Areas Modulate Neural Responses to Tools in the Ventral Stream

Neural responses to small manipulable objects ("tools") in high-level visual areas in ventral temporal cortex (VTC) provide an opportunity to test how anatomically remote regions modulate ventral stream processing in a domain-specific manner. Prior patient studies indicate that grasp-relevant information can be computed about objects by dorsal stream structures independently of processing in VTC. Prior functional neuroimaging studies indicate privileged functional connectivity between regions of VTC exhibiting tool preferences and regions of parietal cortex supporting object-directed action. Here we test whether lesions to parietal cortex modulate tool preferences within ventral and lateral temporal cortex. We found that lesions to the left anterior intraparietal sulcus, a region that supports hand-shaping during object grasping and manipulation, modulate tool preferences in left VTC and in the left posterior middle temporal gyrus. Control analyses demonstrated that neural responses to "place" stimuli in left VTC were unaffected by lesions to parietal cortex, indicating domain-specific consequences for ventral stream neural responses in the setting of parietal lesions. These findings provide causal evidence that neural specificity for "tools" in ventral and lateral temporal lobe areas may arise, in part, from online inputs to VTC from parietal areas that receive inputs via the dorsal visual pathway.

What Role Does "Elongation" Play in "Tool-Specific" Activation and Connectivity in the Dorsal and Ventral Visual Streams?

Images of tools induce stronger activation than images of nontools in a left-lateralized network that includes ventral-stream areas implicated in tool identification and dorsal-stream areas implicated in tool manipulation. Importantly, however, graspable tools tend to be elongated rather than stubby, and so the tool-selective responses in some of these areas may, to some extent, reflect sensitivity to elongation rather than "toolness" per se. Using functional magnetic resonance imaging, we investigated the role of elongation in driving tool-specific activation in the 2 streams and their interconnections. We showed that in some "tool-selective" areas, the coding of toolness and elongation coexisted, but in others, elongation and toolness were coded independently. Psychophysiological interaction analysis revealed that toolness, but not elongation, had a strong modulation of the connectivity between the ventral and dorsal streams. Dynamic causal modeling revealed that viewing tools (either elongated or stubby) increased the connectivity from the ventral- to the dorsal-stream tool-selective areas, but only viewing elongated tools increased the reciprocal connectivity between these areas. Overall, these data disentangle how toolness and elongation affect the activation and connectivity of the tool network and help to resolve recent controversies regarding the relative contribution of "toolness" versus elongation in driving dorsal-stream "tool-selective" areas.

The Neural Representations of Movement across Semantic Categories

Previous evidence from neuropsychological and neuroimaging studies suggests functional specialization for tools and related semantic knowledge in a left frontoparietal network. It is still debated whether these areas are involved in the representation of rudimentary movement-relevant knowledge regardless of semantic domains (animate vs. inanimate) or categories (tools vs. nontool objects). Here, we used fMRI to record brain activity while 13 volunteers performed two semantic judgment tasks on visually presented items from three different categories: animals, tools, and nontool objects. Participants had to judge two distinct semantic features: whether two items typically move in a similar way (e.g., a fan and a windmill move in circular motion) or whether they are usually found in the same environment (e.g., a seesaw and a swing are found in a playground). We investigated differences in overall activation (which areas are involved) as well as representational content (which information is encoded) across semantic features and categories. Results of voxel-wise mass univariate analysis showed that, regardless of semantic category, a dissociation emerges between processing information on prototypical location (involving the anterior temporal cortex and the angular gyrus) and movement (linked to left inferior parietal and frontal activation). Multivoxel pattern correlation analyses confirmed the representational segregation of networks encoding task- and category-related aspects of semantic processing. Taken together, these findings suggest that the left frontoparietal network is recruited to process movement properties of items (including both biological and nonbiological motion) regardless of their semantic category.

Gesturing tool use and tool transport actions modulates inferior parietal functional connectivity with the dorsal and ventral object processing pathways

Interacting with manipulable objects (tools) requires the integration of diverse computations supported by anatomically remote regions. Previous functional neuroimaging research has demonstrated the left supramarginal (SMG) exhibits functional connectivity to both ventral and dorsal pathways, supporting the integration of ventrally-mediated tool properties and conceptual knowledge with dorsally-computed volumetric and structural representations of tools. This architecture affords us the opportunity to test whether interactions between the left SMG, ventral visual pathway, and dorsal visual pathway are differentially modulated when participants plan and generate tool-directed gestures emphasizing functional manipulation (tool use gesturing) or structure-based grasping (tool transport gesturing). We found that functional connectivity between the left SMG, ventral temporal cortex (bilateral fusiform gyri), and dorsal visual pathway (left superior parietal lobule/posterior intraparietal sulcus) was maximal for tool transport planning and gesturing, whereas functional connectivity between the left SMG, left ventral anterior temporal lobe, and left frontal operculum was maximal for tool use planning and gesturing. These results demonstrate that functional connectivity to the left SMG is differentially modulated by tool use and tool transport gesturing, suggesting that distinct tool features computed by the two object processing pathways are integrated in the parietal lobe in the service of tool-directed action.

A network view on brain regions involved in experts' object and pattern recognition: Implications for the neural mechanisms of skilled visual perception

Skilled visual object and pattern recognition form the basis of many everyday behaviours. The game of chess has often been used as a model case for studying how long-term experience aides in perceiving objects and their spatio-functional interrelations. Earlier research revealed two brain regions, posterior middle temporal gyrus (pMTG) and collateral sulcus (CoS), to be linked to chess experts' superior object and pattern recognition, respectively. Here we elucidated the brain networks these two expertise-related regions are embedded in, employing resting-state functional connectivity analysis and meta-analytic connectivity modelling with the BrainMap database. pMTG was preferentially connected with dorsal visual stream areas and a parieto-prefrontal network for action planning, while CoS was preferentially connected with posterior medial cortex and hippocampus, linked to scene perception, perspective-taking and navigation. Functional profiling using BrainMap meta-data revealed that pMTG was linked to semantic processing as well as inhibition and attention, while CoS was linked to face and shape perception as well as passive viewing. Our findings suggest that pMTG subserves skilled object recognition by mediating the link between object identity and object affordances, while CoS subserves skilled pattern recognition by linking the position of individual objects with typical spatio-functional layouts of their environment stored in memory.

Action and semantic tool knowledge - Effective connectivity in the underlying neural networks

Evidence from neuropsychological and imaging studies indicate that action and semantic knowledge about tools draw upon distinct neural substrates, but little is known about the underlying interregional effective connectivity. With fMRI and dynamic causal modeling (DCM) we investigated effective connectivity in the left-hemisphere (LH) while subjects performed (i) a function knowledge and (ii) a value knowledge task, both addressing semantic tool knowledge, and (iii) a manipulation (action) knowledge task. Overall, the results indicate crosstalk between action nodes and semantic nodes. Interestingly, effective connectivity was weakened between semantic nodes and action nodes during the manipulation task. Furthermore, pronounced modulations of effective connectivity within the fronto-parietal action system of the LH (comprising lateral occipito-temporal cortex, intraparietal sulcus, supramarginal gyrus, inferior frontal gyrus) were observed in a bidirectional manner during the processing of action knowledge. In contrast, the function and value knowledge tasks resulted in a significant strengthening of the effective connectivity between visual cortex and fusiform gyrus. Importantly, this modulation was present in both semantic tasks, indicating that processing different aspects of semantic knowledge about tools evokes similar effective connectivity patterns. Data revealed that interregional effective connectivity during the processing of tool knowledge occurred in a bidirectional manner with a weakening of connectivity between areas engaged in action and semantic knowledge about tools during the processing of action knowledge. Moreover, different semantic tool knowledge tasks elicited similar effective connectivity patterns.

Distortion of Visuo-Motor Temporal Integration in Apraxia: Evidence From Delayed Visual Feedback Detection Tasks and Voxel-Based Lesion-Symptom Mapping

Limb apraxia is a higher brain dysfunction that typically occurs after left hemispheric stroke and its cause cannot be explained by sensory disturbance or motor paralysis. The comparison of motor signals and visual feedback to generate errors, i.e., visuo-motor integration, is important in motor control and motor learning, which may be impaired in apraxia. However, in apraxia after stroke, it is unknown whether there is a specific deficit in visuo-motor temporal integration compared to visuo-tactile and visuo-proprioceptive temporal integration. We examined the precision of visuo-motor temporal integration and sensory-sensory (visuo-tactile and visuo-proprioception) temporal integration in apraxia after stroke by using a delayed visual feedback detection task with three different conditions (tactile, passive movement, and active movement). The delay detection threshold and the probability curve for delay detection obtained in this task were quantitative indicators of the respective temporal integration functions. In addition, we performed subtraction and voxel-based lesion-symptom mapping to identify the brain lesions responsible for apraxia and deficits in visuo-motor temporal integration. The behavioral experiments showed that the delay detection threshold was extended and that the probability curve for delay detection was less steep in apraxic patients compared to controls (pseudo-apraxic patients and unaffected patients), only for the active movement condition, and not for the tactile and passive movement conditions. Furthermore, the severity of apraxia was significantly correlated with the delay detection threshold and the steepness of the probability curve in the active movement condition. These results indicated that multisensory (i.e., visual, tactile, and proprioception) feedback was normally temporally integrated, but motor prediction and visual feedback were not correctly temporally integrated in apraxic patients. That is, apraxic patients had difficulties with visuo-motor temporal integration. Lesion analyses revealed that both apraxia and the distortion of visuo-motor temporal integration were associated with lesions in the fronto-parietal motor network, including the left inferior parietal lobule and left inferior frontal gyrus. We suppose that damage to the left inferior fronto-parietal network could cause deficits in motor prediction for visuo-motor temporal integration, but not for sensory-sensory (visuo-tactile and visuo-proprioception) temporal integration, leading to the distortion of visuo-motor temporal integration in patients with apraxia.

Task- and domain-specific modulation of functional connectivity in the ventral and dorsal object-processing pathways

A whole-brain network of regions collectively supports the ability to recognize and use objects-the Tool Processing Network. Little is known about how functional interactions within the Tool Processing Network are modulated in a task-dependent manner. We designed an fMRI experiment in which participants were required to either generate object pantomimes or to carry out a picture matching task over the same images of tools, while holding all aspects of stimulus presentation constant across the tasks. The Tool Processing Network was defined with an independent functional localizer, and functional connectivity within the network was measured during the pantomime and picture matching tasks. Relative to tool picture matching, tool pantomiming led to an increase in functional connectivity between ventral stream regions and left parietal and frontal-motor areas; in contrast, the matching task was associated with an increase in functional connectivity among regions in ventral temporo-occipital cortex, and between ventral temporal regions and the left inferior parietal lobule. Graph-theory analyses over the functional connectivity data indicated that the left premotor cortex and left lateral occipital complex were hub-like (exhibited high betweenness centrality) during tool pantomiming, while ventral stream regions (left medial fusiform gyrus and left posterior middle temporal gyrus) were hub-like during the picture matching task. These results demonstrate task-specific modulation of functional interactions among a common set of regions, and indicate dynamic coupling of anatomically remote regions in task-dependent manner.

Tool selection and the ventral-dorsal organization of tool-related knowledge

Tool selection is a cognitive process necessary for tool use, and may rely on distinct knowledge under different conditions. This fMRI experiment was designed to identify neural substrates mediating tool selection under different conditions. Participants performed a picture‐matching task that presented a recipient object and an action‐goal, and required the selection of the best tool object from among four candidates. Some trials allowed selection of the prototypical tool, whereas others forced selection of either a functionally substitutable or impossible tool. Statistical contrasts revealed significantly different activation between Proto and Sub conditions in frontal, parietal, and temporal lobes. The middle temporal gyrus (MTG) bilaterally, and the right posterior cingulate were more strongly activated by prototypical tool selection, and left inferior parietal lobule (IPL), intraparietal sulcus (IPS), middle frontal gyrus, and precuneus were more strongly activated when selecting substitutable objects. These findings are concordant with previous neuroimaging studies of tool use knowledge in demonstrating that activation of the MTG represents functional knowledge for conventional tool usage, and activation of the IPL/IPS supports action (i.e., praxic) knowledge representations. These results contribute to the literature that dissociates the roles of ventral and dorsal streams in tool‐related knowledge and behavior, and emphasize the role of the left hemisphere for processing goal‐directed object interactions.

Abstract Representations of Object-Directed Action in the Left Inferior Parietal Lobule

Prior neuroimaging and neuropsychological research indicates that the left inferior parietal lobule in the human brain is a critical substrate for representing object manipulation knowledge. In the present functional MRI study we used multivoxel pattern analyses to test whether action similarity among objects can be decoded in the inferior parietal lobule independent of the task applied to objects (identification or pantomime) and stimulus format in which stimuli are presented (pictures or printed words). Participants pantomimed the use of objects, cued by printed words, or identified pictures of objects. Classifiers were trained and tested across task (e.g., training data: pantomime; testing data: identification), stimulus format (e.g., training data: word format; testing format: picture) and specific objects (e.g., training data: scissors vs. corkscrew; testing data: pliers vs. screwdriver). The only brain region in which action relations among objects could be decoded across task, stimulus format and objects was the inferior parietal lobule. By contrast, medial aspects of the ventral surface of the left temporal lobe represented object function, albeit not at the same level of abstractness as actions in the inferior parietal lobule. These results suggest compulsory access to abstract action information in the inferior parietal lobe even when simply identifying objects.

Getting a handle on virtual tools: An examination of the neuronal activity associated with virtual tool use

Tool use is associated with three visual streams-dorso-dorsal, ventro-dorsal, and ventral visual streams. These streams are involved in processing online motor planning, action semantics, and tool semantics features, respectively. Little is known about the way in which the brain represents virtual tools. To directly assess this question, a virtual tool paradigm was created that provided the ability to manipulate tool components in isolation of one another. During functional magnetic resonance imaging (fMRI), adult participants performed a series of virtual tool manipulation tasks in which vision and movement kinematics of the tool were manipulated. Reaction time and hand movement direction were monitored while the tasks were performed. Functional imaging revealed that activity within all three visual streams was present, in a similar pattern to what would be expected with physical tool use. However, a previously unreported network of right-hemisphere activity was found including right inferior parietal lobule, middle and superior temporal gyri and supramarginal gyrus - regions well known to be associated with tool processing within the left hemisphere. These results provide evidence that both virtual and physical tools are processed within the same brain regions, though virtual tools recruit bilateral tool processing regions to a greater extent than physical tools.

Facilitation of Function and Manipulation Knowledge of Tools Using Transcranial Direct Current Stimulation (tDCS)

Using a variety of tools is a common and essential component of modern human life. Patients with brain damage or neurological disorders frequently have cognitive deficits in their recognition and manipulation of tools. In this study, we focused on improving tool-related cognition using transcranial direct current stimulation (tDCS). Converging evidence from neuropsychology, neuroimaging and non- invasive brain stimulation has identified the anterior temporal lobe (ATL) and inferior parietal lobule (IPL) as brain regions supporting action semantics. We observed enhanced performance in tool cognition with anodal tDCS over ATL and IPL in two cognitive tasks that require rapid access to semantic knowledge about the function or manipulation of common tools. ATL stimulation improved access to both function and manipulation knowledge of tools. The effect of IPL stimulation showed a trend toward better manipulation judgments. Our findings support previous studies of tool semantics and provide a novel approach for manipulation of underlying circuits.

Limb apraxia and the left parietal lobe

Limb apraxia is a heterogeneous disorder of skilled action and tool use that has long perplexed clinicians and researchers. It occurs after damage to various loci in a densely interconnected network of regions in the left temporal, parietal, and frontal lobes. Historically, a highly classificatory approach to the study of apraxia documented numerous patterns of performance related to two major apraxia subtypes: ideational and ideomotor apraxia. More recently, there have been advances in our understanding of the functional neuroanatomy and connectivity of the left-hemisphere "tool use network," and the patterns of performance that emerge from lesions to different loci within this network. This chapter focuses on the left inferior parietal lobe, and its role in tool and body representation, action prediction, and action selection, and how these functions relate to the deficits seen in patients with apraxia subsequent to parietal lesions. Finally, suggestions are offered for several future directions that will benefit the study of apraxia, including increased attention to research on rehabilitation of this disabling disorder.

For a cognitive neuroscience of concepts: Moving beyond the grounding issue

Cognitive neuroscience research on conceptual knowledge often is discussed with respect to "embodiment" or "grounding." We tried to disentangle at least three distinct claims made using these terms. One of these, the view that concepts are entirely reducible to sensory-motor representations, is untenable and diminishing in the literature. A second is the view that concepts and sensory-motor representations "interact," and a third view addresses the question of how concepts are neurally organized-the neural partitions among concepts of different kinds, and where these partitions are localized in cortex. We argue that towards the second and third issues, much fruitful research can be pursued, but that no position on them is specifically related to "grounding." Furthermore, to move forward on them, it is important to precisely distinguish different kinds of representations-conceptual vs. sensory-motor-from each other theoretically and empirically. Neuroimaging evidence often lacks such specificity. We take an approach that distinguishes conceptual from sensory-motor representations by virtue of two properties: broad generality and tolerance to the absence of sensory-motor associations. We review three of our recent experiments that employ these criteria in order to localize neural representations of several specific kinds of nonsensory attributes: functions, intentions, and belief traits. Building on past work, we find that neuroimaging evidence can be used fruitfully to distinguish interesting hypotheses about neural organization. On the other hand, most such evidence does not speak to any clear notion of "grounding" or "embodiment," because these terms do not make clear, specific, empirical predictions. We argue that cognitive neuroscience will proceed most fruitfully by relinquishing these terms.

Modulating Mimetic Preference with Theta Burst Stimulation of the Inferior Parietal Cortex

We like an object more when we see someone else reaching for it. To what extent is action observation causally linked to object valuation? In this study, we set out to answer to this question by applying continuous theta burst stimulation (cTBS) over the left inferior parietal lobule (IPL). Previous studies pointed to this region as critical in the representation of others' actions and in tool manipulation. However, it is unclear to what extent IPL's involvement simply reflects action observation, rather than a casual role in objects' valuation. To clarify this issue, we measured cTBS-dependent modulations of participants' “mimetic preference ratings”, i.e., the difference between the ratings of pairs of familiar objects that were (vs. were not) reached out for by other individuals. Our result shows that cTBS increased mimetic preference ratings for tools, when compared to a control condition without stimulation. This effect was selective for items that were reached for or manipulated by another individual, whilst it was not detected in non-tool objects. Although preliminary, this finding suggests that the automatic and covert simulation of an observed action, even when there is no intention to act on an object, influences explicit affective judgments for objects. This work supports embodied cognition theories by substantiating that our subjective preference is grounded in action.

Learning to tie the knot: The acquisition of functional object representations by physical and observational experience

Here we examined neural substrates for physically and observationally learning to construct novel objects, and characterized brain regions associated with each kind of learning using fMRI. Each participant was assigned a training partner, and for five consecutive days practiced tying one group of knots (“tied” condition) or watched their partner tie different knots (“watched” condition) while a third set of knots remained untrained. Functional MRI was obtained prior to and immediately following the week of training while participants performed a visual knot-matching task. After training, a portion of left superior parietal lobule demonstrated a training by scan session interaction. This means this parietal region responded selectively to knots that participants had physically learned to tie in the post-training scan session but not the pre-training scan session. A conjunction analysis on the post-training scan data showed right intraparietal sulcus and right dorsal premotor cortex to respond when viewing images of knots from the tied and watched conditions compared to knots that were untrained during the post-training scan session. This suggests that these brain areas track both physical and observational learning. Together, the data provide preliminary evidence of engagement of brain regions associated with hand-object interactions when viewing objects associated with physical experience, and with observational experience without concurrent physical practice.

Auditory object perception: A neurobiological model and prospective review

Interaction with the world is a multisensory experience, but most of what is known about the neural correlates of perception comes from studying vision. Auditory inputs enter cortex with its own set of unique qualities, and leads to use in oral communication, speech, music, and the understanding of emotional and intentional states of others, all of which are central to the human experience. To better understand how the auditory system develops, recovers after injury, and how it may have transitioned in its functions over the course of hominin evolution, advances are needed in models of how the human brain is organized to process real-world natural sounds and "auditory objects". This review presents a simple fundamental neurobiological model of hearing perception at a category level that incorporates principles of bottom-up signal processing together with top-down constraints of grounded cognition theories of knowledge representation. Though mostly derived from human neuroimaging literature, this theoretical framework highlights rudimentary principles of real-world sound processing that may apply to most if not all mammalian species with hearing and acoustic communication abilities. The model encompasses three basic categories of sound-source: (1) action sounds (non-vocalizations) produced by 'living things', with human (conspecific) and non-human animal sources representing two subcategories; (2) action sounds produced by 'non-living things', including environmental sources and human-made machinery; and (3) vocalizations ('living things'), with human versus non-human animals as two subcategories therein. The model is presented in the context of cognitive architectures relating to multisensory, sensory-motor, and spoken language organizations. The models' predictive values are further discussed in the context of anthropological theories of oral communication evolution and the neurodevelopment of spoken language proto-networks in infants/toddlers. These phylogenetic and ontogenetic frameworks both entail cortical network maturations that are proposed to at least in part be organized around a number of universal acoustic-semantic signal attributes of natural sounds, which are addressed herein.

The Neural Bases of Event Monitoring across Domains: a Simultaneous ERP-fMRI Study

The ability to check and evaluate the environment over time with the aim to detect the occurrence of target stimuli is supported by sustained/tonic as well as transient/phasic control processes, which overall might be referred to as event monitoring. The neural underpinning of sustained attentional control processes involves a fronto-parietal network. However, it has not been well-defined yet whether this cortical circuit acts irrespective of the specific material to be monitored and whether this mediates sustained as well as transient monitoring processes. In the current study, the functional activity of brain during an event monitoring task was investigated and compared between two cognitive domains, whose processing is mediated by differently lateralized areas. Namely, participants were asked to monitor sequences of either faces (supported by right-hemisphere regions) or tools (left-hemisphere). In order to disentangle sustained from transient components of monitoring, a simultaneous EEG-fMRI technique was adopted within a block design. When contrasting monitoring versus control blocks, the conventional fMRI analysis revealed the sustained involvement of bilateral fronto-parietal regions, in both task domains. Event-related potentials (ERPs) showed a more positive amplitude over frontal sites in monitoring compared to control blocks, providing evidence of a transient monitoring component. The joint ERP-fMRI analysis showed that, in the case of face monitoring, this transient component relies on right-lateralized areas, including the inferior parietal lobule and the middle frontal gyrus. In the case of tools, no fronto-parietal areas correlated with the transient ERP activity, suggesting that in this domain phasic monitoring processes were masked by tonic ones. Overall, the present findings highlight the role of bilateral fronto-parietal regions in sustained monitoring, independently of the specific task requirements, and suggest that right-lateralized areas subtend transient monitoring processes, at least in some task contexts.

The role of the motor system in action naming in patients with neurodegenerative extrapyramidal syndromes

Previous studies of patients with brain damage have suggested a close relationship between aphasia and movement disorders. Neurodegenerative extrapyramidal syndromes associated with cognitive impairment provide an interesting model for studying the neural substrates of cognitive and motor symptoms. In this review, we focused on studies investigating language production abilities in patients with Parkinson's disease (PD), Corticobasal Syndrome (CBS) and Progressive Supranuclear Palsy (PSP). According to some reports, these patients exhibit a reduction in performance in both action and object naming or verb production compared to healthy individuals. Furthermore, a disproportional impairment of action naming compared to object naming was systematically observed in patients with these disorders. The study of these clinical conditions offers the unique opportunity to examine the close link between linguistic features and motor characteristics of action. This particular pattern of language impairment may contribute to the debate on embodiment theory and on the involvement of the basal ganglia in language and in integrating language and movement. From a translational perspective, we suggest that language ability assessments are useful in the clinical work-up, along with neuropsychological and motor evaluations. Specific protocols should be developed in the near future to better characterize language deficits and to permit an early cognitive diagnosis. Moreover, the link between language deficits and motor impairment opens a new issue for treatment approaches. Treatment of one of these two symptoms may ameliorate the other, and treating both may produce a greater improvement in patients' global clinical conditions.