The representation of tool use in humans and monkeys: common and uniquely human features

Neural substrate for the engagement of the ventral visual stream in motor control in the macaque monkey

The present study aimed to describe the cortical connectivity of a sector located in the ventral bank of the superior temporal sulcus in the macaque (intermediate area TEa and TEm [TEa/m]), which appears to represent the major source of output of the ventral visual stream outside the temporal lobe. The retrograde tracer wheat germ agglutinin was injected in the intermediate TEa/m in four macaque monkeys. The results showed that 58-78% of labeled cells were located within ventral visual stream areas other than the TE complex. Outside the ventral visual stream, there were connections with the memory-related medial temporal area 36 and the parahippocampal cortex, orbitofrontal areas involved in encoding subjective values of stimuli for action selection, and eye- or hand-movement related parietal (LIP, AIP, and SII), prefrontal (12r, 45A, and 45B) areas, and a hand-related dysgranular insula field. Altogether these data provide a solid substrate for the engagement of the ventral visual stream in large scale cortical networks for skeletomotor or oculomotor control. Accordingly, the role of the ventral visual stream could go beyond pure perceptual processes and could be also finalized to the neural mechanisms underlying the control of voluntary motor behavior.

Graspable foods and tools elicit similar responses in visual cortex

The extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g. faces, scenes, and tools). Although food is primarily distinguished from other objects by its edibility, not its appearance, recent evidence suggests that there is also food selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with hands. In this context, food items share many properties with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted functional MRI and behavioral experiments to test this hypothesis. We found that graspable food items and tools were judged to be similar in their action-related properties and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food selectivity may reflect the behavioral affordances of food items rather than a distinct form of category selectivity.

The primacy of experience in language processing: Semantic priming is driven primarily by experiential similarity

The organization of semantic memory, including memory for word meanings, has long been a central question in cognitive science. Although there is general agreement that word meaning representations must make contact with sensory-motor and affective experiences in a non-arbitrary fashion, the nature of this relationship remains controversial. One prominent view proposes that word meanings are represented directly in terms of their experiential content (i.e., sensory-motor and affective representations). Opponents of this view argue that the representation of word meanings reflects primarily taxonomic structure, that is, their relationships to natural categories. In addition, the recent success of language models based on word co-occurrence (i.e., distributional) information in emulating human linguistic behavior has led to proposals that this kind of information may play an important role in the representation of lexical concepts. We used a semantic priming paradigm designed for representational similarity analysis (RSA) to quantitatively assess how well each of these theories explains the representational similarity pattern for a large set of words. Crucially, we used partial correlation RSA to account for intercorrelations between model predictions, which allowed us to assess, for the first time, the unique effect of each model. Semantic priming was driven primarily by experiential similarity between prime and target, with no evidence of an independent effect of distributional or taxonomic similarity. Furthermore, only the experiential models accounted for unique variance in priming after partialling out explicit similarity ratings. These results support experiential accounts of semantic representation and indicate that, despite their good performance at some linguistic tasks, the distributional models evaluated here do not encode the same kind of information used by the human semantic system.

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.

Cognitive neuropsychological and neuroanatomic predictors of naturalistic action performance in left hemisphere stroke: a retrospective analysis

Individuals who have experienced a left hemisphere cerebrovascular accident (LCVA) have been shown to make errors in naturalistic action tasks designed to assess the ability to perform everyday activities such as preparing a cup of coffee. Naturalistic action errors in this population are often attributed to limb apraxia, a common deficit in the representation and performance of object-related actions. However, naturalistic action impairments are also observed in right hemisphere stroke and traumatic brain injury, populations infrequently associated with apraxia, and errors across all these populations are influenced by overall severity. Based on these and other data, an alternative (though not mutually exclusive) account is that naturalistic action errors in LCVA are also a consequence of deficits in general attentional resource availability or allocation. In this study, we conducted a retrospective analysis of data from a large group of 51 individuals with LCVA who had completed a test of naturalistic action, along with a battery of tests assessing praxis, attention allocation and control, reasoning, and language abilities to determine which of these capacities contribute uniquely to naturalistic action impairments. Using a regularized regression method, we found that naturalistic action impairments are predicted by both praxis deficits (hand posture sequencing and gesture recognition), as well as attention allocation and control deficits (orienting and dividing attention), along with language comprehension ability and age. Using support vector regression-lesion symptom mapping (SVR-LSM), we also demonstrated that naturalistic action impairments are associated with lesions to posterior middle temporal gyrus and anterior inferior parietal lobule - regions known to be implicated in praxis; as well the middle frontal gyrus that has been implicated in both praxis and attention allocation and control. Taken together, these findings support the hypothesis that naturalistic action impairments in LCVA are a consequence of apraxia as well as deficits in attention allocation and control.

'Snakes and ladders' in paleoanthropology: From cognitive surprise to skillfulness a million years ago

A paradigmatic account may suffice to explain behavioral evolution in early Homo. We propose a parsimonious account that (1) could explain a particular, frequently-encountered, archeological outcome of behavior in early Homo - namely, the fashioning of a Paleolithic stone 'handaxe' - from a biological theoretic perspective informed by the free energy principle (FEP); and that (2) regards instances of the outcome as postdictive or retrodictive, circumstantial corroboration. Our proposal considers humankind evolving as a self-organizing biological ecosystem at a geological time-scale. We offer a narrative treatment of this self-organization in terms of the FEP. Specifically, we indicate how 'cognitive surprises' could underwrite an evolving propensity in early Homo to express sporadic unorthodox or anomalous behavior. This co-evolutionary propensity has left us a legacy of Paleolithic artifacts that is reminiscent of a 'snakes and ladders' board game of appearances, disappearances, and reappearances of particular archeological traces of Paleolithic behavior. When detected in the Early and Middle Pleistocene record, anthropologists and archeologists often imagine evidence of unusual or novel behavior in terms of early humankind ascending the rungs of a figurative phylogenetic 'ladder' - as if these corresponded to progressive evolution of cognitive abilities that enabled incremental achievements of increasingly innovative technical prowess, culminating in the cognitive ascendancy of Homo sapiens. The conjecture overlooks a plausible likelihood that behavior by an individual who was atypical among her conspecifics could have been disregarded in a community of Hominina (for definition see Appendix 1) that failed to recognize, imagine, or articulate potential advantages of adopting hitherto unorthodox behavior. Such failure, as well as diverse fortuitous demographic accidents, would cause exceptional personal behavior to be ignored and hence unremembered. It could disappear by a pitfall, down a 'snake', as it were, in the figurative evolutionary board game; thereby causing a discontinuity in the evolution of human behavior that presents like an evolutionary puzzle. The puzzle discomforts some paleoanthropologists trained in the natural and life sciences. They often dismiss it, explaining it away with such self-justifying conjectures as that, maybe, separate paleospecies of Homo differentially possessed different cognitive abilities, which, supposedly, could account for the presence or absence in the Pleistocene archeological record of traces of this or that behavioral outcome or skill. We argue that an alternative perspective - that inherits from the FEP and an individual's 'active inference' about its surroundings and of its own responses - affords a prosaic, deflationary, and parsimonious way to account for appearances, disappearances, and reappearances of particular behavioral outcomes and skills of early humankind.

Domestic dogs as a comparative model for social neuroscience: Advances and challenges

Dogs and humans have lived together for thousands of years and share many analogous socio-cognitive skills. Dog neuroimaging now provides insight into the neural bases of these shared social abilities. Here, we summarize key findings from dog fMRI identifying neocortical brain areas implicated in visual social cognition, such as face, body, and emotion perception, as well as action observation in dogs. These findings provide converging evidence that the temporal cortex plays a significant role in visual social cognition in dogs. We further briefly review investigations into the neural base of the dog-human relationship, mainly involving limbic brain regions. We then discuss current challenges in the field, such as statistical power and lack of common template spaces, and how to overcome them. Finally, we argue that the foundation has now been built to investigate and compare the neural bases of more complex socio-cognitive phenomena shared by dogs and humans. This will strengthen and expand the role of the domestic dog as a powerful comparative model species and provide novel insights into the evolutionary roots of social cognition.

Comparative Analysis of Human-Chimpanzee Divergence in Brain Connectivity and its Genetic Correlates

Chimpanzees (Pan troglodytes) are humans' closest living relatives, making them the most directly relevant comparison point for understanding human brain evolution. Zeroing in on the differences in brain connectivity between humans and chimpanzees can provide key insights into the specific evolutionary changes that might have occured along the human lineage. However, conducting comparisons of brain connectivity between humans and chimpanzees remains challenging, as cross-species brain atlases established within the same framework are currently lacking. Without the availability of cross-species brain atlases, the region-wise connectivity patterns between humans and chimpanzees cannot be directly compared. To address this gap, we built the first Chimpanzee Brainnetome Atlas (ChimpBNA) by following a well-established connectivity-based parcellation framework. Leveraging this new resource, we found substantial divergence in connectivity patterns across most association cortices, notably in the lateral temporal and dorsolateral prefrontal cortex between the two species. Intriguingly, these patterns significantly deviate from the patterns of cortical expansion observed in humans compared to chimpanzees. Additionally, we identified regions displaying connectional asymmetries that differed between species, likely resulting from evolutionary divergence. Genes associated with these divergent connectivities were found to be enriched in cell types crucial for cortical projection circuits and synapse formation. These genes exhibited more pronounced differences in expression patterns in regions with higher connectivity divergence, suggesting a potential foundation for brain connectivity evolution. Therefore, our study not only provides a fine-scale brain atlas of chimpanzees but also highlights the connectivity divergence between humans and chimpanzees in a more rigorous and comparative manner and suggests potential genetic correlates for the observed divergence in brain connectivity patterns between the two species. This can help us better understand the origins and development of uniquely human cognitive capabilities.

Graspable foods and tools elicit similar responses in visual cortex

Extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g., faces, scenes, and tools). The dominant interpretation of these effects is that they reflect activation of distinct "category-selective" brain regions specialized to represent these and other stimulus categories. We sought to explore an alternative perspective: that the response to these stimuli is determined less by whether they form distinct categories, and more by their relevance to different forms of natural behavior. In this regard, food is an interesting test case, since it is primarily distinguished from other objects by its edibility, not its appearance, and there is evidence of food-selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with the hands. In this context, food items share many properties in common with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted fMRI and behavioral experiments to test this hypothesis. We found that behaviorally graspable food items and tools were judged to be similar in their action-related properties, and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food-selectivity may reflect the behavioral affordances of food items rather than a distinct form of category-selectivity.

Unraveling tactile categorization and decision-making in the subregions of supramarginal gyrus via direct cortical stimulation

OBJECTIVE

This study aims to investigate the potential of direct cortical stimulation (DCS) to modulate tactile categorization and decision-making, as well as to identify the specific locations where these cognitive functions occur.

METHODS

We analyzed behavioral changes in three epilepsy patients with implanted electrodes using electrocorticography (ECoG) and a vibrotactile discrimination task. DCS was applied to investigate its impact on tactile categorization and decision-making processes. We determined the precise location of the electrodes where each cognitive function was modulated.

RESULTS

This functional discrimination was related with gamma band activity from ECoG. DCS selectively affected either tactile categorization or decision-making processes. Tactile categorization was modulated by stimulating the rostral part of the supramarginal gyrus, while decision-making was modulated by stimulating the caudal part.

CONCLUSIONS

DCS can enhance cognitive processes and map brain regions responsible for tactile categorization and decision-making within the supramarginal gyrus. This study also demonstrates that DCS and the gamma activity of ECoG can concordantly identify the detailed brain mapping in a tactile process compared to other functional neuroimaging.

SIGNIFICANCE

The combination of DCS and ECoG gamma activity provides a more nuanced and detailed understanding of brain function than traditional neuroimaging techniques alone.

Hemispheric lateralization of language processing: insights from network-based symptom mapping and patient subgroups

The hemispheric laterality of language processing has become a hot topic in modern neuroscience. Although most previous studies have reported left-lateralized language processing, other studies found it to be bilateral. A previous neurocomputational model has proposed a unified framework to explain that the above discrepancy might be from healthy and patient individuals. This model posits an initial symmetry but imbalanced capacity in language processing for healthy individuals, with this imbalance contributing to language recovery disparities following different hemispheric injuries. The present study investigated this model by analyzing the lateralization patterns of language subnetworks across multiple attributes with a group of 99 patients (compared to nonlanguage processing) and examining the lateralization patterns of language subnetworks in subgroups with damage to different hemispheres. Subnetworks were identified using a whole-brain network-based lesion-symptom mapping method, and the lateralization index was quantitatively measured. We found that all the subnetworks in language processing were left-lateralized, while subnetworks in nonlanguage processing had different lateralization patterns. Moreover, diverse hemisphere-injury subgroups exhibited distinct language recovery effects. These findings provide robust support for the proposed neurocomputational model of language processing.

The Primacy of Experience in Language Processing: Semantic Priming Is Driven Primarily by Experiential Similarity

The organization of semantic memory, including memory for word meanings, has long been a central question in cognitive science. Although there is general agreement that word meaning representations must make contact with sensory-motor and affective experiences in a non-arbitrary fashion, the nature of this relationship remains controversial. One prominent view proposes that word meanings are represented directly in terms of their experiential content (i.e., sensory-motor and affective representations). Opponents of this view argue that the representation of word meanings reflects primarily taxonomic structure, that is, their relationships to natural categories. In addition, the recent success of language models based on word co-occurrence (i.e., distributional) information in emulating human linguistic behavior has led to proposals that this kind of information may play an important role in the representation of lexical concepts. We used a semantic priming paradigm designed for representational similarity analysis (RSA) to quantitatively assess how well each of these theories explains the representational similarity pattern for a large set of words. Crucially, we used partial correlation RSA to account for intercorrelations between model predictions, which allowed us to assess, for the first time, the unique effect of each model. Semantic priming was driven primarily by experiential similarity between prime and target, with no evidence of an independent effect of distributional or taxonomic similarity. Furthermore, only the experiential models accounted for unique variance in priming after partialling out explicit similarity ratings. These results support experiential accounts of semantic representation and indicate that, despite their good performance at some linguistic tasks, the distributional models evaluated here do not encode the same kind of information used by the human semantic system.

Cortico-spinal modularity in the parieto-frontal system: A new perspective on action control

Classical neurophysiology suggests that the motor cortex (MI) has a unique role in action control. In contrast, this review presents evidence for multiple parieto-frontal spinal command modules that can bypass MI. Five observations support this modular perspective: (i) the statistics of cortical connectivity demonstrate functionally-related clusters of cortical areas, defining functional modules in the premotor, cingulate, and parietal cortices; (ii) different corticospinal pathways originate from the above areas, each with a distinct range of conduction velocities; (iii) the activation time of each module varies depending on task, and different modules can be activated simultaneously; (iv) a modular architecture with direct motor output is faster and less metabolically expensive than an architecture that relies on MI, given the slow connections between MI and other cortical areas; (v) lesions of the areas composing parieto-frontal modules have different effects from lesions of MI. Here we provide examples of six cortico-spinal modules and functions they subserve: module 1) arm reaching, tool use and object construction; module 2) spatial navigation and locomotion; module 3) grasping and observation of hand and mouth actions; module 4) action initiation, motor sequences, time encoding; module 5) conditional motor association and learning, action plan switching and action inhibition; module 6) planning defensive actions. These modules can serve as a library of tools to be recombined when faced with novel tasks, and MI might serve as a recombinatory hub. In conclusion, the availability of locally-stored information and multiple outflow paths supports the physiological plausibility of the proposed modular perspective.

Digital Intentions in the Fingers: I Know What You Are Doing with Your Smartphone

Every day, we make thousands of finger movements on the touchscreen of our smartphones. The same movements might be directed at various distal goals. We can type "What is the weather in Rome?" in Google to acquire information from a weather site, or we may type it on WhatsApp to decide whether to visit Rome with a friend. In this study, we show that by watching an agent's typing hands, an observer can infer whether the agent is typing on the smartphone to obtain information or to share it with others. The probability of answering correctly varies with age and typing style. According to embodied cognition, we propose that the recognition process relies on detecting subtle differences in the agent's movement, a skill that grows with sensorimotor competence. We expect that this preliminary work will serve as a starting point for further research on sensorimotor representations of digital actions.

Functional characterization of macaque insula using task-based and resting-state fMRI

Neurophysiological investigations over the past decades have demonstrated the involvement of the primate insula in a wide array of sensory, cognitive, affective and regulatory functions, yet the complex functional organization of the insula remains unclear. Here we examined to what extent non-invasive task-based and resting-state fMRI provides support for functional specialization and integration of sensory and motor information in the macaque insula. Task-based fMRI experiments suggested a functional specialization related to processing of ingestive/taste/distaste information in anterior insula, grasping-related sensorimotor responses in middle insula and vestibular information in posterior insula. Visual stimuli depicting social information involving conspecific`s lip-smacking gestures yielded responses in middle and anterior portions of dorsal and ventral insula, overlapping partially with the sensorimotor and ingestive/taste/distaste fields. Functional specialization/integration of the insula was further corroborated by seed-based whole brain resting-state analyses, showing distinct functional connectivity gradients across the anterio-posterior extent of both dorsal and ventral insula. Posterior insula showed functional correlations in particular with vestibular/optic flow network regions, mid-dorsal insula with vestibular/optic flow as well as parieto-frontal regions of the sensorimotor grasping network, mid-ventral insula with social/affiliative network regions in temporal, cingulate and prefrontal cortices and anterior insula with taste and mouth motor networks including premotor and frontal opercular regions.

Left anterior supramarginal gyrus activity during tool use action observation after extensive tool use training

The advanced use of complex tools is considered a primary characteristic of human evolution and technological advancement. However, questions remain regarding whether humans possess unique underlying brain networks that support advanced tool-using abilities. Specifically, previous studies have demonstrated the presence of a structurally and functionally unique region in the left anterior supramarginal gyrus (aSMG), that is consistently active during tool use action observation. This region has been proposed as a primary hub for integrating semantic and technical information to form action plans with tools. However, it is still largely unknown how tool use motor learning affects left aSMG activation or connectivity with other brain regions. To address this, participants with little experience using chopsticks observed an experimenter using chopsticks to perform a novel task while undergoing two functional magnetic resonance imaging (fMRI) scans. Between the scans, participants underwent four weeks of behavioral training where they learned to use chopsticks and achieve proficiency in the observed task. Results demonstrated a significant change in effective connectivity between the left aSMG and the left anterior intraparietal sulcus (aIPS), a region involved in object affordances and planning grasping actions. These findings suggest that during unfamiliar tool use, the left aSMG integrates semantic and technical information to communicate with regions involved with grasp selection, such as the aIPS. This communication then allows appropriate grasps to be planned based on the physical properties of the objects involved and their potential interactions.

From fossils to mind

Fossil endocasts record features of brains from the past: size, shape, vasculature, and gyrification. These data, alongside experimental and comparative evidence, are needed to resolve questions about brain energetics, cognitive specializations, and developmental plasticity. Through the application of interdisciplinary techniques to the fossil record, paleoneurology has been leading major innovations. Neuroimaging is shedding light on fossil brain organization and behaviors. Inferences about the development and physiology of the brains of extinct species can be experimentally investigated through brain organoids and transgenic models based on ancient DNA. Phylogenetic comparative methods integrate data across species and associate genotypes to phenotypes, and brains to behaviors. Meanwhile, fossil and archeological discoveries continuously contribute new knowledge. Through cooperation, the scientific community can accelerate knowledge acquisition. Sharing digitized museum collections improves the availability of rare fossils and artifacts. Comparative neuroanatomical data are available through online databases, along with tools for their measurement and analysis. In the context of these advances, the paleoneurological record provides ample opportunity for future research. Biomedical and ecological sciences can benefit from paleoneurology's approach to understanding the mind as well as its novel research pipelines that establish connections between neuroanatomy, genes and behavior.

F = ma. Is the macaque brain Newtonian?

Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.

Coevolution of language and tools in the human brain: An ALE meta-analysis of neural activation during syntactic processing and tool use

Language and complex tool use are often cited as behaviors unique to humans and may be evolutionarily linked owing to the underlying cognitive processes they have in common. We executed a quantitative activation likelihood estimation (ALE) meta-analysis (GingerALE 2.3) on published, whole-brain neuroimaging studies to identify areas associated with syntactic processing and/or tool use in humans. Significant clusters related to syntactic processing were identified in areas known to be related to language production and comprehension, including bilateral Broca's area in the inferior frontal gyrus. Tool use activation clusters were all in the left hemisphere and included the primary motor cortex and premotor cortex, in addition to other areas involved with sensorimotor transformation. Activation shared by syntactic processing and tool use was only significant at one cluster, located in the pars opercularis of the left inferior frontal gyrus. This minimal overlap between syntactic processing and tool use activation from our meta-analysis of neuroimaging studies indicates that there is not a widespread common neural network between the two. Broca's area may serve as an important hub that was initially recruited in early human evolution in the context of simple tool use, but was eventually co-opted for linguistic purposes, including the sequential and hierarchical ordering processes that characterize syntax. In the future, meta-analyses of additional components of language may allow for a more comprehensive examination of the functional networks that underlie the coevolution of human language and complex tool use.

Evidence of motor resonance in stroke patients with severe upper limb function impairments

For the past fifteen years, observation of actions has proved to be effective in the motor rehabilitation of stroke. Despite this, no evidence has ever been provided that this practice is able to activate the efferent motor system of a limb unable to perform the observed action due to stroke. In fact, transcranial magnetic stimulation cannot easily be used in these patients, and the fMRI evidence is inconclusive. This creates a logical problem, as the effectiveness of action observation in functional recovery is attributed to its ability to evoke action simulation, up to sub-threshold muscle activation (i.e., motor resonance), in healthy individuals. To provide the necessary proof-of-concept, patients with severe upper limb function impairments and matched control participants were submitted to a verified action prediction paradigm. They were asked to watch videos showing gripping movements towards a graspable or an ungraspable object, and to press a button the instant the agent touched the object. The presence of more accurate responses for the graspable object trials is considered an indirect evidence of motor resonance. Participants were required to perform the task in two sessions which differed in the hand used to respond. Despite the serious difficulty of movement, 8 out of 18 patients were able to perform the task with their impaired hand. We found that the responses given by the paretic hand showed a modulation of the action prediction time no different from that showed by the non-paretic hand, which, in turn, did not differ from that showed by the matched control participants. The present proof-of-concept study shows that action observation involves the efferent motor system even when the hand used to respond is unable to perform the observed action due to a cortical lesion, providing the missing evidence to support the already established use of Action Observation Training (AOT) in motor rehabilitation of stroke.

Disentangling Object Category Representations Driven by Dynamic and Static Visual Input

Humans can label and categorize objects in a visual scene with high accuracy and speed, a capacity well characterized with studies using static images. However, motion is another cue that could be used by the visual system to classify objects. To determine how motion-defined object category information is processed by the brain in the absence of luminance-defined form information, we created a novel stimulus set of "object kinematograms" to isolate motion-defined signals from other sources of visual information. Object kinematograms were generated by extracting motion information from videos of 6 object categories and applying the motion to limited-lifetime random dot patterns. Using functional magnetic resonance imaging (fMRI) (n = 15, 40% women), we investigated whether category information from the object kinematograms could be decoded within the occipitotemporal and parietal cortex and evaluated whether the information overlapped with category responses to static images from the original videos. We decoded object category for both stimulus formats in all higher-order regions of interest (ROIs). More posterior occipitotemporal and ventral regions showed higher accuracy in the static condition, while more anterior occipitotemporal and dorsal regions showed higher accuracy in the dynamic condition. Further, decoding across the two stimulus formats was possible in all regions. These results demonstrate that motion cues can elicit widespread and robust category responses on par with those elicited by static luminance cues, even in ventral regions of visual cortex that have traditionally been associated with primarily image-defined form processing.SIGNIFICANCE STATEMENT Much research on visual object recognition has focused on recognizing objects in static images. However, motion is a rich source of information that humans might also use to categorize objects. Here, we present the first study to compare neural representations of several animate and inanimate objects when category information is presented in two formats: static cues or isolated dynamic motion cues. Our study shows that, while higher-order brain regions differentially process object categories depending on format, they also contain robust, abstract category representations that generalize across format. These results expand our previous understanding of motion-derived animate and inanimate object category processing and provide useful tools for future research on object category processing driven by multiple sources of visual information.

The parietal lobe evolution and the emergence of material culture in the human genus

Traditional and new disciplines converge in suggesting that the parietal lobe underwent a considerable expansion during human evolution. Through the study of endocasts and shape analysis, paleoneurology has shown an increased globularity of the braincase and bulging of the parietal region in modern humans, as compared to other human species, including Neandertals. Cortical complexity increased in both the superior and inferior parietal lobules. Emerging fields bridging archaeology and neuroscience supply further evidence of the involvement of the parietal cortex in human-specific behaviors related to visuospatial capacity, technological integration, self-awareness, numerosity, mathematical reasoning and language. Here, we complement these inferences on the parietal lobe evolution, with results from more classical neuroscience disciplines, such as behavioral neurophysiology, functional neuroimaging, and brain lesions; and apply these to define the neural substrates and the role of the parietal lobes in the emergence of functions at the core of material culture, such as tool-making, tool use and constructional abilities.

Cytoarchitecture, myeloarchitecture, and parcellation of the chimpanzee inferior parietal lobe

The parietal lobe is a region of especially pronounced change in human brain evolution. Based on comparative neuroanatomical studies, the inferior parietal lobe (IPL) has been shown to be disproportionately larger in humans relative to chimpanzees and macaques. However, it remains unclear whether the underlying histological architecture of IPL cortical areas displays human-specific organization. Chimpanzees are among the closest living relatives of humans, making them an ideal comparative species to investigate potential evolutionary changes in the IPL. We parcellated the chimpanzee IPL using cytoarchitecture and myeloarchitecture, in combination with quantitative comparison of cellular features between the identified cortical areas. Four major areas on the lateral convexity of the chimpanzee IPL (PF, PFG, PG, OPT) and two opercular areas (PFOP, PGOP) were identified, similar to what has been observed in macaques. Analysis of the quantitative profiles of cytoarchitecture showed that cell profile density was significantly different in a combination of layers III, IV, and V between bordering cortical areas, and that the density profiles of these six areas supports their classification as distinct. The similarity to macaque IPL cytoarchitecture suggests that chimpanzees share homologous IPL areas. In comparison, human rostral IPL is reported to differ in its anatomical organization and to contain additional subdivisions, such as areas PFt and PFm. These changes in human brain evolution might have been important as tool making capacities became more complex.

“Natural Laboratory Complex” for novel primate neuroscience

We propose novel strategies for primate experimentation that are ethically valuable and pragmatically useful for cognitive neuroscience and neuropsychiatric research. Specifically, we propose Natural Laboratory Complex or Natural Labs, which are a combination of indoor-outdoor structures for studying free moving and socially housed primates in natural or naturalistic environment. We contend that Natural Labs are pivotal to improve primate welfare, and at the same time to implement longitudinal and socio-ecological studies of primate brain and behavior. Currently emerging advanced technologies and social systems (including recent COVID-19 induced “remote” infrastructures) can speed-up cognitive neuroscience approaches in freely behaving animals. Experimental approaches in natural(istic) settings are not in competition with conventional approaches of laboratory investigations, and could establish several benefits at the ethical, experimental, and economic levels.

Does hand modulate the reshaping of the attentional system during rightward prism adaptation? An fMRI study

Adaptation to right-deviating prisms (R-PA), that is, learning to point with the right hand to targets perceived through prisms, has been shown to change spatial topography within the inferior parietal lobule (IPL) by increasing responses to left, central, and right targets on the left hemisphere and decreasing responses to right and central targets on the right hemisphere. As pointed out previously, this corresponds to a switch of the dominance of the ventral attentional network from the right to the left hemisphere. Since the encoding of hand movements in pointing paradigms is side-dependent, the choice of right vs. left hand for pointing during R-PA may influence the visuomotor adaptation process and hence the reshaping of the attentional system. We have tested this hypothesis in normal subjects by comparing activation patterns to visual targets in left, central, and right fields elicited before and after adaptation to rightward-deviating prisms using the right hand (RWRH) with those in two control groups. The first control group underwent adaptation to rightward-deviating prisms using the left hand, whereas the second control group underwent adaptation to leftward-deviating prisms using the right hand. The present study confirmed the previously described enhancement of left and central visual field representation within left IPL following R-PA. It further showed that the use of right vs. left hand during adaptation modulates this enhancement in some but not all parts of the left IPL. Interestingly, in some clusters identified in this study, L-PA with right hand mimics partially the effect of R-PA by enhancing activation elicited by left stimuli in the left IPL and by decreasing activation elicited by right stimuli in the right IPL. Thus, the use of right vs. left hand modulates the R-PA-induced reshaping of the ventral attentional system. Whether the choice of hand during R-PA affects also the reshaping of the dorsal attentional system remains to be determined as well as possible clinical applications of this approach. Depending on the patients' conditions, using the right or the left hand during PA might potentiate the beneficial effects of this intervention.

Complex tools and motor-to-mechanical transformations

The ability to use complex tools is thought to depend on multifaceted motor-to-mechanical transformations within the left inferior parietal lobule (IPL), linked to cognitive control over compound actions. Here we show using neuroimaging that demanding transformations of finger movements into proper mechanical movements of functional parts of complex tools invoke significantly the right rather than left rostral IPL, and bilateral posterior-to-mid and left anterior intraparietal sulci. These findings emerged during the functional grasp and tool-use programming phase. The expected engagement of left IPL was partly revealed by traditional region-of-interest analyses, and further modeling/estimations at the hand-independent level. Thus, our results point to a special role of right IPL in supporting sensory-motor spatial mechanisms which enable an effective control of fingers in skillful handling of complex tools. The resulting motor-to-mechanical transformations involve dynamic hand-centered to target-centered reference frame conversions indispensable for efficient interactions with the environment.

Phenotypic and genetic associations between gray matter covariation and tool use skill in chimpanzees (Pan troglodytes): Repeatability in two genetically isolated populations

Humans and chimpanzees both exhibit a diverse set of tool use skills which suggests selection for tool manufacture and use occurred in the common ancestors of the two species. Our group has previously reported phenotypic and genetic associations between tool use skill and gray matter covariation, as quantified by source-based morphometry (SBM), in chimpanzees. As a follow up study, here we evaluated repeatability in heritability in SBM components and their phenotypic association with tool use skill in two genetically independent chimpanzee cohorts. Within the two independent cohorts of chimpanzees, we identified 8 and 16 SBM components, respectively. Significant heritability was evident for multiple SBM components within both cohorts. Further, phenotypic associations between tool use performance and the SBM components were largely consistent between the two cohorts; the most consistent finding being an association between tool use performance and an SBM component including the posterior superior temporal sulcus (STS) and superior temporal gyrus (STG), and the interior and superior parietal regions (p< 0.05). These findings indicate that the STS, STG, and parietal cortices are phenotypically and genetically implicated in chimpanzee tool use abilities.

Brain intrinsic connection patterns underlying tool processing in human adults are present in neonates and not in macaques

Tool understanding and use are supported by a dedicated left-lateralized, intrinsically connected network in the human adult brain. To examine this network’s phylogenetic and ontogenetic origins, we compared resting-state functional connectivity (rsFC) among regions subserving tool processing in human adults to rsFC among homologous regions in human neonates and macaque monkeys (adolescent and mature). These homologous regions formed an intrinsic network in human neonates, but not in macaques. Network topological patterns were highly similar between human adults and neonates, and significantly less so between humans and macaques. The premotor-parietal rsFC had most significant contribution to the formation of the neonatal tool network. These results suggest that an intrinsic brain network potentially supporting tool processing exists in the human brain prior to individual tool use experiences, and that the premotor-parietal functional connection in particular offers a brain basis for complex tool behaviors specific to humans.

Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human

The cortical grasp network encodes planning and execution of grasps and processes spoken and written aspects of language. High-level cortical areas within this network are attractive implant sites for brain-machine interfaces (BMIs). While a tetraplegic patient performed grasp motor imagery and vocalized speech, neural activity was recorded from the supramarginal gyrus (SMG), ventral premotor cortex (PMv), and somatosensory cortex (S1). In SMG and PMv, five imagined grasps were well represented by firing rates of neuronal populations during visual cue presentation. During motor imagery, these grasps were significantly decodable from all brain areas. During speech production, SMG encoded both spoken grasp types and the names of five colors. Whereas PMv neurons significantly modulated their activity during grasping, SMG's neural population broadly encoded features of both motor imagery and speech. Together, these results indicate that brain signals from high-level areas of the human cortex could be used for grasping and speech BMI applications.

The Semantics of Natural Objects and Tools in the Brain: A Combined Behavioral and MEG Study

Current literature supports the notion that the recognition of objects, when visually presented, is sub-served by neural structures different from those responsible for the semantic processing of their nouns. However, embodiment foresees that processing observed objects and their verbal labels should share similar neural mechanisms. In a combined behavioral and MEG study, we compared the modulation of motor responses and cortical rhythms during the processing of graspable natural objects and tools, either verbally or pictorially presented. Our findings demonstrate that conveying meaning to an observed object or processing its noun similarly modulates both motor responses and cortical rhythms; being natural graspable objects and tools differently represented in the brain, they affect in a different manner both behavioral and MEG findings, independent of presentation modality. These results provide experimental evidence that neural substrates responsible for conveying meaning to objects overlap with those where the object is represented, thus supporting an embodied view of semantic processing.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Functional connectivity evidence for state-independent executive function deficits in patients with major depressive disorder

BACKGROUND

Persistent neurocognitive deficits are often associated with poor outcomes of major depressive disorder (MDD). Executive dysfunction is the most common cognitive deficit in MDD. However, it remains unclear which subcomponent of executive dysfunction is state-independent with distinct neural substrates.

METHODS

A comprehensive neurocognitive test battery was used to assess four subcomponents of executive function (working memory, inhibition, shifting, and verbal fluency) in 95 MDD patients and 111 matched healthy controls (HCs). After 6 months of paroxetine treatment, 56 patients achieved clinical remission (rMDD) and completed the second-time neurocognitive test. Network-based statistics analysis was utilized to explore the changes in functional connectivity (FC).

RESULTS

Compared with the HCs, all the four subcomponents of MDD patients were significantly impaired. After treatment, there was a significant improvement in working memory, inhibition, and verbal fluency in the rMDD group. And shifting and verbal fluency of the rMDD group remained impaired compared with the HCs. Fifteen functional connections were interrupted in the MDD group, and 11 connections remained in a disrupted state after treatment. Importantly, verbal fluency was negatively correlated with the disrupted FC between the right dorsal prefrontal cortex and the left inferior parietal lobule in patients with MDD and remitted MDD.

LIMITATIONS

The correlation analysis of the association between cognitive impairment and connectivity alterations precluded us from making causal inferences.

CONCLUSIONS

Verbal fluency is the potential state-independent cognitive deficit with distinct neural basis in patients with MDD.

The unique role of parietal cortex in action observation: Functional organization for communicative and manipulative actions

Action observation is supported by a network of regions in occipito-temporal, parietal, and premotor cortex in primates. Recent research suggests that the parietal node has regions dedicated to different action classes including manipulation, interpersonal interactions, skin displacement, locomotion, and climbing. The goals of the current study consist of: 1) extending this work with new classes of actions that are communicative and specific to humans, 2) investigating how parietal cortex differs from the occipito-temporal and premotor cortex in representing action classes. Human subjects underwent fMRI scanning while observing three action classes: indirect communication, direct communication, and manipulation, plus two types of control stimuli, static controls which were static frames from the video clips, and dynamic controls consisting of temporally-scrambled optic flow information. Using univariate analysis, MVPA, and representational similarity analysis, our study presents several novel findings. First, we provide further evidence for the anatomical segregation in parietal cortex of different action classes: We have found a new site that is specific for representing human-specific indirect communicative actions in cytoarchitectonic parietal area PFt. Second, we found that the discriminability between action classes was higher in parietal cortex than the other two levels suggesting the coding of action identity information at this level. Finally, our results advocate the use of the control stimuli not just for univariate analysis of complex action videos but also when using multivariate techniques.

Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.

Cross-species neuroscience: closing the explanatory gap

Neuroscience has seen substantial development in non-invasive methods available for investigating the living human brain. However, these tools are limited to coarse macroscopic measures of neural activity that aggregate the diverse responses of thousands of cells. To access neural activity at the cellular and circuit level, researchers instead rely on invasive recordings in animals. Recent advances in invasive methods now permit large-scale recording and circuit-level manipulations with exquisite spatio-temporal precision. Yet, there has been limited progress in relating these microcircuit measures to complex cognition and behaviour observed in humans. Contemporary neuroscience thus faces an explanatory gap between macroscopic descriptions of the human brain and microscopic descriptions in animal models. To close the explanatory gap, we propose adopting a cross-species approach. Despite dramatic differences in the size of mammalian brains, this approach is broadly justified by preserved homology. Here, we outline a three-armed approach for effective cross-species investigation that highlights the need to translate different measures of neural activity into a common space. We discuss how a cross-species approach has the potential to transform basic neuroscience while also benefiting neuropsychiatric drug development where clinical translation has, to date, seen minimal success. This article is part of the theme issue 'Key relationships between non-invasive functional neuroimaging and the underlying neuronal activity'.

It's not all about looks: The role of object shape in parietal representations of manual tools

The ability to build and expertly manipulate manual tools sets humans apart from other animals. Watching images of manual tools has been shown to elicit a distinct pattern of neural activity in a network of parietal areas, assumingly because tools entail a potential for action-a unique feature related to their functional use and not shared with other manipulable objects. However, a question has been raised whether this selectivity reflects a processing of low-level visual properties-such as elongated shape that is idiosyncratic to most tool-objects-rather than action-specific features. To address this question, we created and behaviourally validated a stimulus set that dissociates objects that are manipulable and nonmanipulable, as well as objects with different degrees of body extension property (tools and non-tools), while controlling for object shape and low-level image properties. We tested the encoding of action-related features by investigating neural representations in two parietal regions of interest (intraparietal sulcus and superior parietal lobule) using functional MRI. Univariate differences between tools and non-tools were not observed when controlling for visual properties, but strong evidence for the action account was nevertheless revealed when using a multivariate approach. Overall, this study provides further evidence that the representational content in the dorsal visual stream reflects encoding of action-specific properties.

Neural Processes Underlying Tool Use in Humans, Macaques, and Corvids

It was thought that tool use in animals is an adaptive specialization. Recent studies, however, have shown that some non-tool-users, such as rooks and jays, can use and manufacture tools in laboratory settings. Despite the abundant evidence of tool use in corvids, little is known about the neural mechanisms underlying tool use in this family of birds. This review summarizes the current knowledge on the neural processes underlying tool use in humans, macaques and corvids. We suggest a possible neural network for tool use in macaques and hope this might inspire research to discover a similar brain network in corvids. We hope to establish a framework to elucidate the neural mechanisms that supported the convergent evolution of tool use in birds and mammals.

Motor resonance in monkey parietal and premotor cortex during action observation: Influence of viewing perspective and effector identity

Observing others performing motor acts like grasping has been shown to elicit neural responses in the observer`s parieto-frontal motor network, which typically becomes active when the observer would perform these actions him/herself. While some human studies suggested strongest motor resonance during observation of first person or egocentric perspectives compared to third person or allocentric perspectives, other research either report the opposite or did not find any viewpoint-related preferences in parieto-premotor cortices. Furthermore, it has been suggested that these motor resonance effects are lateralized in the parietal cortex depending on the viewpoint and identity of the observed effector (left vs right hand). Other studies, however, do not find such straightforward hand identity dependent motor resonance effects. In addition to these conflicting findings in human studies, to date, little is known about the modulatory role of viewing perspective and effector identity (left or right hand) on motor resonance effects in monkey parieto-premotor cortices. Here, we investigated the extent to which different viewpoints of observed conspecific hand actions yield motor resonance in rhesus monkeys using fMRI. Observing first person, lateral and third person viewpoints of conspecific hand actions yielded significant activations throughout the so-called action observation network, including STS, parietal and frontal cortices. Although region-of-interest analysis of parietal and premotor motor/mirror neuron regions AIP, PFG and F5, showed robust responses in these regions during action observation in general, a clear preference for egocentric or allocentric perspectives was not evident. Moreover, except for lateralized effects due to visual field biases, motor resonance in the monkey brain during grasping observation did not reflect hand identity dependent coding.

A parietal region processing numerosity of observed actions: An FMRI study

When observing others' behavior, it is important to perceive not only the identity of the observed actions (OAs), but also the number of times they were performed. Given the mounting evidence implicating posterior parietal cortex in action observation, and in particular that of manipulative actions, the aim of this study was to identify the parietal region, if any, that contributes to the processing of observed manipulative action (OMA) numerosity, using the functional magnetic resonance imaging technique. Twenty‐one right‐handed healthy volunteers performed two discrimination tasks while in the scanner, responding to video stimuli in which an actor performed manipulative actions on colored target balls that appeared four times consecutively. The subjects discriminated between two small numerosities of either OMAs (“Action” condition) or colors of balls (“Ball” condition). A significant difference between the “Action” and “Ball” conditions was observed in occipito‐temporal cortex and the putative human anterior intraparietal sulcus (phAIP) area as well as the third topographic map of numerosity‐selective neurons at the post‐central sulcus (NPC3) of the left parietal cortex. A further region of interest analysis of the group‐average data showed that at the single voxel level the latter area, more than any other parietal or occipito‐temporal numerosity map, favored numerosity of OAs. These results suggest that phAIP processes the identity of OMAs, while neighboring NPC3 likely processes the numerosity of the identified OAs.

Distinct auditory and visual tool regions with multisensory response properties in human parietal cortex

Left parietal cortex has been associated with the human-specific ability of sophisticated tool use. Yet, it is unclear how tool information is represented across senses. Here, we compared auditory and visual tool-specific activations within healthy human subjects to probe the relation of tool-specific networks, uni- and multisensory response properties, and functional and structural connectivity using functional and diffusion-weighted MRI. In each subject, we identified an auditory tool network with regions in left anterior inferior parietal cortex (aud-aIPL), bilateral posterior lateral sulcus, and left inferior precentral sulcus, and a visual tool network with regions in left aIPL (vis-aIPL) and bilateral inferior temporal gyrus. Aud-aIPL was largely separate and anterior/inferior from vis-aIPL, with varying degrees of overlap across subjects. Both regions displayed a strong preference for tools versus other stimuli presented within the same modality. Despite their modality preference, aud-aIPL and vis-aIPL and a region in left inferior precentral sulcus displayed multisensory response properties, as revealed in multivariate analyses. Thus, two largely separate tool networks are engaged by the visual and auditory modalities with nodes in parietal and prefrontal cortex potentially integrating information across senses. The diversification of tool processing in human parietal cortex underpins its critical role in complex object processing.

Brain correlates of motor complexity during observed and executed actions

Recently, cortical areas with motor properties have attracted attention widely to their involvement in both action generation and perception. Inferior frontal gyrus (IFG), ventral premotor cortex (PMv) and inferior parietal lobule (IPL), presumably consisting of motor-related areas, are of particular interest, given that they respond to motor behaviors both when they are performed and observed. Converging neuroimaging evidence has shown the functional roles of IFG, PMv and IPL in action understanding. Most studies have focused on the effects of modulations in goals and kinematics of observed actions on the brain response, but little research has explored the effects of manipulations in motor complexity. To address this, we used fNIRS to examine the brain activity in the frontal, motor, parietal and occipital regions, aiming to better understand the brain correlates involved in encoding motor complexity. Twenty-one healthy adults executed and observed two hand actions that differed in motor complexity. We found that motor complexity sensitive brain regions were present in the pars opercularis IFG/PMv, primary motor cortex (M1), IPL/supramarginal gyrus and middle occipital gyrus (MOG) during action execution, and in pars opercularis IFG/PMv and M1 during action observation. Our findings suggest that the processing of motor complexity involves not only M1 but also pars opercularis IFG, PMv and IPL, each of which plays a critical role in action perception and execution.

Dissociated modulations of multivoxel activation patterns in the ventral and dorsal visual pathways by the temporal dynamics of stimuli

INTRODUCTION

Previous studies suggested temporal limitations of visual object identification in the ventral pathway. Moreover, multivoxel pattern analyses (MVPA) of fMRI activation have shown reliable encoding of various object categories including faces and tools in the ventral pathway. By contrast, the dorsal pathway is involved in reaching a target and grasping a tool, and quicker in processing the temporal dynamics of stimulus change. However, little is known about how activation patterns in both pathways may change according to the temporal dynamics of stimulus change.

METHODS

Here, we measured fMRI responses of two consecutive stimuli with varying interstimulus intervals (ISIs), and we compared how the two visual pathways respond to the dynamics of stimuli by using MVPA and information-based searchlight mapping.

RESULTS

We found that the temporal dynamics of stimuli modulate responses of the two visual pathways in opposite directions. Specifically, slower temporal dynamics (longer ISIs) led to greater activity and better MVPA results in the ventral pathway. However, faster temporal dynamics (shorter ISIs) led to greater activity and better MVPA results in the dorsal pathway.

CONCLUSIONS

These results are the first to show how temporal dynamics of stimulus change modulated multivoxel fMRI activation pattern change. And such temporal dynamic response function in different ROIs along the two visual pathways may shed lights on understanding functional relationship and organization of these ROIs.

Thalamic Inputs to Posterior Parietal Cortical Areas Involved in Skilled Forelimb Movement and Tool Use in the Capuchin Monkey

The posterior parietal cortex (PPC) is a central hub for the primate forebrain networks that control skilled manual behavior, including tool use. Here, we quantified and compared the sources of thalamic input to electrophysiologically-identified hand/forearm-related regions of several PPC areas, namely areas 5v, AIP, PFG, and PF, of the capuchin monkey (Sapajus sp). We found that these areas receive most of their thalamic connections from the Anterior Pulvinar (PuA), Lateral Posterior (LP) and Medial Pulvinar (PuM) nuclei. Each PPC area receives a specific combination of projections from these nuclei, and fewer additional projections from other nuclei. Moreover, retrograde labeling of the cells innervating different PPC areas revealed substantial intermingling of these cells within the thalamus. Differences in thalamic input may contribute to the different functional properties displayed by the PPC areas. Furthermore, the observed innervation of functionally-related PPC domains from partly intermingled thalamic cell populations accords with the notion that higher-order thalamic inputs may dynamically regulate functional connectivity between cortical areas.

Somatosensory Cortex Efficiently Processes Touch Located Beyond the Body

The extent to which a tool is an extension of its user is a question that has fascinated writers and philosophers for centuries [1]. Despite two decades of research [2-7], it remains unknown how this could be instantiated at the neural level. To this aim, the present study combined behavior, electrophysiology and neuronal modeling to characterize how the human brain could treat a tool like an extended sensory "organ." As with the body, participants localize touches on a hand-held tool with near-perfect accuracy [7]. This behavior is owed to the ability of the somatosensory system to rapidly and efficiently use the tool as a tactile extension of the body. Using electroencephalography (EEG), we found that where a hand-held tool was touched was immediately coded in the neural dynamics of primary somatosensory and posterior parietal cortices of healthy participants. We found similar neural responses in a proprioceptively deafferented patient with spared touch perception, suggesting that location information is extracted from the rod's vibrational patterns. Simulations of mechanoreceptor responses [8] suggested that the speed at which these patterns are processed is highly efficient. A second EEG experiment showed that touches on the tool and arm surfaces were localized by similar stages of cortical processing. Multivariate decoding algorithms and cortical source reconstruction provided further evidence that early limb-based processes were repurposed to map touch on a tool. We propose that an elementary strategy the human brain uses to sense with tools is to recruit primary somatosensory dynamics otherwise devoted to the body.

Action Observation and Effector Independency

The finding of reasonably consistent spatial and temporal productions of actions across different body parts has been used to argue in favor of the existence of a high-order representation of motor programs. In these terms, a generalized motor program consists of an abstract memory structure apt to specify a class of non-specific instructions used to guide a broad range of movements (e.g., “grasp,” “bite”). Although a number of studies, using a variety of tasks, have assessed the issue of effector independence in terms of action execution, little is known regarding the issue of effector independence within an action observation context. Here corticospinal excitability (CSE) of the right hand’s first dorsal interosseous (FDI) and abductor digiti minimi (ADM) muscles was assessed by means of single-pulse transcranial magnetic stimulation (spTMS) during observation of a grasping action performed by the hand, the foot, the mouth, the elbow, or the knee. The results indicate that observing a grasping action performed with different body parts activates the effector typically adopted to execute that action, i.e., the hand. We contend that, as far as grasping is concerned, motor activations by action observation are evident in the muscles typically used to perform the observed action, even when the action is executed with another effector. Nevertheless, some exceptions call for a deeper analysis of motor coding.

Dissociating action and abstract verb comprehension post-stroke

The neural bases of action and abstract concept representations remain a topic of debate. While several lines of research provide evidence for grounding of action-related conceptual content into sensory-motor systems, results of traditional lesion-deficit studies have been somewhat inconsistent. Further, few studies have directly compared the neural substrates of action and relatively abstract verb comprehension post-stroke. Here, we investigated the impact of the disruption of two neural networks on comprehension of action and relatively abstract verbs in 48 unilateral left-hemisphere stroke patients using two methodologies: 1) lesion-deficit association and 2) resting-state functional connectivity (RSFC) analyses. Disruption of RSFC between the left inferior frontal gyrus and right hemisphere primary and secondary sensory-motor areas predicted greater relative impairment of action semantics. Voxel-based lesion-symptom mapping revealed that damage to frontal white matter, extending towards the inferior frontal gyrus, also predicted greater relative impairment of action semantics. On the other hand, damage to the left anterior middle temporal gyrus significantly impaired the more abstract category relative to action. These findings support the view that action and non-action/abstract semantic processing rely on partially dissociable brain networks, with action concepts relying more heavily on sensory-motor areas. The results also have wider implications for lesion-deficit association studies and show how the contralateral hemisphere can play a compensatory role following unilateral stroke.