The lateral occipitotemporal cortex in action

Shared representations of human actions across vision and language

Humans can recognize and communicate about many actions performed by others. How are actions organized in the mind, and is this organization shared across vision and language? We collected similarity judgments of human actions depicted through naturalistic videos and sentences, and tested four models of action categorization, defining actions at different levels of abstraction ranging from specific (action verb) to broad (action target: whether an action is directed towards an object, another person, or the self). The similarity judgments reflected a shared organization of action representations across videos and sentences, determined mainly by the target of actions, even after accounting for other semantic features. Furthermore, language model embeddings predicted the behavioral similarity of action videos and sentences, and captured information about the target of actions alongside unique semantic information. Together, our results show that action concepts are similarly organized in the mind across vision and language, and that this organization reflects socially relevant goals.

Organization of conceptual tool knowledge following left and right brain lesions: Evidence from neuropsychological dissociations and multivariate disconnectome symptom mapping

The aim of this work was to better understand the organization of conceptual tool knowledge following stroke. We explored specifically the link between manipulation kinematics and manipulation hand posture; and the link between manipulation kinematics and function relations in left brain-damaged (n = 30) and right brain-damaged (n = 30) patients. We examined the performance of brain-damaged patients in conceptual tool tasks using neuropsychological dissociations and disconnectome symptom mapping. Our results suggest that manipulation kinematics is more impaired than function relations, following left or right brain lesions. We also observed that manipulation kinematics and manipulation hand posture are dissociable dimensions but are still highly interrelated, particularly in left brain-damaged patients. We also found that the corpus callosum and bilateral superior longitudinal fasciculus are involved in action and semantic tool knowledge following left brain lesions. Our results provide evidence that the right hemisphere contains conceptual tool representations. Further studies are needed to better understand the mechanisms supporting the cognitive recovery of conceptual tool knowledge. An emerging hypothesis is that the right hemisphere may support functional recovery through interhemispheric transfer following a left hemisphere stroke.

A visual representation of the hand in the resting somatomotor regions of the human brain

Hand visibility affects motor control, perception, and attention, as visual information is integrated into an internal model of somatomotor control. Spontaneous brain activity, i.e., at rest, in the absence of an active task, is correlated among somatomotor regions that are jointly activated during motor tasks. Recent studies suggest that spontaneous activity patterns not only replay task activation patterns but also maintain a model of the body's and environment's statistical regularities (priors), which may be used to predict upcoming behavior. Here, we test whether spontaneous activity in the human somatomotor cortex as measured using fMRI is modulated by visual stimuli that display hands vs. non-hand stimuli and by the use/action they represent. A multivariate pattern analysis was performed to examine the similarity between spontaneous activity patterns and task-evoked patterns to the presentation of natural hands, robot hands, gloves, or control stimuli (food). In the left somatomotor cortex, we observed a stronger (multivoxel) spatial correlation between resting state activity and natural hand picture patterns compared to other stimuli. No task-rest similarity was found in the visual cortex. Spontaneous activity patterns in somatomotor brain regions code for the visual representation of human hands and their use.

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.

The neural correlates of limb apraxia: An anatomical likelihood estimation meta-analysis of lesion-symptom mapping studies in brain-damaged patients

Limb apraxia is a motor disorder frequently observed following a stroke. Apraxic deficits are classically assessed with four tasks: tool use, pantomime of tool use, imitation, and gesture understanding. These tasks are supported by several cognitive processes represented in a left-lateralized brain network including inferior frontal gyrus, inferior parietal lobe (IPL), and lateral occipito-temporal cortex (LOTC). For the past twenty years, voxel-wise lesion symptom mapping (VLSM) studies have been used to unravel the neural correlates associated with apraxia, but none of them has proposed a comprehensive view of the topic. In the present work, we proposed to fill this gap by performing a systematic Anatomic Likelihood Estimation meta-analysis of VLSM studies which included tasks traditionally used to assess apraxia. We found that the IPL was crucial for all the tasks. Moreover, lesions within the LOTC were more associated with imitation deficits than tool use or pantomime, confirming its important role in higher visual processing. Our results questioned traditional neurocognitive models on apraxia and may have important clinical implications.

Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain

Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

The neural representation of body part concepts

Neuropsychological and neuroimaging studies provide evidence for a degree of category-related organization of conceptual knowledge in the brain. Some of this evidence indicates that body part concepts are distinctly represented from other categories; yet, the neural correlates and mechanisms underlying these dissociations are unclear. We expand on the limited prior data by measuring functional magnetic resonance imaging responses induced by body part words and performing a series of analyses investigating the cortical representation of this semantic category. Across voxel-level contrasts, pattern classification, representational similarity analysis, and vertex-wise encoding analyses, we find converging evidence that the posterior middle temporal gyrus, the supramarginal gyrus, and the ventral premotor cortex in the left hemisphere play important roles in the preferential representation of this category compared to other concrete objects.

Hemispheric asymmetry of hand and tool perception in left- and right-handers with known language dominance

Regions in the brain that are selective for images of hands and tools have been suggested to be lateralised to the left hemisphere of right-handed individuals. In left-handers, many functions related to tool use or tool pantomime may also depend more on the left hemisphere. This result seems surprising, given that the dominant hand of these individuals is controlled by the right hemisphere. One explanation is that the left hemisphere is dominant for speech and language in the majority of left-handers, suggesting a supraordinate control system for complex motor sequencing that is required for skilled tool use, as well as for speech. In the present study, we examine if this left-hemispheric specialisation extends to perception of hands and tools in left- and right-handed individuals. We, crucially, also include a group of left-handers with right-hemispheric language dominance to examine their asymmetry biases. The results suggest that tools lateralise to the left hemisphere in most right-handed individuals with left-hemispheric language dominance. Tools also lateralise to the language dominant hemisphere in right-hemispheric language dominant left-handers, but the result for left-hemispheric language dominant left-handers are more varied, and no clear bias towards one hemisphere is found. Hands did not show a group-level asymmetry pattern in any of the groups. These results suggest a more complex picture regarding hemispheric overlap of hand and tool representations, and that visual appearance of tools may be driven in part by both language dominance and the hemisphere which controls the motor-dominant hand.

Characterizing the discriminability of visual categorical information in strongly connected voxels

Functional brain responses are strongly influenced by connectivity. Recently, we demonstrated a major example of this: category discriminability within occipitotemporal cortex (OTC) is enhanced for voxel sets that share strong functional connectivity to distal brain areas, relative to those that share lesser connectivity. That is, within OTC regions, sets of 'most-connected' voxels show improved multivoxel pattern discriminability for tool-, face-, and place stimuli relative to voxels with weaker connectivity to the wider brain. However, understanding whether these effects generalize to other domains (e.g. body perception network), and across different levels of the visual processing streams (e.g. dorsal as well as ventral stream areas) is an important extension of this work. Here, we show that this so-called connectivity-guided decoding (CGD) effect broadly generalizes across a wide range of categories (tools, faces, bodies, hands, places). This effect is robust across dorsal stream areas, but less consistent in earlier ventral stream areas. In the latter regions, category discriminability is generally very high, suggesting that extraction of category-relevant visual properties is less reliant on connectivity to downstream areas. Further, CGD effects are primarily expressed in a category-specific manner: For example, within the network of tool regions, discriminability of tool information is greater than non-tool information. The connectivity-guided decoding approach shown here provides a novel demonstration of the crucial relationship between wider brain connectivity and complex local-level functional responses at different levels of the visual processing streams. Further, this approach generates testable new hypotheses about the relationships between connectivity and local selectivity.

Causal relationship between multiparameter brain MRI phenotypes and age: evidence from Mendelian randomization

To explore the causal relationship between age and brain health (cortical atrophy, white matter integrity, white matter hyperintensities and cerebral microbleeds in various brain regions) related multiparameter imaging features using two-sample Mendelian randomization. Age was determined as chronological age of the subject. Cortical volume, white matter micro-integrity, white matter hyperintensity volume and cerebral microbleeds of each brain region were included as phenotypes for brain health. Age and imaging of brain health related genetic data were analysed to determine the causal relationship using inverse-variance weighted model, validated by heterogeneity and horizontal pleiotropy variables. Age is causally related to increased volumes of white matter hyperintensities (β = 0.151). For white matter micro-integrity, fibres of the inferior cerebellar peduncle (axial diffusivity β = -0.128, orientation dispersion index β = 0.173), cerebral peduncle (axial diffusivity β = -0.136), superior fronto-occipital fasciculus (isotropic volume fraction β = 0.163) and fibres within the limbic system were causally deteriorated. We also detected decreased cortical thickness of multiple frontal and temporal regions (P < 0.05). Microbleeds were not related with aging (P > 0.05). Aging is a threat of brain health, leading to cortical atrophy mainly in the frontal lobes, as well as the white matter degeneration especially abnormal hyperintensity and deteriorated white matter integrity around the hippocampus.

Action-specific feature processing in the human cortex: An fMRI study

Sensorimotor integration involves feedforward and reentrant processing of sensory input. Grasp-related motor activity precedes and is thought to influence visual object processing. Yet, while the importance of reentrant feedback is well established in perception, the top-down modulations for action and the neural circuits involved in this process have received less attention. Do action-specific intentions influence the processing of visual information in the human cortex? Using a cue-separation fMRI paradigm, we found that action-specific instruction processing (manual alignment vs. grasp) became apparent only after the visual presentation of oriented stimuli, and occurred as early as in the primary visual cortex and extended to the dorsal visual stream, motor and premotor areas. Further, dorsal stream area aIPS, known to be involved in object manipulation, and the primary visual cortex showed task-related functional connectivity with frontal, parietal and temporal areas, consistent with the idea that reentrant feedback from dorsal and ventral visual stream areas modifies visual inputs to prepare for action. Importantly, both the task-dependent modulations and connections were linked specifically to the object presentation phase of the task, suggesting a role in processing the action goal. Our results show that intended manual actions have an early, pervasive, and differential influence on the cortical processing of vision.

Overlapping representations of observed actions and action-related features

The lateral occipitotemporal cortex (LOTC) has been shown to capture the representational structure of a smaller range of actions. In the current study, we carried out an fMRI experiment in which we presented human participants with images depicting 100 different actions and used representational similarity analysis (RSA) to determine which brain regions capture the semantic action space established using judgments of action similarity. Moreover, to determine the contribution of a wide range of action-related features to the neural representation of the semantic action space we constructed an action feature model on the basis of ratings of 44 different features. We found that the semantic action space model and the action feature model are best captured by overlapping activation patterns in bilateral LOTC and ventral occipitotemporal cortex (VOTC). An RSA on eight dimensions resulting from principal component analysis carried out on the action feature model revealed partly overlapping representations within bilateral LOTC, VOTC, and the parietal lobe. Our results suggest spatially overlapping representations of the semantic action space of a wide range of actions and the corresponding action-related features. Together, our results add to our understanding of the kind of representations along the LOTC that support action understanding.

Visual neuroscience: A brain area tuned for processing social interactions

Socialising with others is part of everyday life. A new study demonstrates that a brain area specialised for visual body perception is attuned to processing social interactions between two people. Intriguingly, this area is lateralised in the left hemisphere.

Converging evidence that left extrastriate body area supports visual sensitivity to social interactions

Navigating our complex social world requires processing the interactions we observe. Recent psychophysical and neuroimaging studies provide parallel evidence that the human visual system may be attuned to efficiently perceive dyadic interactions. This work implies, but has not yet demonstrated, that activity in body-selective cortical regions causally supports efficient visual perception of interactions. We adopt a multi-method approach to close this important gap. First, using a large fMRI dataset (n = 92), we found that the left hemisphere extrastriate body area (EBA) responds more to face-to-face than non-facing dyads. Second, we replicated a behavioral marker of visual sensitivity to interactions: categorization of facing dyads is more impaired by inversion than non-facing dyads. Third, in a pre-registered experiment, we used fMRI-guided transcranial magnetic stimulation to show that online stimulation of the left EBA, but not a nearby control region, abolishes this selective inversion effect. Activity in left EBA, thus, causally supports the efficient perception of social interactions.

In vivo tau is associated with change in memory and processing speed, but not reasoning, in cognitively unimpaired older adults

The relationship between tau deposition and cognitive decline in cognitively healthy older adults is still unclear. The tau PET tracer 18F-MK-6240 has shown favorable imaging characteristics to identify early tau deposition in aging. We evaluated the relationship between in vivo tau levels (18F-MK-6240) and retrospective cognitive change over 5 years in episodic memory, processing speed, and reasoning. For tau quantification, a set of regions of interest (ROIs) was selected a priori based on previous literature: (1) total-ROI comprising selected areas, (2) medial temporal lobe-ROI, and (3) lateral temporal lobe-ROI and cingulate/parietal lobe-ROI. Higher tau burden in most ROIs was associated with a steeper decline in memory and speed. There were no associations between tau and reasoning change. The novelty of this finding is that tau burden may affect not only episodic memory, a well-established finding but also processing speed. Our finding reinforces the notion that early tau deposition in areas related to Alzheimer's disease is associated with cognitive decline in cognitively unimpaired individuals, even in a sample with low amyloid-β pathology.

The functional organization of skilled actions in the adextral and atypical brain

When planning functional grasps of tools, right-handed individuals (dextrals) show mostly left-lateralized neural activity in the praxis representation network (PRN), regardless of the used hand. Here we studied whether or not similar cerebral asymmetries are evident in non-righthanded individuals (adextrals). Sixty two participants, 28 righthanders and 34 non-righthanders (21 lefthanders, 13 mixedhanders), planned functional grasps of tools vs. grasps of control objects, and subsequently performed their pantomimed executions, in an event-related functional magnetic resonance imaging (fMRI) project. Both hands were tested, separately in two different sessions, counterbalanced across participants. After accounting for non-functional components of the prospective grasp, planning functional grasps of tools was associated with greater engagement of the same, left-hemisphere occipito-temporal, parietal and frontal areas of PRN, regardless of hand and handedness. Only when the analyses involved signal changes referenced to resting baseline intervals, differences between adextrals and dextrals emerged. Whereas in the left hemisphere the neural activity was equivalent in both groups (except for the occipito-temporo-parietal junction), its increases in the right occipito-temporal cortex, medial intraparietal sulcus (area MIP), the supramarginal gyrus (area PFt/PF), and middle frontal gyrus (area p9-46v) were significantly greater in adextrals. The inverse contrast was empty. Notably, when individuals with atypical and typical hemispheric phenotypes were directly compared, planning functional (vs. control) grasps invoked, instead, significant clusters located nearly exclusively in the left hemisphere of the typical phenotype. Previous studies interpret similar right-sided vs. left-sided increases in neural activity for skilled actions as handedness dependent, i.e., located in the hemisphere dominant for manual skills. Yet, none of the effects observed here can be purely handedness dependent because there were mixed-handed individuals among adextrals, and numerous mixed-handed and left-handed individuals possess the typical phenotype. Thus, our results clearly show that hand dominance has limited power in driving the cerebral organization of motor cognitive functions.

Low frequency oscillations during hand laterality judgment task with and without personal perspectives: a preliminary study

Sense of personal perspective is crucial for understanding in attentional mechanisms of the perception in "self" or "other's" body. In a hand laterality judgment (HLJ) task, perception of perspective can be assessed by arranging angular orientations and depths of images. A total of 11 healthy, right-handed participants (8 females, mean age: 38.36 years, education: 14 years) were included in the study. The purpose of this study was to investigate behavioural and cortical responses in low-frequency cortical rhythms during a HLJ task. A total of 80-visual hand stimuli were presented through the experiment. Hand visuals were categorized in the way of side (right vs. left) and perspective (1st vs. 3rd personal perspective). Both behavioural outcomes and brain oscillatory characteristics (i.e., frequency and amplitude) of the Electroencephalography were analysed. All reaction time and incorrect answers for 3rd person perspective were higher than the ones for 1st person perspective. Location effect was statistically significant in event-related theta responses confirming the dominant activity of theta frequency in spatial memory tasks on parietal and occipital areas. In addition, we found there were increasing in delta power and phase in hand visuals with 1st person perspective and increasing theta phase in hand visuals with 3rd person perspective (p < 0.05). Accordingly, a clear dissociation in the perception of perspectives in low-frequency bands was revealed. These different cortical strategy in the perception of hand visual with and without perspectives may be interpreted as delta activity may be related in self-body perception, whereas theta activity may be related in allocentric perception.

The Representation of Observed Actions at the Subordinate, Basic, and Superordinate Level

Actions can be planned and recognized at different hierarchical levels, ranging from very specific (e.g., to swim backstroke) to very broad (e.g., locomotion). Understanding the corresponding neural representation is an important prerequisite to reveal how our brain flexibly assigns meaning to the world around us. To address this question, we conducted an event-related fMRI study in male and female human participants in which we examined distinct representations of observed actions at the subordinate, basic and superordinate level. Using multiple regression representational similarity analysis (RSA) in predefined regions of interest, we found that the three different taxonomic levels were best captured by patterns of activations in bilateral lateral occipitotemporal cortex (LOTC), showing the highest similarity with the basic level model. A whole-brain multiple regression RSA revealed that information unique to the basic level was captured by patterns of activation in dorsal and ventral portions of the LOTC and in parietal regions. By contrast, the unique information for the subordinate level was limited to bilateral occipitotemporal cortex, while no single cluster was obtained that captured unique information for the superordinate level. The behaviorally established action space was best captured by patterns of activation in the LOTC and superior parietal cortex, and the corresponding neural patterns of activation showed the highest similarity with patterns of activation corresponding to the basic level model. Together, our results suggest that occipitotemporal cortex shows a preference for the basic level model, with flexible access across the subordinate and the basic level.SIGNIFICANCE STATEMENT The human brain captures information at varying levels of abstraction. It is debated which brain regions host representations across different hierarchical levels, with some studies emphasizing parietal and premotor regions, while other studies highlight the role of the lateral occipitotemporal cortex (LOTC). To shed light on this debate, here we examined the representation of observed actions at the three taxonomic levels suggested by Rosch et al. (1976) Our results highlight the role of the LOTC, which hosts a shared representation across the subordinate and the basic level, with the highest similarity with the basic level model. These results shed new light on the hierarchical organization of observed actions and provide insights into the neural basis underlying the basic level advantage.

Minor Changes Change Memories: Functional Magnetic Resonance Imaging and Behavioral Reflections of Episodic Prediction Errors

Episodic memories can be modified, a process that is potentially driven by mnemonic prediction errors. In the present study, we used modified cues to induce prediction errors of different episodic relevance. Participants encoded episodes in the form of short toy stories and then returned for an fMRI session on the subsequent day. Here, participants were presented either original episodes or slightly modified versions thereof. Modifications consisted of replacing a single object within the episode and either challenged the gist of an episode (gist modifications) or left it intact (surface modifications). On the next day, participants completed a post-fMRI memory test that probed memories for originally encoded episodes. Both types of modifications triggered brain activation in regions we previously found to be involved in the processing of content-based mnemonic prediction errors (i.e., the exchange of an object). Specifically, these were ventrolateral pFC, intraparietal cortex, and lateral occipitotemporal cortex. In addition, gist modifications triggered pronounced brain responses, whereas those for surface modification were only significant in the right inferior frontal sulcus. Processing of gist modifications also involved the posterior temporal cortex and the precuneus. Interestingly, our findings confirmed the posterior hippocampal role of detail processing in episodic memory, as evidenced by increased posterior hippocampal activity for surface modifications compared with gist modifications. In the post-fMRI memory test, previous experience with surface modified, but not gist-modified episodes, increased erroneous acceptance of the same modified versions as originally encoded. Whereas surface-level prediction errors might increase uncertainty and facilitate confusion of alternative episode representations, gist-level prediction errors seem to trigger the clear distinction of independent episodes.

The impact of early adversity on the cerebral cortex - a Mendelian randomization study

Background

The early adversity is associated with a series of negative outcomes in adulthood, and the impact on the cerebral cortex may be one of the fundamental causes of these adverse consequences in adulthood. In this study, we aim to investigate the causal relationship between early adversity and changes in cerebral cortex structure using Mendelian randomization (MR) analysis.

Methods

The GWAS summary statistics of 6 early adversity traits were obtained from individuals of European ancestry in the UK Biobank. The GWAS summary statistics of 34 known functional cortical regions were obtained from the ENIGMA Consortium. Causal relationships between the adversity factors and brain cortical structure were assessed using the inverse-variance weighted (IVW), MR-Egger, and weighted median methods, with IVW being the primary evaluation method. Cochran's Q-test, MR-PRESSO, leave-one-out analysis, and funnel plot examination were employed to detect potential heterogeneity and pleiotropy, as well as to identify and exclude outliers.

Results

At a global level, no causal relationship was found between early adversity and cortical thickness (TH) or surface area (SA) of the brain. However, at the regional level, early adversity was found to potentially influence the TH of the caudal anterior cingulate, superior temporal, entorhinal, paracentral, lateral occipital, banks of the superior temporal sulcus, and supramarginal regions, as well as the SA of the pars triangularis, lateral occipital, parahippocampal, medial orbitofrontal, and isthmus cingulate regions. All findings were nominally significant and passed sensitivity analyses, with no significant heterogeneity or pleiotropy detected.

Discussion

Our study provides evidence for the association between early adversity and alterations in brain cortical structure, which may serve as a foundation for certain mental disorders. Furthermore, magnetic resonance imaging (MRI) might be considered as a promising tool to aid healthcare professionals in identifying individuals with a history of adverse experiences, allowing for early interventions.

Planet earth calling: unveiling the brain's response to awe and driving eco-friendly consumption

Eco-friendly consumption is important for solving climate crisis and moving humanity toward a better future. However, few consumers are willing to pay premiums for eco-friendly products. We investigated the psychological and neural factors that can increase eco-friendly consumption. We propose an experience of awe, in which the individual self is temporarily attenuated as the importance of beings other than oneself increases. Behavioral (Study 1) and functional magnetic resonance imaging (fMRI; Study 2) experiments were conducted to explore the awe mechanisms through which climate crisis messages lead to eco-friendly consumption. In Study 1, we found participants felt awe when exposed to climate crisis messages, and their choice of eco-friendly consumption increased. In Study 2, we found that when individuals were exposed to messages depicting the climate crisis (as opposed to a control stimulus), their brains exhibited a lower level of activation in the self-awareness processing and a higher level of activation in external attention processing areas. These results suggest that the awe experience plays an important role in promoting eco-friendly consumption. Marketing must evolve from satisfying basic individual needs to a high level for the well-being of humanity, the planet, and the biosphere. This study sheds light on our understanding of human perceptions of the climate crisis and suggests an effective communication strategy to increase individuals' eco-friendly actions.

Mechanisms and neuroanatomy of response selection in tool and non-tool action tasks: Evidence from left-hemisphere stroke

The ability to select between potential actions is central to the complex process of tool use. After left hemisphere stroke, individuals with limb apraxia make more hand action errors when gesturing the use of tools with conflicting hand actions for grasping-to-move and use (e.g., screwdriver) relative to tools that are grasped-to-move and used with the same hand action (e.g., hammer). Prior research indicates that this grasp-use interference effect is driven by abnormalities in the competitive action selection process. The goal of this project was to determine whether common mechanisms and neural substrates support the competitive selection of task-appropriate responses in both tool and non-tool domains. If so, the grasp-use interference effect in a tool use gesturing task should be correlated with response interference effects in the classic Eriksen flanker and Simon tasks, and at least partly overlapping neural regions should subserve the 3 tasks. Sixty-four left hemisphere stroke survivors (33 with apraxia) participated in the tool- and non-tool interference tasks and underwent T1 anatomical MRI. There were robust grasp-use interference effects (grasp-use conflict test) and response interference effects (Eriksen flanker and Simon tasks), but these effects were not correlated. Lesion-symptom mapping analyses showed that lesions to the left inferior parietal lobule, ventral premotor cortex, and insula were associated with grasp-use interference. Lesions to the left inferior parietal lobule, postcentral gyrus, insula, caudate, and putamen were associated with response interference in the Eriksen flanker task. Lesions to the left caudate and putamen were also associated with response interference in the Simon task. Our results suggest that the selection of hand posture for tool use is mediated by distinct cognitive mechanisms and partly distinct neuroanatomic substrates from those mapping a stimulus to an appropriate motor response in non-tool domains.

Concepts require flexible grounding

Research on semantic memory has a problem. On the one hand, a robust body of evidence implicates sensorimotor regions in conceptual processing. On the other hand, a different body of evidence implicates a modality independent semantic system. The standard solution to this tension is to posit a hub-and-spoke system with modality independent hubs and modality specific spokes. In this paper, I argue in support of an alternative view of grounding which remains committed to neural reenactment but emphasizes the multimodal and multilevel nature of the semantic system. This view is built upon the recognition that abstraction is a design feature of concepts. Semantic memory employs hierarchically structured representations to capture different degrees of abstraction. Grounding does not work the way that many embodied approaches have assumed.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Early categorization of social affordances during the visual encoding of bodily stimuli

Interpersonal interactions rely on various communication channels, both verbal and non-verbal, through which information regarding one's intentions and emotions are perceived. Here, we investigated the neural correlates underlying the visual processing of hand postures conveying social affordances (i.e., hand-shaking), compared to control stimuli such as hands performing non-social actions (i.e., grasping) or showing no movement at all. Combining univariate and multivariate analysis on electroencephalography (EEG) data, our results indicate that occipito-temporal electrodes show early differential processing of stimuli conveying social information compared to non-social ones. First, the amplitude of the Early Posterior Negativity (EPN, an Event-Related Potential related to the perception of body parts) is modulated differently during the perception of social and non-social content carried by hands. Moreover, our multivariate classification analysis (MultiVariate Pattern Analysis - MVPA) expanded the univariate results by revealing early (<200 ms) categorization of social affordances over occipito-parietal sites. In conclusion, we provide new evidence suggesting that the encoding of socially relevant hand gestures is categorized in the early stages of visual processing.

A large-scale fMRI dataset for human action recognition

Human action recognition is a critical capability for our survival, allowing us to interact easily with the environment and others in everyday life. Although the neural basis of action recognition has been widely studied using a few action categories from simple contexts as stimuli, how the human brain recognizes diverse human actions in real-world environments still needs to be explored. Here, we present the Human Action Dataset (HAD), a large-scale functional magnetic resonance imaging (fMRI) dataset for human action recognition. HAD contains fMRI responses to 21,600 video clips from 30 participants. The video clips encompass 180 human action categories and offer a comprehensive coverage of complex activities in daily life. We demonstrate that the data are reliable within and across participants and, notably, capture rich representation information of the observed human actions. This extensive dataset, with its vast number of action categories and exemplars, has the potential to deepen our understanding of human action recognition in natural environments.

A shared neural code for the physics of actions and object events

Observing others' actions recruits frontoparietal and posterior temporal brain regions - also called the action observation network. It is typically assumed that these regions support recognizing actions of animate entities (e.g., person jumping over a box). However, objects can also participate in events with rich meaning and structure (e.g., ball bouncing over a box). So far, it has not been clarified which brain regions encode information specific to goal-directed actions or more general information that also defines object events. Here, we show a shared neural code for visually presented actions and object events throughout the action observation network. We argue that this neural representation captures the structure and physics of events regardless of animacy. We find that lateral occipitotemporal cortex encodes information about events that is also invariant to stimulus modality. Our results shed light onto the representational profiles of posterior temporal and frontoparietal cortices, and their roles in encoding event information.

Magnetoencephalogram-based brain-computer interface for hand-gesture decoding using deep learning

Advancements in deep learning algorithms over the past decade have led to extensive developments in brain-computer interfaces (BCI). A promising imaging modality for BCI is magnetoencephalography (MEG), which is a non-invasive functional imaging technique. The present study developed a MEG sensor-based BCI neural network to decode Rock-Paper-scissors gestures (MEG-RPSnet). Unique preprocessing pipelines in tandem with convolutional neural network deep-learning models accurately classified gestures. On a single-trial basis, we found an average of 85.56% classification accuracy in 12 subjects. Our MEG-RPSnet model outperformed two state-of-the-art neural network architectures for electroencephalogram-based BCI as well as a traditional machine learning method, and demonstrated equivalent and/or better performance than machine learning methods that have employed invasive, electrocorticography-based BCI using the same task. In addition, MEG-RPSnet classification performance using an intra-subject approach outperformed a model that used a cross-subject approach. Remarkably, we also found that when using only central-parietal-occipital regional sensors or occipitotemporal regional sensors, the deep learning model achieved classification performances that were similar to the whole-brain sensor model. The MEG-RSPnet model also distinguished neuronal features of individual hand gestures with very good accuracy. Altogether, these results show that noninvasive MEG-based BCI applications hold promise for future BCI developments in hand-gesture decoding.

A data-driven investigation of human action representations

Understanding actions performed by others requires us to integrate different types of information about people, scenes, objects, and their interactions. What organizing dimensions does the mind use to make sense of this complex action space? To address this question, we collected intuitive similarity judgments across two large-scale sets of naturalistic videos depicting everyday actions. We used cross-validated sparse non-negative matrix factorization to identify the structure underlying action similarity judgments. A low-dimensional representation, consisting of nine to ten dimensions, was sufficient to accurately reconstruct human similarity judgments. The dimensions were robust to stimulus set perturbations and reproducible in a separate odd-one-out experiment. Human labels mapped these dimensions onto semantic axes relating to food, work, and home life; social axes relating to people and emotions; and one visual axis related to scene setting. While highly interpretable, these dimensions did not share a clear one-to-one correspondence with prior hypotheses of action-relevant dimensions. Together, our results reveal a low-dimensional set of robust and interpretable dimensions that organize intuitive action similarity judgments and highlight the importance of data-driven investigations of behavioral representations.

Functional organization of social perception in the human brain

Humans rapidly extract diverse and complex information from ongoing social interactions, but the perceptual and neural organization of the different aspects of social perception remains unresolved. We showed short movie clips with rich social content to 97 healthy participants while their haemodynamic brain activity was measured with fMRI. The clips were annotated moment-to-moment for a large set of social features and 45 of the features were evaluated reliably between annotators. Cluster analysis of the social features revealed that 13 dimensions were sufficient for describing the social perceptual space. Three different analysis methods were used to map the social perceptual processes in the human brain. Regression analysis mapped regional neural response profiles for different social dimensions. Multivariate pattern analysis then established the spatial specificity of the responses and intersubject correlation analysis connected social perceptual processing with neural synchronization. The results revealed a gradient in the processing of social information in the brain. Posterior temporal and occipital regions were broadly tuned to most social dimensions and the classifier revealed that these responses showed spatial specificity for social dimensions; in contrast Heschl gyri and parietal areas were also broadly associated with different social signals, yet the spatial patterns of responses did not differentiate social dimensions. Frontal and subcortical regions responded only to a limited number of social dimensions and the spatial response patterns did not differentiate social dimension. Altogether these results highlight the distributed nature of social processing in the brain.

A domain-general frontoparietal network interacts with domain-preferential intermediate pathways to support working memory task

Working memory (WM) is essential for cognition, but the underlying neural mechanisms remain elusive. From a hierarchical processing perspective, this paper proposed and tested a hypothesis that a domain-general network at the top of the WM hierarchy can interact with distinct domain-preferential intermediate circuits to support WM. Employing a novel N-back task, we first identified the posterior superior temporal gyrus (pSTG), middle temporal area (MT), and postcentral gyrus (PoCG) as intermediate regions for biological motion and shape motion processing, respectively. Using further psychophysiological interaction analyses, we delineated a frontal-parietal network (FPN) as the domain-general network. These results were further verified and extended by a delayed match to sample (DMS) task. Although the WM load-dependent and stimulus-free activations during the DMS delay phase confirm the role of FPN as a domain-general network to maintain information, the stimulus-dependent activations within this network during the DMS encoding phase suggest its involvement in the final stage of the hierarchical processing chains. In contrast, the load-dependent activations of intermediate regions in the N-back task highlight their further roles beyond perception in WM tasks. These results provide empirical evidence for a hierarchical processing model of WM and may have significant implications for WM training.

Loss of action-related function and connectivity in the blind extrastriate body area

The Extrastriate Body Area (EBA) participates in the visual perception and motor actions of body parts. We recently showed that EBA’s perceptual function develops independently of visual experience, responding to stimuli with body-part information in a supramodal fashion. However, it is still unclear if the EBA similarly maintains its action-related function. Here, we used fMRI to study motor-evoked responses and connectivity patterns in the congenitally blind brain. We found that, unlike the case of perception, EBA does not develop an action-related response without visual experience. In addition, we show that congenital blindness alters EBA’s connectivity profile in a counterintuitive way—functional connectivity with sensorimotor cortices dramatically decreases, whereas connectivity with perception-related visual occipital cortices remains high. To the best of our knowledge, we show for the first time that action-related functions and connectivity in the visual cortex could be contingent on visuomotor experience. We further discuss the role of the EBA within the context of visuomotor control and predictive coding theory.

Two distinct networks containing position-tolerant representations of actions in the human brain

Humans can recognize others' actions in the social environment. This action recognition ability is rarely hindered by the movement of people in the environment. The neural basis of this position tolerance for observed actions is not fully understood. Here, we aimed to identify brain regions capable of generalizing representations of actions across different positions and investigate the representational content of these regions. In a functional magnetic resonance imaging experiment, participants viewed point-light displays of different human actions. Stimuli were presented in either the upper or the lower visual field. Multivariate pattern analysis and a surface-based searchlight approach were employed to identify brain regions that contain position-tolerant action representation: Classifiers were trained with patterns in response to stimuli presented in one position and were tested with stimuli presented in another position. Results showed above-chance classification in the left and right lateral occipitotemporal cortices, right intraparietal sulcus, and right postcentral gyrus. Further analyses exploring the representational content of these regions showed that responses in the lateral occipitotemporal regions were more related to subjective judgments, while those in the parietal regions were more related to objective measures. These results provide evidence for two networks that contain abstract representations of human actions with distinct representational content.

Multimodal processing in face-to-face interactions: A bridging link between psycholinguistics and sensory neuroscience

In face-to-face communication, humans are faced with multiple layers of discontinuous multimodal signals, such as head, face, hand gestures, speech and non-speech sounds, which need to be interpreted as coherent and unified communicative actions. This implies a fundamental computational challenge: optimally binding only signals belonging to the same communicative action while segregating signals that are not connected by the communicative content. How do we achieve such an extraordinary feat, reliably, and efficiently? To address this question, we need to further move the study of human communication beyond speech-centred perspectives and promote a multimodal approach combined with interdisciplinary cooperation. Accordingly, we seek to reconcile two explanatory frameworks recently proposed in psycholinguistics and sensory neuroscience into a neurocognitive model of multimodal face-to-face communication. First, we introduce a psycholinguistic framework that characterises face-to-face communication at three parallel processing levels: multiplex signals, multimodal gestalts and multilevel predictions. Second, we consider the recent proposal of a lateral neural visual pathway specifically dedicated to the dynamic aspects of social perception and reconceive it from a multimodal perspective ("lateral processing pathway"). Third, we reconcile the two frameworks into a neurocognitive model that proposes how multiplex signals, multimodal gestalts, and multilevel predictions may be implemented along the lateral processing pathway. Finally, we advocate a multimodal and multidisciplinary research approach, combining state-of-the-art imaging techniques, computational modelling and artificial intelligence for future empirical testing of our model.

Expectations of efficient actions bias social perception: a pre-registered online replication

Humans take a teleological stance when observing others' actions, interpreting them as intentional and goal directed. In predictive processing accounts of social perception, this teleological stance would be mediated by a perceptual prediction of an ideal energy-efficient reference trajectory with which a rational actor would achieve their goals within the current environmental constraints. Hudson and colleagues (2018 Proc. R. Soc. B 285, 20180638. (doi:10.1098/rspb.2018.0638)) tested this hypothesis in a series of experiments in which participants reported the perceived disappearance points of hands reaching for objects. They found that these judgements were biased towards the expected efficient reference trajectories. Observed straight reaches were reported higher when an obstacle needed to be overcome than if the path was clear. By contrast, unnecessarily high reaches over empty space were perceptually flattened. Moreover, these perceptual biases increased the more the environmental constraints and expected action trajectories were explicitly processed. These findings provide an important advance to our understanding of the mechanisms underlying social perception. The current replication tests the robustness of these findings and whether they uphold in an online setting.

Gesture meaning modulates the neural correlates of effector-specific imitation deficits in left hemisphere stroke

BACKGROUND

Previous studies on left hemisphere (LH) stroke patients reported effector-specific (hand, fingers, bucco-facial) differences in imitation performance. Furthermore, imitation performance differed between meaningless (ML) and meaningful (MF) gestures. Recent work suggests that a gesture's meaning impacts the body-part specificity of gesture imitation.

METHODS

We tested the hypothesis that the gesture's meaning (ML vs MF) affects the lesion correlates of effector-specific imitation deficits (here: bucco-facial vs arm/hand gestures) using behavioural data and support vector regression-based lesion-symptom mapping (SVR-LSM) in a large sample of 194 sub-acute LH stroke patients.

RESULTS

Behavioural data revealed a significant interaction between the effector used for imitation and the meaning of the imitated gesture. SVR-LSM analyses revealed shared lesion correlates for impaired imitation independent of effector or gesture meaning in the left supramarginal (SMG) and superior temporal gyri (STG). Besides, within the territory of the left middle cerebral artery, impaired imitation of bucco-facial gestures was associated with more anterior lesions, while arm/hand imitation deficits were associated with more posterior lesions. MF gestures were specifically associated with lesions in the left inferior frontal gyrus and the left insular region. Notably, an interaction of effector-specificity and gesture meaning was also present at the lesion level: A more pronounced difference in imitation performance between the effectors for ML (versus MF) gestures was associated with left-hemispheric lesions in the STG, SMG, putamen, precentral gyrus and white matter tracts.

CONCLUSION

The current behavioural data show that ML gestures are particularly sensitive in assessing effector-specific imitation deficits in LH stroke patients. Moreover, a gesture's meaning modulated the effector-specific lesion correlates of bucco-facial and arm/hand gesture imitation. Hence, it is crucial to consider gesture meaning in apraxia assessments.

Action Observation Network Activity Related to Object-Directed and Socially-Directed Actions in Adolescents

The human action observation network (AON) encompasses brain areas consistently engaged when we observe other's actions. Although the core nodes of the AON are present from childhood, it is not known to what extent they are sensitive to different action features during development. Because social cognitive abilities continue to mature during adolescence, the AON response to socially-oriented actions, but not to object-related actions, may differ in adolescents and adults. To test this hypothesis, we scanned with functional magnetic resonance imaging (fMRI) male and female typically-developing teenagers (n = 28; 13 females) and adults (n = 25; 14 females) while they passively watched videos of manual actions varying along two dimensions: sociality (i.e., directed toward another person or not) and transitivity (i.e., involving an object or not). We found that action observation recruited the same fronto-parietal and occipito-temporal regions in adults and adolescents. The modulation of voxel-wise activity according to the social or transitive nature of the action was similar in both groups of participants. Multivariate pattern analysis, however, revealed that decoding accuracies in intraparietal sulcus (IPS)/superior parietal lobe (SPL) for both sociality and transitivity were lower for adolescents compared with adults. In addition, in the lateral occipital temporal cortex (LOTC), generalization of decoding across the orthogonal dimension was lower for sociality only in adolescents. These findings indicate that the representation of the content of others' actions, and in particular their social dimension, in the adolescent AON is still not as robust as in adults.SIGNIFICANCE STATEMENT The activity of the action observation network (AON) in the human brain is modulated according to the purpose of the observed action, in particular the extent to which it involves interaction with an object or with another person. How this conceptual representation of actions is implemented during development is largely unknown. Here, using multivoxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data, we discovered that, while the action observation network is in place in adolescence, the fine-grain organization of its posterior regions is less robust than in adults to decode the abstract social dimensions of an action. This finding highlights the late maturation of social processing in the human brain.

Limb Apraxias: The Influence of Higher Order Perceptual and Semantic Deficits in Motor Recovery After Stroke

Stroke is a leading cause of disability worldwide. Limb apraxia is a group of higher order motor disorders associated with greater disability and dependence after stroke. Original neuropsychology studies distinguished separate brain pathways involved in perception and action, known as the dual stream hypothesis. This framework has allowed a better understanding of the deficits identified in Limb Apraxia. In this review, we propose a hierarchical organization of this disorder, in which a distinction can be made between several visuomotor pathways that lead to purposeful actions. Based on this, executive apraxias (such as limb kinetic apraxia) cause deficits in executing fine motor hand skills, and intermediate apraxias (such as optic ataxia and tactile apraxia) cause deficits in reaching to grasp and manipulating objects in space. These disorders usually affect the contralesional limb. A further set of disorders collectively known as limb apraxias include deficits in gesture imitation, pantomime, gesture recognition, and object use. These deficits are due to deficits in integrating perceptual and semantic information to generate complex movements. Limb apraxias are usually caused by left-hemisphere lesions in right-handed stroke patients, affecting both limbs. The anterior- to posterior-axis of brain areas are disrupted depending on the increasing involvement of perceptual and semantic processes with each condition. Lower-level executive apraxias are linked to lesions in the frontal lobe and the basal ganglia, while intermediate apraxias are linked to lesions in dorso-dorsal subdivisions of the dorsal fronto-parietal networks. Limb apraxias can be caused by lesions in both dorsal and ventral subdivisions including the ventro-dorsal stream and a third visuomotor pathway, involved in body schema and social cognition. Rehabilitation of these disorders with behavioral therapies has aimed to either restore perceptuo-semantic deficits or compensate to overcome these deficits. Further studies are required to better stratify patients, using modern neurophysiology and neuroimaging techniques, to provide targeted and personalized therapies for these disorders in the future.

Improved gesturing in left-hemispheric stroke by right inferior parietal theta burst stimulation

Objectives

Apraxia is a common syndrome of left hemispheric stroke. A parieto-premotor-prefrontal network has been associated with apraxia, in which the left inferior parietal lobe (IPL-L) plays a major role. We hypothesized that transcranial continuous theta burst stimulation (cTBS) over the right inferior parietal lobe (IPL-R) improves gesturing by reducing its inhibition on the contralateral IPL in left hemispheric stroke patients. It was assumed that this effect is independent of lesion volume and that transcallosal connectivity is predictive for gestural effect after stimulation.

Materials and methods

Nineteen stroke patients were recruited. Lesion volume and fractional anisotropy of the corpus callosum were acquired with structural magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI). Each patient had pseudorandomised sessions with sham or with stimulation over the IPL-R or over the right inferior frontal gyrus IFG-R. Gesturing was assessed in a double-blinded manner before and after each session. We tested the effects of stimulation on gesture performance using a linear mixed-effects model.

Results

Pairwise treatment contrasts showed, that, compared to sham, the behavioral effect was higher after stimulation over IPL-R (12.08, 95% CI 6.04 - 18.13, p < 0.001). This treatment effect was approximately twice as high as the contrasts for IFG-R vs. sham (6.25, 95% CI -0.20 - 12.70, p = 0.058) and IPL-R vs. IFG-R vs. sham (5.83, 95% CI -0.49 - 12.15, p = 0.071). Furthermore, higher fractional anisotropy in the splenium (connecting the left and right IPL) were associated with higher behavioral effect. Relative lesion volume did not affect the changes after sham or stimulation over IPL-R or IFG-R.

Conclusion

One single session of cTBS over the IPL-R improved gesturing after left hemispheric stroke. Denser microstructure in the corpus callosum correlated with favorable gestural response. We therefore propose the indirect transcallosal modulation of the IPL-L as a promising model of restoring interhemispheric balance, which may be useful in rehabilitation of apraxia.

The transition from invariant to action-dependent visual object representation in human dorsal pathway

The human brain can efficiently process action-related visual information, which supports our ability to quickly understand and learn others' actions. The visual information of goal-directed action is extensively represented in the parietal and frontal cortex, but how actions and goal-objects are represented within this neural network is not fully understood. Specifically, which part of this dorsal network represents the identity of goal-objects? Is such goal-object information encoded at an abstract level or highly interactive with action representations? Here, we used functional magnetic resonance imaging with a large number of participants (n = 94) to investigate the neural representation of goal-objects and actions when participants viewed goal-directed action videos. Our results showed that the goal-directed action information could be decoded across much of the dorsal pathway, but in contrast, the invariant goal-object information independent of action was mainly localized in the early stage of dorsal pathway in parietal cortex rather than the down-stream areas of the parieto-frontal cortex. These results help us to understand the relationship between action and goal-object representations in the dorsal pathway, and the evolution of interactive representation of goal-objects and actions along the dorsal pathway during goal-directed action observation.

Cortical and subcortical morphological alterations in motor subtypes of Parkinson's disease

Parkinson's disease (PD) can be classified into an akinetic-rigid (AR) and a tremor-dominant (TD) subtype based on predominant motor symptoms. Patients with different motor subtypes often show divergent clinical manifestations; however, the underlying neural mechanisms remain unclear. This study aimed to characterize the cortical and subcortical morphological alterations in motor subtypes of PD. T1-weighted MRI images were obtained for 90 patients with PD (64 with the AR subtype and 26 with the TD subtype) and 56 healthy controls (HCs). Cortical surface area, sulcal depth (measured by Freesurfer's Sulc index), and subcortical volume were computed to identify the cortical and subcortical morphological alterations in the two motor subtypes. Compared with HCs, we found widespread surface area reductions in the AR subtype yet sparse surface area reductions in the TD subtype. We found no significant Sulc change in the AR subtype yet increased Sulc in the right supramarginal gyrus in the TD subtype. The hippocampal volumes in both subtypes were lower than those of HCs. In PD patients, the surface area of left posterior cingulate cortex was positively correlated with Mini-Mental State Examination (MMSE) score, while the Sulc value of right middle frontal gyrus was positively correlated with severity of motor impairments. Additionally, the hippocampal volumes were positively correlated with MMSE and Montreal Cognitive Assessment scores and negatively correlated with severity of motor impairments and Hoehn & Yahr scores. Taken together, these findings may contribute to a better understanding of the neural substrates underlying the distinct symptom profiles in the two PD subtypes.

Functional topologies of spatial cognition predict cognitive and motor progression in Parkinson’s

Background

Spatial cognition deteriorates in Parkinson’s disease (PD), but the neural substrates are not understood, despite the risk for future dementia. It is also unclear whether deteriorating spatial cognition relates to changes in other cognitive domains or contributes to motor dysfunction.

Objective

This study aimed to identify functional connectivity abnormalities in cognitively normal PD (PDCN) in regions that support spatial cognition to determine their relationship to interfacing cognitive functions and motor disability, and to determine if they predict cognitive and motor progression 2 years later in a PDCN subsample.

Methods

Sixty-three PDCN and 43 controls underwent functional MRI while judging whether pictures, rotated at various angles, depicted the left or right hand. The task activates systems that respond to increases in rotation angle, a proxy for visuospatial difficulty. Angle-modulated functional connectivity was analyzed for frontal cortex, posterior cortex, and basal ganglia regions.

Results

Two aberrant connectivity patterns were found in PDCN, which were condensed into principal components that characterized the strength and topology of angle-modulated connectivity. One topology related to a marked failure to amplify frontal, posterior, and basal ganglia connectivity with other brain areas as visuospatial demands increased, unlike the control group (control features). Another topology related to functional reorganization whereby regional connectivity was strengthened with brain areas not recruited by the control group (PDCN features). Functional topologies correlated with diverse cognitive domains at baseline, underscoring their influences on spatial cognition. In PDCN, expression of topologies that were control features predicted greater cognitive progression longitudinally, suggesting inefficient communications within circuitry normally recruited to handle spatial demands. Conversely, stronger expression of topologies that were PDCN features predicted less longitudinal cognitive decline, suggesting functional reorganization was compensatory. Parieto-occipital topologies (control features) had different prognostic implications for longitudinal changes in motor disability. Expression of one topology predicted less motor decline, whereas expression of another predicted increased postural instability and gait disturbance (PIGD) feature severity. Concurrently, greater longitudinal decline in spatial cognition predicted greater motor and PIGD feature progression, suggesting deterioration in shared substrates.

Conclusion

These novel discoveries elucidate functional mechanisms of visuospatial cognition in PDCN, which foreshadow future cognitive and motor disability.

Representation of motion concepts in occipitotemporal cortex: fMRI activation, decoding and connectivity analyses

Embodied theories of semantic cognition predict that brain regions involved in motion perception are engaged when people comprehend motion concepts expressed in language. Left lateral occipitotemporal cortex (LOTC) is implicated in both motion perception and motion concept processing but prior studies have produced mixed findings on which parts of this region are engaged by motion language. We scanned participants performing semantic judgements about sentences describing motion events and static events. We performed univariate analyses, multivariate pattern analyses (MVPA) and psychophysiological interaction (PPI) analyses to investigate the effect of motion on activity and connectivity in different parts of LOTC. In multivariate analyses that decoded whether a sentence described motion or not, the middle and posterior parts of LOTC showed above-chance level performance, with performance exceeding that of other brain regions. Univariate ROI analyses found the middle part of LOTC was more active for motion events than static ones. Finally, PPI analyses found that when processing motion events, the middle and posterior parts of LOTC (overlapping with motion perception regions), increased their connectivity with cognitive control regions. Taken together, these results indicate that the more posterior parts of LOTC, including motion perception cortex, respond differently to motion vs. static events. These findings are consistent with embodiment accounts of semantic processing, and suggest that understanding verbal descriptions of motion engages areas of the occipitotemporal cortex involved in perceiving motion.

When action prediction grows old: An fMRI study

Predicting the unfolding of others' actions (action prediction) is crucial for successfully navigating the social world and interacting efficiently. Age-related changes in this domain have remained largely unexplored, especially for predictions regarding simple gestures and independent of contextual information or motor expertise. Here, we evaluated whether healthy aging impacts the neurophysiological processes recruited to anticipate, from the observation of implied-motion postures, the correct conclusion of simple grasping and pointing actions. A color-discrimination task served as a control condition to assess the specificity of the age-related effects. Older adults showed reduced efficiency in performance that was yet not specific to the action prediction task. Nevertheless, fMRI results revealed task-specific age-related differences: while both groups showed stronger recruitment of the lateral occipito-temporal cortex bilaterally during the action prediction than the control task, the younger participants additionally showed a higher bilateral engagement of parietal regions. Importantly, in both groups, the recruitment of visuo-motor processes in the right posterior parietal cortex was a predictor of good performance. These results support the hypothesis of decreased involvement of sensorimotor processes in cognitive tasks when processing action- and body-related stimuli in healthy aging. These results have implications for social interaction, which requires the fast reading of others' gestures.

Action goals and the praxis network: an fMRI study

The praxis representation network (PRN) of the left cerebral hemisphere is typically linked to the control of functional interactions with familiar tools. Surprisingly, little is known about the PRN engagement in planning and execution of tool-directed actions motivated by non-functional but purposeful action goals. Here we used functional neuroimaging to perform both univariate and multi-voxel pattern analyses (MVPA) in 20 right-handed participants who planned and later executed, with their dominant and non-dominant hands, disparate grasps of tools for different goals, including: (1) planning simple vs. demanding functional grasps of conveniently vs. inconveniently oriented tools with an intention to immediately use them, (2) planning simple—but non-functional—grasps of inconveniently oriented tools with a goal to pass them to a different person, (3) planning reaching movements directed at such tools with an intention to move/push them with the back of the hand, and (4) pantomimed execution of the earlier planned tasks. While PRN contributed to the studied interactions with tools, the engagement of its critical nodes, and/or complementary right hemisphere processing, was differently modulated by task type. E.g., planning non-functional/structural grasp-to-pass movements of inconveniently oriented tools, regardless of the hand, invoked the left parietal and prefrontal nodes significantly more than simple, non-demanding functional grasps. MVPA corroborated decoding capabilities of critical PRN areas and some of their right hemisphere counterparts. Our findings shed new lights on how performance of disparate action goals influences the extraction of object affordances, and how or to what extent it modulates the neural activity within the parieto-frontal brain networks.

The role of the anterior temporal cortex in action: evidence from fMRI multivariate searchlight analysis during real object grasping

Intelligent manipulation of handheld tools marks a major discontinuity between humans and our closest ancestors. Here we identified neural representations about how tools are typically manipulated within left anterior temporal cortex, by shifting a searchlight classifier through whole-brain real action fMRI data when participants grasped 3D-printed tools in ways considered typical for use (i.e., by their handle). These neural representations were automatically evocated as task performance did not require semantic processing. In fact, findings from a behavioural motion-capture experiment confirmed that actions with tools (relative to non-tool) incurred additional processing costs, as would be suspected if semantic areas are being automatically engaged. These results substantiate theories of semantic cognition that claim the anterior temporal cortex combines sensorimotor and semantic content for advanced behaviours like tool manipulation.

Social-affective features drive human representations of observed actions

Humans observe actions performed by others in many different visual and social settings. What features do we extract and attend when we view such complex scenes, and how are they processed in the brain? To answer these questions, we curated two large-scale sets of naturalistic videos of everyday actions and estimated their perceived similarity in two behavioral experiments. We normed and quantified a large range of visual, action-related, and social-affective features across the stimulus sets. Using a cross-validated variance partitioning analysis, we found that social-affective features predicted similarity judgments better than, and independently of, visual and action features in both behavioral experiments. Next, we conducted an electroencephalography experiment, which revealed a sustained correlation between neural responses to videos and their behavioral similarity. Visual, action, and social-affective features predicted neural patterns at early, intermediate, and late stages, respectively, during this behaviorally relevant time window. Together, these findings show that social-affective features are important for perceiving naturalistic actions and are extracted at the final stage of a temporal gradient in the brain.

Complex tools and motor-to-mechanical transformations

The ability to use complex tools is thought to depend on multifaceted motor-to-mechanical transformations within the left inferior parietal lobule (IPL), linked to cognitive control over compound actions. Here we show using neuroimaging that demanding transformations of finger movements into proper mechanical movements of functional parts of complex tools invoke significantly the right rather than left rostral IPL, and bilateral posterior-to-mid and left anterior intraparietal sulci. These findings emerged during the functional grasp and tool-use programming phase. The expected engagement of left IPL was partly revealed by traditional region-of-interest analyses, and further modeling/estimations at the hand-independent level. Thus, our results point to a special role of right IPL in supporting sensory-motor spatial mechanisms which enable an effective control of fingers in skillful handling of complex tools. The resulting motor-to-mechanical transformations involve dynamic hand-centered to target-centered reference frame conversions indispensable for efficient interactions with the environment.