Two Cortical Systems for Reaching in Central and Peripheral Vision

Social Cognition and Functional Connectivity in Early and Chronic Schizophrenia

BACKGROUND

Individuals with schizophrenia (SZ) experience impairments in social cognition that contribute to poor functional outcomes. However, mechanisms of social cognitive dysfunction in SZ remain poorly understood, which impedes the design of novel interventions to improve outcomes. In this preregistered project, we examined the representation of social cognition in the brain's functional architecture in early and chronic SZ.

METHODS

The study contains 2 parts: a confirmatory and an exploratory portion. In the confirmatory portion, we identified resting-state connectivity disruptions evident in early and chronic SZ. We performed a connectivity analysis using regions associated with social cognitive dysfunction in early and chronic SZ to test whether aberrant connectivity observed in chronic SZ (n = 47 chronic SZ and n = 52 healthy control participants) was also present in early SZ (n = 71 early SZ and n = 47 healthy control participants). In the exploratory portion, we assessed the out-of-sample generalizability and precision of predictive models of social cognition. We used machine learning to predict social cognition and established generalizability with out-of-sample testing and confound control.

RESULTS

Results revealed decreases between the left inferior frontal gyrus and the intraparietal sulcus in early and chronic SZ, which were significantly associated with social and general cognition and global functioning in chronic SZ and with general cognition and global functioning in early SZ. Predictive modeling revealed the importance of out-of-sample evaluation and confound control.

CONCLUSIONS

This work provides insights into the functional architecture in early and chronic SZ and suggests that inferior frontal gyrus-intraparietal sulcus connectivity could be a prognostic biomarker of social impairments and a target for future interventions (e.g., neuromodulation) focused on improved social functioning.

Object-oriented hand dexterity and grasping abilities, from the animal quarters to the neurosurgical OR: a systematic review of the underlying neural correlates in non-human, human primate and recent findings in awake brain surgery

Introduction

The sensorimotor integrations subserving object-oriented manipulative actions have been extensively investigated in non-human primates via direct approaches, as intracortical micro-stimulation (ICMS), cytoarchitectonic analysis and anatomical tracers. However, the understanding of the mechanisms underlying complex motor behaviors is yet to be fully integrated in brain mapping paradigms and the consistency of these findings with intraoperative data obtained during awake neurosurgical procedures for brain tumor removal is still largely unexplored. Accordingly, there is a paucity of systematic studies reviewing the cross-species analogies in neural activities during object-oriented hand motor tasks in primates and investigating the concordance with intraoperative findings during brain mapping. The current systematic review was designed to summarize the cortical and subcortical neural correlates of object-oriented fine hand actions, as revealed by fMRI and PET studies, in non-human and human primates and how those were translated into neurosurgical studies testing dexterous hand-movements during intraoperative brain mapping.

Methods

A systematic literature review was conducted following the PRISMA guidelines. PubMed, EMBASE and Web of Science databases were searched. Original articles were included if they: (1) investigated cortical activation sites on fMRI and/or PET during grasping task; (2) included humans or non-human primates. A second query was designed on the databases above to collect studies reporting motor, hand manipulation and dexterity tasks for intraoperative brain mapping in patients undergoing awake brain surgery for any condition. Due to the heterogeneity in neurosurgical applications, a qualitative synthesis was deemed more appropriate.

Results

We provided an updated overview of the current state of the art in translational neuroscience about the extended frontoparietal grasping-praxis network with a specific focus on the comparative functioning in non-human primates, healthy humans and how the latter knowledge has been implemented in the neurosurgical operating room during brain tumor resection.

Discussion

The anatomical and functional correlates we reviewed confirmed the evolutionary continuum from monkeys to humans, allowing a cautious but practical adoption of such evidence in intraoperative brain mapping protocols. Integrating the previous results in the surgical practice helps preserve complex motor abilities, prevent long-term disability and poor quality of life and allow the maximal safe resection of intrinsic brain tumors.

Dissecting the chain of information processing and its interplay with neurochemicals and fluid intelligence across development

Previous research has highlighted the role of glutamate and gamma-aminobutyric acid (GABA) in perceptual, cognitive, and motor tasks. However, the exact involvement of these neurochemical mechanisms in the chain of information processing, and across human development, is unclear. In a cross-sectional longitudinal design, we used a computational approach to dissociate cognitive, decision, and visuomotor processing in 293 individuals spanning early childhood to adulthood. We found that glutamate and GABA within the intraparietal sulcus (IPS) explained unique variance in visuomotor processing, with higher glutamate predicting poorer visuomotor processing in younger participants but better visuomotor processing in mature participants, while GABA showed the opposite pattern. These findings, which were neurochemically, neuroanatomically and functionally specific, were replicated ~21 mo later and were generalized in two further different behavioral tasks. Using resting functional MRI, we revealed that the relationship between IPS neurochemicals and visuomotor processing is mediated by functional connectivity in the visuomotor network. We then extended our findings to high-level cognitive behavior by predicting fluid intelligence performance. We present evidence that fluid intelligence performance is explained by IPS GABA and glutamate and is mediated by visuomotor processing. However, this evidence was obtained using an uncorrected alpha and needs to be replicated in future studies. These results provide an integrative biological and psychological mechanistic explanation that links cognitive processes and neurotransmitters across human development and establishes their potential involvement in intelligent behavior.

A review of brain regions and associated post-concussion symptoms

The human brain is an exceptionally complex organ that is comprised of billions of neurons. Therefore, when a traumatic event such as a concussion occurs, somatic, cognitive, behavioral, and sleep impairments are the common outcome. Each concussion is unique in the sense that the magnitude of biomechanical forces and the direction, rotation, and source of those forces are different for each concussive event. This helps to explain the unpredictable nature of post-concussion symptoms that can arise and resolve. The purpose of this narrative review is to connect the anatomical location, healthy function, and associated post-concussion symptoms of some major cerebral gray and white matter brain regions and the cerebellum. As a non-exhaustive description of post-concussion symptoms nor comprehensive inclusion of all brain regions, we have aimed to amalgamate the research performed for specific brain regions into a single article to clarify and enhance clinical and research concussion assessment. The current status of concussion diagnosis is highly subjective and primarily based on self-report of symptoms, so this review may be able to provide a connection between brain anatomy and the clinical presentation of concussions to enhance medical imaging assessments. By explaining anatomical relevance in terms of clinical concussion symptom presentation, an increased understanding of concussions may also be achieved to improve concussion recognition and diagnosis.

A systematic review and meta-analysis of voxel-based morphometric studies of fibromyalgia

Objective

Although neuroimaging investigations have revealed significant changes in brain structure in fibromyalgia (FM) patients, these findings are inconsistent. The current study conducted a systematic review and meta-analysis of voxel-based morphometric studies in order to comprehend those alterations in brain structure in FM patients.

Methods

Voxel-based morphometric (VBM) studies published up to January 17, 2023 were searched in the Web of Science, PubMed, EMBASE, Cochrane Library (CENTRAL), China National Knowledge Infrastructure (CNKI), Chongqing VIP, Wanfang Database. Two independent researchers carried out study screening, quality assessment, clinical data and neuroimaging data extraction. The whole-brain voxel-based gray matter (GM) data of FM patients were collected from eligible studies, and meta-analyzed using anisotropic effect size-signed differential mapping (AES-SDM).

Results

Twelve researches were included in this study, including 289 FM patients (mean age: 47.36 years) and 272 HS (mean age: 47.34 years). According to the meta-analysis, FM patients had increased GM in the right postcentral gyrus and left angular gyrus, and decreased GM in the right cingulate gyrus, right paracingulate gyrus, left cerebellum, and left gyrus rectus.

Conclusion

Our study suggests that fibromyalgia patients have altered gray matter in several brain regions that are involved in affective, cognitive functions, and in motor adaptations to pain processing.

A Short Route for Reach Planning between Human V6A and the Motor Cortex

In the macaque monkey, area V6A, located in the medial posterior parietal cortex, contains cells that encode the spatial position of a reaching target. It has been suggested that during reach planning this information is sent to the frontal cortex along a parieto-frontal pathway that connects V6A-premotor cortex-M1. A similar parieto-frontal network may also exist in the human brain, and we aimed here to study the timing of this functional connection during planning of a reaching movement toward different spatial positions. We probed the functional connectivity between human area V6A (hV6A) and the primary motor cortex (M1) using dual-site, paired-pulse transcranial magnetic stimulation with a short (4 ms) and a longer (10 ms) interstimulus interval while healthy participants (18 men and 18 women) planned a visually-guided or a memory-guided reaching movement toward positions located at different depths and directions. We found that, when the stimulation over hV6A is sent 4 ms before the stimulation over M1, hV6A inhibits motor-evoked potentials during planning of either rightward or leftward reaching movements. No modulations were found when the stimulation over hV6A was sent 10 ms before the stimulation over M1, suggesting that only short medial parieto-frontal routes are active during reach planning. Moreover, the short route of hV6A-premotor cortex-M1 is active during reach planning irrespectively of the nature (visual or memory) of the reaching target. These results agree with previous neuroimaging studies and provide the first demonstration of the flow of inhibitory signals between hV6A and M1.SIGNIFICANCE STATEMENT All our dexterous movements depend on the correct functioning of the network of brain areas. Knowing the functional timing of these networks is useful to gain a deeper understanding of how the brain works to enable accurate arm movements. In this article, we probed the parieto-frontal network and demonstrated that it takes 4 ms for the medial posterior parietal cortex to send inhibitory signals to the frontal cortex during reach planning. This fast flow of information seems not to be dependent on the availability of visual information regarding the reaching target. This study opens the way for future studies to test how this timing could be impaired in different neurological disorders.

Parietofrontal oscillations show hand-specific interactions with top-down movement plans

To generate a hand-specific reach plan, the brain must integrate hand-specific signals with the desired movement strategy. Although various neurophysiology/imaging studies have investigated hand-target interactions in simple reach-to-target tasks, the whole brain timing and distribution of this process remain unclear, especially for more complex, instruction-dependent motor strategies. Previously, we showed that a pro/anti pointing instruction influences magnetoencephalographic (MEG) signals in frontal cortex that then propagate recurrently through parietal cortex (Blohm G, Alikhanian H, Gaetz W, Goltz HC, DeSouza JF, Cheyne DO, Crawford JD. NeuroImage 197: 306-319, 2019). Here, we contrasted left versus right hand pointing in the same task to investigate 1) which cortical regions of interest show hand specificity and 2) which of those areas interact with the instructed motor plan. Eight bilateral areas, the parietooccipital junction (POJ), superior parietooccipital cortex (SPOC), supramarginal gyrus (SMG), medial/anterior interparietal sulcus (mIPS/aIPS), primary somatosensory/motor cortex (S1/M1), and dorsal premotor cortex (PMd), showed hand-specific changes in beta band power, with four of these (M1, S1, SMG, aIPS) showing robust activation before movement onset. M1, SMG, SPOC, and aIPS showed significant interactions between contralateral hand specificity and the instructed motor plan but not with bottom-up target signals. Separate hand/motor signals emerged relatively early and lasted through execution, whereas hand-motor interactions only occurred close to movement onset. Taken together with our previous results, these findings show that instruction-dependent motor plans emerge in frontal cortex and interact recurrently with hand-specific parietofrontal signals before movement onset to produce hand-specific motor behaviors.NEW & NOTEWORTHY The brain must generate different motor signals depending on which hand is used. The distribution and timing of hand use/instructed motor plan integration are not understood at the whole brain level. Using MEG we show that different action planning subnetworks code for hand usage and integrating hand use into a hand-specific motor plan. The timing indicates that frontal cortex first creates a general motor plan and then integrates hand specificity to produce a hand-specific motor plan.

Neural substrates of spatial processing and navigation in blindness: An activation likelihood estimation meta-analysis

Even though vision is considered the best suited sensory modality to acquire spatial information, blind individuals can form spatial representations to navigate and orient themselves efficiently in space. Consequently, many studies support the amodality hypothesis of spatial representations since sensory modalities other than vision contribute to the formation of spatial representations, independently of visual experience and imagery. However, given the high variability in abilities and deficits observed in blind populations, a clear consensus about the neural representations of space has yet to be established. To this end, we performed a meta-analysis of the literature on the neural correlates of spatial processing and navigation via sensory modalities other than vision, like touch and audition, in individuals with early and late onset blindness. An activation likelihood estimation (ALE) analysis of the neuroimaging literature revealed that early blind individuals and sighted controls activate the same neural networks in the processing of non-visual spatial information and navigation, including the posterior parietal cortex, frontal eye fields, insula, and the hippocampal complex. Furthermore, blind individuals also recruit primary and associative occipital areas involved in visuo-spatial processing via cross-modal plasticity mechanisms. The scarcity of studies involving late blind individuals did not allow us to establish a clear consensus about the neural substrates of spatial representations in this specific population. In conclusion, the results of our analysis on neuroimaging studies involving early blind individuals support the amodality hypothesis of spatial representations.

Multiple cortical visual streams in humans

The effective connectivity between 55 visual cortical regions and 360 cortical regions was measured in 171 HCP participants using the HCP-MMP atlas, and complemented with functional connectivity and diffusion tractography. A Ventrolateral Visual "What" Stream for object and face recognition projects hierarchically to the inferior temporal visual cortex, which projects to the orbitofrontal cortex for reward value and emotion, and to the hippocampal memory system. A Ventromedial Visual "Where" Stream for scene representations connects to the parahippocampal gyrus and hippocampus. An Inferior STS (superior temporal sulcus) cortex Semantic Stream receives from the Ventrolateral Visual Stream, from visual inferior parietal PGi, and from the ventromedial-prefrontal reward system and connects to language systems. A Dorsal Visual Stream connects via V2 and V3A to MT+ Complex regions (including MT and MST), which connect to intraparietal regions (including LIP, VIP and MIP) involved in visual motion and actions in space. It performs coordinate transforms for idiothetic update of Ventromedial Stream scene representations. A Superior STS cortex Semantic Stream receives visual inputs from the Inferior STS Visual Stream, PGi, and STV, and auditory inputs from A5, is activated by face expression, motion and vocalization, and is important in social behaviour, and connects to language systems.

An anti-inertial motion bias explains people discounting inertial motion of carried objects

In this paper we propose an anti-inertial motion (AIM) bias that can explain several intuitive physics beliefs including the straight-down belief and beliefs held concerning the pendulum problem. We show how the AIM bias also explains two new beliefs that we explore - a straight-up-and-down belief as well as a straight-out/backward bias that occurs for objects traveling in one plane that are then thrown in another plane, ostensibly affording a greater opportunity for perception of canonical motion. We then show how the AIM bias in general is invariant across perceived/imagined speed of the object carrier, only altering percentages of straight-out from backward responses, and why occluding the carrier once the object is released into a second plane does not result in more veridical perception. The AIM bias serves as a simple explanation for a family of beliefs including those in the current paper as well as those shown in previous work.

Choosing Sides: Impact of Prismatic Adaptation on the Lateralization of the Attentional System

Seminal studies revealed differences between the effect of adaptation to left- vs. right-deviating prisms (L-PA, R-PA) in normal subjects. Whereas L-PA leads to neglect-like shift in attention, demonstrated in numerous visuo-spatial and cognitive tasks, R-PA has only minor effects in specific aspects of a few tasks. The paucity of R-PA effects in normal subjects contrasts with the striking alleviation of neglect symptoms in patients with right hemispheric lesions. Current evidence from activation studies in normal subjects highlights the contribution of regions involved in visuo-motor control during prism exposure and a reorganization of spatial representations within the ventral attentional network (VAN) after the adaptation. The latter depends on the orientation of prisms used. R-PA leads to enhancement of the ipsilateral visual and auditory space within the left inferior parietal lobule (IPL), switching thus the dominance of VAN from the right to the left hemisphere. L-PA leads to enhancement of the ipsilateral space in right IPL, emphasizing thus the right hemispheric dominance of VAN. Similar reshaping has been demonstrated in patients. We propose here a model, which offers a parsimonious explanation of the effect of L-PA and R-PA both in normal subjects and in patients with hemispheric lesions. The model posits that prismatic adaptation induces instability in the synaptic organization of the visuo-motor system, which spreads to the VAN. The effect is lateralized, depending on the side of prism deviation. Successful pointing with prisms implies reaching into the space contralateral, and not ipsilateral, to the direction of prism deviation. Thus, in the hemisphere contralateral to prism deviation, reach-related neural activity decreases, leading to instability of the synaptic organization, which induces a reshuffling of spatial representations in IPL. Although reshuffled spatial representations in IPL may be functionally relevant, they are most likely less efficient than regular representations and may thus cause partial dysfunction. The former explains, e.g., the alleviation of neglect symptoms after R-PA in patients with right hemispheric lesions, the latter the occurrence of neglect-like symptoms in normal subjects after L-PA. Thus, opting for R- vs. L-PA means choosing the side of major IPL reshuffling, which leads to its partial dysfunction in normal subjects and to recruitment of alternative or enhanced spatial representations in patients with hemispheric lesions.

The role of the anterior temporal cortex in action: evidence from fMRI multivariate searchlight analysis during real object grasping

Intelligent manipulation of handheld tools marks a major discontinuity between humans and our closest ancestors. Here we identified neural representations about how tools are typically manipulated within left anterior temporal cortex, by shifting a searchlight classifier through whole-brain real action fMRI data when participants grasped 3D-printed tools in ways considered typical for use (i.e., by their handle). These neural representations were automatically evocated as task performance did not require semantic processing. In fact, findings from a behavioural motion-capture experiment confirmed that actions with tools (relative to non-tool) incurred additional processing costs, as would be suspected if semantic areas are being automatically engaged. These results substantiate theories of semantic cognition that claim the anterior temporal cortex combines sensorimotor and semantic content for advanced behaviours like tool manipulation.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Exploring Cognition with Brain-Machine Interfaces

Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.

The macaque ventral intraparietal area has expanded into three homologue human parietal areas

The macaque ventral intraparietal area (VIP) in the fundus of the intraparietal sulcus has been implicated in a diverse range of sensorimotor and cognitive functions such as motion processing, multisensory integration, processing of head peripersonal space, defensive behavior, and numerosity coding. Here, we exhaustively review macaque VIP function, cytoarchitectonics, and anatomical connectivity and integrate it with human studies that have attempted to identify a potential human VIP homologue. We show that human VIP research has consistently identified three, rather than one, bilateral parietal areas that each appear to subsume some, but not all, of the macaque area's functionality. Available evidence suggests that this human "VIP complex" has evolved as an expansion of the macaque area, but that some precursory specialization within macaque VIP has been previously overlooked. The three human areas are dominated, roughly, by coding the head or self in the environment, visual heading direction, and the peripersonal environment around the head, respectively. A unifying functional principle may be best described as prediction in space and time, linking VIP to state estimation as a key parietal sensorimotor function. VIP's expansive differentiation of head and self-related processing may have been key in the emergence of human bodily self-consciousness.

How do visual skills relate to action video game performance?

It has been claimed that video gamers possess increased perceptual and cognitive skills compared to non-video gamers. Here, we examined to which extent gaming performance in CS:GO (Counter-Strike: Global Offensive) correlates with visual performance. We tested 94 players ranging from beginners to experts with a battery of visual paradigms, such as visual acuity and contrast detection. In addition, we assessed performance in specific gaming skills, such as shooting and tracking, and administered personality traits. All measures together explained about 70% of the variance of the players’ rank. In particular, regression models showed that a few visual abilities, such as visual acuity in the periphery and the susceptibility to the Honeycomb illusion, were strongly associated with the players’ rank. Although the causality of the effect remains unknown, our results show that high-rank players perform better in certain visual skills compared to low-rank players.

The Interrelation Between Peripersonal Action Space and Interpersonal Social Space: Psychophysiological Evidence and Clinical Implications

The peripersonal space is an adaptive and flexible interface between the body and the environment that fulfills a dual-motor function: preparing the body for voluntary object-oriented actions to interact with incentive stimuli and preparing the body for defensive responses when facing potentially harmful stimuli. In this position article, we provide arguments for the sensorimotor rooting of the peripersonal space representation and highlight the variables that contribute to its flexible and adaptive characteristics. We also demonstrate that peripersonal space represents a mediation zone between the body and the environment contributing to not only the control of goal-directed actions but also the organization of social life. The whole of the data presented and discussed led us to the proposal of a new theoretical framework linking the peripersonal action space and the interpersonal social space and we highlight how this theoretical framework can account for social behaviors in populations with socio-emotional deficits.

Grasping and Manipulation: Neural Bases and Anatomical Circuitry in Humans

Neurophysiological and neuroimaging evidence suggests a significant contribution of several brain areas, including subdivisions of the parietal and the premotor cortex, during the processing of different components of hand and arm movements. Many investigations improved our knowledge about the neural processes underlying the execution of reaching and grasping actions, while few studies have directly investigated object manipulation. Most studies on the latter topic concern the use of tools to achieve specific goals. Yet, there are very few studies on pure manipulation performed in order to explore and recognize objects, as well as on manipulation performed with a high level of manual dexterity. Another dimension that is quite neglected by the available studies on grasping and manipulation is, on the one hand, the contribution of the subcortical nodes, first of all the basal ganglia and cerebellum, to these functions, and, on the other hand, recurrent connections of these structures with cortical areas. In the first part, we have reviewed the parieto-premotor and subcortical circuits underlying reaching and grasping in humans, with a focus on functional neuroimaging data. Then, we have described the main structures recruited during object manipulation. We have also reported the contribution of recent structural connectivity techniques whereby the cortico-cortical and cortico-subcortical connections of grasping-related and manipulation-related areas in the human brain can be determined. Based on our review, we have concluded that studies on cortical and subcortical circuits involved in grasping and manipulation might be promising to provide new insights about motor learning and brain plasticity in patients with motor disorders.

Transcranial Magnetic Stimulation Over the Human Medial Posterior Parietal Cortex Disrupts Depth Encoding During Reach Planning

Accumulating evidence supports the view that the medial part of the posterior parietal cortex (mPPC) is involved in the planning of reaching, but while plenty of studies investigated reaching performed toward different directions, only a few studied different depths. Here, we investigated the causal role of mPPC (putatively, human area V6A-hV6A) in encoding depth and direction of reaching. Specifically, we applied single-pulse transcranial magnetic stimulation (TMS) over the left hV6A at different time points while 15 participants were planning immediate, visually guided reaching by using different eye-hand configurations. We found that TMS delivered over hV6A 200 ms after the Go signal affected the encoding of the depth of reaching by decreasing the accuracy of movements toward targets located farther with respect to the gazed position, but only when they were also far from the body. The effectiveness of both retinotopic (farther with respect to the gaze) and spatial position (far from the body) is in agreement with the presence in the monkey V6A of neurons employing either retinotopic, spatial, or mixed reference frames during reach plan. This work provides the first causal evidence of the critical role of hV6A in the planning of visually guided reaching movements in depth.

Multiple processes independently predict motor learning

Background

Our ability to acquire, refine and adapt skilled limb movements is a hallmark of human motor learning that allows us to successfully perform many daily activities. The capacity to acquire, refine and adapt other features of motor performance, such as visual search, eye-hand coordination and visuomotor decisions, may also contribute to motor learning. However, the extent to which refinements of multiple behavioral features and their underlying neural processes independently contribute to motor learning remains unknown. In the current study, we used an ethological approach to test the hypothesis that practice-related refinements of multiple behavioral features would be independently predictive of motor learning.

Methods

Eighteen healthy, young adults used an upper-limb robot with eye-tracking to practice six trials of a continuous, visuomotor task once a week for six consecutive weeks. Participants used virtual paddles to hit away 200 “Targets” and avoid hitting 100 “Distractors” that continuously moved towards them from the back of the workspace. Motor learning was inferred from trial-by-trial acquisition and week-by-week retention of improvements on two measures of task performance related to motor execution and motor inhibition. Adaptations involving underlying neural processes were inferred from trial-by-trial acquisition and week-by-week retention of refinements on measures of skilled limb movement, visual search, eye-hand coordination and visuomotor decisions. We tested our hypothesis by quantifying the extent to which refinements on measures of multiple behavioral features (predictors) were independently predictive of improvements on our two measures of task performance (outcomes) after removing all shared variance between predictors.

Results

We found that refinements on measures of skilled limb movement, visual search and eye-hand coordination were independently predictive of improvements on our measure of task performance related to motor execution. In contrast, only refinements of eye-hand coordination were independently predictive of improvements on our measure of task performance related to motor inhibition.

Conclusion

Our results provide indirect evidence that refinements involving multiple, neural processes may independently contribute to motor learning, and distinct neural processes may underlie improvements in task performance related to motor execution and motor inhibition. This also suggests that refinements involving multiple, neural processes may contribute to motor recovery after stroke, and rehabilitation interventions should be designed to produce refinements of all behavioral features that may contribute to motor recovery.

Gaze direction influences grasping actions towards unseen, haptically explored, objects

Haptic exploration produces mental object representations that can be memorized for subsequent object-directed behaviour. Storage of haptically-acquired object images (HOIs), engages, besides canonical somatosensory areas, the early visual cortex (EVC). Clear evidence for a causal contribution of EVC to HOI representation is still lacking. The use of visual information by the grasping system undergoes necessarily a frame of reference shift by integrating eye-position. We hypothesize that if the motor system uses HOIs stored in a retinotopic coding in the visual cortex, then its use is likely to depend at least in part on eye position. We measured the kinematics of 4 fingers in the right hand of 15 healthy participants during the task of grasping different unseen objects behind an opaque panel, that had been previously explored haptically. The participants never saw the object and operated exclusively based on haptic information. The position of the object was fixed, in front of the participant, but the subject’s gaze varied from trial to trial between 3 possible positions, towards the unseen object or away from it, on either side. Results showed that the middle and little fingers’ kinematics during reaching for the unseen object changed significantly according to gaze position. In a control experiment we showed that intransitive hand movements were not modulated by gaze direction. Manipulating eye-position produces small but significant configuration errors, (behavioural errors due to shifts in frame of reference) possibly related to an eye-centered frame of reference, despite the absence of visual information, indicating sharing of resources between the haptic and the visual/oculomotor system to delayed haptic grasping.

The Topography of Visually Guided Grasping in the Premotor Cortex: A Dense-Transcranial Magnetic Stimulation (TMS) Mapping Study

Visuomotor transformations at the cortical level occur along a network where posterior parietal regions are connected to homologous premotor regions. Grasping-related activity is represented in a diffuse, ventral and dorsal system in the posterior parietal regions, but no systematic causal description of a premotor counterpart of a similar diffuse grasping representation is available. To fill this gap, we measured the kinematics of right finger movements in 17 male and female human participants during grasping of three objects of different sizes. Single-pulse transcranial magnetic stimulation was applied 100 ms after visual presentation of the object over a regular grid of 8 spots covering the left premotor cortex (PMC) and 2 Sham stimulations. Maximum finger aperture during reach was used as the feature to classify object size in different types of classifiers. Classification accuracy was taken as a measure of the efficiency of visuomotor transformations for grasping. Results showed that transcranial magnetic stimulation reduced classification accuracy compared with Sham stimulation when it was applied to 2 spots in the ventral PMC and 1 spot in the medial PMC, corresponding approximately to the ventral PMC and the dorsal portion of the supplementary motor area. Our results indicate a multifocal representation of object geometry for grasping in the PMC that matches the known multifocal parietal maps of grasping representations. Additionally, we confirm that, by applying a uniform spatial sampling procedure, transcranial magnetic stimulation can produce cortical functional maps independent of a priori spatial assumptions.SIGNIFICANCE STATEMENT Visually guided actions activate a large frontoparietal network. Here, we used a dense grid of transcranial magnetic stimulation spots covering the whole premotor cortex (PMC), to identify with accurate spatial mapping the functional specialization of the human PMC during grasping movement. Results corroborate previous findings about the role of the ventral PMC in preshaping the fingers according to the size of the target. Crucially, we found that the medial part of PMC, putatively covering the supplementary motor area, plays a direct role in object grasping. In concert with findings in nonhuman primates, these results indicate a multifocal representation of object geometry for grasping in the PMC and expand our understanding of how our brain integrates visual and motor information to perform visually guided actions.

Allocentric representations for target memory and reaching in human cortex

The use of allocentric cues for movement guidance is complex because it involves the integration of visual targets and independent landmarks and the conversion of this information into egocentric commands for action. Here, we focus on the mechanisms for encoding reach targets relative to visual landmarks in humans. First, we consider the behavioral results suggesting that both of these cues influence target memory, but are then transformed-at the first opportunity-into egocentric commands for action. We then consider the cortical mechanisms for these behaviors. We discuss different allocentric versus egocentric mechanisms for coding of target directional selectivity in memory (inferior temporal gyrus versus superior occipital gyrus) and distinguish these mechanisms from parieto-frontal activation for planning egocentric direction of actual reach movements. Then, we consider where and how the former allocentric representations of remembered reach targets are converted into the latter egocentric plans. In particular, our recent neuroimaging study suggests that four areas in the parietal and frontal cortex (right precuneus, bilateral dorsal premotor cortex, and right presupplementary area) participate in this allo-to-ego conversion. Finally, we provide a functional overview describing how and why egocentric and landmark-centered representations are segregated early in the visual system, but then reintegrated in the parieto-frontal cortex for action.

No effect of triple-pulse TMS medial to intraparietal sulcus on online correction for target perturbations during goal-directed hand and foot reaches

Posterior parietal cortex (PPC) is central to sensorimotor processing for goal-directed hand and foot movements. Yet, the specific role of PPC subregions in these functions is not clear. Previous human neuroimaging and transcranial magnetic stimulation (TMS) work has suggested that PPC lateral to the intraparietal sulcus (IPS) is involved in directing the arm, shaping the hand, and correcting both finger-shaping and hand trajectory during movement. The lateral localization of these functions agrees with the comparably lateral position of the hand and fingers within the motor and somatosensory homunculi along the central sulcus; this might suggest that, in analogy, (goal-directed) foot movements would be mediated by medial portions of PPC. However, foot movement planning activates similar regions for both hand and foot movement along the caudal-to-rostral axis of PPC, with some effector-specificity evident only rostrally, near the central regions of sensorimotor cortex. Here, we attempted to test the causal involvement of PPC regions medial to IPS in hand and foot reaching as well as online correction evoked by target displacement. Participants made hand and foot reaches towards identical visual targets. Sometimes, the target changed position 100–117 ms into the movement. We disturbed cortical processing over four positions medial to IPS with three pulses of TMS separated by 40 ms, both during trials with and without target displacement. We timed TMS to disrupt reach execution and online correction. TMS did not affect endpoint error, endpoint variability, or reach trajectories for hand or foot. While these negative results await replication with different TMS timing and parameters, we conclude that regions medial to IPS are involved in planning, rather than execution and online control, of goal-directed limb movements.

The function of "looking-at-nothing" for sequential sensorimotor tasks: Eye movements to remembered action-target locations

When performing manual actions, eye movements precede hand movements to target locations: Before we grasp an object, we look at it. Eye-hand guidance is even preserved when visual targets are unavailable, e.g., grasping behind an occlusion. This "looking-atnothing" behavior might be functional, e.g., as "deictic pointer" for manual control or as memory-retrieval cue, or a by-product of automatization. Here, it is studied if looking at empty locations before acting on them is beneficial for sensorimotor performance. In five experiments, participants completed a click sequence on eight visual targets for 0-100 trials while they had either to fixate on the screen center or could move their eyes freely. During 50-100 consecutive trials, participants clicked the same sequence on a blank screen with free or fixed gaze. During both phases, participants looked at target locations when gaze shifts were allowed. With visual targets, target fixations led to faster, more precise clicking, fewer errors, and sparser cursor-paths than central fixation. Without visual information, a tiny free-gaze benefit could sometimes be observed and was rather a memory than a motor-calculation benefit. Interestingly, central fixation during learning forced early explicit encoding causing a strong benefit for acting on remembered targets later, independent of whether eyes moved then.

Decoding Grasping Movements from the Parieto-Frontal Reaching Circuit in the Nonhuman Primate

Prehension movements typically include a reaching phase, guiding the hand toward the object, and a grip phase, shaping the hand around it. The dominant view posits that these components rely upon largely independent parieto-frontal circuits: a dorso-medial circuit involved in reaching and a dorso-lateral circuit involved in grasping. However, mounting evidence suggests a more complex arrangement, with dorso-medial areas contributing to both reaching and grasping. To investigate the role of the dorso-medial reaching circuit in grasping, we trained monkeys to reach-and-grasp different objects in the dark and determined if hand configurations could be decoded from functional magnetic resonance imaging (MRI) responses obtained from the reaching and grasping circuits. Indicative of their established role in grasping, object-specific grasp decoding was found in anterior intraparietal (AIP) area, inferior parietal lobule area PFG and ventral premotor region F5 of the lateral grasping circuit, and primary motor cortex. Importantly, the medial reaching circuit also conveyed robust grasp-specific information, as evidenced by significant decoding in parietal reach regions (particular V6A) and dorsal premotor region F2. These data support the proposed role of dorso-medial "reach" regions in controlling aspects of grasping and demonstrate the value of complementing univariate with more sensitive multivariate analyses of functional MRI (fMRI) data in uncovering information coding in the brain.

The neural basis of hand choice: An fMRI investigation of the Posterior Parietal Interhemispheric Competition model

The current study investigates a new neurobiological model of human hand choice: The Posterior Parietal Interhemispheric Competition (PPIC) model. The model specifies that neural populations in bilateral posterior intraparietal and superior parietal cortex (pIP-SPC) encode actions in hand-specific terms, and compete for selection across and within hemispheres. Actions with both hands are encoded bilaterally, but the contralateral hand is overrepresented. We use a novel fMRI paradigm to test the PPIC model. Participants reach to visible targets while in the scanner, and conditions involving free choice of which hand to use (Choice) are compared with when hand-use is instructed. Consistent with the PPIC model, bilateral pIP-SPC is preferentially responsive for the Choice condition, and for actions made with the contralateral hand. In the right pIP-SPC, these effects include anterior intraparietal and superior parieto-occipital cortex. Left dorsal premotor cortex, and an area in the right lateral occipitotemporal cortex show the same response pattern, while the left inferior parietal lobule is preferentially responsive for the Choice condition and when using the ipsilateral hand. Behaviourally, hand choice is biased by target location - for targets near the left/right edges of the display, the hand in ipsilateral hemispace is favoured. Moreover, consistent with a competitive process, response times are prolonged for choices to more ambiguous targets, where hand choice is relatively unbiased, and fMRI responses in bilateral pIP-SPC parallel this pattern. Our data provide support for the PPIC model, and reveal a selective network of brain areas involved in free hand choice, including bilateral posterior parietal cortex, left-lateralized inferior parietal and dorsal premotor cortices, and the right lateral occipitotemporal cortex.

Neural substrates for allocentric-to-egocentric conversion of remembered reach targets in humans

Targets for goal-directed action can be encoded in allocentric coordinates (relative to another visual landmark), but it is not known how these are converted into egocentric commands for action. Here, we investigated this using a slow event-related fMRI paradigm, based on our previous behavioural finding that the allocentric-to-egocentric (Allo-Ego) conversion for reach is performed at the first possible opportunity. Participants were asked to remember (and eventually reach towards) the location of a briefly presented target relative to another visual landmark. After a first memory delay, participants were forewarned by a verbal instruction if the landmark would reappear at the same location (potentially allowing them to plan a reach following the auditory cue before the second delay), or at a different location where they had to wait for the final landmark to be presented before response, and then reach towards the remembered target location. As predicted, participants showed landmark-centred directional selectivity in occipital-temporal cortex during the first memory delay, and only developed egocentric directional selectivity in occipital-parietal cortex during the second delay for the 'Same cue' task, and during response for the 'Different cue' task. We then compared cortical activation between these two tasks at the times when the Allo-Ego conversion occurred, and found common activation in right precuneus, right presupplementary area and bilateral dorsal premotor cortex. These results confirm that the brain converts allocentric codes to egocentric plans at the first possible opportunity, and identify the four most likely candidate sites specific to the Allo-Ego transformation for reaches.

The dorsal "action" pathway

In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.

Optic ataxia: beyond the dorsal stream cliché

This chapter reviews clinical and scientific approaches to optic ataxia. This double historic track allows us to address important issues such as the link between Bálint syndrome and optic ataxia, the alleged double dissociation between optic ataxia and visual agnosia, and the use of optic ataxia to argue for a specific vision-for-action occipitoposterior parietal stream. Clinical cases are described and reveal that perceptual deficits have been long shown to accompany ataxia. Importantly, the term ataxia appears to be misleading as patients exhibit a combination of visual and nonvisual perceptual, attentional, and visuomotor guidance deficits, which are confirmed by experimental approaches. Three major features of optic ataxia are described. The first is a spatial feature whereby the deficits exhibited by patients appear to be specific to peripheral vision, akin to the field effect. Visuomotor field examination allows us to quantify this deficit and reveals that it consists of a highly reliable retinocentric hypometria. The third is a temporal feature whereby these deficits are exacerbated under temporal constraints, i.e., when attending to dynamic stimuli. These two aspects combine in a situation where patients have to quickly respond to a target presented in peripheral vision that is experimentally displaced upon movement onset. In addition to the field effect, a hand effect can be described in conditions where the hand is not visible. Spatial and temporal aspects as well as field and hand effects may rely on several posterior parietal modules that remain to be precisely identified both anatomically and functionally. It is concluded that optic ataxia is not a visuomotor deficit and there is no dissociation between perception and action capacities in optic ataxia, hence a fortiori no double dissociation between optic ataxia and visual agnosia. Future directions for understanding the basic pathophysiology of optic ataxia are proposed.

Effector-based attention systems

Visual processing is known to be enhanced at the end point of eye movements. Feedback within the oculomotor system has been shown to drive these alterations in visual processing. However, we do not simply view the world; we also reach out and interact using our hands. Consequently, it is not surprising that visual processing has also been shown to be altered in near-hand space. A growing body of work documents a myriad of alterations in near-hand visual processing, with little consensus on the neural underpinnings of the effect of the hand. Since movement of the eyes and hands is governed by parallel frontoparietal networks and since within the oculomotor system feedback from these motor control regions has been shown to drive enhanced visual processing at saccade end points, it is plausible that a similar feedback mechanism is at play in near-hand improvements in visual processing. Here, we compare and contrast oculomotor-driven and hand-driven changes in visual processing and provide support for the hypothesis that feedback within the reaching and grasping systems enhances visual processing near the hand in a novel way.

Partially Mixed Selectivity in Human Posterior Parietal Association Cortex

To clarify the organization of motor representations in posterior parietal cortex, we test how three motor variables (body side, body part, cognitive strategy) are coded in the human anterior intraparietal cortex. All tested movements were encoded, arguing against strict anatomical segregation of effectors. Single units coded for diverse conjunctions of variables, with different dimensions anatomically overlapping. Consistent with recent studies, neurons encoding body parts exhibited mixed selectivity. This mixed selectivity resulted in largely orthogonal coding of body parts, which "functionally segregate" the effector responses despite the high degree of anatomical overlap. Body side and strategy were not coded in a mixed manner as effector determined their organization. Mixed coding of some variables over others, what we term "partially mixed coding," argues that the type of functional encoding depends on the compared dimensions. This structure is advantageous for neuroprosthetics, allowing a single array to decode movements of a large extent of the body.

Upper limb and eye movement coordination during reaching tasks in people with stroke

PURPOSE

To enhance understanding of the relationship between upper limb and eye movements during reaching tasks in people with stroke.

METHODS

Eye movements were recorded from 10 control participants and 8 chronic stroke participants during a visual orienting task (Experiment 1) and a series of reaching tasks (Experiment 2). Stroke participants completed the reaching tasks using (i) their less impaired upper limb, (ii) their more impaired upper limb without support, and (iii) their more impaired upper limb, with support (SaeboMAS gravitational support and/or electrical stimulation). Participants were tested individually and completed both experiments in the same session.

RESULTS

Oculomotor control and the coordination between the upper limb and the oculomotor system were found to be intact in stroke participants when no limb movements were required, or when the less impaired upper limb was used. However, when the more impaired upper limb was used, success and accuracy in reaching decreased and patterns of eye movements changed, with an observed increase in eye movements to the limb itself. With upper limb support, patterns of hand-eye coordination were found to more closely resemble those of the control group.

CONCLUSION

Deficits in upper limb motor systems result in changes in patterns of eye movement behavior during reaching tasks. These changes in eye movement behavior can be modulated by providing upper limb support. Implications for Rehabilitation Deficits in upper limb motor systems can result in changes in patterns of eye movement behavior during reaching tasks. Upper limb support can reduce deficits in hand-eye coordination. Stroke rehabilitation outcomes should consider motor and oculomotor performance.

The Intersection between Ocular and Manual Motor Control: Eye-Hand Coordination in Acquired Brain Injury

Acute and chronic disease processes that lead to cerebral injury can often be clinically challenging diagnostically, prognostically, and therapeutically. Neurodegenerative processes are one such elusive diagnostic group, given their often diffuse and indolent nature, creating difficulties in pinpointing specific structural abnormalities that relate to functional limitations. A number of studies in recent years have focused on eye-hand coordination (EHC) in the setting of acquired brain injury (ABI), highlighting the important set of interconnected functions of the eye and hand and their relevance in neurological conditions. These experiments, which have concentrated on focal lesion-based models, have significantly improved our understanding of neurophysiology and underscored the sensitivity of biomarkers in acute and chronic neurological disease processes, especially when such biomarkers are combined synergistically. To better understand EHC and its connection with ABI, there is a need to clarify its definition and to delineate its neuroanatomical and computational underpinnings. Successful EHC relies on the complex feedback- and prediction-mediated relationship between the visual, ocular motor, and manual motor systems and takes advantage of finely orchestrated synergies between these systems in both the spatial and temporal domains. Interactions of this type are representative of functional sensorimotor control, and their disruption constitutes one of the most frequent deficits secondary to brain injury. The present review describes the visually mediated planning and control of eye movements, hand movements, and their coordination, with a particular focus on deficits that occur following neurovascular, neurotraumatic, and neurodegenerative conditions. Following this review, we also discuss potential future research directions, highlighting objective EHC as a sensitive biomarker complement within acute and chronic neurological disease processes.