Influence of gaze, vision, and memory on hand kinematics in a placement task

People usually reach for objects to place them in some position and orientation, but the placement component of this sequence is often ignored. For example, reaches are influenced by gaze position, visual feedback, and memory delays, but their influence on object placement is unclear. Here, we tested these factors in a task where participants placed and oriented a trapezoidal block against two-dimensional (2-D) visual templates displayed on a frontally located computer screen. In experiment 1, participants matched the block to three possible orientations: 0° (horizontal), +45° and -45°, with gaze fixated 10° to the left/right. The hand and template either remained illuminated (closed-loop), or visual feedback was removed (open-loop). Here, hand location consistently overshot the template relative to gaze, especially in the open-loop task; likewise, orientation was influenced by gaze position (depending on template orientation and visual feedback). In experiment 2, a memory delay was added, and participants sometimes performed saccades (toward, away from, or across the template). In this task, the influence of gaze on orientation vanished, but location errors were influenced by both template orientation and final gaze position. Contrary to our expectations, the previous saccade metrics also impacted placement overshoot. Overall, hand orientation was influenced by template orientation in a nonlinear fashion. These results demonstrate interactions between gaze and orientation signals in the planning and execution of hand placement and suggest different neural mechanisms for closed-loop, open-loop, and memory delay placement.NEW & NOTEWORTHY Eye-hand coordination studies usually focus on object acquisition, but placement is equally important. We investigated how gaze position influences object placement toward a 2-D template with different levels of visual feedback. Like reach, placement overestimated goal location relative to gaze and was influenced by previous saccade metrics. Gaze also modulated hand orientation, depending on template orientation and level of visual feedback. Gaze influence was feedback-dependent, with location errors having no significant effect after a memory delay.

Parietofrontal oscillations show hand-specific interactions with top-down movement plans

To generate a hand-specific reach plan, the brain must integrate hand-specific signals with the desired movement strategy. Although various neurophysiology/imaging studies have investigated hand-target interactions in simple reach-to-target tasks, the whole brain timing and distribution of this process remain unclear, especially for more complex, instruction-dependent motor strategies. Previously, we showed that a pro/anti pointing instruction influences magnetoencephalographic (MEG) signals in frontal cortex that then propagate recurrently through parietal cortex (Blohm G, Alikhanian H, Gaetz W, Goltz HC, DeSouza JF, Cheyne DO, Crawford JD. NeuroImage 197: 306-319, 2019). Here, we contrasted left versus right hand pointing in the same task to investigate 1) which cortical regions of interest show hand specificity and 2) which of those areas interact with the instructed motor plan. Eight bilateral areas, the parietooccipital junction (POJ), superior parietooccipital cortex (SPOC), supramarginal gyrus (SMG), medial/anterior interparietal sulcus (mIPS/aIPS), primary somatosensory/motor cortex (S1/M1), and dorsal premotor cortex (PMd), showed hand-specific changes in beta band power, with four of these (M1, S1, SMG, aIPS) showing robust activation before movement onset. M1, SMG, SPOC, and aIPS showed significant interactions between contralateral hand specificity and the instructed motor plan but not with bottom-up target signals. Separate hand/motor signals emerged relatively early and lasted through execution, whereas hand-motor interactions only occurred close to movement onset. Taken together with our previous results, these findings show that instruction-dependent motor plans emerge in frontal cortex and interact recurrently with hand-specific parietofrontal signals before movement onset to produce hand-specific motor behaviors.NEW & NOTEWORTHY The brain must generate different motor signals depending on which hand is used. The distribution and timing of hand use/instructed motor plan integration are not understood at the whole brain level. Using MEG we show that different action planning subnetworks code for hand usage and integrating hand use into a hand-specific motor plan. The timing indicates that frontal cortex first creates a general motor plan and then integrates hand specificity to produce a hand-specific motor plan.

Neural encoding and functional interactions underlying pantomimed movements

Pantomimes are a unique movement category which can convey complex information about our intentions in the absence of any interaction with real objects. Indeed, we can pretend to use the same tool to perform different actions or to achieve the same goal adopting different tools. Nevertheless, how our brain implements pantomimed movements is still poorly understood. In our study, we explored the neural encoding and functional interactions underlying pantomimes adopting multivariate pattern analysis (MVPA) and connectivity analysis of fMRI data. Participants performed pantomimed movements, either grasp-to-move or grasp-to-use, as if they were interacting with two different tools (scissors or axe). These tools share the possibility to achieve the same goal. We adopted MVPA to investigate two levels of representation during the planning and execution of pantomimes: (1) distinguishing different actions performed with the same tool, (2) representing the same final goal irrespective of the adopted tool. We described widespread encoding of action information within regions of the so-called “tool” network. Several nodes of the network—comprising regions within the ventral and the dorsal stream—also represented goal information. The spatial distribution of goal information changed from planning—comprising posterior regions (i.e. parietal and temporal)—to execution—including also anterior regions (i.e. premotor cortex). Moreover, connectivity analysis provided evidence for task-specific bidirectional coupling between the ventral stream and parieto-frontal motor networks. Overall, we showed that pantomimes were characterized by specific patterns of action and goal encoding and by task-dependent cortical interactions.

Ballroom dancers exhibit a dispositional need for arousal and elevated cerebral cortical activity during preferred melodic recall

Background

Although the association of human temperament and preference has been studied previously, few investigations have examined cerebral cortical activation to assess brain dynamics associated with the motivation to engage in performance. The present study adopted a personality and cognitive neuroscience approach to investigate if participation in ballroom dancing is associated with sensation-seeking temperament and elevated cerebral cortical arousal during freely chosen musical recall.

Methods

Preferred tempo, indicated by tapping speed during melodic recall, and a measure of fundamental disposition or temperament were assessed in 70 ballroom dancers and 71 nondancers. All participants completed a trait personality inventory (i.e., the Chen Huichang 60 Temperaments Inventory) to determine four primary types: choleric, sanguine, phlegmatic and melancholic. Participants separately recalled their favorite musical piece and tapped to it with their index finger for 40 beats using a computer keyboard. A subset of 59 participants (29 ballroom dancers and 30 nondancers) also repeated the same tapping task while electroencephalographic (EEG) activity was recorded.

Results

The results revealed that the dancers were more extraverted, indicative of a heightened need for arousal, exhibited a preference for faster musical tempo, and exhibited elevated EEG beta power during the musical recall task relative to nondancers. Paradoxically, dancers also showed elevated introversion (i.e., melancholic score) relative to nondancers, which can be resolved by consideration of interactional personality theory if one assumes reasonably that dance performance environment is perceived in a stimulating manner.

Conclusion

The results are generally consistent with arousal theory, and suggest that ballroom dancers seek elevated stimulation and, thereby, choose to engage with active and energetic rhythmic auditory stimulation, thus providing the nervous system with the requisite stimulation for desired arousal. These results also suggest an underlying predisposition for engagement in ballroom dance and support the gravitational hypothesis, which propose that personality traits and perception lead to the motivation to engage in specific forms of human performance.

Spatiotemporal transformations for gaze control

Sensorimotor transformations require spatiotemporal coordination of signals, that is, through both time and space. For example, the gaze control system employs signals that are time-locked to various sensorimotor events, but the spatial content of these signals is difficult to assess during ordinary gaze shifts. In this review, we describe the various models and methods that have been devised to test this question, and their limitations. We then describe a new method that can (a) simultaneously test between all of these models during natural, head-unrestrained conditions, and (b) track the evolving spatial continuum from target (T) to future gaze coding (G, including errors) through time. We then summarize some applications of this technique, comparing spatiotemporal coding in the primate frontal eye field (FEF) and superior colliculus (SC). The results confirm that these areas preferentially encode eye-centered, effector-independent parameters, and show-for the first time in ordinary gaze shifts-a spatial transformation between visual and motor responses from T to G coding. We introduce a new set of spatial models (T-G continuum) that revealed task-dependent timing of this transformation: progressive during a memory delay between vision and action, and almost immediate without such a delay. We synthesize the results from our studies and supplement it with previous knowledge of anatomy and physiology to propose a conceptual model where cumulative transformation noise is realized as inaccuracies in gaze behavior. We conclude that the spatiotemporal transformation for gaze is both local (observed within and across neurons in a given area) and distributed (with common signals shared across remote but interconnected structures).

A common variant of the NOTCH4 gene modulates functional connectivity of the occipital cortex and its relationship with schizotypal traits

BACKGROUND

Schizotypal traits are considered as inheritable traits and the endophenotype for schizophrenia. A common variant in the NOTCH4 gene, rs204993, has been linked with schizophrenia, but the neural underpinnings are largely unknown.

METHODS

In present study, we compared the differences of brain functions between different genotypes of rs204993 and its relationship with schizotypal traits among 402 Chinese Han healthy volunteers. The brain function was evaluated with functional connectivity strength (FCS) using the resting-state functional magnetic resonance image(rs-fMRI). The schizotypal traits were measured by the schizotypal personality questionnaire (SPQ).

RESULTS

Our results showed that carriers with the AA genotype showed reduced FCS in the left occipital cortex when compared with carriers with the AG and GG genotypes, and the carriers with the AG genotype showed reduced FCS in the left occipital cortex when compared with carriers with the GG genotype. The FCS values in the left occipital lobe were negatively associated with the SPQ scores and its subscale scores within the carriers with the GG genotype, but not within the carriers with AA or AG genotype.

CONCLUSION

Our results suggested that the common variant in the NOTCH4 gene, rs204993, modulates the function of the occipital cortex, which may contribute to schizotypal traits. These findings provide insight for genetic effects on schizotypal traits and its potential neural substrate.

Parietal Cortex Integrates Saccade and Object Orientation Signals to Update Grasp Plans

Coordinated reach-to-grasp movements are often accompanied by rapid eye movements (saccades) that displace the desired object image relative to the retina. Parietal cortex compensates for this by updating reach goals relative to current gaze direction, but its role in the integration of oculomotor and visual orientation signals for updating grasp plans is unknown. Based on a recent perceptual experiment, we hypothesized that inferior parietal cortex (specifically supramarginal gyrus [SMG]) integrates saccade and visual signals to update grasp plans in additional intraparietal/superior parietal regions. To test this hypothesis in humans (7 females, 6 males), we used a functional magnetic resonance paradigm, where saccades sometimes interrupted grasp preparation toward a briefly presented object that later reappeared (with the same/different orientation) just before movement. Right SMG and several parietal grasp regions, namely, left anterior intraparietal sulcus and bilateral superior parietal lobule, met our criteria for transsaccadic orientation integration: they showed task-dependent saccade modulations and, during grasp execution, they were specifically sensitive to changes in object orientation that followed saccades. Finally, SMG showed enhanced functional connectivity with both prefrontal saccade regions (consistent with oculomotor input) and anterior intraparietal sulcus/superior parietal lobule (consistent with sensorimotor output). These results support the general role of parietal cortex for the integration of visuospatial perturbations, and provide specific cortical modules for the integration of oculomotor and visual signals for grasp updating.SIGNIFICANCE STATEMENT How does the brain simultaneously compensate for both external and internally driven changes in visual input? For example, how do we grasp an unstable object while eye movements are simultaneously changing its retinal location? Here, we used fMRI to identify a group of inferior parietal (supramarginal gyrus) and superior parietal (intraparietal and superior parietal) regions that show saccade-specific modulations during unexpected changes in object/grasp orientation, and functional connectivity with frontal cortex saccade centers. This provides a network, complementary to the reach goal updater, that integrates visuospatial updating into grasp plans, and may help to explain some of the more complex symptoms associated with parietal damage, such as constructional ataxia.

Dissociation between Temporal and Spatial Anticipation in the Neural Dynamics of Goal-directed Movement Preparation

It is well documented that providing advanced information regarding the spatial location of a target stimulus (i.e., spatial anticipation) or its timing of occurrence (i.e., temporal anticipation) influences reach preparation, reducing RTs. Yet, it remains unknown whether the RT gains attributable to temporal and spatial anticipation are subtended by similar preparatory dynamics. Here, this issue is addressed in humans by investigating EEG beta-band activity during reach preparation. Participants performed a reach RT task in which they initiated a movement as fast as possible toward visual targets following their appearance. Temporal anticipation was manipulated by having the target appear after a constant or variable delay period, whereas spatial anticipation was manipulated by precueing participants about the upcoming target location in advance or not. Results revealed that temporal and spatial anticipation both reduced reach RTs, with no interaction. Interestingly, temporal and spatial anticipation were associated with fundamentally different patterns of beta-band modulations. Temporal anticipation was associated with beta-band desynchronization over contralateral sensorimotor regions specifically around the expected moment of target onset, the magnitude of which was correlated with RT modulations across participants. In contrast, spatial anticipation did not influence sensorimotor activity but rather led to increased beta-band power over bilateral parieto-occipital regions during the entire delay period. These results argue for distinct states of preparation incurred by temporal and spatial anticipation. In particular, sensorimotor beta-band desynchronization may reflect the timely disinhibition of movement-related neuronal ensembles at the expected time of movement initiation, without reflecting its spatial parameters per se.

Timing Determines Tuning: A Rapid Spatial Transformation in Superior Colliculus Neurons during Reactive Gaze Shifts

Gaze saccades, rapid shifts of the eyes and head toward a goal, have provided fundamental insights into the neural control of movement. For example, it has been shown that the superior colliculus (SC) transforms a visual target (T) code to future gaze (G) location commands after a memory delay. However, this transformation has not been observed in "reactive" saccades made directly to a stimulus, so its contribution to normal gaze behavior is unclear. Here, we tested this using a quantitative measure of the intermediate codes between T and G, based on variable errors in gaze endpoints. We demonstrate that a rapid spatial transformation occurs within the primate's SC (Macaca mulatta) during reactive saccades, involving a shift in coding from T, through intermediate codes, to G. This spatial shift progressed continuously both across and within cell populations [visual, visuomotor (VM), motor], rather than relaying discretely between populations with fixed spatial codes. These results suggest that the SC produces a rapid, noisy, and distributed transformation that contributes to variable errors in reactive gaze shifts.

Reduced resting-state brain functional network connectivity and poor regional homogeneity in patients with CADASIL

BACKGROUND

Cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL) manifests principally as a suite of cognitive impairments, particularly in the executive domain. Executive functioning requires the dynamic coordination of neural activity over large-scale networks. It remains unclear whether changes in resting-state brain functional network connectivity and regional homogeneities (ReHos) underly the mechanisms of executive dysfunction evident in CADASIL patients.

METHODS

In this study, 22 CADASIL patients and 44 matched healthy controls underwent resting-state functional magnetic resonance imaging (fMRI). Independent component analysis (ICA) was used to measure functional brain network connectivity, and ReHos were calculated to evaluate local brain activities. We used seed-based functional connectivity (FC) analyses to determine whether dysfunctional areas (as defined by ReHos) exhibited abnormal FC with other brain areas. Relationships among the mean intra-network connectivity z-scores of dysfunctional areas within functional networks, and cognitive scores were evaluated using Pearson correlation analyses.

RESULTS

Compared to the controls, CADASIL patients exhibited decreased intra-network connectivity within the bilateral lingual gyrus (LG) and the right cuneus (CU) (thus within the visual network [VIN)], and within the right precuneus (Pcu), inferior frontal gyrus (IFG), and precentral gyrus (thus within the frontal network [FRN]). Compared to the controls, patients also exhibited significantly lower ReHos in the right precuneus and cuneus (Pcu/CU), visual association cortex, calcarine gyri, posterior cingulate, limbic lobe, and weaker FC between the right Pcu/CU and the bilateral parahippocampal gyrus (PHG), and between the right Pcu/CU and the right postcentral gyrus. Notably, the mean connectivity z-scores of the bilateral LG and the right CU within the VIN were positively associated with compromised attention, calculation and delayed recall as revealed by tests of the various cognitive domains explored by the Mini-Mental State Examination.

CONCLUSIONS

The decreases in intra-network connectivity within the VIN and FRN and reduced local brain activity in the posterior parietal area suggest that patients with CADASIL may exhibit dysfunctional visuomotor behaviors (a hallmark of executive function), and that all visual information processing, visuomotor planning, and movement execution may be affected.

State Estimation for Early Feedback Responses in Reaching: Intramodal or Multimodal?

Humans are highly skilled in controlling their reaching movements, making fast and task-dependent movement corrections to unforeseen perturbations. To guide these corrections, the neural control system requires a continuous, instantaneous estimate of the current state of the arm and body in the world. According to Optimal Feedback Control theory, this estimate is multimodal and constructed based on the integration of forward motor predictions and sensory feedback, such as proprioceptive, visual and vestibular information, modulated by context, and shaped by past experience. But how can a multimodal estimate drive fast movement corrections, given that the involved sensory modalities have different processing delays, different coordinate representations, and different noise levels? We develop the hypothesis that the earliest online movement corrections are based on multiple single modality state estimates rather than one combined multimodal estimate. We review studies that have investigated online multimodal integration for reach control and offer suggestions for experiments to test for the existence of intramodal state estimates. If proven true, the framework of Optimal Feedback Control needs to be extended with a stage of intramodal state estimation, serving to drive short-latency movement corrections.

Diverse coordinate frames on sensorimotor areas in visuomotor transformation

The visuomotor transformation during a goal-directed movement may involve a coordinate transformation from visual 'extrinsic' to muscle-like 'intrinsic' coordinate frames, which might be processed via a multilayer network architecture composed of neural basis functions. This theory suggests that the postural change during a goal-directed movement task alters activity patterns of the neurons in the intermediate layer of the visuomotor transformation that recieves both visual and proprioceptive inputs, and thus influence the multi-voxel pattern of the blood oxygenation level dependent signal. Using a recently developed multi-voxel pattern decoding method, we found extrinsic, intrinsic and intermediate coordinate frames along the visuomotor cortical pathways during a visuomotor control task. The presented results support the hypothesis that, in human, the extrinsic coordinate frame was transformed to the muscle-like frame over the dorsal pathway from the posterior parietal cortex and the dorsal premotor cortex to the primary motor cortex.

Differential Recruitment of Parietal Cortex during Spatial and Non-spatial Reach Planning

The planning of goal-directed arm reaching movements is associated with activity in the dorsal parieto-frontal cortex, within which multiple regions subserve the integration of arm- and target-related sensory signals to encode a motor goal. Surprisingly, many of these regions show sustained activity during reach preparation even when target location is not specified, i.e., when a motor goal cannot be unambiguously formed. The functional role of these non-spatial preparatory signals remains unresolved. Here this process was investigated in humans by comparing reach preparatory activity in the presence or absence of information regarding upcoming target location. In order to isolate the processes specific to reaching and to control for visuospatial attentional factors, the reaching task was contrasted to a finger movement task. Functional MRI and electroencephalography (EEG) were used to characterize the spatio-temporal pattern of reach-related activity in the parieto-frontal cortex. Reach planning with advance knowledge of target location induced robust blood oxygenated level dependent and EEG responses across parietal and premotor regions contralateral to the reaching arm. In contrast, reach preparation without knowledge of target location was associated with a significant BOLD response bilaterally in the parietal cortex. Furthermore, EEG alpha- and beta-band activity was restricted to parietal scalp sites, the magnitude of the latter being correlated with reach reaction times. These results suggest an intermediate stage of sensorimotor transformations in bilateral parietal cortex when target location is not specified.