Allocentric versus egocentric representation of remembered reach targets in human cortex

Scene semantics affects allocentric spatial coding for action in naturalistic (virtual) environments

Interacting with objects in our environment requires determining their locations, often with respect to surrounding objects (i.e., allocentrically). According to the scene grammar framework, these usually small, local objects are movable within a scene and represent the lowest level of a scene's hierarchy. How do higher hierarchical levels of scene grammar influence allocentric coding for memory-guided actions? Here, we focused on the effect of large, immovable objects (anchors) on the encoding of local object positions. In a virtual reality study, participants (n = 30) viewed one of four possible scenes (two kitchens or two bathrooms), with two anchors connected by a shelf, onto which were presented three local objects (congruent with one anchor) (Encoding). The scene was re-presented (Test) with 1) local objects missing and 2) one of the anchors shifted (Shift) or not (No shift). Participants, then, saw a floating local object (target), which they grabbed and placed back on the shelf in its remembered position (Response). Eye-tracking data revealed that both local objects and anchors were fixated, with preference for local objects. Additionally, anchors guided allocentric coding of local objects, despite being task-irrelevant. Overall, anchors implicitly influence spatial coding of local object locations for memory-guided actions within naturalistic (virtual) environments.

Influence of gaze, vision, and memory on hand kinematics in a placement task

People usually reach for objects to place them in some position and orientation, but the placement component of this sequence is often ignored. For example, reaches are influenced by gaze position, visual feedback, and memory delays, but their influence on object placement is unclear. Here, we tested these factors in a task where participants placed and oriented a trapezoidal block against two-dimensional (2-D) visual templates displayed on a frontally located computer screen. In experiment 1, participants matched the block to three possible orientations: 0° (horizontal), +45° and -45°, with gaze fixated 10° to the left/right. The hand and template either remained illuminated (closed-loop), or visual feedback was removed (open-loop). Here, hand location consistently overshot the template relative to gaze, especially in the open-loop task; likewise, orientation was influenced by gaze position (depending on template orientation and visual feedback). In experiment 2, a memory delay was added, and participants sometimes performed saccades (toward, away from, or across the template). In this task, the influence of gaze on orientation vanished, but location errors were influenced by both template orientation and final gaze position. Contrary to our expectations, the previous saccade metrics also impacted placement overshoot. Overall, hand orientation was influenced by template orientation in a nonlinear fashion. These results demonstrate interactions between gaze and orientation signals in the planning and execution of hand placement and suggest different neural mechanisms for closed-loop, open-loop, and memory delay placement.NEW & NOTEWORTHY Eye-hand coordination studies usually focus on object acquisition, but placement is equally important. We investigated how gaze position influences object placement toward a 2-D template with different levels of visual feedback. Like reach, placement overestimated goal location relative to gaze and was influenced by previous saccade metrics. Gaze also modulated hand orientation, depending on template orientation and level of visual feedback. Gaze influence was feedback-dependent, with location errors having no significant effect after a memory delay.

Belief inference for hierarchical hidden states in spatial navigation

Uncertainty abounds in the real world, and in environments with multiple layers of unobservable hidden states, decision-making requires resolving uncertainties based on mutual inference. Focusing on a spatial navigation problem, we develop a Tiger maze task that involved simultaneously inferring the local hidden state and the global hidden state from probabilistically uncertain observation. We adopt a Bayesian computational approach by proposing a hierarchical inference model. Applying this to human task behaviour, alongside functional magnetic resonance brain imaging, allows us to separate the neural correlates associated with reinforcement and reassessment of belief in hidden states. The imaging results also suggest that different layers of uncertainty differentially involve the basal ganglia and dorsomedial prefrontal cortex, and that the regions responsible are organised along the rostral axis of these areas according to the type of inference and the level of abstraction of the hidden state, i.e. higher-order state inference involves more anterior parts.

Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand

Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.

Spatial representations of objects used away and towards the body: The effect of near and far space

An action with an object can be accomplished only if we encode the position of the object with respect to our body (i.e., egocentrically) and/or to another element in the environment (i.e., allocentrically). However, some actions with the objects are directed towards our body, such as brushing our teeth, and others away from the body, such as writing. Objects can be near the body, that is within arm reaching, or far from the body, that is outside arm reaching. The aim of this study was to verify if the direction of use of the objects influences the way we represent their position in both near and far space. Objects typically used towards (TB) or away from the body (AB) were presented in near or far space and participants had to judge whether an object was closer to them (i.e., egocentric judgement) or closer to another object (i.e., allocentric judgement). Results showed that egocentric judgements on TB objects were more accurate in near than in far space. Moreover, allocentric judgements on AB objects were less accurate than egocentric judgements in near space but not in far space. These results are discussed with respect to the different roles that visuo-motor and visuo-spatial mechanisms play in near space and far space, respectively.

Action-specific feature processing in the human cortex: An fMRI study

Sensorimotor integration involves feedforward and reentrant processing of sensory input. Grasp-related motor activity precedes and is thought to influence visual object processing. Yet, while the importance of reentrant feedback is well established in perception, the top-down modulations for action and the neural circuits involved in this process have received less attention. Do action-specific intentions influence the processing of visual information in the human cortex? Using a cue-separation fMRI paradigm, we found that action-specific instruction processing (manual alignment vs. grasp) became apparent only after the visual presentation of oriented stimuli, and occurred as early as in the primary visual cortex and extended to the dorsal visual stream, motor and premotor areas. Further, dorsal stream area aIPS, known to be involved in object manipulation, and the primary visual cortex showed task-related functional connectivity with frontal, parietal and temporal areas, consistent with the idea that reentrant feedback from dorsal and ventral visual stream areas modifies visual inputs to prepare for action. Importantly, both the task-dependent modulations and connections were linked specifically to the object presentation phase of the task, suggesting a role in processing the action goal. Our results show that intended manual actions have an early, pervasive, and differential influence on the cortical processing of vision.

Cortical Correlates of Visuospatial Switching Processes Between Egocentric and Allocentric Frames of Reference: A fNIRS Study

Human beings represent spatial information according to egocentric (body-to-object) and allocentric (object-to-object) frames of reference. In everyday life, we constantly switch from one frame of reference to another in order to react effectively to the specific needs of the environment and task demands. However, to the best of our knowledge, no study to date has investigated the cortical activity of switching and non-switching processes between egocentric and allocentric spatial encodings. To this aim, a custom-designed visuo-spatial memory task was administered and the cortical activities underlying switching vs non-switching spatial processes were investigated. Changes in concentrations of oxygenated and deoxygenated haemoglobin were measured using functional near-infrared spectroscopy (fNIRS). Participants were asked to memorize triads of geometric objects and then make two consecutive judgments about the same triad. In the non-switching condition, both spatial judgments considered the same frame of reference: only egocentric or only allocentric. In the switching condition, if the first judgment was egocentric, the second one was allocentric (or vice versa). The results showed a generalized activation of the frontal regions during the switching compared to the non-switching condition. Additionally, increased cortical activity was found in the temporo-parietal junction during the switching condition compared to the non-switching condition. Overall, these results illustrate the cortical activity underlying the processing of switching between body position and environmental stimuli, showing an important role of the temporo-parietal junction and frontal regions in the preparation and switching between egocentric and allocentric reference frames.

Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.

Increased functional connectivity between the auditory cortex and the frontoparietal network compensates for impaired visuomotor transformation after early auditory deprivation

Early auditory deprivation leads to a reorganization of large-scale brain networks involving and extending beyond the auditory system. It has been documented that visuomotor transformation is impaired after early deafness, associated with a hyper-crosstalk between the task-critical frontoparietal network and the default-mode network. However, it remains unknown whether and how the reorganized large-scale brain networks involving the auditory cortex contribute to impaired visuomotor transformation after early deafness. Here, we asked deaf and early hard of hearing participants and normal hearing controls to judge the spatial location of a visual target. Compared with normal hearing controls, the superior temporal gyrus showed significantly increased functional connectivity with the frontoparietal network and the default-mode network in deaf and early hard of hearing participants, specifically during egocentric judgments. However, increased superior temporal gyrus-frontoparietal network and superior temporal gyrus-default-mode network coupling showed antagonistic effects on egocentric judgments. In deaf and early hard of hearing participants, increased superior temporal gyrus-frontoparietal network connectivity was associated with improved egocentric judgments, whereas increased superior temporal gyrus-default-mode network connectivity was associated with deteriorated performance in the egocentric task. Therefore, the data suggest that the auditory cortex exhibits compensatory neuroplasticity (i.e. increased functional connectivity with the task-critical frontoparietal network) to mitigate impaired visuomotor transformation after early auditory deprivation.

Integration of landmark and saccade target signals in macaque frontal cortex visual responses

Visual landmarks influence spatial cognition and behavior, but their influence on visual codes for action is poorly understood. Here, we test landmark influence on the visual response to saccade targets recorded from 312 frontal and 256 supplementary eye field neurons in rhesus macaques. Visual response fields are characterized by recording neural responses to various target-landmark combinations, and then we test against several candidate spatial models. Overall, frontal/supplementary eye fields response fields preferentially code either saccade targets (40%/40%) or landmarks (30%/4.5%) in gaze fixation-centered coordinates, but most cells show multiplexed target-landmark coding within intermediate reference frames (between fixation-centered and landmark-centered). Further, these coding schemes interact: neurons with near-equal target and landmark coding show the biggest shift from fixation-centered toward landmark-centered target coding. These data show that landmark information is preserved and influences target coding in prefrontal visual responses, likely to stabilize movement goals in the presence of noisy egocentric signals.

Dynamic spatial coding in parietal cortex mediates tactile-motor transformation

Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike.

Seeing our hand or a tool during visually-guided actions: Different effects on the somatosensory and visual cortices

The processing of proprioceptive information in the context of a conflict between visual and somatosensory feedbacks deteriorates motor performance. Previous studies have shown that seeing one's hand increases the weighting assigned to arm somatosensory inputs. In this light, we hypothesized that the sensory conflict, when tracing the contour of a shape with mirror-reversed vision, will be greater for participants who trace with a stylus seen in their hand (Hand group, n = 17) than for participants who trace with the tip of rod without seen their hand (Tool group, n = 15). Based on this hypothesis, we predicted that the tracing performance with mirror vision will be more deteriorated for the Hand group than for the Tool group, and we predicted a greater gating of somatosensory information for the Hand group to reduce the sensory conflict. The participants of both groups followed the outline of a shape in two visual conditions. Direct vision: the participants saw the hand or portion of a light 40 cm rod directly. Mirror Vision: the hand or the rod was seen through a mirror. We measured tracing performance using a digitizing tablet and the cortical activity with electroencephalography. Behavioral analyses revealed that the tracing performance of both groups was similarly impaired by mirror vision. However, contrasting the spectral content of the cortical oscillatory activity between the Mirror and Direct conditions, we observed that tracing with mirror vision resulted in significantly larger alpha (8-12 Hz) and beta (15-25 Hz) powers in the somatosensory cortex for participants of the Hand group. The somatosensory alpha and beta powers did not significantly differ between Mirror and Direct vision conditions for the Tool group. For both groups, tracing with mirror vision altered the activity of the visual cortex: decreased alpha power for the Hand group, decreased alpha and beta power for the Tool group. Overall, these results suggest that seeing the hand enhanced the sensory conflict when tracing with mirror vision and that the increase of alpha and beta powers in the somatosensory cortex served to reduce the weight assigned to somatosensory information. The increased activity of the visual cortex observed for both groups in the mirror vision condition suggests greater visual processing with increased task difficulty. Finally, the fact that the participants of the Tool group did not show better tracing performance than those of the Hand group suggests that tracing deterioration resulted from a sensorimotor conflict (as opposed to a visuo-proprioceptive conflict).

The Role of Temporal Order in Egocentric and Allocentric Spatial Representations

Several studies have shown that spatial information is encoded using two types of reference systems: egocentric (body-based) and/or allocentric (environment-based). However, most studies have been conducted in static situations, neglecting the fact that when we explore the environment, the objects closest to us are also those we encounter first, while those we encounter later are usually those closest to other environmental objects/elements. In this study, participants were shown with two stimuli on a computer screen, each depicting a different geometric object, placed at different distances from them and an external reference (i.e., a bar). The crucial manipulation was that the stimuli were shown sequentially. After participants had memorized the position of both stimuli, they had to indicate which object appeared closest to them (egocentric judgment) or which object appeared closest to the bar (allocentric judgment). The results showed that egocentric judgements were facilitated when the object closest to them was presented first, whereas allocentric judgements were facilitated when the object closest to the bar was presented second. These results show that temporal order has a different effect on egocentric and allocentric frames of reference, presumably rooted in the embodied way in which individuals dynamically explore the environment.

Opponent Learning with Different Representations in the Cortico-Basal Ganglia Circuits

The direct and indirect pathways of the basal ganglia (BG) have been suggested to learn mainly from positive and negative feedbacks, respectively. Since these pathways unevenly receive inputs from different cortical neuron types and/or regions, they may preferentially use different state/action representations. We explored whether such a combined use of different representations, coupled with different learning rates from positive and negative reward prediction errors (RPEs), has computational benefits. We modeled animal as an agent equipped with two learning systems, each of which adopted individual representation (IR) or successor representation (SR) of states. With varying the combination of IR or SR and also the learning rates from positive and negative RPEs in each system, we examined how the agent performed in a dynamic reward navigation task. We found that combination of SR-based system learning mainly from positive RPEs and IR-based system learning mainly from negative RPEs could achieve a good performance in the task, as compared with other combinations. In such a combination of appetitive SR-based and aversive IR-based systems, both systems show activities of comparable magnitudes with opposite signs, consistent with the suggested profiles of the two BG pathways. Moreover, the architecture of such a combination provides a novel coherent explanation for the functional significance and underlying mechanism of diverse findings about the cortico-BG circuits. These results suggest that particularly combining different representations with appetitive and aversive learning could be an effective learning strategy in certain dynamic environments, and it might actually be implemented in the cortico-BG circuits.

Cortical areas involved in grasping and reaching actions with and without visual information: An ALE meta-analysis of neuroimaging studies

The functional specialization of the ventral stream in Perception and the dorsal stream in Action is the cornerstone of the leading model proposed by Goodale and Milner in 1992. This model is based on neuropsychological evidence and has been a matter of debate for almost three decades, during which the dual-visual stream hypothesis has received much attention, including support and criticism. The advent of functional magnetic resonance imaging (fMRI) has allowed investigating the brain areas involved in Perception and Action, and provided useful data on the functional specialization of the two streams. Research on this topic has been quite prolific, yet no meta-analysis so far has explored the spatial convergence in the involvement of the two streams in Action. The present meta-analysis (N = 53 fMRI and PET studies) was designed to reveal the specific neural activations associated with Action (i.e., grasping and reaching movements), and the extent to which visual information affects the involvement of the two streams during motor control. Our results provide a comprehensive view of the consistent and spatially convergent neural correlates of Action based on neuroimaging studies conducted over the past two decades. In particular, occipital-temporal areas showed higher activation likelihood in the Vision compared to the No vision condition, but no difference between reach and grasp actions. Frontal-parietal areas were consistently involved in both reach and grasp actions regardless of visual availability. We discuss our results in light of the well-established dual-visual stream model and frame these findings in the context of recent discoveries obtained with advanced fMRI methods, such as multivoxel pattern analysis.

Memory-Guided Reaching: Is It Effortful?

We previously showed that perceived effort during visually guided reaching was altered as task demand varied. Further, self-reported subjective fatigue correlated with perceived effort and reach performance under visually guided conditions. Memory-guided reaching often leads to performance deterioration and can provide insights about the planning and control of reach actions. It is unclear how perceived effort changes during memory-guided reaching and whether self-reported subjective fatigue is associated with perceived effort of memory-guided reaching. Twenty-three young adults performed reach actions under visually- and memory-guided conditions. Perceived effort, reaction time, and endpoint error increased significantly from the visually- to the memory-guided condition. Self-reported subjective fatigue was associated with perceived effort and reach distance error during memory-guided reaching; those with higher levels of fatigue reported greater perceived effort and tended to reach farther when visual information was not available. These findings establish a foundation to examine relationships between subjective fatigue, perceived effort, and reach control.

Are Grid-Like Representations a Component of All Perception and Cognition?

Grid cells or grid-like responses have been reported in the rodent, bat and human brains during various spatial and non-spatial tasks. However, the functions of grid-like representations beyond the classical hippocampal formation remain elusive. Based on accumulating evidence from recent rodent recordings and human fMRI data, we make speculative accounts regarding the mechanisms and functional significance of the sensory cortical grid cells and further make theory-driven predictions. We argue and reason the rationale why grid responses may be universal in the brain for a wide range of perceptual and cognitive tasks that involve locomotion and mental navigation. Computational modeling may provide an alternative and complementary means to investigate the grid code or grid-like map. We hope that the new discussion will lead to experimentally testable hypotheses and drive future experimental data collection.

Grounding Context in Embodied Cognitive Robotics

Biological agents are context-dependent systems that exhibit behavioral flexibility. The internal and external information agents process, their actions, and emotions are all grounded in the context within which they are situated. However, in the field of cognitive robotics, the concept of context is far from being clear with most studies making little to no reference to it. The aim of this paper is to provide an interpretation of the notion of context and its core elements based on different studies in natural agents, and how these core contextual elements have been modeled in cognitive robotics, to introduce a new hypothesis about the interactions between these contextual elements. Here, global context is categorized as agent-related, environmental, and task-related context. The interaction of their core elements, allows agents to first select self-relevant tasks depending on their current needs, or for learning and mastering their environment through exploration. Second, to perform a task and continuously monitor its performance. Third, to abandon a task in case its execution is not going as expected. Here, the monitoring of prediction error, the difference between sensorimotor predictions and incoming sensory information, is at the core of behavioral flexibility during situated action cycles. Additionally, monitoring prediction error dynamics and its comparison with the expected reduction rate should indicate the agent its overall performance on executing the task. Sensitivity to performance evokes emotions that function as the driving element for autonomous behavior which, at the same time, depends on the processing of the interacting core elements. Taking all these into account, an interactionist model of contexts and their core elements is proposed. The model is embodied, affective, and situated, by means of the processing of the agent-related and environmental core contextual elements. Additionally, it is grounded in the processing of the task-related context and the associated situated action cycles during task execution. Finally, the model proposed here aims to guide how artificial agents should process the core contextual elements of the agent-related and environmental context to give rise to the task-related context, allowing agents to autonomously select a task, its planning, execution, and monitoring for behavioral flexibility.

Impaired body-centered sensorimotor transformations in congenitally deaf people

Congenital deafness modifies an individual’s daily interaction with the environment and alters the fundamental perception of the external world. How congenital deafness shapes the interface between the internal and external worlds remains poorly understood. To interact efficiently with the external world, visuospatial representations of external target objects need to be effectively transformed into sensorimotor representations with reference to the body. Here, we tested the hypothesis that egocentric body-centred sensorimotor transformation is impaired in congenital deafness. Consistent with this hypothesis, we found that congenital deafness induced impairments in egocentric judgements, associating the external objects with the internal body. These impairments were due to deficient body-centred sensorimotor transformation per se, rather than the reduced fidelity of the visuospatial representations of the egocentric positions. At the neural level, we first replicated the previously well-documented critical involvement of the frontoparietal network in egocentric processing, in both congenitally deaf participants and hearing controls. However, both the strength of neural activity and the intra-network connectivity within the frontoparietal network alone could not account for egocentric performance variance. Instead, the inter-network connectivity between the task-positive frontoparietal network and the task-negative default-mode network was significantly correlated with egocentric performance: the more cross-talking between them, the worse the egocentric judgement. Accordingly, the impaired egocentric performance in the deaf group was related to increased inter-network connectivity between the frontoparietal network and the default-mode network and decreased intra-network connectivity within the default-mode network. The altered neural network dynamics in congenital deafness were observed for both evoked neural activity during egocentric processing and intrinsic neural activity during rest. Our findings thus not only demonstrate the optimal network configurations between the task-positive and -negative neural networks underlying coherent body-centred sensorimotor transformations but also unravel a critical cause (i.e. impaired body-centred sensorimotor transformation) of a variety of hitherto unexplained difficulties in sensory-guided movements the deaf population experiences in their daily life.

Confidence modulates the decodability of scene prediction during partially-observable maze exploration in humans

Prediction ability often involves some degree of uncertainty-a key determinant of confidence. Here, we sought to assess whether predictions are decodable in partially-observable environments where one's state is uncertain, and whether this information is sensitive to confidence produced by such uncertainty. We used functional magnetic resonance imaging-based, partially-observable maze navigation tasks in which subjects predicted upcoming scenes and reported their confidence regarding these predictions. Using a multi-voxel pattern analysis, we successfully decoded both scene predictions and subjective confidence from activities in the localized parietal and prefrontal regions. We also assessed confidence in their beliefs about where they were in the maze. Importantly, prediction decodability varied according to subjective scene confidence in the superior parietal lobule and state confidence estimated by the behavioral model in the inferior parietal lobule. These results demonstrate that prediction in uncertain environments depends on the prefrontal-parietal network within which prediction and confidence interact.

Navigation strategies in patients with vestibular loss tested in a virtual reality T-maze

During navigation, humans mainly rely on egocentric and allocentric spatial strategies, two different frames of reference working together to build a coherent representation of the environment. Spatial memory deficits during navigation have been repeatedly reported in patients with vestibular disorders. However, little is known about how vestibular disorders can change the use of spatial navigation strategies. Here, we used a new reverse T-maze paradigm in virtual reality to explore whether vestibular loss specifically modifies the use of egocentric or allocentric spatial strategies in patients with unilateral (n = 23) and bilateral (n = 23) vestibular loss compared to healthy volunteers (n = 23) matched for age, sex and education level. Results showed that the odds of selecting and using a specific strategy in the T-maze were significantly reduced in both unilateral and bilateral vestibular loss. An exploratory analysis suggests that only right vestibular loss decreased the odds of adopting a spatial strategy, indicating an asymmetry of vestibular functions. When considering patients who used strategies to navigate, we observed that a bilateral vestibular loss reduced the odds to use an allocentric strategy, whereas a unilateral vestibular loss decreased the odds to use an egocentric strategy. Age was significantly associated with an overall lower chance to adopt a navigation strategy and, more specifically, with a decrease in the odds of using an allocentric strategy. We did not observe any sex difference in the ability to select and use a specific navigation strategy. Findings are discussed in light of previous studies on visuo-spatial abilities and studies of vestibulo-hippocampal interactions in peripheral vestibular disorders. We discuss the potential impact of the history of the disease (chronic stage in patients with a bilateral vestibulopathy vs. subacute stage in patients with a unilateral vestibular loss), of hearing impairment and non-specific attentional deficits in patients with vestibular disorders.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

Functional and Structural Architectures of Allocentric and Egocentric Spatial Coding in Aging: A Combined DTI and fMRI Study

Background

Aging disrupts the optimal balance between neural nodes underlying orienting and attention control functions. Previous studies have suggested that age-related changes in cognitive process are associated to the changes in the myelinated fiber bundles, which affected the speed and actions of the signal propagation across different neural networks. However, whether the age-related difference in allocentric and egocentric spatial coding is accounted by the difference in white-matter integrity is unclear. In this study, using diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI), we sought to elucidate whether age-related differences in white matter integrity accounts for the difference in nodes to the distributed spatial coding-relevant brain networks.

Material and Method

Older (n = 24) and younger (n = 27) participants completed the structural DTI and fMRI scans during which they engaged in a cue-to-target task to elicit allocentric or egocentric processes.

Results and Conclusion

Efficient modulation of both allocentric and egocentric spatial coding in fronto-parietal attention network (FPAN) requires structure–function interaction. Allocentric task-modulated connectivity of the fronto-parietal network (FPN) and dorsal attention network (DAN) with the temporal lobe was influenced by the aging differences of the white-matter tracts of the posterior and superior corona radiata (PCR and SCR), respectively. On the other hand, aging difference of the superior longitudinal fasciculus mainly influenced the egocentric-task-modulated connections of the DAN and FPN with frontal regions and posterior cingulate cortex. This study suggested that functional connections of the FPAN with near and far task-relevant nodes vary significantly with age and conditions.

Hierarchical Integration of Communicative and Spatial Perspective‐Taking Demands in Sensorimotor Control of Referential Pointing

Recognized as a simple communicative behavior, referential pointing is cognitively complex because it invites a communicator to consider an addressee's knowledge. Although we know referential pointing is affected by addressees’ physical location, it remains unclear whether and how communicators’ inferences about addressees’ mental representation of the interaction space influence sensorimotor control of referential pointing. The communicative perspective‐taking task requires a communicator to point at one out of multiple referents either to instruct an addressee which one should be selected (communicative, COM) or to predict which one the addressee will select (non‐communicative, NCOM), based on either which referents can be seen (Level‐1 perspective‐taking, PT1) or how the referents were perceived (Level‐2 perspective‐taking, PT2) by the addressee. Communicators took longer to initiate the movements in PT2 than PT1 trials, and they held their pointing fingers for longer at the referent in COM than NCOM trials. The novel findings of this study pertain to trajectory control of the pointing movements. Increasing both communicative and perspective‐taking demands led to longer pointing trajectories, with an under‐additive interaction between those two experimental factors. This finding suggests that participants generate communicative behaviors that are as informative as required rather than overly exaggerated displays, by integrating communicative and perspective‐taking information hierarchically during sensorimotor control. This observation has consequences for models of human communication. It implies that the format of communicative and perspective‐taking knowledge needs to be commensurate with the movement dynamics controlled by the sensorimotor system.

Repetition effects in action planning reflect effector- but not hemisphere-specific coding

Action choices are influenced by future and recent past action states. For example, when performing two actions in succession, response times (RTs) to initiate the second action are reduced when the same hand is used. These findings suggest the existence of effector-specific processing for action planning. However, given that each hand is primarily controlled by the contralateral hemisphere, the RT benefit might actually reflect effector-independent, hemisphere-specific rather than effector-specific repetition effects. Here, participants performed two consecutive movements, each with a hand or a foot, in one of two directions. Direction was specified in an egocentric reference frame (inward, outward) or in an allocentric reference frame (left, right). Successive actions were initiated faster when the same limb (e.g., left hand-left hand), but not the other limb of the same body side (e.g., left foot-left hand), executed the second action. The same-limb advantage was evident even when the two movements involved different directions, whether specified egocentrically or allocentrically. Corroborating evidence from computational modeling lends support to the claim that repetition effects in action planning reflect persistent changes in baseline activity within neural populations that encode effector-specific action plans.

NEW & NOTEWORTHY Repeated hand use facilitates the initiation of successive actions (repetition effect). This finding has been interpreted as evidence for effector-specific action plans. However, given that each hand is primarily controlled by the contralateral hemisphere, any differences might reflect effector-independent, hemisphere-specific rather than effector-specific processing. We dissociated these alternatives by asking participants to perform successive actions with hands and feet and provide novel evidence that repetition effects in limb use truly reflect effector-specific coding.

Investigating the neuroanatomy underlying proprioception using a stroke model

Neuroanatomical investigations have associated cortical areas, beyond Primary Somatosensory Cortex (S1), with impaired proprioception. Cortical regions have included temporoparietal (TP) regions (supramarginal gyrus, superior temporal gyrus, Heschl's gyrus) and insula. Previous approaches have struggled to account for concurrent damage across multiple brain regions. Here, we used a targeted lesion analysis approach to examine the impact of specific combinations of cortical and sub-cortical lesions and quantified the prevalence of proprioceptive impairments when different regions are damaged or spared. Seventy-seven individuals with stroke (49 male; 28 female) were identified meeting prespecified lesion criteria based on MRI/CT imaging: 1) TP lesions without S1, 2) TP lesions with S1, 3) isolated S1 lesions, 4) isolated insula lesions, and 5) lesions not impacting these regions (other regions group). Initially, participants meeting these criteria (1-4) were grouped together into right or left lesion groups and compared to each other, and the other regions group (5), on a robotic Arm Position Matching (APM) task and a Kinesthesia (KIN) task. We then examined the behaviour of individuals that met each specific criteria (groups 1-5). Proprioceptive impairments were more prevalent following right hemisphere lesions than left hemisphere lesions. The extent of damage to TP regions correlated with performance on both robotic tasks. Even without concurrent S1 lesions, TP and insular lesions were associated with impairments on the APM and KIN tasks. Finally, lesions not impacting these regions were much less likely to result in impairments. This study highlights the critical importance of TP and insular regions for accurate proprioception. SIGNIFICANCE STATEMENT: This work advances our understanding of the neuroanatomy of human proprioception. We validate the importance of regions, beyond the dorsal column medial lemniscal pathway and S1, for proprioception. Further, we provide additional evidence of the importance of the right hemisphere for human proprioception. Improved knowledge on the neuroanatomy of proprioception is crucial for advancing therapeutic approaches which target individuals with proprioceptive impairments following neurological injury or with neurological disorders.

Two Distinct Systems Represent Contralateral and Ipsilateral Sensorimotor Processes in the Human Premotor Cortex: A Dense TMS Mapping Study

Animal brains contain behaviorally committed representations of the surrounding world, which integrate sensory and motor information. In primates, sensorimotor mechanisms reside in part in the premotor cortex (PM), where sensorimotor neurons are topographically clustered according to functional specialization. Detailed functional cartography of the human PM is still under investigation. We explored the topographic distribution of spatially dependent sensorimotor functions in healthy volunteers performing left or right, hand or foot, responses to visual cues presented in the left or right hemispace, thus combining independently stimulus side, effector side, and effector type. Event-related transcranial magnetic stimulation was applied to single spots of a dense grid of 10 points on the participants' left hemiscalp, covering the whole PM. Results showed: (1) spatially segregated hand and foot representations, (2) focal representations of contralateral cues and movements in the dorsal PM, and (3) distributed representations of ipsilateral cues and movements in the ventral and dorso-medial PM. The present novel causal information indicates that (1) the human PM is somatotopically organized and (2) the left PM contains sensory-motor representations of both hemispaces and of both hemibodies, but the hemispace and hemibody contralateral to the PM are mapped on a distinct, nonoverlapping cortical region compared to the ipsilateral ones.

Neuroanatomical correlates of the perception of body axis orientation during body tilt: a voxel-based morphometry study

Accurate perception of the orientations of the body axis and gravity is essential for actions. The ability to perceive these orientations during head and body tilt varies across individuals, and its underlying neural basis is unknown. To address this, we investigated the association between inter-individual differences in local gray matter (GM) volume and inter-individual differences in the ability to estimate the directions of body longitudinal axis or gravity during whole-body tilt using voxel-based morphometry (VBM) analysis in 50 healthy adults (20–46 years, 25 men and 25 women). Although no anatomical regions were identified relating to performance requiring estimates of gravitational direction, we found a significant correlation between the GM volume in the right middle occipital gyrus and the ability to estimate the body axis orientation. This finding provides the first evidence on neuroanatomical substrates of the perception of body axis orientation during body tilt.

Neural encoding and functional interactions underlying pantomimed movements

Pantomimes are a unique movement category which can convey complex information about our intentions in the absence of any interaction with real objects. Indeed, we can pretend to use the same tool to perform different actions or to achieve the same goal adopting different tools. Nevertheless, how our brain implements pantomimed movements is still poorly understood. In our study, we explored the neural encoding and functional interactions underlying pantomimes adopting multivariate pattern analysis (MVPA) and connectivity analysis of fMRI data. Participants performed pantomimed movements, either grasp-to-move or grasp-to-use, as if they were interacting with two different tools (scissors or axe). These tools share the possibility to achieve the same goal. We adopted MVPA to investigate two levels of representation during the planning and execution of pantomimes: (1) distinguishing different actions performed with the same tool, (2) representing the same final goal irrespective of the adopted tool. We described widespread encoding of action information within regions of the so-called “tool” network. Several nodes of the network—comprising regions within the ventral and the dorsal stream—also represented goal information. The spatial distribution of goal information changed from planning—comprising posterior regions (i.e. parietal and temporal)—to execution—including also anterior regions (i.e. premotor cortex). Moreover, connectivity analysis provided evidence for task-specific bidirectional coupling between the ventral stream and parieto-frontal motor networks. Overall, we showed that pantomimes were characterized by specific patterns of action and goal encoding and by task-dependent cortical interactions.

Common and distinct neural trends of allocentric and egocentric spatial coding: An ALE meta-analysis

The uniqueness of neural processes between allocentric and egocentric spatial coding has been controversial. The distinctive paradigms used in previous studies for manipulating spatial coding could have attributed for the inconsistent results. This study was aimed to generate converging evidence from previous functional brain imaging experiments for collating neural substrates associated with these two types of spatial coding. An additional aim was to test whether test-taking processes would have influenced the results. We obtained coordinate-based functional neuroimaging data for 447 subjects and performed activation likelihood estimation (ALE) meta-analysis. Among the 28 experiments, the results indicate two common clusters of convergence. They were the right precuneus and the right superior frontal gyrus as parts of the parieto-frontal circuit. Between-type differences were in the parieto-occipital circuit, with allocentric showing convergence in the superior occipital gyrus (SOG) cluster compared with egocentric showing convergence in the middle occipital gyrus (MOG) cluster. Task-specific influences were only found in allocentric spatial coding. Spatial judgment-oriented tasks seem to increase the demands on manipulating spatial relationships among the visual objects, while spatial navigation tasks seem to increase the demands on maintaining object representations. Our findings address the theoretical controversies on spatial coding that both the allocentric and egocentric types are common in their processes mediated by the parieto-frontal network, while unique and additional processes in the allocentric type are mediated by the parieto-occipital network. The positive results on possible task-specific confound offer insights into the future design of spatial tasks for eliciting spatial coding processes.

Mild Stroke Affects Pointing Movements Made in Different Frames of Reference

Background

Motor performance is a complex process controlled in task-specific spatial frames of reference (FRs). Movements can be made within the framework of the body (egocentric FR) or external space (exocentric FR). People with stroke have impaired reaching, which may be related to deficits in movement production in different FRs.

Objective

To characterize rapid motor responses to changes in the number of degrees of freedom for movements made in different FRs and their relationship with sensorimotor and cognitive impairment in individuals with mild chronic stroke.

Methods

Healthy and poststroke individuals moved their hand along the contralateral forearm (egocentric task) and between targets in the peripersonal space (exocentric task) without vision while flexing the trunk. Trunk movement was blocked in randomized trials.

Results

For the egocentric task, controls produced the same endpoint trajectories in both conditions (free- and blocked-trunk) by preserving similar shoulder-elbow interjoint coordination (IJC). However, endpoint trajectories were dissimilar because of altered IJC in stroke. For the exocentric task, controls produced the same endpoint trajectories when the trunk was free or blocked by rapidly changing the IJC, whereas this was not the case in stroke. Deficits in exocentric movement after stroke were related to cognitive but not sensorimotor impairment.

Conclusions

Individuals with mild stroke have deficits rapidly responding to changing conditions for complex reaching tasks. This may be related to cognitive deficits and limitations in the regulation of tonic stretch reflex thresholds. Such deficits should be considered in rehabilitation programs encouraging the reintegration of the affected arm into activities of daily living.

Spatiotemporal Coding in the Macaque Supplementary Eye Fields: Landmark Influence in the Target-to-Gaze Transformation

Eye-centered (egocentric) and landmark-centered (allocentric) visual signals influence spatial cognition, navigation, and goal-directed action, but the neural mechanisms that integrate these signals for motor control are poorly understood. A likely candidate for egocentric/allocentric integration in the gaze control system is the supplementary eye fields (SEF), a mediofrontal structure with high-level “executive” functions, spatially tuned visual/motor response fields, and reciprocal projections with the frontal eye fields (FEF). To test this hypothesis, we trained two head-unrestrained monkeys (Macaca mulatta) to saccade toward a remembered visual target in the presence of a visual landmark that shifted during the delay, causing gaze end points to shift partially in the same direction. A total of 256 SEF neurons were recorded, including 68 with spatially tuned response fields. Model fits to the latter established that, like the FEF and superior colliculus (SC), spatially tuned SEF responses primarily showed an egocentric (eye-centered) target-to-gaze position transformation. However, the landmark shift influenced this default egocentric transformation: during the delay, motor neurons (with no visual response) showed a transient but unintegrated shift (i.e., not correlated with the target-to-gaze transformation), whereas during the saccade-related burst visuomotor (VM) neurons showed an integrated shift (i.e., correlated with the target-to-gaze transformation). This differed from our simultaneous FEF recordings (Bharmauria et al., 2020), which showed a transient shift in VM neurons, followed by an integrated response in all motor responses. Based on these findings and past literature, we propose that prefrontal cortex incorporates landmark-centered information into a distributed, eye-centered target-to-gaze transformation through a reciprocal prefrontal circuit.

Decreased utilization of allocentric coordinates during reaching movement in individuals with autism spectrum disorder

Despite numerous reports of abnormalities in limb motor controls in spatial orientation in individuals with autism spectrum disorder (ASD), the underlying mechanisms have not been elucidated. We studied the influence of allocentric coordinates on ongoing reaching movements, which has been reported to strongly affect the reaching movements of typically developing (TD) individuals. ASD and TD participants observed a target presented randomly on one of the four corners of a frame on a screen. After it disappeared, another frame was presented slightly shifted leftward/rightward. The participants touched the memorized position of the target relatively congruent with a reference frame (allocentric condition) or ignoring it (egocentric condition). Results suggested that TD individuals were apt to touch the positions in allocentric manner rather than egocentric manner, while ASDs did not show this prioritization. Our findings demonstrate that decreased utilization of visual landmarks in ongoing movement may underlie motor disabilities in autism.

The use of egocentric and allocentric reference frames in static and dynamic conditions in humans

The dissociation between egocentric and allocentric reference frames is well established. Spatial coding relative to oneself has been associated with a brain network distinct from spatial coding using a cognitive map independently of the actual position. These differences were, however, revealed by a variety of tasks from both static conditions, using a series of images, and dynamic conditions, using movements through space. We aimed to clarify how these paradigms correspond to each other concerning the neural correlates of the use of egocentric and allocentric reference frames. We review here studies of allocentric and egocentric judgments used in static two- and three-dimensional tasks and compare their results with the findings from spatial navigation studies. We argue that neural correlates of allocentric coding in static conditions but using complex three-dimensional scenes and involving spatial memory of participants resemble those in spatial navigation studies, while allocentric representations in two-dimensional tasks are connected with other perceptual and attentional processes. In contrast, the brain networks associated with the egocentric reference frame in static two-dimensional and three-dimensional tasks and spatial navigation tasks are, with some limitations, more similar. Our review demonstrates the heterogeneity of experimental designs focused on spatial reference frames. At the same time, it indicates similarities in brain activation during reference frame use despite this heterogeneity.

Shared contributions of the head and torso to spatial reference frames across spatial judgments

Egocentric frames of reference take the body as the point of origin of a spatial coordinate system. Bodies, however, are not points, but extended objects, with distinct parts that can move independently of one another. We recently developed a novel paradigm to probe the use of different body parts in simple spatial judgments, what we called the misalignment paradigm. In this study, we applied the misalignment paradigm in a perspective-taking task to investigate whether the weightings given to different body parts are shared across different spatial judgments involving different spatial axes. Participants saw birds-eye images of a person with their head rotated 45° relative to the torso. On each trial, a ball appeared and participants made judgments either of whether the ball was to the person's left or right, or whether the ball was in front of the person or behind them. By analysing the pattern of responses with respect to both head and torso, we quantified the contribution of each body part to the reference frames underlying each judgment. For both judgment types we found clear contributions of both head and torso, with more weight being given on average to the torso. Individual differences in the use of the two body parts were correlated across judgment types indicating the use of a shared set of weightings used across spatial axes and judgments. Moreover, retesting of participants several months later showed high stability of these weightings, suggesting that they are stable characteristics of people.

Connectivity-Related Roles of Contralesional Brain Regions for Motor Performance Early after Stroke

Hemiparesis after stroke is associated with increased neural activity not only in the lesioned but also in the contralesional hemisphere. While most studies have focused on the role of contralesional primary motor cortex (M1) activity for motor performance, data on other areas within the unaffected hemisphere are scarce, especially early after stroke. We here combined functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) to elucidate the contribution of contralesional M1, dorsal premotor cortex (dPMC), and anterior intraparietal sulcus (aIPS) for the stroke-affected hand within the first 10 days after stroke. We used “online” TMS to interfere with neural activity at subject-specific fMRI coordinates while recording 3D movement kinematics. Interfering with aIPS activity improved tapping performance in patients, but not healthy controls, suggesting a maladaptive role of this region early poststroke. Analyzing effective connectivity parameters using a Lasso prediction model revealed that behavioral TMS effects were predicted by the coupling of the stimulated aIPS with dPMC and ipsilesional M1. In conclusion, we found a strong link between patterns of frontoparietal connectivity and TMS effects, indicating a detrimental influence of the contralesional aIPS on motor performance early after stroke.

Egocentric metric representations in peripersonal space: A bridge between motor resources and spatial memory

Research on visuospatial memory has shown that egocentric (subject-to-object) and allocentric (object-to-object) reference frames are connected to categorical (non-metric) and coordinate (metric) spatial relations, and that motor resources are recruited especially when processing spatial information in peripersonal (within arm reaching) than extrapersonal (outside arm reaching) space. In order to perform our daily-life activities, these spatial components cooperate along a continuum from recognition-related (e.g., recognizing stimuli) to action-related (e.g., reaching stimuli) purposes. Therefore, it is possible that some types of spatial representations rely more on action/motor processes than others. Here, we explored the role of motor resources in the combinations of these visuospatial memory components. A motor interference paradigm was adopted in which participants had their arms bent behind their back or free during a spatial memory task. This task consisted in memorizing triads of objects and then verbally judging what was the object: (1) closest to/farthest from the participant (egocentric coordinate); (2) to the right/left of the participant (egocentric categorical); (3) closest to/farthest from a target object (allocentric coordinate); and (4) on the right/left of a target object (allocentric categorical). The triads appeared in participants' peripersonal (Experiment 1) or extrapersonal (Experiment 2) space. The results of Experiment 1 showed that motor interference selectively damaged egocentric-coordinate judgements but not the other spatial combinations. The results of Experiment 2 showed that the interference effect disappeared when the objects were in the extrapersonal space. A third follow-up study using a within-subject design confirmed the overall pattern of results. Our findings provide evidence that motor resources play an important role in the combination of coordinate spatial relations and egocentric representations in peripersonal space.

The role of perception and action on the use of allocentric information in a large-scale virtual environment

In everyday life, our brain constantly builds spatial representations of the objects surrounding us. Many studies have investigated the nature of these spatial representations. It is well established that we use allocentric information in real-time and memory-guided movements. Most studies relied on small-scale and static experiments, leaving it unclear whether similar paradigms yield the same results on a larger scale using dynamic objects. We created a virtual reality task that required participants to encode the landing position of a virtual ball thrown by an avatar. Encoding differed in the nature of the task in that it was either purely perceptual (“view where the ball landed while standing still”—Experiment 1) or involved an action (“intercept the ball with the foot just before it lands”—Experiment 2). After encoding, participants were asked to place a real ball at the remembered landing position in the virtual scene. In some trials, we subtly shifted either the thrower or the midfield line on a soccer field to manipulate allocentric coding of the ball’s landing position. In both experiments, we were able to replicate classic findings from small-scale experiments and to generalize these results to different encoding tasks (perception vs. action) and response modes (reaching vs. walking-and-placing). Moreover, we found that participants preferably encoded the ball relative to the thrower when they had to intercept the ball, suggesting that the use of allocentric information is determined by the encoding task by enhancing task-relevant allocentric information. Our findings indicate that results previously obtained from memory-guided reaching are not restricted to small-scale movements, but generalize to whole-body movements in large-scale dynamic scenes.

Integration of Eye-Centered and Landmark-Centered Codes in Frontal Eye Field Gaze Responses

The visual system is thought to separate egocentric and allocentric representations, but behavioral experiments show that these codes are optimally integrated to influence goal-directed movements. To test if frontal cortex participates in this integration, we recorded primate frontal eye field activity during a cue-conflict memory delay saccade task. To dissociate egocentric and allocentric coordinates, we surreptitiously shifted a visual landmark during the delay period, causing saccades to deviate by 37% in the same direction. To assess the cellular mechanisms, we fit neural response fields against an egocentric (eye-centered target-to-gaze) continuum, and an allocentric shift (eye-to-landmark-centered) continuum. Initial visual responses best-fit target position. Motor responses (after the landmark shift) predicted future gaze position but embedded within the motor code was a 29% shift toward allocentric coordinates. This shift appeared transiently in memory-related visuomotor activity, and then reappeared in motor activity before saccades. Notably, fits along the egocentric and allocentric shift continua were initially independent, but became correlated across neurons just before the motor burst. Overall, these results implicate frontal cortex in the integration of egocentric and allocentric visual information for goal-directed action, and demonstrate the cell-specific, temporal progression of signal multiplexing for this process in the gaze system.

Egocentric and allocentric spatial memory in typically developed children: Is spatial memory associated with visuospatial skills, behavior, and cortisol?

INTRODUCTION

Spatial orientation relies mainly on two frameworks. The egocentric depends on our own position and point of view. The allocentric relies on remembering, recalling, and recognizing environmental stimuli called landmarks. The aim of this study was to analyze the egocentric and allocentric spatial memory performance in children of different ages using two experimental memory card-placing tasks. We also aimed to examine relationships between spatial memory and other cognitive, physiological, and behavioral factors that, potentially, could be associated with spatial memory performance. Those were other visuospatial functions, the regular behavior of the child, cortisol levels, and daily life spatial memory.

METHODS

We assessed 62 children (5, 6, and 7 years) using card-placing tasks. We used RIST for IQ evaluation and subtest from NEPSY-II for visuospatial ability assessment. Collection of saliva sample was carried out for cortisol analysis. Parents completed BASC questionnaire for behavioral evaluation and ECM-Q questionnaire for daily life spatial memory evaluation.

RESULTS

Our results showed that older children performed better on mental rotation. Directionality, map interpretation, and daily memory were directly associated with both egocentric and allocentric orientation. Egocentric performance was positively related to leadership abilities but negatively to depression and atypicality, while allocentric performance was directly associated with adaptive behavior but inversely with hyperactivity. Finally, cortisol values were positively associated with allocentric performance.

CONCLUSIONS

Our study shows the development of different spatial abilities between 5 and 7 years, as well as the relationship between orientation performance, visuospatial skills, behavior, and cortisol.

Parietal Cortex Integrates Saccade and Object Orientation Signals to Update Grasp Plans

Coordinated reach-to-grasp movements are often accompanied by rapid eye movements (saccades) that displace the desired object image relative to the retina. Parietal cortex compensates for this by updating reach goals relative to current gaze direction, but its role in the integration of oculomotor and visual orientation signals for updating grasp plans is unknown. Based on a recent perceptual experiment, we hypothesized that inferior parietal cortex (specifically supramarginal gyrus [SMG]) integrates saccade and visual signals to update grasp plans in additional intraparietal/superior parietal regions. To test this hypothesis in humans (7 females, 6 males), we used a functional magnetic resonance paradigm, where saccades sometimes interrupted grasp preparation toward a briefly presented object that later reappeared (with the same/different orientation) just before movement. Right SMG and several parietal grasp regions, namely, left anterior intraparietal sulcus and bilateral superior parietal lobule, met our criteria for transsaccadic orientation integration: they showed task-dependent saccade modulations and, during grasp execution, they were specifically sensitive to changes in object orientation that followed saccades. Finally, SMG showed enhanced functional connectivity with both prefrontal saccade regions (consistent with oculomotor input) and anterior intraparietal sulcus/superior parietal lobule (consistent with sensorimotor output). These results support the general role of parietal cortex for the integration of visuospatial perturbations, and provide specific cortical modules for the integration of oculomotor and visual signals for grasp updating.SIGNIFICANCE STATEMENT How does the brain simultaneously compensate for both external and internally driven changes in visual input? For example, how do we grasp an unstable object while eye movements are simultaneously changing its retinal location? Here, we used fMRI to identify a group of inferior parietal (supramarginal gyrus) and superior parietal (intraparietal and superior parietal) regions that show saccade-specific modulations during unexpected changes in object/grasp orientation, and functional connectivity with frontal cortex saccade centers. This provides a network, complementary to the reach goal updater, that integrates visuospatial updating into grasp plans, and may help to explain some of the more complex symptoms associated with parietal damage, such as constructional ataxia.

Asymmetrical Switch Costs in Spatial Reference Frames Switching

Previous studies found that the egocentric and allocentric reference frames are distinct in their functions, developmental trajectory, and neural basis. However, these two spatial reference frames exist in parallel, and people switch between them frequently in their daily lives. Using an allocentric and egocentric switching task, this study explored the cognitive processes involved in the switch between egocentric and allocentric reference frames and the possible asymmetry of switch costs. Sixty-two participants were tested in congruent (i.e., the target was on the same side in two reference frames) and incongruent conditions (i.e., the target was on a different side in two reference frames). The results indicated that the interaction between allocentric and egocentric reference frames was bidirectional and that the congruency effect was higher in the egocentric task than in the allocentric task. More important, the switch costs between allocentric and egocentric reference frames were found in both conditions, and the switch cost was higher for allocentric task. To our knowledge, this was the first study to focus on how switch costs and asymmetrical switch costs occur in allocentric and egocentric task switching.

Allocentric representations for target memory and reaching in human cortex

The use of allocentric cues for movement guidance is complex because it involves the integration of visual targets and independent landmarks and the conversion of this information into egocentric commands for action. Here, we focus on the mechanisms for encoding reach targets relative to visual landmarks in humans. First, we consider the behavioral results suggesting that both of these cues influence target memory, but are then transformed-at the first opportunity-into egocentric commands for action. We then consider the cortical mechanisms for these behaviors. We discuss different allocentric versus egocentric mechanisms for coding of target directional selectivity in memory (inferior temporal gyrus versus superior occipital gyrus) and distinguish these mechanisms from parieto-frontal activation for planning egocentric direction of actual reach movements. Then, we consider where and how the former allocentric representations of remembered reach targets are converted into the latter egocentric plans. In particular, our recent neuroimaging study suggests that four areas in the parietal and frontal cortex (right precuneus, bilateral dorsal premotor cortex, and right presupplementary area) participate in this allo-to-ego conversion. Finally, we provide a functional overview describing how and why egocentric and landmark-centered representations are segregated early in the visual system, but then reintegrated in the parieto-frontal cortex for action.

Caloric vestibular stimulation has no effect on perceived body size

It has been suggested that the vestibular system not only plays a role for our sense of balance and postural control but also might modulate higher-order body representations, such as the perceived shape and size of our body. Recent findings using virtual reality (VR) to realistically manipulate the length of whole extremities of first person biometric avatars under vestibular stimulation did not support this assumption. It has been discussed that these negative findings were due to the availability of visual feedback on the subjects' virtual arms and legs. The present study tested this hypothesis by excluding the latter information. A newly recruited group of healthy subjects had to adjust the position of blocks in 3D space of a VR scenario such that they had the feeling that they could just touch them with their left/right hand/heel. Caloric vestibular stimulation did not alter perceived size of own extremities. Findings suggest that vestibular signals do not serve to scale the internal representation of (large parts of) our body's metric properties. This is in obvious contrast to the egocentric representation of our body midline which allows us to perceive and adjust the position of our body with respect to the surroundings. These two qualia appear to belong to different systems of body representation in humans.

Spatial orientation assessment in preschool children: Egocentric and allocentric frameworks

Spatial orientation is an important function in daily life because it allows us to reach a target place when moving through our environment, using self-centered (egocentric) or environmental information (allocentric). Compared to other cognitive functions, spatial orientation has been studied less in preschool ages. Some brain areas, such as the hippocampus and the temporal as well as the parietal and frontal cortices, are involved in spatial orientation. Therefore, when these brain regions are altered in neurological conditions or in atypical development in children, we would expect impairment of spatial abilities. The aim of this study is to review studies, published in recent years, that use egocentric and allocentric spatial orientation tasks for assessing spatial memory in preschool children, with the final goal of finding out which tests could be included in a clinical neuropsychological evaluation. We observed that although egocentric spatial orientation emerges first during development, allocentric spatial orientation tasks are employed at very early ages. Most of these tasks are performed in real environments, allowing children's self-movements and using environmental modifications, but technologies such as virtual or augmented reality are increasingly used. Other aspects are discussed, such as the lack of consensus in the nomenclature, the difficulty of tracing the course of development of spatial orientation, or the ecological validity of the tests used. We finally observed that there is greater interest in studying the allocentric framework than the egocentric one, which makes it difficult to compare the use of the two frames of reference during a neuropsychological evaluation in preschool-aged children.

Independent working memory resources for egocentric and allocentric spatial information

Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks.

Neural substrates for allocentric-to-egocentric conversion of remembered reach targets in humans

Targets for goal-directed action can be encoded in allocentric coordinates (relative to another visual landmark), but it is not known how these are converted into egocentric commands for action. Here, we investigated this using a slow event-related fMRI paradigm, based on our previous behavioural finding that the allocentric-to-egocentric (Allo-Ego) conversion for reach is performed at the first possible opportunity. Participants were asked to remember (and eventually reach towards) the location of a briefly presented target relative to another visual landmark. After a first memory delay, participants were forewarned by a verbal instruction if the landmark would reappear at the same location (potentially allowing them to plan a reach following the auditory cue before the second delay), or at a different location where they had to wait for the final landmark to be presented before response, and then reach towards the remembered target location. As predicted, participants showed landmark-centred directional selectivity in occipital-temporal cortex during the first memory delay, and only developed egocentric directional selectivity in occipital-parietal cortex during the second delay for the 'Same cue' task, and during response for the 'Different cue' task. We then compared cortical activation between these two tasks at the times when the Allo-Ego conversion occurred, and found common activation in right precuneus, right presupplementary area and bilateral dorsal premotor cortex. These results confirm that the brain converts allocentric codes to egocentric plans at the first possible opportunity, and identify the four most likely candidate sites specific to the Allo-Ego transformation for reaches.