Thinking in spatial terms: decoupling spatial representation from sensorimotor control in monkey posterior parietal areas 7a and LIP

Dynamic spatial coding in parietal cortex mediates tactile-motor transformation

Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike.

Visuomotor interactions in the mouse forebrain mediated by extrastriate cortico-cortical pathways

Introduction

The mammalian visual system can be broadly divided into two functional processing pathways: a dorsal stream supporting visually and spatially guided actions, and a ventral stream enabling object recognition. In rodents, the majority of visual signaling in the dorsal stream is transmitted to frontal motor cortices via extrastriate visual areas surrounding V1, but exactly where and to what extent V1 feeds into motor-projecting visual regions is not well known.

Methods

We employed a dual labeling strategy in male and female mice in which efferent projections from V1 were labeled anterogradely, and motor-projecting neurons in higher visual areas were labeled with retrogradely traveling adeno-associated virus (rAAV-retro) injected in M2. We characterized the labeling in both flattened and coronal sections of dorsal cortex and made high-resolution 3D reconstructions to count putative synaptic contacts in different extrastriate areas.

Results

The most pronounced colocalization V1 output and M2 input occurred in extrastriate areas AM, PM, RL and AL. Neurons in both superficial and deep layers in each project to M2, but high resolution volumetric reconstructions indicated that the majority of putative synaptic contacts from V1 onto M2-projecting neurons occurred in layer 2/3.

Discussion

These findings support the existence of a dorsal processing stream in the mouse visual system, where visual signals reach motor cortex largely via feedforward projections in anteriorly and medially located extrastriate areas.

The cortical connectome of primate lateral prefrontal cortex

The lateral prefrontal cortex (LPFC) of primates plays an important role in executive control, but how it interacts with the rest of the cortex remains unclear. To address this, we densely mapped the cortical connectome of LPFC, using electrical microstimulation combined with functional MRI (EM-fMRI). We found isomorphic mappings between LPFC and five major processing domains composing most of the cerebral cortex except early sensory and motor areas. An LPFC grid of ∼200 stimulation sites topographically mapped to separate grids of activation sites in the five domains, coarsely resembling how the visual cortex maps the retina. The temporal and parietal maps largely overlapped in LPFC, suggesting topographically organized convergence of the ventral and dorsal streams, and the other maps overlapped at least partially. Thus, the LPFC contains overlapping, millimeter-scale maps that mirror the organization of major cortical processing domains, supporting LPFC's role in coordinating activity within and across these domains.

The macaque ventral intraparietal area has expanded into three homologue human parietal areas

The macaque ventral intraparietal area (VIP) in the fundus of the intraparietal sulcus has been implicated in a diverse range of sensorimotor and cognitive functions such as motion processing, multisensory integration, processing of head peripersonal space, defensive behavior, and numerosity coding. Here, we exhaustively review macaque VIP function, cytoarchitectonics, and anatomical connectivity and integrate it with human studies that have attempted to identify a potential human VIP homologue. We show that human VIP research has consistently identified three, rather than one, bilateral parietal areas that each appear to subsume some, but not all, of the macaque area's functionality. Available evidence suggests that this human "VIP complex" has evolved as an expansion of the macaque area, but that some precursory specialization within macaque VIP has been previously overlooked. The three human areas are dominated, roughly, by coding the head or self in the environment, visual heading direction, and the peripersonal environment around the head, respectively. A unifying functional principle may be best described as prediction in space and time, linking VIP to state estimation as a key parietal sensorimotor function. VIP's expansive differentiation of head and self-related processing may have been key in the emergence of human bodily self-consciousness.

A Neural Network Model for Learning 3D Object Representations Through Haptic Exploration

Humans initially learn about objects through the sense of touch, in a process called “haptic exploration.” In this paper, we present a neural network model of this learning process. The model implements two key assumptions. The first is that haptic exploration can be thought of as a type of navigation, where the exploring hand plays the role of an autonomous agent, and the explored object is this agent's “local environment.” In this scheme, the agent's movements are registered in the coordinate system of the hand, through slip sensors on the palm and fingers. Our second assumption is that the learning process rests heavily on a simple model of sequence learning, where frequently-encountered sequences of hand movements are encoded declaratively, as “chunks.” The geometry of the object being explored places constraints on possible movement sequences: our proposal is that representations of possible, or frequently-attested sequences implicitly encode the shape of the explored object, along with its haptic affordances. We evaluate our model in two ways. We assess how much information about the hand's actual location is conveyed by its internal representations of movement sequences. We also assess how effective the model's representations are in a reinforcement learning task, where the agent must learn how to reach a given location on an explored object. Both metrics validate the basic claims of the model. We also show that the model learns better if objects are asymmetrical, or contain tactile landmarks, or if the navigating hand is articulated, which further constrains the movement sequences supported by the explored object.

Visual and Vestibular Selectivity for Self-Motion in Macaque Posterior Parietal Area 7a

We examined the responses of neurons in posterior parietal area 7a to passive rotational and translational self-motion stimuli, while systematically varying the speed of visually simulated (optic flow cues) or actual (vestibular cues) self-motion. Contrary to a general belief that responses in area 7a are predominantly visual, we found evidence for a vestibular dominance in self-motion processing. Only a small fraction of neurons showed multisensory convergence of visual/vestibular and linear/angular self-motion cues. These findings suggest possibly independent neuronal population codes for visual versus vestibular and linear versus angular self-motion. Neural responses scaled with self-motion magnitude (i.e., speed) but temporal dynamics were diverse across the population. Analyses of laminar recordings showed a strong distance-dependent decrease for correlations in stimulus-induced (signal correlation) and stimulus-independent (noise correlation) components of spike-count variability, supporting the notion that neurons are spatially clustered with respect to their sensory representation of motion. Single-unit and multiunit response patterns were also correlated, but no other systematic dependencies on cortical layers or columns were observed. These findings describe a likely independent multimodal neural code for linear and angular self-motion in a posterior parietal area of the macaque brain that is connected to the hippocampal formation.

Auditory motion-specific mechanisms in the primate brain

This work examined the mechanisms underlying auditory motion processing in the auditory cortex of awake monkeys using functional magnetic resonance imaging (fMRI). We tested to what extent auditory motion analysis can be explained by the linear combination of static spatial mechanisms, spectrotemporal processes, and their interaction. We found that the posterior auditory cortex, including A1 and the surrounding caudal belt and parabelt, is involved in auditory motion analysis. Static spatial and spectrotemporal processes were able to fully explain motion-induced activation in most parts of the auditory cortex, including A1, but not in circumscribed regions of the posterior belt and parabelt cortex. We show that in these regions motion-specific processes contribute to the activation, providing the first demonstration that auditory motion is not simply deduced from changes in static spatial location. These results demonstrate that parallel mechanisms for motion and static spatial analysis coexist within the auditory dorsal stream.

Are All Spatial Reference Frames Egocentric? Reinterpreting Evidence for Allocentric, Object-Centered, or World-Centered Reference Frames

The use and neural representation of egocentric spatial reference frames is well-documented. In contrast, whether the brain represents spatial relationships between objects in allocentric, object-centered, or world-centered coordinates is debated. Here, I review behavioral, neuropsychological, neurophysiological (neuronal recording), and neuroimaging evidence for and against allocentric, object-centered, or world-centered spatial reference frames. Based on theoretical considerations, simulations, and empirical findings from spatial navigation, spatial judgments, and goal-directed movements, I suggest that all spatial representations may in fact be dependent on egocentric reference frames.

Causal reasoning with forces

Causal composition allows people to generate new causal relations by combining existing causal knowledge. We introduce a new computational model of such reasoning, the force theory, which holds that people compose causal relations by simulating the processes that join forces in the world, and compare this theory with the mental model theory (Khemlani et al., 2014) and the causal model theory (Sloman et al., 2009), which explain causal composition on the basis of mental models and structural equations, respectively. In one experiment, the force theory was uniquely able to account for people's ability to compose causal relationships from complex animations of real-world events. In three additional experiments, the force theory did as well as or better than the other two theories in explaining the causal compositions people generated from linguistically presented causal relations. Implications for causal learning and the hierarchical structure of causal knowledge are discussed.

Cognitive modulation of local and callosal neural interactions in decision making

Traditionally, the neurophysiological mechanisms of cognitive processing have been investigated at the single cell level. Here we show that the dynamic, millisecond-by-millisecond, interactions between neuronal events measured by local field potentials are modulated in an orderly fashion by key task variables of a space categorization task performed by monkeys. These interactions were stronger during periods of higher cognitive load and varied in sign (positive, negative). They were observed both within area 7a of the posterior parietal cortex and between symmetric 7a areas of the two hemispheres. Time lags for maximum interactions were longer for opposite- vs. same-hemisphere recordings, and lags for negative interactions were longer than for positive interactions in both recording sites. These findings underscore the involvement of dynamic neuronal interactions in cognitive processing within and across hemispheres. They also provide accurate estimates of lags in callosal interactions, very comparable to similar estimates of callosal conduction delays derived from neuroanatomical measurements (Caminiti et al., 2013).

Navigating actions through the rodent parietal cortex

The posterior parietal cortex (PPC) participates in a manifold of cognitive functions, including visual attention, working memory, spatial processing, and movement planning. Given the vast interconnectivity of PPC with sensory and motor areas, it is not surprising that neuronal recordings show that PPC often encodes mixtures of spatial information as well as the movements required to reach a goal. Recent work sought to discern the relative strength of spatial vs. motor signaling in PPC by recording single unit activity in PPC of freely behaving rats during selective changes in either the spatial layout of the local environment or in the pattern of locomotor behaviors executed during navigational tasks. The results revealed unequivocally a predominant sensitivity of PPC neurons to locomotor action structure, with subsets of cells even encoding upcoming movements more than 1 s in advance. In light of these and other recent findings in the field, I propose that one of the key contributions of PPC to navigation is the synthesis of goal-directed behavioral sequences, and that the rodent PPC may serve as an apt system to investigate cellular mechanisms for spatial motor planning as traditionally studied in humans and monkeys.