Representation of vestibular and visual cues to self-motion in ventral intraparietal cortex

Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition

Peripersonal space (PPS) is a construct referring to the portion of space immediately surrounding our bodies, where most of the interactions between the subject and the environment, including other individuals, take place. Decades of animal and human neuroscience research have revealed that the brain holds a separate representation of this region of space: this distinct spatial representation has evolved to ensure proper relevance to stimuli that are close to the body and prompt an appropriate behavioral response. The neural underpinnings of such construct have been thoroughly investigated by different generations of studies involving anatomical and electrophysiological investigations in animal models, and, recently, neuroimaging experiments in human subjects. Here, we provide a comprehensive anatomical overview of the anatomical circuitry underlying PPS representation in the human brain. Gathering evidence from multiple areas of research, we identified cortical and subcortical regions that are involved in specific aspects of PPS encoding.We show how these regions are part of segregated, yet integrated functional networks within the brain, which are in turn involved in higher-order integration of information. This wide-scale circuitry accounts for the relevance of PPS encoding in multiple brain functions, including not only motor planning and visuospatial attention but also emotional and social cognitive aspects. A complete characterization of these circuits may clarify the derangements of PPS representation observed in different neurological and neuropsychiatric diseases.

Attention affects the perception of self-motion direction from optic flow

Many studies have demonstrated that attention affects the perception of many visual features. However, previous studies show conflicting results regarding the effect of attention on the perception of self-motion direction (i.e., heading) from optic flow. To address this question, we conducted three behavioral experiments and found that estimation accuracies of large headings (>14°) decreased with attention load, discrimination thresholds of these headings increased with attention load, and heading estimates were systematically compressed toward the focus of attention. Therefore, the current study demonstrated that attention affected heading perception from optic flow, showing that the perception is both information-driven and cognitive.

Decentralized Neural Circuits of Multisensory Information Integration in the Brain

The brain combines multisensory inputs together to obtain a complete and reliable description of the world. Recent experiments suggest that several interconnected multisensory brain areas are simultaneously involved to integrate multisensory information. It was unknown how these mutually connected multisensory areas achieve multisensory integration. To answer this question, using biologically plausible neural circuit models we developed a decentralized system for information integration that comprises multiple interconnected multisensory brain areas. Through studying an example of integrating visual and vestibular cues to infer heading direction, we show that such a decentralized system is well consistent with experimental observations. In particular, we demonstrate that this decentralized system can optimally integrate information by implementing sampling-based Bayesian inference. The Poisson variability of spike generation provides appropriate variability to drive sampling, and the interconnections between multisensory areas store the correlation prior between multisensory stimuli. The decentralized system predicts that optimally integrated information emerges locally from the dynamics of the communication between brain areas and sheds new light on the interpretation of the connectivity between multisensory brain areas.

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

From Multisensory Integration to Multisensory Decision-Making

Organisms live in a dynamic environment in which sensory information from multiple sources is ever changing. A conceptually complex task for the organisms is to accumulate evidence across sensory modalities and over time, a process known as multisensory decision-making. This is a new concept, in terms of that previous researches have been largely conducted in parallel disciplines. That is, much efforts have been put either in sensory integration across modalities using activity summed over a duration of time, or in decision-making with only one sensory modality that evolves over time. Recently, a few studies with neurophysiological measurements emerge to study how different sensory modality information is processed, accumulated, and integrated over time in decision-related areas such as the parietal or frontal lobes in mammals. In this review, we summarize and comment on these studies that combine the long-existed two parallel fields of multisensory integration and decision-making. We show how the new findings provide insight into our understanding about neural mechanisms mediating multisensory information processing in a more complete way.

Cross-Modal Plasticity during Self-Motion Perception

To maintain stable and coherent perception in an ever-changing environment, the brain needs to continuously and dynamically calibrate information from multiple sensory sources, using sensory and non-sensory information in a flexible manner. Here, we review how the vestibular and visual signals are recalibrated during self-motion perception. We illustrate two different types of recalibration: one long-term cross-modal (visual-vestibular) recalibration concerning how multisensory cues recalibrate over time in response to a constant cue discrepancy, and one rapid-term cross-modal (visual-vestibular) recalibration concerning how recent prior stimuli and choices differentially affect subsequent self-motion decisions. In addition, we highlight the neural substrates of long-term visual-vestibular recalibration, with profound differences observed in neuronal recalibration across multisensory cortical areas. We suggest that multisensory recalibration is a complex process in the brain, is modulated by many factors, and requires the coordination of many distinct cortical areas. We hope this review will shed some light on research into the neural circuits of visual-vestibular recalibration and help develop a more generalized theory for cross-modal plasticity.

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Integrating noisy signals across time as well as sensory modalities, a process named multi-sensory decision making (MSDM), is an essential strategy for making more accurate and sensitive decisions in complex environments. Although this field is just emerging, recent extraordinary works from different perspectives, including computational theory, psychophysical behaviour and neurophysiology, begin to shed new light onto MSDM. In the current review, we focus on MSDM by using a model system of visuo-vestibular heading. Combining well-controlled behavioural paradigms on virtual-reality systems, single-unit recordings, causal manipulations and computational theory based on spiking activity, recent progress reveals that vestibular signals contain complex temporal dynamics in many brain regions, including unisensory, multi-sensory and sensory-motor association areas. This challenges the brain for cue integration across time and sensory modality such as optic flow which mainly contains a motion velocity signal. In addition, new evidence from the higher-level decision-related areas, mostly in the posterior and frontal/prefrontal regions, helps revise our conventional thought on how signals from different sensory modalities may be processed, converged, and moment-by-moment accumulated through neural circuits for forming a unified, optimal perceptual decision. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Multisensory decisions from self to world

Classic Bayesian models of perceptual inference describe how an ideal observer would integrate 'unisensory' measurements (multisensory integration) and attribute sensory signals to their origin(s) (causal inference). However, in the brain, sensory signals are always received in the context of a multisensory bodily state-namely, in combination with other senses. Moreover, sensory signals from both interoceptive sensing of one's own body and exteroceptive sensing of the world are highly interdependent and never occur in isolation. Thus, the observer must fundamentally determine whether each sensory observation is from an external (versus internal, self-generated) source to even be considered for integration. Critically, solving this primary causal inference problem requires knowledge of multisensory and sensorimotor dependencies. Thus, multisensory processing is needed to separate sensory signals. These multisensory processes enable us to simultaneously form a sense of self and form distinct perceptual decisions about the external world. In this opinion paper, we review and discuss the similarities and distinctions between multisensory decisions underlying the sense of self and those directed at acquiring information about the world. We call attention to the fact that heterogeneous multisensory processes take place all along the neural hierarchy (even in forming 'unisensory' observations) and argue that more integration of these aspects, in theory and experiment, is required to obtain a more comprehensive understanding of multisensory brain function. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Temporal and spatial properties of vestibular signals for perception of self-motion

It is well recognized that the vestibular system is involved in numerous important cognitive functions, including self-motion perception, spatial orientation, locomotion, and vector-based navigation, in addition to basic reflexes, such as oculomotor or body postural control. Consistent with this rationale, vestibular signals exist broadly in the brain, including several regions of the cerebral cortex, potentially allowing tight coordination with other sensory systems to improve the accuracy and precision of perception or action during self-motion. Recent neurophysiological studies in animal models based on single-cell resolution indicate that vestibular signals exhibit complex spatiotemporal dynamics, producing challenges in identifying their exact functions and how they are integrated with other modality signals. For example, vestibular and optic flow could provide congruent and incongruent signals regarding spatial tuning functions, reference frames, and temporal dynamics. Comprehensive studies, including behavioral tasks, neural recording across sensory and sensory-motor association areas, and causal link manipulations, have provided some insights into the neural mechanisms underlying multisensory self-motion perception.

Sequential sparse autoencoder for dynamic heading representation in ventral intraparietal area

To navigate in space, it is important to predict headings in real-time from neural responses in the brain to vestibular and visual signals, and the ventral intraparietal area (VIP) is one of the critical brain areas. However, it remains unexplored in the population level how the heading perception is represented in VIP. And there are no commonly used methods suitable for decoding the headings from the population responses in VIP, given the large spatiotemporal dynamics and heterogeneity in the neural responses. Here, responses were recorded from 210 VIP neurons in three rhesus monkeys when they were performing a heading perception task. And by specifically and separately modelling the both dynamics with sparse representation, we built a sequential sparse autoencoder (SSAE) to do the population decoding on the recorded dataset and tried to maximize the decoding performance. The SSAE relies on a three-layer sparse autoencoder to extract temporal and spatial heading features in the dataset via unsupervised learning, and a softmax classifier to decode the headings. Compared with other population decoding methods, the SSAE achieves a leading accuracy of 96.8% ± 2.1%, and shows the advantages of robustness, low storage and computing burden for real-time prediction. Therefore, our SSAE model performs well in learning neurobiologically plausible features comprising dynamic navigational information.

The computational rules of cross-modality suppression in the visual posterior sylvian area

The macaque visual posterior sylvian area (VPS) is an area with neurons responding selectively to heading direction in both visual and vestibular modalities, but how VPS neurons combined these two sensory signals is still unknown. In contrast to the subadditive characteristics in the medial superior temporal area (MSTd), responses in VPS were dominated by vestibular signals, with approximately a winner-take-all competition. The conditional Fisher information analysis shows that VPS neural population encodes information from distinct sensory modalities under large and small offset conditions, which differs from MSTd whose neural population contains more information about visual stimuli in both conditions. However, the combined responses of single neurons in both areas can be well fit by weighted linear sums of unimodal responses. Furthermore, a normalization model captured most vestibular and visual interaction characteristics for both VPS and MSTd, indicating the divisive normalization mechanism widely exists in the cortex.

Vestibular Contributions to Primate Neck Postural Muscle Activity during Natural Motion

To maintain stable posture of the head and body during our everyday activities, the brain integrates information across multiple sensory systems. Here, we examined how the primate vestibular system, independently and in combination with visual sensory input, contributes to the sensorimotor control of head posture across the range of dynamic motion experienced during daily life. We recorded activity of single motor units in the splenius capitis and sternocleidomastoid muscles in rhesus monkeys during yaw rotations spanning the physiological range of self-motion (up to 20 Hz) in darkness. Splenius capitis motor unit responses continued to increase with frequency up to 16 Hz in normal animals, and were strikingly absent following bilateral peripheral vestibular loss. To determine whether visual information modulated these vestibular-driven neck muscle responses, we experimentally controlled the correspondence between visual and vestibular cues of self-motion. Surprisingly, visual information did not influence motor unit responses in normal animals, nor did it substitute for absent vestibular feedback following bilateral peripheral vestibular loss. A comparison of muscle activity evoked by broadband versus sinusoidal head motion further revealed that low-frequency responses were attenuated when low- and high-frequency self-motion were experienced concurrently. Finally, we found that vestibular-evoked responses were enhanced by increased autonomic arousal, quantified via pupil size. Together, our findings directly establish the vestibular system's contribution to the sensorimotor control of head posture across the dynamic motion range experienced during everyday activities, as well as how vestibular, visual, and autonomic inputs are integrated for postural control.SIGNIFICANCE STATEMENT Our sensory systems enable us to maintain control of our posture and balance as we move through the world. Notably, the vestibular system senses motion of the head and sends motor commands, via vestibulospinal pathways, to axial and limb muscles to stabilize posture. By recording the activity of single motor units, here we show, for the first time, that the vestibular system contributes to the sensorimotor control of head posture across the dynamic motion range experienced during everyday activities. Our results further establish how vestibular, autonomic, and visual inputs are integrated for postural control. This information is essential for understanding both the mechanisms underlying the control of posture and balance, and the impact of the loss of sensory function.

Contrary neuronal recalibration in different multisensory cortical areas

The adult brain demonstrates remarkable multisensory plasticity by dynamically recalibrating itself based on information from multiple sensory sources. After a systematic visual-vestibular heading offset is experienced, the unisensory perceptual estimates for subsequently presented stimuli are shifted toward each other (in opposite directions) to reduce the conflict. The neural substrate of this recalibration is unknown. Here, we recorded single-neuron activity from the dorsal medial superior temporal (MSTd), parietoinsular vestibular cortex (PIVC), and ventral intraparietal (VIP) areas in three male rhesus macaques during this visual-vestibular recalibration. Both visual and vestibular neuronal tuning curves in MSTd shifted - each according to their respective cues' perceptual shifts. Tuning of vestibular neurons in PIVC also shifted in the same direction as vestibular perceptual shifts (cells were not robustly tuned to the visual stimuli). By contrast, VIP neurons demonstrated a unique phenomenon: both vestibular and visual tuning shifted in accordance with vestibular perceptual shifts. Such that, visual tuning shifted, surprisingly, contrary to visual perceptual shifts. Therefore, while unsupervised recalibration (to reduce cue conflict) occurs in early multisensory cortices, higher-level VIP reflects only a global shift, in vestibular space.

Being active over one's own motion: Considering predictive mechanisms in self-motion perception

Self-motion perception is a key element guiding pilots' behavior. Its importance is mostly revealed when impaired, leading in most cases to spatial disorientation which is still today a major factor of accidents occurrence. Self-motion perception is known as mainly based on visuo-vestibular integration and can be modulated by the physical properties of the environment with which humans interact. For instance, several studies have shown that the respective weight of visual and vestibular information depends on their reliability. More recently, it has been suggested that the internal state of an operator can also modulate multisensory integration. Interestingly, the systems' automation can interfere with this internal state through the loss of the intentional nature of movements (i.e., loss of agency) and the modulation of associated predictive mechanisms. In this context, one of the new challenges is to better understand the relationship between automation and self-motion perception. The present review explains how linking the concepts of agency and self-motion is a first approach to address this issue.

Functional connectivity fingerprints of the frontal eye field and inferior frontal junction suggest spatial versus nonspatial processing in the prefrontal cortex

Neuroimaging evidence suggests that the frontal eye field (FEF) and inferior frontal junction (IFJ) govern the encoding of spatial and nonspatial (such as feature- or object-based) representations, respectively, both during visual attention and working memory tasks. However, it is still unclear whether such contrasting functional segregation is also reflected in their underlying functional connectivity patterns. Here, we hypothesized that FEF has predominant functional coupling with spatiotopically organized regions in the dorsal ('where') visual stream whereas IFJ has predominant functional connectivity with the ventral ('what') visual stream. We applied seed-based functional connectivity analyses to temporally high-resolving resting-state magnetoencephalography (MEG) recordings. We parcellated the brain according to the multimodal Glasser atlas and tested, for various frequency bands, whether the spontaneous activity of each parcel in the ventral and dorsal visual pathway has predominant functional connectivity with FEF or IFJ. The results show that FEF has a robust power correlation with the dorsal visual pathway in beta and gamma bands. In contrast, anterior IFJ (IFJa) has a strong power coupling with the ventral visual stream in delta, beta and gamma oscillations. Moreover, while FEF is phase-coupled with the superior parietal lobe in the beta band, IFJa is phase-coupled with the middle and inferior temporal cortex in delta and gamma oscillations. We argue that these intrinsic connectivity fingerprints are congruent with each brain region's function. Therefore, we conclude that FEF and IFJ have dissociable connectivity patterns that fit their respective functional roles in spatial versus nonspatial top-down attention and working memory control.

Alterations in Corticocortical Vestibular Network Functional Connectivity Are Associated with Decreased Balance Ability in Elderly Individuals with Mild Cognitive Impairment

The corticocortical vestibular network (CVN) plays an important role in maintaining balance and stability. In order to clarify the specific relationship between the CVN and the balance ability of patients with mild cognitive impairment (MCI), we recruited 30 MCI patients in the community. According to age and sex, they were 1:1 matched to 30 older adults with normal cognitive function. We evaluated balance ability and performed MRI scanning in the two groups of participants. We analyzed functional connectivity within the CVN based on the region of interest. Then, we performed a Pearson correlation analysis between the functional connection and the Berg Balance Scale scores. The research results show that compared with the control group, there were three pairs of functional connections (hMST_R−Premotor_R, PFcm_R−SMA_L, and hMST_L−VIP_R) that were significantly decreased in the CVNs of the MCI group (p < 0.05). Further correlation analysis showed that there was a significant positive correlation between hMST_R−Premotor_R functional connectivity and BBS score (r = 0.364, p = 0.004). The decline in balance ability and increase in fall risk in patients with MCI may be closely related to the change in the internal connection mode of the corticocortical vestibular network.

Heading perception from optic flow is affected by heading distribution

Recent studies have revealed a central tendency in the perception of physical features. That is, the perceived feature was biased toward the mean of recently experienced features (i.e., previous feature distribution). However, no study explored whether the central tendency was in heading perception or not. In this study, we conducted three experiments to answer this question. The results showed that the perceived heading was not biased toward the mean of the previous heading distribution, suggesting that the central tendency was not in heading perception. However, the perceived headings were overall biased toward the left side, where headings rarely appeared in the right-heavied distribution (Experiment 3), suggesting that heading perception from optic flow was affected by previously seen headings. It indicated that the participants learned the heading distributions and used them to adjust their heading perception. Our study revealed that heading perception from optic flow was not purely perceptual and that postperceptual stages (e.g., attention and working memory) might be involved in the heading perception from optic flow.

Not so spontaneous: Multi-dimensional representations of behaviors and context in sensory areas

Sensory areas are spontaneously active in the absence of sensory stimuli. This spontaneous activity has long been studied; however, its functional role remains largely unknown. Recent advances in technology, allowing large-scale neural recordings in the awake and behaving animal, have transformed our understanding of spontaneous activity. Studies using these recordings have discovered high-dimensional spontaneous activity patterns, correlation between spontaneous activity and behavior, and dissimilarity between spontaneous and sensory-driven activity patterns. These findings are supported by evidence from developing animals, where a transition toward these characteristics is observed as the circuit matures, as well as by evidence from mature animals across species. These newly revealed characteristics call for the formulation of a new role for spontaneous activity in neural sensory computation.

Cortical Mechanisms of Multisensory Linear Self-motion Perception

Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.

A neural mechanism for detecting object motion during self-motion

Detection of objects that move in a scene is a fundamental computation performed by the visual system. This computation is greatly complicated by observer motion, which causes most objects to move across the retinal image. How the visual system detects scene-relative object motion during self-motion is poorly understood. Human behavioral studies suggest that the visual system may identify local conflicts between motion parallax and binocular disparity cues to depth and may use these signals to detect moving objects. We describe a novel mechanism for performing this computation based on neurons in macaque middle temporal (MT) area with incongruent depth tuning for binocular disparity and motion parallax cues. Neurons with incongruent tuning respond selectively to scene-relative object motion, and their responses are predictive of perceptual decisions when animals are trained to detect a moving object during self-motion. This finding establishes a novel functional role for neurons with incongruent tuning for multiple depth cues.

How Tilting the Head Interferes With Eye-Hand Coordination: The Role of Gravity in Visuo-Proprioceptive, Cross-Modal Sensory Transformations

To correctly position the hand with respect to the spatial location and orientation of an object to be reached/grasped, visual information about the target and proprioceptive information from the hand must be compared. Since visual and proprioceptive sensory modalities are inherently encoded in a retinal and musculo-skeletal reference frame, respectively, this comparison requires cross-modal sensory transformations. Previous studies have shown that lateral tilts of the head interfere with the visuo-proprioceptive transformations. It is unclear, however, whether this phenomenon is related to the neck flexion or to the head-gravity misalignment. To answer to this question, we performed three virtual reality experiments in which we compared a grasping-like movement with lateral neck flexions executed in an upright seated position and while lying supine. In the main experiment, the task requires cross-modal transformations, because the target information is visually acquired, and the hand is sensed through proprioception only. In the other two control experiments, the task is unimodal, because both target and hand are sensed through one, and the same, sensory channel (vision and proprioception, respectively), and, hence, cross-modal processing is unnecessary. The results show that lateral neck flexions have considerably different effects in the seated and supine posture, but only for the cross-modal task. More precisely, the subjects’ response variability and the importance associated to the visual encoding of the information significantly increased when supine. We show that these findings are consistent with the idea that head-gravity misalignment interferes with the visuo-proprioceptive cross-modal processing. Indeed, the principle of statistical optimality in multisensory integration predicts the observed results if the noise associated to the visuo-proprioceptive transformations is assumed to be affected by gravitational signals, and not by neck proprioceptive signals per se. This finding is also consistent with the observation of otolithic projections in the posterior parietal cortex, which is involved in the visuo-proprioceptive processing. Altogether these findings represent a clear evidence of the theorized central role of gravity in spatial perception. More precisely, otolithic signals would contribute to reciprocally align the reference frames in which the available sensory information can be encoded.

Influence of Tactile Flow on Visual Heading Perception

The integration of information from different sensory modalities is crucial for successful navigation through an environment. Among others, self-motion induces distinct optic flow patterns on the retina, vestibular signals and tactile flow, which contribute to determine traveled distance (path integration) or movement direction (heading). While the processing of combined visual-vestibular information is subject to a growing body of literature, the processing of visuo-tactile signals in the context of self-motion has received comparatively little attention. Here, we investigated whether visual heading perception is influenced by behaviorally irrelevant tactile flow. In the visual modality, we simulated an observer's self-motion across a horizontal ground plane (optic flow). Tactile self-motion stimuli were delivered by air flow from head-mounted nozzles (tactile flow). In blocks of trials, we presented only visual or tactile stimuli and subjects had to report their perceived heading. In another block of trials, tactile and visual stimuli were presented simultaneously, with the tactile flow within ±40° of the visual heading (bimodal condition). Here, importantly, participants had to report their perceived visual heading. Perceived self-motion direction in all conditions revealed a centripetal bias, i.e., heading directions were perceived as compressed toward straight ahead. In the bimodal condition, we found a small but systematic influence of task-irrelevant tactile flow on visually perceived headings as function of their directional offset. We conclude that tactile flow is more tightly linked to self-motion perception than previously thought.

Cognitive, Systems, and Computational Neurosciences of the Self in Motion

Navigating by path integration requires continuously estimating one's self-motion. This estimate may be derived from visual velocity and/or vestibular acceleration signals. Importantly, these senses in isolation are ill-equipped to provide accurate estimates, and thus visuo-vestibular integration is an imperative. After a summary of the visual and vestibular pathways involved, the crux of this review focuses on the human and theoretical approaches that have outlined a normative account of cue combination in behavior and neurons, as well as on the systems neuroscience efforts that are searching for its neural implementation. We then highlight a contemporary frontier in our state of knowledge: understanding how velocity cues with time-varying reliabilities are integrated into an evolving position estimate over prolonged time periods. Further, we discuss how the brain builds internal models inferring when cues ought to be integrated versus segregated-a process of causal inference. Lastly, we suggest that the study of spatial navigation has not yet addressed its initial condition: self-location.

Supervised Multisensory Calibration Signals Are Evident in VIP But Not MSTd

Multisensory plasticity enables our senses to dynamically adapt to each other and the external environment, a fundamental operation that our brain performs continuously. We searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) in 2 male rhesus macaques using a paradigm of supervised calibration. We report little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. In contrast, neural correlates of plasticity are found in higher-level multisensory VIP, an area with strong decision-related activity. Accordingly, we observed systematic shifts of VIP tuning curves, which were reflected in the choice-related component of the population response. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions. These results lay the foundation for understanding multisensory neural plasticity, applicable broadly to maintaining accuracy for sensorimotor tasks.SIGNIFICANCE STATEMENT Multisensory plasticity is a fundamental and continual function of the brain that enables our senses to adapt dynamically to each other and to the external environment. Yet, very little is known about the neuronal mechanisms of multisensory plasticity. In this study, we searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) using a paradigm of supervised calibration. We found little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. By contrast, neural correlates of plasticity were found in VIP, a higher-level multisensory area with strong decision-related activity. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions.

Cortical visual area CSv as a cingulate motor area: a sensorimotor interface for the control of locomotion

The response properties, connectivity and function of the cingulate sulcus visual area (CSv) are reviewed. Cortical area CSv has been identified in both human and macaque brains. It has similar response properties and connectivity in the two species. It is situated bilaterally in the cingulate sulcus close to an established group of medial motor/premotor areas. It has strong connectivity with these areas, particularly the cingulate motor areas and the supplementary motor area, suggesting that it is involved in motor control. CSv is active during visual stimulation but only if that stimulation is indicative of self-motion. It is also active during vestibular stimulation and connectivity data suggest that it receives proprioceptive input. Connectivity with topographically organized somatosensory and motor regions strongly emphasizes the legs over the arms. Together these properties suggest that CSv provides a key interface between the sensory and motor systems in the control of locomotion. It is likely that its role involves online control and adjustment of ongoing locomotory movements, including obstacle avoidance and maintaining the intended trajectory. It is proposed that CSv is best seen as part of the cingulate motor complex. In the human case, a modification of the influential scheme of Picard and Strick (Picard and Strick, Cereb Cortex 6:342-353, 1996) is proposed to reflect this.

Multisensory integration in cortical regions responding to locomotion-related visual and somatomotor signals

During real-world locomotion, in order to be able to move along a path or avoid an obstacle, continuous changes in self-motion direction (i.e. heading) are needed. Control of heading changes during locomotion requires the integration of multiple signals (i.e., visual, somatomotor, vestibular). Recent fMRI studies have shown that both somatomotor areas (human PEc [hPEc], human PE [hPE], primary somatosensory cortex [S-I]) and egomotion visual regions (cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) respond to either leg movements and egomotion-compatible visual stimulations, suggesting a role in the analysis of both visual attributes of egomotion and somatomotor signals with the aim of guiding locomotion. However, whether these regions are able to integrate egomotion-related visual signals with somatomotor inputs coming from leg movements during heading changes remains an open question. Here we used a combined approach of individual functional localizers and task-evoked activity by fMRI. In thirty subjects we first localized three egomotion areas (CSv, pCi, PIC) and three somatomotor regions (S-I, hPE, hPEc). Then, we tested their responses in a multisensory integration experiment combining visual and somatomotor signals relevant to locomotion in congruent or incongruent trials. We used an fMR-adaptation paradigm to explore the sensitivity to the repeated presentation of these bimodal stimuli in the six regions of interest. Results revealed that hPE, S-I and CSv showed an adaptation effect regardless of congruency, while PIC, pCi and hPEc showed sensitivity to congruency. PIC exhibited a preference for congruent trials compared to incongruent trials. Areas pCi and hPEc exhibited an adaptation effect only for congruent and incongruent trials, respectively. PIC, pCi and hPEc sensitivity to the congruency relationship between visual (locomotion-compatible) cues and (leg-related) somatomotor inputs suggests that these regions are involved in multisensory integration processes, likely in order to guide/adjust leg movements during heading changes.

The macaque ventral intraparietal area has expanded into three homologue human parietal areas

The macaque ventral intraparietal area (VIP) in the fundus of the intraparietal sulcus has been implicated in a diverse range of sensorimotor and cognitive functions such as motion processing, multisensory integration, processing of head peripersonal space, defensive behavior, and numerosity coding. Here, we exhaustively review macaque VIP function, cytoarchitectonics, and anatomical connectivity and integrate it with human studies that have attempted to identify a potential human VIP homologue. We show that human VIP research has consistently identified three, rather than one, bilateral parietal areas that each appear to subsume some, but not all, of the macaque area's functionality. Available evidence suggests that this human "VIP complex" has evolved as an expansion of the macaque area, but that some precursory specialization within macaque VIP has been previously overlooked. The three human areas are dominated, roughly, by coding the head or self in the environment, visual heading direction, and the peripersonal environment around the head, respectively. A unifying functional principle may be best described as prediction in space and time, linking VIP to state estimation as a key parietal sensorimotor function. VIP's expansive differentiation of head and self-related processing may have been key in the emergence of human bodily self-consciousness.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Encoding of vestibular and optic flow cues to self-motion in the posterior superior temporal polysensory area

KEY POINTS

Neurons in the posterior superior temporal polysensory area (STPp) showed significant directional selectivity in response to vestibular, optic flow and combined visual-vestibular stimuli. By comparison to the dorsal medial superior temporal area, the visual latency was slower in STPp but the vestibular latency was faster. Heading preferences under combined stimulation in STPp were usually dominated by visual signals. Cross-modal enhancement was observed in STPp when both vestibular and visual cues were presented together at their heading preferences.

ABSTRACT

Human neuroimaging data implicated that the superior temporal polysensory area (STP) might be involved in vestibular-visual interaction during heading computations, but the heading selectivity has not been examined in the macaque. Here, we investigated the convergence of optic flow and vestibular signals in macaque STP by using a virtual-reality system and found that 6.3% of STP neurons showed multisensory responses, with visual and vestibular direction preferences either congruent or opposite in roughly equal proportion. The percentage of vestibular-tuned cells (18.3%) was much smaller than that of visual-tuned cells (30.4%) in STP. The vestibular tuning strength was usually weaker than the visual condition. The visual latency was significantly slower in STPp than in the dorsal medial superior temporal area (MSTd), but the vestibular latency was significantly faster than in MSTd. During the bimodal condition, STP cells' response was dominated by visual signals, with the visual heading preference not affected by the vestibular signals but the response amplitudes modulated by vestibular signals in a subadditive way.

Optic flow selectivity in the macaque parieto-occipital sulcus

In humans, several neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates higher-level motion areas, like V6 and the cingulate sulcus visual area (CSv). In macaque, there are few studies on the sensitivity of V6 and CSv to egomotion compatible optic flow. The only fMRI study on this issue revealed selectivity to egomotion compatible optic flow in macaque CSv but not in V6 (Cotterau et al. Cereb Cortex 27(1):330-343, 2017, but see Fan et al. J Neurosci. 35:16303-16314, 2015). Yet, it is unknown whether monkey visual motion areas MT + and V6 display any distinctive fMRI functional profile relative to the optic flow stimulation, as it is the case for the homologous human areas (Pitzalis et al., Cereb Cortex 20(2):411-424, 2010). Here, we described the sensitivity of the monkey brain to two motion stimuli (radial rings and flow fields) originally used in humans to functionally map the motion middle temporal area MT + (Tootell et al. J Neurosci 15: 3215-3230, 1995a; Nature 375:139-141, 1995b) and the motion medial parietal area V6 (Pitzalis et al. 2010), respectively. In both animals, we found regions responding only to optic flow or radial rings stimulation, and regions responding to both stimuli. A region in the parieto-occipital sulcus (likely including V6) was one of the most highly selective area for coherently moving fields of dots, further demonstrating the power of this type of stimulation to activate V6 in both humans and monkeys. We did not find any evidence that putative macaque CSv responds to Flow Fields.

Action-dependent processing of self-motion in parietal cortex of macaque monkeys

Successful interaction with the environment requires the dissociation of self-induced from externally induced sensory stimulation. Temporal proximity of action and effect is hereby often used as an indicator of whether an observed event should be interpreted as a result of own actions or not. We tested how the delay between an action (press of a touch bar) and an effect (onset of simulated self-motion) influences the processing of visually simulated self-motion in the ventral intraparietal area (VIP) of macaque monkeys. We found that a delay between the action and the start of the self-motion stimulus led to a rise of activity above the baseline activity before motion onset in a subpopulation of 21% of the investigated neurons. In the responses to the stimulus, we found a significantly lower sustained activity when the press of a touch bar and the motion onset were contiguous compared to the condition when the motion onset was delayed. We speculate that this weak inhibitory effect might be part of a mechanism that sharpens the tuning of VIP neurons during self-induced motion and thus has the potential to increase the precision of heading information that is required to adjust the orientation of self-motion in everyday navigational tasks.NEW & NOTEWORTHY Neurons in macaque ventral intraparietal area (VIP) are responding to sensory stimulation related to self-motion, e.g. visual optic flow. Here, we found that self-motion induced activation depends on the sense of agency, i.e., it differed when optic flow was perceived as self- or externally induced. This demonstrates that area VIP is well suited for study of the interplay between active behavior and sensory processing during self-motion.

Robust vestibular self-motion signals in macaque posterior cingulate region

Self-motion signals, distributed ubiquitously across parietal-temporal lobes, propagate to limbic hippocampal system for vector-based navigation via hubs including posterior cingulate cortex (PCC) and retrosplenial cortex (RSC). Although numerous studies have indicated posterior cingulate areas are involved in spatial tasks, it is unclear how their neurons represent self-motion signals. Providing translation and rotation stimuli to macaques on a 6-degree-of-freedom motion platform, we discovered robust vestibular responses in PCC. A combined three-dimensional spatiotemporal model captured data well and revealed multiple temporal components including velocity, acceleration, jerk, and position. Compared to PCC, RSC contained moderate vestibular temporal modulations and lacked significant spatial tuning. Visual self-motion signals were much weaker in both regions compared to the vestibular signals. We conclude that macaque posterior cingulate region carries vestibular-dominant self-motion signals with plentiful temporal components that could be useful for path integration.

Dynamics of Heading and Choice-Related Signals in the Parieto-Insular Vestibular Cortex of Macaque Monkeys

Perceptual decision-making is increasingly being understood to involve an interaction between bottom-up sensory-driven signals and top-down choice-driven signals, but how these signals interact to mediate perception is not well understood. The parieto-insular vestibular cortex (PIVC) is an area with prominent vestibular responsiveness, and previous work has shown that inactivating PIVC impairs vestibular heading judgments. To investigate the nature of PIVC's contribution to heading perception, we recorded extracellularly from PIVC neurons in two male rhesus macaques during a heading discrimination task, and compared findings with data from previous studies of dorsal medial superior temporal (MSTd) and ventral intraparietal (VIP) areas using identical stimuli. By computing partial correlations between neural responses, heading, and choice, we find that PIVC activity reflects a dynamically changing combination of sensory and choice signals. In addition, the sensory and choice signals are more balanced in PIVC, in contrast to the sensory dominance in MSTd and choice dominance in VIP. Interestingly, heading and choice signals in PIVC are negatively correlated during the middle portion of the stimulus epoch, reflecting a mismatch in the polarity of heading and choice signals. We anticipate that these results will help unravel the mechanisms of interaction between bottom-up sensory signals and top-down choice signals in perceptual decision-making, leading to more comprehensive models of self-motion perception.SIGNIFICANCE STATEMENT Vestibular information is important for our perception of self-motion, and various cortical regions in primates show vestibular heading selectivity. Inactivation of the macaque vestibular cortex substantially impairs the precision of vestibular heading discrimination, more so than inactivation of other multisensory areas. Here, we record for the first time from the vestibular cortex while monkeys perform a forced-choice heading discrimination task, and we compare results with data collected previously from other multisensory cortical areas. We find that vestibular cortex activity reflects a dynamically changing combination of sensory and choice signals, with both similarities and notable differences with other multisensory areas.

Primate extrastriate cortical area MST: a gateway between sensation and cognition

Primate visual cortex consists of dozens of distinct brain areas, each providing a highly specialized component to the sophisticated task of encoding the incoming sensory information and creating a representation of our visual environment that underlies our perception and action. One such area is the medial superior temporal cortex (MST), a motion-sensitive, direction-selective part of the primate visual cortex. It receives most of its input from the middle temporal (MT) area, but MST cells have larger receptive fields and respond to more complex motion patterns. The finding that MST cells are tuned for optic flow patterns has led to the suggestion that the area plays an important role in the perception of self-motion. This hypothesis has received further support from studies showing that some MST cells also respond selectively to vestibular cues. Furthermore, the area is part of a network that controls the planning and execution of smooth pursuit eye movements and its activity is modulated by cognitive factors, such as attention and working memory. This review of more than 90 studies focuses on providing clarity of the heterogeneous findings on MST in the macaque cortex and its putative homolog in the human cortex. From this analysis of the unique anatomical and functional position in the hierarchy of areas and processing steps in primate visual cortex, MST emerges as a gateway between perception, cognition, and action planning. Given this pivotal role, this area represents an ideal model system for the transition from sensation to cognition.

Preference for locomotion-compatible curved paths and forward direction of self-motion in somatomotor and visual areas

During locomotion, leg movements define the direction of walking (forward or backward) and the path one is taking (straight or curved). These aspects of locomotion produce characteristic visual motion patterns during movement. Here, we tested whether cortical regions responding to either egomotion-compatible visual motion, or leg movements, or both, are sensitive to these locomotion-relevant aspects of visual motion. We compared a curved path (typically the visual feedback of a changing direction of movement in the environment) to a linear path for simulated forward and backward motion in an event-related fMRI experiment. We used an individual surface-based approach and two functional localizers to define (1) six egomotion-related areas (V6+, V3A, intraparietal motion area [IPSmot], cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) using the flow field stimulus and (2) three leg-related cortical regions (human PEc [hPEc], human PE [hPE] and primary somatosensory cortex [S-I]) using a somatomotor task. Then, we extracted the response from all these regions with respect to the main event-related fMRI experiment, consisting of passive viewing of an optic flow stimulus, simulating a forward or backward direction of self-motion in either linear or curved path. Results showed that some regions have a significant preference for the curved path motion (hPEc, hPE, S-I, IPSmot) or a preference for the forward motion (V3A), while other regions have both a significant preference for the curved path motion and for the forward compared to backward motion (V6+, CSv, pCi). We did not find any significant effects of the present stimuli in PIC. Since controlling locomotion mainly means controlling changes of walking direction in the environment during forward self-motion, such a differential functional profile among these cortical regions suggests that they play a differentiated role in the visual guidance of locomotion.

Connectivity of the Cingulate Sulcus Visual Area (CSv) in Macaque Monkeys

In humans, the posterior cingulate cortex contains an area sensitive to visual cues to self-motion. This cingulate sulcus visual area (CSv) is structurally and functionally connected with several (multi)sensory and (pre)motor areas recruited during locomotion. In nonhuman primates, electrophysiology has shown that the cingulate cortex is also related to spatial navigation. Recently, functional MRI in macaque monkeys identified a cingulate area with similar visual properties to human CSv. In order to bridge the gap between human and nonhuman primate research, we examined the structural and functional connectivity of putative CSv in three macaque monkeys adopting the same approach as in humans based on diffusion MRI and resting-state functional MRI. The results showed that putative monkey CSv connects with several visuo-vestibular areas (e.g., VIP/FEFsem/VPS/MSTd) as well as somatosensory cortex (e.g., dorsal aspects of areas 3/1/2), all known to process sensory signals that can be triggered by self-motion. Additionally, strong connections are observed with (pre)motor areas located in the dorsal prefrontal cortex (e.g., F3/F2/F1) and within the anterior cingulate cortex (e.g., area 24). This connectivity pattern is strikingly reminiscent of that described for human CSv, suggesting that the sensorimotor control of locomotion relies on similar organizational principles in human and nonhuman primates.

Structural connectome and connectivity lateralization of the multimodal vestibular cortical network

Unlike other sensory systems, the structural connectivity patterns of the human vestibular cortex remain a matter of debate. Based on their functional properties and hypothesized centrality within the vestibular network, the ‘core’ cortical regions of this network are thought to be areas in the posterior peri-sylvian cortex, in particular the retro-insula (previously named the posterior insular cortex-PIC), and the subregion OP2 of the parietal operculum.

To study the vestibular network, structural connectivity matrices from n=974 healthy individuals drawn from the public Human Connectome Project (HCP) repository were estimated using multi-shell diffusion-weighted data followed by probabilistic tractography and spherical-deconvolution informed filtering of tractograms in combination with subject-specific grey-matter parcellations. Weighted graph-theoretical measures, modularity, and ‘hubness’ of the multimodal vestibular network were then estimated, and a structural lateralization index was defined in order to assess the difference in fiber density of homonym regions in the right and left hemisphere. Differences in connectivity patterns between OP2 and PIC were also estimated.

We found that the bilateral intraparietal sulcus, PIC, and to a lesser degree OP2, are key ‘hub’ regions within the multimodal vestibular network. PIC and OP2 structural connectivity patterns were lateralized to the left hemisphere, while structural connectivity patterns of the posterior peri-sylvian supramarginal and superior temporal gyri were lateralized to the right hemisphere. These lateralization patterns were independent of handedness.

We also found that the structural connectivity pattern of PIC is consistent with a key role of PIC in visuo-vestibular processing and that the structural connectivity pattern of OP2 is consistent with integration of mainly vestibular somato-sensory and motor information. These results suggest an analogy between PIC and the simian visual posterior sylvian (VPS) area and OP2 and the simian parieto-insular vestibular cortex (PIVC).

Overall, these findings may provide novel insights to the current models of vestibular function, as well as to the understanding of the complexity and lateralized signs of vestibular syndromes.

The Effects of Depth Cues and Vestibular Translation Signals on the Rotation Tolerance of Heading Tuning in Macaque Area MSTd

When the eyes rotate during translational self-motion, the focus of expansion (FOE) in optic flow no longer indicates heading, yet heading judgements are largely unbiased. Much emphasis has been placed on the role of extraretinal signals in compensating for the visual consequences of eye rotation. However, recent studies also support a purely visual mechanism of rotation compensation in heading-selective neurons. Computational theories support a visual compensatory strategy but require different visual depth cues. We examined the rotation tolerance of heading tuning in macaque area MSTd using two different virtual environments, a frontoparallel (2D) wall and a 3D cloud of random dots. Both environments contained rotational optic flow cues (i.e., dynamic perspective), but only the 3D cloud stimulus contained local motion parallax cues, which are required by some models. The 3D cloud environment did not enhance the rotation tolerance of heading tuning for individual MSTd neurons, nor the accuracy of heading estimates decoded from population activity, suggesting a key role for dynamic perspective cues. We also added vestibular translation signals to optic flow, to test whether rotation tolerance is enhanced by non-visual cues to heading. We found no benefit of vestibular signals overall, but a modest effect for some neurons with significant vestibular heading tuning. We also find that neurons with more rotation tolerant heading tuning typically are less selective to pure visual rotation cues. Together, our findings help to clarify the types of information that are used to construct heading representations that are tolerant to eye rotations.

Antero-Posterior vs. Lateral Vestibular Input Processing in Human Visual Cortex

Visuo-vestibular integration is crucial for locomotion, yet the cortical mechanisms involved remain poorly understood. We combined binaural monopolar galvanic vestibular stimulation (GVS) and functional magnetic resonance imaging (fMRI) to characterize the cortical networks activated during antero-posterior and lateral stimulations in humans. We focused on functional areas that selectively respond to egomotion-consistent optic flow patterns: the human middle temporal complex (hMT+), V6, the ventral intraparietal (VIP) area, the cingulate sulcus visual (CSv) area and the posterior insular cortex (PIC). Areas hMT+, CSv, and PIC were equivalently responsive during lateral and antero-posterior GVS while areas VIP and V6 were highly activated during antero-posterior GVS, but remained silent during lateral GVS. Using psychophysiological interaction (PPI) analyses, we confirmed that a cortical network including areas V6 and VIP is engaged during antero-posterior GVS. Our results suggest that V6 and VIP play a specific role in processing multisensory signals specific to locomotion during navigation.

Visual Perception of Heading in the Syndrome of Oculopalatal Tremor

Perception of our linear motion, heading, relies on convergence from multiple sensory systems utilizing visual and vestibular signals. Multisensory convergence takes place in the visuo-vestibular areas of the cerebral cortex and posterior cerebellar vermis. Latter closely connected with the inferior olive may malfunction in disorders of olivo-cerebellar hypersynchrony, such as the syndrome of oculopalatal tremor (OPT). We had recently shown an impairment in vestibular heading perception in the subjects with OPT. Here we asked whether the hypersynchrony in the inferior-olive cerebellar circuit also affects the visual perception of heading, and the impairment is coupled with the deficits in vestibular heading perception. Three subjects with OPT and 11 healthy controls performed a two-alternative forced-choice task in two separate experiments; one when they were moved en bloc in a straight-ahead forward direction or at multiple heading angles to the right or the left; and second when under virtual reality goggle they experienced the movement of star cloud leading to the percept of heading straight, left or to the right at the heading angles similar to those utilized in the vestibular task. The resultant psychometric function curves, derived from the two-alternative-forced-choice task, revealed abnormal threshold to perceive heading direction, abnormal sensitivity to the change in heading direction compared to straight ahead, and a bias towards one side. Although the impairment was present in both visual and vestibular heading perception, the deficits were not coupled.

A Causal Role of Area hMST for Self-Motion Perception in Humans

Previous studies in the macaque monkey have provided clear causal evidence for an involvement of the medial-superior-temporal area (MST) in the perception of self-motion. These studies also revealed an overrepresentation of contraversive heading. Human imaging studies have identified a functional equivalent (hMST) of macaque area MST. Yet, causal evidence of hMST in heading perception is lacking. We employed neuronavigated transcranial magnetic stimulation (TMS) to test for such a causal relationship. We expected TMS over hMST to induce increased perceptual variance (i.e., impaired precision), while leaving mean heading perception (accuracy) unaffected. We presented 8 human participants with an optic flow stimulus simulating forward self-motion across a ground plane in one of 3 directions. Participants indicated perceived heading. In 57% of the trials, TMS pulses were applied, temporally centered on self-motion onset. TMS stimulation site was either right-hemisphere hMST, identified by a functional magnetic resonance imaging (fMRI) localizer, or a control-area, just outside the fMRI localizer activation. As predicted, TMS over area hMST, but not over the control-area, increased response variance of perceived heading as compared with noTMS stimulation trials. As hypothesized, this effect was strongest for contraversive self-motion. These data provide a first causal evidence for a critical role of hMST in visually guided navigation.

Flexible coding of object motion in multiple reference frames by parietal cortex neurons

Neurons represent spatial information in diverse reference frames, but it remains unclear whether neural reference frames change with task demands and whether these changes can account for behavior. We examined how neurons represent the direction of a moving object during self-motion, while monkeys switched, from trial to trial, between reporting object direction in head- and world-centered reference frames. Self-motion information is needed to compute object motion in world coordinates, but should be ignored when judging object motion in head coordinates. Neural responses in the ventral intraparietal area are modulated by the task reference frame, such that population activity represents object direction in either reference frame. In contrast, responses in the lateral portion of the medial superior temporal area primarily represent object motion in head coordinates. Our findings demonstrate a neural representation of object motion that changes with task requirements.

Cerebral Hemodynamic Responses to the Sensory Conflict Between Visual and Rotary Vestibular Stimuli: An Analysis With a Multichannel Near-Infrared Spectroscopy (NIRS) System

Sensory conflict among visual, vestibular, and somatosensory information induces vertiginous sensation and postural instability. To elucidate the cognitive mechanisms of the integration between the visual and vestibular cues in humans, we analyzed the cortical hemodynamic responses during sensory conflict between visual and horizontal rotatory vestibular stimulation using a multichannel near-infrared spectroscopy (NIRS) system. The subjects sat on a rotatory chair that was accelerated at 3°/s² for 20 s to the right or left, kept rotating at 60°/s for 80 s, and then decelerated at 3°/s² for 20 s. The subjects were instructed to watch white stripes projected on a screen surrounding the chair during the acceleration and deceleration periods. The white stripes moved in two ways; in the "congruent" condition, the stripes moved in the opposite direction of chair rotation at 3°/s² (i.e., natural visual stimulation), whereas in the "incongruent" condition, the stripes moved in the same direction of chair rotation at 3°/s² (i.e., conflicted visual stimulation). The cortical hemodynamic activity was recorded from the bilateral temporoparietal regions. Statistical analyses using NIRS-SPM software indicated that hemodynamic activity increased in the bilateral temporoparietal junctions (TPJs) and human MT+ complex, including the medial temporal (MT) area and medial superior temporal (MST) area in the incongruent condition. Furthermore, the subjective strength of the vertiginous sensation was negatively correlated with hemodynamic activity in the dorsal part of the supramarginal gyrus (SMG) in and around the intraparietal sulcus (IPS). These results suggest that sensory conflict between the visual and vestibular stimuli promotes cortical cognitive processes in the cortical network consisting of the TPJ, the medial temporal gyrus (MTG), and IPS, which might contribute to self-motion perception to maintain a sense of balance or equilibrioception during sensory conflict.

The Ventral Posterior Lateral Thalamus Preferentially Encodes Externally Applied Versus Active Movement: Implications for Self-Motion Perception

Successful interaction with our environment requires that voluntary behaviors be precisely coordinated with our perception of self-motion. The vestibular sensors in the inner ear detect self-motion and in turn send projections via the vestibular nuclei to multiple cortical areas through 2 principal thalamocortical pathways, 1 anterior and 1 posterior. While the anterior pathway has been extensively studied, the role of the posterior pathway is not well understood. Accordingly, here we recorded responses from individual neurons in the ventral posterior lateral thalamus of macaque monkeys during externally applied (passive) and actively generated self-motion. The sensory responses of neurons that robustly encoded passive rotations and translations were canceled during comparable voluntary movement (~80% reduction). Moreover, when both passive and active self-motion were experienced simultaneously, neurons selectively encoded the detailed time course of the passive component. To examine the mechanism underlying the selective elimination of vestibular sensitivity to active motion, we experimentally controlled correspondence between intended and actual head movement. We found that suppression only occurred if the actual sensory consequences of motion matched the motor-based expectation. Together, our findings demonstrate that the posterior thalamocortical vestibular pathway selectively encodes unexpected motion, thereby providing a neural correlate for ensuring perceptual stability during active versus externally generated motion.

Vestibular processing during natural self-motion: implications for perception and action

How the brain computes accurate estimates of our self-motion relative to the world and our orientation relative to gravity in order to ensure accurate perception and motor control is a fundamental neuroscientific question. Recent experiments have revealed that the vestibular system encodes this information during everyday activities using pathway-specific neural representations. Furthermore, new findings have established that vestibular signals are selectively combined with extravestibular information at the earliest stages of central vestibular processing in a manner that depends on the current behavioural goal. These findings have important implications for our understanding of the brain mechanisms that ensure accurate perception and behaviour during everyday activities and for our understanding of disorders of vestibular processing.

Complementary congruent and opposite neurons achieve concurrent multisensory integration and segregation

Our brain perceives the world by exploiting multisensory cues to extract information about various aspects of external stimuli. The sensory cues from the same stimulus should be integrated to improve perception, and otherwise segregated to distinguish different stimuli. In reality, however, the brain faces the challenge of recognizing stimuli without knowing in advance the sources of sensory cues. To address this challenge, we propose that the brain conducts integration and segregation concurrently with complementary neurons. Studying the inference of heading-direction via visual and vestibular cues, we develop a network model with two reciprocally connected modules modeling interacting visual-vestibular areas. In each module, there are two groups of neurons whose tunings under each sensory cue are either congruent or opposite. We show that congruent neurons implement integration, while opposite neurons compute cue disparity information for segregation, and the interplay between two groups of neurons achieves efficient multisensory information processing.

Connectivity of the Cingulate Sulcus Visual Area (CSv) in the Human Cerebral Cortex

The human cingulate sulcus visual area (CSv) responds selectively to visual and vestibular cues to self-motion. Although it is more selective for visual self-motion cues than any other brain region studied, it is not known whether CSv mediates perception of self-motion. An alternative hypothesis, based on its location, is that it provides sensory information to the motor system for use in guiding locomotion. To evaluate this hypothesis we studied the connectivity pattern of CSv, which is completely unknown, with a combination of diffusion MRI and resting-state functional MRI. Converging results from the 2 approaches suggest that visual drive is provided primarily by areas hV6, pVIP (putative intraparietal cortex) and PIC (posterior insular cortex). A strong connection with the medial portion of the somatosensory cortex, which represents the legs and feet, suggests that CSv may receive locomotion-relevant proprioceptive information as well as visual and vestibular signals. However, the dominant connections of CSv are with specific components of the motor system, in particular the cingulate motor areas and the supplementary motor area. We propose that CSv may provide a previously unknown link between perception and action that serves the online control of locomotion.