Vestibular signals in macaque extrastriate visual cortex are functionally appropriate for heading perception

Time to move: Brain dynamics underlying natural action and cognition

Advances in Mobile Brain/Body Imaging (MoBI) technology allows for real-time measurements of human brain dynamics during every day, natural, real-life situations. This special issue Time to Move brings together a collection of experimental papers, targeted reviews and opinion articles that lay out the latest MoBI findings. A wide range of topics across different fields are covered including art, athletics, virtual reality, and mobility. What unites these diverse topics is the common goal to enhance and restore human abilities by reaching a better understanding on how cognition is implemented by the brain-body relationship. The breadth and novelty of paradigms and findings reported here positions MoBI as a new frontier in the field of human cognitive neuroscience.

Development of a new method for assessing otolith function in mice using three-dimensional binocular analysis of the otolith-ocular reflex

In the interaural direction, translational linear acceleration is loaded during lateral translational movement and gravitational acceleration is loaded during lateral tilting movement. These two types of acceleration induce eye movements via two kinds of otolith-ocular reflexes to compensate for movement and maintain clear vision: horizontal eye movement during translational movement, and torsional eye movement (torsion) during tilting movement. Although the two types of acceleration cannot be discriminated, the two otolith-ocular reflexes can distinguish them effectively. In the current study, we tested whether lateral-eyed mice exhibit both of these otolith-ocular reflexes. In addition, we propose a new index for assessing the otolith-ocular reflex in mice. During lateral translational movement, mice did not show appropriate horizontal eye movement, but exhibited unnecessary vertical torsion-like eye movement that compensated for the angle between the body axis and gravito-inertial acceleration (GIA; i.e., the sum of gravity and inertial force due to movement) by interpreting GIA as gravity. Using the new index (amplitude of vertical component of eye movement)/(angle between body axis and GIA), the mouse otolith-ocular reflex can be assessed without determining whether the otolith-ocular reflex is induced during translational movement or during tilting movement.

Computational Mechanisms for Perceptual Stability using Disparity and Motion Parallax

Walking and other forms of self-motion create global motion patterns across our eyes. With the resulting stream of visual signals, how do we perceive ourselves as moving through a stable world? Although the neural mechanisms are largely unknown, human studies (Warren and Rushton, 2009) provide strong evidence that the visual system is capable of parsing the global motion into two components: one due to self-motion and the other due to independently moving objects. In the present study, we use computational modeling to investigate potential neural mechanisms for stabilizing visual perception during self-motion that build on neurophysiology of the middle temporal (MT) and medial superior temporal (MST) areas. One such mechanism leverages direction, speed, and disparity tuning of cells in dorsal MST (MSTd) to estimate the combined motion parallax and disparity signals attributed to the observer's self-motion. Feedback from the most active MSTd cell subpopulations suppresses motion signals in MT that locally match the preference of the MSTd cell in both parallax and disparity. This mechanism combined with local surround inhibition in MT allows the model to estimate self-motion while maintaining a sparse motion representation that is compatible with perceptual stability. A key consequence is that after signals compatible with the observer's self-motion are suppressed, the direction of independently moving objects is represented in a world-relative rather than observer-relative reference frame. Our analysis explicates how temporal dynamics and joint motion parallax-disparity tuning resolve the world-relative motion of moving objects and establish perceptual stability. Together, these mechanisms capture findings on the perception of object motion during self-motion.SIGNIFICANCE STATEMENT The image integrated by our eyes as we move through our environment undergoes constant flux as trees, buildings, and other surroundings stream by us. If our view can change so radically from one moment to the next, how do we perceive a stable world? Although progress has been made in understanding how this works, little is known about the underlying brain mechanisms. We propose a computational solution whereby multiple brain areas communicate to suppress the motion attributed to our movement relative to the stationary world, which is often responsible for a large proportion of the flux across the visual field. We simulated the proposed neural mechanisms and tested model estimates using data from human perceptual studies.

Integration of visual and tactile information in reproduction of traveled distance

In the natural world, self-motion always stimulates several different sensory modalities. Here we investigated the interplay between a visual optic flow stimulus simulating self-motion and a tactile stimulus (air flow resulting from self-motion) while human observers were engaged in a distance reproduction task. We found that adding congruent tactile information (i.e., speed of the air flow and speed of visual motion are directly proportional) to the visual information significantly improves the precision of the actively reproduced distances. This improvement, however, was smaller than predicted for an optimal integration of visual and tactile information. In contrast, incongruent tactile information (i.e., speed of the air flow and speed of visual motion are inversely proportional) did not improve subjects' precision indicating that incongruent tactile information and visual information were not integrated. One possible interpretation of the results is a link to properties of neurons in the ventral intraparietal area that have been shown to have spatially and action-congruent receptive fields for visual and tactile stimuli.NEW & NOTEWORTHY This study shows that tactile and visual information can be integrated to improve the estimates of the parameters of self-motion. This, however, happens only if the two sources of information are congruent-as they are in a natural environment. In contrast, an incongruent tactile stimulus is still used as a source of information about self-motion but it is not integrated with visual information.

Distributed Visual–Vestibular Processing in the Cerebral Cortex of Man and Macaque

Recent advances in understanding the neurobiological underpinnings of visual–vestibular interactions underlying self-motion perception are reviewed with an emphasis on comparisons between the macaque and human brains. In both species, several distinct cortical regions have been identified that are active during both visual and vestibular stimulation and in some of these there is clear evidence for sensory integration. Several possible cross-species homologies between cortical regions are identified. A key feature of cortical organization is that the same information is apparently represented in multiple, anatomically diverse cortical regions, suggesting that information about self-motion is used for different purposes in different brain regions.

Transformation of spatiotemporal dynamics in the macaque vestibular system from otolith afferents to cortex

Sensory signals undergo substantial recoding when neural activity is relayed from sensors through pre-thalamic and thalamic nuclei to cortex. To explore how temporal dynamics and directional tuning are sculpted in hierarchical vestibular circuits, we compared responses of macaque otolith afferents with neurons in the vestibular and cerebellar nuclei, as well as five cortical areas, to identical three-dimensional translational motion. We demonstrate a remarkable spatio-temporal transformation: otolith afferents carry spatially aligned cosine-tuned translational acceleration and jerk signals. In contrast, brainstem and cerebellar neurons exhibit non-linear, mixed selectivity for translational velocity, acceleration, jerk and position. Furthermore, these components often show dissimilar spatial tuning. Moderate further transformation of translation signals occurs in the cortex, such that similar spatio-temporal properties are found in multiple cortical areas. These results suggest that the first synapse represents a key processing element in vestibular pathways, robustly shaping how self-motion is represented in central vestibular circuits and cortical areas.

Distributed Representation of Curvilinear Self-Motion in the Macaque Parietal Cortex

Information about translations and rotations of the body is critical for complex self-motion perception during spatial navigation. However, little is known about the nature and function of their convergence in the cortex. We measured neural activity in multiple areas in the macaque parietal cortex in response to three different types of body motion applied through a motion platform: translation, rotation, and combined stimuli, i.e., curvilinear motion. We found a continuous representation of motion types in each area. In contrast to single-modality cells preferring either translation-only or rotation-only stimuli, convergent cells tend to be optimally tuned to curvilinear motion. A weighted summation model captured the data well, suggesting that translation and rotation signals are integrated subadditively in the cortex. Interestingly, variation in the activity of convergent cells parallels behavioral outputs reported in human psychophysical experiments. We conclude that representation of curvilinear self-motion perception is widely distributed in the primate sensory cortex.

Effects of high intensity noise on the vestibular system in rats

Some individuals with noise-induced hearing loss (NIHL) also report balance problems. These accompanying vestibular complaints are not well understood. The present study used a rat model to examine the effects of noise exposure on the vestibular system. Rats were exposed to continuous broadband white noise (0-24 kHz) at an intensity of 116 dB sound pressure level (SPL) via insert ear phones in one ear for three hours under isoflurane anesthesia. Seven days after the exposure, a significant increase in ABR threshold (43.3 ± 1.9 dB) was observed in the noise-exposed ears, indicating hearing loss. Effects of noise exposure on vestibular function were assessed by three approaches. First, fluorescein-conjugated phalloidin staining was used to assess vestibular stereocilia following noise exposure. This analysis revealed substantial sensory stereocilia bundle loss in the saccular and utricular maculae as well as in the anterior and horizontal semicircular canal cristae, but not in the posterior semicircular canal cristae. Second, single unit recording of vestibular afferent activity was performed under pentobarbital anesthesia. A total of 548 afferents were recorded from 10 noise-treated rats and 12 control rats. Noise exposure produced a moderate reduction in baseline firing rates of regular otolith afferents and anterior semicircular canal afferents. Also a moderate change was noted in the gain and phase of the horizontal and anterior semicircular canal afferent's response to sinusoidal head rotation (1 and 2 Hz, 45°/s peak velocity). Third, noise exposure did not result in significant changes in gain or phase of the horizontal rotational and translational vestibulo-ocular reflex (VOR). These results suggest that noise exposure not only causes hearing loss, but also causes substantial damage in the peripheral vestibular system in the absence of immediate clinically measurable vestibular signs. These peripheral deficits, however, may lead to vestibular disorders over time.

Chaos in balance: non-linear measures of postural control predict individual variations in visual illusions of motion

Visually-induced illusions of self-motion (vection) can be compelling for some people, but they are subject to large individual variations in strength. Do these variations depend, at least in part, on the extent to which people rely on vision to maintain their postural stability? We investigated by comparing physical posture measures to subjective vection ratings. Using a Bertec balance plate in a brightly-lit room, we measured 13 participants' excursions of the centre of foot pressure (CoP) over a 60-second period with eyes open and with eyes closed during quiet stance. Subsequently, we collected vection strength ratings for large optic flow displays while seated, using both verbal ratings and online throttle measures. We also collected measures of postural sway (changes in anterior-posterior CoP) in response to the same visual motion stimuli while standing on the plate. The magnitude of standing sway in response to expanding optic flow (in comparison to blank fixation periods) was predictive of both verbal and throttle measures for seated vection. In addition, the ratio between eyes-open and eyes-closed CoP excursions during quiet stance (using the area of postural sway) significantly predicted seated vection for both measures. Interestingly, these relationships were weaker for contracting optic flow displays, though these produced both stronger vection and more sway. Next we used a non-linear analysis (recurrence quantification analysis, RQA) of the fluctuations in anterior-posterior position during quiet stance (both with eyes closed and eyes open); this was a much stronger predictor of seated vection for both expanding and contracting stimuli. Given the complex multisensory integration involved in postural control, our study adds to the growing evidence that non-linear measures drawn from complexity theory may provide a more informative measure of postural sway than the conventional linear measures.

Neural representation of orientation relative to gravity in the macaque cerebellum

A fundamental challenge for maintaining spatial orientation and interacting with the world is knowledge of our orientation relative to gravity, i.e., head tilt. Sensing gravity is complicated because of Einstein's equivalence principle, in which gravitational and translational accelerations are physically indistinguishable. Theory has proposed that this ambiguity is solved by tracking head tilt through multisensory integration. Here we identify a group of Purkinje cells in the caudal cerebellar vermis with responses that reflect an estimate of head tilt. These tilt-selective cells are complementary to translation-selective Purkinje cells, such that their population activities sum to the net gravitoinertial acceleration encoded by the otolith organs, as predicted by theory. These findings reflect the remarkable ability of the cerebellum for neural computation and provide quantitative evidence for a neural representation of gravity, whose calculation relies on long-postulated theoretical concepts such as internal models and Bayesian priors.

Spatiotemporal properties of optic flow and vestibular tuning in the cerebellar nodulus and uvula

Convergence of visual motion and vestibular information is essential for accurate spatial navigation. Such multisensory integration has been shown in cortex, e.g., the dorsal medial superior temporal (MSTd) and ventral intraparietal (VIP) areas, but not in the parieto-insular vestibular cortex (PIVC). Whether similar convergence occurs subcortically remains unknown. Many Purkinje cells in vermal lobules 10 (nodulus) and 9 (uvula) of the macaque cerebellum are tuned to vestibular translation stimuli, yet little is known about their visual motion responsiveness. Here we show the existence of translational optic flow-tuned Purkinje cells, found exclusively in the anterior part of the nodulus and ventral uvula, near the midline. Vestibular responses of Purkinje cells showed a remarkable similarity to those in MSTd (but not PIVC or VIP) neurons, in terms of both response latency and relative contributions of velocity, acceleration, and position components. In contrast, the spatiotemporal properties of optic flow responses differed from those in MSTd, and matched the vestibular properties of these neurons. Compared with MSTd, optic flow responses of Purkinje cells showed smaller velocity contributions and larger visual motion acceleration responses. The remarkable similarity between the nodulus/uvula and MSTd vestibular translation responsiveness suggests a functional coupling between the two areas for vestibular processing of self-motion information.

Computation of linear acceleration through an internal model in the macaque cerebellum

A combination of theory and behavioral findings has supported a role for internal models in the resolution of sensory ambiguities and sensorimotor processing. Although the cerebellum has been proposed as a candidate for implementation of internal models, concrete evidence from neural responses is lacking. Here we exploit un-natural motion stimuli, which induce incorrect self-motion perception and eye movements, to explore the neural correlates of an internal model proposed to compensate for Einstein’s equivalence principle and generate neural estimates of linear acceleration and gravity. We show that caudal cerebellar vermis Purkinje cells and cerebellar nuclei neurons selective for actual linear acceleration also encode erroneous linear acceleration, as expected from the internal model hypothesis, even when no actual linear acceleration occurs. These findings provide strong evidence that the cerebellum might be involved in the implementation of internal models that mimic physical principles to interpret sensory signals, as previously hypothesized by theorists.

Cognitive processes involved in smooth pursuit eye movements: behavioral evidence, neural substrate and clinical correlation

Smooth-pursuit eye movements allow primates to track moving objects. Efficient pursuit requires appropriate target selection and predictive compensation for inherent processing delays. Prediction depends on expectation of future object motion, storage of motion information and use of extra-retinal mechanisms in addition to visual feedback. We present behavioral evidence of how cognitive processes are involved in predictive pursuit in normal humans and then describe neuronal responses in monkeys and behavioral responses in patients using a new technique to test these cognitive controls. The new technique examines the neural substrate of working memory and movement preparation for predictive pursuit by using a memory-based task in macaque monkeys trained to pursue (go) or not pursue (no-go) according to a go/no-go cue, in a direction based on memory of a previously presented visual motion display. Single-unit task-related neuronal activity was examined in medial superior temporal cortex (MST), supplementary eye fields (SEF), caudal frontal eye fields (FEF), cerebellar dorsal vermis lobules VI–VII, caudal fastigial nuclei (cFN), and floccular region. Neuronal activity reflecting working memory of visual motion direction and go/no-go selection was found predominantly in SEF, cerebellar dorsal vermis and cFN, whereas movement preparation related signals were found predominantly in caudal FEF and the same cerebellar areas. Chemical inactivation produced effects consistent with differences in signals represented in each area. When applied to patients with Parkinson's disease (PD), the task revealed deficits in movement preparation but not working memory. In contrast, patients with frontal cortical or cerebellar dysfunction had high error rates, suggesting impaired working memory. We show how neuronal activity may be explained by models of retinal and extra-retinal interaction in target selection and predictive control and thus aid understanding of underlying pathophysiology.

Choice-related activity and correlated noise in subcortical vestibular neurons

Functional links between neuronal activity and perception are studied by examining trial-by-trial correlations (choice probabilities) between neural responses and perceptual decisions. We addressed fundamental issues regarding the nature and origin of choice probabilities by recording from subcortical (brainstem and cerebellar) neurons in rhesus monkeys during a vestibular heading discrimination task. Subcortical neurons showed robust choice probabilities that exceeded those seen in cortex (area MSTd) under identical conditions. The greater choice probabilities of subcortical neurons could be predicted by a stronger dependence of correlated noise on tuning similarity, as revealed by population decoding. Significant choice probabilities were observed almost exclusively for neurons that responded selectively to translation, whereas neurons that represent net gravito-inertial acceleration did not show choice probabilities. These findings suggest that the emergence of choice probabilities in the vestibular system depends on a critical signal transformation that occurs in subcortical pathways to distinguish translation from orientation relative to gravity.

Dynamic visuomotor transformation involved with remote flying of a plane utilizes the 'Mirror Neuron' system

Brain regions involved with processing dynamic visuomotor representational transformation are investigated using fMRI. The perceptual-motor task involved flying (or observing) a plane through a simulated Red Bull Air Race course in first person and third person chase perspective. The third person perspective is akin to remote operation of a vehicle. The ability for humans to remotely operate vehicles likely has its roots in neural processes related to imitation in which visuomotor transformation is necessary to interpret the action goals in an egocentric manner suitable for execution. In this experiment for 3^rd person perspective the visuomotor transformation is dynamically changing in accordance to the orientation of the plane. It was predicted that 3^rd person remote flying, over 1^st, would utilize brain regions composing the ‘Mirror Neuron’ system that is thought to be intimately involved with imitation for both execution and observation tasks. Consistent with this prediction differential brain activity was present for 3^rd person over 1^st person perspectives for both execution and observation tasks in left ventral premotor cortex, right dorsal premotor cortex, and inferior parietal lobule bilaterally (Mirror Neuron System) (Behaviorally: 1^st>3^rd). These regions additionally showed greater activity for flying (execution) over watching (observation) conditions. Even though visual and motor aspects of the tasks were controlled for, differential activity was also found in brain regions involved with tool use, motion perception, and body perspective including left cerebellum, temporo-occipital regions, lateral occipital cortex, medial temporal region, and extrastriate body area. This experiment successfully demonstrates that a complex perceptual motor real-world task can be utilized to investigate visuomotor processing. This approach (Aviation Cerebral Experimental Sciences ACES) focusing on direct application to lab and field is in contrast to standard methodology in which tasks and conditions are reduced to their simplest forms that are remote from daily life experience.

Vestibular-related frontal cortical areas and their roles in smooth-pursuit eye movements: representation of neck velocity, neck-vestibular interactions, and memory-based smooth-pursuit

Smooth-pursuit eye movements are voluntary responses to small slow-moving objects in the fronto-parallel plane. They evolved in primates, who possess high-acuity foveae, to ensure clear vision about the moving target. The primate frontal cortex contains two smooth-pursuit related areas; the caudal part of the frontal eye fields (FEF) and the supplementary eye fields (SEF). Both areas receive vestibular inputs. We review functional differences between the two areas in smooth-pursuit. Most FEF pursuit neurons signal pursuit parameters such as eye velocity and gaze-velocity, and are involved in canceling the vestibulo-ocular reflex by linear addition of vestibular and smooth-pursuit responses. In contrast, gaze-velocity signals are rarely represented in the SEF. Most FEF pursuit neurons receive neck velocity inputs, while discharge modulation during pursuit and trunk-on-head rotation adds linearly. Linear addition also occurs between neck velocity responses and vestibular responses during head-on-trunk rotation in a task-dependent manner. During cross-axis pursuit-vestibular interactions, vestibular signals effectively initiate predictive pursuit eye movements. Most FEF pursuit neurons discharge during the interaction training after the onset of pursuit eye velocity, making their involvement unlikely in the initial stages of generating predictive pursuit. Comparison of representative signals in the two areas and the results of chemical inactivation during a memory-based smooth-pursuit task indicate they have different roles; the SEF plans smooth-pursuit including working memory of motion-direction, whereas the caudal FEF generates motor commands for pursuit eye movements. Patients with idiopathic Parkinson's disease were asked to perform this task, since impaired smooth-pursuit and visual working memory deficit during cognitive tasks have been reported in most patients. Preliminary results suggested specific roles of the basal ganglia in memory-based smooth-pursuit.

Representation of vestibular and visual cues to self-motion in ventral intraparietal cortex

Convergence of vestibular and visual motion information is important for self-motion perception. One cortical area that combines vestibular and optic flow signals is the ventral intraparietal area (VIP). We characterized unisensory and multisensory responses of macaque VIP neurons to translations and rotations in three dimensions. Approximately one-half of VIP cells show significant directional selectivity in response to optic flow, one-half show tuning to vestibular stimuli, and one-third show multisensory responses. Visual and vestibular direction preferences of multisensory VIP neurons could be congruent or opposite. When visual and vestibular stimuli were combined, VIP responses could be dominated by either input, unlike the medial superior temporal area (MSTd) where optic flow tuning typically dominates or the visual posterior sylvian area (VPS) where vestibular tuning dominates. Optic flow selectivity in VIP was weaker than in MSTd but stronger than in VPS. In contrast, vestibular tuning for translation was strongest in VPS, intermediate in VIP, and weakest in MSTd. To characterize response dynamics, direction-time data were fit with a spatiotemporal model in which temporal responses were modeled as weighted sums of velocity, acceleration, and position components. Vestibular responses in VIP reflected balanced contributions of velocity and acceleration, whereas visual responses were dominated by velocity. Timing of vestibular responses in VIP was significantly faster than in MSTd, whereas timing of optic flow responses did not differ significantly among areas. These findings suggest that VIP may be proximal to MSTd in terms of vestibular processing but hierarchically similar to MSTd in terms of optic flow processing.

Neuronal activity in medial superior temporal area (MST) during memory-based smooth pursuit eye movements in monkeys

We examined recently neuronal substrates for predictive pursuit using a memory-based smooth pursuit task that distinguishes the discharge related to memory of visual motion-direction from that related to movement preparation. We found that the supplementary eye fields (SEF) contain separate signals coding memory and assessment of visual motion-direction, decision not-to-pursue, and preparation for pursuit. Since medial superior temporal area (MST) is essential for visual motion processing and projects to SEF, we examined whether MST carried similar signals. We analyzed the discharge of 108 MSTd neurons responding to visual motion stimuli. The majority (69/108 = 64%) were also modulated during smooth pursuit. However, in nearly all (104/108 = 96%) of the MSTd neurons tested, there was no significant discharge modulation during the delay periods that required memory of visual motion-direction or preparation for smooth pursuit or not-to-pursue. Only 4 neurons of the 108 (4%) exhibited significantly higher discharge rates during the delay periods; however, their responses were non-directional and not instruction specific. Representative signals in the MSTd clearly differed from those in the SEF during memory-based smooth pursuit. MSTd neurons are unlikely to provide signals for memory of visual motion-direction or preparation for smooth pursuit eye movements.

A comparison of vestibular spatiotemporal tuning in macaque parietoinsular vestibular cortex, ventral intraparietal area, and medial superior temporal area

Vestibular responses have been reported in the parietoinsular vestibular cortex (PIVC), the ventral intraparietal area (VIP), and the dorsal medial superior temporal area (MSTd) of macaques. However, differences between areas remain largely unknown, and it is not clear whether there is a hierarchy in cortical vestibular processing. We examine the spatiotemporal characteristics of macaque vestibular responses to translational motion stimuli using both empirical and model-based analyses. Temporal dynamics of direction selectivity were similar across areas, although there was a gradual shift in the time of peak directional tuning, with responses in MSTd typically being delayed by 100-150 ms relative to responses in PIVC (VIP was intermediate). Responses as a function of both stimulus direction and time were fit with a spatiotemporal model consisting of separable spatial and temporal response profiles. Temporal responses were characterized by a Gaussian function of velocity, a weighted sum of velocity and acceleration, or a weighted sum of velocity, acceleration, and position. Velocity and acceleration components contributed most to response dynamics, with a gradual shift from acceleration dominance in PIVC to velocity dominance in MSTd. The position component contributed little to temporal responses overall, but was substantially larger in MSTd than PIVC or VIP. The overall temporal delay in model fits also increased substantially from PIVC to VIP to MSTd. This gradual transformation of temporal responses suggests a hierarchy in cortical vestibular processing, with PIVC being most proximal to the vestibular periphery and MSTd being most distal.

Neuronal activity in the caudal frontal eye fields of monkeys during memory-based smooth pursuit eye movements: comparison with the supplementary eye fields

Recently, we examined the neuronal substrate of predictive pursuit during memory-based smooth pursuit and found that supplementary eye fields (SEFs) contain signals coding assessment and memory of visual motion direction, decision not-to-pursue ("no-go"), and preparation for pursuit. To determine whether these signals were unique to the SEF, we examined the discharge of 185 task-related neurons in the caudal frontal eye fields (FEFs) in 2 macaques. Visual motion memory and no-go signals were also present in the caudal FEF but compared with those in the SEF, the percentage of neurons coding these signals was significantly lower. In particular, unlike SEF neurons, directional visual motion responses of caudal FEF neurons decayed exponentially. In contrast, the percentage of neurons coding directional pursuit eye movements was significantly higher in the caudal FEF than in the SEF. Unlike SEF inactivation, muscimol injection into the caudal FEF did not induce direction errors or no-go errors but decreased eye velocity during pursuit causing an inability to compensate for the response delays during sinusoidal pursuit. These results indicate significant differences between the 2 regions in the signals represented and in the effects of chemical inactivation suggesting that the caudal FEF is primarily involved in generating motor commands for smooth-pursuit eye movements.

Spatiotemporal properties of vestibular responses in area MSTd

Recent studies have shown that many neurons in the primate dorsal medial superior temporal area (MSTd) show spatial tuning during inertial motion and that these responses are vestibular in origin. Given their well-studied role in processing visual self-motion cues (i.e., optic flow), these neurons may be involved in the integration of visual and vestibular signals to facilitate robust perception of self-motion. However, the temporal structure of vestibular responses in MSTd has not been characterized in detail. Specifically, it is not known whether MSTd neurons encode velocity, acceleration, or some combination of motion parameters not explicitly encoded by vestibular afferents. In this study, we have applied a frequency-domain analysis to single-unit responses during translation in three dimensions (3D). The analysis quantifies the stimulus-driven temporal modulation of each response as well as the degree to which this modulation reflects the velocity and/or acceleration profile of the stimulus. We show that MSTd neurons signal a combination of velocity and acceleration components with the velocity component being stronger for most neurons. These two components can exist both within and across motion directions, although their spatial tuning did not show a systematic relationship across the population. From these results, vestibular responses in MSTd appear to show characteristic features of spatiotemporal convergence, similar to previous findings in the brain stem and thalamus. The predominance of velocity encoding in this region may reflect the suitability of these signals to be integrated with visual signals regarding self-motion perception.

Computation of egomotion in the macaque cerebellar vermis

The nodulus and uvula (lobules X and IX of the vermis) receive mossy fibers from both vestibular afferents and vestibular nuclei neurons and are thought to play a role in spatial orientation. Their properties relate to a sensory ambiguity of the vestibular periphery: otolith afferents respond identically to translational (inertial) accelerations and changes in orientation relative to gravity. Based on theoretical and behavioral evidence, this sensory ambiguity is resolved using rotational cues from the semicircular canals. Recordings from the cerebellar cortex have identified a neural correlate of the brain's ability to resolve this ambiguity in the simple spike activities of nodulus/uvula Purkinje cells. This computation, which likely involves the cerebellar circuitry and its reciprocal connections with the vestibular nuclei, results from a remarkable convergence of spatially- and temporally-aligned otolith-driven and semicircular canal-driven signals. Such convergence requires a spatio-temporal transformation of head-centered canal-driven signals into an estimate of head reorientation relative to gravity. This signal must then be subtracted from the otolith-driven estimate of net acceleration to compute inertial motion. At present, Purkinje cells in the nodulus/uvula appear to encode the output of this computation. However, how the required spatio-temporal matching takes place within the cerebellar circuitry and what role complex spikes play in spatial orientation and disorientation remains unknown. In addition, the role of visual cues in driving and/or modifying simple and complex spike activity, a process potentially critical for long-term adaptation, constitutes another important direction for future studies.

Response dynamics and tilt versus translation discrimination in parietoinsular vestibular cortex

The parietoinsular vestibular cortex (PIVC) is a large area in the lateral sulcus with neurons that respond to vestibular stimulation. Here we compare the properties of PIVC cells with those of neurons in brain stem, cerebellum, and thalamus. Most PIVC cells modulated during both translational and rotational head motion. Translation acceleration gains showed a modest decrease as stimulus frequency increased, with a steeper slope than that reported previously for thalamic and cerebellar nuclei neurons. Response dynamics during yaw rotation were similar to those reported for vestibular neurons in brain stem and thalamus: velocity gains were relatively flat through the mid-frequency range, increased at high frequencies, and decreased at low frequencies. Tilt dynamics were more variable: PIVC neurons responsive only to rotation had gains that decreased with increased frequency, whereas neurons responsive during both translation and rotation (convergent neurons) actually increased their modulation magnitude at high frequencies. Using combinations of translation and tilt, most PIVC neurons were better correlated with translational motion; only 14% were better correlated with net acceleration. Thus, although yaw rotation responses in PIVC appear little processed compared with other central vestibular neurons, translation and tilt responses suggest a further processing of linear acceleration signals in thalamocortical circuits.

Relationship between complex and simple spike activity in macaque caudal vermis during three-dimensional vestibular stimulation

Lobules 10 and 9 in the caudal posterior vermis [also known as nodulus and uvula (NU)] are thought important for spatial orientation and balance. Here, we characterize complex spike (CS) and simple spike (SS) activity in response to three-dimensional vestibular stimulation. The strongest modulation was seen during translation (CS: 12.8 +/- 1.5, SS: 287.0 +/- 23.2 spikes/s/G, 0.5 Hz). Preferred directions tended to cluster along the cardinal axes (lateral, fore-aft, vertical) for CSs and along the semicircular canal axes for SSs. Most notably, the preferred directions for CS/SS pairs arising from the same Purkinje cells were rarely aligned. During 0.5 Hz pitch/roll tilt, only about a third of CSs had significant modulation. Thus, most CSs correlated best with inertial rather than net linear acceleration. By comparison, all SSs were selective for translation and ignored changes in spatial orientation relative to gravity. Like SSs, tilt modulation of CSs increased at lower frequencies. CSs and SSs had similar response dynamics, responding to linear velocity during translation and angular position during tilt. The most salient finding is that CSs did not always modulate out-of-phase with SSs. The CS/SS phase difference varied broadly among Purkinje cells, yet for each cell it was precisely matched for the otolith-driven and canal-driven components of the response. These findings illustrate a spatiotemporal mismatch between CS/SS pairs and provide the first comprehensive description of the macaque NU, an important step toward understanding how CSs and SSs interact during complex movements and spatial disorientation.

Canal-otolith interactions and detection thresholds of linear and angular components during curved-path self-motion

Gravitational signals arising from the otolith organs and vertical plane rotational signals arising from the semicircular canals interact extensively for accurate estimation of tilt and inertial acceleration. Here we used a classical signal detection paradigm to examine perceptual interactions between otolith and horizontal semicircular canal signals during simultaneous rotation and translation on a curved path. In a rotation detection experiment, blindfolded subjects were asked to detect the presence of angular motion in blocks where half of the trials were pure nasooccipital translation and half were simultaneous translation and yaw rotation (curved-path motion). In separate, translation detection experiments, subjects were also asked to detect either the presence or the absence of nasooccipital linear motion in blocks, in which half of the trials were pure yaw rotation and half were curved path. Rotation thresholds increased slightly, but not significantly, with concurrent linear velocity magnitude. Yaw rotation detection threshold, averaged across all conditions, was 1.45 +/- 0.81 degrees/s (3.49 +/- 1.95 degrees/s(2)). Translation thresholds, on the other hand, increased significantly with increasing magnitude of concurrent angular velocity. Absolute nasooccipital translation detection threshold, averaged across all conditions, was 2.93 +/- 2.10 cm/s (7.07 +/- 5.05 cm/s(2)). These findings suggest that conscious perception might not have independent access to separate estimates of linear and angular movement parameters during curved-path motion. Estimates of linear (and perhaps angular) components might instead rely on integrated information from canals and otoliths. Such interaction may underlie previously reported perceptual errors during curved-path motion and may originate from mechanisms that are specialized for tilt-translation processing during vertical plane rotation.

Visual-vestibular cue integration for heading perception: applications of optimal cue integration theory

The perception of self-motion is crucial for navigation, spatial orientation and motor control. In particular, estimation of one's direction of translation, or heading, relies heavily on multisensory integration in most natural situations. Visual and nonvisual (e.g., vestibular) information can be used to judge heading, but each modality alone is often insufficient for accurate performance. It is not surprising, then, that visual and vestibular signals converge frequently in the nervous system, and that these signals interact in powerful ways at the level of behavior and perception. Early behavioral studies of visual-vestibular interactions consisted mainly of descriptive accounts of perceptual illusions and qualitative estimation tasks, often with conflicting results. In contrast, cue integration research in other modalities has benefited from the application of rigorous psychophysical techniques, guided by normative models that rest on the foundation of ideal-observer analysis and Bayesian decision theory. Here we review recent experiments that have attempted to harness these so-called optimal cue integration models for the study of self-motion perception. Some of these studies used nonhuman primate subjects, enabling direct comparisons between behavioral performance and simultaneously recorded neuronal activity. The results indicate that humans and monkeys can integrate visual and vestibular heading cues in a manner consistent with optimal integration theory, and that single neurons in the dorsal medial superior temporal area show striking correlates of the behavioral effects. This line of research and other applications of normative cue combination models should continue to shed light on mechanisms of self-motion perception and the neuronal basis of multisensory integration.

Activity of pursuit-related neurons in medial superior temporal area (MST) during static roll-tilt

Recent studies have shown that rhesus macaques can perceive visual motion direction in earth-centered coordinates as accurately as humans. We tested whether coordinate frames representing smooth pursuit and/or visual motion signals in medial superior temporal area (MST) are earth centered to better understand its role in coordinating smooth pursuit. In 2 Japanese macaques, we compared preferred directions (re monkeys' head–trunk axis) of pursuit and/or visual motion responses of MSTd neurons while upright and during static whole-body roll-tilt. In the majority (41/51 = 80%) of neurons tested, preferred directions of pursuit and/or visual motion responses were not significantly different while upright and during 40° static roll-tilt. Preferred directions of the remaining 20% of neurons (n = 10) were shifted beyond the range expected from ocular counter-rolling; the maximum shift was 14°, and the mean shift was 12°. These shifts, however, were still less than half of the expected shift if MST signals are coded in the earth-centered coordinates. Virtually, all tested neurons (44/46 = 96%) failed to exhibit a significant difference between resting discharge rate while upright and during static roll-tilt while fixating a stationary spot. These results suggest that smooth pursuit and/or visual motion signals of MST neurons are not coded in the earth-centered coordinates; our results favor the head- and/or trunk-centered coordinates.

Self versus environment motion in postural control

To stabilize our position in space we use visual information as well as non-visual physical motion cues. However, visual cues can be ambiguous: visually perceived motion may be caused by self-movement, movement of the environment, or both. The nervous system must combine the ambiguous visual cues with noisy physical motion cues to resolve this ambiguity and control our body posture. Here we have developed a Bayesian model that formalizes how the nervous system could solve this problem. In this model, the nervous system combines the sensory cues to estimate the movement of the body. We analytically demonstrate that, as long as visual stimulation is fast in comparison to the uncertainty in our perception of body movement, the optimal strategy is to weight visually perceived movement velocities proportional to a power law. We find that this model accounts for the nonlinear influence of experimentally induced visual motion on human postural behavior both in our data and in previously published results.

Visual cues typically provide ambiguous information about the orientation of our body in space. When we perceive relative motion between ourselves and the environment, it could have been caused by our movement within the environment, or the movement of the environment around us, or the simultaneous movements of both our body and the environment. The nervous system must resolve this ambiguity for efficient control of our body posture during stance. Here, we show that the nervous system could solve this problem by optimally combining visual signals with physical motion cues. Sensory ambiguity is a central problem during cue combination. Our results thus have implications on how the nervous system could resolve sensory ambiguity in other cue combination tasks.

Does the middle temporal area carry vestibular signals related to self-motion?

Recent studies have described vestibular responses in the dorsal medial superior temporal area (MSTd), a region of extrastriate visual cortex thought to be involved in self-motion perception. The pathways by which vestibular signals are conveyed to area MSTd are currently unclear, and one possibility is that vestibular signals are already present in areas that are known to provide visual inputs to MSTd. Thus, we examined whether selective vestibular responses are exhibited by single neurons in the middle temporal area (MT), a visual motion-sensitive region that projects heavily to area MSTd. We compared responses in MT and MSTd to three-dimensional rotational and translational stimuli that were either presented using a motion platform (vestibular condition) or simulated using optic flow (visual condition). When monkeys fixated a visual target generated by a projector, half of MT cells (and most MSTd neurons) showed significant tuning during the vestibular rotation condition. However, when the fixation target was generated by a laser in a dark room, most MT neurons lost their vestibular tuning whereas most MSTd neurons retained their selectivity. Similar results were obtained for free viewing in darkness. Our findings indicate that MT neurons do not show genuine vestibular responses to self-motion; rather, their tuning in the vestibular rotation condition can be explained by retinal slip due to a residual vestibulo-ocular reflex. Thus, the robust vestibular signals observed in area MSTd do not arise through inputs from area MT.