Head tilt-translation combinations distinguished at the level of neurons

Using virtual reality to augment perception, enhance sensorimotor adaptation, and change our minds

Technological advances that involve human sensorimotor processes can have both intended and unintended effects on the central nervous system (CNS). This mini review focuses on the use of virtual environments (VE) to augment brain functions by enhancing perception, eliciting automatic motor behavior, and inducing sensorimotor adaptation. VE technology is becoming increasingly prevalent in medical rehabilitation, training simulators, gaming, and entertainment. Although these VE applications have often been shown to optimize outcomes, whether it be to speed recovery, reduce training time, or enhance immersion and enjoyment, there are inherent drawbacks to environments that can potentially change sensorimotor calibration. Across numerous VE studies over the years, we have investigated the effects of combining visual and physical motion on perception, motor control, and adaptation. Recent results from our research involving exposure to dynamic passive motion within a visually-depicted VE reveal that short-term exposure to augmented sensorimotor discordance can result in systematic aftereffects that last beyond the exposure period. Whether these adaptations are advantageous or not, remains to be seen. Benefits as well as risks of using VE-driven sensorimotor stimulation to enhance brain processes will be discussed.

Head stabilization shows visual and inertial dependence during passive stimulation: implications for virtual rehabilitation

Sensorimotor coordination relies on the fine calibration and integration of visual, vestibular, and somatosensory input. Using virtual environments (VE) allows for the dissociation of visual and inertial inputs to manipulate human behavioral outputs. Our goal was to employ VE technology in a novel manner to investigate how head stabilization is affected by spatiotemporal properties of dynamic visual input when combined with passive motion on a linear sled. Healthy adults (n = 12) wore a head-mounted display during naso-occipital sinusoidal horizontal whole body translations while seated. Subjects were secured in a seat with a five-point harness, with the head free to move. Frequency and amplitude of sinusoidal input (i.e., inertial conditions) were set to create overlapping conditions of maximum acceleration (amax) or velocity (vmax). Four inertial conditions were combined with four visual conditions (VIS). VIS were created so that direction of optic flow either matched direction of passive motion or did not. The effect of near and far fixation distance within the VE was also tested. Head kinematics were collected with a three-axis gyro. Head stability showed a complex interaction dependent on changes in weighting of visual and inertial inputs that changed with the sled driving frequency. Inertial condition affected amplitude (p < 0.0000) and phase (p < 0.0000) of head pitch angular velocity. In the absence of visual input, head pitch velocity amplitude increased (p < 0.01). An interaction effect between inertial and VIS conditions on head yaw occurred in SW (p < 0.05). There was also a significant interaction of depth of field and inertial condition on amplitude (p < 0.001) and phase (p < 0.05) of head yaw velocity in SW, especially during high vmax conditions. We conclude visual flow can organize lateral cervical responses despite being discordant with inertial input. When using VE for rehabilitation, possible unintended, involuntary or reflexive motor responses that may not be present in traditional training environments should be taken into consideration.

Sensory conflict compared in microgravity, artificial gravity, motion sickness, and vestibular disorders

Perceptual disturbances and motion sickness are often attributed to sensory conflict. We investigated several conditions: head movements in microgravity, periodic motions in 1-g, and locomotion with vestibular disorders. In every case, linear vectors such as linear and gravitational acceleration are crucial factors, as previously found for head movements in artificial gravity, and thus the importance of measuring linear vectors emerges as a common theme. By modeling the sensory conflict between the vestibular and somatosensory systems, we computed a measure of linear conflict known as the "Stretch Factor". We hypothesized that the motions with the greatest Stretch Factor would be the most provocative motions.

RESULTS

For head movements in microgravity, the Stretch Factor can explain why fast movements are more provocative than slow movements, and why pitch movements are more provocative than yaw movements. For off-vertical-axis rotation (OVAR) in 1-g, the Stretch Factor predicts that the most provocative frequency is higher than that for vertical linear oscillation (VLO). For example, the same sensor dynamics can predict a most provocative frequency around 0.2 Hz for VLO but 0.3 Hz for OVAR, solving a mystery of this experimentally observed discrepancy. Finally, we determined that certain sensory conflict perceptions reported by vestibular patients could be explained via mathematical simulation.

Phase-linking and the perceived motion during off-vertical axis rotation

Human off-vertical axis rotation (OVAR) in the dark typically produces perceived motion about a cone, the amplitude of which changes as a function of frequency. This perception is commonly attributed to the fact that both the OVAR and the conical motion have a gravity vector that rotates about the subject. Little-known, however, is that this rotating-gravity explanation for perceived conical motion is inconsistent with basic observations about self-motion perception: (a) that the perceived vertical moves toward alignment with the gravito-inertial acceleration (GIA) and (b) that perceived translation arises from perceived linear acceleration, as derived from the portion of the GIA not associated with gravity. Mathematically proved in this article is the fact that during OVAR these properties imply mismatched phase of perceived tilt and translation, in contrast to the common perception of matched phases which correspond to conical motion with pivot at the bottom. This result demonstrates that an additional perceptual rule is required to explain perception in OVAR. This study investigates, both analytically and computationally, the phase relationship between tilt and translation at different stimulus rates-slow (45 degrees /s) and fast (180 degrees /s), and the three-dimensional shape of predicted perceived motion, under different sets of hypotheses about self-motion perception. We propose that for human motion perception, there is a phase-linking of tilt and translation movements to construct a perception of one's overall motion path. Alternative hypotheses to achieve the phase match were tested with three-dimensional computational models, comparing the output with published experimental reports. The best fit with experimental data was the hypothesis that the phase of perceived translation was linked to perceived tilt, while the perceived tilt was determined by the GIA. This hypothesis successfully predicted the bottom-pivot cone commonly reported and a reduced sense of tilt during fast OVAR. Similar considerations apply to the hilltop illusion often reported during horizontal linear oscillation. Known response properties of central neurons are consistent with this ability to phase-link translation with tilt. In addition, the competing "standard" model was mathematically proved to be unable to predict the bottom-pivot cone regardless of the values used for parameters in the model.

Compensatory manual motor responses while object wielding during combined linear visual and physical roll tilt stimulation

Dynamic signals from multiple sensory channels must be integrated by the central nervous system to create a unified perception of self-motion and spatial orientation. Using immersive virtual environments, we altered the relative contribution of visual and inertial inputs and evaluated the effects on perceptuomotor outputs. Subjects seated in a tilting chair were exposed to a combined 0.25 Hz sinusoidal roll-tilt (+/-7.5 degrees) about the naso-occipital axis while viewing one of four visual conditions. One visual condition was in darkness, and the other three depicted 2 m of sinusoidal horizontal or vertical linear motion either synchronous or asynchronous with the roll-tilt. Subjects performed a perceptuomotor task of aligning a handheld object to gravitational vertical (GV) with the entire arm being free to move in six degrees of freedom. Subjects were tested with two objects, a joystick and glass of water, in counter-balanced order. Specific visual effects were as follows: (1) the phase leads of object tilt relative to chair/subject roll-tilt were affected by visual condition, (2) horizontal translation of the object was entrained with visual velocity, rather than with visual acceleration or maximum roll-tilt, and (3) when vertical visual motion was viewed during chair/subject roll-tilt, vertical object translation increased. Although the head-fixed scene meant visual vertical cues were always aligned with the subject's median sagittal plane, object tilt showed sensitivity to inertial roll-tilt (Gain > 0.5) which was not significantly different from the dark condition. Two object effects were found: (1) tilt deviation from GV was greater when wielding a joystick compared to a full glass of water, and (2) the phase of horizontal visual motion relative to subject roll tilt affected the joystick amplitude of horizontal translation but not the glass of water. In conclusion, an attentional shift driven by postural assumptions can account for the two object effects, however, the visual effects suggest that a process for deriving the net gravitoinertial force from visual and inertial cues is involved. Inertial signals dominated the perception of verticality, but visual linear translation affected the spatiotemporal dynamics of the manual motor responses during object wielding.

Coordinate transformations and sensory integration in the detection of spatial orientation and self-motion: from models to experiments

An accurate internal representation of our current motion and orientation in space is critical to navigate in the world and execute appropriate action. The force of gravity provides an allocentric frame of reference that defines one's motion relative to inertial (i.e., world-centered) space. However, movement in this environment also introduces particular motion detection problems as our internal linear accelerometers, the otolith organs, respond identically to either translational motion or changes in head orientation relative to gravity. According to physical principles, there exists an ideal solution to the problem of distinguishing between the two as long as the brain also has access to accurate internal estimates of angular velocity. Here, we illustrate how a nonlinear integrative neural network that receives sensory signals from the vestibular organs could be used to implement the required computations for inertial motion detection. The model predicts several distinct cell populations that are comparable with experimentally identified cell types and accounts for a number of previously unexplained characteristics of their responses. A key model prediction is the existence of cell populations that transform head-referenced rotational signals from the semicircular canals into spatially referenced estimates of head reorientation relative to gravity. This chapter provides an overview of how addressing the problem of inertial motion estimation from a computational standpoint has contributed to identifying the actual neuronal populations responsible for solving the tilt-translation ambiguity and has facilitated the interpretation of neural response properties.