Interaction between reference frames during subjective vertical estimates in a tilted immersive virtual environment

Rod and frame test parameters for neuropsychology studies

BACKGROUND

The rod and frame test (RFT), a measure of field dependence-independence, recently has reemerged as a measure of research interest and potential diagnostic value in neuropsychology. In the standard RFT, the subject experiences offsetting visual cues from a frame surrounding an embedded rod, while the subject's postural/vestibular cues provide the sense of verticality as the subject attempts to set the rod to vertical. The paper shows that RFTs not adhering to RFT parameters can reduce the test's visual framework impact experienced by the subject. Comparisons of neuropsychological studies will highlight that correct adherence to RFT testing conditions can strengthen RFT effects.

METHOD

This review presents the parameters that have been studied which impact on subject performance on the RFT. It identifies how computer administered RFTs have been applied to enhance the study of the RFT parameters and make the RFT more accessible to the study of different diagnostic groups. The article also critiques studies by identifying how the RFT's parameters, study's design and statistical analysis may have diminished identifying the full effects of the RFT experience.

RESULTS

Parameters impacting judgments of verticality of the rod can include: perceived size of rod and frame, the gap between the ends of the rod and surrounding frame, presentation of the rod within an encompassing 3D visual framework that visually blocks out the surrounding environment, a dark room, instructions stressing egocentric vs allocentric strategies, double frame surrounding the rod to assess global perception effects, etc. Details are presented how gap size likely affected results in neuropsychology studies. Potentially, these and other experiments may be studied using computer administered RFTs.

CONCLUSIONS

Based on the descriptions of computer administered RFTs, this article suggested that incorporating these technologies can provide better understanding underlying the RFT, and in turn, understanding neuropsychology processes.

How about running on Mars? Influence of sensorimotor coherence on running and spatial perception in simulated reduced gravity

Motor control, including locomotion, strongly depends on the gravitational field. Recent developments such as lower-body positive pressure treadmills (LBPPT) have enabled studies on Earth about the effects of reduced body weight (BW) on walking and running, up to 60% BW. The present experiment was set up to further investigate adaptations to a more naturalistic simulated hypogravity, mimicking a Martian environment with additional visual information during running sessions on LBPPT. Twenty-nine participants performed three sessions of four successive five-min runs at preferred speed, alternating Earth- or simulated Mars-like gravity (100% vs. 38% BW). They were displayed visual scenes using a virtual reality headset to assess the effects of coherent visual flow while running. Running performance was characterized by normal ground reaction force and pelvic accelerations. The perceived upright and vection (visually-induced self-motion sensation)in dynamic visual environments were also investigated at the end of the different sessions. We found that BW reduction induced biomechanical adaptations independently of the visual context. Active peak force and stance time decreased, while flight time increased. Strong inter-individual differences in braking and push-off times appeared at 38% BW, which were not systematically observed in our previous studies at 80% and 60% BW. Additionally, the importance given to dynamic visual cues in the perceived upright diminished at 38% BW, suggesting an increased reliance on the egocentric body axis as a reference for verticality when the visual context is fully coherent with the previous locomotor activity. Also, while vection was found to decrease in case of a coherent visuomotor coupling at 100% BW (i.e., post-exposure influence), it remained unaffected by the visual context at 38% BW. Overall, our findings suggested that locomotor and perceptual adaptations were not similarly impacted, depending on the -simulated- gravity condition and visual context.

Re-assessing the role of culture on the visual orientation perception of the rod and frame test

In recent research of culture and ethnicity in visual perception, some researchers have found support for the hypothesis that more collectivistic cultures tend to be more influenced by surrounding contextual visual information than more individualistic cultures. This hypothesis suggests that even low-level visual perception may not be universal and has great implications on how vision research should be conducted. The current study reexamines this hypothesis in the rod and frame task, which tests the influence of a tilted contextual frame on orientation perception of the rod. We found no difference between participants of East Asian and Western European descent in this task. Despite not finding the cultural effect, we found a well-reported gender effect in which women were more influenced by the tilt of the frame than men, helping to ensure the quality of the data collected. Our results suggest that contextual influence on visual perception does not affect East Asians and white Western Europeans differently.

Influence of vestibular signals on bodily self-consciousness: Different sensory weighting strategies based on visual dependency

Previous studies showed that the vestibular system is crucial for multisensory integration, however, its contribution to bodily self-consciousness more specifically on full-body illusions is not well understood. Thus, the current study examined the role of visuo-vestibular conflict on a full-body illusion (FBI) experiment that was induced during a supine body position. In a mixed design experiment, 56 participants underwent through a full-body illusion protocol. During the experiment, half of the participants received synchronous visuo-tactile stimulation, and the other half received asynchronous visuo-tactile stimulation, while their physical body was lying in a supine position, but the virtual body was standing. Additionally, the contribution of individual sensory weighting strategies was investigated via the Rod and Frame task (RFT), which was applied both before (pre-FBI standing and pre-FBI supine) and after the full-body illusion (post-FBI supine) protocol. Subjective reports of the participants confirmed previous findings suggesting that there was a significant increase in ownership over a virtual body during synchronous visuo-tactile stimulation. Additionally, further categorization of participants based on their visual dependency (by RFT) showed that those participants who rely more on visual information (visual field dependents) perceived the full-body illusion more strongly than non-visual field dependents during the synchronous visuo-tactile stimulation condition. Further analysis provided not only a quantitative demonstration of full-body illusion but also revealed changes in perceived self-orientation based on their field dependency. Altogether, findings of the current study make further contributions to our understanding of the vestibular system and brought new insight for individual sensory weighting strategies during a full-body illusion.

Changes in the perception of upright body orientation with age

To determine own upright body orientation the brain creates a sense of verticality by a combination of multisensory inputs. To test whether this process is affected by aging, we placed younger and older adults on a motion platform and systematically tilted the orientation of their visual surroundings by using an augmented reality setup. In a series of trials, participants adjusted the orientation of the platform until they perceived themselves to be upright. Tilting the visual scene around the roll axis induced a bias in subjective postural vertical determination in the direction of scene tilt in both groups. In the group of older participants, however, the observed peak bias was larger and occurred at larger visual tilt angles. This indicates that the susceptibility to visually induced biases increases with age, possibly caused by a reduced reliability of sensory information.

The Tilted Self: Visuo-Graviceptive Mismatch in the Full-Body Illusion

The bodily self is a fundamental part of human self-consciousness and relies on online multimodal information and prior beliefs about one's own body. While the contribution of the vestibular system in this process remains under-investigated, it has been theorized to be important. The present experiment investigates the influence of conflicting gravity-related visual and bodily information on the sense of a body and, vice versa, the influence of altered embodiment on verticality and own-body orientation perception. In a full-body illusion setup, participants saw in a head-mounted display a projection of their own body 2 m in front of them, on which they saw a tactile stimulation on their back displayed either synchronously or asynchronously. By tilting the seen body to one side, an additional visuo-graviceptive conflict about the body orientation was created. Self-identification with the seen body was measured explicitly with a questionnaire and implicitly with skin temperature. As measures of orientation with respect to gravity, we assessed subjective haptic vertical and the haptic body orientation. Finally, we measured the individual visual field dependence using the rod-and-frame test. The results show a decrease in self-identification during the additional visuo-graviceptive conflict, but no modulation of perceived verticality or subjective body orientation. Furthermore, explorative analyses suggest a stimulation-dependent modulation of the perceived body orientation in individuals with a strong visual field dependence only. The results suggest a mutual interaction of graviceptive and other sensory signals and the individual's weighting style in defining our sense of a bodily self.

Do Visual and Vestibular Inputs Compensate for Somatosensory Loss in the Perception of Spatial Orientation? Insights from a Deafferented Patient

The present study aimed at investigating the consequences of a massive loss of somatosensory inputs on the perception of spatial orientation. The occurrence of possible compensatory processes for external (i.e., object) orientation perception and self-orientation perception was examined by manipulating visual and/or vestibular cues. To that aim, we compared perceptual responses of a deafferented patient (GL) with respect to age-matched Controls in two tasks involving gravity-related judgments. In the first task, subjects had to align a visual rod with the gravitational vertical (i.e., Subjective Visual Vertical: SVV) when facing a tilted visual frame in a classic Rod-and-Frame Test. In the second task, subjects had to report whether they felt tilted when facing different visuo-postural conditions which consisted in very slow pitch tilts of the body and/or visual surroundings away from vertical. Results showed that, much more than Controls, the deafferented patient was fully dependent on spatial cues issued from the visual frame when judging the SVV. On the other hand, the deafferented patient did not rely at all on visual cues for self-tilt detection. Moreover, the patient never reported any sensation of tilt up to 18° contrary to Controls, hence showing that she did not rely on vestibular (i.e., otoliths) signals for the detection of very slow body tilts either. Overall, this study demonstrates that a massive somatosensory deficit substantially impairs the perception of spatial orientation, and that the use of the remaining sensory inputs available to a deafferented patient differs regarding whether the judgment concerns external vs. self-orientation.

Sensorimotor and cognitive factors associated with the age-related increase of visual field dependence: a cross-sectional study

Reliance on the visual frame of reference for spatial orientation (or visual field dependence) has been reported to increase with age. This has implications on old adults' daily living tasks as it affects stability, attention, and adaptation capacities. However, the nature and underlying mechanisms of this increase are not well defined. We investigated sensorimotor and cognitive factors possibly associated with increased visual field dependence in old age, by considering functions that are both known to degrade with age and important for spatial orientation and sensorimotor control: reliance on the (somatosensory-based) egocentric frame of reference, visual fixation stability, and attentional processing of complex visual scenes (useful field of view, UFOV). Twenty young, 18 middle-aged, and 20 old adults completed a visual examination, three tests of visual field dependence (RFT, RDT, and GEFT), a test of egocentric dependence (subjective vertical estimation with the body erect and tilted at 70°), a visual fixation task, and a test of visual attentional processing (UFOV®). Increased visual field dependence with age was associated with reduced egocentric dependence, visual fixation stability, and visual attentional processing. In addition, visual fixation instability and reduced UFOV were correlated. Results of middle-aged adults fell between those of the young and old, revealing the progressive nature of the age effects we evaluated. We discuss results in terms of reference frame selection with respect to ageing as well as visual and non-visual information processing. Inter-individual differences amongst old adults are highlighted and discussed with respect to the functionality of increased visual field dependence.

How do visual and postural cues combine for self-tilt perception during slow pitch rotations?

Self-orientation perception relies on the integration of multiple sensory inputs which convey spatially-related visual and postural cues. In the present study, an experimental set-up was used to tilt the body and/or the visual scene to investigate how these postural and visual cues are integrated for self-tilt perception (the subjective sensation of being tilted). Participants were required to repeatedly rate a confidence level for self-tilt perception during slow (0.05°·s(-1)) body and/or visual scene pitch tilts up to 19° relative to vertical. Concurrently, subjects also had to perform arm reaching movements toward a body-fixed target at certain specific angles of tilt. While performance of a concurrent motor task did not influence the main perceptual task, self-tilt detection did vary according to the visuo-postural stimuli. Slow forward or backward tilts of the visual scene alone did not induce a marked sensation of self-tilt contrary to actual body tilt. However, combined body and visual scene tilt influenced self-tilt perception more strongly, although this effect was dependent on the direction of visual scene tilt: only a forward visual scene tilt combined with a forward body tilt facilitated self-tilt detection. In such a case, visual scene tilt did not seem to induce vection but rather may have produced a deviation of the perceived orientation of the longitudinal body axis in the forward direction, which may have lowered the self-tilt detection threshold during actual forward body tilt.

To pass or not to pass: more a question of body orientation than visual cues

This study investigated the influence of pitch body tilt on judging the possibility of passing under high obstacles in the presence of an illusory horizontal self-motion. Seated subjects tilted at various body orientations were asked to estimate the possibility of passing under a projected bar (i.e., a parking barrier), while imagining a forward whole-body displacement normal to gravity. This task was performed under two visual conditions, providing either no visual surroundings or a translational horizontal optic flow that stopped just before the barrier appeared. The results showed a main overestimation of the possibility of passing under the bar in both cases and most importantly revealed a strong influence of body orientation despite the visual specification of horizontal self-motion by optic flow (i.e., both visual conditions yielded a comparable body tilt effect). Specifically, the subjective passability was proportionally deviated towards the body tilt by 46% of its magnitude when facing a horizontal optic flow and 43% without visual surroundings. This suggests that the egocentric attraction exerted by body tilt when referring the subjective passability to horizontal self-motion still persists even when anchoring horizontally related visual cues are displayed. These findings are discussed in terms of interaction between spatial references. The link between the reliability of available sensory inputs and the weight attributed to each reference is also addressed.

Does visually induced self-motion affect grip force when holding an object?

Accurate control of grip force during object manipulation is necessary to prevent the object from slipping, especially to compensate for the action of gravitational and inertial forces resulting from hand/object motion. The goal of the current study was to assess whether the control of grip force was influenced by visually induced self-motion (i.e., vection), which would normally be accompanied by changes in object load. The main task involved holding a 400-g object between the thumb and the index finger while being seated within a virtual immersive environment that simulated the vertical motion of an elevator across floors. Different visual motions were tested, including oscillatory (0.21 Hz) and constant-speed displacements of the virtual scene. Different arm-loading conditions were also tested: with or without the hand-held object and with or without oscillatory arm motion (0.9 Hz). At the perceptual level, ratings from participants showed that both oscillatory and constant-speed motion of the elevator rapidly induced a long-lasting sensation of self-motion. At the sensorimotor level, vection compellingness altered arm movement control. Spectral analyses revealed that arm motion was entrained by the oscillatory motion of the elevator. However, we found no evidence that grip force used to hold the object was visually affected. Specifically, spectral analyses revealed no component in grip force that would mirror the virtual change in object load associated with the oscillatory motion of the elevator, thereby allowing the grip-to-load force coupling to remain unaffected. Altogether, our findings show that the neural mechanisms underlying vection interfere with arm movement control but do not interfere with the delicate modulation of grip force. More generally, those results provide evidence that the strength of the coupling between the sensorimotor system and the perceptual level can be modulated depending on the effector.

Does the integration of haptic and visual cues reduce the effect of a biased visual reference frame on the subjective head orientation?

Background

The selection of appropriate frames of reference (FOR) is a key factor in the elaboration of spatial perception and the production of robust interaction with our environment. The extent to which we perceive the head axis orientation (subjective head orientation, SHO) with both accuracy and precision likely contributes to the efficiency of these spatial interactions. A first goal of this study was to investigate the relative contribution of both the visual and egocentric FOR (centre-of-mass) in the SHO processing. A second goal was to investigate humans' ability to process SHO in various sensory response modalities (visual, haptic and visuo-haptic), and the way they modify the reliance to either the visual or egocentric FORs. A third goal was to question whether subjects combined visual and haptic cues optimally to increase SHO certainty and to decrease the FORs disruption effect.

Methodology/Principal Findings

Thirteen subjects were asked to indicate their SHO while the visual and/or egocentric FORs were deviated. Four results emerged from our study. First, visual rod settings to SHO were altered by the tilted visual frame but not by the egocentric FOR alteration, whereas no haptic settings alteration was observed whether due to the egocentric FOR alteration or the tilted visual frame. These results are modulated by individual analysis. Second, visual and egocentric FOR dependency appear to be negatively correlated. Third, the response modality enrichment appears to improve SHO. Fourth, several combination rules of the visuo-haptic cues such as the Maximum Likelihood Estimation (MLE), Winner-Take-All (WTA) or Unweighted Mean (UWM) rule seem to account for SHO improvements. However, the UWM rule seems to best account for the improvement of visuo-haptic estimates, especially in situations with high FOR incongruence. Finally, the data also indicated that FOR reliance resulted from the application of UWM rule. This was observed more particularly, in the visual dependent subject. Conclusions: Taken together, these findings emphasize the importance of identifying individual spatial FOR preferences to assess the efficiency of our interaction with the environment whilst performing spatial tasks.

Sensorimotor integration and psychopathology: motor control abnormalities related to psychiatric disorders

OBJECTIVES

Recent evidence is reviewed to examine relationships among sensorimotor and cognitive aspects in some important psychiatry disorders. This study reviews the theoretical models in the context of sensorimotor integration and the abnormalities reported in the most common psychiatric disorders, such as Alzheimer's disease, autism spectrum disorder and squizophrenia.

METHODS

The bibliographical search used Pubmed/Medline, ISI Web of Knowledge, Cochrane data base and Scielo databases. The terms chosen for the search were: Alzheimer's disease, AD, autism spectrum disorder, and Squizophrenia in combination with sensorimotor integration. Fifty articles published in English and were selected conducted from 1989 up to 2010.

RESULTS

We found that the sensorimotor integration process plays a relevant role in elementary mechanisms involved in occurrence of abnormalities in most common psychiatric disorders, participating in the acquisition of abilities that have as critical factor the coupling of different sensory data which will constitute the basis of elaboration of consciously goal-directed motor outputs. Whether these disorders are associated with an abnormal peripheral sensory input or defective central processing is still unclear, but some studies support a central mechanism.

CONCLUSION

Sensorimotor integration seems to play a significant role in the disturbances of motor control, like deficits in the feedforward mechanism, typically seen in AD, autistic and squizophrenic patients.

Postural configuration affects the perception of earth-based space during pitch tilt

This study investigates the relative contribution of body parts in the elaboration of a whole-body egocentric attraction phenomenon previously observed during earth-based judgments. This was addressed through a particular earth-based task requiring estimating the possibility of passing under a projected line, imagining a forward horizontal displacement. Different postural configurations were tested, involving whole-body tilt, trunk tilt alone or head tilt alone. Two legs positions relative to the trunk were manipulated. Results showed systematic deviations of the subjective "passability" toward the tilt, linearly related to the tilt magnitude. For each postural configuration, the egocentric influence appeared to be highly dependent on the position of trunk and head axes, whereas the legs position appeared not relevant. When compared to the whole-body tilt condition, tilting the trunk alone consistently reduced the amount of the deviation toward the tilt, whereas tilting the head alone consistently increased it. Our results suggest that several specific effects from multiple body parts can account for the global deviation of the estimates observed during whole-body tilt. Most importantly, we support that the relative contribution of the body segments could mainly depend on a reweighting process, probably based on the reliability of sensory information available for a particular postural set.

Pitch body orientation influences the perception of self-motion direction induced by optic flow

We studied the effect of static pitch body tilts on the perception of self-motion direction induced by a visual stimulus. Subjects were seated in front of a screen on which was projected a 3D cluster of moving dots visually simulating a forward motion of the observer with upward or downward directional biases (relative to a true earth horizontal direction). The subjects were tilted at various angles relative to gravity and were asked to estimate the direction of the perceived motion (nose-up, as during take-off or nose-down, as during landing). The data showed that body orientation proportionally affected the amount of error in the reported perceived direction (by 40% of body tilt magnitude in a range of +/-20 degrees) and these errors were systematically recorded in the direction of body tilt. As a consequence, a same visual stimulus was differently interpreted depending on body orientation. While the subjects were required to perform the task in a geocentric reference frame (i.e., relative to a gravity-related direction), they were obviously influenced by egocentric references. These results suggest that the perception of self-motion is not elaborated within an exclusive reference frame (either egocentric or geocentric) but rather results from the combined influence of both.