The role of gravitational cues in the judgment of visual orientation

Contributions of Body-Orientation to Mental Ball Dropping Task During Out-of-Body Experiences

Out-of-body experiences (OBEs) provide fascinating insights into our understanding of bodily self-consciousness and the workings of the brain. Studies that examined individuals with brain lesions reported that OBEs are generally characterized by participants experiencing themselves outside their physical body (i.e., disembodied feeling) (Blanke and Arzy, 2005). Based on such a characterization, it has been shown that it is possible to create virtual OBEs in immersive virtual environments (Ehrsson, 2007; Ionta et al., 2011b; Bourdin et al., 2017). However, the extent to which body-orientation influences virtual OBEs is not well-understood. Thus, in the present study, 30 participants (within group design) experienced a full-body ownership illusion (synchronous visuo-tactile stimulation only) induced with a gender-matched full-body virtual avatar seen from the first-person perspective (1PP). At the beginning of the experiment, participants performed a mental ball dropping (MBD) task, seen from the location of their virtual avatar, to provide a baseline measurement. After this, a full-body ownership illusion (embodiment phase) was induced in all participants. This was followed by the virtual OBE illusion phase of the experiment (disembodiment phase) in which the first-person viewpoint was switched to a third-person perspective (3PP), and participants' disembodied viewpoint was gradually raised to 14 m above the virtual avatar, from which altitude they repeated the MBD task. During the experiment, this procedure was conducted twice, and the participants were allocated first to the supine or the standing body position at random. Results of the MBD task showed that the participants experienced increased MBD durations during the supine condition compared to the standing condition. Furthermore, although the findings from the subjective reports confirmed the previous findings of virtual OBEs, no significant difference between the two postures was found for body ownership. Taken together, the findings of the current study make further contributions to our understanding of both the vestibular system and time perception during OBEs.

Influence of vestibular signals on bodily self-consciousness: Different sensory weighting strategies based on visual dependency

Previous studies showed that the vestibular system is crucial for multisensory integration, however, its contribution to bodily self-consciousness more specifically on full-body illusions is not well understood. Thus, the current study examined the role of visuo-vestibular conflict on a full-body illusion (FBI) experiment that was induced during a supine body position. In a mixed design experiment, 56 participants underwent through a full-body illusion protocol. During the experiment, half of the participants received synchronous visuo-tactile stimulation, and the other half received asynchronous visuo-tactile stimulation, while their physical body was lying in a supine position, but the virtual body was standing. Additionally, the contribution of individual sensory weighting strategies was investigated via the Rod and Frame task (RFT), which was applied both before (pre-FBI standing and pre-FBI supine) and after the full-body illusion (post-FBI supine) protocol. Subjective reports of the participants confirmed previous findings suggesting that there was a significant increase in ownership over a virtual body during synchronous visuo-tactile stimulation. Additionally, further categorization of participants based on their visual dependency (by RFT) showed that those participants who rely more on visual information (visual field dependents) perceived the full-body illusion more strongly than non-visual field dependents during the synchronous visuo-tactile stimulation condition. Further analysis provided not only a quantitative demonstration of full-body illusion but also revealed changes in perceived self-orientation based on their field dependency. Altogether, findings of the current study make further contributions to our understanding of the vestibular system and brought new insight for individual sensory weighting strategies during a full-body illusion.

Instructions, Illusory Self-Tilt and the Rod-and-Frame Test

If an illusion of self-tilt is involved in rod-and-frame test performance, then instructions to adjust the rod to the body midline (egocentric instructions) should result in less rod adjustment error than the standard instructions for the rod-and-frame test to adjust the rod to the gravitational vertical. Two experiments were designed to examine this possibility. The results of the first experiment indicate that the tilted rod-and-frame display induces an illusion of self-tilt in the opposite direction. Significant differences between instructional conditions were found in the second experiment as expected. Other rod-and-frame studies are discussed in view of these findings.

ROD and Frame Test Scores and Verbalized Strategies

The cognitive strategies used by 31 college students, 15 men and 16 women, while solving the Rod and Frame Test in a dark room were evaluated. These strategies were analyzed in terms of the subjects' performance on the task. Those who scored lower and who were better performers on the task, used significantly more “internal” strategies than those subjects with higher scores (worse performers) who in turn employed a great number of “external” strategies in solving the task.

How do visual and postural cues combine for self-tilt perception during slow pitch rotations?

Self-orientation perception relies on the integration of multiple sensory inputs which convey spatially-related visual and postural cues. In the present study, an experimental set-up was used to tilt the body and/or the visual scene to investigate how these postural and visual cues are integrated for self-tilt perception (the subjective sensation of being tilted). Participants were required to repeatedly rate a confidence level for self-tilt perception during slow (0.05°·s(-1)) body and/or visual scene pitch tilts up to 19° relative to vertical. Concurrently, subjects also had to perform arm reaching movements toward a body-fixed target at certain specific angles of tilt. While performance of a concurrent motor task did not influence the main perceptual task, self-tilt detection did vary according to the visuo-postural stimuli. Slow forward or backward tilts of the visual scene alone did not induce a marked sensation of self-tilt contrary to actual body tilt. However, combined body and visual scene tilt influenced self-tilt perception more strongly, although this effect was dependent on the direction of visual scene tilt: only a forward visual scene tilt combined with a forward body tilt facilitated self-tilt detection. In such a case, visual scene tilt did not seem to induce vection but rather may have produced a deviation of the perceived orientation of the longitudinal body axis in the forward direction, which may have lowered the self-tilt detection threshold during actual forward body tilt.

Combined influence of visual scene and body tilt on arm pointing movements: gravity matters!

Performing accurate actions such as goal-directed arm movements requires taking into account visual and body orientation cues to localize the target in space and produce appropriate reaching motor commands. We experimentally tilted the body and/or the visual scene to investigate how visual and body orientation cues are combined for the control of unseen arm movements. Subjects were asked to point toward a visual target using an upward movement during slow body and/or visual scene tilts. When the scene was tilted, final pointing errors varied as a function of the direction of the scene tilt (forward or backward). Actual forward body tilt resulted in systematic target undershoots, suggesting that the brain may have overcompensated for the biomechanical movement facilitation arising from body tilt. Combined body and visual scene tilts also affected final pointing errors according to the orientation of the visual scene. The data were further analysed using either a body-centered or a gravity-centered reference frame to encode visual scene orientation with simple additive models (i.e., ‘combined’ tilts equal to the sum of ‘single’ tilts). We found that the body-centered model could account only for some of the data regarding kinematic parameters and final errors. In contrast, the gravity-centered modeling in which the body and visual scene orientations were referred to vertical could explain all of these data. Therefore, our findings suggest that the brain uses gravity, thanks to its invariant properties, as a reference for the combination of visual and non-visual cues.

Semi-automatic measurement of visual verticality perception in humans reveals a new category of visual field dependency

Previous assessment of verticality by means of rod and rod and frame tests indicated that human subjects can be more (field dependent) or less (field independent) influenced by a frame placed around a tilted rod. In the present study we propose a new approach to these tests. The judgment of visual verticality (rod test) was evaluated in 50 young subjects (28 males, ranging in age from 20 to 27 years) by randomly projecting a luminous rod tilted between -18 and +18° (negative values indicating left tilts) onto a tangent screen. In the rod and frame test the rod was displayed within a luminous fixed frame tilted at +18 or -18°. Subjects were instructed to verbally indicate the rod's inclination direction (forced choice). Visual dependency was estimated by means of a Visual Index calculated from rod and rod and frame test values. Based on this index, volunteers were classified as field dependent, intermediate and field independent. A fourth category was created within the field-independent subjects for whom the amount of correct guesses in the rod and frame test exceeded that of the rod test, thus indicating improved performance when a surrounding frame was present. In conclusion, the combined use of subjective visual vertical and the rod and frame test provides a specific and reliable form of evaluation of verticality in healthy subjects and might be of use to probe changes in brain function after central or peripheral lesions.

Influence of head orientation on visually and memory-guided arm movements

In the absence of visual supervision, tilting the head sideways gives rise to deviations in spatially defined arm movements. The purpose of this study was to determine whether these deviations are restricted to situations with impoverished visual information. Two experiments were conducted in which participants were positioned supine and reproduced with their unseen index finger a 2 dimensional figure either under visual supervision or from memory (eyes closed). In the former condition, the figure remained visible (using a mirror). In the latter condition, the figure was first observed and then reproduced from memory. Participants' head was either aligned with the trunk or tilted 30° towards the left or right shoulder. In experiment 1, participants observed first the figure with the head straight and then reproduced it with the head either aligned or tilted sideways. In Experiment 2, participants observed the figure with the head in the position in which the figure was later reproduced. Results of Experiment 1 and 2 showed deviations of the motor reproduction in the direction opposite to the head in both the memory and visually-guided conditions. However, the deviations decreased significantly under visual supervision when the head was tilted left. In Experiment 1, the perceptual visual bias induced by head tilt was evaluated. Participants were required to align the figure parallel to their median trunk axis. Results revealed that the figure was perceived as parallel with the trunk when it was actually tilted in the direction of the head. Perceptual and motor responses did not correlate. Therefore, as long as visual feedback of the arm is prevented, an internal bias, likely originating from head/trunk representation, alters hand-motor production irrespectively of whether visual feedback of the figure is available or not.

Subjective visual vertical in erect/supine subjects and under microgravity: effects of lower body negative pressure

Perception of the subjective visual vertical (SVV) is mainly based on the contributions from the visual, vestibular, and proprioceptive systems, and participates to the process of spatial orientation in relation to the surrounding environment and to the gravito-inertial force. The SVV can be significantly influenced by the presence of a displaced visual field, as in the case of the rod and frame test (RFT). A series of studies showed the effects of haematic mass shifts to and from the lower limbs on SVV, due to visceral mechanoreceptors (VM) located at the level of the kidneys and of the thorax. These sensors may be artificially activated with a lower body negative pressure (LBNP) device. In this study, the role of visual and VM cues to orientation perception have been evaluated using the RFT and the LBNP devices under a microgravity environment. A preliminary investigation was conducted in a sample of military pilots to develop a RFT protocol to be used in microgravity environments. This protocol was adopted to evaluate the contribution of VM to the SVV in a cosmonaut before, during and after a 10 day space flight, with and without concurrent activation of LBNP. The same test sequence, including LBNP exposure, was repeated a few months later on Earth on the same subject. As expected, the influence of the frame on rod positioning was statistically significant in all test conditions. During the in-flight experimental step, a substantial lack of significant changes compared to the pre-flight condition was observed. Moreover, substantially no effects due to LBNP were observed. A mild rod displacement from the body axis was detected under microgravity compared to the pre-flight recording. Such a finding was in part reduced during LBNP. The same findings were observed during the post-flight repetition of the experiment. Our results showed an absence in this subject of significant effects on the RFT due to microgravity. In conclusion, no effects from his VM on the RFT and minor changes in the SVV could be detected.

Perception of longitudinal body axis in microgravity during parabolic flight

It has been proposed that an internal representation of body vertical has a prominent role in spatial orientation. This investigation investigated the ability of human subjects to accurately locate their longitudinal body axis (an imaginary straight body midline running from head to toes) while free-floating in microgravity. Subjects were tested in-flight, as well as on ground in normal gravity in both the upright and supine orientations to provide baseline measurements. The subjects wore a goggle device and were in total darkness. They used knobs to rotate two luminous lines until they were parallel to the subjective direction of their longitudinal body axis, in the roll (right/left) and the pitch (forward/backward) planes. Results showed that the error between the perceived and the objective direction of the longitudinal body axis was significantly larger in microgravity than in normal gravity. This error in this egocentric frame of reference is presumably due to the absence of somatosensory cues when free-floating. Mechanical pressure on the chest using an airbag reduced the error in perception of the longitudinal body axis in microgravity, thus improving spatial orientation.

Role of gravity-based information on the orientation and localization of the perceived body midline

The present study focused on the influence of gravity-based information on the orientation and localization of the perceived body midline. The orientation was investigated by the rolling adjustment of a rod on the subjects' Z-axis and the localization by the horizontal adjustment of a visual dot as being straight ahead. Experiment 1 investigated the effect of the dissociation between the Z-axis and the direction of gravity by placing subjects in roll tilt and supine postures. In roll tilt, the perception of the body midline orientation was deviated in the direction of body tilt and the perception of its localization was deviated in the opposite direction. In the supine body orientation, estimates of the Z-axis and straight-ahead remained veridical as when the body was upright. Experiment 2 highlighted the relative importance of the otolithic and tactile information using diffuse pressure stimulation. The estimation of body midline orientation was modified contrarily to the estimation of its localization. Thus, subjects had no absolute representation of their egocentric space. The main hypothesis regarding the dissociation between the orientation and localization of the body midline may be related to a difference in the integration of sensory information. It can be suggested that the horizontal component of the vestibulo-ocular reflex (VOR) contributed to the perceived localization of the body midline, whereas its orientation was mainly influenced by tactile information.

Geometric visual illusions in microgravity during parabolic flight

This investigation explores whether the absence of gravitational information in a microgravity environment affects the perception of several classical visual illusions based on the arrangement of horizontal and vertical lines. Because the perception of horizontal and vertical orientation changes in microgravity, our prediction was that the strength of visual illusions based on the arrangement of horizontal and vertical lines would be altered when study participants were free-floating during parabolic flight. The frequency of appearance of reversed-T, Müller-Lyer, Ponzo, and Hering illusions substantially decreased when observers were free-floating, whereas the Zöllner and the Poggendorff illusions were not affected. Because the former illusions rely more heavily on perspective cues for generating inaccurate judgments of depth and size, these results suggest an alteration in the role of linear perspective for three-dimensional vision in microgravity. They also confirm that the visual system normally relies on otolith and somatosensory information for providing accurate judgments about the size and distance of objects when presented with planar presentations of geometric figures.

Contribution of reference frames for movement planning in peripersonal space representation

The principal goal of our study is to gain an insight into the representation of peripersonal space. Two different experiments were conducted in this study. In the first experiment, subjects were asked to represent principal anatomical reference planes by drawing ellipses in the sagittal, frontal and horizontal planes. The three-dimensional hand-drawing movements, which were achieved with and without visual guidance, were considered as the expression of a cognitive process per se: the peripersonal space representation for action. We measured errors in the spatial orientation of ellipses with regard to the requested reference planes. For ellipses drawn without visual guidance, with eyes open and eyes closed, orientation errors were related to the reference planes. Errors were minimal for sagittal and maximal for horizontal plane. These disparities in errors were considerably reduced when subjects drew using a visual guide. These findings imply that different planes are centrally represented, and are characterized, by different errors when subjects use a body-centered frame for performing the movement and suggest that the representation of peripersonal space may be anisotropic. However, this representation can be modified when subjects use an environment-centered reference frame to produce the movement. In the second experiment, subjects were instructed to represent, with eyes open and eyes closed, sagittal, frontal and horizontal planes by pointing to virtual targets located in these planes. Disparities in orientation errors measured for pointing were similar to those found for drawing, implying that the sensorimotor representation of reference planes was not constrained by the type of motor tasks. Moreover, arm postures measured at pointing endpoints and at comparable spatial locations in drawing are strongly correlated. These results suggest that similar patterns of errors and arm posture correlation, for drawing and pointing, can be the consequence of using a common space representation and reference frame. These findings are consistent with the assumption of an anisotropic action-related representation of peripersonal space when the movement is performed in a body-centered frame.

Kinesthetic estimation of the main orientations from the upright and supine positions

This work investigated the accuracy of the perception of the main orientations (i.e., vertical and horizontal orientations) with the kinesthetic modality--a modality not previously used in this field of research. To further dissociate the influence of the postural and physical verticals, two body positions were explored (supine and upright). Twenty-two blindfolded participants were asked to set, as accurately as possible, a rod to both physical orientations while assuming one of the two body positions. The horizontal was perceived more accurately than the vertical orientation in the upright position but not in the supine position. Essentially, there were no differences in the supine position because the adjustments to the physical vertical were much more accurate than they were in the upright position. The lower accuracy in the estimation of the vertical orientation observed in the upright position might be linked to the dynamics associated with the maintenance of posture.

Perception of self-tilt in a true and illusory vertical plane

A tilted furnished room can induce strong visual reorientation illusions in stationary subjects. Supine subjects may perceive themselves upright when the room is tilted 90 degrees so that the visual polarity axis is kept aligned with the subject. This 'upright illusion' was used to induce roll tilt in a truly horizontal, but perceptually vertical, plane. A semistatic tilt profile was applied, in which the tilt angle gradually changed from 0 degrees to 90 degrees, and vice versa. This method produced larger illusory self-tilt than usually found with static tilt of a visual scene. Ten subjects indicated self-tilt by setting a tactile rod to perceived vertical. Six of them experienced the upright illusion and indicated illusory self-tilt with an average gain of about 0.5. This value is smaller than with true self-tilt (0.8), but comparable to the gain of visually induced self-tilt in erect subjects. Apparently, the contribution of nonvisual cues to gravity was independent of the subject's orientation to gravity itself. It therefore seems that the gain of visually induced self-tilt is smaller because of lacking, rather than conflicting, nonvisual cues. A vector analysis is used to discuss the results in terms of relative sensory weightings.

Visually induced reorientation illusions

It is known that rotation of a furnished room around the roll axis of erect subjects produces an illusion of 360 degrees self-rotation in many subjects. Exposure of erect subjects to stationary tilted visual frames or rooms produces only up to 20 degrees of illusory tilt. But, in studies using static tilted rooms, subjects remained erect and the body axis was not aligned with the room. We have revealed a new class of disorientation illusions that occur in many subjects when placed in a 90 degrees or 180 degrees tilted room containing polarised objects (familiar objects with tops and bottoms). For example, supine subjects looking up at a wall of the room feel upright in an upright room and their arms feel weightless when held out from the body. We call this the levitation illusion. We measured the incidence of 90 degrees or 180 degrees reorientation illusions in erect, supine, recumbent, and inverted subjects in a room tilted 90 degrees or 180 degrees. We report that reorientation illusions depend on the displacement of the visual scene rather than of the body. However, illusions are most likely to occur when the visual and body axes are congruent. When the axes are congruent, illusions are least likely to occur when subjects are prone rather than supine, recumbent, or inverted.

The tilt-constancy theory of visual illusions

The authors argue that changes in the perception of vertical and horizontal caused by local visual cues can account for many classical visual illusions. Because the perception of orientation is influenced more by visual cues than gravity-based cues when the observer is tilted (e.g., S. E. Asch & H. A. Witkin, 1948), the authors predicted that the strength of many visual illusions would increase when observers were tilted 30 degrees. The magnitude of Zöllner, Poggendorff, and Ponzo illusions and the tilt-induction effect substantially increased when observers were tilted. In contrast, the Müller-Lyer illusion and a size constancy illusion, which are not related to orientation perception, were not affected by body orientation. Other theoretical approaches do not predict the obtained pattern of results.

The role of neck afferents in subjective orientation in the visual and tactile sensory modalities

We studied the influence of neck afferents on the perception of orientation. In Experiment 1, we investigated the effect of head tilt on the subjective vertical in both the visual and tactile modalities. The results showed that head tilt triggers an Aubert effect in the visual modality and a Müller effect in the tactile modality. Significant positive correlations between the two adjustment modalities were restricted to head tilt to the left. In Experiment 2, we investigated the role of neck afferents on tactile orientation in seated and supine positions. The results showed that, in the supine position, the tactile E-effect was twice as large as in the seated position. These experiments confirm that tactile perception of orientation is affected by neck afferents, and show that the influence of neck afferents is limited by relevant gravitational cues.

Visual and somesthetic influences on postural orientation in the median plane

We investigated optic and somesthetic contributions to perceived body orientation in the pitch dimension. In a within-subject factorial design, each of 12 subjects attempted to set his/her body erect or 45 degrees back from erect while restrained in a movable bed surrounded by an adjustable box. The box provided a visual environment consisting of either a grid pattern, two luminous lines, or complete darkness. Both the grid pattern and the luminous lines were effective at biasing settings of body position when the box was pitched; the pitched grid was more effective than the pitched lines. Although the pitch of the box influenced orientation to both goals, the effect was greater for the diagonal goal than for the erect goal. We present a model of postural orientation in the median plane that involves vestibular, somatosensory, and visual inputs.

Spatial reference in weightlessness: perceptual factors and mental representations

The role of gravity in spatial coordinate assignment and the mental representation of space were studied in three experiments, varying different perceptual cues systematically: the retinal, the visual background, the vestibular, and proprioceptive information. Verbal descriptions of visually presented arrays were required under different head positions (straight/tilt) and under different gravitational conditions (gravity present/gravity absent). The results of two experiments conducted with 2 subjects who participated in a space flight revealed that subjects are able to adequately assign positions in space in the absence of gravitational information, and that they do this by using their head-retinal coordinates as primary references. This indicates that they cognitively adapted to the perceptually new situation. The findings from a third experiment conducted with a larger group of subjects under a condition in which the gravitational information was present but irrelevant to the task being solved (subjects were in a horizontal supine position) show that subjects, in general, are flexible in using cues other than gravitational ones as references when the latter cannot serve as a referential system. These findings, together with the observation that consistent spatial assignment is possible even immediately after first exposure to the perceptually totally novel situation of weightlessness, seem to suggest that the mental representation of space, onto which given perceptual information is mapped, is independent of a particular percept.

Perception of rotated forms: a theory of information types

The present article proposes a theory of form perception in an attempt to understand puzzling problems in mental rotation and in perception of forms rotated in the frontal-parallel plane. According to the theory, it is critical to distinguish four types of information. They result from the orthogonal combination of two binary distinctions: information can be orientation-free or orientation-bound, elementary or conjunctive. The theory provides an explanation as to when and why mental rotation has to be performed. If two forms can be discriminated only on the basis of conjunctive orientation-bound information, mental rotation or some other functionally equivalent strategy is required. Mental rotation is unnecessary if the forms differ in either type of orientation-free information, provided that the difference is actually encoded as such. This explanation along with the proposed distinctions among the four types of information was supported by two mental rotation experiments and three visual search experiments.

Do confusing information and egocentric instructions influence perception?

In an investigation of psychological differentiation, Witkin's personality dimension, 12 field-dependent and 12 field-independent students were selected from a population of college men in summerschool based on their Embedded Figures Test scores. They were assigned to conditions, given egocentric or gravitational instructions, and provided clarified or obscuring feedback about their performance on the Rod and Frame Test. Although instructions had no effect, students with clarified feedback performed better than those whose feedback was confusing. Field-independent men had less difficulty with the confusing feedback than did field-dependent men.

Component analysis of orientation illusions

Orientation illusions occur when the inducing figure is a line or grating (the tilt illusion) or a square outline frame (the rod-and-frame illusion). In the range of inducing figure tilts between vertical and horizontal, the tilt illusion describes one cycle of positive (direct) and negative (indirect) effects but the rod-and-frame illusion describes two such cycles. In two experiments, angular functions of illusions were measured with the six possible inducing figures which result when two of the four sides of a square inducing frame are deleted. As expected, the parallel-side frame amputations induced angular functions similar to the tilt illusion and these functions differed from those induced by the orthogonal-sided amputations. In agreement with previous findings on the nonadditivity of tilt illusions, the sum of angular functions induced by frame amputations, which together form a complete frame, were not always equivalent to the angular function induced by a complete frame, and there were asymmetries in the data fro which neither of two simple hypotheses could adequately account. The discussion focuses upon properties of inducing figures which psychophysical hypotheses might need to consider in order to account for the shapes of angular functions of orientation illusions and, in particular,a distinction is drawn between the global orientation of the inducing figure and the orientations of it (local) component features. It is suggested that it might be fruitful if the tilt illusion and the rod-and-frame illusion were conceived of as illusions resulting from inducing figures composed of all or part of n gratings of spatial frequency fn intersecting at angles of 180 degrees/n.