Influences of visual pitch and visual yaw on visually perceived eye level (VPEL) and straight ahead (VPSA) for erect and rolled-to-horizontal observers

Visually Perceived Eye Level and Horizontal Midline of the Body Trunk Influenced by Optic Flow

The eye level and the horizontal midline of the body trunk can serve, respectively as references for judging the vertical and horizontal egocentric directions. We investigated whether the optic-flow pattern, which is the dynamic motion information generated when one moves in the visual world, can be used by the visual system to determine and calibrate these two references. Using a virtual-reality setup to generate the optic-flow pattern, we showed that judged elevation of the eye level and the azimuth of the horizontal midline of the body trunk are biased toward the positional placement of the focus of expansion (FOE) of the optic-flow pattern. Furthermore, for the vertical reference, prolonged viewing of an optic-flow pattern with lowered FOE not only causes a lowered judged eye level after removal of the optic-flow pattern, but also an overestimation of distance in the dark. This is equivalent to a reduction in the judged angular declination of the object after adaptation, indicating that the optic-flow information also plays a role in calibrating the extraretinal signals used to establish the vertical reference.

The Rod-and-Frame Effect: The Whole is Less than the Sum of its Parts

Since the discovery of the influence of the tilted frame on the visual perception of the orientation perceived as vertical (VPV), the frame has been treated as a unitary object—a Gestalt. We evaluated the effect of 1-line, 2-line, 3-line, and 4-line (square frame) stimuli of two different sizes, and asked whether the influence of the square frame on VPV is any greater than the additive combination of separate influences produced by the individual lines constituting the frame. We found that, for each size, the square frame is considerably less influential than the additive combination of the influences of the individual lines. The results conform to a mass action rule, in which the lengths and orientations of the individual line components are what matters and the organization of the lines into a square does not—no higher-level Gestalt property is involved in the induction effect on VPV.

Impact of Vestibular Lesions on Allocentric Navigation and Interval Timing: The Role of Self-Initiated Motion in Spatial-Temporal Integration

Bilateral intratympanic sodium arsenate injections (100 mg/ml in isotonic saline) in adult male Long Evans rats produced impairments in allocentric navigation using a 12-arm radial maze procedure as well as a motor test battery designed to evaluate vestibular function. In contrast, no impairments in the accuracy or precision of duration reproduction using 20-s and 80-s peak-interval procedures were observed when both target durations were associated with the same lever response, but distinguished by signal modality (e.g., light or sound). In contrast, an ordinal-reproduction procedure with 800, 3200, and 12,800 ms standards requiring the timing of self-initiated movements during the production phase revealed large impairments in the accuracy and precision of timing for vestibular lesioned rats. These impairments were greater on trials in which self-initiated body movements (e.g., holding down the response lever for a fixed duration) were required without the support of external stimuli signaling the onset and offset of the reproduced duration in contrast to trials in which such external support was provided. The conclusion is that space and time are separable entities and not simply the product of a generalized system, but they can be integrated into a common metric using gravity and self-initiated movement as a reference.

How do visual and postural cues combine for self-tilt perception during slow pitch rotations?

Self-orientation perception relies on the integration of multiple sensory inputs which convey spatially-related visual and postural cues. In the present study, an experimental set-up was used to tilt the body and/or the visual scene to investigate how these postural and visual cues are integrated for self-tilt perception (the subjective sensation of being tilted). Participants were required to repeatedly rate a confidence level for self-tilt perception during slow (0.05°·s(-1)) body and/or visual scene pitch tilts up to 19° relative to vertical. Concurrently, subjects also had to perform arm reaching movements toward a body-fixed target at certain specific angles of tilt. While performance of a concurrent motor task did not influence the main perceptual task, self-tilt detection did vary according to the visuo-postural stimuli. Slow forward or backward tilts of the visual scene alone did not induce a marked sensation of self-tilt contrary to actual body tilt. However, combined body and visual scene tilt influenced self-tilt perception more strongly, although this effect was dependent on the direction of visual scene tilt: only a forward visual scene tilt combined with a forward body tilt facilitated self-tilt detection. In such a case, visual scene tilt did not seem to induce vection but rather may have produced a deviation of the perceived orientation of the longitudinal body axis in the forward direction, which may have lowered the self-tilt detection threshold during actual forward body tilt.

Combined influence of visual scene and body tilt on arm pointing movements: gravity matters!

Performing accurate actions such as goal-directed arm movements requires taking into account visual and body orientation cues to localize the target in space and produce appropriate reaching motor commands. We experimentally tilted the body and/or the visual scene to investigate how visual and body orientation cues are combined for the control of unseen arm movements. Subjects were asked to point toward a visual target using an upward movement during slow body and/or visual scene tilts. When the scene was tilted, final pointing errors varied as a function of the direction of the scene tilt (forward or backward). Actual forward body tilt resulted in systematic target undershoots, suggesting that the brain may have overcompensated for the biomechanical movement facilitation arising from body tilt. Combined body and visual scene tilts also affected final pointing errors according to the orientation of the visual scene. The data were further analysed using either a body-centered or a gravity-centered reference frame to encode visual scene orientation with simple additive models (i.e., ‘combined’ tilts equal to the sum of ‘single’ tilts). We found that the body-centered model could account only for some of the data regarding kinematic parameters and final errors. In contrast, the gravity-centered modeling in which the body and visual scene orientations were referred to vertical could explain all of these data. Therefore, our findings suggest that the brain uses gravity, thanks to its invariant properties, as a reference for the combination of visual and non-visual cues.

To pass or not to pass: more a question of body orientation than visual cues

This study investigated the influence of pitch body tilt on judging the possibility of passing under high obstacles in the presence of an illusory horizontal self-motion. Seated subjects tilted at various body orientations were asked to estimate the possibility of passing under a projected bar (i.e., a parking barrier), while imagining a forward whole-body displacement normal to gravity. This task was performed under two visual conditions, providing either no visual surroundings or a translational horizontal optic flow that stopped just before the barrier appeared. The results showed a main overestimation of the possibility of passing under the bar in both cases and most importantly revealed a strong influence of body orientation despite the visual specification of horizontal self-motion by optic flow (i.e., both visual conditions yielded a comparable body tilt effect). Specifically, the subjective passability was proportionally deviated towards the body tilt by 46% of its magnitude when facing a horizontal optic flow and 43% without visual surroundings. This suggests that the egocentric attraction exerted by body tilt when referring the subjective passability to horizontal self-motion still persists even when anchoring horizontally related visual cues are displayed. These findings are discussed in terms of interaction between spatial references. The link between the reliability of available sensory inputs and the weight attributed to each reference is also addressed.

Short-lived effects of a visual inducer during egocentric space perception and manual behavior

A pitched visual inducer has a strong effect on the visually perceived elevation of a target in extrapersonal space, and also on the elevation of the arm when a subject points with an unseen arm to the target's elevation. The manual effect is a systematic function of hand-to-body distance (Li and Matin Vision Research 45:533-550, 2005): When the arm is fully extended, manual responses to perceptually mislocalized luminous targets are veridical; when the arm is close to the body, gross matching errors occur. In the present experiments, we measured this hand-to-body distance effect during the presence of a pitched visual inducer and after inducer offset, using three values of hand-to-body distance (0, 40, and 70 cm) and two open-loop tasks (pointing to the perceived elevation of a target at true eye level and setting the height of the arm to match the elevation). We also measured manual behavior when subjects were instructed to point horizontally under induction and after inducer offset (no visual target at any time). In all cases, the hand-to-body distance effect disappeared shortly after inducer offset. We suggest that the rapid disappearance of the distance effect is a manifestation of processes in the dorsal visual stream that are involved in updating short-lived representations of the arm in egocentric visual perception and manual behavior.

Influence of pitch tilts on the perception of gravity-referenced eye level in labyrinthine defective subjects

We investigate the role of vestibular information in judging the gravity-referenced eye level (i.e., earth-referenced horizon or GREL) during sagittal body tilt whilst seated. Ten bilateral labyrinthine-defective subjects (LDS) and 10 age-matched controls set a luminous dot to their perception of GREL in darkness, with and without arm pointing. Although judgements were linearly influenced by the magnitude of whole-body tilt, results showed no significant difference between LDS and age-matched controls in the subjective GREL accuracy or in the intra-subject variability of judgement. However, LDS performance without arm pointing was related to the degree of vestibular compensation inferred from another postural study performed with the same patients. LDS did not utilize upper limb input during arm pointing movements as a source of graviceptive information to compensate for the vestibular loss. The data suggest that vestibular cues are not of prime importance in GREL estimates in static conditions. The absence of difference between controls and LDS GREL performance, and the correlation between the postural task and GREL accuracy, indicate that somatosensory input may convey as much graviceptive information required for GREL judgements as the vestibular system.

The field dependence/independence cognitive style does not control the spatial perception of elevation

Earlier work described the presence of a significant connection between an individual's ability to disregard distracting aspects of a visual field in the classical rod-and-frame test (RFT), in which a subject is required to set a rod so that it will appear vertical in the presence of a square frame that is roll tilted from vertical, and in paper-and-pencil tests, in which the subject is required to find a hidden figure embedded in a more complex figure (the Embedded Figures Test [EFT]; see, e.g., Witkin, Dyk, Faterson, Goodenough, & Karp, 1962; Witkin et al., 1954; Witkin, Oltman, Raskin, & Karp, 1971). This has led to a belief in the existence of a bipolar dimension of cognitive style that is utilized in such disembedding tasks--namely, the extent to which an individual is dependent on or independent from the influence of a distracting visual field. The influence of an inducing visual field on the perception of elevation measured by the setting of a visual target to appear at eye level (the visually perceived eye level [VPEL] discrimination) has also been found to be correlated with the RFT. We have thus explored the possible involvement of the dependence/independence cognitive style on the VPEL discrimination. Measurements were made on each of 18 subjects (9 of them female, 9 male) setting a small target to the VPEL in the presence of a pitched visual field across a range of six pitches from -30 degrees (topbackward) to +20 degrees (topforward) and on each of three tests generally recognized as tests of cognitive spatial abilities: the EFT, the Gestalt Completion Test, and the Snowy Pictures Test (SPT). Although there were significant pairwise correlations relating performance on the three cognitive tests (+.73, +.48, and +.71), the correlation of each of these three with the slope of the VPEL-versus-pitch function was not significant, as it was with the slope of the perception of visual pitch of the field (PVP)-versus-pitch function. VPEL, PVP, and a cognitive factor separated into three essentially independent factors in a multiple-factor analysis, with the three cognitive tests clustering at the cognitive factor, and with no significant loading on either of the other two factors. From the above considerations and a multiple-factor analytic treatment including additional results from this and other laboratories, we conclude that the cognitive-processing style held to be involved in the performance on the EFT and the perception of vertical as measured by the RFT is not general for egocentric space perception; it does not involve the perception of elevation.

Visually perceived vertical (VPV): induced changes in orientation by 1-line and 2-line roll-tilted and pitched visual fields

We report a series of nine experiments which show that a single roll-tilted line in darkness induces changes of the orientation perceived as vertical (VPV) that are similar in magnitude and direction to those measured by Witkin and Asch (1948a) [Studies in space orientation. I. Perception of the upright with displaced visual fields. Journal of Experimental Psychology, 38, 762-782] with the classical square 4-sided frame, and we describe the configuration-independent mass-action rules by which the influences of the individual lines influences are combined. Clockwise (cw) and counterclockwise (ccw) orientations of a line produce cw and ccw displacements of the VPV setting, respectively, with effect magnitude increasing approximately linearly with line orientation (e.g., a 66.25 degrees - long line at 25 degrees horizontal eccentricity that varies in roll-tilt through +/-13.2 degrees around vertical generates a systematic variation in VPV over +/-7 degrees). The slope of the VPV-vs-roll-tilt function increases with line length along a negatively accelerated exponential function (length constant = 17.1 degrees). The influences of two bilaterally symmetric lines combine linearly and algebraically and the combined influence is linearly related to the sum of the VPVs for the 1-line components with a slope equal to 0.91 for short lines and 0.66 for long lines; thus, VPV for short lines manifests nearly complete additive summation, but for long lines, the 2-line VPV is nearer to the average of the VPV values for the two components measured separately. The effectiveness of the conjunction of two line segments within a visual scene does not depend on their separate orientations, only on their sum. Individual lines from pitched-only planes or from combinations of such planes generate identical influences to those generated from lines in frontoparallel planes with the same image orientations at the eye of the observer (their "retinal orientations"). Retinal orientation is the key to the induction of VPV change independently of the line's plane of origin.

Two wrongs make a right: linear increase of accuracy of visually-guided manual pointing, reaching, and height-matching with increase in hand-to-body distance

Measurements were made of the accuracy of open-loop manual pointing and height-matching to a visual target whose elevation was perceptually mislocalized. Accuracy increased linearly with distance of the hand from the body, approaching complete accuracy at full extension; with the hand close to the body (within the midfrontal plane), the manual errors equaled the magnitude of the perceptual mislocalization. The visual inducing stimulus responsible for the perceptual errors was a single pitched-from-vertical line that was long (50 degrees), eccentrically-located (25 degrees horizontal), and viewed in otherwise total darkness. The line induced perceptual errors in the elevation of a small, circular visual target set to appear at eye level (VPEL), a setting that changed linearly with the change in the line's visual pitch as has been previously reported (pitch: -30 degrees topbackward to 30 degrees topforward); the elevation errors measured by VPEL settings varied systematically with pitch through an 18 degrees range. In a fourth experiment the visual inducing stimulus responsible for the perceptual errors was shown to induce separately-measured errors in the manual setting of the arm to feel horizontal that were also distance-dependent. The distance-dependence of the visually-induced changes in felt arm position accounts quantitatively for the distance-dependence of the manual errors in pointing/reaching and height matching to the visual target: The near equality of the changes in felt horizontal and changes in pointing/reaching with the finger at the end of the fully extended arm is responsible for the manual accuracy of the fully-extended point; with the finger in the midfrontal plane their large difference is responsible for the inaccuracies of the midfrontal-plane point. The results are inconsistent with the widely-held but controversial theory that visual spatial information employed for perception and action are dissociated and different with no illusory visual influence on action. A different two-system theory, the Proximal/Distal model, employing the same signals from vision and from the body-referenced mechanism with different weights for different hand-to-body distances, accounts for both the perceptual and the manual results in the present experiments.

Perceptual compensation for eye torsion

To correctly perceive visual directions relative to the head, one needs to compensate for the eye's orientation in the head. In this study we focus on compensation for the eye's torsion regarding objects that contain the line of sight and objects that do not pass through the fixation point. Subjects judged the location of flashed probe points relative to their binocular plane of regard, the mid-sagittal or the transverse plane of the head, while fixating straight ahead, right upward, or right downward at 30 cm distance, to evoke eye torsion according to Listing's law. In addition, we investigated the effects of head-tilt and monocular versus binocular viewing. Flashed probe points were correctly localized in the plane of regard irrespective of eccentric viewing, head-tilt, and monocular or binocular vision in nearly all subjects and conditions. Thus, eye torsion that varied by +/-9 degrees across these different conditions was in general compensated for. However, the position of probes relative to the midsagittal or the transverse plane, both true head-fixed planes, was misjudged. We conclude that judgment of the orientation of the plane of regard, a plane that contains the line of sight, is veridical, indicating accurate compensation for actual eye torsion. However, when judgment has to be made of a head-fixed plane that is offset with respect to the line of sight, eye torsion that accompanies that eye orientation appears not to be taken into account correctly.

Neural model for processing the influence of visual orientation on visually perceived eye level (VPEL)

An individual line or a combination of lines viewed in darkness has a large influence on the elevation to which an observer sets a target so that it is perceived to lie at eye level (VPEL). These influences are systematically related to the orientation of pitched-from-vertical lines on pitched plane(s) and to the lengths of the lines, as well as to the orientations of lines of 'equivalent pitch' that lie on frontoparallel planes. A three-stage model processes the visual influence: The first stage parallel processes the orientations of the lines utilizing 2 classes of orientation-sensitive neural units in each hemisphere, with the two classes sensitive to opposing ranges of orientations; the signal delivered by each class is of opposite sign in the two hemispheres. The second stage generates the total visual influence from the parallel combination of inputs delivered by the 4 groups of the first stage, and a third stage combines the total visual influence from the second stage with signals from the body-referenced mechanism that contains information about the position and orientation of the eyes, head, and body. The circuit equation describing the combined influence of n separate inputs from stage 1 on the output of the stage 2 integrating neuron is derived for n stimulus lines which possess any combination of orientations and lengths; Each of the n lines is assumed to stimulate one of the groups of orientation-sensitive units in visual cortex (stage 1) whose signals converge on to a dendrite of the integrating neuron (stage 2), and to produce changes in postsynaptic membrane conductance (g(i)) and potential (V(i)) there. The net current from the n dendrites results in a voltage change (V(A)) at the initial segment of the axon of the integrating neuron. Nerve impulse frequency proportional to this voltage change signals the total visual influence on perceived elevation of the visual field. The circuit equation corresponding to the total visual influence for n equal length inducing lines is V(A)= sum V(i)/[n+(g(A)/g(S))], where the potential change due to line i, V(i), is proportional to line orientation, g(A) is the conductance at the axon's summing point, and g(S)=g(i) for each i for the equal length case; the net conductance change due to a line is proportional to the line's length. The circuit equation is interpreted as a basis for quantitative predictions from the model that can be compared to psychophysical measurements of the elevation of VPEL. The interpretation provides the predicted relation for the visual influence on VPEL, V, by n inducing lines each with length l: thus, V=a+[k(i) sum theta(i)/n+(k(2)/l)], where theta(i) is the orientation of line i, a is the effect of the body-referenced mechanism, and k(1) and k(2) are constants. The model's output is fitted to the results of five sets of experiments in which the elevation of VPEL measured with a small target in the median plane is systematically influenced by distantly located 1-line or 2-line inducing stimuli varying in orientation and length and viewed in otherwise total darkness with gaze restricted to the median plane; each line is located at either 25 degrees eccentricity to the left or right of the median plane. The model predicts the negatively accelerated growth of VPEL with line length for each orientation and the change of slope constant of the linear combination rule among lines from 1.00 (linear summation; short lines) to 0.61 (near-averaging; long lines). Fits to the data are obtained over a range of orientations from -30 degrees to +30 degrees of pitch for 1-line visual fields from lengths of 3 degrees to 64 degrees, for parallel 2-line visual fields over the same range of lengths and orientations, for short and long 2-line combinations in which each of the two members may have any orientation (parallel or nonparallel pairs), and for the well-illuminated and fully structured pitchroom. In addition, similar experiments with 2-line stimuli of equivalent pitch in the frontoparallel plane were also fitted to the model. The model accounts for more than 98% of the variance of the results in each case.