Low-Latency Ocular Parallax Rendering and Investigation of Its Effect on Depth Perception in Virtual Reality

With a demand for an immersive experience in virtual/augmented reality (VR/AR) displays, recent efforts have incorporated eye states, such as focus and fixation, into display graphics. Among these, ocular parallax, a small parallax generated by eye rotation, has received considerable attention for its impact on depth perception. However, the substantial latency of head-mounted displays (HMDs) has made it challenging to accurately assess its true effect during free eye movements. To address this issue, we propose a high-speed (360 Hz) and low-latency (4.8 ms) ocular parallax rendering system with a custom-built eye tracker. Using this proposed system, we conducted an investigation to determine the latency requirements necessary for achieving perceptually stable ocular parallax rendering. Our findings indicate that, in binocular viewing, ocular parallax rendering is perceived as significantly less stable than conventional rendering when the latency exceeds 43.72 ms at 1.3 D and 21.50 ms at 2.0 D. We also evaluated the effects of ocular parallax rendering on binocular fusion and monocular depth perception under free viewing conditions. The results demonstrated that ocular parallax rendering can enhance binocular fusion but has a limited impact on depth perception under monocular viewing conditions when latency is minimized.

Classification images for aerial images capture visual expertise for binocular disparity and a prior for lighting from above

Using a novel approach to classification images (CIs), we investigated the visual expertise of surveyors for luminance and binocular disparity cues simultaneously after screening for stereoacuity. Stereoscopic aerial images of hedges and ditches were classified in 10,000 trials by six trained remote sensing surveyors and six novices. Images were heavily masked with luminance and disparity noise simultaneously. Hedge and ditch images had reversed disparity on around half the trials meaning hedges became ditch-like and vice versa. The hedge and ditch images were also flipped vertically on around half the trials, changing the direction of the light source and completing a 2 × 2 × 2 stimulus design. CIs were generated by accumulating the noise textures associated with "hedge" and "ditch" classifications, respectively, and subtracting one from the other. Typical CIs had a central peak with one or two negative side-lobes. We found clear differences in the amplitudes and shapes of perceptual templates across groups and noise-type, with experts prioritizing binocular disparity and using this more effectively. Contrariwise, novices used luminance cues more than experts meaning that task motivation alone could not explain group differences. Asymmetries in the luminance CIs revealed individual differences for lighting interpretation, with experts less prone to assume lighting from above, consistent with their training on aerial images of UK scenes lit by a southerly sun. Our results show that (i) dual noise in images can be used to produce simultaneous CI pairs, (ii) expertise for disparity cues does not depend on stereoacuity, (iii) CIs reveal the visual strategies developed by experts, (iv) top-down perceptual biases can be overcome with long-term learning effects, and (v) CIs have practical potential for directing visual training.

Short communication: Binocular rivalry dynamics during locomotion

Locomotion has been shown to impact aspects of visual processing in both humans and animal models. In the current study, we assess the impact of locomotion on the dynamics of binocular rivalry. We presented orthogonal gratings, one contrast-modulating at 0.8 Hz (matching average step frequency) and the other at 3.2 Hz, to participants using a virtual reality headset. We compared two conditions: stationary and walking. We continuously monitored participants' foot position using tracking devices to measure the step cycle. During the walking condition, participants viewed the rivaling gratings for 60-second trials while walking on a circular path in a virtual reality environment. During the stationary condition, observers viewed the same stimuli and environment while standing still. The task was to continuously indicate the dominant percept via button press using handheld controllers. We found no significant differences between walking and standing for normalized dominance duration distributions, mean normalized dominance distributions, mean alternation rates, or mean fitted frequencies. Although our findings do not align with prior research highlighting distinctions in normalized dominance distributions between walking and standing, our study contributes unique evidence indicating that alternation rates vary across the step cycle. Specifically, we observed that the number of alternations is at its lowest during toe-off phases and reaches its peak at heel strike. This novel insight enhances our understanding of the dynamic nature of alternation patterns throughout the step cycle.

Absolute and relative disparity mechanisms revealed by an equivalent noise analysis

The precision of stereopsis and vergence are ultimately limited by internal binocular disparity noise. Here we propose an equivalent noise model with both global and local internal disparity noises to provide a unified explanation of both absolute and relative disparity thresholds. To test this model, we developed a psychophysical procedure to measure the equivalent internal disparity noise by adding external disparity noise to random-Gabor-patch stereograms. We used the method of constant stimuli to measure the minimum and maximum disparity thresholds (Dmin and Dmax) for both absolute and relative disparity. Consistent with previous studies, we found that Dmin thresholds are substantially worse for absolute disparity than for relative disparity. We tested three relative disparity mechanisms: (1) the difference between the monocular separations of targets projecting to the two eyes; (2) the direct measurement of relative disparity; and (3) the difference of absolute disparities of targets. Computing the difference of absolute disparities when detecting relative disparity, Mechanism 3 cancels global noise, resulting in a much lower relative Dmin threshold, and provides a reasonable fit to the experimental data. We also found that the presence of as much as 2400 arcsec of external disparity noise does not appear to affect the Dmax threshold. This observation suggests that Dmax is implicated in a mechanism that disregards the disparity variance of individual items, relying instead on the average disparity across all items, supporting the depth model proposed in our previous study (Ding & Levi, 2021), which posits distinct mechanisms governing Dmin and Dmax thresholds.

Effect of 3-D depth structure, element size, and area containing elements on total-element overestimation phenomenon

The number of elements distributed in a three-dimensional stimulus is overestimated compared to a two-dimensional stimulus when both stimuli have the same number of elements. We examined the effect of the properties of a three-dimensional stimulus (the number of overlapping stereo surfaces, size of the elements, and size of the area containing elements, on the overestimation phenomenon in four experiments. The two stimuli were presented side-by-side with the same diameters. Observers judged which of the three-dimensional standard and two-dimensional comparison had more elements. The results showed that (a) the overestimation phenomenon occurred for the three-dimensional standard stimuli, (b) the size of the areas affected the amount of overestimation, while the number of overlapping stereo surfaces and size of elements did not, and (c) the amount of overestimation increased when the stimuli included more than 100 elements. Implications of these findings were discussed in the framework of back-surface bias, occlusion, and disparity-processing interference models.

Effects of binocular disparity on binocular luminance combination

This study aimed to examine the effects of binocular disparity on binocular combination of brightness information coming from luminance increments and decrements. The point of subjective equality was determined by asking the observers to judge which stimulus appeared brighter-a bar stimulus with variable disparity or another stimulus with zero disparity. For the bar stimulus, the interocular luminance ratio was varied to trace an equal brightness curve. Binocular disparity had no effect on luminance increments presented on a gray or black background. In contrast, when luminance decrements were presented on a gray background, non-zero disparities elevated points of subjective equality for stimuli with interocular luminance differences. This means that the binocular brightness combination of the two monocular signals shifted from winner-take-all summation toward linear averaging. It has been argued that this effect may be caused by non-zero binocular disparities attenuating interocular suppression, which is deemed to operate normally with zero disparity.

Transformations of sensory information in the brain suggest changing criteria for optimality

Neurons throughout the brain modulate their firing rate lawfully in response to sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization in which neurons aim to robustly and efficiently represent sensory information. Our understanding of how this optimization varies across different areas in the brain, however, is still in its infancy. Here, we show that neural sensory responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation towards optimizing for perceptual discrimination. Focusing on the representation of binocular disparities-the slight differences in the retinal images of the two eyes-we re-analyze measurements characterizing neuronal tuning curves in brain areas V1, V2, and MT (middle temporal) in the macaque monkey. We compare these to measurements of the statistics of binocular disparity typically encountered during natural behaviors using a Fisher Information framework. The differences in tuning curve characteristics across areas are consistent with a shift in optimization goals: V1 and V2 population-level responses are more consistent with maximizing the information encoded about naturally occurring binocular disparities, while MT responses shift towards maximizing the ability to support disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective areas of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings emphasize the need to consider not just information preservation and neural resources, but also relevance to behavior, when assessing the optimality of neural codes.

An Accumulating Neural Signal Underlying Binocular Rivalry Dynamics

During binocular rivalry, conflicting images are presented one to each eye and perception alternates stochastically between them. Despite stable percepts between alternations, modeling suggests that neural signals representing the two images change gradually, and that the duration of stable percepts are determined by the time required for these signals to reach a threshold that triggers an alternation. However, direct physiological evidence for such signals has been lacking. Here, we identify a neural signal in the human visual cortex that shows these predicted properties. We measured steady-state visual evoked potentials (SSVEPs) in 84 human participants (62 females, 22 males) who were presented with orthogonal gratings, one to each eye, flickering at different frequencies. Participants indicated their percept while EEG data were collected. The time courses of the SSVEP amplitudes at the two frequencies were then compared across different percept durations, within participants. For all durations, the amplitude of signals corresponding to the suppressed stimulus increased and the amplitude corresponding to the dominant stimulus decreased throughout the percept. Critically, longer percepts were characterized by more gradual increases in the suppressed signal and more gradual decreases of the dominant signal. Changes in signals were similar and rapid at the end of all percepts, presumably reflecting perceptual transitions. These features of the SSVEP time courses are well predicted by a model in which perceptual transitions are produced by the accumulation of noisy signals. Identification of this signal underlying binocular rivalry should allow strong tests of neural models of rivalry, bistable perception, and neural suppression.SIGNIFICANCE STATEMENT During binocular rivalry, two conflicting images are presented to the two eyes and perception alternates between them, with switches occurring at seemingly random times. Rivalry is an important and longstanding model system in neuroscience, used for understanding neural suppression, intrinsic neural dynamics, and even the neural correlates of consciousness. All models of rivalry propose that it depends on gradually changing neural activity that on reaching some threshold triggers the perceptual switches. This manuscript reports the first physiological measurement of neural signals with that set of properties in human participants. The signals, measured with EEG in human observers, closely match the predictions of recent models of rivalry, and should pave the way for much future work.

Invited Session V: Binocular vision and interactions: Depth perception in virtual environments: The role of experience

In this presentation I'll review results of stereoacuity, disparity matching and depth magnitude estimation studies in which comparison of so-called naïve and experienced observers shows substantive differences in performance. I will describe our working theory that the critical difference between these groups is their tolerance to conflicts between stereopsis and other sources of depth information. Further, I will review some recent data that suggest there are some conflicts that even experienced 3D participants cannot disregard.

The effect of training on sensitivity and stability of double fusion in Panum's limiting case

Panum's limiting case is a phenomenon of monocular occlusion in binocular vision. This occurs when one object is occluded by the other object for one eye, but the two objects are both visible for the other eye. Although previous studies have found that vertical gradient of horizontal disparity and cue conflict are two important factors for double fusion, the effect of training on the sensitivity and stability of Panum's limiting case remains unknown. The current study trained 26 participants for 5 days with several of Panum's configurations (Gilliam, Frisby, and Wang series). The latency and duration of double fusion were recorded to examine the effects of training on sensitivity and stability of double fusion in Panum's limiting case. For each level of vertical gradient of horizontal disparity and cue conflict, the latency of double fusion decreased and the duration of double fusion increased with each additional training session. The results showed that vertical gradient of horizontal disparity and cue conflict interacted, and the duration of high cue conflict was significantly shorter than that of medium and low cue conflict for each level of vertical gradient of horizontal disparity. The findings suggest that there is an effect of training for vertical gradient of horizontal disparity and cue conflict in Panum's limiting case, and that the three factors jointly affect the sensitivity and stability of double fusion.

Coarse-to-fine interaction on perceived depth in compound grating

To encode binocular disparity, the visual system uses a pair of left eye and right eye bandpass filters with either a position or a phase offset between them. Such pairs are considered to exit at multiple scales to encode a wide range of disparity. However, local disparity measurements by bandpass mechanisms can be ambiguous, particularly when the actual disparity is larger than a half-cycle of the preferred spatial frequency of the filter, which often occurs in fine scales. In this study, we investigated whether the visual system uses a coarse-to-fine interaction to resolve this ambiguity at finer scales for depth estimation from disparity. The stimuli were stereo grating patches composed of a target and comparison patterns. The target patterns contained spatial frequencies of 1 and 4 cycles per degree (cpd). The phase disparity of the low-frequency component was 0° (at the horopter), -90° (uncrossed), or 90° (crossed), and that of the high-frequency components was changed independent of the low-frequency disparity, in the range between -90° (uncrossed) and 90° (crossed). The observers' task was to indicate whether the target appeared closer to the comparison pattern, which always shared the disparity with the low-frequency component of the target. Regardless of whether the comparison pattern was a 1-cpd + 4-cpd compound or a 1-cpd simple grating, the perceived depth order of the target and the comparison varied in accordance with the phase disparity of the high-frequency component of the target. This effect occurred not only when the low-frequency component was at the horopter, but also when it contained a large disparity corresponding to one cycle of the high-frequency component (±90°). Our findings suggest a coarse-to-fine interaction in multiscale disparity processing, in which the depth interpretation of the high-frequency changes based on the disparity of the low-frequency component.

Disparities in Eye Care Access and Utilization: A Narrative Review

This narrative review summarizes the literature on factors related to eye care access and utilization in the United States. Using the Healthy People 2030 framework, this review investigates social determinants of health associated with general and follow-up engagement, screenings, diagnostic visits, treatment, technology, and teleophthalmology. We provide hypotheses for these documented eye care disparities, featuring qualitative, patient-centered research. Lastly, we provide recommendations in the hopes of appropriately eliminating these disparities and reimagining eye care.

Integration and suppression interact in binocular vision

Contingent on stereo compatibility, two images presented dichoptically can lead to either binocular integration, thus generating stable stereopsis, or interocular suppression that induces binocular rivalry with bistable perception that alternates between the two images. The relationship between binocular integration and interocular suppression concerns how our brain processes binocular inputs to form unified visual awareness but remains unclear. Here, a series of psychophysical experiments were conducted to address this question, revealing that these collaborative and competitive binocular interactions are interconnected and would mediate one another according to their strength. Specifically, Experiments 1a and 1b showed that the presence of binocular rivalry inhibited peripheral stereopsis, significantly elevating the stereo threshold, with higher elevation resulting from increasing rivalry contrast. Experiments 2a and 2b showed that existing stereopsis with increasing binocular disparity balanced the dynamics of peripheral binocular rivalry, rendering more equivalent eye dominance. Based on these interactions, we suggest that binocular integration and interocular suppression may mediate one another through an overlapping mechanism for regulating eye dominance, with strong stereo percepts tending to reduce eye dominance and strong rivalry tending to increase eye dominance.

Topical Review: Methodological Variables in Clinical and Laboratory Measurements of Fixation Disparity

SIGNIFICANCE

Fixation disparity is a small vergence error that does not disrupt fusion. Fixation disparity measures correlate with binocular symptoms. This article covers methodological differences between clinical fixation disparity measurement devices, findings when objective and subjective fixation disparities are compared, and the potential impact of binocular capture on fixation disparity measurements. Fixation disparity is a small vergence error that occurs in nonstrabismic individuals and does not disrupt fusion. This article reviews clinical fixation disparity variables and their clinical diagnostic value. Clinical devices that are used to measure these variables are described, as are studies in which the output from these devices has been compared. Methodological differences between the devices such as the location of the fusional stimulus, the rate at which judgments of dichoptic alignment are made, and the strength of the accommodative stimulus are all considered. In addition, the article covers theories of the neural origins of fixation disparity and control system models incorporating fixation disparity. Studies in which objective fixation disparities (oculomotor portion of fixation disparity assessed with an eye tracker) and subjective fixation disparities (sensory portion of fixation disparity assessed psychophysically with dichoptic Nonius lines) have been compared are also examined, and consideration is given to why some investigators find differences in these measures, whereas other investigators do not. The conclusion thus far is that there are likely complex interactions between vergence adaptation, accommodation, and the location of the fusional stimulus that lead to differences in objective and subjective fixation disparity measures. Finally, capture of the visual direction of monocular stimuli by adjacent fusional stimuli and the implications for fixation disparity measures are considered.

Top-down modulation on depth processing: Visual searches for metric and ordinal depth information show a pattern of dissociation

Depending on the goal, one can selectively process the metric depth or the ordinal depth information in the same scene. It is unknown whether the metric depth and ordinal depth information are processed through a shared or different underlying mechanisms. Here, we investigated the processing of the metric depth and ordinal depth using visual search. Items were presented at multiple depth planes defined by the binocular disparity, with one item per depth plane. In the metric-search task, participants were required to search for the target on a particular depth plane, among one to three distractors. In the ordinal-search task, the target was specified by its depth order indicated by numbers (smaller numbers indicated nearer depth planes). We found that the ordinal search was faster and more accurate than the metric search, and the data showed a pattern of dissociation. Metric search, but not ordinal search, was slowed when the target and distractors were closer in depth, while ordinal search was slower for the middle than the edge positions but metric search was unaffected. These two opposite effects suggest that metric depth and ordinal depth may be processed differently.

Subtractive adaptation is a more effective and general mechanism in binocular rivalry than divisive adaptation

The activity of neurons is influenced by random fluctuations and can be strongly modulated by firing rate adaptation, particularly in sensory systems. Still, there is ongoing debate about the characteristics of neuronal noise and the mechanisms of adaptation, and even less is known about how exactly they affect perception. Noise and adaptation are critical in binocular rivalry, a visual phenomenon where two images compete for perceptual dominance. Here, we investigated the effects of different noise processes and adaptation mechanisms on visual perception by simulating a model of binocular rivalry with Gaussian white noise, Ornstein-Uhlenbeck noise, and pink noise, in variants with divisive adaptation, subtractive adaptation, and without adaptation. By simulating the nine models in parameter space, we find that white noise only produces rivalry when paired with subtractive adaptation and that subtractive adaptation reduces the influence of noise intensity on rivalry strength and introduces convergence of the mean percept duration, an important metric of binocular rivalry, across all noise processes. In sum, our results show that white noise is an insufficient description of background activity in the brain and that subtractive adaptation is a stronger and more general switching mechanism in binocular rivalry than divisive adaptation, with important noise-filtering properties.

Perceiving depth from texture and disparity cues: Evidence for a non-probabilistic account of cue integration

Bayesian inference theories have been extensively used to model how the brain derives three-dimensional (3D) information from ambiguous visual input. In particular, the maximum likelihood estimation (MLE) model combines estimates from multiple depth cues according to their relative reliability to produce the most probable 3D interpretation. Here, we tested an alternative theory of cue integration, termed the intrinsic constraint (IC) theory, which postulates that the visual system derives the most stable, not most probable, interpretation of the visual input amid variations in viewing conditions. The vector sum model provides a normative approach for achieving this goal where individual cue estimates are components of a multidimensional vector whose norm determines the combined estimate. Individual cue estimates are not accurate but related to distal 3D properties through a deterministic mapping. In three experiments, we show that the IC theory can more adeptly account for 3D cue integration than MLE models. In Experiment 1, we show systematic biases in the perception of depth from texture and depth from binocular disparity. Critically, we demonstrate that the vector sum model predicts an increase in perceived depth when these cues are combined. In Experiment 2, we illustrate the IC theory radical reinterpretation of the just noticeable difference (JND) and test the related vector sum model prediction of the classic finding of smaller JNDs for combined-cue versus single-cue stimuli. In Experiment 3, we confirm the vector sum prediction that biases found in cue integration experiments cannot be attributed to flatness cues, as the MLE model predicts.

Fixation disparity and refractive error among first-year optometry students

PURPOSE

To determine the fixation disparity and refractive error of first-year optometry students to ascertain any relationship between them and also identify any association between fixation disparity and visual symptoms at near.

METHOD

It was an analytical cross-sectional study involving 85 participants aged 17 to 27 years (18.60 ± 1.37), 41% of whom were males. Subjective refraction was done at 3 m and fixation disparity was measured with and without spectacle correction using the Wesson Fixation Disparity Card. All analysis was set within a 95% confidence interval with a p-value ≤ 0.05 considered statistically significant.

RESULTS

Refractive error ranged from 0.25 SEQ (spherical equivalent) to 5.50 SEQ. Mean fixation disparity ranged from 2.9 ± 2.6 to 3.9 ± 2.8 min arc. There was no statistically significant correlation between refractive error and fixation disparity without correction (r = -0.180, p = 0.098) and with correction (r = 0.155, p = 0.157). For fixation disparity in the ortho and exo direction, mean fixation disparity with correction of participants who experienced headaches during or after reading (5.1 ± 2.6 min arc) was significantly higher (p = 0.032) than participants who did not (2.0 ± 2.6 min arc).

CONCLUSION

Myopia is common among first-year optometry students. Refractive error has no significant effect on fixation disparity. Headache is significantly associated with exo fixation disparity at near.

Neural representations of competing stimuli along the dorsal and ventral visual pathways during binocular rivalry

Binocular rivalry arises when two discrepant stimuli are simultaneously presented to different eyes, during which observers consciously experience vivid perceptual alternations without physical changes in visual inputs. Neural dynamics tracking such perceptual alternations have been identified at both early and late visual areas, leading to the fundamental debate concerning the primary neural substrate underlying binocular rivalry. One promising hypothesis that might reconcile these seemingly paradoxical findings is a gradual shift from interocular competition between monocular neurons to pattern competition among binocular neurons. Here, we examined this hypothesis by investigating how neural representations of rivalrous stimuli evolved along the visual pathway. We found that representations of the dominant and the suppressed stimuli initially co-existed in V1, which were enhanced and attenuated respectively in extrastriate visual areas. Notably, neural activity in V4 was dictated by the representation of the dominant stimulus, while the representation of the suppressed stimulus was only partially inhibited in dorsal areas V3A and MT+. Our findings revealed a progressive transition from the co-existing representations of the rivalrous inputs to the dictatorial representation of the dominant stimulus in the ventral pathway, and advocated different cortical evolutionary patterns of visual representations between the dorsal and the ventral pathways.

High-resolution quantitative and functional MRI indicate lower myelination of thin and thick stripes in human secondary visual cortex

The characterization of cortical myelination is essential for the study of structure-function relationships in the human brain. However, knowledge about cortical myelination is largely based on post-mortem histology, which generally renders direct comparison to function impossible. The repeating pattern of pale-thin-pale-thick stripes of cytochrome oxidase (CO) activity in the primate secondary visual cortex (V2) is a prominent columnar system, in which histology also indicates different myelination of thin/thick versus pale stripes. We used quantitative magnetic resonance imaging (qMRI) in conjunction with functional magnetic resonance imaging (fMRI) at ultra-high field strength (7 T) to localize and study myelination of stripes in four human participants at sub-millimeter resolution in vivo. Thin and thick stripes were functionally localized by exploiting their sensitivity to color and binocular disparity, respectively. Resulting functional activation maps showed robust stripe patterns in V2 which enabled further comparison of quantitative relaxation parameters between stripe types. Thereby, we found lower longitudinal relaxation rates (R1) of thin and thick stripes compared to surrounding gray matter in the order of 1-2%, indicating higher myelination of pale stripes. No consistent differences were found for effective transverse relaxation rates (R2*). The study demonstrates the feasibility to investigate structure-function relationships in living humans within one cortical area at the level of columnar systems using qMRI.

Stereopsis for rapidly moving targets

Stereoscopic depth perception is possible with luminance-defined target velocities at least as high as 600° s-1, up to the limit of 30 Hz imposed by the high-temporal frequency cut-off of the eye. The limitation for perceiving depth from stereo disparity of moving targets is not their velocity but the temporal frequency bandwidth of the eye, which is affected by adaption state. Stereoacuity for a depth shift in a horizontally moving grating depends not on spatial disparity between corresponding luminance points in spatial units of arc min, but on the spatial shift as a fixed proportion of the period of the grating, in other words, on the phase angle difference between the two eyes, as is also the case for obliquely orientated, stationary gratings. Phase differences explain not only the classic Pulfrich stereophenomenon but its equivalent with dynamic visual noise, and a new effect in which depth results from interocular phase differences in luminance modulation. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Effect of binocular disparity on learning anatomy with stereoscopic augmented reality visualization: A double center randomized controlled trial

Binocular disparity provides one of the important depth cues within stereoscopic three-dimensional (3D) visualization technology. However, there is limited research on its effect on learning within a 3D augmented reality (AR) environment. This study evaluated the effect of binocular disparity on the acquisition of anatomical knowledge and perceived cognitive load in relation to visual-spatial abilities. In a double-center randomized controlled trial, first-year (bio)medical undergraduates studied lower extremity anatomy in an interactive 3D AR environment either with a stereoscopic 3D view (n = 32) or monoscopic 3D view (n = 34). Visual-spatial abilities were tested with a mental rotation test. Anatomical knowledge was assessed by a validated 30-item written test and 30-item specimen test. Cognitive load was measured by the NASA-TLX questionnaire. Students in the stereoscopic 3D and monoscopic 3D groups performed equally well in terms of percentage correct answers (written test: 47.9 ± 15.8 vs. 49.1 ± 18.3; P = 0.635; specimen test: 43.0 ± 17.9 vs. 46.3 ± 15.1; P = 0.429), and perceived cognitive load scores (6.2 ± 1.0 vs. 6.2 ± 1.3; P = 0.992). Regardless of intervention, visual-spatial abilities were positively associated with the specimen test scores (η² = 0.13, P = 0.003), perceived representativeness of the anatomy test questions (P = 0.010) and subjective improvement in anatomy knowledge (P < 0.001). In conclusion, binocular disparity does not improve learning anatomy. Motion parallax should be considered as another important depth cue that contributes to depth perception during learning in a stereoscopic 3D AR environment.

Strong tuning for stereoscopic depth indicates orientation-specific recurrent circuitry in tree shrew V1

Neurons in the primary visual cortex (V1) are tuned to specific disparities between the two retinal images, which form the neural substrate for stereoscopic vision. We show that V1 neurons in tree shrews, but not in mice, display highly selective responses to narrow ranges of disparity in random-dot stereograms. Surprisingly, V1 neurons in both species show similarly strong tuning to gratings of varying interocular phase differences. This stimulus-dependent dissociation of disparity tuning can be explained by a network model that combines both feedforward and recurrent connections. The features of the model connections are supported by cortical organizations specific to each species. We validate this model by identifying putative inhibitory neurons and confirming their predicted disparity tuning in both species. Together, our studies establish a foundation for using tree shrews in studying binocular vision and raise an exciting possibility of how cortical columns could be uniquely important in computing stereoscopic depth.

Spatial-temporal contrast sensitivity of the eye alignment reflex

The binocular alignment of the eyes involves both voluntary and reflexive mechanisms, but little is known about the visual input and neurological pathway of the reflex component. Our studies examined the role of spatiotemporal frequency and contrast in the control of reflex eye alignment, and compared the contrast sensitivity of the alignment reflex with psychophysical contrast sensitivity. We measured the contrast sensitivity of vertical disparity-driven vergence eye movements in response to bandwidth filtered static or 6 Hz counterphase flickering noise and measured psychophysical detection sensitivity for the same stimuli. Contrast thresholds for producing a detectable vertical alignment change (measured with nonius lines) were determined using a staircase method for 7 spatial frequencies [0.25-16 cycles per degree] and 3 vertical disparities [5, 10, and 30 arcmin] in 7 adults with normal or corrected to normal vision. The main findings of this study are, (1) the vertical alignment reflex had overall relatively high contrast sensitivity, comparable to but somewhat less than visual detection thresholds, (2) the most effective stimulus spatial frequency scaled in inverse proportion to the disparity being stimulated, and (3) unlike psychophysical contrast sensitivity, the eye alignment reflex contrast sensitivity was not improved by flickering low spatial frequencies.

Cognitive penetrability of scene representations based on horizontal image disparities

The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers' task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.

Transformer Based Binocular Disparity Prediction with Occlusion Predict and Novel Full Connection Layers

The depth estimation algorithm based on the convolutional neural network has many limitations and defects by constructing matching cost volume to calculate the disparity: using a limited disparity range, the authentic disparity beyond the predetermined range can not be acquired; Besides, the matching process lacks constraints on occlusion and matching uniqueness; Also, as a local feature extractor, a convolutional neural network lacks the ability of global context information perception. Aiming at the problems in the matching method of constructing matching cost volume, we propose a disparity prediction algorithm based on Transformer, which specifically comprises the Swin-SPP module for feature extraction based on Swin Transformer, Transformer disparity matching network based on self-attention and cross-attention mechanism, and occlusion prediction sub-network. In addition, we propose a double skip connection fully connected layer to solve the problems of gradient vanishing and explosion during the training process for the Transformer model, thus further enhancing inference accuracy. The proposed model in this paper achieved an EPE (Absolute error) of 0.57 and 0.61, and a 3PE (Percentage error greater than 3 px) of 1.74% and 1.56% on KITTI 2012 and KITTI 2015 datasets, respectively, with an inference time of 0.46 s and parameters as low as only 2.6 M, showing great advantages compared with other algorithms in various evaluation metrics.

Robust natural depth for anticorrelated random dot stereogram for edge stimuli, but minimal reversed depth for embedded circular stimuli, irrespective of eccentricity

The small differences between the images formed in our left and right eyes are an important cue to the three-dimensional structure of scenes. These disparities are encoded by binocular neurons in the visual cortex. At the earliest stage of processing, these respond to binocular correlation between images. We assessed the perception of depth in anticorrelated stimuli, in which the contrast polarity in one eye is reversed, as a function of their location in the retinal image, and their depth configuration (a horizontal edge or a circle surrounded by an annulus) We found that, regardless of stimulus eccentricity, participants perceived depth in the natural direction for edge stimuli, and weakened, reversed depth for circular stimuli.

A computational model of stereoscopic prey capture in praying mantises

We present a simple model which can account for the stereoscopic sensitivity of praying mantis predatory strikes. The model consists of a single “disparity sensor”: a binocular neuron sensitive to stereoscopic disparity and thus to distance from the animal. The model is based closely on the known behavioural and neurophysiological properties of mantis stereopsis. The monocular inputs to the neuron reflect temporal change and are insensitive to contrast sign, making the sensor insensitive to interocular correlation. The monocular receptive fields have a excitatory centre and inhibitory surround, making them tuned to size. The disparity sensor combines inputs from the two eyes linearly, applies a threshold and then an exponent output nonlinearity. The activity of the sensor represents the model mantis’s instantaneous probability of striking. We integrate this over the stimulus duration to obtain the expected number of strikes in response to moving targets with different stereoscopic disparity, size and vertical disparity. We optimised the parameters of the model so as to bring its predictions into agreement with our empirical data on mean strike rate as a function of stimulus size and disparity. The model proves capable of reproducing the relatively broad tuning to size and narrow tuning to stereoscopic disparity seen in mantis striking behaviour. Although the model has only a single centre-surround receptive field in each eye, it displays qualitatively the same interaction between size and disparity as we observed in real mantids: the preferred size increases as simulated prey distance increases beyond the preferred distance. We show that this occurs because of a stereoscopic “false match” between the leading edge of the stimulus in one eye and its trailing edge in the other; further work will be required to find whether such false matches occur in real mantises. Importantly, the model also displays realistic responses to stimuli with vertical disparity and to pairs of identical stimuli offering a “ghost match”, despite not being fitted to these data. This is the first image-computable model of insect stereopsis, and reproduces key features of both neurophysiology and striking behaviour.

The praying mantis is the only insect so far known to compute depth using stereoscopic (3D) vision. Mantis stereopsis appears to be simpler than human stereopsis and most machine sterovision algorithms. A computational model of mantis stereopsis may therefore be beneficial to the field of robotics, particularly where computational power is limited. Using a combination of behavioural observations and neurophysiological data, we propose a very simple model structure to describe the prey capture response in the praying mantis. We used the limited available data on the mantis’ size and distance preferences for its prey to train our model parameters. Our simple model is able to qualitatively reproduce previously unexplained characteristics of our training data, and predicts key observations in additional empirical data that was not included in the model training. Whilst we believe our model to be only a partial and heavily simplified account of mantis stereopsis, our results are supportive of our model structure as an approximation of the size and disparity sensors used by the mantis when catching its prey.

Perceptual Adaptation to Continuous Versus Intermittent Exposure to Spatial Distortions

Purpose

To examine perceptual adaptation when people wear spectacles that produce unequal retinal image magnification.

Methods

Two groups of 15 participants (10 male; mean age 25.6 ± 4.9 years) wore spectacles with a 3.8% horizontal magnifier over one eye. The continuous-wear group wore the spectacles for 5 hours straight. The intermittent-wear group wore them for five 1-hour intervals. To measure slant and shape distortions produced by the spectacles, participants adjusted visual stimuli until they appeared frontoparallel or equiangular, respectively. Adaptation was quantified as the difference in responses at the beginning and end of wearing the spectacles. Aftereffects were quantified as the difference before and after removing the spectacles. We hypothesized that intermittent wear may lead to visual cue reweighting, so we fit a cue combination model to the data and examined changes in weights given to perspective and binocular disparity slant cues.

Results

Both groups experienced significant shape adaptation and aftereffects. The continuous-wear group underwent significant slant adaptation and the intermittent group did not, but there was no significant difference between groups, suggesting that the difference in adaptation was negligible. There was no evidence for cue reweighting in the intermittent wear group, but unexpectedly, the weight given to binocular disparity cues for slant increased significantly in the continuous-wear group.

Conclusions

We did not find strong evidence that adaptation to spatial distortions differed between the two groups. However, there may be differences in the cue weighting strategies employed when spectacles are worn intermittently or continuously.

Task-Specific Employment of Sensory Signals Underlies Rapid Task Switching

Much of our flexible behavior is dependent on responding efficiently to relevant information while discarding irrelevant information. Little is known, however, about how neural pathways governing sensory-motor associations can rapidly switch to accomplish such flexibility. Here, we addressed this question by electrically microstimulating middle temporal (MT) neurons selective for both motion direction and binocular disparity in monkeys switching between direction and depth discrimination tasks. Surprisingly, we frequently found that the observed psychophysical bias precipitated by delivering microstimulation to neurons whose preferred direction and depth were related to opposite choices in the two tasks was substantially shifted toward a specific movement. Furthermore, these effects correlated with behavioral switching performance. Our findings suggest that the outputs of sensory signals are task specific and that irrelevant sensory-motor pathways are gated depending on task demand so as to accomplish rapid attentional switching.

[Neural Mechanism Underlying Stereoscopic Depth Perception: Why are the Two Eyes Aligned?]

This paper explains the basics of depth perception and explores why both eyes are aligned. We concluded that the brain may analyze image features for binocular fusion while calculating the horizontal disparity for depth perception.

The magnitude of monocular light attenuation required to elicit the Pulfrich illusion

In the Pulfrich illusion, the depth of a moving object is misperceived due to induced retinal disparity and/or interocular velocity differences arising from differences in luminance, contrast, or spatial frequency between the two eyes. These effects have been shown to occur both for visual deficits and for optical corrections that introduce significant binocular differences between the retinal images. However, it remains unknown to what extent the illusion might arise given normal variation between the eyes, such as natural interocular variation in pupil diameter (anisocoria). To assess this, we examined the threshold interocular retinal illuminance difference required to experience illusory depth in two random-dot fields moving in opposite directions in 24 normally-sighted observers with dilated pupils. Interocular difference in retinal illuminance was induced by placing neutral density filters of different intensities before the left eye. A minority of subjects (n = 8) did not provide meaningful data on changes in the experience of illusory depth with interocular difference in retinal illuminance and four subjects showed biases >±10% from the 50% point of subjective equality in the psychometric function. For the remaining 12 participants, the retinal illuminance had to differ by approximately 40% for the depth between the planes to become visible at threshold levels. This difference was approximately constant over a range of absolute luminance levels from 10 to 80 cd/m2. Our results suggest that while motion-in-depth illusions due to interocular differences in retinal illuminance may be pronounced in certain ophthalmic diseases or following certain optical interventions, it is unlikely to be manifest as a result of normal interocular variations in retinal illuminance. Further, our results also point towards the existence of substantial individual differences in the experience of what is otherwise thought of as a readily appreciable motion-in-depth illusion.

Spatiotemporal integration of isolated binocular three-dimensional motion cues

Two primary binocular cues-based on velocities seen by the two eyes or on temporal changes in binocular disparity-support the perception of three-dimensional (3D) motion. Although these cues support 3D motion perception in different perceptual tasks or regimes, stimulus cross-cue contamination and/or substantial differences in spatiotemporal structure have complicated interpretations. We introduce novel psychophysical stimuli which cleanly isolate the cues, based on a design introduced in oculomotor work (Sheliga, Quaia, FitzGibbon, & Cumming, 2016). We then use these stimuli to characterize and compare the temporal and spatial integration properties of velocity- and disparity-based mechanisms. On average, temporal integration of velocity-based cues progressed more than twice as quickly as disparity-based cues; performance in each pure-cue condition saturated at approximately 200 ms and approximately 500 ms, respectively. This temporal distinction suggests that disparity-based 3D direction judgments may include a post-sensory stage involving additional integration time in some observers, whereas velocity-based judgments are rapid and seem to be more purely sensory in nature. Thus, these two binocular mechanisms appear to support 3D motion perception with distinct temporal properties, reflecting differential mixtures of sensory and decision contributions. Spatial integration profiles for the two mechanisms were similar, and on the scale of receptive fields in area MT. Consistent with prior work, there were substantial individual differences, which we interpret as both sensory and cognitive variations across subjects, further clarifying the case for distinct sets of both cue-specific sensory and cognitive mechanisms. The pure-cue stimuli presented here lay the groundwork for further investigations of velocity- and disparity-based contributions to 3D motion perception.

Binocularly-driven competing neural responses and the perceptual resolution of color

Competing rivalrous neural representations can be resolved at several levels of the visual system. Sustained percepts during interocular-switch rivalry (ISR), in which rivalrous left- and right-eye stimuli swap between eyes several times a second, often are attributed to competing binocularly driven neural representations of each rivalrous stimulus. An alternative view posits monocular neural competition together with a switch in eye dominance at the moment of each stimulus swap between eyes. Here, a range of experimental conditions was tested that would change the colors seen if mediated by eye dominance but not if by competition between binocularly driven responses. Observers viewed multiple chromatically rivalrous discs in various temporal and spatial patterns, and reported when all discs in view appeared the same color. Unlike typical ISR paradigms that swap the complete stimulus in each eye, some of the rivalrous discs were swapped at a different time, or faster frequency, than other discs. Monocular dominance of one eye at a time implies that all discs will rarely be seen as identical in color when some discs swap at a different frequency than others. On the other hand, competing binocularly driven neural responses are not affected by asynchronous swap timing among the individual discs. Results for every observer are in accord with competing responses at the level of binocularly driven, chromatically tuned neurons. Although an account based on eye dominance can be constructed using many small retinotopic zones that have independent timing for the moment of switching the dominant eye, competing binocularly driven responses are a more parsimonious explanation.

Human primary visual cortex shows larger population receptive fields for binocular disparity-defined stimuli

The visual perception of 3D depth is underpinned by the brain's ability to combine signals from the left and right eyes to produce a neural representation of binocular disparity for perception and behaviour. Electrophysiological studies of binocular disparity over the past 2 decades have investigated the computational role of neurons in area V1 for binocular combination, while more recent neuroimaging investigations have focused on identifying specific roles for different extrastriate visual areas in depth perception. Here we investigate the population receptive field properties of neural responses to binocular information in striate and extrastriate cortical visual areas using ultra-high field fMRI. We measured BOLD fMRI responses while participants viewed retinotopic mapping stimuli defined by different visual properties: contrast, luminance, motion, correlated and anti-correlated stereoscopic disparity. By fitting each condition with a population receptive field model, we compared quantitatively the size of the population receptive field for disparity-specific stimulation. We found larger population receptive fields for disparity compared with contrast and luminance in area V1, the first stage of binocular combination, which likely reflects the binocular integration zone, an interpretation supported by modelling of the binocular energy model. A similar pattern was found in region LOC, where it may reflect the role of disparity as a cue for 3D shape. These findings provide insight into the binocular receptive field properties underlying processing for human stereoscopic vision.

Image Size and the Range of Clear and Single Binocular Vision in 3D Displays

SIGNIFICANCE

The range of clear and single binocular vision differs between 3D displays and clinical prism vergences, but this difference is unexplained. This difference prevents clinicians from predicting the range of clear and single binocular vision in 3D-viewing patients. In this study, we tested a hypothesis for this difference.

PURPOSE

The purpose of this study was to determine whether changing fixation target size in 3D viewing significantly affects the vergence ranges and, if so, then to determine whether the target size effect is driven by fusional vergence gain changes, threshold of blur changes, or both.

METHODS

Twenty-one visually normal adults aged 18 to 28 years viewed 3D images at 40 cm in an electronic stereoscopic. The fixation target, a Maltese cross, moved in depth at 2∆/s by way of changing crossed or uncrossed disparity until blur and diplopia ensued. We used four target sizes: (1) small (width × height, 0.21° × 0.63°), (2) medium (1.43° × 4.3°), (3) large (3.6° × 10.8°), and (4) 3D (size changing congruently with disparity). The effect of target size on responses was tested by mixed ANOVAs.

RESULT

Mean convergence blurs and breaks increased with target size by 40% (P < .001) and 71% (P < .001), respectively, and in divergence by 33% (P = .03) and 30% (P = .04), respectively. The increases in break magnitude with target size implicate fusional vergence gain change in the size effect. Increasing target size raised the threshold of blur from 1.06 to 1.82 D in convergence and from 0.97 to 1.48 D in divergence (P = .008).

CONCLUSIONS

Growing fixation target size in 3D viewing increases fusional vergence gain and blur thresholds, which together increase the limits of clear and single binocular vision. Therefore, the clarity of a 3D image depends not only on its disparity but also on the size of the viewed image.

Binocular vision supports the development of scene segmentation capabilities: Evidence from a deep learning model

The application of deep learning techniques has led to substantial progress in solving a number of critical problems in machine vision, including fundamental problems of scene segmentation and depth estimation. Here, we report a novel deep neural network model, capable of simultaneous scene segmentation and depth estimation from a pair of binocular images. By manipulating the arrangement of binocular image pairs, presenting the model with standard left-right image pairs, identical image pairs or swapped left-right images, we show that performance levels depend on the presence of appropriate binocular image arrangements. Segmentation and depth estimation performance are both impaired when images are swapped. Segmentation performance levels are maintained, however, for identical image pairs, despite the absence of binocular disparity information. Critically, these performance levels exceed those found for an equivalent, monocularly trained, segmentation model. These results provide evidence that binocular image differences support both the direct recovery of depth and segmentation information, and the enhanced learning of monocular segmentation signals. This finding suggests that binocular vision may play an important role in visual development. Better understanding of this role may hold implications for the study and treatment of developmentally acquired perceptual impairments.

Stimulus dependence of interocular suppression

Interocular suppression is the phenomenon in which the signal from one eye inhibits the other eye in the presence of dissimilar images. Various clinical and laboratory-based tests have been used to assess suppression, which vary in color, contrast, and stimulus size. These stimulus variations may yield different spatial extents of suppression, which makes it difficult to compare the outcomes. To evaluate the role of stimulus characteristics, we measured the suppression zone using a binocular rivalry paradigm in normally-sighted observers by systematically varying the stimulus parameters. The stimuli consist of a constantly visible horizontal reference seen by one eye while two vertical suppressors were presented to the other eye. With a keypress, the suppressors appeared for 1 s, to induce a transient suppression zone in the middle part of the reference. Subjects adjusted the width between the suppressors to determine the zone. The zone decreased significantly with increasing spatial frequency and lower contrast. The width was 1.4 times larger than the height. The zone was smaller with negative compared to positive contrast polarity but independent of eye dominance, luminance, and colored filters. A departure from scale invariance was captured with a model suggesting a stimulus-dependent and a small fixed non-stimulus-dependent portion.

A gain-control disparity energy model for perceived depth from disparity

Luminance contrast is one of the key factors in the visibility of objects in the world around us. Previous work has shown that the perceived depth from binocular disparity depends profoundly on the luminance contrast of the image. This dependence cannot be explained by existing disparity models, such as the well-established disparity energy model, because they predict no effect of luminance contrast on depth perception. Here, we develop a model for disparity processing that incorporates contrast normalization of the neural response into the disparity energy model to account for the contrast dependence of perceived depth from disparity. Our model contains an array of disparity channels, each with a different disparity selectivity. The binocular images are first processed by the left- and right-eye receptive fields of each channel. The outputs of the two receptive fields are combined linearly as the excitatory disparity sensitivity and then fed into a nonlinear contrast gain control mechanism. The perceived depth is determined by the weighted average of all the disparity channels that respond to the binocular images. This model provides the first analytic account of how luminance contrast affects perceived depth from disparity.

[Migraine with typical aura without headache; first presentation at older age]

Transient visual phenomena in later life due to a visual aura in migraine are not uncommon and can also occur without headache. This migraine with aura is not always recognized as such. Since visual phenomena can also have a variety of other causes, they can present a diagnostic dilemma in both primary and secondary care. Visual aura phenomena have various and often complex manifestations and are usually observed binocularly. In case of transient visual phenomena, the patient's history is of utmost importance to determine whether there is a mono- or binocular cause of the complaints. Timely recognition of visual phenomena in the context of migraine can prevent unnecessary diagnostics and treatments.

3D Contrast Image Reconstruction From Human Brain Activity

Several studies demonstrated that functional magnetic resonance imaging (fMRI) signals in early visual cortex can be used to reconstruct 2-dimensional (2D) visual contents. However, it remains unknown how to reconstruct 3-dimensional (3D) visual stimuli from fMRI signals in visual cortex. 3D visual stimuli contain 2D visual features and depth information. Moreover, binocular disparity is an important cue for depth perception. Thus, it is more challenging to reconstruct 3D visual stimuli than 2D visual stimuli from the fMRI signals of visual cortex. This study aimed to reconstruct 3D visual images by constructing three decoding models: contrast-decoding, disparity-decoding and contrast-disparity-decoding models, and testing these models with fMRI data from humans viewing 3D contrast images. The results revealed that the 3D contrast stimuli can be reconstructed from the visual cortex. And the early visual regions (V1, V2) showed predominant advantages in reconstructing the contrast in 3D images for the contrast-decoding model. The dorsal visual regions (V3A, V7 and MT) showed predominant advantages in decoding the disparity in 3D images for the disparity-decoding model. The combination of the early and dorsal visual regions showed predominant advantages in decoding both the contrast and disparity for the contrast-disparity-decoding model. The results suggested that the contrast and disparity in 3D images were mainly represented in the early and dorsal visual regions separately. The two visual systems may interact with each other to decode 3D-contrast images.

Functional specialization in human dorsal pathway for stereoscopic depth processing

Binocular disparity, a primary cue for stereoscopic depth perception, is widely represented in visual cortex. However, the functional specialization in the disparity processing network remains unclear. Using magnetic resonance imaging-guided transcranial magnetic stimulation, we studied the causal contributions of V3A and MT+ to stereoscopic depth perception. Subjects viewed random-dot stereograms forming transparent planes with various interplane disparities. Their smallest detectable disparity and largest detectable disparity were measured in two experiments. We found that the smallest detectable disparity was affected by V3A, but not MT+ , stimulation. On the other hand, the largest detectable disparity was affected by both V3A and MT+ stimulation. Our results suggest different roles of V3A and MT+ in stereoscopic depth processing.

Does vision extract absolute distance from vergence?

Since Kepler (1604) and Descartes (1637), 'vergence' (the angular rotation of the eyes) has been thought of as one of our most important absolute distance cues. But vergence has never been tested as an absolute distance cue divorced from obvious confounding cues such as binocular disparity. In this article, we control for these confounding cues for the first time by gradually manipulating vergence and find that observers fail to accurately judge distance from vergence. We consider several different interpretations of these results and argue that the most principled response to these results is to question the general effectiveness of vergence as an absolute distance cue. Given that other absolute distance cues (such as motion parallax and vertical disparities) are limited in application, this poses a real challenge to our contemporary understanding of visual scale.

Binocular Matching Model Based on Hierarchical V1 and V2 Receptive Fields With Color, Orientation, and Region Feature Information

Binocular matching models serve as the core component in most stereo visual aid systems developed for people with visual impairments. However, purely computational models lack a neuro-biological basis for explaining the phenomena observed in neuro-biology, and therefore offer no support for the development of bioengineering applications, and are overly complex for hardware implementation. In contrast, existing neurobiological models suffer from low matching calculation accuracy. Therefore, the present work proposes a novel binocular matching model based on the receptive field of simple cells rather than on image pixels, and thereby incorporates neurobiological structure, reduces hardware complexity, has enough accuracy and can be used in visual aid system. The proposed model is employed to calculate and optimize the binocular disparity via a cost function. Specifically, we simulate the functions and structures of V1 and V2 neurons according to the discoveries of modern neurobiology. Accordingly, the receptive fields of V1 layer neurons are aggregated to obtain the receptive fields of the V2 layer, and the disparity is obtained in the V2 layer. The accuracy of the proposed model is verified by comparisons of the disparity results obtained using the proposed model with those obtained using other neurobiological model, and thereby demonstrates that the model can guide the design of visual aid systems.

Disruptive coloration and binocular disparity: breaking camouflage

Many species employ camouflage to disguise their true shape and avoid detection or recognition. Disruptive coloration is a form of camouflage in which high-contrast patterns obscure internal features or break up an animal's outline. In particular, edge enhancement creates illusory, or 'fake' depth edges within the animal's body. Disruptive coloration often co-occurs with background matching, and together, these strategies make it difficult for an observer to visually segment an animal from its background. However, stereoscopic vision could provide a critical advantage in the arms race between perception and camouflage: the depth information provided by binocular disparities reveals the true three-dimensional layout of a scene, and might, therefore, help an observer to overcome the effects of disruptive coloration. Human observers located snake targets embedded in leafy backgrounds. We analysed performance (response time) as a function of edge enhancement, illumination conditions and the availability of binocular depth cues. We confirm that edge enhancement contributes to effective camouflage: observers were slower to find snakes whose patterning contains 'fake' depth edges. Importantly, however, this effect disappeared when binocular depth cues were available. Illumination also affected detection: under directional illumination, where both the leaves and snake produced strong cast shadows, snake targets were localized more quickly than in scenes rendered under ambient illumination. In summary, we show that illusory depth edges, created via disruptive coloration, help to conceal targets from human observers. However, cast shadows and binocular depth information improve detection by providing information about the true three-dimensional structure of a scene. Importantly, the strong interaction between disparity and edge enhancement suggests that stereoscopic vision has a critical role in breaking camouflage, enabling the observer to overcome the disruptive effects of edge enhancement.

First- and second-order contributions to depth perception in anti-correlated random dot stereograms

The binocular energy model of neural responses predicts that depth from binocular disparity might be perceived in the reversed direction when the contrast of dots presented to one eye is reversed. While reversed-depth has been found using anti-correlated random-dot stereograms (ACRDS) the findings are inconsistent across studies. The mixed findings may be accounted for by the presence of a gap between the target and surround, or as a result of overlap of dots around the vertical edges of the stimuli. To test this, we assessed whether (1) the gap size (0, 19.2 or 38.4 arc min) (2) the correlation of dots or (3) the border orientation (circular target, or horizontal or vertical edge) affected the perception of depth. Reversed-depth from ACRDS (circular no-gap condition) was seen by a minority of participants, but this effect reduced as the gap size increased. Depth was mostly perceived in the correct direction for ACRDS edge stimuli, with the effect increasing with the gap size. The inconsistency across conditions can be accounted for by the relative reliability of first- and second-order depth detection mechanisms, and the coarse spatial resolution of the latter.

Binocular contrast summation and inhibition depends on spatial frequency, eccentricity and binocular disparity

PURPOSE

When central vision is compromised, visually-guided behaviour becomes dependent on peripheral retina, often at a preferred retinal locus (PRL). Previous studies have examined adaptation to central vision loss with monocular 2D paradigms, whereas in real tasks, patients make binocular eye movements to targets of various sizes and depth in 3D environments.

METHODS

We therefore examined monocular and binocular contrast sensitivity functions with a 26-AFC (alternate forced choice) band-pass filtered letter identification task at 2° or 6° eccentricity in observers with simulated central vision loss. Binocular stimuli were presented in corresponding or non-corresponding stereoscopic retinal locations. Gaze-contingent scotomas (0.5° radius disks of pink noise) were simulated independently in each eye with a 1000 Hz eye tracker and 120 Hz dichoptic shutter glasses.

RESULTS

Contrast sensitivity was higher for binocular than monocular conditions, but only exceeded probability summation at low-mid spatial frequencies in corresponding retinal locations. At high spatial frequencies or non-corresponding retinal locations, binocular contrast sensitivity showed evidence of interocular suppression.

CONCLUSIONS

These results suggest that binocular vision deficits may be underestimated by monocular vision tests and identify a method that can be used to select a PRL based on binocular contrast summation.