Coarse-fine dichotomies in human stereopsis

Depth perception of stereoscopic transparent stimuli with frame manipulation

Depth perception is crucial in human vision, allowing us to move and interact with our 3-D surroundings. We used a stereoscopic transparent stimulus comprising parallel overlapping transparent stereoscopic surfaces (POTS) to understand depth perception better. The study focused on exploring the effect of a surrounding frame on the perceived depth of a POTS configuration. The research was based on a proposed idea that explains an "off-frame" effect: a frame at a different depth from a 2-D photograph depicting a 3-D scene increases its apparent depth qualitatively. The idea assumes that processing the disparity between a frame and a photo reduces the reliability of the photograph's flatness cues and increases depth magnitude in depth cue integration. We examined whether the idea can be applied to a 3-D POTS with the flatness cue as the constant accommodation. Through three experiments, the study showed that frames impact the perceived depth magnitude of a POTS configuration. More specifically, the depth magnitude increases as the frame's disparity concerning the monitor plane increases and decreases as the frame's size increases. We discussed the results in the context of depth cue combination.

Effect of 3-D depth structure, element size, and area containing elements on total-element overestimation phenomenon

The number of elements distributed in a three-dimensional stimulus is overestimated compared to a two-dimensional stimulus when both stimuli have the same number of elements. We examined the effect of the properties of a three-dimensional stimulus (the number of overlapping stereo surfaces, size of the elements, and size of the area containing elements, on the overestimation phenomenon in four experiments. The two stimuli were presented side-by-side with the same diameters. Observers judged which of the three-dimensional standard and two-dimensional comparison had more elements. The results showed that (a) the overestimation phenomenon occurred for the three-dimensional standard stimuli, (b) the size of the areas affected the amount of overestimation, while the number of overlapping stereo surfaces and size of elements did not, and (c) the amount of overestimation increased when the stimuli included more than 100 elements. Implications of these findings were discussed in the framework of back-surface bias, occlusion, and disparity-processing interference models.

Coarse-to-fine interaction on perceived depth in compound grating

To encode binocular disparity, the visual system uses a pair of left eye and right eye bandpass filters with either a position or a phase offset between them. Such pairs are considered to exit at multiple scales to encode a wide range of disparity. However, local disparity measurements by bandpass mechanisms can be ambiguous, particularly when the actual disparity is larger than a half-cycle of the preferred spatial frequency of the filter, which often occurs in fine scales. In this study, we investigated whether the visual system uses a coarse-to-fine interaction to resolve this ambiguity at finer scales for depth estimation from disparity. The stimuli were stereo grating patches composed of a target and comparison patterns. The target patterns contained spatial frequencies of 1 and 4 cycles per degree (cpd). The phase disparity of the low-frequency component was 0° (at the horopter), -90° (uncrossed), or 90° (crossed), and that of the high-frequency components was changed independent of the low-frequency disparity, in the range between -90° (uncrossed) and 90° (crossed). The observers' task was to indicate whether the target appeared closer to the comparison pattern, which always shared the disparity with the low-frequency component of the target. Regardless of whether the comparison pattern was a 1-cpd + 4-cpd compound or a 1-cpd simple grating, the perceived depth order of the target and the comparison varied in accordance with the phase disparity of the high-frequency component of the target. This effect occurred not only when the low-frequency component was at the horopter, but also when it contained a large disparity corresponding to one cycle of the high-frequency component (±90°). Our findings suggest a coarse-to-fine interaction in multiscale disparity processing, in which the depth interpretation of the high-frequency changes based on the disparity of the low-frequency component.

Large depth differences between target and flankers can increase crowding: Evidence from a multi-depth plane display

Crowding occurs when the presence of nearby features causes highly visible objects to become unrecognizable. Although crowding has implications for many everyday tasks and the tremendous amounts of research reflect its importance, surprisingly little is known about how depth affects crowding. Most available studies show that stereoscopic disparity reduces crowding, indicating that crowding may be relatively unimportant in three-dimensional environments. However, most previous studies tested only small stereoscopic differences in depth in which disparity, defocus blur, and accommodation are inconsistent with the real world. Using a novel multi-depth plane display, this study investigated how large (0.54-2.25 diopters), real differences in target-flanker depth, representative of those experienced between many objects in the real world, affect crowding. Our findings show that large differences in target-flanker depth increased crowding in the majority of observers, contrary to previous work showing reduced crowding in the presence of small depth differences. Furthermore, when the target was at fixation depth, crowding was generally more pronounced when the flankers were behind the target as opposed to in front of it. However, when the flankers were at fixation depth, crowding was generally more pronounced when the target was behind the flankers. These findings suggest that crowding from clutter outside the limits of binocular fusion can still have a significant impact on object recognition and visual perception in the peripheral field.

The role of binocular vision in the control and development of visually guided upper limb movements

Vision provides a key sensory input for the performance of fine motor skills, which are fundamentally important to daily life activities, as well as skilled occupational and recreational performance. Binocular visual function is a crucial aspect of vision that requires the ability to combine inputs from both eyes into a unified percept. Summation and fusion are two aspects of binocular processing associated with performance advantages, including more efficient visuomotor control of upper limb movements. This paper uses the multiple processes model of limb control to explore how binocular viewing could facilitate the planning and execution of prehension movements in adults and typically developing children. Insight into the contribution of binocularity to visuomotor control also comes from examining motor performance in individuals with amblyopia, a condition characterized by reduced visual acuity and poor binocular function. Overall, research in this field has advanced our understanding of the role of binocular vision in the development and performance of visuomotor skills, the first step towards developing assessment tools and targeted rehabilitation for children with neurodevelopment disorders at risk of poor visuomotor outcomes. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Learning to see in depth

Stereopsis provides us with a vivid impression of the depth and distance of objects in our 3- dimensional world. Stereopsis is important for a number of everyday visual tasks, including (but not limited to) reaching and grasping, fine visuo-motor control, and navigating in our world. This review briefly discusses the neural substrate for normal binocular vision and stereopsis and its development in primates; outlines some of the issues and limitations of stereopsis tests and examines some of the factors that limit the typical development of stereopsis and the causes and consequences of stereo-deficiency and stereo-blindness. Finally, we review several approaches to improving or recovering stereopsis in both neurotypical individuals and those with stereo-deficiency and stereo-blindness and outline some emerging strategies for improving stereopsis.

Robust natural depth for anticorrelated random dot stereogram for edge stimuli, but minimal reversed depth for embedded circular stimuli, irrespective of eccentricity

The small differences between the images formed in our left and right eyes are an important cue to the three-dimensional structure of scenes. These disparities are encoded by binocular neurons in the visual cortex. At the earliest stage of processing, these respond to binocular correlation between images. We assessed the perception of depth in anticorrelated stimuli, in which the contrast polarity in one eye is reversed, as a function of their location in the retinal image, and their depth configuration (a horizontal edge or a circle surrounded by an annulus) We found that, regardless of stimulus eccentricity, participants perceived depth in the natural direction for edge stimuli, and weakened, reversed depth for circular stimuli.

Shape judgments in natural scenes: Convexity biases versus stereopsis

Determining the relief of upcoming terrain is critical to locomotion over rough or uneven ground. Given the significant contribution of stereopsis to perceived surface shape, it should play a crucial role in determining the shape of ground surfaces. The aim of this series of experiments was to evaluate the relative contribution of monocular and binocular depth cues to judgments of ground relief. To accomplish this goal, we simulated a depth discrimination task using naturalistic imagery. Stimuli consisted of a stereoscopically rendered grassy terrain with a central mound or a dip with varying height. We measured thresholds for discrimination of the direction of the depth offset. To determine the relationship between relief discrimination and measures of stereopsis, we used two stereoacuity tasks performed under the same viewing conditions. To assess the impact of ambiguous two-dimensional shading cues on depth judgments in our terrain task, we manipulated the intensity of the shading (low and high). Our results show that observers reliably discriminated ground reliefs as small as 20 cm at a viewing distance of 9.1 m. As the shading was intensified, a large proportion of observers (30%) exhibited a strong convexity bias, even when stereopsis indicated a concave depression. This finding suggests that there are significant individual differences in the reliance on assumptions of surface curvature that must be considered in experimental conditions. In impoverished viewing environments with limiting depth cues, these convexity biases could persist in judgments of ground relief, especially when shading cues are highly salient.

Dynamics of absolute and relative disparity processing in human visual cortex

Cortical processing of binocular disparity is believed to begin in V1 where cells are sensitive to absolute disparity, followed by the extraction of relative disparity in higher visual areas. While much is known about the cortical distribution and spatial tuning of disparity-selective neurons, the relationship between their spatial and temporal properties is less well understood. Here, we use steady-state Visual Evoked Potentials and dynamic random dot stereograms to characterize the temporal dynamics of spatial mechanisms in human visual cortex that are primarily sensitive to either absolute or relative disparity. Stereograms alternated between disparate and non-disparate states at 2 Hz. By varying the disparity-defined spatial frequency content of the stereograms from a planar surface to corrugated ones, we biased responses towards absolute vs. relative disparities. Reliable Components Analysis was used to derive two dominant sources from the 128 channel EEG records. The first component (RC1) was maximal over the occipital pole. In RC1, first harmonic responses were sustained, tuned for corrugation frequency, and sensitive to the presence of disparity references, consistent with prior psychophysical sensitivity measurements. By contrast, the second harmonic, associated with transient processing, was not spatially tuned and was indifferent to references, consistent with it being generated by an absolute disparity mechanism. Thus, our results reveal a duplex coding strategy in the disparity domain, where relative disparities are computed via sustained mechanisms and absolute disparities are computed via transient mechanisms.

Stereoscopic Depth Perception and Visuospatial Dysfunction in Alzheimer's Disease

With visuospatial dysfunction emerging as a potential marker that can detect Alzheimer's disease (AD) even in its earliest stages and with disturbance in stereopsis suspected to be the prime contributor to visuospatial deficits in AD, we assessed stereoscopic abilities of patients with AD and mild cognitive impairment (MCI). Whereas previous research assessing patients' stereoacuity has yielded mixed results, we assessed patients' capacity to process coarse disparities that can convey adequate depth information about objects in the environment. We produced two virtual cubes at two different distances from the observer by manipulating disparity type (absolute vs. relative), disparity direction (crossed vs. uncrossed) and disparity magnitude, then had participants judge the object that appeared closer to them. Two patient groups performed as well as, or even better than elderly controls, suggesting that AD patients' coarse disparity processing capacity is capable of supporting common tasks involving reaching, grasping, driving, and navigation. Results may help researchers narrow down the exact cause(s) of visuospatial deficits in AD and develop and validate measures to assess visuospatial dysfunction in clinical trials and disease diagnosis.

Essential Infantile Esotropia: A Course of Treatment From Our Experience

Background: Essential infantile esotropia (EIE) is the most common type of childhood esotropia. Although its classical approach is surgical, less invasive techniques have been proposed as an adjunct or alternative to traditional surgery. Among them, chemodenervation with botulinum toxin (BT) has been investigated, showing variable and sometimes conflicting results. Objectives: To compare the outcomes of bilateral BT injection and traditional surgery in a pediatric population with EIE in order to optimize and standardize the therapeutic approach. Other purposes are to evaluate whether early intervention may prevent the onset of vertical ocular deviation (which is part of the clinical picture of EIE) and/or influence the development of fine stereopsis, and also to assess changes in refractive status over time among the enrolled population. Methods: A retrospective consecutive cohort study was conducted in 86 children aged 0-48 months who underwent correction of EIE. The primary intervention in naïve subjects was either bilateral BT injection (36 subjects, "BT group") or strabismus surgery (50 subjects, "surgery group"). Results: Overall, BT chemodenervation (one or two injections) was effective in 13 (36.1%) subjects. With regard to residual deviation angle, the outcomes at least 5 years after the last intervention were overlapping in children receiving initial treatment with either injection or surgery; however, the success rate of primary intervention in the surgery group was higher, and the average number of interventions necessary to achieve orthotropia was smaller. Both early treatment with chemodenervation and surgery at a later age were not found to prevent the onset of vertical ocular deviation, whereas, surprisingly, the percentage of subjects developing fine stereopsis was higher in the surgery group. Finally, with regard to the change in refractive status over time, most of the subjects increased their initial hyperopia, whereas 10% became myopic. Conclusions: Our data suggest that a single bilateral BT injection by age 2 years should be considered as the first-line treatment of EIE without vertical component; whereas, traditional surgery should be considered as the first-line treatment for all other cases and in subjects unresponsive to primary single BT injection.

Development of stereo vision in young infants

In this study, infants' visual processing of depth-inducing stimuli was tested using a new method suitable for experimental settings. Stereograms of the Lang-Stereopad^® were presented in a timed preferential-looking paradigm to determine infants' preference for a stereogram as compared to a stimulus not inducing an impression of depth. A total of 80 infants were tested at 7 months of age; of these, a sub-sample of 41 infants were tested longitudinally at 4 and 7 months to characterize the developmental trajectory of their preference. Infants were simultaneously presented with a card showing a random-dot stereogram (800" disparity) and a similar looking dummy card without stereogram. In the total sample, 7-month-olds showed a clear preference for the stereogram regardless of sex. In the longitudinal sample, 7-month-olds but not 4-month-olds looked significantly longer to the stereogram as compared to the dummy card. On individual level, 56% of the 4-month-olds and 85% of the 7-month-olds predominantly looked at the stereogram. The findings yield evidence for a clear developmental progression and show that the test cards of the Lang-Stereopad^® prototype provide a viable instrument to determine the preference for depth-inducing stimuli in young infants when used in a controlled experimental setting.

Near-optimal combination of disparity across a log-polar scaled visual field

The human visual system is foveated: we can see fine spatial details in central vision, whereas resolution is poor in our peripheral visual field, and this loss of resolution follows an approximately logarithmic decrease. Additionally, our brain organizes visual input in polar coordinates. Therefore, the image projection occurring between retina and primary visual cortex can be mathematically described by the log-polar transform. Here, we test and model how this space-variant visual processing affects how we process binocular disparity, a key component of human depth perception. We observe that the fovea preferentially processes disparities at fine spatial scales, whereas the visual periphery is tuned for coarse spatial scales, in line with the naturally occurring distributions of depths and disparities in the real-world. We further show that the visual system integrates disparity information across the visual field, in a near-optimal fashion. We develop a foveated, log-polar model that mimics the processing of depth information in primary visual cortex and that can process disparity directly in the cortical domain representation. This model takes real images as input and recreates the observed topography of human disparity sensitivity. Our findings support the notion that our foveated, binocular visual system has been moulded by the statistics of our visual environment.

We investigate how humans perceive depth from binocular disparity at different spatial scales and across different regions of the visual field. We show that small changes in disparity-defined depth are detected best in central vision, whereas peripheral vision best captures the coarser structure of the environment. We also demonstrate that depth information extracted from different regions of the visual field is combined into a unified depth percept. We then construct an image-computable model of disparity processing that takes into account how our brain organizes the visual input at our retinae. The model operates directly in cortical image space, and neatly accounts for human depth perception across the visual field.

Sensory systems in birds: What we have learned from studying sensory specialists

"Diversity" is an apt descriptor of the research career of Jack Pettigrew as it ranged from the study of trees, to clinical conditions, to sensory neuroscience. Within sensory neuroscience, he was fascinated by the evolution of sensory systems across species. Here, we review some of his work on avian sensory specialists and research that he inspired in others. We begin with an overview of the importance of the Wulst in stereopsis and the need for further study of the Wulst in relation to binocularity across avian species. Next, we summarize recent anatomical, behavioral, and physiological studies on optic flow specializations in hummingbirds. Beyond vision, we discuss the first evidence of a tactile "fovea" in birds and how this led to detailed studies of tactile specializations in waterfowl and sensorimotor systems in parrots. We then describe preliminary studies by Pettigrew of two endemic Australian species, the plains-wanderer (Pedionomus torquatus) and letter-winged kite (Elanus scriptus), that suggest the evolution of some unique auditory and visual specializations in relation to their unique behavior and ecology. Finally, we conclude by emphasizing the importance of a comparative and integrative approach to understanding avian sensory systems and provide an example of one system that has yet to be properly examined: tactile facial bristles in birds. Through reviewing this research and offering future avenues for discovery, we hope that others also embrace the comparative approach to understanding sensory system evolution in birds and other vertebrates.

The upper disparity limit increases gradually with eccentricity

Stereopsis is important for tasks of daily living such as eye-hand coordination. It is best in central vision but is also mediated by the periphery. Previously we have shown that individuals with central-field loss who have residual stereopsis in the periphery perform better at an eye-hand-coordination task when they perform the task binocularly rather than monocularly. Here we seek to determine what sets the limit of stereopsis, defined as the largest disparity that supports the sustained appearance of depth, in the near periphery in healthy individuals. While stereoacuity thresholds increase sharply with eccentricity, Panum's area increases much more slowly. We used a rigorous method to determine the uppermost limit of disparity. At long durations, the two half-images that define a large disparity appear as two isolated targets in the same flat plane; small incremental changes in disparity produce changes in the separation between the half-images, and disparity magnitude can be judged on the basis of separation, like a monocular width judgment. The disparity limit is the point at which the threshold for judging dichoptic separation between the half-images is equal to the monocular width-discrimination threshold. The disparity limit at 10° was a factor of 2-4 times larger than the fovea, regardless of the meridian tested. The increase in the disparity limit with eccentricity was shallow, similar to that of Panum's area. Within this disparity limit, disparity increment thresholds were comparable for foveal and peripheral targets, illustrating the significance and utility of peripheral stereopsis, especially in the absence of foveal stereopsis.

The prevalence and diagnosis of 'stereoblindness' in adults less than 60 years of age: a best evidence synthesis

PURPOSE

Stereoscopic vision (or stereopsis) is the ability to perceive depth from binocular disparity - the difference of viewpoints between the two eyes. Interestingly, there are large individual differences as to how well one can appreciate depth from such a cue. The total absence of stereoscopic vision, called 'stereoblindness', has been associated with negative behavioural outcomes such as poor distance estimation. Surprisingly, the prevalence of stereoblindness remains unclear, as it appears highly dependent on the way in which stereopsis is measured.

RECENT FINDINGS

This review highlights the fact that stereopsis is not a unitary construct, but rather implies different systems. The optimal conditions for measuring these varieties of stereoscopic information processing are discussed given the goal of detecting stereoblindness, using either psychophysical or clinical stereotests. In that light, we then discuss the estimates of stereoblindness prevalence of past studies.

SUMMARY

We identify four different approaches that all converge toward a prevalence of stereoblindness of 7% (median approach: 7%; unambiguous-stereoblindness-criteria approach: 7%; visual-defect-included approach: 7%; multiple-criteria approach: 7%). We note that these estimates were derived considering adults of age <60 years old. Older adults may have a higher prevalence. Finally, we make recommendations for a new ecological definition of stereoblindness and for efficient clinical methods for determining stereoblindness by adapting existing tools.

Vection strength increases with simulated eye-separation

Research has previously shown that adding consistent stereoscopic information to self-motion displays can improve the vection in depth induced in physically stationary observers. In some past studies, the simulated eye-separation was always close to the observer's actual eye-separation, as the aim was to examine vection under ecological viewing conditions that provided consistent binocular and monocular self-motion information. The present study investigated whether large discrepancies between the observer's simulated and physical eye-separations would alter the vection-inducing potential of stereoscopic optic flow (either helping, hindering, or preventing the induction of vection). Our self-motion displays simulated eye-separations of 0 cm (the non-stereoscopic control), 3.25 cm (reduced from normal), 6.5 cm (approximately normal), and 13 cm (exaggerated relative to normal). The rated strength of vection in depth was found to increase systematically with the simulated eye-separation. While vection was the strongest in the 13-cm condition (stronger than even the 6.5-cm condition), the 3.25-cm condition still produced superior vection to the 0-cm control (i.e., it had significantly stronger vection ratings and shorter onset latencies). Perceptions of scene depth and object motion-in-depth speed were also found to increase with the simulated eye-separation. As expected based on the findings of previous studies, correlational analyses suggested that the stereoscopic advantage for vection (found for all of our non-zero eye-separation conditions) was due to the increase in perceived motion-in-depth.

Stereopsis in animals: evolution, function and mechanisms

Stereopsis is the computation of depth information from views acquired simultaneously from different points in space. For many years, stereopsis was thought to be confined to primates and other mammals with front-facing eyes. However, stereopsis has now been demonstrated in many other animals, including lateral-eyed prey mammals, birds, amphibians and invertebrates. The diversity of animals known to have stereo vision allows us to begin to investigate ideas about its evolution and the underlying selective pressures in different animals. It also further prompts the question of whether all animals have evolved essentially the same algorithms to implement stereopsis. If so, this must be the best way to do stereo vision, and should be implemented by engineers in machine stereopsis. Conversely, if animals have evolved a range of stereo algorithms in response to different pressures, that could inspire novel forms of machine stereopsis appropriate for distinct environments, tasks or constraints. As a first step towards addressing these ideas, we here review our current knowledge of stereo vision in animals, with a view towards outlining common principles about the evolution, function and mechanisms of stereo vision across the animal kingdom. We conclude by outlining avenues for future work, including research into possible new mechanisms of stereo vision, with implications for machine vision and the role of stereopsis in the evolution of camouflage.

Summary: Stereopsis has evolved independently in different animals. We review the various functions it serves and the variety of mechanisms that could underlie stereopsis in different species.

First- and second-order contributions to depth perception in anti-correlated random dot stereograms

The binocular energy model of neural responses predicts that depth from binocular disparity might be perceived in the reversed direction when the contrast of dots presented to one eye is reversed. While reversed-depth has been found using anti-correlated random-dot stereograms (ACRDS) the findings are inconsistent across studies. The mixed findings may be accounted for by the presence of a gap between the target and surround, or as a result of overlap of dots around the vertical edges of the stimuli. To test this, we assessed whether (1) the gap size (0, 19.2 or 38.4 arc min) (2) the correlation of dots or (3) the border orientation (circular target, or horizontal or vertical edge) affected the perception of depth. Reversed-depth from ACRDS (circular no-gap condition) was seen by a minority of participants, but this effect reduced as the gap size increased. Depth was mostly perceived in the correct direction for ACRDS edge stimuli, with the effect increasing with the gap size. The inconsistency across conditions can be accounted for by the relative reliability of first- and second-order depth detection mechanisms, and the coarse spatial resolution of the latter.

Monovision: Consequences for depth perception from large disparities

Recent studies have confirmed that monovision treatment degrades stereopsis but it is not clear if these effects are limited to fine disparity processing, or how they are affected by viewing distance or age. Given the link between stereopsis and postural stability, it is important that we have full understanding of the impact of monovision on binocular function. In this study we assessed the short-term effects of optically induced monovision on a depth-discrimination task for young and older (presbyopic) adults. In separate sessions, the upper limits of stereopsis were assessed with participants' best optical correction and with monovision (-1D and +1D lenses in front of the dominant and non-dominant eyes respectively), at both near (62 cm) and far (300 cm) viewing distances. Monovision viewing resulted in significant reductions in the upper limit of stereopsis or more generally in discrimination performance at large disparities, in both age groups at a viewing distance of 300 cm. Dynamic photorefraction performed on a sample of four young observers revealed that they tended to accommodate to minimize blur in one eye at the expense of blur in the other. Older participants would have experienced roughly equivalent blur in the two eyes. Despite this difference, both groups displayed similar detrimental effects of monovision. In addition, we find that discrimination accuracy was worse with monovision at the 3 m viewing distance which involves fixation distances that are typical during walking. These data suggest that stability during locomotion may be compromised, a factor that is of concern for our older participants.

Simple reaction times to cyclopean stimuli reveal that the binocular system is tuned to react faster to near than to far objects

Binocular depth perception is an important mechanism to segregate the visual scene for mapping relevant objects in our environment. Convergent evidence from psychophysical and neurophysiological studies have revealed asymmetries between the processing of near (crossed) and far (uncrossed) binocular disparities. The aim of the present study was to test if near or far objects are processed faster and with higher contrast sensitivity in the visual system. We therefore measured the relationship between binocular disparity and simple reaction time (RT) as well as contrast gain based on the contrast-RT function in young healthy adults. RTs were measured to suddenly appearing cyclopean target stimuli, which were checkerboard patterns encoded by depth in dynamic random dot stereograms (DRDS). The DRDS technique allowed us to selectively study the stereoscopic processing system by eliminating all monocular cues. The results showed that disparity and contrast had significant effects on RTs. RTs as a function of disparity followed a U-shaped tuning curve indicating an optimum at around 15 arc min, where RTs were minimal. Surprisingly, the disparity tuning of RT was much less pronounced for far disparities. At the optimal disparity, we measured advantages of about 80 ms and 30 ms for near disparities at low (10%) and high (90%) contrasts, respectively. High contrast always reduced RTs as well as the disparity dependent differences. Furthermore, RT-based contrast gains were higher for near disparities in the range of disparities where RTs were the shortest. These results show that the sensitivity of the human visual system is biased for near versus far disparities and near stimuli can result in faster motor responses, probably because they bear higher biological relevance.

Thresholds for sine-wave corrugations defined by binocular disparity in random dot stereograms: Factor analysis of individual differences reveals two stereoscopic mechanisms tuned for spatial frequency

Threshold functions for sinusoidal depth corrugations typically reach their minimum (highest sensitivity) at spatial frequencies of 0.2-0.4 cycles/degree (cpd), with lower thresholds for horizontal than vertical corrugations at low spatial frequencies. To elucidate spatial frequency and orientation tuning of stereoscopic mechanisms, we measured the disparity sensitivity functions, and used factor analytic techniques to estimate the existence of independent underlying stereo channels. The data set (N = 30 individuals) was for horizontal and vertical corrugations of spatial frequencies ranging from 0.1 to 1.6 cpd. A principal component analysis of disparity sensitivities (log-arcsec) revealed that two significant factors accounted for 70% of the variability. Following Varimax rotation to approximate "simple structure", one factor clearly loaded onto low spatial frequencies (≤0.4 cpd), and a second was tuned to higher spatial frequencies (≥0.8 cpd). Each factor had nearly identical tuning (loadings) for horizontal and vertical patterns. The finding of separate factors for low and high spatial frequencies is consistent with previous studies. The failure to find separate factors for horizontal and vertical corrugations is somewhat surprising because the neuronal mechanisms are believed to be different. Following an oblique rotation (Direct Oblimin), the two factors correlated significantly, suggesting some interdependence rather than full independence between the two factors.

An Assessment of Stereovision Acquired in Adulthood

SIGNIFICANCE

Increasing evidence indicates that childhood binocular vision disorders that lead to stereodeficiency may be treated in adulthood. Reports of patients who gain stereopsis as adults indicate that this achievement provides for a qualitatively different and dramatically improved sense of space and depth.

PURPOSE

Increasing evidence suggests that stereopsis can be achieved in adult patients despite long-standing binocular disorders. We polled individuals who gained stereopsis as adults to ascertain their initial binocular disorders, the length of time they were stereodeficient, effective treatments, and the nature of their recovered stereovision.

METHODS

A questionnaire was posted online and announced in a brief article in the journal Vision Development and Rehabilitation.

RESULTS

Of the 63 responders, 56 (89%) reported strabismus and/or amblyopia, and 55 (87%) indicated that they had been stereodeficient for as long as they could remember. All but seven participants (89%) achieved stereovision through vision training or a combination of surgery and vision training, and many reported vivid visual changes.

CONCLUSIONS

Despite childhood binocular disorders, patients may be able to achieve stereopsis following interventions in adulthood. This achievement provides for a qualitatively different and dramatically improved sense of space and depth.

Characterization of Spatial Frequency Channels Underlying Disparity Sensitivity by Factor Analysis of Population Data

It has been suggested that at least two mechanisms mediate disparity processing, one for coarse and one for fine disparities. Here we analyze individual differences in our previously measured normative dataset on the disparity sensitivity as a function of spatial frequency of 61 observers to assess the tuning of the spatial frequency channels underlying disparity sensitivity for oblique corrugations (Reynaud et al., 2015). Inter-correlations and factor analysis of the population data revealed two spatial frequency channels for disparity sensitivity: one tuned to high spatial frequencies and one tuned to low spatial frequencies. Our results confirm that disparity is encoded by spatial frequency channels of different sensitivities tuned to different ranges of corrugation frequencies.

Recovering stereo vision by squashing virtual bugs in a virtual reality environment

Stereopsis is the rich impression of three-dimensionality, based on binocular disparity-the differences between the two retinal images of the same world. However, a substantial proportion of the population is stereo-deficient, and relies mostly on monocular cues to judge the relative depth or distance of objects in the environment. Here we trained adults who were stereo blind or stereo-deficient owing to strabismus and/or amblyopia in a natural visuomotor task-a 'bug squashing' game-in a virtual reality environment. The subjects' task was to squash a virtual dichoptic bug on a slanted surface, by hitting it with a physical cylinder they held in their hand. The perceived surface slant was determined by monocular texture and stereoscopic cues, with these cues being either consistent or in conflict, allowing us to track the relative weighting of monocular versus stereoscopic cues as training in the task progressed. Following training most participants showed greater reliance on stereoscopic cues, reduced suppression and improved stereoacuity. Importantly, the training-induced changes in relative stereo weights were significant predictors of the improvements in stereoacuity. We conclude that some adults deprived of normal binocular vision and insensitive to the disparity information can, with appropriate experience, recover access to more reliable stereoscopic information.This article is part of the themed issue 'Vision in our three-dimensional world'.

Magnitude, precision, and realism of depth perception in stereoscopic vision

Our perception of depth is substantially enhanced by the fact that we have binocular vision. This provides us with more precise and accurate estimates of depth and an improved qualitative appreciation of the three-dimensional (3D) shapes and positions of objects. We assessed the link between these quantitative and qualitative aspects of 3D vision. Specifically, we wished to determine whether the realism of apparent depth from binocular cues is associated with the magnitude or precision of perceived depth and the degree of binocular fusion. We presented participants with stereograms containing randomly positioned circles and measured how the magnitude, realism, and precision of depth perception varied with the size of the disparities presented. We found that as the size of the disparity increased, the magnitude of perceived depth increased, while the precision with which observers could make depth discrimination judgments decreased. Beyond an initial increase, depth realism decreased with increasing disparity magnitude. This decrease occurred well below the disparity limit required to ensure comfortable viewing.

The Active Side of Stereopsis: Fixation Strategy and Adaptation to Natural Environments

Depth perception in near viewing strongly relies on the interpretation of binocular retinal disparity to obtain stereopsis. Statistical regularities of retinal disparities have been claimed to greatly impact on the neural mechanisms that underlie binocular vision, both to facilitate perceptual decisions and to reduce computational load. In this paper, we designed a novel and unconventional approach in order to assess the role of fixation strategy in conditioning the statistics of retinal disparity. We integrated accurate realistic three-dimensional models of natural scenes with binocular eye movement recording, to obtain accurate ground-truth statistics of retinal disparity experienced by a subject in near viewing. Our results evidence how the organization of human binocular visual system is finely adapted to the disparity statistics characterizing actual fixations, thus revealing a novel role of the active fixation strategy over the binocular visual functionality. This suggests an ecological explanation for the intrinsic preference of stereopsis for a close central object surrounded by a far background, as an early binocular aspect of the figure-ground segregation process.

Disparity configuration influences depth discrimination in naïve adults, but not in children

We report a series of experiments in which we assess depth discrimination performance in adults and children using a disparity-balanced target configuration to avoid the effects of anticipatory vergence eye movements. In our first study we found that children outperformed adults by a substantial margin, and the adults were consistently near chance. This was surprising given that we initially tested naïve adults to provide a benchmark for the children's data, and all observers met the criterion for stereoacuity. In subsequent experiments we recruited groups of inexperienced adult observers and assessed the role of a wide range of spatial and temporal factors in this apparent deficit. We found that the adult performance remained poor in spite of changes to the stimulus layout, exposure duration, and spatial scale. The only manipulations that improved performance were those that limited the binocular disparity to a single sign. We conclude that these data reflect a form of involuntary disparity pooling that makes it difficult for naïve observers to judge depth from disparity from multiple targets. The absence of this effect in children likely reflects the late maturation of global processes and depth cue integration.

Encoding and estimation of first- and second-order binocular disparity in natural images

•

First- and second-order responses to natural binocular images are correlated.

•

Second-order mechanisms can improve the accuracy of disparity estimation.

•

Second-order mechanisms can extend the depth range of binocular stereopsis.

The first stage of processing of binocular information in the visual cortex is performed by mechanisms that are bandpass-tuned for spatial frequency and orientation. Psychophysical and physiological evidence have also demonstrated the existence of second-order mechanisms in binocular processing, which can encode disparities that are not directly accessible to first-order mechanisms. We compared the responses of first- and second-order binocular filters to natural images. We found that the responses of the second-order mechanisms are to some extent correlated with the responses of the first-order mechanisms, and that they can contribute to increasing both the accuracy, and depth range, of binocular stereopsis.

Stereopsis and amblyopia: A mini-review

Amblyopia is a neuro-developmental disorder of the visual cortex that arises from abnormal visual experience early in life. Amblyopia is clinically important because it is a major cause of vision loss in infants and young children. Amblyopia is also of basic interest because it reflects the neural impairment that occurs when normal visual development is disrupted. Amblyopia provides an ideal model for understanding when and how brain plasticity may be harnessed for recovery of function. Over the past two decades there has been a rekindling of interest in developing more effective methods for treating amblyopia, and for extending the treatment beyond the critical period, as exemplified by new clinical trials and new basic research studies. The focus of this review is on stereopsis and its potential for recovery. Impaired stereoscopic depth perception is the most common deficit associated with amblyopia under ordinary (binocular) viewing conditions (Webber & Wood, 2005). Our review of the extant literature suggests that this impairment may have a substantial impact on visuomotor tasks, difficulties in playing sports in children and locomoting safely in older adults. Furthermore, impaired stereopsis may also limit career options for amblyopes. Finally, stereopsis is more impacted in strabismic than in anisometropic amblyopia. Our review of the various approaches to treating amblyopia (patching, perceptual learning, videogames) suggests that there are several promising new approaches to recovering stereopsis in both anisometropic and strabismic amblyopes. However, recovery of stereoacuity may require more active treatment in strabismic than in anisometropic amblyopia. Individuals with strabismic amblyopia have a very low probability of improvement with monocular training; however they fare better with dichoptic training than with monocular training, and even better with direct stereo training.

Receptive fields of visual neurons: the early years

This paper traces the history of the visual receptive field (RF) from Hartline to Hubel and Wiesel. Hartline (1938, 1940) found that an isolated optic nerve fiber in the frog could be excited by light falling on a small circular area of the retina. He called this area the RF, using a term first introduced by Sherrington (1906) in the tactile domain. In 1953 Kuffler discovered the antagonistic center-surround organization of cat RFs, and Barlow, Fitzhugh, and Kuffler (1957) extended this work to stimulus size and state of adaptation. Shortly thereafter, Lettvin and colleagues (1959) in an iconic paper asked "what the frog's eye tells the frog's brain". Meanwhile, Jung and colleagues (1952-1973) searched for the perceptual correlates of neuronal responses, and Jung and Spillmann (1970) proposed the term perceptive field (PF) as a psychophysical correlate of the RF. The Westheimer function (1967) enabled psychophysical measurements of the PF center and surround in human and monkey, which correlated closely with the underlying RF organization. The sixties and seventies were marked by rapid progress in RF research. Hubel and Wiesel (1959-1974), recording from neurons in the visual cortex of the cat and monkey, found elongated RFs selective for the shape, orientation, and position of the stimulus, as well as for movement direction and ocularity. These findings prompted the emergence in visual psychophysics of the concept of feature detectors selective for lines, bars, and edges, and contributed to a model of the RF in terms of difference of Gaussians (DOG) and Fourier channels. The distinction between simple, complex, and hypercomplex neurons followed. Although RF size increases towards the peripheral retina, its cortical representation remains constant due to the reciprocal relationship with the cortical magnification factor (M). This constitutes a uniform yardstick for M-scaled stimuli across the retina. Developmental studies have shown that RF properties are not fixed. RFs possess their full response inventory already at birth, but require the interaction with appropriate stimuli within a critical time window for refinement and consolidation. Taken together these findings paved the way for a better understanding of how objective properties of the external world are encoded to become subjective properties of the subjective, perceptual world.

Are blur and disparity complementary cues to depth?

The image blur and binocular disparity of a 3D scene point both increase with distance in depth away from fixation. Perceived depth from disparity has been studied extensively and is known to be most precise near fixation. Perceived depth from blur is much less well understood. A recent experiment (Held, R. T, Cooper, E. A., & Banks, M. S. (2012). Current Biology, 22, 426-431) which used a volumetric stereo display found evidence that blur and disparity are complementary cues to depth, namely the disparity cue dominates over the blur cue near the fixation depth and blur dominates over disparity at depths that are far from fixation. Here we present a similar experiment but which used a traditional 3D display so that blur was produced by image processing rather than by the subjects' optics. Contrary to Held et al., we found that subjects did not rely more on blur to discriminate depth at distances far from fixation, even though a sufficient level of blur was available to do so. The discrepancy between the findings of the two studies can be explained in at least two ways. First, Held et al.'s subjects received trial-to-trial feedback in a training phase and may have learned how to perform the task using blur discrimination. Second, Held et al.'s volumetric stereo display may have provided other optical cues that indicated that the blur was real rather than rendered. The latter possibility would have significant implications about how depth is perceived from blur under different viewing conditions.

The relationship of age when motor alignment is achieved and the subsequent development of stereopsis in infantile esotropia

PURPOSE

To determine the oldest age beyond which the chance of developing stereopsis is not possible even with excellent motor alignment in patients with infantile esotropia.

METHODS

The medical records of children with infantile esotropia who underwent a single operation and had alignment within 10(Δ) of orthotropia at all follow-up examinations were retrospectively reviewed. Patients were assessed for stereopsis after the age of 48 months.

RESULTS

A total of 38 children were included. There was a statistically significant inverse correlation between age at surgery and final stereopsis (r = 0.494, P = 0.002). There was a significant difference at mean age at surgery between patients having stereopsis better than 1000 arcsec and those having no stereopsis (P = 0.002). Post hoc power analysis revealed a value of 85%. Receiver operating characteristic curve analysis revealed that the optimum cut-off value of the age at surgery for predicting stereopsis was 16 months (Youden index = 0.474; area under ROC curve, 0.784; 95% CI: 0.62-0.90; P = 0.0002).

CONCLUSIONS

Surgery for infantile esotropia is most likely to result in measureable stereopsis if patient age at alignment is not more than 16 months.

Binocular fusion, suppression and diplopia for blurred edges

Purpose

(1) To devise a model-based method for estimating the probabilities of binocular fusion, interocular suppression and diplopia from psychophysical judgements, (2) To map out the way fusion, suppression and diplopia vary with binocular disparity and blur of single edges shown to each eye, (3) To compare the binocular interactions found for edges of the same vs opposite contrast polarity.

Methods

Test images were single, horizontal, Gaussian-blurred edges, with blur B = 1–32 min arc, and vertical disparity 0–8.B, shown for 200 ms. In the main experiment, observers reported whether they saw one central edge, one offset edge, or two edges. We argue that the relation between these three response categories and the three perceptual states (fusion, suppression, diplopia) is indirect and likely to be distorted by positional noise and criterion effects, and so we developed a descriptive, probabilistic model to estimate both the perceptual states and the noise/criterion parameters from the data.

Results

(1) Using simulated data, we validated the model-based method by showing that it recovered fairly accurately the disparity ranges for fusion and suppression, (2) The disparity range for fusion (Panum's limit) increased greatly with blur, in line with previous studies. The disparity range for suppression was similar to the fusion limit at large blurs, but two or three times the fusion limit at small blurs. This meant that diplopia was much more prevalent at larger blurs, (3) Diplopia was much more frequent when the two edges had opposite contrast polarity. A formal comparison of models indicated that fusion occurs for same, but not opposite, polarities. Probability of suppression was greater for unequal contrasts, and it was always the lower-contrast edge that was suppressed.

Conclusions

Our model-based data analysis offers a useful tool for probing binocular fusion and suppression psychophysically. The disparity range for fusion increased with edge blur but fell short of complete scale-invariance. The disparity range for suppression also increased with blur but was not close to scale-invariance. Single vision occurs through fusion, but also beyond the fusion range, through suppression. Thus suppression can serve as a mechanism for extending single vision to larger disparities, but mainly for sharper edges where the fusion range is small (5–10 min arc). For large blurs the fusion range is so much larger that no such extension may be needed.

Terminator disparity contributes to stereo matching for eye movements and perception

In the context of motion detection, the endings (or terminators) of 1-D features can be detected as 2-D features, affecting the perceived direction of motion of the 1-D features (the barber-pole illusion) and the direction of tracking eye movements. In the realm of binocular disparity processing, an equivalent role for the disparity of terminators has not been established. Here we explore the stereo analogy of the barber-pole stimulus, applying disparity to a 1-D noise stimulus seen through an elongated, zero-disparity, aperture. We found that, in human subjects, these stimuli induce robust short-latency reflexive vergence eye movements, initially in the direction orthogonal to the 1-D features, but shortly thereafter in the direction predicted by the disparity of the terminators. In addition, these same stimuli induce vivid depth percepts, which can only be attributed to the disparity of line terminators. When the 1-D noise patterns are given opposite contrast in the two eyes (anticorrelation), both components of the vergence response reverse sign. Finally, terminators drive vergence even when the aperture is defined by a texture (as opposed to a contrast) boundary. These findings prove that terminators contribute to stereo matching, and constrain the type of neuronal mechanisms that might be responsible for the detection of terminator disparity.

Simulating the cortical 3D visuomotor transformation of reach depth

We effortlessly perform reach movements to objects in different directions and depths. However, how networks of cortical neurons compute reach depth from binocular visual inputs remains largely unknown. To bridge the gap between behavior and neurophysiology, we trained a feed-forward artificial neural network to uncover potential mechanisms that might underlie the 3D transformation of reach depth. Our physiologically-inspired 4-layer network receives distributed 3D visual inputs (1^st layer) along with eye, head and vergence signals. The desired motor plan was coded in a population (3^rd layer) that we read out (4^th layer) using an optimal linear estimator. After training, our network was able to reproduce all known single-unit recording evidence on depth coding in the parietal cortex. Network analyses predict the presence of eye/head and vergence changes of depth tuning, pointing towards a gain-modulation mechanism of depth transformation. In addition, reach depth was computed directly from eye-centered (relative) visual distances, without explicit absolute depth coding. We suggest that these effects should be observable in parietal and pre-motor areas.

Integrating multiple cues to depth order at object boundaries

We examined the interaction between motion and stereo cues to depth order along object boundaries. Relative depth was conveyed by a change in the speed of image motion across a boundary (motion parallax), the disappearance of features on a surface moving behind an occluding object (motion occlusion), or a difference in the stereo disparity of adjacent surfaces. We compared the perceived depth orders for different combinations of cues, incorporating conditions with conflicting depth orders and conditions with varying reliability of the individual cues. We observed large differences in performance between subjects, ranging from those whose depth order judgments were driven largely by the stereo disparity cues to those whose judgments were dominated by motion occlusion. The relative strength of these cues influenced individual subjects' behavior in conditions of cue conflict and reduced reliability.

Alternation frequency thresholds for stereopsis as a technique for exploring stereoscopic difficulties

When stereoscopic images are presented alternately to the two eyes, stereopsis occurs at F ≥ 1 Hz full-cycle frequencies for very simple stimuli, and F ≥ 3 Hz full-cycle frequencies for random-dot stereograms (eg Ludwig I, Pieper W, Lachnit H, 2007 “Temporal integration of monocular images separated in time: stereopsis, stereoacuity, and binocular luster” Perception & Psychophysics69 92–102). Using twenty different stereograms presented through liquid crystal shutters, we studied the transition to stereopsis with fifteen subjects. The onset of stereopsis was observed during a stepwise increase of the alternation frequency, and its disappearance was observed during a stepwise decrease in frequency. The lowest F values (around 2.5 Hz) were observed with stimuli involving two to four simple disjoint elements (circles, arcs, rectangles). Higher F values were needed for stimuli containing slanted elements or curved surfaces (about 1 Hz increment), overlapping elements at two different depths (about 2.5 Hz increment), or camouflaged overlapping surfaces (> 7 Hz increment). A textured cylindrical surface with a horizontal axis appeared easier to interpret (5.7 Hz) than a pair of slanted segments separated in depth but forming a cross in projection (8 Hz). Training effects were minimal, and F usually increased as disparities were reduced. The hierarchy of difficulties revealed in the study may shed light on various problems that the brain needs to solve during stereoscopic interpretation. During the construction of the three-dimensional percept, the loss of information due to natural decay of the stimuli traces must be compensated by refreshes of visual input. In the discussion an attempt is made to link our results with recent advances in the comprehension of visual scene memory.