Binocular depth processing in the ventral visual pathway

Two Disparity Channels in Human Visual Cortex With Different Contrast and Blur Sensitivity

Purpose

Our goal is to describe the contrast and blur sensitivity of multiple horizontal disparity subsystems and to relate them to the contrast and spatial sensitivities of their monocular inputs.

Methods

Steady-state visual evoked potential (SSVEP) amplitudes were recorded in response to dynamic random dot stereograms (DRDSs) alternating at 2 Hz between zero disparity and varying magnitudes of crossed disparity for disparity plane and disparity grating stimuli. Half-image contrasts ranged between 2.5% and 80% and over a range of Gaussian blurs from 1.4 to 12 arcmin. Separate experiments measured contrast and blur sensitivity for the monocular half-images.

Results

The first and second harmonics disparity responses were maximal for disparity gratings and for the disparity plane condition, respectively. The first harmonic of the disparity grating response was more affected by both contrast and blur than was the second harmonic of the disparity plane response, which had higher contrast sensitivity than the first harmonic.

Conclusions

The corrugation frequency, contrast, and blur tuning of the first harmonic suggest that it reflects activity of neurons tuned to higher luminance spatial frequencies that are selective for relative disparity, whereas the second harmonic reflects the activity of neurons sensitive to absolute disparity that are driven by low monocular spatial frequencies.

Translational Relevance

SSVEPs to DRDSs provide two objective neural measures of disparity processing, the first harmonic-whose stimulus preferences are similar to those of behavioral stereoacuity-and the second harmonic that represents an independent disparity-specific but not necessarily stereoscopic mechanism.

Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates

The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.

Analysis of convolutional neural networks reveals the computational properties essential for subcortical processing of facial expression

Perception of facial expression is crucial for primate social interactions. This visual information is processed through the ventral cortical pathway and the subcortical pathway. However, the subcortical pathway exhibits inaccurate processing, and the responsible architectural and physiological properties remain unclear. To investigate this, we constructed and examined convolutional neural networks with three key properties of the subcortical pathway: a shallow layer architecture, concentric receptive fields at the initial processing stage, and a greater degree of spatial pooling. These neural networks achieved modest accuracy in classifying facial expressions. By replacing these properties, individually or in combination, with corresponding cortical features, performance gradually improved. Similar to amygdala neurons, some units in the final processing layer exhibited sensitivity to retina-based spatial frequencies (SFs), while others were sensitive to object-based SFs. Replacement of any of these properties affected the coordinates of the SF encoding. Therefore, all three properties limit the accuracy of facial expression information and are essential for determining the SF representation coordinate. These findings characterize the role of the subcortical computational processes in facial expression recognition.

User's image perception improved strategy and application of augmented reality systems in smart medical care: A review

BACKGROUND

Augmented reality (AR) is a new human-computer interaction technology that combines virtual reality, computer vision, and computer networks. With the rapid advancement of the medical field towards intelligence and data visualisation, AR systems are becoming increasingly popular in the medical field because they can provide doctors with clear enough medical images and accurate image navigation in practical applications. However, it has been discovered that different display types of AR systems have different effects on doctors' perception of the image after virtual-real fusion during the actual medical application. If doctors cannot correctly perceive the image, they may be unable to correctly match the virtual information with the real world, which will have a significant impact on their ability to recognise complex structures.

METHODS

This paper uses Citespace, a literature analysis tool, to visualise and analyse the research hotspots when AR systems are used in the medical field.

RESULTS

A visual analysis of the 1163 articles retrieved from the Web of Science Core Collection database reveals that display technology and visualisation technology are the key research directions of AR systems at the moment.

CONCLUSION

This paper categorises AR systems based on their display principles, reviews current image perception optimisation schemes for various types of systems, and analyses and compares different display types of AR systems based on their practical applications in the field of smart medical care so that doctors can select the appropriate display types based on different application scenarios. Finally, the future development direction of AR display technology is anticipated in order for AR technology to be more effectively applied in the field of smart medical care. The advancement of display technology for AR systems is critical for their use in the medical field, and the advantages and disadvantages of various display types should be considered in different application scenarios to select the best AR system.

The matching rule of Panum's limiting case and its influencing factors

Introduction

Panum's limiting case is one of the typical configurations of monocular occlusion region. The matching rule of Panum's limiting case is the key to understanding how monocular occlusion region produces stereopsis. There are currently two main views on the matching rule of Panum's limiting case, namely double fusion and uniqueness constraint. This paper further discusses its matching mechanism on the basis of previous studies.

Methods

In this study, fold line Panum's stimuli were used to study the matching rule of Panum's limiting case. In Experiment 1, fixation position was adopted to present the stimulus in a short time to explore the matching rules in Panum's limiting case. In Experiment 2, the effect of fixation position on Panum's limiting case matching results was further investigated.

Results

The results of Experiment 1 show that when stimuli are presented in a short period of time, the reported result that a single feature in one eye may be matched alternately with two features in the other eye. This matching rule is called "fast alternative matching" in this article. The results of Experiment 2 results show that the position of the fixation could affect the matching result of participants.

Conclusion

In conclusion, the matching rule of Panum's limiting case is fast alternative matching, and the matching result is related to the attention state of the participant. These results not only provide a new perspective for matching rules in Panum's limiting case, but also show that depth perception results in stereopsis can be influenced by top-down cognitive processing. This study provides a theoretical basis for studying the formation of stereopsis in the monocular region to a certain extent. In summary, the matching rule of Panum's limiting case is fast alternative matching. In previous studies, the perceived result of double fusion may be caused by fast alternative matching. Also, the matching results are related to the participant's state of attention, which suggests that the depth perception results of stereopsis are influenced by top-down cognitive processing.

Cortical Deficits are Correlated with Impaired Stereopsis in Patients with Strabismus

In this study, we explored the neural mechanism underlying impaired stereopsis and possible functional plasticity after strabismus surgery. We enrolled 18 stereo-deficient patients with intermittent exotropia before and after surgery, along with 18 healthy controls. Functional magnetic resonance imaging data were collected when participants viewed three-dimensional stimuli. Compared with controls, preoperative patients showed hypoactivation in higher-level dorsal (visual and parietal) areas and ventral visual areas. Pre- and postoperative activation did not significantly differ in patients overall; patients with improved stereopsis showed stronger postoperative activation than preoperative activation in the right V3A and left intraparietal sulcus. Worse stereopsis and fusional control were correlated with preoperative hypoactivation, suggesting that cortical deficits along the two streams might reflect impaired stereopsis in intermittent exotropia. The correlation between improved stereopsis and activation in the right V3A after surgery indicates that functional plasticity may underlie the improvement of stereopsis. Thus, additional postoperative strategies are needed to promote functional plasticity and enhance the recovery of stereopsis.

Abnormal effective connectivity in visual cortices underlies stereopsis defects in amblyopia

•

Abnormal effective connectivity inherent stereopsis defects in amblyopia was studied.

•

A weakened connection from V2v to LO2 relates to stereopsis defects in amblyopia.

•

Higher-order visual cortices may serve as key nodes to the stereopsis defects.

•

An independent longitudinal dataset was used to validate the obtained results.

The neural basis underlying stereopsis defects in patients with amblyopia remains unclear, which hinders the development of clinical therapy. This study aimed to investigate visual network abnormalities in patients with amblyopia and their associations with stereopsis function. Spectral dynamic causal modeling methods were employed for resting-state functional magnetic resonance imaging data to investigate the effective connectivity (EC) among 14 predefined regions of interest in the dorsal and ventral visual pathways. We adopted two independent datasets, including a cross-sectional and a longitudinal dataset. In the cross-sectional dataset, we compared group differences in EC between 31 patients with amblyopia (mean age: 26.39 years old) and 31 healthy controls (mean age: 25.71 years old) and investigated the association between EC and stereoacuity. In addition, we explored EC changes after perceptual learning in a novel longitudinal dataset including 9 patients with amblyopia (mean age: 15.78 years old). We found consistent evidence from the two datasets indicating that the aberrant EC from V2v to LO2 is crucial for the stereoscopic deficits in the patients with amblyopia: it was weaker in the patients than in the controls, showed a positive linear relationship with the stereoscopic function, and increased after perceptual learning in the patients. In addition, higher-level dorsal (V3d, V3A, and V3B) and ventral areas (LO1 and LO2) were important nodes in the network of abnormal ECs associated with stereoscopic deficits in the patients with amblyopia. Our research provides insights into the neural mechanism underlying stereopsis deficits in patients with amblyopia and provides candidate targets for focused stimulus interventions to enhance the efficacy of clinical treatment for the improvement of stereopsis deficiency.

Electroencephalography Study of Frontal Lobe Evoked by Dynamic Random-Dot Stereogram

Purpose

The purpose of this study was to investigate the cortical electrical activity and electroencephalography (EEG) features of the frontal lobe evoked by dynamic random dot stereogram (DRDS) and to probe the functional connectivity (FC) between the frontal lobe and occipital lobe when processing 3D perception based on the binocular disparity.

Methods

The EEG experiment involved 14 healthy adults with normal stereopsis (<60″) and normal corrected visual acuity (20/20). The Neuroscan system and 32-channel EEG cap were used to record EEG signals based on the DRDS stimuli. The maximum energies of 3 frequency bands (theta-/alpha- /beta-wave) from 13 interesting channels (FP1, FP2, F7, F3, FZ, F4, F8, FC3, FCZ, FC4, O1, OZ, and O2) located in the frontal and occipital lobes were calculated and analyzed. The FC between any two electrodes from the frontal and occipital lobes was calculated based on the Phase lag index (PLI).

Results

The maximum powers of theta- and alpha-waves in most channels of the frontal and occipital lobes were significantly increased (P < 0.05) when the depth perception was evoked by DRDS above the threshold, compared with that without stereo vision. The changes in the maximum powers of both theta- and alpha-waves were significantly different among the 13 electrodes (P = 0.0004 and 0.0015, respectively). Tukey's multiple comparisons showed that the changes in the maximum powers of theta-wave were significantly different in F8 vs. O1, F8 vs. OZ, and F4 vs. O1 (P = 0.0186, 0.0444, and 0.0412, respectively). Moreover, the changes in the maximum powers of alpha-waves were significantly different in FP1 vs. O1 (P = 0.0182). The FCs of theta-waves between the frontal channels and the occipital channels were significantly enhanced when processing the depth perception, compared with those without stereopsis. There was no significant change in the FCs of the alpha-waves when having 3D perception except for FC between F8 and O1 and FC between F8 and OZ.

Conclusions

The cortical electrical activity in the frontal lobe and the functional connectivity between the frontal lobe and the occipital lobe increase when participating in the processing binocular disparity and obtaining 3D perception. Theta-waves in the frontal lobe may be crucial in the stereo vision.

Binocular Viewing Facilitates Size Constancy for Grasping and Manual Estimation

A prerequisite for efficient prehension is the ability to estimate an object’s distance and size. While most studies demonstrate that binocular viewing is associated with a more efficient grasp programming and execution compared to monocular viewing, the factors contributing to this advantage are not fully understood. Here, we examined how binocular vision facilitates grasp scaling using two tasks: prehension and manual size estimation. Participants (n = 30) were asked to either reach and grasp an object or to provide an estimate of an object’s size using their thumb and index finger. The objects were cylinders with a diameter of 0.5, 1.0, or 1.5 cm placed at three distances along the midline (40, 42, or 44 cm). Results from a linear regression analysis relating grip aperture to object size revealed that grip scaling during monocular viewing was reduced similarly for both grasping and estimation tasks. Additional analysis revealed that participants adopted a larger safety margin for grasping during monocular compared to binocular viewing, suggesting that monocular depth cues do not provide sufficient information about an object’s properties, which consequently leads to a less efficient grasp execution.

Testing a formal theory of perception is not easy: Comments on Yu, Todd & Petrov (2021) and Yu, Petrov & Todd (2021)

Yu, Todd, and Petrov (2021, Journal of Vision) and their follow-up study (Yu, Petrov, & Todd, 2021, i-Perception) aimed at evaluating the role of three-dimensional (3D) symmetry in binocular shape perception by comparing their experimental data to predictions they derived from our computational models. We point out in this note that their predictions were incorrect, so their studies can neither reject nor support our models of 3D shape perception. We explain (1) the role of the data and the constraints in solving ill-posed inverse problems, (2) the role of binocular depth-order, as opposed to binocular depth-intervals in shape perception, (3) the nature and the effect of 3D compactness as an a priori constraint, and (4) the implications of the separation of binocular disparity and stereoacuity in the two functional streams in the visual cortex.

Recent understanding of binocular vision in the natural environment with clinical implications

Technological advances in recent decades have allowed us to measure both the information available to the visual system in the natural environment and the rich array of behaviors that the visual system supports. This review highlights the tasks undertaken by the binocular visual system in particular and how, for much of human activity, these tasks differ from those considered when an observer fixates a static target on the midline. The everyday motor and perceptual challenges involved in generating a stable, useful binocular percept of the environment are discussed, together with how these challenges are but minimally addressed by much of current clinical interpretation of binocular function. The implications for new technology, such as virtual reality, are also highlighted in terms of clinical and basic research application.

Binocular vision supports the development of scene segmentation capabilities: Evidence from a deep learning model

The application of deep learning techniques has led to substantial progress in solving a number of critical problems in machine vision, including fundamental problems of scene segmentation and depth estimation. Here, we report a novel deep neural network model, capable of simultaneous scene segmentation and depth estimation from a pair of binocular images. By manipulating the arrangement of binocular image pairs, presenting the model with standard left-right image pairs, identical image pairs or swapped left-right images, we show that performance levels depend on the presence of appropriate binocular image arrangements. Segmentation and depth estimation performance are both impaired when images are swapped. Segmentation performance levels are maintained, however, for identical image pairs, despite the absence of binocular disparity information. Critically, these performance levels exceed those found for an equivalent, monocularly trained, segmentation model. These results provide evidence that binocular image differences support both the direct recovery of depth and segmentation information, and the enhanced learning of monocular segmentation signals. This finding suggests that binocular vision may play an important role in visual development. Better understanding of this role may hold implications for the study and treatment of developmentally acquired perceptual impairments.

General and Specific Effects of Stereo Learning

Technological advancements in virtual reality challenge the human vision, especially stereopsis, a function, which characterizes how two eyes coordinate to form a unified three-dimensional (3D) representation of the external world and is found to be deficient in 30% of the normal population. Although a few previous studies have consistently found that the perceptual learning of stereopsis significantly improved stereoacuity, an underlying mechanism of stereo learning remains heavily debated. Here, we trained subjects with normal stereo vision (assessed with the FLY Stereo Acuity Test) to judge stereopsis containing three types of binocular disparity orders (i.e., zero-, first-, and second-order), aiming to systematically examine the characteristics and plasticity of stereo learning. Thirty subjects were randomly assigned to the three training groups (each for the zero-, first-, or second-order disparity separately). The disparity thresholds were measured before and after training. The disparity threshold was measured in 10 additional control subjects only at the pre- and post-training phase. Stereoscopic images were displayed through a shutter goggle, which is synchronized to a monitor. We found that the training significantly improved the zero-, first-, and second-order disparity threshold by 52.42, 36.28, and 14.9% in the zero-order training condition; 30.44, 63.74, and 21.07% in the first-order training condition; and 30.77, 25.19, and 75.12% in the second-order training condition, respectively. There was no significant improvement in the control group. Interestingly, the greatest improvements in the first- and second-order disparity threshold were found in the corresponding disparity training group; on the contrary, the improvements in the zero-order disparity threshold were comparable across all the three disparity training groups. Our findings demonstrated both general (related to the zero-order disparity) and specific improvements (related to the first- and second-order disparity) in stereo learning, suggesting that stereo training occurs at different visual processing stages and its effects might depend on the specific training sites.

Where there is no object formation, there is no perceptual organization: Evidence from the configural superiority effect

Object formation is considered the aim of perceptual organization, but such a proposition has been neglected in empirical studies. In the current study, we investigated the role of object formation in configural superiority. Essentially, discrimination on bar orientations was enhanced by adding a right angle to each of the bars. Such facilitation is due to the emergent feature (EF) of closure formed by combining the bars with right angles. To study object formation, visual stimuli were generated by random dot stereograms to form objects or holes in 3D. Behaviorally, we found that the EF of closure facilitated oddball discrimination on objects, as demonstrated by previous studies, but did not facilitate oddball discrimination on holes with the same shape as objects. Multivariate pattern analysis of functional magnetic resonance imaging (fMRI) data showed that the EF of closure increased the object classification accuracy compared to the holes in the lateral occipital cortex (LOC), where object information is encoded, but not in the early visual cortex (EVC). The neural representations of objects and holes with and without EFs were further investigated using representational similarity analysis. The results demonstrate that in the LOC, the neural representations of objects with EFs showed a greater difference than those of the other three, that is, objects without EFs and holes with or without EFs. However, the uniqueness of objects with EFs was not observed in the EVC. Thus, our results suggest that the EF of closure, which leads to the configural superiority effect, only emerges for objects but not for holes, and only in the LOC but not the EVC. Our study provides the first empirical evidence suggesting that object formation plays an indispensable role in perceptual organization.

Stereoscopic three-dimensional visualisation technology in anatomy learning: A meta-analysis

OBJECTIVES

The features that contribute to the apparent effectiveness of three-dimensional visualisation technology [3DVT] in teaching anatomy are largely unknown. The aim of this study was to conduct a systematic review and meta-analysis of the role of stereopsis in learning anatomy with 3DVT.

METHODS

The review was conducted and reported according to PRISMA Standards. Literature search of English articles was performed using EMBASE, MEDLINE, CINAHL EBSCOhost, ERIC EBSCOhost, Cochrane CENTRAL, Web of Science and Google Scholar databases until November 2019. Study selection, data extraction and study appraisal were performed independently by two authors. Articles were assessed for methodological quality using the Medical Education Research Study Quality Instrument and the Cochrane Collaboration's tool for assessing the risk of bias. For quantitative analysis, studies were grouped based on relative between-intervention differences in instructional methods and type of control conditions.

RESULTS

A total of 3934 citations were obtained of which 67 underwent a full-text review. Ultimately, 13 randomised controlled trials were included in the meta-analysis. When interactive, stereoscopic 3D models were compared to interactive, monoscopic 3D models within a single level of instructional design, for example isolating stereopsis as the only true manipulated element in the experimental design, an effect size [ES] of 0.53 (95% confidence interval [CI] 0.26-0.80; P < .00001) was found. In comparison with 2D images within multiple levels of instructional design, an effect size of 0.45 (95% CI 0.10-0.81; P < .002) was found. Stereopsis had no effect on learning when utilised with non-interactive 3D images (ES = -0.87, 95% CI -2.09-0.35; P = .16).

CONCLUSION

Stereopsis is an important distinguishing element of 3DVT that has a significant positive effect on acquisition of anatomical knowledge when utilised within an interactive 3D environment. A distinction between stereoscopic and monoscopic 3DVT is essential to make in anatomical education and research.

Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque

The division of labor between the dorsal and ventral visual pathways has been well studied, but not often with direct comparison at the single-neuron resolution with matched stimuli. Here we directly compared how single neurons in MT and V4, mid-tier areas of the two pathways, process binocular disparity, a powerful cue for 3D perception and actions. We found that MT neurons transmitted disparity signals more quickly and robustly, whereas V4 or its upstream neurons transformed the signals into sophisticated representations more prominently. Therefore, signaling speed and robustness were traded for transformation between the dorsal and ventral pathways. The key factor in this tradeoff was disparity-tuning shape: V4 neurons had more even-symmetric tuning than MT neurons. Moreover, the tuning symmetry predicted the degree of signal transformation across neurons similarly within each area, implying a general role of tuning symmetry in the stereoscopic processing by the two pathways.

Surface slant impairs disparity discontinuity discrimination

Binocular disparity signals are highly informative about the three-dimensional structure of visual scenes, including aiding the detection of depth discontinuities between surfaces. Here, we examine factors affecting sensitivity to such surface discontinuities. Participants were presented with random dot stereograms depicting two planar surfaces slanted in opposite directions and were asked to judge the sign of the depth discontinuity created where those surfaces met. Although the judgement was focussed on the adjacent edges, the precision of depth discontinuity discrimination depended upon the slant of the two surfaces: increasing surface slants to ±60° increased discontinuity discrimination thresholds by, on average, a factor of 5. Control experiments examining discontinuity discrimination across surfaces with identical slants showed either biases in discontinuity judgements or reduced threshold elevation. These results suggest that sensitivity to depth discontinuities is affected by processing limitations in both local absolute disparity measurement mechanisms and mechanisms selective for disparity differences. As further evidence in support of this conclusion, we show that our results are well-described by a model of discontinuity discrimination based on the encoding of local differences in relative disparity.

Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas

Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.

The Effect of Stereoscopic Augmented Reality Visualization on Learning Anatomy and the Modifying Effect of Visual-Spatial Abilities: A Double-Center Randomized Controlled Trial

Monoscopically projected three-dimensional (3D) visualization technology may have significant disadvantages for students with lower visual-spatial abilities despite its overall effectiveness in teaching anatomy. Previous research suggests that stereopsis may facilitate a better comprehension of anatomical knowledge. This study evaluated the educational effectiveness of stereoscopic augmented reality (AR) visualization and the modifying effect of visual-spatial abilities on learning. In a double-center randomized controlled trial, first- and second-year (bio)medical undergraduates studied lower limb anatomy with stereoscopic 3D AR model (n = 20), monoscopic 3D desktop model (n = 20), or two-dimensional (2D) anatomical atlas (n = 18). Visual-spatial abilities were tested with Mental Rotation Test (MRT), Paper Folding Test (PFT), and Mechanical Reasoning (MR) Test. Anatomical knowledge was assessed by the validated 30-item paper posttest. The overall posttest scores in the stereoscopic 3D AR group (47.8%) were similar to those in the monoscopic 3D desktop group (38.5%; P = 0.240) and the 2D anatomical atlas group (50.9%; P = 1.00). When stratified by visual-spatial abilities test scores, students with lower MRT scores achieved higher posttest scores in the stereoscopic 3D AR group (49.2%) as compared to the monoscopic 3D desktop group (33.4%; P = 0.015) and similar to the scores in the 2D group (46.4%; P = 0.99). Participants with higher MRT scores performed equally well in all conditions. It is instrumental to consider an aptitude-treatment interaction caused by visual-spatial abilities when designing research into 3D learning. Further research is needed to identify contributing features and the most effective way of introducing this technology into current educational programs.

Cerebral Visual Impairment and Clinical Assessment: The European Perspective

This paper summarizes the multidisciplinary pediatric assessment methods of 3 European centers for identifying and assessing cerebral visual impairment in childhood. It describes a comprehensive neurodevelopmental assessment evaluation in which visual aspects play an important part. Developmental trajectories and the heterogeneity of the clinical picture are emphasized. Multidisciplinary ophthalmology and neurodisability/neurology teamwork together with the parent and teachers, to reach an integrated and individualized perspective for the individual child, are described. This comprehensive assessment is the starting point for habilitation programs and interventions, that can support and meet the child's needs and help them reach their optimal potential. Future developments in classification of the cerebral visual impairment conditions, building on the child's individual assessment profile, will further enhance the direction of clinical, educational, and research progress.

Image Segmentation Based on Relative Motion and Relative Disparity Cues in Topographically Organized Areas of Human Visual Cortex

The borders between objects and their backgrounds create discontinuities in image feature maps that can be used to recover object shape. Here we used functional magnetic resonance imaging to identify cortical areas that encode two of the most important image segmentation cues: relative motion and relative disparity. Relative motion and disparity cues were isolated by defining a central 2-degree disk using random-dot kinematograms and stereograms, respectively. For motion, the disk elicited retinotopically organized activations starting in V1 and extending through V2 and V3. In the surrounding region, we observed phase-inverted activations indicative of suppression, extending out to at least 6 degrees of retinal eccentricity. For disparity, disk activations were only found in V3, while suppression was observed in all early visual areas. Outside of early visual cortex, several areas were sensitive to both types of cues, most notably LO1, LO2 and V3B, making them additional candidate areas for motion- and disparity-cue combination. Adding an orthogonal task at fixation did not diminish these effects, and in fact led to small but measurable disk activations in V1 and V2 for disparity. The overall pattern of extra-striate activations is consistent with recent three-stream models of cortical organization.

Single-cell responses to three-dimensional structure in a functionally defined patch in macaque area TEO

Both dorsal and ventral visual pathways harbor several areas sensitive to gradients of binocular disparity (i.e., higher-order disparity). Although a wealth of information exists about disparity processing in early visual (V1, V2, and V3) and end-stage areas, TE in the ventral stream, and the anterior intraparietal area (AIP) in the dorsal stream, little is known about midlevel area TEO in the ventral pathway. We recorded single-unit responses to disparity-defined curved stimuli in a functional magnetic resonance imaging (fMRI) activation elicited by curved surfaces compared with flat surfaces in the macaque area TEO. This fMRI activation contained a small proportion of disparity-selective neurons, with very few of them second-order disparity selective. Overall, this population of TEO neurons did not preserve its three-dimensional structure selectivity across positions in depth, indicating a lack of higher-order disparity selectivity, but showed stronger responses to flat surfaces than to curved surfaces, as predicted by the fMRI experiment. The receptive fields of the responsive TEO cells were relatively small and generally foveal. A linear support vector machine classifier showed that this population of disparity-selective TEO neurons contains reliable information about the sign of curvature and the position in depth of the stimulus. NEW & NOTEWORTHY We recorded in a part of the macaque area TEO that is activated more by curved surfaces than by flat surfaces at different disparities using the same stimuli. In contrast to previous studies, this functional magnetic resonance imaging-defined patch did not contain a large number of higher-order disparity-selective neurons. However, a linear support vector machine could reliably classify both the sign of the disparity gradient and the position in depth of the stimuli.

A Tale of Two Visual Systems: Invariant and Adaptive Visual Information Representations in the Primate Brain

Visual information processing contains two opposite needs. There is both a need to comprehend the richness of the visual world and a need to extract only pertinent visual information to guide thoughts and behavior at a given moment. I argue that these two aspects of visual processing are mediated by two complementary visual systems in the primate brain-specifically, the occipitotemporal cortex (OTC) and the posterior parietal cortex (PPC). The role of OTC in visual processing has been documented extensively by decades of neuroscience research. I review here recent evidence from human imaging and monkey neurophysiology studies to highlight the role of PPC in adaptive visual processing. I first document the diverse array of visual representations found in PPC. I then describe the adaptive nature of visual representation in PPC by contrasting visual processing in OTC and PPC and by showing that visual representations in PPC largely originate from OTC.

Vision in our three-dimensional world

Many aspects of our perceptual experience are dominated by the fact that our two eyes point forward. Whilst the location of our eyes leaves the environment behind our head inaccessible to vision, co-ordinated use of our two eyes gives us direct access to the three-dimensional structure of the scene in front of us, through the mechanism of stereoscopic vision. Scientific understanding of the different brain regions involved in stereoscopic vision and three-dimensional spatial cognition is changing rapidly, with consequent influences on fields as diverse as clinical practice in ophthalmology and the technology of virtual reality devices.This article is part of the themed issue 'Vision in our three-dimensional world'.

Functional interactions between the macaque dorsal and ventral visual pathways during three-dimensional object vision

The division of labor between the dorsal and the ventral visual stream in the primate brain has inspired numerous studies on the visual system in humans and in nonhuman primates. However, how and under which circumstances the two visual streams interact is still poorly understood. Here we review evidence from anatomy, modelling, electrophysiology, electrical microstimulation (EM), reversible inactivation and functional imaging in the macaque monkey aimed at clarifying at which levels in the hierarchy of visual areas the two streams interact, and what type of information might be exchanged between the two streams during three-dimensional (3D) object viewing. Neurons in both streams encode 3D structure from binocular disparity, synchronized activity between parietal and inferotemporal areas is present during 3D structure categorization, and clusters of 3D structure-selective neurons in parietal cortex are anatomically connected to ventral stream areas. In addition, caudal intraparietal cortex exerts a causal influence on 3D-structure related activations in more anterior parietal cortex and in inferotemporal cortex. Thus, both anatomical and functional evidence indicates that the dorsal and the ventral visual stream interact during 3D object viewing.