Common mechanisms for 2D tilt and 3D slant after-effects

Reduced Monocular Luminance Promotes Fusion But Not Mixed Perception in Amblyopia

Purpose

The purpose of this study was to understand how monocular luminance reduction affects binocular balance and examine whether it differentially influences fusion and mixed perception in amblyopia.

Methods

Twenty-three normally sighted observers and 12 adults with amblyopia participated in this study. A novel binocular rivalry task was used to measure the phase duration of four perceptual responses (right- and left-tilts, fusion, and mixed perception) before and after a neutral density (ND) filter was applied at various levels to the dominant eye (DE) of controls and the fellow eye (FE) of patients with amblyopia. Phase durations were analyzed to assess whether the duration of fusion or mixed perception shifted after monocular luminance reduction. Moreover, we quantified ocular dominance and adjusted monocular contrast and luminance separately to investigate the relationship between changes in ocular dominance induced by the two manipulations.

Results

In line with previous studies, binocular balance shifted in favor of the brighter eye in both normal adults and patients with amblyopia. As a function of the ND filter's density, the duration of fusion and mixed perception decreased in normal controls, whereas that of fusion but not mixed perception increased significantly in patients with amblyopia. In addition, changes in binocular balance from luminance reduction were more significant in more balanced amblyopes or normal observers. Furthermore, shifts in binocular balance after contrast and luminance modulation were correlated in both normal and amblyopic observers.

Conclusions

The duration of fusion but not mixed perception increased in amblyopia after monocular luminance reduction in the FE. Moreover, our findings demonstrate that changes in ocular dominance from contrast-modulation and luminance-modulation are correlated in both normal and amblyopic observers.

Humans Perceive Binocular Rivalry and Fusion in a Tristable Dynamic State

Human vision combines inputs from the two eyes into one percept. Small differences "fuse" together, whereas larger differences are seen "rivalrously" from one eye at a time. These outcomes are typically treated as mutually exclusive processes, with paradigms targeting one or the other and fusion being unreported in most rivalry studies. Is fusion truly a default, stable state that only breaks into rivalry for non-fusible stimuli? Or are monocular and fused percepts three sub-states of one dynamical system? To determine whether fusion and rivalry are separate processes, we measured human perception of Gabor patches with a range of interocular orientation disparities. Observers (10 female, 5 male) reported rivalrous, fused, and uncertain percepts over time. We found a dynamic "tristable" zone spanning from ∼25-35° of orientation disparity where fused, left-eye-, or right-eye-dominant percepts could all occur. The temporal characteristics of fusion and non-fusion periods during tristability matched other bistable processes. We tested statistical models with fusion as a higher-level bistable process alternating with rivalry against our findings. None of these fit our data, but a simple bistable model extended to have three states reproduced many of our observations. We conclude that rivalry and fusion are multistable substates capable of direct competition, rather than separate bistable processes.SIGNIFICANCE STATEMENT When inputs to the two eyes differ, they can either fuse together or engage in binocular rivalry, where each eye's view is seen exclusively in turn. Visual stimuli have often been tailored to produce either fusion or rivalry, implicitly treating them as separate mutually-exclusive perceptual processes. We have found that some similar-but-different stimuli can result in both outcomes over time. Comparing various simple models with our results suggests that rivalry and fusion are not independent processes, but compete within a single multistable system. This conceptual shift is a step toward unifying fusion and rivalry, and understanding how they both contribute to the visual system's production of a unified interpretation of the conflicting images cast on the retina by real-world scenes.

A dichoptic study of the oblique effect

The oblique effect is a decreased sensitivity for oblique orientations compared with horizontal/vertical orientations. We investigated whether orientation-matching acuity for binocularly presented stimuli is dependent on orientations of retinal projections or on the perceived orientation of the stimulus. Using a stereoscope, we constructed a stimulus, such that retinal orientations were oblique, while the perceived orientation was vertical. We then used this stimulus to test observers in an orientation-matching task. If orientation matching depends on the orientations of retinal projections, low matching performance would be expected, since retinal projections are oblique. However, if orientation matching depends on perceived orientation (vertical), high matching performance would be expected. We found that observers' performance can only be predicted from the perceived orientation, not the orientations of retinal projections, implying that in binocular viewing the oblique effect occurs after binocular fusion.

Orientation disparity: a cue for 3D orientation?

Orientation disparity, the difference in orientation that results when a texture element on a slanted surface is projected to the two eyes, has been proposed as a binocular cue for 3D orientation. Since orientation disparity is confounded with position disparity, neither behavioral nor neurophysiological experiments have successfully isolated its contribution to slant estimates or established whether the visual system uses it. Using a modified disparity energy model, we simulated a population of binocular visual cortical neurons tuned to orientation disparity and measured the amount of Fisher information contained in the activity patterns. We evaluated the potential contribution of orientation disparity to 3D orientation estimation and delimited the stimulus conditions under which it is a reliable cue. Our results suggest that orientation disparity is an efficient source of information about 3D orientation and that it is plausible that the visual system could have mechanisms that are sensitive to it. Although orientation disparity is neither necessary nor sufficient for estimating slant, it appears that it could be useful when combined with estimates from position disparity gradients and monocular perspective cues.

Factors contributing to the adaptation aftereffects of facial expression

Previous studies have demonstrated the existence of adaptation aftereffects for facial expressions. Here we investigated which aspects of facial stimuli contribute to these aftereffects. In Experiment 1, we examined the role of local adaptation to image elements such as curvature, shape and orientation, independent of expression, by using hybrid faces constructed from either the same or opposing expressions. While hybrid faces made with consistent expressions generated aftereffects as large as those with normal faces, there were no aftereffects from hybrid faces made from different expressions, despite the fact that these contained the same local image elements. In Experiment 2, we examined the role of facial features independent of the normal face configuration by contrasting adaptation with whole faces to adaptation with scrambled faces. We found that scrambled faces also generated significant aftereffects, indicating that expressive features without a normal facial configuration could generate expression aftereffects. In Experiment 3, we examined the role of facial configuration by using schematic faces made from line elements that in isolation do not carry expression-related information (e.g. curved segments and straight lines) but that convey an expression when arranged in a normal facial configuration. We obtained a significant aftereffect for facial configurations but not scrambled configurations of these line elements. We conclude that facial expression aftereffects are not due to local adaptation to image elements but due to high-level adaptation of neural representations that involve both facial features and facial configuration.

What is adapted in face adaptation? The neural representations of expression in the human visual system

The neural representation of facial expression within the human visual system is not well defined. Using an adaptation paradigm, we examined aftereffects on expression perception produced by various stimuli. Adapting to a face, which was used to create morphs between two expressions, substantially biased expression perception within the morphed faces away from the adapting expression. This adaptation was not based on low-level image properties, as a different image of the same person displaying that expression produced equally robust aftereffects. Smaller but significant aftereffects were generated by images of different individuals, irrespective of gender. Non-face visual, auditory, or verbal representations of emotion did not generate significant aftereffects. These results suggest that adaptation affects at least two neural representations of expression: one specific to the individual (not the image), and one that represents expression across different facial identities. The identity-independent aftereffect suggests the existence of a 'visual semantic' for facial expression in the human visual system.