Binocular fusion of luminance, color, motion and flicker--two eyes are worse than one

Perceptual learning based on a temporal stimulus enhances visual function in adult amblyopic subjects

Studies have shown that Perceptual Learning (PL) can lead to enhancement of spatial visual functions in amblyopic subjects. Here we aimed to determine whether a simple flickering stimulus can be utilized in PL to enhance temporal function performance and whether enhancement will transfer to spatial functions in amblyopic subjects. Six adult amblyopic and six normally sighted subjects underwent an evaluation of their performance of baseline psychophysics spatial functions (Visual acuity (VA), contrast sensitivity (CS), temporal functions (critical fusion frequency (CFF) test), as well as a static and flickering stereopsis test, and an electrophysiological evaluation (VEP). The subjects then underwent 5 training sessions (on average, a total of 150 min over 2.5 weeks), which included a task similar to the CFF test using the method of constant stimuli. After completing the training sessions, subjects repeated the initial performance evaluation tasks. All amblyopic subjects showed improved temporal visual performance (CFF) in the amblyopic eye (on average, 17%, p << 0.01) following temporal PL. Generalization to spatial, spatio-temporal, and binocular tasks was also found: VA increased by 0.12 logMAR (p = 0.004), CS in backward masking significantly increased (by up to 19%, p = 0.003), and flickering stereopsis increased by 85 arcsec (p = 0.048). These results were further electrophysiologically manifested by an increase in VEP amplitude (by 43%, p = 0.03), increased Signal-to-Noise ratio (SNR) (by 39%, p = 0.024) to levels not different from normally sighted subjects, along with an improvement in inter-ocular delay (by 5.8 ms, p = 0.003). In contrast, no significant effect of training was found in the normally sighted group. These results highlight the potential of PL based on a temporal stimulus to improve the temporal and spatial visual performance in amblyopes. Future work is needed to optimize this method for clinical applications.

Temporal synchronization elicits enhancement of binocular vision functions

Integration of information over the CNS is an important neural process that affects our ability to perceive and react to the environment. The visual system is required to continuously integrate information arriving from two different sources (the eyes) to create a coherent percept with high spatiotemporal precision. Although this neural integration of information is assumed to be critical for visual performance, it can be impaired under some pathological or developmental conditions. Here we took advantage of a unique developmental condition, amblyopia ("lazy eye"), which is characterized by an impaired temporal synchronization between the two eyes, to meticulously study the effect of synchronization on the integration of binocular visual information. We measured the eyes' asynchrony and compensated for it (with millisecond temporal resolution) by providing time-shifted stimuli to the eyes. We found that the re-synchronization of the ocular input elicited a significant improvement in visual functions, and binocular functions, such as binocular summation and stereopsis, were regained. This phenomenon was also evident in neurophysiological measures. Our results can shed light on other neural processing aspects and might also have translational relevance for the field of training, rehabilitation, and perceptual learning.

Nature-inspired saccadic-like electrical stimulation paradigm promotes sustained retinal ganglion cell responses by spatiotemporally alternating activation of contiguous multi-electrode patterns

Objective. Retinal electrical stimulation using multi-electrode arrays (MEAs) aims to restore visual object perception in blind patients. However, the rate and duration of the artificial visual sensations are limited due to the rapid response decay of the stimulated neurons. Hence, we investigated a novel nature-inspired saccadic-like stimulation paradigm (biomimetic) to evoke sustained retinal responses. For implementation, the macroelectrode was replaced by several contiguous microelectrodes and activated non-simultaneously but alternating topologically.Approach.MEAs with hexagonally arranged electrodes were utilized to simulate and record mouse retinal ganglion cells (RGCs). Two shapes were presented electrically using MEAs: a 6e-hexagon (six hexagonally arranged 10µm electrodes; 6e-hexagon diameter: 80µm) and a double-bar (180µm spaced, 320µm in length). Electrodes of each shape were activated in three different modes (simultaneous, circular, and biomimetic ('zig-zag')), stimulating at different frequencies (1-20 Hz).Main results.The biomimetic stimulation generated enhanced RGC responses increasing the activity rate by 87.78%. In the spatiotemporal context, the electrical representation of the 6e-hexagon produced sustained and local RGC responses (∼130µm corresponding to ∼2.5° of the human visual angle) for up to 90 s at 10 Hz stimulation and resolved the electrically presented double-bar. In contrast, during conventional simultaneous stimulation, the responses were poor and declined within seconds. Similarly, the applicability of the biomimetic mode for retinal implants (7 × 8 pixels) was successfully demonstrated. An object shape impersonating a smile was presented electrically, and the recorded data were used to emulate the implant's performance. The spatiotemporal pixel mapping of the activity produced a complete retinal image of the smile.Significance.The application of electrical stimulation in the biomimetic mode produced locally enhanced RGC responses with significantly reduced fading effects and yielded advanced spatiotemporal performance reflecting the presented electrode shapes in the mapped activity imprint. Therefore, it is likely that the RGC responses persist long enough to evoke visual perception and generate a seamless image, taking advantage of the flicker fusion. Hence, replacing the implant's macroelectrodes with microelectrodes and their activation in a topologically alternating biomimetic fashion may overcome the patient's perceptual image fading, thereby enhancing the spatiotemporal characteristics of artificial vision.

Detection of binocular chromatic fusion limit for opposite colors

When the input colors of the left and right eyes are different from one another, binocular rivalry may occur. According to Hering theory, opponent colors would have the most significant tendency for rivalry. However, binocular color fusion still occurs under the condition that each eye's opponent chromatic responses do not exceed a specific chromatic fusion limit (CFL). This paper detects the binocular chromatic fusion limit for opposite colors within a conventional 3D display color gamut. We conducted a psychophysical experiment to quantitatively measure the binocular chromatic fusion limit on four opposite color directions in the CIELAB color space. Due to color inconsistency between eyes may affect the binocular color fusion, the experiment was divided into two sessions by swapping stimulation colors of left and right eyes. There were 5 subjects and they each experienced 320 trials. By analyzing the results, we used ellipses to quantify the chromatic fusion limits for opposing colors. The average semi-major axis of the ellipses is 27.55 Δ E a b∗, and the average semi-minor axis is 16.98 Δ E a b∗. We observed that the chromatic fusion limit varies with the opposite color direction: the CFL on RedBlue-GreenYellow direction is greater than that on Red-Green direction, the latter being greater than that on Yellow-Blue direction and the CFL on RedYellow-GreenBlue direction is smallest. Furthermore, we suggested that the chromatic fusion limit is independent of the distribution of cells, and there is no significant change in the fusion ellipse boundaries after swapping left and right eye colors.

Binaural Pitch Fusion: Binaural Pitch Averaging in Cochlear Implant Users With Broad Binaural Fusion

OBJECTIVES

Individuals who use hearing aids (HAs) or cochlear implants (CIs) can experience broad binaural pitch fusion, such that sounds differing in pitch by as much as 3 to 4 octaves are perceptually integrated across ears. Previously, it was shown in HA users that the fused pitch is a weighted average of the two monaural pitches, ranging from equal weighting to dominance by the lower pitch. The goal of this study was to systematically measure the fused pitches in adult CI users, and determine whether CI users experience similar pitch averaging effects as observed in HA users.

DESIGN

Twelve adult CI users (Cochlear Ltd, Sydney, Australia) participated in this study: six bimodal CI users, who wear a CI with a contralateral HA, and six bilateral CI users. Stimuli to HA ears were acoustic pure tones, and stimuli to CI ears were biphasic pulse trains delivered to individual electrodes. Fusion ranges, the ranges of frequencies/electrodes in the comparison ear that were fused with a single electrode (electrode 22, 18, 12, or 6) in the reference ear, were measured using simultaneous, dichotic presentation of reference and comparison stimuli in opposite ears, and varying the comparison stimulus. Once the fusion ranges were measured, the fused binaural pitch of a reference-pair stimulus combination was measured by finding a pitch match to monaural comparison stimuli presented to the paired stimulus ear.

RESULTS

Fusion pitch weighting in CI users varied depending on the pitch difference of the reference-pair stimulus combination, with equal pitch averaging occurring for stimuli closer in pitch and lower pitch dominance occurring for stimuli farther apart in pitch. The averaging region was typically 0.5 to 2.3 octaves around the reference for bimodal CI users and 0.4 to 1.5 octaves for bilateral CI users. In some cases, a bias in the averaging region was observed toward the ear with greater stimulus variability.

CONCLUSIONS

Fusion pitch weighting effects in CI users were similar to those observed previously in HA users. However, CI users showed greater inter-subject variability in both pitch averaging ranges and bias effects. These findings suggest that binaural pitch averaging could be a common underlying mechanism in hearing-impaired listeners.

Salience-Based Edge Selection in Flicker and Binocular Color Vision

A test cross that flickers between light yellow and dark blue at 5 to 8Hz looks apparently yellow on a dark gray surround and apparently blue on a light gray surround (flicker augmented contrast). The achromatic surround cannot be inducing the perceived colors. Instead, the visual system selects the more salient apparent color with the higher Michelson contrast. The same is true for dichoptic vision. When one eye views a steady, light yellow cross and the other eye views a congruent steady dark blue cross, the binocular combination of colors looks apparently yellow on a dark gray surround and apparently blue on a light gray surround. Thus, when competing stimuli are distributed over time (flicker) or space (dichoptic vision), the visual system overweights the stimulus with the higher contrast. To see objects clearly, we accept the best view of any object and downplay inferior alternatives.

Binaural pitch fusion: Comparison of normal-hearing and hearing-impaired listeners

Binaural pitch fusion is the fusion of dichotically presented tones that evoke different pitches between the ears. In normal-hearing (NH) listeners, the frequency range over which binaural pitch fusion occurs is usually <0.2 octaves. Recently, broad fusion ranges of 1-4 octaves were demonstrated in bimodal cochlear implant users. In the current study, it was hypothesized that hearing aid (HA) users would also exhibit broad fusion. Fusion ranges were measured in both NH and hearing-impaired (HI) listeners with hearing losses ranging from mild-moderate to severe-profound, and relationships of fusion range with demographic factors and with diplacusis were examined. Fusion ranges of NH and HI listeners averaged 0.17 ± 0.13 octaves and 1.7 ± 1.5 octaves, respectively. In HI listeners, fusion ranges were positively correlated with a principal component measure of the covarying factors of young age, early age of hearing loss onset, and long durations of hearing loss and HA use, but not with hearing threshold, amplification level, or diplacusis. In NH listeners, no correlations were observed with age, hearing threshold, or diplacusis. The association of broad fusion with early onset, long duration of hearing loss suggests a possible role of long-term experience with hearing loss and amplification in the development of broad fusion.

Two Ears Are Not Always Better than One: Mandatory Vowel Fusion Across Spectrally Mismatched Ears in Hearing-Impaired Listeners

Hearing loss and auditory prostheses can alter auditory processing by inducing large pitch mismatches and broad pitch fusion between the two ears. Similar to integration of incongruent inputs in other sensory modalities, the mismatched, fused pitches are often averaged across ears for simple stimuli. Here, we measured parallel effects on complex stimulus integration using a new technique based on vowel classification in five bilateral hearing aid users and eight bimodal cochlear implant users. Continua between five pairs of synthetic vowels were created by varying the first formant spectral peak while keeping the second formant constant. Comparison of binaural and monaural vowel classification functions for each vowel pair continuum enabled visualization of the following frequency-dependent integration trends: (1) similar monaural and binaural functions, (2) ear dominance, (3) binaural averaging, and (4) binaural interference. Hearing aid users showed all trends, while bimodal cochlear implant users showed mostly ear dominance or interference. Interaural pitch mismatches, frequency ranges of binaural pitch fusion, and the relative weightings of pitch averaging across ears were also measured using tone and/or electrode stimulation. The presence of both large interaural pitch mismatches and broad pitch fusion was not sufficient to predict vowel integration trends such as binaural averaging or interference. The way that pitch averaging was weighted between ears also appears to be important for determining binaural vowel integration trends. Abnormally broad spectral fusion and the associated phoneme fusion across mismatched ears may underlie binaural speech perception interference observed in hearing aid and cochlear implant users.

Stereo chromatic contrast sensitivity model to blue-yellow gratings

As a fundamental metric of human visual system (HVS), contrast sensitivity function (CSF) is typically measured by sinusoidal gratings at the detection of thresholds for psychophysically defined cardinal channels: luminance, red-green, and blue-yellow. Chromatic CSF, which is a quick and valid index to measure human visual performance and various retinal diseases in two-dimensional (2D) space, can not be directly applied into the measurement of human stereo visual performance. And no existing perception model considers the influence of chromatic CSF of inclined planes on depth perception in three-dimensional (3D) space. The main aim of this research is to extend traditional chromatic contrast sensitivity characteristics to 3D space and build a model applicable in 3D space, for example, strengthening stereo quality of 3D images. This research also attempts to build a vision model or method to check human visual characteristics of stereo blindness. In this paper, CRT screen was clockwise and anti-clockwise rotated respectively to form the inclined planes. Four inclined planes were selected to investigate human chromatic vision in 3D space and contrast threshold of each inclined plane was measured with 18 observers. Stimuli were isoluminant blue-yellow sinusoidal gratings. Horizontal spatial frequencies ranged from 0.05 to 5 c/d. Contrast sensitivity was calculated as the inverse function of the pooled cone contrast threshold. According to the relationship between spatial frequency of inclined plane and horizontal spatial frequency, the chromatic contrast sensitivity characteristics in 3D space have been modeled based on the experimental data. The results show that the proposed model can well predicted human chromatic contrast sensitivity characteristics in 3D space.

Abnormal binaural spectral integration in cochlear implant users

Bimodal stimulation, or stimulation of a cochlear implant (CI) together with a contralateral hearing aid (HA), can improve speech perception in noise However, this benefit is variable, and some individuals even experience interference with bimodal stimulation. One contributing factor to this variability may be differences in binaural spectral integration (BSI) due to abnormal auditory experience. CI programming introduces interaural pitch mismatches, in which the frequencies allocated to the electrodes (and contralateral HA) differ from the electrically stimulated cochlear frequencies. Previous studies have shown that some, but not all, CI users adapt pitch perception to reduce this mismatch. The purpose of this study was to determine whether broadened BSI may also reduce the perception of mismatch. Interaural pitch mismatches and dichotic pitch fusion ranges were measured in 21 bimodal CI users. Seventeen subjects with wide fusion ranges also conducted a task to pitch match various fused electrode-tone pairs. All subjects showed abnormally wide dichotic fusion frequency ranges of 1-4 octaves. The fusion range size was weakly correlated with the interaural pitch mismatch, suggesting a link between broad binaural pitch fusion and large interaural pitch mismatch. Dichotic pitch averaging was also observed, in which a new binaural pitch resulted from the fusion of the original monaural pitches, even when the pitches differed by as much as 3-4 octaves. These findings suggest that abnormal BSI, indicated by broadened fusion ranges and spectral averaging between ears, may account for speech perception interference and nonoptimal integration observed with bimodal compared with monaural hearing device use.