Three-dimensional binocular eye-hand coordination in normal vision and with simulated visual impairment

Gaze behaviour during multiple object tracking is dependent on binocular vision integrity

INTRODUCTION

Despite the critical importance of binocular vision integrity in daily activities, there exists limited understanding of how alterations in binocular vision integrity impact gaze behaviour during dynamic, complex psychomotor skills. This study aimed to measure how alterations in binocular vision integrity, created by Bangerter filters (BF), affect gaze behaviour during multiple object tracking (MOT).

METHODS

During the experiment, 22 volunteers completed the MOT task under three different visual conditions. The first condition involved natural binocular viewing, while the second and third conditions used 0.4 and 0.2 neutral density BF, respectively, resulting in monocular blur in the sensorially dominant eye. During the MOT task, participants were instructed to track three of eight balls for 10 s, and the speed was adjusted using a staircase procedure. Throughout the task, the following gaze parameters were recorded: fixation duration, saccade duration, amplitude and frequency as well as blink rate.

RESULTS

During MOT execution, participants employed three gaze strategies regardless of viewing conditions: saccadic movements were predominant, followed by maintaining fixation on a central location throughout the trial and to a lesser extent, smooth pursuit eye movements. There was a significant effect of manipulating viewing conditions on the MOT scores (p = 0.046, η2  = 0.09). As the viewing conditions became more difficult, we observed a decrease in fixation duration (p = 0.004, η2  = 0.16) and blink rate (p < 0.001, η2  = 0.20) and an increase in saccadic amplitude (p < 0.001, η2  = 0.29).

CONCLUSIONS

The results support the notion that perceptual-cognitive skills depend on the integrity of binocular vision, underscoring the sensitivity of gaze behaviours to any impairment of binocular function.

The effect of different depth planes during a manual tracking task in three-dimensional virtual reality space

Unlike ballistic arm movements such as reaching, the contribution of depth information to the performance of manual tracking movements is unclear. Thus, to understand how the brain handles information, we investigated how a required movement along the depth axis would affect behavioral tracking performance, postulating that it would be affected by the amount of depth movement. We designed a visually guided planar tracking task that requires movement on three planes with different depths: a fronto-parallel plane called ROT (0), a sagittal plane called ROT (90), and a plane rotated by 45° with respect to the sagittal plane called ROT (45). Fifteen participants performed a circular manual tracking task under binocular and monocular visions in a three-dimensional (3D) virtual reality space. As a result, under binocular vision, ROT (90), which required the largest depth movement among the tasks, showed the greatest error in 3D. Similarly, the errors (deviation from the target path) on the depth axis revealed significant differences among the tasks. Under monocular vision, significant differences in errors were observed only on the lateral axis. Moreover, we observed that the errors in the lateral and depth axes were proportional to the required movement on these axes under binocular vision and confirmed that the required depth movement under binocular vision determined depth error independent of the other axes. This finding implies that the brain may independently process binocular vision information on each axis. Meanwhile, the required depth movement under monocular vision was independent of performance along the depth axis, indicating an intractable behavior. Our findings highlight the importance of handling depth movement, especially when a virtual reality situation, involving tracking tasks, is generated.

Despite Impaired Binocular Function, Binocular Disparity Integration Across the Visual Field Is Spared in Normal Aging and Glaucoma

Purpose

To examine how binocularly asymmetric glaucomatous visual field damage affects binocular disparity processing across the visual field.

Methods

We recruited 18 patients with primary open-angle glaucoma, 16 age-matched controls, and 13 young controls. Participants underwent standard clinical assessments of binocular visual acuity, binocular contrast sensitivity, stereoacuity, and perimetry. We employed a previously validated psychophysical procedure to measure how sensitivity to binocular disparity varied across spatial frequencies and visual field sectors (i.e., with full-field stimuli spanning the central 21° of the visual field and with stimuli restricted to annular regions spanning 0°-3°, 3°-9°, or 9°-21°). We employed measurements with annular stimuli to model different possible scenarios regarding how disparity information is combined across visual field sectors. We adjudicated between potential mechanisms by comparing model predictions to the patterns observed with full-field stimuli.

Results

Perimetry confirmed that patients with glaucoma exhibited binocularly asymmetric visual field damage (P < 0.001). Across participant groups, foveal regions preferentially processed disparities at finer spatial scales, whereas periphery regions were tuned for coarser scales (P < 0.001). Disparity sensitivity also decreased from fovea to periphery (P < 0.001) and across participant groups (Ps < 0.01). Finally, similar to controls, patients with glaucoma exhibited near-optimal disparity integration, specifically at low spatial frequencies (P < 0.001).

Conclusions

Contrary to the conventional view that glaucoma spares central vision, we find that glaucomatous damage causes a widespread loss of disparity sensitivity across both foveal and peripheral regions. Despite these losses, cortical integration mechanisms appear to be well preserved, suggesting that patients with glaucoma make the best possible use of their remaining binocular function.

Opportunities and Limitations of a Gaze-Contingent Display to Simulate Visual Field Loss in Driving Simulator Studies

Background

Research on task performance under visual field loss is often limited due to small and heterogenous samples. Simulations of visual impairments hold the potential to account for many of those challenges. Digitally altered pictures, glasses, and contact lenses with partial occlusions have been used in the past. One of the most promising methods is the use of a gaze-contingent display that occludes parts of the visual field according to the current gaze position. In this study, the gaze-contingent paradigm was implemented in a static driving simulator to simulate visual field loss and to evaluate parallels in the resulting driving and gaze behavior in comparison to patients.

Methods

The sample comprised 15 participants without visual impairment. All the subjects performed three drives: with full vision, simulated left-sided homonymous hemianopia, and simulated right-sided homonymous hemianopia, respectively. During each drive, the participants drove through an urban environment where they had to maneuver through intersections by crossing straight ahead, turning left, and turning right.

Results

The subjects reported reduced safety and increased workload levels during simulated visual field loss, which was reflected in reduced lane position stability and greater absence of large gaze movements. Initial compensatory strategies could be found concerning a dislocated gaze position and a distorted fixation ratio toward the blind side, which was more pronounced for right-sided visual field loss. During left-sided visual field loss, the participants showed a smaller horizontal range of gaze positions, longer fixation durations, and smaller saccadic amplitudes compared to right-sided homonymous hemianopia and, more distinctively, compared to normal vision.

Conclusion

The results largely mirror reports from driving and visual search tasks under simulated and pathological homonymous hemianopia concerning driving and scanning challenges, initially adopted compensatory strategies, and driving safety. This supports the notion that gaze-contingent displays can be a useful addendum to driving simulator research with visual impairments if the results are interpreted considering methodological limitations and inherent differences to the pathological impairment.

Visual uncertainty unveils the distinct role of haptic cues in multisensory grasping

Human multisensory grasping movements (i.e., seeing and feeling a handheld object while grasping it with the contralateral hand) are superior to movements guided by each separate modality. This multisensory advantage might be driven by the integration of vision with either the haptic position only or with both position and size cues. To contrast these two hypotheses, we manipulated visual uncertainty (central vs. peripheral vision) and the availability of haptic cues during multisensory grasping. We showed a multisensory benefit irrespective of the degree of visual uncertainty suggesting that the integration process involved in multisensory grasping can be flexibly modulated by the contribution of each modality. Increasing visual uncertainty revealed the role of the distinct haptic cues. The haptic position cue was sufficient to promote multisensory benefits evidenced by faster actions with smaller grip apertures, whereas the haptic size was fundamental in fine-tuning the grip aperture scaling. These results support the hypothesis that, in multisensory grasping, vision is integrated with all haptic cues, with the haptic position cue playing the key part. Our findings highlight the important role of non-visual sensory inputs in sensorimotor control and hint at the potential contributions of the haptic modality in developing and maintaining visuomotor functions.Significance statementThe longstanding view that vision is considered the primary sense we rely on to guide grasping movements relegates the equally important haptic inputs, such as touch and proprioception, to a secondary role. Here we show that by increasing visual uncertainty during visuo-haptic grasping, the central nervous system exploits distinct haptic inputs about the object position and size to optimize grasping performance. Specifically, we demonstrate that haptic inputs about the object position are fundamental to support vision in enhancing grasping performance, whereas haptic size inputs can further refine hand shaping. Our results provide strong evidence that non-visual inputs serve an important, previously under-appreciated, functional role in grasping.

Electroencephalography Study of Frontal Lobe Evoked by Dynamic Random-Dot Stereogram

Purpose

The purpose of this study was to investigate the cortical electrical activity and electroencephalography (EEG) features of the frontal lobe evoked by dynamic random dot stereogram (DRDS) and to probe the functional connectivity (FC) between the frontal lobe and occipital lobe when processing 3D perception based on the binocular disparity.

Methods

The EEG experiment involved 14 healthy adults with normal stereopsis (<60″) and normal corrected visual acuity (20/20). The Neuroscan system and 32-channel EEG cap were used to record EEG signals based on the DRDS stimuli. The maximum energies of 3 frequency bands (theta-/alpha- /beta-wave) from 13 interesting channels (FP1, FP2, F7, F3, FZ, F4, F8, FC3, FCZ, FC4, O1, OZ, and O2) located in the frontal and occipital lobes were calculated and analyzed. The FC between any two electrodes from the frontal and occipital lobes was calculated based on the Phase lag index (PLI).

Results

The maximum powers of theta- and alpha-waves in most channels of the frontal and occipital lobes were significantly increased (P < 0.05) when the depth perception was evoked by DRDS above the threshold, compared with that without stereo vision. The changes in the maximum powers of both theta- and alpha-waves were significantly different among the 13 electrodes (P = 0.0004 and 0.0015, respectively). Tukey's multiple comparisons showed that the changes in the maximum powers of theta-wave were significantly different in F8 vs. O1, F8 vs. OZ, and F4 vs. O1 (P = 0.0186, 0.0444, and 0.0412, respectively). Moreover, the changes in the maximum powers of alpha-waves were significantly different in FP1 vs. O1 (P = 0.0182). The FCs of theta-waves between the frontal channels and the occipital channels were significantly enhanced when processing the depth perception, compared with those without stereopsis. There was no significant change in the FCs of the alpha-waves when having 3D perception except for FC between F8 and O1 and FC between F8 and OZ.

Conclusions

The cortical electrical activity in the frontal lobe and the functional connectivity between the frontal lobe and the occipital lobe increase when participating in the processing binocular disparity and obtaining 3D perception. Theta-waves in the frontal lobe may be crucial in the stereo vision.

Exploring the effects of degraded vision on sensorimotor performance

PURPOSE

Many people experience unilateral degraded vision, usually owing to a developmental or age-related disorder. There are unresolved questions regarding the extent to which such unilateral visual deficits impact on sensorimotor performance; an important issue as sensorimotor limitations can constrain quality of life by restricting 'activities of daily living'. Examination of the relationship between visual deficit and sensorimotor performance is essential for determining the functional implications of ophthalmic conditions. This study attempts to explore the effect of unilaterally degraded vision on sensorimotor performance.

METHODS

In Experiment 1 we simulated visual deficits in 30 participants using unilateral and bilateral Bangerter filters to explore whether motor performance was affected in water pouring, peg placing, and aiming tasks. Experiment 2 (n = 74) tested the hypothesis that kinematic measures are associated with visuomotor deficits by measuring the impact of small visual sensitivity decrements created by monocular viewing on sensorimotor interactions with targets presented on a planar surface in aiming, tracking and steering tasks.

RESULTS

In Experiment 1, the filters caused decreased task performance-confirming that unilateral (and bilateral) visual loss has functional implications. In Experiment 2, kinematic measures were affected by monocular viewing in two of three tasks requiring rapid online visual feedback (aiming and steering).

CONCLUSIONS

Unilateral visual loss has a measurable impact on sensorimotor performance. The benefits of binocular vision may be particularly important for some groups (e.g. older adults) where an inability to complete sensorimotor tasks may necessitate assisted living. There is an urgent need to develop rigorous kinematic approaches to the quantification of the functional impact of unilaterally degraded vision and of the benefits associated with treatments for unilateral ophthalmic conditions to enable informed decisions around treatment.

Binocular vision and the control of foot placement during walking in natural terrain

Coordination between visual and motor processes is critical for the selection of stable footholds when walking in uneven terrains. While recent work (Matthis et al. in Curr Biol 8(28):1224–1233, 2018) demonstrates a tight link between gaze (visual) and gait (motor), it remains unclear which aspects of visual information play a role in this visuomotor control loop, and how the loss of this information affects that relationship. Here we examine the role of binocular information in the visuomotor control of walking over complex terrain. We recorded eye and body movements while normally-sighted participants walked over terrains of varying difficulty, with intact vision or with vision in one eye blurred to disrupt binocular vision. Gaze strategy was highly sensitive to the complexity of the terrain, with more fixations dedicated to foothold selection as the terrain became more difficult. The primary effect of increased sensory uncertainty due to disrupted binocular vision was a small bias in gaze towards closer footholds, indicating greater pressure on the visuomotor control process. Participants with binocular vision losses due to developmental disorders (i.e., amblyopia, strabismus), who have had the opportunity to develop alternative strategies, also biased their gaze towards closer footholds. Across all participants, we observed a relationship between an individual’s typical level of binocular visual function and the degree to which gaze is shifted toward the body. Thus the gaze–gait relationship is sensitive to the level of sensory uncertainty, and deficits in binocular visual function (whether transient or long-standing) have systematic effects on gaze strategy in complex terrains. We conclude that binocular vision provides useful information for locating footholds during locomotion. Furthermore, we have demonstrated that combined eye/body tracking in natural environments can be used to provide a more detailed understanding of the impact of a type of vision loss on the visuomotor control process of walking, a vital everyday task.

Associations Between Binocular Depth Perception and Performance Gains in Laparoscopic Skill Acquisition

The ability to perceive differences in depth is important in many daily life situations. It is also of relevance in laparoscopic surgical procedures that require the extrapolation of three-dimensional visual information from two-dimensional planar images. Besides visual-motor coordination, laparoscopic skills and binocular depth perception are demanding visual tasks for which learning is important. This study explored potential relations between binocular depth perception and individual variations in performance gains during laparoscopic skill acquisition in medical students naïve of such procedures. Individual differences in perceptual learning of binocular depth discrimination when performing a random dot stereogram (RDS) task were measured as variations in the slope changes of the logistic disparity psychometric curves from the first to the last blocks of the experiment. The results showed that not only did the individuals differ in their depth discrimination; the extent with which this performance changed across blocks also differed substantially between individuals. Of note, individual differences in perceptual learning of depth discrimination are associated with performance gains from laparoscopic skill training, both with respect to movement speed and an efficiency score that considered both speed and precision. These results indicate that learning-related benefits for enhancing demanding visual processes are, in part, shared between these two tasks. Future studies that include a broader selection of task-varying monocular and binocular cues as well as visual-motor coordination are needed to further investigate potential mechanistic relations between depth perceptual learning and laparoscopic skill acquisition. A deeper understanding of these mechanisms would be important for applied research that aims at designing behavioral interventions for enhancing technology-assisted laparoscopic skills.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

A dichoptic feedback-based oculomotor training method to manipulate interocular alignment

Strabismus is a prevalent impairment of binocular alignment that is associated with a spectrum of perceptual deficits and social disadvantages. Current treatments for strabismus involve ocular alignment through surgical or optical methods and may include vision therapy exercises. In the present study, we explore the potential of real-time dichoptic visual feedback that may be used to quantify and manipulate interocular alignment. A gaze-contingent ring was presented independently to each eye of 11 normally-sighted observers as they fixated a target dot presented only to their dominant eye. Their task was to center the rings within 2° of the target for at least 1 s, with feedback provided by the sizes of the rings. By offsetting the ring in the non-dominant eye temporally or nasally, this task required convergence or divergence, respectively, of the non-dominant eye. Eight of 11 observers attained 5° asymmetric convergence and 3 of 11 attained 3° asymmetric divergence. The results suggest that real-time gaze-contingent feedback may be used to quantify and transiently simulate strabismus and holds promise as a method to augment existing therapies for oculomotor alignment disorders.

Characterization, passive and active treatment in strabismic amblyopia: a narrative review

Strabismic amblyopia is characterized by a distorted spatial perception. In this condition, the neurofunctional disorder occurring during first years of life provoke several monocular and binocular anomalies such as crowding, deficits in the accommodative response, contrast sensitivity, and ocular motility abilities. The inhibition of the binocular function of the brain by the misaligned amblyopic eye induces a binocular imbalance leading to interocular suppression and the reduction or lack of stereoacuity. Passive treatments such as occlusion, optical and/or pharmacological penalization, and Bangerter foils has been demonstrated to be potentially useful treatments for strabismic amblyopia. Recent researches have proved new pharmacological options to improve and maintain visual acuity after occlusion treatment in strabismic amblyopia. Likewise, the active vision therapy, in the last years, is becoming a very relevant therapeutic option in combination with passive treatments, especially during and after monocular therapy, in the attempt of recovering the imbalanced binocular vision.

Point-wise correlations between 10-2 Humphrey visual field and OCT data in open angle glaucoma

PURPOSE

Optical Coherence Tomography (OCT) is a powerful instrument for helping clinicians detect and monitor glaucoma. The aim of this study was to provide a detailed mapping of the relationships between visual field (VF) sensitivities and measures of retinal structure provided by a commercial Spectral Domain (SD)-OCT system (RTvue-100 Optovue).

METHODS

Sixty-three eyes of open angle glaucoma patients (17 males, 16 females, and mean age 71 ± 7.5 years) were included in this retrospective, observational clinical study. Thickness values for superior and inferior retina, as well as average values, were recorded for the full retina, the outer retina, the ganglion cell complex, and the peripapillary retinal nerve fiber layer (RNFL). RNFL thickness was further evaluated along eight separate sectors (temporal lower, temporal upper, superior temporal, superior nasal, nasal upper, nasal lower, inferior nasal, and inferior temporal). Point-wise correlations were then computed between each of these OCT measures and the visual sensitivities at all VF locations assessed via Humphrey 10-2 and 24-2 perimetry. Lastly, OCT data were fit to VF data to predict glaucoma stage.

RESULTS

The relationship between retinal thickness and visual sensitivities reflects the known topography of the retina. Spatial correlation patterns between visual sensitivities and RNFL thickness along different sectors broadly agree with previously hypothesized structure-function maps, yet suggest that structure-function maps still require more precise characterizations. Given these relationships, we find that OCT data can predict glaucoma stage.

CONCLUSION

Ganglion cell complex and RNFL thickness measurements are highlighted as the most promising candidate metrics for glaucoma detection and monitoring.

Eye movements as a readout of sensorimotor decision processes

Real-world tasks, such as avoiding obstacles, require a sequence of interdependent choices to reach accurate motor actions. Yet, most studies on primate decision making involve simple one-step choices. Here we analyze motor actions to investigate how sensorimotor decisions develop over time. In a go/no-go interception task human observers (n = 42) judged whether a briefly presented moving target would pass (interceptive hand movement required) or miss (no hand movement required) a strike box while their eye and hand movements were recorded. Go/no-go decision formation had to occur within the first few hundred milliseconds to allow time-critical interception. We found that the earliest time point at which eye movements started to differentiate actions (go versus no-go) preceded hand movement onset. Moreover, eye movements were related to different stages of decision making. Whereas higher eye velocity during smooth pursuit initiation was related to more accurate interception decisions (whether or not to act), faster pursuit maintenance was associated with more accurate timing decisions (when to act). These results indicate that pursuit initiation and maintenance are continuously linked to ongoing sensorimotor decision formation.NEW & NOTEWORTHY Here we show that eye movements are a continuous indicator of decision processes underlying go/no-go actions. We link different stages of decision formation to distinct oculomotor events during open- and closed-loop smooth pursuit. Critically, the earliest time point at which eye movements differentiate actions preceded hand movement onset, suggesting shared sensorimotor processing for eye and hand movements. These results emphasize the potential of studying eye movements as a readout of cognitive processes.

People With Central Vision Loss Have Difficulty Watching Videos

Purpose

People with central vision loss (CVL) often report difficulties watching video. We objectively evaluated the ability to follow the story (using the information acquisition method).

Methods

Subjects with CVL (n = 23) or normal vision (NV, n = 60) described the content of 30-second video clips from movies and documentaries. We derived an objective information acquisition (IA) score for each response using natural-language processing. To test whether the impact of CVL was simply due to reduced resolution, another group of NV subjects (n = 15) described video clips with defocus blur that reduced visual acuity to 20/50 to 20/800. Mixed models included random effects correcting for differences between subjects and between the clips, with age, gender, cognitive status, and education as covariates.

Results

Compared to both NV groups, IA scores were worse for the CVL group (P < 0.001). IA reduced with worsening visual acuity (P < 0.001), and the reduction with worsening visual acuity was greater for the CVL group than the NV-defocus group (P = 0.01), which was seen as a greater discrepancy at worse levels of visual acuity.

Conclusions

The IA method was able to detect difficulties in following the story experienced by people with CVL. Defocus blur failed to recreate the CVL experience. IA is likely to be useful for evaluations of the effects of vision rehabilitation.