Multiplexing Prisms for Field Expansion

The effects of an electronic head-mounted display in vision rehabilitation for patients with tunnel vision

PURPOSE

To investigate the effect of a new head-mounted electronic visual aid-Acesight on improving visual function and daily activities in patients with tunnel vision.

METHODS

57 patients with tunnel vision participated in this study. The visual field (VF), visual acuity (VA), search ability, time of finding people from the side (TFPS), walking ability, and the subjective feelings of patients with and without Acesight were measured.

RESULTS

15 (36%) patients thought Acesight was "helpful", 16 (28%) thought it was "a little help", and 26 (46%) believed that it was "not helpful." The proportion of people aged < 60 years found Acesight helpful was higher. When wearing Acesight, the average horizontal VF diameter (°) (35.54[8.72]) and vertical VF diameter (°) (26.63[5.38]) were larger than those without visual aids (20.61[9.22], 18.19[6.67]) (P all < 0.001). The average TFPS before and while wearing the Acesight was 1.77s(0.32) and 1.19s(0.29), respectively (t = 14.28, P < 0.001). The average search times, number of collisions, walking speeds when wearing the Acesight were not statistically different from those without visual aids (P all > 0.05).

CONCLUSION

More than half of patients with tunnel vision found the Acesight helpful, and a higher proportion of those aged < 60 years old found it helpful. Acesight can expand the horizontal and vertical VF of patients with tunnel vision and can enable patients to detect objects coming from the side earlier.

TRIAL REGISTRATION

ChiCTR2000028859; Date of registration: 2020/1/5; URL: http://www.chictr.org.cn/showproj.aspx?proj=47129.

The effect of visual rivalry in peripheral head-mounted displays on mobility

Recent head-mounted displays and smart glasses use vision multiplexing, an optical approach where two or more views are superimposed on each other. In vision multiplexing, augmented information is presented over an observer's natural field of view, providing field expansion and critical information during mobility situations like walking and driving. Yet despite its utility, vision multiplexing may produce visual rivalry, a phenomenon where perception alternates between the augmented information and the background scene for seconds at a time. To investigate, we compared the effect of different peripheral vision multiplexing configurations (unilateral opaque, unilateral see-through and bilateral see-through) on the detection of augmented information, incorporating at the same time real-world characteristics (target eccentricity, depth condition, and gaze movement) for a more realistic assessment. Results showed a persistently lower target detection rate in unilateral configurations than the bilateral configuration, suggesting a larger effect of binocular rivalry on target visibility. Nevertheless, this effect does become attenuated when more naturalistic elements are incorporated, and we discuss recommendations for vision multiplexing design and possible avenues for further research.

Binocular see-through configuration and eye movement attenuate visual rivalry in peripheral wearable displays

Visual confusion occurs when two dissimilar images are superimposed onto the same retinal location. In the context of wearable displays, it can be used to provide multiple sources of information to users on top of the real-world scene. While useful, visual confusion may cause visual rivalry that can suppress one of the sources. If two different images are projected to each eye (i.e., monocular displays), it provokes binocular rivalry wherein visual perception intermittently switches between the two images. When a semi-transparent image is superimposed (i.e., see-through displays), monocular rivalry results, causing perceptual alternations between the foreground and the background images. Here, we investigated how these rivalries influence the visibility of the peripheral target using three configurations of wearable displays (i.e., monocular opaque, monocular see-through, and binocular see-through) with three eye movement conditions (i.e., saccades, smooth pursuit, and central fixation). Using the HTC VIVE Eye Pro headset, subjects viewed a forward vection of a 3D corridor with a horizontally moving vertical grating at 10° above the center fixation. During each trial (~1 min), subjects followed a fixation cross that varied in location to induce eye movements and simultaneously reported whether the peripheral target was visible. Results showed that the binocular display had significantly higher target visibility than both monocular displays, and the monocular see-through display had the lowest target visibility. Target visibility was also higher when eye movements were executed, suggesting that the effects of rivalry are attenuated by eye movements and binocular see-through displays.

Confusing Image Quality Assessment: Toward Better Augmented Reality Experience

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environments, however, studies on how this fusion will influence the Quality of Experience (QoE) of these two components are lacking. To achieve better QoE of AR, whose two layers are influenced by each other, it is important to evaluate its perceptual quality first. In this paper, we consider AR technology as the superimposition of virtual scenes and real scenes, and introduce visual confusion as its basic theory. A more general problem is first proposed, which is evaluating the perceptual quality of superimposed images, i.e., confusing image quality assessment. A ConFusing Image Quality Assessment (CFIQA) database is established, which includes 600 reference images and 300 distorted images generated by mixing reference images in pairs. Then a subjective quality perception experiment is conducted towards attaining a better understanding of how humans perceive the confusing images. Based on the CFIQA database, several benchmark models and a specifically designed CFIQA model are proposed for solving this problem. Experimental results show that the proposed CFIQA model achieves state-of-the-art performance compared to other benchmark models. Moreover, an extended ARIQA study is further conducted based on the CFIQA study. We establish an ARIQA database to better simulate the real AR application scenarios, which contains 20 AR reference images, 20 background (BG) reference images, and 560 distorted images generated from AR and BG references, as well as the correspondingly collected subjective quality ratings. Three types of full-reference (FR) IQA benchmark variants are designed to study whether we should consider the visual confusion when designing corresponding IQA algorithms. An ARIQA metric is finally proposed for better evaluating the perceptual quality of AR images. Experimental results demonstrate the good generalization ability of the CFIQA model and the state-of-the-art performance of the ARIQA model. The databases, benchmark models, and proposed metrics are available at: https://github.com/DuanHuiyu/ARIQA.

Photographic Depiction of the Field of View with Spectacles-mounted Low Vision Aids

SIGNIFICANCE

Photographic depiction helps to illustrate the primary and secondary field of view effects of low vision devices along with their utility to clinicians, patients, and caretakers. This technique may also be helpful for designers and researchers in improving the design and fitting of low vision devices.

PURPOSE

The field of view through spectacles-mounted low vision devices has typically been evaluated using perimetry. However, the perimetric field diagram is different from the retinal image and often fails to represent the important aspects of the field of view and visual parameters. We developed a photographic depiction method to record and veridically show the field of view effects of these devices.

METHODS

We used a 3D-printed holder to place spectacles-mounted devices at the same distance from the empirically determined reference point of the field of view in a camera lens (f = 16 mm) as they would be from an eye, when in use. The field of view effects of a bioptic telescope, a minifier (reverse telescope), and peripheral prisms were captured using a conventional camera, representing retinal images. The human eye pupil size (adjusting the F number: f/2.8 to f/8 and f/22 in the camera lens) and fitting parameters (pantoscopic tilt and back vertex distance) varied.

RESULTS

Real-world indoor and outdoor walking and driving scenarios were depicted as retinal images illustrating the field of view through low vision devices, distinguishing optical and obscuration scotomas, and demonstrating secondary effects (spatial distortions, viewpoint changes, diplopia, spurious reflection, and multiplexing effects) not illustrated by perimetric field diagrams.

CONCLUSIONS

Photographic depiction illustrates the primary and secondary field of view effects of the low vision devices. These images highlight the benefit and possible trade-offs of the low vision devices and may be beneficial in education and training.

2017 Charles F. Prentice Award Lecture: Peripheral Prisms for Visual Field Expansion: A Translational Journey

On the occasion of being awarded the Prentice Medal, I was asked to summarize my translational journey. Here I describe the process of becoming a low-vision rehabilitation clinician and researcher, frustrated by the unavailability of effective treatments for some conditions. This led to decades of working to understand patients' needs and the complexities and subtleties of their visual systems and conditions. It was followed by many iterations of developing vision aids and the techniques needed to objectively evaluate their benefit. I specifically address one path: the invention and development of peripheral prisms to expand the visual fields of patients with homonymous hemianopia, leading to our latest multiperiscopic prism (mirror-based design) with its clear 45° field-of-view image shift.

Multi-periscopic prism device for field expansion

Patients with visual field loss frequently collide with other pedestrians, with the highest risk being from pedestrians at a bearing angle of 45°. Current prismatic field expansion devices (≈30°) cannot cover pedestrians posing the highest risk and are limited by poor image quality and restricted eye scanning range (<5°). A new field expansion device: multi-periscopic prism (MPP); comprising a cascade of half-penta prisms provides wider shifting power (45°) with dramatically better image quality and wider eye scanning range (15°) is presented. Spectacles-mounted MPPs were implemented using 3D printing. The efficacy of the MPP is demonstrated using perimetry, photographic depiction, and analyses of the collision risk covered by the devices.

Field Expansion with Multiplexing Prism Glasses Improves Pedestrian Detection for Acquired Monocular Vision

Purpose

Patients with acquired monocular vision (AMV) lose vision in the temporal crescent on the side of the blind eye. This visual field loss affects patients’ ability to detect potential hazards in the blind field. Mounting a base-in multiplexing prism (MxP) on the nasal side of the seeing eye can provide true field expansion and enable detection of potential collision hazards. We evaluated the efficacy of the MxP glasses in a virtual reality walking environment.

Methods

A three-dimensional printed clip-on MxP holder that can be adjusted for an individual user's facial parameters was developed. Virtual reality walking scenarios were designed to evaluate the effect of MxP field expansion on the detection of a pedestrian approaching from different initial bearing angles and courses. The pedestrian detection rates and response times of 10 participants with simulated AMV (normally sighted participants with one eye patched) and three patients with AMV were measured.

Results

The MxP provided true field expansion of about 25°. Participants performed significantly better with the MxP than without the MxP in the pedestrian detection task on their blind field, while their seeing field performance was not significantly different.

Conclusions

The MxP glasses for patients with AMV improved the detection of potential collision hazards in the blind field.

Translational Relevance

The MxP with an adjustable clip-on holder may help patients with AMV to decrease the risk of collision with other pedestrians.

Low Vision Enhancement with Head-mounted Video Display Systems: Are We There Yet?

SIGNIFICANCE

Head-mounted video display systems and image processing as a means of enhancing low vision are ideas that have been around for more than 20 years. Recent developments in virtual and augmented reality technology and software have opened up new research opportunities that will lead to benefits for low vision patients. Since the Visionics low vision enhancement system (LVES), the first head-mounted video display LVES, was engineered 20 years ago, various other devices have come and gone with a recent resurgence of the technology over the past few years. In this article, we discuss the history of the development of LVESs, describe the current state of available technology by outlining existing systems, and explore future innovation and research in this area. Although LVESs have now been around for more than two decades, there is still much that remains to be explored. With the growing popularity and availability of virtual reality and augmented reality technologies, we can now integrate these methods within low vision rehabilitation to conduct more research on customized contrast-enhancement strategies, image motion compensation, image-remapping strategies, and binocular disparity, all while incorporating eye-tracking capabilities. Future research should use this available technology and knowledge to learn more about the visual system in the low vision patient and extract this new information to create prescribable vision enhancement solutions for the visually impaired individual.

Peripheral Prisms Improve Obstacle Detection during Simulated Walking for Patients with Left Hemispatial Neglect and Hemianopia

SIGNIFICANCE

The first report on the use of peripheral prisms (p-prisms) for patients with left neglect and homonymous visual field defects (HVFDs).

PURPOSE

The purpose of this study was to investigate if patients with left hemispatial neglect and HVFDs benefit from p-prisms to expand the visual field and improve obstacle detection.

METHODS

Patients (24 with HVFDs, 10 of whom had left neglect) viewed an animated, virtual, shopping mall corridor and reported if they would have collided with a human obstacle that appeared at various offsets up to 13.5° from their simulated walking path. There were 40 obstacle presentations on each side, with and without p-prisms. No training with p-prisms was provided, and gaze was fixed at the center of expansion.

RESULTS

Detection on the side of the HVFD improved significantly with p-prisms in both groups, from 26 to 92% in the left-neglect group and 43 to 98% in the non-neglect group (both P < .001). There was a tendency for greater improvement in the neglect patients with p-prisms. For collision judgments, both groups exhibited a large increase in perceived collisions on the side of the HVFD with the prisms (P < .001), with no difference between the groups (P = .93). Increased perceived collisions represent a wider perceived safety margin on the side of the HVFD.

CONCLUSIONS

Within the controlled conditions of this simulated, collision judgment task, patients with left neglect responded well to initial application of p-prisms exhibiting improved detection and wider safety margins on the side of the HVFD that did not differ from non-neglect patients. Further study of p-prisms for neglect patients in free-gaze conditions after extended wear and in real-world mobility tasks is clearly warranted.

Psychophysical Tests Do Not Identify Ocular Dominance Consistently

Classical sighting or sensory tests are used in clinical practice to identify the dominant eye. Several psychophysical tests were recently proposed to quantify the magnitude of dominance but whether their results agree was never investigated. We addressed this question for the two most common psychophysical tests: The perceived-phase test, which measures the cyclopean appearance of dichoptically presented sinusoids of different phase, and the coherence-threshold test, which measures interocular differences in motion perception when signal and noise stimuli are presented dichoptically. We also checked for agreement with three classical tests (Worth 4-dot, Randot suppression, and Bagolini lenses). Psychophysical tests were administered in their conventional form and also using more dependable psychophysical methods. The results showed weak correlations between psychophysical measures of strength of dominance with inconsistent identification of the dominant eye across tests: Agreement on left-eye dominance, right-eye dominance, or nondominance by both tests occurred only for 11 of 40 observers (27.5%); the remaining 29 observers were classified differently by each test, including 14 cases (35%) of opposite classification (left-eye dominance by one test and right-eye dominance by the other). Classical tests also yielded conflicting results that did not agree well with classification based on psychophysical tests. The results are discussed in the context of determination of ocular dominance for clinical decisions.

Measuring Pedestrian Collision Detection With Peripheral Field Loss and the Impact of Peripheral Prisms

Purpose

Peripheral field loss (PFL) due to retinitis pigmentosa, choroideremia, or glaucoma often results in a highly constricted residual central field, which makes it difficult for patients to avoid collision with approaching pedestrians. We developed a virtual environment to evaluate the ability of patients to detect pedestrians and judge potential collisions. We validated the system with both PFL patients and normally sighted subjects with simulated PFL. We also tested whether properly placed high-power prisms may improve pedestrian detection.

Methods

A virtual park-like open space was rendered using a driving simulator (configured for walking speeds), and pedestrians in testing scenarios appeared within and outside the residual central field. Nine normally sighted subjects and eight PFL patients performed the pedestrian detection and collision judgment tasks. The performance of the subjects with simulated PFL was further evaluated with field of view expanding prisms.

Results

The virtual system for testing pedestrian detection and collision judgment was validated. The performance of PFL patients and normally sighted subjects with simulated PFL were similar. The prisms for simulated PFL improved detection rates, reduced detection response times, and supported reasonable collision judgments in the prism-expanded field; detections and collision judgments in the residual central field were not influenced negatively by the prisms.

Conclusions

The scenarios in a virtual environment are suitable for evaluating PFL and the impact of field of view expanding devices.

Translational Relevance

This study validated an objective means to evaluate field expansion devices in reproducible near-real-life settings.

No Useful Field Expansion with Full-field Prisms

SIGNIFICANCE

Full-field prisms that fill the entire spectacle eye wire have been considered as field expansion devices for homonymous hemianopia (HH) and acquired monocular vision (AMV). Although the full-field prism is used for addressing binocular dysfunction and for prism adaptation training after brain injury as treatment for spatial hemineglect, we show that the full-field prism for field expansion does not effectively expand the visual field in either HH or AMV.

PURPOSE

Full-field prisms may shift a portion of the blind side to the residual seeing side. However, foveal fixation on an object of interest through a full-field prism requires head and/or eye rotation away from the blind side, thus negating the shift of the field toward the blind side.

METHODS

We fit meniscus and flat full-field 7Δ and 12Δ yoked prisms and conducted Goldmann perimetry in HH and AMV. We compared the perimetry results with ray tracing calculations.

RESULTS

The rated prism power was in effect at the primary position of gaze for all prisms, and the meniscus prisms maintained almost constant power at all eccentricities. To fixate on the perimetry target, the subjects needed to turn their head and/or eyes away from the blind side, which negated the field shift into the blind side. In HH, there was no difference in the perimetry results on the blind side with any of the prisms. In AMV, the lower nasal field of view was slightly shifted into the blind side with the flat prisms, but not with the meniscus prisms.

CONCLUSIONS

Full-field prisms are not an effective field expansion device owing to the inevitable fixation shift. There is potential for a small field shift with the flat full-field prism in AMV, but such lenses cannot incorporate refractive correction. Furthermore, in considering the apical scotoma, the shift provides a mere field substitution at best.

Field Expansion for Acquired Monocular Vision Using a Multiplexing Prism

SIGNIFICANCE

Acquired monocular vision (AMV) is a common visual field loss. Patients report mobility difficulties in walking due to collisions with objects or other pedestrians on the blind side.

PURPOSE

The visual field of people with AMV extends more than 90° temporally on the side of the seeing eye but is restricted to approximately 55° nasally. We developed a novel field expansion device using a multiplexing prism (MxP) that superimposes the see-through and shifted views for true field expansion without apical scotoma. We present various designs of the device that enable customized fitting and improved cosmetics.

METHODS

A partial MxP segment is attached (base-in) near the nose bridge. To avoid total internal reflection due to the high angle of incidence at nasal field end (55°), we fit the MxP with serrations facing the eye and tilt the prism base toward the nose. We calculated the width of the MxP (the apex location) needed to prevent apical scotoma and monocular diplopia. We also consider the effect of spectacle prescriptions on these settings. The results are verified perimetrically.

RESULTS

We documented the effectivity of various prototype glasses designs with perimetric measurements. With the prototypes, all patients with AMV had field-of-view expansions up to 90° nasally without any loss of seeing field.

CONCLUSIONS

The novel and properly mounted MxP in glasses has the potential for meaningful field-of-view expansion up to the size of normal binocular vision in cosmetically acceptable form.