Prosthetic Visual Performance Using a Disparity-Based Distance-Filtering System

Pre-processing visual scenes for retinal prosthesis systems: A comprehensive review

BACKGROUND

Retinal prostheses offer hope for individuals with degenerative retinal diseases by stimulating the remaining retinal cells to partially restore their vision. This review delves into the current advancements in retinal prosthesis technology, with a special emphasis on the pivotal role that image processing and machine learning techniques play in this evolution.

METHODS

We provide a comprehensive analysis of the existing implantable devices and optogenetic strategies, delineating their advantages, limitations, and challenges in addressing complex visual tasks. The review extends to various image processing algorithms and deep learning architectures that have been implemented to enhance the functionality of retinal prosthetic devices. We also illustrate the testing results by demonstrating the clinical trials or using Simulated Prosthetic Vision (SPV) through phosphene simulations, which is a critical aspect of simulating visual perception for retinal prosthesis users.

RESULTS

Our review highlights the significant progress in retinal prosthesis technology, particularly its capacity to augment visual perception among the visually impaired. It discusses the integration between image processing and deep learning, illustrating their impact on individual interactions and navigations within the environment through applying clinical trials and also illustrating the limitations of some techniques to be used with current devices, as some approaches only use simulation even on sighted-normal individuals or rely on qualitative analysis, where some consider realistic perception models and others do not.

CONCLUSION

This interdisciplinary field holds promise for the future of retinal prostheses, with the potential to significantly enhance the quality of life for individuals with retinal prostheses. Future research directions should pivot towards optimizing phosphene simulations for SPV approaches, considering the distorted and confusing nature of phosphene perception, thereby enriching the visual perception provided by these prosthetic devices. This endeavor will not only improve navigational independence but also facilitate a more immersive interaction with the environment.

Benefits of thermal and distance-filtered imaging for wayfinding with prosthetic vision

Visual prostheses such as the Argus II provide partial vision for individuals with limited or no light perception. However, their effectiveness in daily life situations is limited by scene complexity and variability. We investigated whether additional image processing techniques could improve mobility performance in everyday indoor environments. A mobile system connected to the Argus II provided thermal or distance-filtered video stimulation. Four participants used the thermal camera to locate a person and the distance filter to navigate a hallway with obstacles. The thermal camera allowed for finding a target person in 99% of trials, while unfiltered video led to confusion with other objects and a success rate of only 55% ([Formula: see text]). Similarly, the distance filter enabled participants to detect and avoid 88% of obstacles by removing background clutter, whereas unfiltered video resulted in a detection rate of only 10% ([Formula: see text]). For any given elapsed time, the success rate with filtered video was higher than with unfiltered video. After 90 s, participants' success rate reached above 50% with filtered video and 24% and 3% with normal camera in the first and second tasks, respectively. Despite individual variations, all participants showed significant improvement when using the thermal and distance filters compared to unfiltered video. Adding a thermal and distance filter to a visual prosthesis system can enhance the performance of mobility activities by removing clutter in the background, showing people and warm objects with the thermal camera, or nearby obstacles with the distance filter.

Ectopic expression of a mechanosensitive channel confers spatiotemporal resolution to ultrasound stimulations of neurons for visual restoration

Remote and precisely controlled activation of the brain is a fundamental challenge in the development of brain-machine interfaces for neurological treatments. Low-frequency ultrasound stimulation can be used to modulate neuronal activity deep in the brain, especially after expressing ultrasound-sensitive proteins. But so far, no study has described an ultrasound-mediated activation strategy whose spatiotemporal resolution and acoustic intensity are compatible with the mandatory needs of brain-machine interfaces, particularly for visual restoration. Here we combined the expression of large-conductance mechanosensitive ion channels with uncustomary high-frequency ultrasonic stimulation to activate retinal or cortical neurons over millisecond durations at a spatiotemporal resolution and acoustic energy deposit compatible with vision restoration. The in vivo sonogenetic activation of the visual cortex generated a behaviour associated with light perception. Our findings demonstrate that sonogenetics can deliver millisecond pattern presentations via an approach less invasive than current brain-machine interfaces for visual restoration.

A systematic review of extended reality (XR) for understanding and augmenting vision loss

Over the past decade, extended reality (XR) has emerged as an assistive technology not only to augment residual vision of people losing their sight but also to study the rudimentary vision restored to blind people by a visual neuroprosthesis. A defining quality of these XR technologies is their ability to update the stimulus based on the user's eye, head, or body movements. To make the best use of these emerging technologies, it is valuable and timely to understand the state of this research and identify any shortcomings that are present. Here we present a systematic literature review of 227 publications from 106 different venues assessing the potential of XR technology to further visual accessibility. In contrast to other reviews, we sample studies from multiple scientific disciplines, focus on technology that augments a person's residual vision, and require studies to feature a quantitative evaluation with appropriate end users. We summarize prominent findings from different XR research areas, show how the landscape has changed over the past decade, and identify scientific gaps in the literature. Specifically, we highlight the need for real-world validation, the broadening of end-user participation, and a more nuanced understanding of the usability of different XR-based accessibility aids.

Stereoscopic Distance Filtering Plus Thermal Imaging Glasses Design

The authors present the development of eyewear that incorporates stereoscopic and thermal imaging cameras for the purpose of highlighting objects/views of interest. Image processing algorithms that simplify complex elements in a scene have the ability to improve the utility of blind and low vision aids. Thermal imaging can be used to highlight important objects such as people or animals, while stereoscopic imaging can be used to filter background imagery beyond a certain distance. The methods used have been successful in providing utility to retinal prosthesis users. The stereoscopic camera systems involved strict requirements on the relative orientation of the cameras for calibrated distance filtering. A mechanical design is presented that fixes the relative camera locations on a 3D printed titanium structure that can float in the frame to maintain orientations even when the eyewear is flexed during wearing. Clinical Relevance - The design presented has utility in improving perceived spatial resolution in implantable retinal prostheses, implantable visual cortical prostheses, direct-vision prostheses, and wearable low vision aids.

The Effect of Induced Intraocular Stray Light on Recognition Thresholds for Pseudo-High-Pass Filtered Letters

Purpose

The Moorfields Acuity Chart (MAC)—comprising pseudo-high-pass filtered “vanishing optotype” (VO) letters—is more sensitive to functional visual loss in age-related macular degeneration (AMD) compared to conventional letter charts. It is currently unknown the degree to which MAC acuity is affected by optical factors such as cataract. This is important to know when determining whether an individual's vision loss owes more to neural or optical factors. Here we estimate recognition acuity for VOs and conventional letters with simulated lens aging, achieved using different levels of induced intraocular light scatter.

Methods

Recognition thresholds were determined for two experienced and one naive participant with conventional and VO letters. Stimuli were presented either foveally or at 10 degrees in the horizontal temporal retina, under varying degrees of intraocular light scatter induced by white resin opacity-containing filters (WOFs grades 1 to 5).

Results

Foveal acuity only became significantly different from baseline (no filter) for WOF grade 5 with conventional letters and WOF grades 4 and 5 with VOs. In the periphery, no statistical difference was found for any stray-light level for both conventional and VOs.

Conclusions

Recognition acuity measured with conventional and VOs is robust to the effects of simulated lens opacification, and thus its higher sensitivity to neural damage should not simultaneously be confounded by such optical factors.

Translational Relevance

The MAC may be better able to differentiate between neural and optical deficits of visual performance, making it more suitable for the assessment of patients with AMD, who may display both types of functional visual loss.

A Second-Generation (44-Channel) Suprachoroidal Retinal Prosthesis: Interim Clinical Trial Results

Purpose

To report the initial safety and efficacy results of a second-generation (44-channel) suprachoroidal retinal prosthesis at 56 weeks after device activation.

Methods

Four subjects, with advanced retinitis pigmentosa and bare-light perception only, enrolled in a phase II trial (NCT03406416). A 44-channel electrode array was implanted in a suprachoroidal pocket. Device stability, efficacy, and adverse events were investigated at 12-week intervals.

Results

All four subjects were implanted successfully and there were no device-related serious adverse events. Color fundus photography indicated a mild postoperative subretinal hemorrhage in two recipients, which cleared spontaneously within 2 weeks. Optical coherence tomography confirmed device stability and position under the macula. Screen-based localization accuracy was significantly better for all subjects with device on versus device off. Two subjects were significantly better with the device on in a motion discrimination task at 7, 15, and 30°/s and in a spatial discrimination task at 0.033 cycles per degree. All subjects were more accurate with the device on than device off at walking toward a target on a modified door task, localizing and touching tabletop objects, and detecting obstacles in an obstacle avoidance task. A positive effect of the implant on subjects' daily lives was confirmed by an orientation and mobility assessor and subject self-report.

Conclusions

These interim study data demonstrate that the suprachoroidal prosthesis is safe and provides significant improvements in functional vision, activities of daily living, and observer-rated quality of life.

Translational Relevance

A suprachoroidal prosthesis can provide clinically useful artificial vision while maintaining a safe surgical profile.