Glare-free retinal imaging using a portable light field fundus camera

Predicting the cognitive impairment with multimodal ophthalmic imaging and artificial neural network for community screening

BACKGROUND/AIMS

To investigate the comprehensive prediction ability for cognitive impairment in a general elder population using the combination of the multimodal ophthalmic imaging and artificial neural networks.

METHODS

Patients with cognitive impairment and cognitively healthy individuals were recruited. All subjects underwent medical history, blood pressure measurement, the Montreal Cognitive Assessment, medical optometry, intraocular pressure and custom-built multimodal ophthalmic imaging, which integrated pupillary light reaction, multispectral imaging, laser speckle contrast imaging and retinal oximetry. Multidimensional parameters were analysed by Student's t-test. Logistic regression analysis and back-propagation neural network (BPNN) were used to identify the predictive capability for cognitive impairment.

RESULTS

This study included 104 cognitive impairment patients (61.5% female; mean (SD) age, 68.3 (9.4) years), and 94 cognitively healthy age-matched and sex-matched subjects (56.4% female; mean (SD) age, 65.9 (7.6) years). The variation of most parameters including decreased pupil constriction amplitude (CA), relative CA, average constriction velocity, venous diameter, venous blood flow and increased centred retinal reflectance in 548 nm (RC548) in cognitive impairment was consistent with previous studies while the reduced flow acceleration index and oxygen metabolism were reported for the first time. Compared with the logistic regression model, BPNN had better predictive performance (accuracy: 0.91 vs 0.69; sensitivity: 93.3% vs 61.70%; specificity: 90.0% vs 68.66%).

CONCLUSIONS

This study demonstrates retinal spectral signature alteration, neurodegeneration and angiopathy occur concurrently in cognitive impairment. The combination of multimodal ophthalmic imaging and BPNN can be a useful tool for predicting cognitive impairment with high performance for community screening.

Design of illumination system using characterized illuminances for smartphone-based fundus camera

Recently, smartphone-based fundus camera (SBFC) research has been actively conducted in response to the need to expand medical infrastructure in underdeveloped countries and the increased telemedicine since the COVID-19 pandemic. Compared to the conventional table-top system, SBFCs have technical challenges that make it difficult to guarantee uniform illumination and avoid back-reflection because of the design constraints of minimizing the form factor and cost. This paper proposes a novel illumination design methodology using characterized illuminance to obtain high-quality fundus images for SBFCs. Key performance indicators (KPIs), such as retinal uniformity, back-reflection suppression, and optical efficiency, were defined to evaluate the performance of the illumination system. Each KPI was calculated using optical simulation software based on Monte-Carlo ray tracing and mapped into a normalized three-dimensional coordinate, the retinal illumination performance space (RIPS). In RIPS, the KPIs are combined into a single parameter ΔRIPS, which is the quantitative difference evaluated as the Euclidean distance between the ideal and actual design point. A compact SBFC illumination system with five design variables was presented to verify the proposed methodology. The final design values at the minimum ΔRIPS were determined using the Taguchi method and response surface methodology. Finally, a working prototype was built, and fundus images were acquired by clinical testing under institutional review board approval. The fundus image had sufficient brightness and resolution to diagnose the lesion with a viewing angle of approximately 50° in one shot.

Serafini R, Lakhtakia S, Valliani AA, Warburton AJ, Patel A, Zhou D, Sklar B, Chelnis J, Elahi E. Portable hardware & software technologies for addressing ophthalmic health disparities: A systematic review

Vision impairment continues to be a major global problem, as the WHO estimates 2.2 billion people struggling with vision loss or blindness. One billion of these cases, however, can be prevented by expanding diagnostic capabilities. Direct global healthcare costs associated with these conditions totaled $255 billion in 2010, with a rapid upward projection to $294 billion in 2020. Accordingly, WHO proposed 2030 targets to enhance integration and patient-centered vision care by expanding refractive error and cataract worldwide coverage. Due to the limitations in cost and portability of adapted vision screening models, there is a clear need for new, more accessible vision testing tools in vision care. This comparative, systematic review highlights the need for new ophthalmic equipment and approaches while looking at existing and emerging technologies that could expand the capacity for disease identification and access to diagnostic tools. Specifically, the review focuses on portable hardware- and software-centered strategies that can be deployed in remote locations for detection of ophthalmic conditions and refractive error. Advancements in portable hardware, automated software screening tools, and big data-centric analytics, including machine learning, may provide an avenue for improving ophthalmic healthcare.

3D retinal imaging and measurement using light field technology

SIGNIFICANCE

Light-field fundus photography has the potential to be a new milestone in ophthalmology. Up-to-date publications show only unsatisfactory image quality, preventing the use of depth measurements. We show that good image quality and, consequently, reliable depth measurements are possible, and we investigate the current challenges of this novel technology.

AIM

We investigated whether light field (LF) imaging of the retina provides depth information, on which structures the depth is estimated, which illumination wavelength should be used, whether deeper layers are measurable, and what kinds of artifacts occur.

APPROACH

The technical setup, a mydriatic fundus camera with an LF imager, and depth estimation were validated by an eye model and in vivo measurements of three healthy subjects and three subjects with suspected glaucoma. Comparisons between subjects and the corresponding optical coherence tomography (OCT) measurements were used for verification of the depth estimation.

RESULTS

This LF setup allowed for three-dimensional one-shot imaging and depth estimation of the optic disc with green light. In addition, a linear relationship was found between the depth estimates of the OCT and those of the setup developed here. This result is supported by the eye model study. Deeper layers were not measurable.

CONCLUSIONS

If image artifacts can be handled, LF technology has the potential to help diagnose and monitor glaucoma risk at an early stage through a rapid, cost-effective one-shot technology.

PlenoptiCam v1.0: A Light-Field Imaging Framework

Light-field cameras play a vital role for rich 3D information retrieval in narrow range depth sensing applications. The key obstacle in composing light-fields from exposures taken by a plenoptic camera is to computationally calibrate, align and rearrange four-dimensional image data. Several attempts have been proposed to enhance the overall image quality by tailoring pipelines dedicated to particular plenoptic cameras and improving the consistency across viewpoints at the expense of high computational loads. The framework presented herein advances prior outcomes thanks to its novel micro image scale-space analysis for generic camera calibration independent of the lens specifications and its parallax-invariant, cost-effective viewpoint color equalization from optimal transport theory. Artifacts from the sensor and micro lens grid are compensated in an innovative way to enable superior quality in sub-aperture image extraction, computational refocusing and Scheimpflug rendering with sub-sampling capabilities. Benchmark comparisons using established image metrics suggest that our proposed pipeline outperforms state-of-the-art tool chains in the majority of cases. Results from a Wasserstein distance further show that our color transfer outdoes the existing transport methods. Our algorithms are released under an open-source license, offer cross-platform compatibility with few dependencies and different user interfaces. This makes the reproduction of results and experimentation with plenoptic camera technology convenient for peer researchers, developers, photographers, data scientists and others working in this field.

Smartphone-based imaging systems for medical applications: a critical review

SIGNIFICANCE

Smartphones come with an enormous array of functionality and are being more widely utilized with specialized attachments in a range of healthcare applications. A review of key developments and uses, with an assessment of strengths/limitations in various clinical workflows, was completed.

AIM

Our review studies how smartphone-based imaging (SBI) systems are designed and tested for specialized applications in medicine and healthcare. An evaluation of current research studies is used to provide guidelines for improving the impact of these research advances.

APPROACH

First, the established and emerging smartphone capabilities that can be leveraged for biomedical imaging are detailed. Then, methods and materials for fabrication of optical, mechanical, and electrical interface components are summarized. Recent systems were categorized into four groups based on their intended application and clinical workflow: ex vivo diagnostic, in vivo diagnostic, monitoring, and treatment guidance. Lastly, strengths and limitations of current SBI systems within these various applications are discussed.

RESULTS

The native smartphone capabilities for biomedical imaging applications include cameras, touchscreens, networking, computation, 3D sensing, audio, and motion, in addition to commercial wearable peripheral devices. Through user-centered design of custom hardware and software interfaces, these capabilities have the potential to enable portable, easy-to-use, point-of-care biomedical imaging systems. However, due to barriers in programming of custom software and on-board image analysis pipelines, many research prototypes fail to achieve a prospective clinical evaluation as intended. Effective clinical use cases appear to be those in which handheld, noninvasive image guidance is needed and accommodated by the clinical workflow. Handheld systems for in vivo, multispectral, and quantitative fluorescence imaging are a promising development for diagnostic and treatment guidance applications.

CONCLUSIONS

A holistic assessment of SBI systems must include interpretation of their value for intended clinical settings and how their implementations enable better workflow. A set of six guidelines are proposed to evaluate appropriateness of smartphone utilization in terms of clinical context, completeness, compactness, connectivity, cost, and claims. Ongoing work should prioritize realistic clinical assessments with quantitative and qualitative comparison to non-smartphone systems to clearly demonstrate the value of smartphone-based systems. Improved hardware design to accommodate the rapidly changing smartphone ecosystem, creation of open-source image acquisition and analysis pipelines, and adoption of robust calibration techniques to address phone-to-phone variability are three high priority areas to move SBI research forward.

Optical-aberrations-corrected light field re-projection for high-quality plenoptic imaging

The singlet plenoptic camera, which consists of a single lens, microlens array (MLA) and image sensor, possesses the superiority that the imaging system is compact and lightweight, which is beneficial to miniaturization. However, such plenoptic cameras suffer from severe optical aberrations and their imaging quality is inferior for post-capture processing. Therefore, this paper proposes an optical-aberrations-corrected light field re-projection method to obtain high-quality singlet plenoptic imaging. First, optical aberrations are modeled by Seidel polynomials and included into point spread function (PSF) modeling. The modeled PSF is subsequently used to reconstruct imaging object information. Finally, the reconstructed imaging object information is re-projected back to the plenoptic imaging plane to obtain high-quality plenoptic images without optical aberrations. PSF modeling is validated by a self-built singlet plenoptic camera and the utility of the proposed optical-aberrations-corrected light field re-projection method is verified by numerical simulations and real imaging experiments.

Embedded deep learning in ophthalmology: making ophthalmic imaging smarter

Deep learning has recently gained high interest in ophthalmology due to its ability to detect clinically significant features for diagnosis and prognosis. Despite these significant advances, little is known about the ability of various deep learning systems to be embedded within ophthalmic imaging devices, allowing automated image acquisition. In this work, we will review the existing and future directions for 'active acquisition'-embedded deep learning, leading to as high-quality images with little intervention by the human operator. In clinical practice, the improved image quality should translate into more robust deep learning-based clinical diagnostics. Embedded deep learning will be enabled by the constantly improving hardware performance with low cost. We will briefly review possible computation methods in larger clinical systems. Briefly, they can be included in a three-layer framework composed of edge, fog, and cloud layers, the former being performed at a device level. Improved egde-layer performance via 'active acquisition' serves as an automatic data curation operator translating to better quality data in electronic health records, as well as on the cloud layer, for improved deep learning-based clinical data mining.