Crosstalk-free volumetric in vivo imaging of a human retina with Fourier-domain full-field optical coherence tomography

Optical-coherence-tomography-based deep-learning scatterer-density estimator using physically accurate noise model

We demonstrate a deep-learning-based scatterer density estimator (SDE) that processes local speckle patterns of optical coherence tomography (OCT) images and estimates the scatterer density behind each speckle pattern. The SDE is trained using large quantities of numerically simulated OCT images and their associated scatterer densities. The numerical simulation uses a noise model that incorporates the spatial properties of three types of noise, i.e., shot noise, relative-intensity noise, and non-optical noise. The SDE's performance was evaluated numerically and experimentally using two types of scattering phantom and in vitro tumor spheroids. The results confirmed that the SDE estimates scatterer densities accurately. The estimation accuracy improved significantly when compared with our previous deep-learning-based SDE, which was trained using numerical speckle patterns generated from a noise model that did not account for the spatial properties of noise.

Real-time line-field optical coherence tomography for cellular resolution imaging of biological tissue

A real-time line-field optical coherence tomography (LF-OCT) system is demonstrated with image acquisition rates of up to 5000 B-frames or 2.5 million A-lines per second for 500 A-lines per B-frame. The system uses a high-speed low-cost camera to achieve continuous data transfer rates required for real-time imaging, allowing the evaluation of future applications in clinical or intraoperative environments. The light source is an 840 nm super-luminescent diode. Leveraging parallel computing with GPU and high speed CoaXPress data transfer interface, we were able to acquire, process, and display OCT data with low latency. The studied system uses anamorphic beam shaping in the detector arm, optimizing the field of view and sensitivity for imaging biological tissue at cellular resolution. The lateral and axial resolution measured in air were 1.7 µm and 6.3 µm, respectively. Experimental results demonstrate real-time inspection of the trabecular meshwork and Schlemm's canal on ex vivo corneoscleral wedges and real-time imaging of endothelial cells of human subjects in vivo.

Optical tomography in a single camera frame using fringe-encoded deep-learning full-field OCT

Optical coherence tomography is a valuable tool for in vivo examination thanks to its superior combination of axial resolution, field-of-view and working distance. OCT images are reconstructed from several phases that are obtained by modulation/multiplexing of light wavelength or optical path. This paper shows that only one phase (and one camera frame) is sufficient for en face tomography. The idea is to encode a high-frequency fringe patterns into the selected layer of the sample using low-coherence interferometry. These patterns can then be efficiently extracted with a high-pass filter enhanced via deep learning networks to create the tomographic full-field OCT view. This brings 10-fold improvement in imaging speed, considerably reducing the phase errors and incoherent light artifacts related to in vivo movements. Moreover, this work opens a path for low-cost tomography with slow consumer cameras. Optically, the device resembles the conventional time-domain full-field OCT without incurring additional costs or a field-of-view/resolution reduction. The approach is validated by imaging in vivo cornea in human subjects. Open-source and easy-to-follow codes for data generation/training/inference with U-Net/Pix2Pix networks are provided to be used in a variety of image-to-image translation tasks.

Multi-focus averaging for multiple scattering suppression in optical coherence tomography

Multiple scattering is one of the main factors that limits the penetration depth of optical coherence tomography (OCT) in scattering samples. We propose a method termed multi-focus averaging (MFA) to suppress the multiple-scattering signals and improve the image contrast of OCT in deep regions. The MFA method captures multiple OCT volumes with various focal positions and averages them in complex form after correcting the varying defocus through computational refocusing. Because the multiple-scattering takes different trajectories among the different focal position configurations, this averaging suppresses the multiple-scattering signal. Meanwhile, the single-scattering takes a consistent trajectory regardless of the focal position configuration and is not suppressed. Hence, the MFA method improves the ratio between the single-scattering signal and multiple-scattering signal, resulting in an enhancement in the image contrast. A scattering phantom and a postmortem zebrafish were measured to validate the proposed method. The results showed that the contrast of intensity images of both the phantom and zebrafish were improved using the MFA method, such that they were better than the contrast provided by the standard single focus averaging method. The MFA method provides a cost-effective solution for contrast enhancement through multiple-scattering reduction in tissue imaging using OCT systems.

Continuous-wave parallel interferometric near-infrared spectroscopy (CW NIRS) with a fast two-dimensional camera

Interferometric near-infrared spectroscopy (iNIRS) is an optical method that noninvasively measures the optical and dynamic properties of the human brain in vivo. However, the original iNIRS technique uses single-mode fibers for light collection, which reduces the detected light throughput. The reduced light throughput is compensated by the relatively long measurement or integration times (∼1 sec), which preclude monitoring of rapid blood flow changes that could be linked to neural activation. Here, we propose parallel interferometric near-infrared spectroscopy (πNIRS) to overcome this limitation. In πNIRS we use multi-mode fibers for light collection and a high-speed, two-dimensional camera for light detection. Each camera pixel acts effectively as a single iNIRS channel. So, the processed signals from each pixel are spatially averaged to reduce the overall integration time. Moreover, interferometric detection provides us with the unique capability of accessing complex information (amplitude and phase) about the light remitted from the sample, which with more than 8000 parallel channels, enabled us to sense the cerebral blood flow with only a 10 msec integration time (∼100x faster than conventional iNIRS). In this report, we have described the theoretical foundations and possible ways to implement πNIRS. Then, we developed a prototype continuous wave (CW) πNIRS system and validated it in liquid phantoms. We used our CW πNIRS to monitor the pulsatile blood flow in a human forearm in vivo. Finally, we demonstrated that CW πNIRS could monitor activation of the prefrontal cortex by recording the change in blood flow in the forehead of the subject while he was reading an unknown text.

Extending field-of-view of retinal imaging by optical coherence tomography using convolutional Lissajous and slow scan patterns

Optical coherence tomography (OCT) is a high-speed non-invasive cross-sectional imaging technique. Although its imaging speed is high, three-dimensional high-spatial-sampling-density imaging of in vivo tissues with a wide field-of-view (FOV) is challenging. We employed convolved Lissajous and slow circular scanning patterns to extend the FOV of retinal OCT imaging with a 1-µm, 100-kHz-sweep-rate swept-source OCT prototype system. Displacements of sampling points due to eye movements are corrected by post-processing based on a Lissajous scan. Wide FOV three-dimensional retinal imaging with high sampling density and motion correction is achieved. Three-dimensional structures obtained using repeated imaging sessions of a healthy volunteer and two patients showed good agreement. The demonstrated technique will extend the FOV of simple point-scanning OCT, such as commercial ophthalmic OCT devices, without sacrificing sampling density.

Line-scanning SD-OCT for in-vivo, non-contact, volumetric, cellular resolution imaging of the human cornea and limbus

In-vivo, non-contact, volumetric imaging of the cellular and sub-cellular structure of the human cornea and limbus with optical coherence tomography (OCT) is challenging due to involuntary eye motion that introduces both motion artifacts and blur in the OCT images. Here we present the design of a line-scanning (LS) spectral-domain (SD) optical coherence tomography system that combines 2 × 3 × 1.7 µm (x, y, z) resolution in biological tissue with an image acquisition rate of ∼2,500 fps, and demonstrate its ability to image in-vivo and without contact with the tissue surface, the cellular structure of the human anterior segment tissues. Volumetric LS-SD-OCT images acquired over a field-of-view (FOV) of 0.7 mm × 1.4 mm reveal fine morphological details in the healthy human cornea, such as epithelial and endothelial cells, sub-basal nerves, as well as the cellular structure of the limbal crypts, the palisades of Vogt (POVs) and the blood microvasculature of the human limbus. LS-SD-OCT is a promising technology that can assist ophthalmologists with the early diagnostics and optimal treatment planning of ocular diseases affecting the human anterior eye.

Computational refocusing of Jones matrix polarization-sensitive optical coherence tomography and investigation of defocus-induced polarization artifacts

Here we demonstrate a long-depth-of-focus imaging method using polarization sensitive optical coherence tomography (PS-OCT). This method involves a combination of Fresnel-diffraction-model-based phase sensitive computational refocusing and Jones-matrix based PS-OCT (JM-OCT). JM-OCT measures four complex OCT images corresponding to four polarization channels. These OCT images are computationally refocused as preserving the mutual phase consistency. This method is validated using a static phantom, postmortem zebrafish, and ex vivo porcine muscle samples. All the samples demonstrated successful computationally-refocused birefringence and degree-of-polarization-uniformity (DOPU) images. We found that defocusing induces polarization artifacts, i.e., incorrectly high birefringence values and low DOPU values, which are substantially mitigated by computational refocusing.

Light-adapted flicker optoretinograms captured with a spatio-temporal optical coherence-tomography (STOC-T) system

For many years electroretinography (ERG) has been used for obtaining information about the retinal physiological function. More recently, a new technique called optoretinography (ORG) has been developed. In one form of this technique, the physiological response of retinal photoreceptors to visible light, resulting in a nanometric photoreceptor optical path length change, is measured by phase-sensitive optical coherence tomography (OCT). To date, a limited number of studies with phase-based ORG measured the retinal response to a flickering light stimulation. In this work, we use a spatio-temporal optical coherence tomography (STOC-T) system to capture optoretinograms with a flickering stimulus over a 1.7 × 0.85 mm2 area of a light-adapted retina located between the fovea and the optic nerve. We show that we can detect statistically-significant differences in the photoreceptor optical path length (OPL) modulation amplitudes in response to different flicker frequencies and with better signal to noise ratios (SNRs) than for a dark-adapted eye. We also demonstrate the ability to spatially map such response to a patterned stimulus with light stripes flickering at different frequencies, highlighting the prospect of characterizing the spatially-resolved temporal-frequency response of the retina with ORG.

Retinal blood flow imaging with combined full-field swept-source optical coherence tomography and laser Doppler holography

Full-field swept-source optical coherence tomography (FF-SS-OCT) and laser Doppler holography (LDH) are two holographic imaging techniques presenting unique capabilities for ophthalmology. We report on interlaced FF-SS-OCT and LDH imaging with a single instrument. Effectively, retinal blood flow and pulsation could be quasi-simultaneously monitored. This instrument holds potential for a wide scope of ophthalmic applications.

Multimode fiber as a tool to reduce cross talk in Fourier-domain full-field optical coherence tomography

Fourier-domain full-field optical coherence tomography (FD-FF-OCT) is an emerging tool for high-speed eye imaging. However, cross-talk formation in images limits the imaging depth. To this end, we have recently shown that reducing spatial coherence with a fast deformable membrane can suppress the noise but over a limited axial range and with substantial data processing. Here, we demonstrate that a multimode fiber with carefully chosen parameters enables cross-talk-free imaging over a long axial range and without significant artifacts. We also show that it can be used to image the human retina and choroid in vivo with exceptional contrast.

Partial-field illumination ophthalmoscope: improving the contrast of a camera-based retinal imager

Effective and accurate in vivo diagnosis of retinal pathologies requires high performance imaging devices, combining a large field of view and the ability to discriminate the ballistic signal from the diffuse background in order to provide a highly contrasted image of the retinal structures. Here, we have implemented the partial-field illumination ophthalmoscope, a patterned illumination modality, integrated to a high pixel rate adaptive optics full-field microscope. This non-invasive technique enables us to mitigate the low signal-to-noise ratio, intrinsic of full-field ophthalmoscopes, by partially illuminating the retina with complementary patterns to reconstruct a wide-field image. This new, to the best of our knowledge, modality provides an image contrast spanning from the full-field to the confocal contrast, depending on the pattern size. As a result, it offers various trade-offs in terms of contrast and acquisition speed, guiding the users towards the most efficient system for a particular clinical application.

Roadmap on digital holography [Invited]

This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.

Enhanced medical diagnosis for dOCTors: a perspective of optical coherence tomography

SIGNIFICANCE

After three decades, more than 75,000 publications, tens of companies being involved in its commercialization, and a global market perspective of about USD 1.5 billion in 2023, optical coherence tomography (OCT) has become one of the fastest successfully translated imaging techniques with substantial clinical and economic impacts and acceptance.

AIM

Our perspective focuses on disruptive forward-looking innovations and key technologies to further boost OCT performance and therefore enable significantly enhanced medical diagnosis.

APPROACH

A comprehensive review of state-of-the-art accomplishments in OCT has been performed.

RESULTS

The most disruptive future OCT innovations include imaging resolution and speed (single-beam raster scanning versus parallelization) improvement, new implementations for dual modality or even multimodality systems, and using endogenous or exogenous contrast in these hybrid OCT systems targeting molecular and metabolic imaging. Aside from OCT angiography, no other functional or contrast enhancing OCT extension has accomplished comparable clinical and commercial impacts. Some more recently developed extensions, e.g., optical coherence elastography, dynamic contrast OCT, optoretinography, and artificial intelligence enhanced OCT are also considered with high potential for the future. In addition, OCT miniaturization for portable, compact, handheld, and/or cost-effective capsule-based OCT applications, home-OCT, and self-OCT systems based on micro-optic assemblies or photonic integrated circuits will revolutionize new applications and availability in the near future. Finally, clinical translation of OCT including medical device regulatory challenges will continue to be absolutely essential.

CONCLUSIONS

With its exquisite non-invasive, micrometer resolution depth sectioning capability, OCT has especially revolutionized ophthalmic diagnosis and hence is the fastest adopted imaging technology in the history of ophthalmology. Nonetheless, OCT has not been completely exploited and has substantial growth potential-in academics as well as in industry. This applies not only to the ophthalmic application field, but also especially to the original motivation of OCT to enable optical biopsy, i.e., the in situ imaging of tissue microstructure with a resolution approaching that of histology but without the need for tissue excision.

Simultaneous directional full-field OCT using path-length and carrier multiplexing

Full-field swept-source optical coherence tomography (FF-SS-OCT) is an emerging technology with potential applications in ophthalmic imaging, microscopy, metrology, and other domains. Here we demonstrate a novel method of multiplexing FF-SS-OCT signals using carrier modulation (CM). The principle of CM could be used to inspect various properties of the scattered light, e.g. its spectrum, polarization, Doppler shift, or distribution in the pupil. The last of these will be explored in this work, where CM was used to acquire images passing through two different optical pupils. The two pupils contained semicircular optical windows with perpendicular orientations, with each window permitting measurement of scattering anisotropy in one dimension by inducing an optical delay between the images formed by the two halves of the pupil. Together, the two forms of multiplexing permit measurement of differential scattering anisotropy in the x and y dimensions simultaneously. To demonstrate the feasibility of this technique our carrier multiplexed directional FF-OCT (CM-D-FF-OCT) system was used to acquire images of a microlens array, human hair, onion skin and in vivo human retina. The results of these studies are presented and briefly discussed in the context of future development and application of this technique.

Fourier-domain full-field optical coherence tomography with real-time axial imaging

Fourier-domain full-field optical coherence tomography (FD-FF-OCT) is a fast interferometric imaging technique capable of volumetric sample imaging. However, half of the backscattered light from a sample is lost as it passes through a 50/50 beam splitter, which is at the heart of almost every interferometer. Here, it is demonstrated that this light could be extracted by spatially splitting the illumination pupil plane and detecting it with a separate camera. When a line camera is used to detect the recovered signal, it enables real-time axial imaging of the human cornea in vivo, which serves as a useful visual feedback for aligning a patient for imaging.

Reflective mirror-based line-scan adaptive optics OCT for imaging retinal structure and function

Line-scan OCT incorporated with adaptive optics (AO) offers high resolution, speed, and sensitivity for imaging retinal structure and function in vivo. Here, we introduce its implementation with reflective mirror-based afocal telescopes, optimized for imaging light-induced retinal activity (optoretinography) and weak retinal reflections at the cellular scale. A non-planar optical design was followed based on previous recommendations with key differences specific to a line-scan geometry. The three beam paths fundamental to an OCT system -illumination/sample, detection, and reference- were modeled in Zemax optical design software to yield theoretically diffraction-limited performance over a 2.2 deg. field-of-view and 1.5 D vergence range at the eye's pupil. The performance for imaging retinal structure was exemplified by cellular-scale visualization of retinal ganglion cells, macrophages, foveal cones, and rods in human observers. The performance for functional imaging was exemplified by resolving the light-evoked optical changes in foveal cone photoreceptors where the spatial resolution was sufficient for cone spectral classification at an eccentricity 0.3 deg. from the foveal center. This enabled the first in vivo demonstration of reduced S-cone (short-wavelength cone) density in the human foveola, thus far observed only in ex vivo histological preparations. Together, the feasibility for high resolution imaging of retinal structure and function demonstrated here holds significant potential for basic science and translational applications.

Multimode fiber enables control of spatial coherence in Fourier-domain full-field optical coherence tomography for in vivo corneal imaging

Fourier-domain full-field optical coherence tomography (FD-FF-OCT) has recently emerged as a fast alternative to point-scanning confocal OCT in eye imaging. However, when imaging the cornea with FD-FF-OCT, a spatially coherent laser can focus down on the retina to a spot that exceeds the maximum permissible exposure level. Here we demonstrate that a long multimode fiber with a small core can be used to reduce the spatial coherence of the laser and, thus, enable ultrafast in vivo volumetric imaging of the human cornea without causing risk to the retina.

Line field Fourier domain optical coherence tomography based on a spatial light modulator

In this study, we developed a line-field Fourier domain optical coherence tomography (LF-FDOCT) system that performs lateral scanning using a two-dimension spatial light modulator and detects multiple channels of spectral domain OCT signal in parallel using a two-dimensional sensor. The LF-FDOCT system eliminates the need for mechanical scanning to acquire volumetric OCT data. It allows parallel acquisition of signal for B mode scan imaging through snapshot detection and offers unprecedented flexibility to select a fast scanning dimension. In this work, we describe the principle of LF-FDOCT imaging and present experimental results to demonstrate the effectiveness of this technology.

Kilohertz retinal FF-SS-OCT and flood imaging with hardware-based adaptive optics

A retinal imaging system was designed for full-field (FF) swept-source (SS) optical coherence tomography (OCT) with cellular resolution. The system incorporates a real-time adaptive optics (AO) subsystem and a very high-speed CMOS sensor, and is capable of acquiring volumetric images of the retina at rates up to 1 kHz. While digital aberration correction (DAC) is an attractive potential alternative to AO, it has not yet been shown to provide resolution allowing visualization of cones in the fovea, where early detection of functional deficits is most critical. Here we demonstrate that FF-SS-OCT with hardware AO permits resolution of foveal cones, imaged at eccentricities of 1° and 2°, with volume rates adequate to measure light-evoked changes in photoreceptors. With the reference arm blocked, the system can operate as a kilohertz AO flood illumination fundus camera with adjustable temporal coherence and is expected to allow measurement of light-evoked changes caused by common path interference in photoreceptor outer segments (OS). In this paper, we describe the system's optical design, characterize its performance, and demonstrate its ability to produce images of the human photoreceptor mosaic.

In vivo imaging of the human cornea with high-speed and high-resolution Fourier-domain full-field optical coherence tomography

Corneal evaluation in ophthalmology necessitates cellular-resolution and fast imaging techniques that allow for accurate diagnoses. Currently, the fastest volumetric imaging technique is Fourier-domain full-field optical coherence tomography (FD-FF-OCT), which uses a fast camera and a rapidly tunable laser source. Here, we demonstrate high-resolution, high-speed, non-contact corneal volumetric imaging in vivo with FD-FF-OCT that can acquire a single 3D volume with a voxel rate of 7.8 GHz. The spatial coherence of the laser source was suppressed to prevent it from focusing on a spot on the retina, and therefore, exceeding the maximum permissible exposure (MPE). The inherently volumetric nature of FD-FF-OCT data enabled flattening of curved corneal layers. The acquired FD-FF-OCT images revealed corneal cellular structures, such as epithelium, stroma and endothelium, as well as subbasal and mid-stromal nerves.

Computational aberration correction in spatiotemporal optical coherence (STOC) imaging

Spatiotemporal optical coherence (STOC) imaging is a new technique for suppressing coherent cross talk noise in Fourier-domain full-field optical coherence tomography (FD-FF-OCT). In STOC imaging, the time-varying inhomogeneous phase masks modulate the incident light to alter the interferometric signal. Resulting interference images are then processed as in standard FD-FF-OCT and averaged incoherently or coherently to produce cross-talk-free volumetric optical coherence tomography (OCT) images of the sample. Here, we show that coherent averaging is suitable when phase modulation is performed for both interferometer arms simultaneously. We explain the advantages of coherent over incoherent averaging. Specifically, we show that modulated signal, after coherent averaging, preserves lateral phase stability, enabling computational phase correction to compensate for geometrical aberrations. Ultimately, we employ it to correct for aberrations present in the image of the photoreceptor layer of the human retina that reveals otherwise invisible photoreceptor mosaics.

Light-efficient beamsplitter for Fourier-domain full-field optical coherence tomography

Any full-field optical coherence tomography (FF-OCT) system wastes almost 75% of light, including 50% of the OCT signal, because it uses a 50/50 beamsplitter (BS) in the standard implementation. Here, a design of a light-efficient BS is presented that loses almost no light when implemented in Fourier-domain FF-OCT. It is based on pupil engineering and a small highly asymmetric BS. The presented signal-to-noise ratio (SNR) analysis demonstrates almost four times improvement over the conventional design. In addition, it is shown that the light-efficient BS can be used to suppress specular reflections from a sample and, thus, further improve the SNR.