Ultraminiature optical design for multispectral fluorescence imaging endoscopes

Label-Free Optical Technologies to Enhance Noninvasive Endoscopic Imaging of Early-Stage Cancers

White light endoscopic imaging allows for the examination of internal human organs and is essential in the detection and treatment of early-stage cancers. To facilitate diagnosis of precancerous changes and early-stage cancers, label-free optical technologies that provide enhanced malignancy-specific contrast and depth information have been extensively researched. The rapid development of technology in the past two decades has enabled integration of these optical technologies into clinical endoscopy. In recent years, the significant advantages of using these adjunct optical devices have been shown, suggesting readiness for clinical translation. In this review, we provide an overview of the working principles and miniaturization considerations and summarize the clinical and preclinical demonstrations of several such techniques for early-stage cancer detection. We also offer an outlook for the integration of multiple technologies and the use of computer-aided diagnosis in clinical endoscopy.

Metaoptics for aberration correction in microendoscopy

Compact and minimally invasive scanning fiber endoscopy probes with micron-level resolution have great potential in detailed tissue interrogation and early disease diagnosis, which are key applications of confocal reflectance imaging at visible wavelengths. State-of-the-art imaging probes commonly employ refractive lens triplets or gradient refractive index (GRIN) lenses as the micro-objective. However, off-axis aberration emerges as a critical factor affecting resolution, especially at the extremities of the imaging field. In response to this challenge, we propose what we believe to be a novel design integrating a metasurface with the GRIN micro-objective to address optical aberrations during beam scan. The metasurface acts as a corrector element for optical aberrations in a fiber-scanning endoscope using the same fiber for excitation and collection. Modeling such hybrid refractive-metasurface designs requires the coupling of simulation techniques across macroscale and nanoscale optics, for which we used an Ansys simulation workflow platform. Operating at a wavelength of 644 nm, this metaoptical element serves as a thin and compact aberration correction surface, ensuring uniform resolution across the entire imaging field. Experimental results from our scanning fiber endoscopy system demonstrate a notable enhancement in optical performance both on-axis and off-axis, achieving a resolution of 3 µm at the center of the imaging field. Impressively, the resolution experiences only a modest degradation by a factor of 0.13 at the edge of the field of view compared to the center.

Characterizing close-focus lenses for microendoscopy

Microendoscopes are commonly used in small lumens in the body, for which a focus near to the distal tip and ability to operate in an aqueous environment are paramount for navigation and disease detection. Commercially available distal optic systems below 1mm in diameter are severely limited, and custom micro lenses are generally very expensive. Gradient index of refraction (GRIN) singlets are available in small diameters but have limited optical performance adjustability. Three-dimensional (3D) printed monolithic optical systems are an emerging option that may be suitable for enabling high performance, close-focus imaging. In this manuscript, we compared the optical performance of three custom distal optic systems; a custom-pitch GRIN singlet, 3D-printed monolithic doublet, and 3D-printed monolithic triplet, with a nominal working distance (WD) of 1.5mm, 0.5mm and 0.4mm in 0.9% saline. These short WDs are ideal for microendoscopy in collapsed or flushed lumens such as pancreatic duct or fallopian tube. The GRIN singlet had performance limited only by the fiber bundle relay over 0.9mm to 1.6 mm depth of field (DOF). The 3D printed doublet was able to achieve a comparable DOF of 0.71mm, while the 3D printed triplet suffered the most limited DOF of 0.55mm. 3D printing enables flexible design of monolithic multi-element systems with aspheric surfaces of very short WDs and relative ease of integration.

First-in-human pilot study of snapshot multispectral endoscopy for early detection of Barrett's-related neoplasia

SIGNIFICANCE

The early detection of dysplasia in patients with Barrett's esophagus could improve outcomes by enabling curative intervention; however, dysplasia is often inconspicuous using conventional white-light endoscopy.

AIM

We sought to determine whether multispectral imaging (MSI) could be applied in endoscopy to improve detection of dysplasia in the upper gastrointestinal (GI) tract.

APPROACH

We used a commercial fiberscope to relay imaging data from within the upper GI tract to a snapshot MSI camera capable of collecting data from nine spectral bands. The system was deployed in a pilot clinical study of 20 patients (ClinicalTrials.gov NCT03388047) to capture 727 in vivo image cubes matched with gold-standard diagnosis from histopathology. We compared the performance of seven learning-based methods for data classification, including linear discriminant analysis, k-nearest neighbor classification, and a neural network.

RESULTS

Validation of our approach using a Macbeth color chart achieved an image-based classification accuracy of 96.5%. Although our patient cohort showed significant intra- and interpatient variance, we were able to resolve disease-specific contributions to the recorded MSI data. In classification, a combined principal component analysis and k-nearest-neighbor approach performed best, achieving accuracies of 95.8%, 90.7%, and 76.1%, respectively, for squamous, non-dysplastic Barrett's esophagus and neoplasia based on majority decisions per-image.

CONCLUSIONS

MSI shows promise for disease classification in Barrett's esophagus and merits further investigation as a tool in high-definition "chip-on-tip" endoscopes.

A Percutaneous Catheter for In Vivo Hyperspectral Imaging of Cardiac Tissue: Challenges, Solutions and Future Directions

PURPOSE

Multiple studies have shown that spectral analysis of tissue autofluorescence can be used as a live indicator for various pathophysiological states of cardiac tissue, including ischemia, ablation-induced damage, or scar formation. Yet today there are no percutaneous devices that can detect autofluorescence signals from inside a beating heart. Our aim was to develop a prototype catheter to demonstrate the feasibility of doing so.

METHODS AND RESULTS

Here we summarize technical solutions leading to the development of a percutaneous catheter capable of multispectral imaging of intracardiac surfaces. The process included several iterations of light sources, optical filtering, and image acquisition techniques. The developed system included a compliant balloon, 355 nm laser irradiance, a high-sensitivity CCD, bandpass filtering, and image acquisition synchronized with the cardiac cycle. It enabled us to capture autofluorescence images from multiple spectral bands within the visible range while illuminating the endocardial surface with ultraviolet light. Principal component analysis and other spectral unmixing post-processing algorithms were then used to reveal target tissue.

CONCLUSION

Based on the success of our prototype system, we are confident that the development of ever more sensitive cameras, recent advances in tunable filters, fiber bundles, and other optical and computational components makes it possible to create percutaneous catheters capable of acquiring hyper or multispectral hypercubes, including those based on autofluorescence, in real-time. This opens the door for widespread use of this methodology for high-resolution intraoperative imaging of internal tissues and organs-including cardiovascular applications.

Snapshot multispectral endomicroscopy

Multispectral endomicroscopy provides tissue functional information in addition to structural information for accurate disease diagnosis. In this Letter, we propose a snapshot multispectral endomicroscope that employs a fiber bundle to deliver an in-body tissue spatial-spectral datastream to an external compressive spectral imager. Equipped with an end-to-end deep-learning-based reconstruction algorithm, we are able to capture tissue multispectral data in video rates and reconstruct high-resolution multispectral images with up to 24 spectral channels in near-real time.

Submillimeter diameter rotary-pullback fiber-optic endoscope for narrowband red-green-blue reflectance, optical coherence tomography, and autofluorescence in vivo imaging

A fiber-based endoscopic imaging system combining narrowband red-green-blue (RGB) reflectance with optical coherence tomography (OCT) and autofluorescence imaging (AFI) has been developed. The system uses a submillimeter diameter rotary-pullback double-clad fiber imaging catheter for sample illumination and detection. The imaging capabilities of each modality are presented and demonstrated with images of a multicolored card, fingerprints, and tongue mucosa. Broadband imaging, which was done to compare with narrowband sources, revealed better contrast but worse color consistency compared with narrowband RGB reflectance. The measured resolution of the endoscopic system is 25  μm in both the rotary direction and the pullback direction. OCT can be performed simultaneously with either narrowband RGB reflectance imaging or AFI.

Quantitative evaluation of comb-structure correction methods for multispectral fibrescopic imaging

Removing the comb artifact introduced by imaging fibre bundles, or 'fibrescopes', for example in medical endoscopy, is essential to provide high quality images to the observer. Multispectral imaging (MSI) is an emerging method that combines morphological (spatial) and chemical (spectral) information in a single data 'cube'. When a fibrescope is coupled to a spectrally resolved detector array (SRDA) to perform MSI, comb removal is complicated by the demosaicking step required to reconstruct the multispectral data cube. To understand the potential for using SRDAs as multispectral imaging sensors in medical endoscopy, we assessed five comb correction methods with respect to five performance metrics relevant to biomedical imaging applications: processing time, resolution, smoothness, signal and the accuracy of spectral reconstruction. By assigning weights to each metric, which are determined by the particular imaging application, our results can be used to select the correction method to achieve best overall performance. In most cases, interpolation gave the best compromise between the different performance metrics when imaging using an SRDA.

Bimodal reflectance and fluorescence multispectral endoscopy based on spectrally resolving detector arrays

Emerging clinical interest in combining standard white light endoscopy with targeted near-infrared (NIR) fluorescent contrast agents for improved early cancer detection has created demand for multimodal imaging endoscopes. We used two spectrally resolving detector arrays (SRDAs) to realize a bimodal endoscope capable of simultaneous reflectance-based imaging in the visible spectral region and multiplexed fluorescence-based imaging in the NIR. The visible SRDA was composed of 16 spectral bands, with peak wavelengths in the range of 463 to 648 nm and full-width at half-maximum (FWHM) between 9 and 26 nm. The NIR SRDA was composed of 25 spectral bands, with peak wavelengths in the range 659 to 891 nm and FWHM 7 to 15 nm. The spectral endoscope design was based on a "babyscope" model using a commercially available imaging fiber bundle. We developed a spectral transmission model to select optical components and provide reference endmembers for linear spectral unmixing of the recorded image data. The technical characterization of the spectral endoscope is presented, including evaluation of the angular field-of-view, barrel distortion, spatial resolution and spectral fidelity, which showed encouraging performance. An agarose phantom containing oxygenated and deoxygenated blood with three fluorescent dyes was then imaged. After spectral unmixing, the different chemical components of the phantom could be successfully identified via majority decision with high signal-to-background ratio (>3). Imaging performance was further assessed in an ex vivo porcine esophagus model. Our preliminary imaging results demonstrate the capability to simultaneously resolve multiple biological components using a compact spectral endoscopy system.