Excitation-scanning hyperspectral video endoscopy: enhancing the light at the end of the tunnel

Hyperspectral imaging and dynamic region of interest tracking approaches to quantify localized cAMP signals

Cyclic adenosine monophosphate (cAMP) is a ubiquitous second messenger known to orchestrate a myriad of cellular functions over a wide range of timescales. In the last 20 years, a variety of single-cell sensors have been developed to measure second messenger signals including cAMP, Ca2+, and the balance of kinase and phosphatase activities. These sensors utilize changes in fluorescence emission of an individual fluorophore or Förster resonance energy transfer (FRET) to detect changes in second messenger concentration. cAMP and kinase activity reporter probes have provided powerful tools for the study of localized signals. Studies relying on these and related probes have the potential to further revolutionize our understanding of G protein-coupled receptor signaling systems. Unfortunately, investigators have not been able to take full advantage of the potential of these probes due to the limited signal-to-noise ratio of the probes and the limited ability of standard epifluorescence and confocal microscope systems to simultaneously measure the distributions of multiple signals (e.g. cAMP, Ca2+, and changes in kinase activities) in real time. In this review, we focus on recently implemented strategies to overcome these limitations: hyperspectral imaging and adaptive thresholding approaches to track dynamic regions of interest (ROI). This combination of approaches increases signal-to-noise ratio and contrast, and allows identification of localized signals throughout cells. These in turn lead to the identification and quantification of intracellular signals with higher effective resolution. Hyperspectral imaging and dynamic ROI tracking approaches offer investigators additional tools with which to visualize and quantify multiplexed intracellular signaling systems.

Switchable LED-based laparoscopic multispectral system for rapid high-resolution perfusion imaging

Significance

Multispectral imaging (MSI) is an approach for real-time, quantitative, and non-invasive tissue perfusion measurements. Current laparoscopic systems based on mosaic sensors or filter wheels lack high spatial resolution or acceptable frame rates.

Aim

To develop a laparoscopic system for MSI-based color video and tissue perfusion imaging during gastrointestinal surgery without compromising spatial or temporal resolution.

Approach

The system was built with 14 switchable light-emitting diodes in the visible and near-infrared spectral range, a 4K image sensor, and a 10 mm laparoscope. Illumination patterns were created for tissue oxygenation and hemoglobin content monitoring. The system was calibrated to a clinically approved laparoscopic hyperspectral system using linear regression models and evaluated in an occlusion study with 36 volunteers.

Results

The root mean squared errors between the MSI and reference system were 0.073 for hemoglobin content, 0.039 for oxygenation in deeper tissue layers, and 0.093 for superficial oxygenation. The spatial resolution at a working distance of 45 mm was 156    μ m . The effective frame rate was 20 fps.

Conclusions

High-resolution perfusion monitoring was successfully achieved. Hardware optimizations will increase the frame rate. Parameter optimizations through alternative illumination patterns, regression, or assumed tissue models are planned. Intraoperative measurements must confirm the suitability during surgery.

Adaptive denoising hyperspectral data for visualization enhancement of intraoperative tissue

The vast amount of reflectance information obtained from the hyperspectral imaging devices offers great opportunities for investigating the function and structure of human tissue. However, the captured hyperspectral data often contain various noises due to the intrinsic imperfection of associated electrical and optical imaging components. This work proposed an automatic total variation algorithm to suppress the noises while preserving the details of the spectral and spatial information. The variation of spectral images at neighboring bands was calculated for regulating the total variation of hyperspectral data so that the spectral-dependent noises can be treated differentially across all bands. Experimental results demonstrated that the proposed method could effectively remove the spectral noises, especially near the ends of those extreme bands. The noise suppressed hyperspectral data could then be used for the visualization enhancement on pathophysiological conditions of intraoperative observed anatomies such as the vessels of brain tissues.

Microscopy is better in color: development of a streamlined spectral light path for real-time multiplex fluorescence microscopy

Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca²⁺ and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

Measurement of agonist-induced Ca2+ signals in human airway smooth muscle cells using excitation scan-based hyperspectral imaging and image analysis approaches

Ca²⁺ and cAMP are ubiquitous second messengers known to differentially regulate a variety of cellular functions over a wide range of timescales. Studies from a variety of groups support the hypothesis that these signals can be localized to discrete locations within cells, and that this subcellular localization is a critical component of signaling specificity. However, to date, it has been difficult to track second messenger signals at multiple locations. To overcome this limitation, we utilized excitation scan-based hyperspectral imaging approaches to track second messenger signals as well as labeled cellular structures and/or proteins in the same cell. We have previously reported that hyperspectral imaging techniques improve the signal-to-noise ratios of both fluorescence measurements, and are thus well suited for the measurement of localized Ca²⁺ signals. We investigated the spatial spread and intensities of agonist-induced Ca²⁺ signals in primary human airway smooth muscle cells (HASMCs) using the Ca²⁺ indicator Cal520. We measured responses triggered by three agonists, carbachol, histamine, and chloroquine. We utilized custom software coded in MATLAB and Python to assess agonist induced changes in Ca²⁺ levels. Software algorithms removed the background and applied correction coefficients to spectral data prior to linear unmixing, spatial and temporal filtering, adaptive thresholding, and automated region of interest (ROI) detection. All three agonists triggered transient Ca²⁺ responses that were spatially and temporally complex. We are currently analyzing differences in both ROI area and intensity distributions triggered by these agonists. This work was supported by NIH awards P01HL066299, K25HL136869, and R01HL137030 and NSF award MRI1725937.