Bond-selective imaging of deep tissue through the optical window between 1600 and 1850 nm

High-speed fluorescence excitation-scanning hyperspectral imaging microscopy using thin-film tunable filters

Hyperspectral imaging (HSI) technologies have enabled a range of experimental techniques and studies in the fluorescence microscopy field. Unfortunately, a drawback of many HSI microscope platforms is increased acquisition time required to collect images across many spectral bands, as well as signal loss due to the need to filter or disperse emitted fluorescence into many discrete bands. We have previously demonstrated that an alternative approach of scanning the fluorescence excitation spectrum can greatly improve system efficiency by decreasing light losses associated with emission filtering. Our initial system was configured using an array of thin-film tunable filters (TFTFs, VersaChrome, Semrock) mounted in a tiltable filter wheel (VF-5, Sutter) that required ~150-200 ms to switch between wavelengths. Here, we present a new configuration for high-speed switching of TFTFs to allow rapid time-lapse HSI microscopy. A TFTF array was mounted in a custom holder that was attached to a piezoelectric rotation mount (ThorLabs), allowing high-speed rotation. Switching between adjacent filters was achieved using the internal optics of a DG-4 lightsource (Sutter Instrument), including a pair of off-axis parabolic mirrors and galvanometers. Output light was coupled to a liquid lightguide and into an inverted widefield fluorescence microscope (TI-2, Nikon Instruments). Initial tests indicate that the HSI system provides a 15-20 nm bandwidth tunable excitation band and ~10-20 ms wavelength switch time, allowing for high-speed HSI imaging of dynamic cellular events. This work was supported by NIH P01HL066299, R01HL169522, NIH TL1TR003106, and NSF MRI1725937.

Combined hyperspectral imaging, monolayer stress microscopy, and S8 image analysis approaches for simultaneously interrogating cellular signals and biomechanics

Second messenger signals, e.g., Ca2+ and cyclic nucleotides, orchestrate a wide range of cellular events. The methods by which second messenger signals determine specific physiological responses are complex. Recent studies point to the importance of temporal and spatial encoding in determining signal specificity. Studies also indicate the importance of mechanical stimuli, substrate stiffness, and mechanical responses - the "mechanosome" - in regulating physiology. Hence, approaches that probe both chemical and mechanical signals are needed. Here, we report preliminary efforts to combine hyperspectral imaging for second messenger signal measurements, monolayer stress microscopy for mechanical force measurements, and S8 analysis software for quantifying localized signals - specifically, Ca2+ dynamics and mechanical forces in human airway smooth muscle cells (HASMCs). HASMCs were prepared as confluent monolayers on 11 kPa gels with embedded fluorescent microparticles that serve as fiducial markers as well as smaller microparticles to measure deformation (strain). Imaging was performed using a custom excitation-scanning hyperspectral microscope. Hyperspectral images were unmixed to identify signals from cellular fluorescent labels (e.g., CAL 590-AM) and fluorescent microparticles. Images were analyzed to quantify localized force dynamics through monolayer stress microscopy. S8 software was used to identify, track, and quantify spatially-localized Ca2+ activity. Results indicate that localized and transient cellular signals and forces can be quantified and mapped within cell populations. Importantly, these results establish a method for simultaneous interrogation of cellular signals and mechanical forces that may play synergistic roles in regulating downstream cellular physiology in confluent monolayers. This work was supported by NIH P01HL066299, R01HL137030, R01HL058506, and NSF MRI1725937. Drs. Leavesley and Rich disclose financial interest in a university start-up company, SpectraCyte LLC, to commercialize spectral imaging technologies.

Validation of Excitation-Scan Hyperspectral Multi-faceted Mirror Array Prototype System Advancements to Hyperspectral Imaging Applications

Hyperspectral imaging technologies (HSI) have undergone rapid development since their beginning stages. While original applications were in remote sensing, other uses include agriculture, food safety and medicine. HSI has shown great utility in fluorescence microscopy for detecting signatures from many fluorescent molecules; however, acquisitions speeds have been slow due to light losses associated with spectral filtering. Therefore, we designed a novel light emitting diode (LED)-based rapid excitation scanning hyperspectral imaging platform allowing users to obtain simultaneous measurements of fluorescent labels without compromising acquisition speeds. Previously, we reported our results of the optical ray trace simulations and the geometrical capability of designing a multifaceted mirror imaging system as an initial approach to combine light at many wavelengths. The design utilized LEDs and a multifaceted mirror array to combine light sources into a liquid light guide. The computational model was constructed using Monte Carlo optical ray software (TracePro, Lambda Research Corp.). Recent prototype validation results show that when compared to a commercial emission scanning spectral confocal microscope (Zeiss-LSM-980), the novel LED-based excitation scanning HSI prototype successfully detected and separated six fluorescent labels from a custom 6-label African green monkey kidney epithelial cells. We report on the prototype's ability to overcome limitations of acquisition speeds, sensitivity, and specificity present in conventional systems. Future work will evaluate prototype's light losses to determine latent design modifications needed to demonstrate the system's feasibility as a promising solution for overcoming HSI acquisition speeds. This work was supported by NSF award MRI1725937.

Improving Visualization of cAMP Gradients Using Algorithmic Modelling

A ubiquitous second messenger molecule, cAMP is responsible for orchestrating many different cellular functions through a variety of pathways. Fӧrster resonance energy transfer (FRET) probes have been used to visualize cAMP spatial gradients in pulmonary microvascular endothelial cells (PMVECs). However, FRET probes have inherently low signal-to-noise ratios; multiple sources of noise can obscure accurate visualization of cAMP gradients using a hyperspectral imaging system. FRET probes have also been used to measure cAMP gradients in 3D; however, it can be difficult to differentiate between true FRET signals and noise. To further understand the effects of noise on experimental data, a model was developed to simulate cAMP gradients under experimental conditions. The model uses a theoretical cAMP heatmap generated using finite element analysis. This heatmap was converted to simulate the FRET probe signal that would be detected experimentally with a hyperspectral imaging system. The signal was mapped onto an image of unlabeled PMVECs. The result was a time lapse model of cAMP gradients obscured by autofluorescence, as visualized with FRET probes. Additionally, the model allowed the simulated expression level of FRET signal to be varied. This allowed accurate attribution of signal to FRET and autofluorescence. Comparing experimental data to the model results at different levels of FRET efficiency has allowed improved understanding of FRET signal specificity and how autofluorescence interferes with FRET signal detection. In conclusion, this model can more accurately determine cAMP gradients in PMVECs. This work was supported by NIH award P01HL066299, R01HL58506 and NSF award 1725937.

Hyperspectral imaging microscopy for measurement of localized second messenger signals in single cells

Ca2+ and cAMP are ubiquitous second messengers known to differentially regulate a variety of cellular functions over a wide range of timescales. Studies from a variety of groups support the hypothesis that these signals can be localized to discrete locations within cells, and that this subcellular localization is a critical component of signaling specificity. However, to date, it has been difficult to track second messenger signals at multiple locations within a single cell. This difficulty is largely due to the inability to measure multiplexed florescence signals in real time. To overcome this limitation, we have utilized both emission scan- and excitation scan-based hyperspectral imaging approaches to track second messenger signals as well as labeled cellular structures and/or proteins in the same cell. We have previously reported that hyperspectral imaging techniques improve the signal-to-noise ratios of both fluorescence and FRET measurements, and are thus well suited for the measurement of localized second messenger signals. Using these approaches, we have measured near plasma membrane and near nuclear membrane cAMP signals, as well as distributed signals within the cytosol, in several cell types including airway smooth muscle, pulmonary endothelial, and HEK-293 cells. We have also measured cAMP and Ca2+ signals near autofluorescent structures that appear to be golgi. Our data demonstrate that hyperspectral imaging approaches provide unique insight into the spatial and kinetic distributions of cAMP and Ca2+ signals in single cells.

Optimizing channel selection for excitation-scanning hyperspectral imaging

A major benefit of fluorescence microscopy is the now plentiful selection of fluorescent markers. These labels can be chosen to serve complementary functions, such as tracking labeled subcellular molecules near demarcated organelles. However, with the standard 3 or 4 emission channels, multiple label detection is restricted to segregated regions of the electromagnetic spectrum, as in RGB coloring. Hyperspectral imaging allows the user to discern many fluorescence labels by their unique spectral properties, provided there is significant differentiation of their emission spectra. The cost of this technique is often an increase in gain or exposure time to accommodate the signal reduction from separating the signal into many discrete excitation or emission channels. Recent advances in hyperspectral imaging have allowed the acquisition of more signal in a shorter time period by scanning the excitation spectra of fluorophores. Here, we explore the selection of optimal channels for both significant signal separation and sufficient signal detection using excitation-scanning hyperspectral imaging. Excitation spectra were obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with a Xe arc lamp and thin film tunable filter array (VersaChrome, Semrock, Inc.) Tunable filters had bandwidths between 13 and 17 nm. Scans utilized excitation wavelengths between 340 nm and 550 nm. Hyperspectral image stacks were generated and analyzed using ENVI and custom MATLAB scripts. Among channel consideration criteria were: number of channels, spectral range of scan, spacing of center wavelengths, and acquisition time.

Hyperspectral imaging fluorescence excitation scanning (HIFEX) microscopy for live cell imaging

In the past two decades, spectral imaging technologies have expanded the capacity of fluorescence microscopy for accurate detection of multiple labels, separation of labels from cellular and tissue autofluorescence, and analysis of autofluorescence signatures. These technologies have been implemented using a range of optical techniques, such as tunable filters, diffraction gratings, prisms, interferometry, and custom Bayer filters. Each of these techniques has associated strengths and weaknesses with regard to spectral resolution, spatial resolution, temporal resolution, and signal-to-noise characteristics. We have previously shown that spectral scanning of the fluorescence excitation spectrum can provide greatly increased signal strength compared to traditional emission-scanning approaches. Here, we present results from utilizing a Hyperspectral Imaging Fluorescence Excitation Scanning (HIFEX) microscope system for live cell imaging. Live cell signaling studies were performed using HEK 293 and rat pulmonary microvascular endothelial cells (PMVECs), transfected with either a cAMP FRET reporter or a Ca2+ reporter. Cells were further labeled to visualize subcellular structures (nuclei, membrane, mitochondria, etc.). Spectral images were acquired using a custom inverted microscope (TE2000, Nikon Instruments) equipped with a 300W Xe arc lamp and tunable excitation filter (VF-5, Sutter Instrument Co., equipped with VersaChrome filters, Semrock), and run through MicroManager. Timelapse spectral images were acquired from 350-550 nm, in 5 nm increments. Spectral image data were linearly unmixed using custom MATLAB scripts. Results indicate that the HIFEX microscope system can acquire live cell image data at acquisition speeds of 8 ms/wavelength band with minimal photobleaching, sufficient for studying moderate speed cAMP and Ca2+ events.

A Spherical Mirror-based Illumination System for Fluorescence Excitation-Scanning Hyperspectral Imaging

Many hardware approaches have been developed for implementing hyperspectral imaging on fluorescence microscope systems; each with tradeoffs in spectral sensitivity and spectral, spatial, and temporal sampling. For example, tunable filter-based systems typically have limited wavelength switching speeds and sensitivities that preclude high-speed spectral imaging. Here, we present a novel approach combining multiple illumination wavelengths using solid state LEDs in a 2-mirror configuration similar to a Cassegrain reflector assembly. This approach provides spectral discrimination by scanning a range of fluorescence excitation wavelengths, which we have previously shown can improve spectral image acquisition time compared to traditional fluorescence emission-scanning hyperspectral imaging. In this work, the geometry of the LED and other optical components was optimized. A model of the spectral illuminator was designed using TracePro ray tracing software (Lambda Research Corp.) that included an emitter, lens, Spherical mirror, flat mirror, and liquid light guide input. A parametric sensitivity study was performed to optimize the optical throughput varying the LED viewing angle, properties of the Spherical reflectors, the lens configuration, focal length, and position. The following factors significantly affected the optical throughput: LED viewing angle, lens position, and lens focal length. Several types of configurations were evaluated, and an optimized lens and LED position were determined. Initial optimization results indicate that a 10% optical transmission can be achieved for either a 16 or 32 wavelength system. Future work will include continuing to optimize the ray trace model, prototyping, and experimental testing of the optimized configuration.

Optimization of Light Transmission through an Excitation-scan Hyperspectral Mirror Array System

Hyperspectral imaging has numerous applications in a range of fields for target detection. While its original applications were in remote sensing, new uses include analyzing food quality, agriculture and medicine, Hyperspectral imaging has shown utility in fluorescence microscopy for detecting signatures from many fluorescent molecules, but acquisition speeds have been slow due to the need to acquire many spectral bands and the light losses associated with spectral filtering. Therefore, a novel confocal microscope, the 5-Dimensional Rapid Hyperspectral Imaging Platform (RHIP-5D) was designed and is undergoing testing to overcome acquisition speed and sensitivity limitations. The current design utilizes light-emitting diodes (LEDs) and a multifaceted mirror array to combine light sources into a liquid light guide. Initial tests demonstrated feasibility and we are now working on determining the ideal location of the liquid light guide, LEDs, lenses and mirror array to optimize optical transmission. A computational model was constructed using Monte Carlo optical ray tracing in TracePro software (Lambda Research Corp.). LED sources were simulated by importing irradiance properties from the manufacturers' specifications. Optical properties of lenses were modeled using lens files available from the manufacturer. Analysis of the model includes geometry and parametric optimization, assessing lens power, mirror angles and location of optical elements. Initial results show an increase of transmission is possible by up to 20%. Future work will involve evaluating the position of the liquid light guide as well as analyzing lens configurations to further increase optical transmission.

Identifying molecular contributors to autofluorescence of neoplastic and normal colon sections using excitation-scanning hyperspectral imaging

Autofluorescence, the endogenous fluorescence present in cells and tissues, has historically been considered a nuisance in biomedical imaging. Many endogenous fluorophores, specifically, collagen, elastin, nicotinamide adenine dinucleotide, and flavin adenine dinucleotide (FAD), are found throughout the human body. In fluorescence imaging scenarios, these signals can be prohibitive as they can outcompete signals introduced for diagnostic purposes. However, autofluorescence also contains information that has diagnostic value. Recent advances in hyperspectral imaging have allowed the acquisition of significantly more data in a shorter time period by scanning the excitation spectra of fluorophores. The reduced acquisition time and increased signal-to-noise ratio allow for separation of significantly more fluorophores than previously possible. We propose to utilize excitation-scanning hyperspectral imaging of autofluorescence to differentiate neoplastic lesions from surrounding non-neoplastic "normal" tissue. The spectra of isolated autofluorescent molecules are obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with an Xe arc lamp and thin-film tunable filter array (VersaChrome, Semrock, Inc.). Scans utilize excitation wavelengths from 360 to 550 nm in 5-nm increments. The resultant molecule-specific spectra are used to analyze hyperspectral image stacks from normal and neoplastic colorectal tissues. Due to a limited number of samples, neoplastic tissues examined here are a pool of both colorectal adenocarcinoma and adenomatous polyps. The hyperspectral images are analyzed with ENVI software and custom MATLAB scripts, including linear spectral unmixing. Initial results indicate the ability to separate signals of endogenous fluorophores and measure the relative concentrations of fluorophores among healthy and diseased states, in this case, normal colon versus neoplastic colon. These results suggest pathology-specific changes to endogenous fluorophores can be detected using excitation-scanning hyperspectral imaging. Future work will focus on expanding the library of pure molecules, exploring histogram distance metrics as a means for identifying deviations in spectral signatures, and examining more defined disease states.

Demystifying autofluorescence with excitation-scanning hyperspectral imaging

Autofluorescence has historically been considered a nuisance in medical imaging. Many endogenous fluorophores, specifically, collagen, elastin, NADH, and FAD, are found throughout the human body. Diagnostically, these signals can be prohibitive since they can outcompete signals introduced for diagnostic purposes. Recent advances in hyperspectral imaging have allowed the acquisition of significantly more data in a shorter time period by scanning the excitation spectra of fluorophores. The reduced acquisition time and increased signal-to-noise ratio allow for separation of significantly more fluorophores than previously possible. Here, we propose to utilize excitation-scanning of autofluorescence to examine tissues and diagnose pathologies. Spectra of autofluorescent molecules were obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with a Xe arc lamp and thin film tunable filter array (VersaChrome, Semrock, Inc.) Scans utilized excitation wavelengths from 360 nm to 550 nm in 5 nm increments. The resultant spectra were used to examine hyperspectral image stacks from various collaborative studies, including an atherosclerotic rat model and a colon cancer study. Hyperspectral images were analyzed with ENVI and custom Matlab scripts including linear spectral unmixing (LSU) and principal component analysis (PCA). Initial results suggest the ability to separate the signals of endogenous fluorophores and measure the relative concentrations of fluorophores among healthy and diseased states of similar tissues. These results suggest pathology-specific changes to endogenous fluorophores can be detected using excitation-scanning hyperspectral imaging. Future work will expand the library of pure molecules and will examine more defined disease states.

Endoscopic hyperspectral imaging: light guide optimization for spectral light source

Hyperspectral imaging (HSI) is a technology used in remote sensing, food processing and documentation recovery. Recently, this approach has been applied in the medical field to spectrally interrogate regions of interest within respective substrates. In spectral imaging, a two (spatial) dimensional image is collected, at many different (spectral) wavelengths, to sample spectral signatures from different regions and/or components within a sample. Here, we report on the use of hyperspectral imaging for endoscopic applications. Colorectal cancer is the 3rd leading cancer for incidences and deaths in the US. One factor of severity is the miss rate of precancerous/flat lesions (~65% accuracy). Integrating HSI into colonoscopy procedures could minimize misdiagnosis and unnecessary resections. We have previously reported a working prototype light source with 16 high-powered light emitting diodes (LEDs) capable of high speed cycling and imaging. In recent testing, we have found our current prototype is limited by transmission loss (~99%) through the multi-furcated solid light guide (lightpipe) and the desired framerate (20-30 fps) could not be achieved. Here, we report on a series of experimental and modeling studies to better optimize the lightpipe and the spectral endoscopy system as a whole. The lightpipe was experimentally evaluated using an integrating sphere and spectrometer (Ocean Optics). Modeling the lightpipe was performed using Monte Carlo optical ray tracing in TracePro (Lambda Research Corp.). Results of these optimization studies will aid in manufacturing a revised prototype with the newly designed light guide and increased sensitivity. Once the desired optical output (5-10 mW) is achieved then the HIS endoscope system will be able to be implemented without adding onto the procedure time.

Applications and assessment of an excitation-scanning hyperspectral imaging system

The majority of microscopic and endoscopic technologies utilize white light illumination. For a number of applications, hyper-spectral imaging can be shown to have significant improvements over standard white-light imaging techniques. This is true for both microscopy and in vivo imaging. However, hyperspectral imaging methods have suffered from slow application times. Often, minutes are required to gather a full imaging stack. Here we will describe and evaluate a novel excitation-scanning hyperspectral imaging system and discuss some applications. We have developed and are optimizing a novel approach called excitation-scanning hyperspectral imaging that provides an order of magnitude increased signal strength. This excitation scanning technique has enabled us to produce a microscopy system capable of high speed hyperspectral imaging with the potential for live video acquisition. The excitation-scanning hyperspectral imaging technology we developed may impact a range of applications. The current design uses digital strobing to illuminate at 16 wavelengths with millisecond image acquisition time. Analog intensity control enables a fully customizable excitation profile. A significant advantage of excitation-scanning hyperspectral imaging is can identify multiple targets simultaneously in real time. Finally, we are exploring utilizing this technology for a variety of applications ranging from measuring cAMP distribution in three dimensions within a cell to electrophysiology.

Colorectal cancer detection by hyperspectral imaging using fluorescence excitation scanning

Hyperspectral imaging technologies have shown great promise for biomedical applications. These techniques have been especially useful for detection of molecular events and characterization of cell, tissue, and biomaterial composition. Unfortunately, hyperspectral imaging technologies have been slow to translate to clinical devices - likely due to increased cost and complexity of the technology as well as long acquisition times often required to sample a spectral image. We have demonstrated that hyperspectral imaging approaches which scan the fluorescence excitation spectrum can provide increased signal strength and faster imaging, compared to traditional emission-scanning approaches. We have also demonstrated that excitation-scanning approaches may be able to detect spectral differences between colonic adenomas and adenocarcinomas and normal mucosa in flash-frozen tissues. Here, we report feasibility results from using excitation-scanning hyperspectral imaging to screen pairs of fresh tumoral and nontumoral colorectal tissues. Tissues were imaged using a novel hyperspectral imaging fluorescence excitation scanning microscope, sampling a wavelength range of 360-550 nm, at 5 nm increments. Image data were corrected to achieve a NIST-traceable flat spectral response. Image data were then analyzed using a range of supervised and unsupervised classification approaches within ENVI software (Harris Geospatial Solutions). Supervised classification resulted in >99% accuracy for single-patient image data, but only 64% accuracy for multi-patient classification (n=9 to date), with the drop in accuracy due to increased false-positive detection rates. Hence, initial data indicate that this approach may be a viable detection approach, but that larger patient sample sizes need to be evaluated and the effects of inter-patient variability studied.

Wide-field spectrally resolved quantitative fluorescence imaging system: toward neurosurgical guidance in glioma resection

In high-grade glioma surgery, tumor resection is often guided by intraoperative fluorescence imaging. 5-aminolevulinic acid-induced protoporphyrin IX (PpIX) provides fluorescent contrast between normal brain tissue and glioma tissue, thus achieving improved tumor delineation and prolonged patient survival compared with conventional white-light-guided resection. However, commercially available fluorescence imaging systems rely solely on visual assessment of fluorescence patterns by the surgeon, which makes the resection more subjective than necessary. We developed a wide-field spectrally resolved fluorescence imaging system utilizing a Generation II scientific CMOS camera and an improved computational model for the precise reconstruction of the PpIX concentration map. In our model, the tissue's optical properties and illumination geometry, which distort the fluorescent emission spectra, are considered. We demonstrate that the CMOS-based system can detect low PpIX concentration at short camera exposure times, while providing high-pixel resolution wide-field images. We show that total variation regularization improves the contrast-to-noise ratio of the reconstructed quantitative concentration map by approximately twofold. Quantitative comparison between the estimated PpIX concentration and tumor histopathology was also investigated to further evaluate the system.

Hyperspectral imaging acousto-optic system with spatial filtering for optical phase visualization

We report a method for phase visualization in the images of transparent specimens using analog image processing in incoherent light. The experimental technique is based on adaptive bandpass spatial filtering with an amplitude mask matched with an acousto-optic tunable filter in a telecentric optical system. We demonstrate the processing of microscopic images of unstained and stained histological sections of human thyroid tumor with improved contrast.

Excitation-Scanning Hyperspectral Imaging as a Means to Discriminate Various Tissues Types

Little is currently known about the fluorescence excitation spectra of disparate tissues and how these spectra change with pathological state. Current imaging diagnostic techniques have limited capacity to investigate fluorescence excitation spectral characteristics. This study utilized excitation-scanning hyperspectral imaging to perform a comprehensive assessment of fluorescence spectral signatures of various tissues. Immediately following tissue harvest, a custom inverted microscope (TE-2000, Nikon Instruments) with Xe arc lamp and thin film tunable filter array (VersaChrome, Semrock, Inc.) were used to acquire hyperspectral image data from each sample. Scans utilized excitation wavelengths from 340 nm to 550 nm in 5 nm increments. Hyperspectral images were analyzed with custom Matlab scripts including linear spectral unmixing (LSU), principal component analysis (PCA), and Gaussian mixture modeling (GMM). Spectra were examined for potential characteristic features such as consistent intensity peaks at specific wavelengths or intensity ratios among significant wavelengths. The resultant spectral features were conserved among tissues of similar molecular composition. Additionally, excitation spectra appear to be a mixture of pure endmembers with commonalities across tissues of varied molecular composition, potentially identifiable through GMM. These results suggest the presence of common autofluorescent molecules in most tissues and that excitation-scanning hyperspectral imaging may serve as an approach for characterizing tissue composition as well as pathologic state. Future work will test the feasibility of excitation-scanning hyperspectral imaging as a contrast mode for discriminating normal and pathological tissues.

Optimization and applications of an excitation-scanning hyperspectral imaging system

Currently, the majority of microscopic and endoscopic technologies utilize white light illumination. For a number of applications, hyper-spectral imaging can be shown to have significant improvements over standard white-light imaging techniques. This is true for both microscopy and in vivo imaging. However, hyperspectral imaging methods have suffered from slow application times. Often, minutes are required to gather a full imaging stack. Here we will describe the system and evaluate optimizations and applications of a novel excitation-scanning hyperspectral imaging system. We have developed and are optimizing a novel approach called excitation-scanning hyperspectral imaging that provides an order of magnitude increased signal strength. Optimization of the light path, optical components and illumination sources have allowed us to achieve high speed image acquisition. This high speed allows for potential live video acquisition. This excitation-scanning hyperspectral imaging technology has potential to impact a range of applications. The current system allows triggering of up to 16 wavelengths at less than 1 millisecond per image using digital strobing. Analog intensity control is also provided for a fully customizable excitation profile. A significant advantage of excitation-scanning hyperspectral imaging is can identify multiple targets simultaneously in real time. We are optimizing the system to compare sensitivity and specificity of excitation-scanning hyperspectral imaging with pathology techniques. Finally, we are exploring utilizing this technology to measure cAMP distribution in three dimensions within a cell.

Comparing Methods for Analysis of Biomedical Hyperspectral Image Data

Over the past 2 decades, hyperspectral imaging technologies have been adapted to address the need for molecule-specific identification in the biomedical imaging field. Applications have ranged from single-cell microscopy to whole-animal in vivo imaging and from basic research to clinical systems. Enabling this growth has been the availability of faster, more effective hyperspectral filtering technologies and more sensitive detectors. Hence, the potential for growth of biomedical hyperspectral imaging is high, and many hyperspectral imaging options are already commercially available. However, despite the growth in hyperspectral technologies for biomedical imaging, little work has been done to aid users of hyperspectral imaging instmments in selecting appropriate analysis algorithms. Here, we present an approach for comparing the effectiveness of spectral analysis algorithms by combining experimental image data with a theoretical "what if' scenario. This approach allows us to quantify several key outcomes that characterize a hyperspectral imaging study: linearity of sensitivity, positive detection cut-off slope, dynamic range, and false positive events. We present results of using this approach for comparing the effectiveness of several common spectral analysis algorithms for detecting weak fluorescent protein emission in the midst of strong tissue autofluorescence. Results indicate that this approach should be applicable to a very wide range of applications, allowing a quantitative assessment of the effectiveness of the combined biology, hardware, and computational analysis for detecting a specific molecular signature.

Design of a modified endoscope illuminator for spectral imaging of colorectal tissues

The gold standard for locating colonic polyps is a white light endoscope in a colonoscopy, however, polyps smaller than 5 mm can be easily missed. Modified procedures such as narrow band imaging have shown only marginal increases in detection rates. Spectral imaging is a potential solution to improve the sensitivity and specificity of colonoscopies by providing the ability to distinguish molecular fluorescence differences in tissues. The goal of this work is to implement a spectral endoscopic light source to acquire spectral image data of colorectal tissues. A beta-version endoscope light source was developed, by retrofitting a white light endoscope light source (Olympus, CLK-4) with 16 narrow band LEDs. This redesigned, beta-prototype uses high-power LEDs with a minimum output of 500 mW to provide sufficient spectral output (0.5 mW) through the endoscope. A mounting apparatus was designed to provide sufficient heat dissipation. Here, we report recent results of our tests to characterize the intensity output through the light source and endoscope to determine the flat spectral output for imaging and intensity losses through the endoscope. We also report preliminary spectral imaging data from transverse pig colon that demonstrates the ability to result in working practical spectral data. Preliminary results of this revised prototype spectral endoscope system demonstrate that there is sufficient power to allow the imaging process to continue and potentially determine spectral differences in cancerous and normal tissue from imaging ex vivo pairs. Future work will focus on building a spectral library for the colorectal region and refining the user interface the system for in vivo use.

Hyperspectral imaging fluorescence excitation scanning for colon cancer detection

Optical spectroscopy and hyperspectral imaging have shown the potential to discriminate between cancerous and noncancerous tissue with high sensitivity and specificity. However, to date, these techniques have not been effectively translated to real-time endoscope platforms. Hyperspectral imaging of the fluorescence excitation spectrum represents new technology that may be well suited for endoscopic implementation. However, the feasibility of detecting differences between normal and cancerous mucosa using fluorescence excitation-scanning hyperspectral imaging has not been evaluated. The goal of this study was to evaluate the initial feasibility of using fluorescence excitation-scanning hyperspectral imaging for measuring changes in fluorescence excitation spectrum concurrent with colonic adenocarcinoma using a small pre-pilot-scale sample size. Ex vivo analysis was performed using resected pairs of colorectal adenocarcinoma and normal mucosa. Adenocarcinoma was confirmed by histologic evaluation of hematoxylin and eosin (H&E) permanent sections. Specimens were imaged using a custom hyperspectral imaging fluorescence excitation-scanning microscope system. Results demonstrated consistent spectral differences between normal and cancerous tissues over the fluorescence excitation range of 390 to 450 nm that could be the basis for wavelength-dependent detection of colorectal cancers. Hence, excitation-scanning hyperspectral imaging may offer an alternative approach for discriminating adenocarcinoma from surrounding normal colonic mucosa, but further studies will be required to evaluate the accuracy of this approach using a larger patient cohort.

Hyperspectral multiplex single-particle tracking of different receptor subtypes labeled with quantum dots in live neurons

The efficacy of existing therapies and the discovery of innovative treatments for central nervous system (CNS) diseases have been limited by the lack of appropriate methods to investigate complex molecular processes at the synaptic level. To improve our capability to investigate complex mechanisms of synaptic signaling and remodeling, we designed a fluorescence hyperspectral imaging platform to simultaneously track different subtypes of individual neurotransmitter receptors trafficking in and out of synapses. This imaging platform allows simultaneous image acquisition of at least five fluorescent markers in living neurons with a high-spatial resolution. We used quantum dots emitting at different wavelengths and functionalized to specifically bind to single receptors on the membrane of living neurons. The hyperspectral imaging platform enabled the simultaneous optical tracking of five different synaptic proteins, including subtypes of glutamate receptors (mGluR and AMPAR) and postsynaptic signaling proteins. It also permitted the quantification of their mobility after treatments with various pharmacological agents. This technique provides an efficient method to monitor several synaptic proteins at the same time, which could accelerate the screening of effective compounds for treatment of CNS disorders.

LED-based endoscopic light source for spectral imaging

Colorectal cancer is the United States 3rd leading cancer in death rates.1 The current screening for colorectal cancer is an endoscopic procedure using white light endoscopy (WLE). There are multiple new methods testing to replace WLE, for example narrow band imaging and autofluorescence imaging.2 However, these methods do not meet the need for a higher specificity or sensitivity. The goal for this project is to modify the presently used endoscope light source to house 16 narrow wavelength LEDs for spectral imaging in real time while increasing sensitivity and specificity. The process to do such was to take an Olympus CLK-4 light source, replace the light and electronics with 16 LEDs and new circuitry. This allows control of the power and intensity of the LEDs. This required a larger enclosure to house a bracket system for the solid light guide (lightpipe), three new circuit boards, a power source and National Instruments hardware/software for computer control. The results were a successfully designed retrofit with all the new features. The LED testing resulted in the ability to control each wavelength's intensity. The measured intensity over the voltage range will provide the information needed to couple the camera for imaging. Overall the project was successful; the modifications to the light source added the controllable LEDs. This brings the research one step closer to the main goal of spectral imaging for early detection of colorectal cancer. Future goals will be to connect the camera and test the imaging process.

Feasibility for detection of autofluorescent signatures in rat organs using a novel excitation-scanning hyperspectral imaging system

The natural fluorescence (autofluorescence) of tissues has been noted as a biomarker for cancer for several decades. Autofluorescence contrast between tumors and healthy tissues has been of significant interest in endoscopy, leading to development of autofluorescence endoscopes capable of visualizing 2-3 fluorescence emission wavelengths to achieve maximal contrast. However, tumor detection with autofluorescence endoscopes is hindered by low fluorescence signal and limited quantitative information, resulting in prolonged endoscopic procedures, prohibitive acquisition times, and reduced specificity of detection. Our lab has designed a novel excitation-scanning hyperspectral imaging system with high fluorescence signal detection, low acquisition time, and enhanced spectral discrimination. In this study, we surveyed a comprehensive set of excised tissues to assess the feasibility of detecting tissue-specific pathologies using excitation-scanning. Fresh, untreated tissue specimens were imaged from 360 to 550 nm on an inverted fluorescence microscope equipped with a set of thin-film tunable filters (Semrock, A Unit of IDEX). Images were subdivided into training and test sets. Automated endmember extraction (ENVI 5.1, Exelis) with PCA identified endmembers within training images of autofluorescence. A spectral library was created from 9 endmembers. The library was used for identification of endmembers in test images. Our results suggest (1) spectral differentiation of multiple tissue types is possible using excitation scanning; (2) shared spectra between tissue types; and (3) the ability to identify unique morphological features in disparate tissues from shared autofluorescent components. Future work will focus on isolating specific molecular signatures present in tissue spectra, and elucidating the contribution of these signatures in pathologies.

Excitation-Scanning Hyperspectral Imaging System for Microscopic and Endoscopic Applications

Current microscopic and endoscopic technologies for cancer screening utilize white-light illumination sources. Hyper-spectral imaging has been shown to improve sensitivity while retaining specificity when compared to white-light imaging in both microscopy and in vivo imaging.1,2 However, hyperspectral imaging methods have historically suffered from slow acquisition times due to the narrow bandwidth of spectral filters. Often minutes are required to gather a full image stack. We have developed a novel approach called excitation-scanning hyperspectral imaging that provides 2-3 orders of magnitude increased signal strength. This reduces acquisition times significantly, allowing for live video acquisition. Here, we describe a preliminary prototype excitation-scanning hyperspectral imaging system that can be coupled with endoscopes or microscopes for hyperspectral imaging of tissues and cells. Our system is comprised of three subsystems: illumination, transmission, and imaging. The illumination subsystem employs light-emitting diode arrays to illuminate at different wavelengths. The transmission subsystem utilizes a unique geometry of optics and a liquid light guide. Software controls allow us to interface with and control the subsystems and components. Digital and analog signals are used to coordinate wavelength intensity, cycling and camera triggering. Testing of the system shows it can cycle 16 wavelengths at as fast as 1 ms per cycle. Additionally, more than 18% of the light transmits through the system. Our setup should allow for hyperspectral imaging of tissue and cells in real time.

Three dimensional measurement of cAMP gradients using hyperspectral confocal microscopy

Cyclic AMP (cAMP) is a ubiquitous second messenger known to differentially regulate many cellular functions over a wide range of timescales. Several lines of evidence have suggested that the distribution of cAMP within cells is not uniform, and that cAMP compartmentalization is largely responsible for signaling specificity within the cAMP signaling pathway. However, to date, no studies have experimentally measured three dimensional (3D) cAMP distributions within cells. Here we use both 2D and 3D hyperspectral microscopy to visualize cAMP gradients in endothelial cells from the pulmonary microvasculature (PMVECs). cAMP levels were measured using a FRET-based cAMP sensor comprised of a cAMP binding domain from EPAC sandwiched between FRET donors and acceptors - Turquoise and Venus fluorescent proteins. Data were acquired using either a Nikon A1R spectral confocal microscope or custom spectral microscopy system. Analysis of hyperspectral image stacks from a single confocal slice or from summed images of all slices (2D analysis) indicated little or no cAMP gradients were formed within PMVECs under basal conditions or following agonist treatment. However, analysis of hyperspectral image stacks from 3D cellular geometries (z stacks) demonstrate marked cAMP gradients from the apical to basolateral membrane of PMVECs. These results strongly suggest that 2D imaging studies of cAMP compartmentalization - whether epifluorescence or confocal microscopy - may lead to erroneous conclusions about the existence of cAMP gradients, and that 3D studies are required to assess mechanisms of signaling specificity.

Review of short-wave infrared spectroscopy and imaging methods for biological tissue characterization

We present a review of short-wave infrared (SWIR, defined here as ∼1000 to 2000 nm) spectroscopy and imaging techniques for biological tissue optical property characterization. Studies indicate notable SWIR absorption features of tissue constituents including water (near 1150, 1450, and 1900 nm), lipids (near 1040, 1200, 1400, and 1700 nm), and collagen (near 1200 and 1500 nm) that are much more prominent than corresponding features observed in the visible and near-infrared (VIS-NIR, defined here as ∼400 to 1000 nm). Furthermore, the wavelength dependence of the scattering coefficient has been observed to follow a power-law decay from the VIS-NIR to the SWIR region. Thus, the magnitude of tissue scattering is lower at SWIR wavelengths than that observed at VIS or NIR wavelengths, potentially enabling increased penetration depth of incident light at SWIR wavelengths that are not highly absorbed by the aforementioned chromophores. These aspects of SWIR suggest that the tissue spectroscopy and imaging in this range of wavelengths have the potential to provide enhanced sensitivity (relative to VIS-NIR measurements) to chromophores such as water and lipids, thereby helping to characterize changes in the concentrations of these chromophores due to conditions such as atherosclerotic plaque, breast cancer, and burns.

Review of quantitative phase-digital holographic microscopy: promising novel imaging technique to resolve neuronal network activity and identify cellular biomarkers of psychiatric disorders

Quantitative phase microscopy (QPM) has recently emerged as a new powerful quantitative imaging technique well suited to noninvasively explore a transparent specimen with a nanometric axial sensitivity. In this review, we expose the recent developments of quantitative phase-digital holographic microscopy (QP-DHM). Quantitative phase-digital holographic microscopy (QP-DHM) represents an important and efficient quantitative phase method to explore cell structure and dynamics. In a second part, the most relevant QPM applications in the field of cell biology are summarized. A particular emphasis is placed on the original biological information, which can be derived from the quantitative phase signal. In a third part, recent applications obtained, with QP-DHM in the field of cellular neuroscience, namely the possibility to optically resolve neuronal network activity and spine dynamics, are presented. Furthermore, potential applications of QPM related to psychiatry through the identification of new and original cell biomarkers that, when combined with a range of other biomarkers, could significantly contribute to the determination of high risk developmental trajectories for psychiatric disorders, are discussed.

Excitation-scanning hyperspectral imaging microscope

Hyperspectral imaging is a versatile tool that has recently been applied to a variety of biomedical applications, notably live-cell and whole-tissue signaling. Traditional hyperspectral imaging approaches filter the fluorescence emission over a broad wavelength range while exciting at a single band. However, these emission-scanning approaches have shown reduced sensitivity due to light attenuation from spectral filtering. Consequently, emission scanning has limited applicability for time-sensitive studies and photosensitive applications. In this work, we have developed an excitation-scanning hyperspectral imaging microscope that overcomes these limitations by providing high transmission with short acquisition times. This is achieved by filtering the fluorescence excitation rather than the emission. We tested the efficacy of the excitation-scanning microscope in a side-by-side comparison with emission scanning for detection of green fluorescent protein (GFP)-expressing endothelial cells in highly autofluorescent lung tissue. Excitation scanning provided higher signal-to-noise characteristics, as well as shorter acquisition times (300  ms/wavelength band with excitation scanning versus 3  s/wavelength band with emission scanning). Excitation scanning also provided higher delineation of nuclear and cell borders, and increased identification of GFP regions in highly autofluorescent tissue. These results demonstrate excitation scanning has utility in a wide range of time-dependent and photosensitive applications.

Pulse splitter-based nonlinear microscopy for live-cardiomyocyte imaging

Second harmonic generation (SHG) microscopy is a new imaging technique used in sarcomeric-addition studies. However, during the early stage of cell culture in which sarcomeric additions occur, the neonatal cardiomyocytes that we have been working with are very sensitive to photodamage, the resulting high rate of cell death prevents systematic study of sarcomeric addition using a conventional SHG system. To address this challenge, we introduced use of the pulse-splitter system developed by Na Ji et al. in our two photon excitation fluorescence (TPEF) and SHG hybrid microscope. The system dramatically reduced photodamage to neonatal cardiomyocytes in early stages of culture, greatly increasing cell viability. Thus continuous imaging of live cardiomyocytes was achieved with a stronger laser and for a longer period than has been reported in the literature. The pulse splitter-based TPEF-SHG microscope constructed in this study was demonstrated to be an ideal imaging system for sarcomeric addition-related investigations of neonatal cardiomyocytes in early stages of culture.

Characterization, comparison, and choice of a commercial double-clad fiber for nonlinear endomicroscopy

Several endomicroscope prototypes for nonlinear optical imaging were developed in the last decade for in situ analysis of tissue with cellular resolution by using short infrared light pulses. Fourier-transform-limited pulses at the tissue site are necessary for optimal excitation of faint endogenous signals. However, obtaining these transform-limited short pulses remains a challenge, and previously proposed devices did not achieve an optimal pulse delivery. We present a study of fibered endomicroscope architecture with an efficient femtosecond pulse delivery and a high excitation level at the output of commercially available double-clad fibers (DCFs). The endomicroscope incorporates a module based on a grism line to compensate for linear and nonlinear effects inside the system. Simulations and experimental results are presented and compared to the literature. Experimentally, we obtained short pulses down to 24 fs at the fiber output, what represents to the best of our knowledge the shortest pulse duration ever obtained at the output of a nonlinear endoscopic system without postcompression. The choice of the optimal DCF among four possible commercial components is discussed and evaluated in regard to multiphoton excitation and fluorescence emission.

Thin-film tunable filters for hyperspectral fluorescence microscopy

Hyperspectral imaging is a powerful tool that acquires data from many spectral bands, forming a contiguous spectrum. Hyperspectral imaging was originally developed for remote sensing applications; however, hyperspectral techniques have since been applied to biological fluorescence imaging applications, such as fluorescence microscopy and small animal fluorescence imaging. The spectral filtering method largely determines the sensitivity and specificity of any hyperspectral imaging system. There are several types of spectral filtering hardware available for microscopy systems, most commonly acousto-optic tunable filters (AOTFs) and liquid crystal tunable filters (LCTFs). These filtering technologies have advantages and disadvantages. Here, we present a novel tunable filter for hyperspectral imaging-the thin-film tunable filter (TFTF). The TFTF presents several advantages over AOTFs and LCTFs, most notably, a high percentage transmission and a high out-of-band optical density (OD). We present a comparison of a TFTF-based hyperspectral microscopy system and a commercially available AOTF-based system. We have characterized the light transmission, wavelength calibration, and OD of both systems, and have then evaluated the capability of each system for discriminating between green fluorescent protein and highly autofluorescent lung tissue. Our results suggest that TFTFs are an alternative approach for hyperspectral filtering that offers improved transmission and out-of-band blocking. These characteristics make TFTFs well suited for other biomedical imaging devices, such as ophthalmoscopes or endoscopes.

Compact high power barium nitrite crystal-based Raman laser at 1197 nm for photoacoustic imaging of fat

Photoacoustic imaging employing molecular overtone vibration as a contrast mechanism opens a new avenue for bond-selective imaging of deep tissues. Broad use of this modality is, however, hampered by the extremely low conversion efficiency of optical parametric oscillators at the overtone transition wavelengths. To overcome such a barrier, we demonstrate the construction and use of a compact, barium nitrite crystal-based Raman laser for photoacoustic imaging of C-H overtone vibrations. Using a 5-ns Nd∶YAG laser as the pumping source, up to 21.4 mJ pulse energy at 1197 nm was generated, corresponding to a conversion efficiency of 34.8%. Using the 1197 nm pulses, three-dimensional photoacoustic imaging of intramuscular fat was demonstrated.

Mapping lipid and collagen by multispectral photoacoustic imaging of chemical bond vibration

Photoacoustic microscopy using vibrational overtone absorption as a contrast mechanism allows bond-selective imaging of deep tissues. Due to the spectral similarity of molecules in the region of overtone vibration, it is difficult to interrogate chemical components using photoacoustic signal at single excitation wavelength. Here we demonstrate that lipids and collagen, two critical markers for many kinds of diseases, can be distinguished by multispectral photoacoustic imaging of the first overtone of C-H bond. A phantom consisting of rat-tail tendon and fat was constructed to demonstrate this technique. Wavelengths between 1650 and 1850 nm were scanned to excite both the first overtone and combination bands of C-H bonds. B-scan multispectral photoacoustic images, in which each pixel contains a spectrum, were analyzed by a multivariate curve resolution-alternating least squares algorithm to recover the spatial distribution of collagen and lipids in the phantom.