High speed functional imaging with source localized multifocal two-photon microscopy

Multifocal two-photon microscopy (MTPM) increases imaging speed over single-focus scanning by parallelizing fluorescence excitation. The imaged fluorescence's susceptibility to crosstalk, however, severely degrades contrast in scattering tissue. Here we present a source-localized MTPM scheme optimized for high speed functional fluorescence imaging in scattering mammalian brain tissue. A rastered line array of beamlets excites fluorescence imaged with a complementary metal-oxide-semiconductor (CMOS) camera. We mitigate scattering-induced crosstalk by temporally oversampling the rastered image, generating grouped images with structured illumination, and applying Richardson-Lucy deconvolution to reassign scattered photons. Single images are then retrieved with a maximum intensity projection through the deconvolved image groups. This method increased image contrast at depths up to 112 μm in scattering brain tissue and reduced functional crosstalk between pixels during neuronal calcium imaging. Source-localization did not affect signal-to-noise ratio (SNR) in densely labeled tissue under our experimental conditions. SNR decreased at low frame rates in sparsely labeled tissue, with no effect at frame rates above 50 Hz. Our non-descanned source-localized MTPM system enables high SNR, 100 Hz capture of fluorescence transients in scattering brain, increasing the scope of MTPM to faster and smaller functional signals.

Hyperspectral imaging in highly scattering media by the spectral phasor approach using two filters

Hyperspectral imaging is a common technique in fluorescence microscopy to obtain the emission spectrum at each pixel of an image. However, methods to obtain spectral resolution based on diffraction gratings or integrated prisms work poorly when the sample is strongly scattering. We developed a microscope named the DIVER that collects the fluorescence emission over a very large angle. Since the fluorescence light after passing through the multiple scattering sample is not collimated, the use of grating or prisms strongly limits the amount of light that can be used with available hyperspectral devices. Here we show that 2 filters that accept uncollimated light over a large aperture are sufficient to calculate the spectral phasor rather than displaying the entire spectrum. Using the properties of the spectral phasors, we can resolve spectral components and perform the type of data analyses that are usually performed in hyperspectral image analysis.

On-chip light-sheet fluorescence imaging flow cytometry at a high flow speed of 1 m/s

We present on-chip fluorescence imaging flow cytometry by light-sheet excitation on a mirror-embedded microfluidic chip. The method allows us to obtain microscopy-grade fluorescence images of cells flowing at a high speed of 1 m/s, which is comparable to the flow speed of conventional non-imaging flow cytometers. To implement the light-sheet excitation of flowing cells in a microchannel, we designed and fabricated a mirror-embedded PDMS-based microfluidic chip. To show its broad utility, we used the method to classify large populations of microalgal cells (Euglena gracilis) and human cancer cells (human adenocarcinoma cells). Our method holds promise for large-scale single-cell analysis.

Erratum: Methods for detecting host genetic modifiers of tumor vascular function using dynamic near-infrared fluorescence imaging: errata

[This corrects the article on p. 543 in vol. 9, PMID: 29552392.].

Blood vessel detection, localization and estimation using a smart laparoscopic grasper: a Monte Carlo study

For centuries, surgeons have relied on their sense of touch to identify vital structures such as blood vessels in traditional open surgery. Over the past two decades, surgeons have shifted to minimally invasive surgical (MIS) approaches, including laparoscopic surgery, which include benefits such as less scarring, less risk for infection, and quicker recovery times. In fact, some surgeries such as cholecystectomies have seen more than an 80% adoption of this technique because of those benefits. However, due to the fundamental challenges associated with using laparoscopic surgery, there has been a lower adoption in more complex specialties, such as colorectal and thoracic surgery, where the field of surgery has bleeding, fat, scar tissue, and adhesions. These problems are exacerbated by complicating factors such as inflammation, cancer, chronic disease, obesity, and re-operations. Importantly, surgeons will often convert from laparoscopy to open surgery if they can no longer proceed using the minimally invasive approach because of issues described with these complicating factors, thereby negating the benefits that the patient would have seen. When the surgeon does attempt these procedures with those issues, the surgery takes on average 30 min - 1 hour longer. A new method by which surgeons can visualize structures like blood vessels could reduce the conversion rates and operating time, thereby driving a greater adoption of laparoscopic surgery in these complex procedures. Here, we show that by adding near infrared (NIR) LEDs and a linear image sensor onto the opposing jaws of the laparoscopic graspers, blood vessels that are embedded within tissues can be detected and localized efficiently, even those not visible using current imaging techniques. We show the results of Monte Carlo simulations to support our claim, including that blood vessels ranging from 2 to 6 mm and buried under up to 1 cm of tissue can be detected. We also report developing a smart grasper handheld prototype to run ex vivo experiments. The results of these experiments matched with those of the Monte Carlo simulations and the estimated blood vessel size showed a strong correlation with the actual size. This technology will be incorporated into already existing laparoscopic tools to assist surgeons during MIS procedures.

Ultrasound-mediation of self-illuminating reporters improves imaging resolution in optically scattering media

In vivo imaging of self-illuminating bio-and chemiluminescent reporters is used to observe the physiology of small animals. However, strong light scattering by biological tissues results in poor spatial resolution of the optical imaging, which also degrades the quantitative accuracy. To overcome this challenging problem, focused ultrasound is used to modulate the light from the reporter at the ultrasound frequency. This produces an ultrasound switchable light 'beacon' that reduces the influence of light scattering in order to improve spatial resolution. The experimental results demonstrate that apart from light modulation at the ultrasound frequency (AC signal at 3.5 MHz), ultrasound also increases the DC intensity of the reporters. This is shown to be due to a temperature rise caused by insonification that was minimized to be within acceptable mammalian tissue safety thresholds by adjusting the duty cycle of the ultrasound. Line scans of bio-and chemiluminescent objects embedded within a scattering medium were obtained using ultrasound modulated (AC) and ultrasound enhanced (DC) signals. Lateral resolution is improved by a factor of 12 and 7 respectively, as compared to conventional CCD imaging. Two chemiluminescent sources separated by ~10 mm at ~20 mm deep inside a 50 mm thick chicken breast have been successfully resolved with an average signal-to-noise ratio of approximately 8-10 dB.

50 Hz volumetric functional imaging with continuously adjustable depth of focus

Understanding how neural circuits control behavior requires monitoring a large population of neurons with high spatial resolution and volume rate. Here we report an axicon-based Bessel beam module with continuously adjustable depth of focus (CADoF), that turns frame rate into volume rate by extending the excitation focus in the axial direction while maintaining high lateral resolutions. Cost-effective and compact, this CADoF Bessel module can be easily integrated into existing two-photon fluorescence microscopes. Simply translating one of the relay lenses along its optical axis enabled continuous adjustment of the axial length of the Bessel focus. We used this module to simultaneously monitor activity of spinal projection neurons extending over 60 µm depth in larval zebrafish at 50 Hz volume rate with adjustable axial extent of the imaged volume.

50 Hz volumetric functional imaging with continuously adjustable depth of focus

Understanding how neural circuits control behavior requires monitoring a large population of neurons with high spatial resolution and volume rate. Here we report an axicon-based Bessel beam module with continuously adjustable depth of focus (CADoF), that turns frame rate into volume rate by extending the excitation focus in the axial direction while maintaining high lateral resolutions. Cost-effective and compact, this CADoF Bessel module can be easily integrated into existing two-photon fluorescence microscopes. Simply translating one of the relay lenses along its optical axis enabled continuous adjustment of the axial length of the Bessel focus. We used this module to simultaneously monitor activity of spinal projection neurons extending over 60 µm depth in larval zebrafish at 50 Hz volume rate with adjustable axial extent of the imaged volume.

Novel endoscope with increased depth of field for imaging human nasal tissue by microscopic optical coherence tomography

Intravital microscopy (IVM) offers the opportunity to visualize static and dynamic changes of tissue on a cellular level. It is a valuable tool in research and may considerably improve clinical diagnosis. In contrast to confocal and non-linear microscopy, optical coherence tomography (OCT) with microscopic resolution (mOCT) provides intrinsically cross-sectional imaging. Changing focus position is not needed, which simplifies especially endoscopic imaging. For in-vivo imaging, here we are presenting endo-microscopic OCT (emOCT). A graded-index-lens (GRIN) based 2.75 mm outer diameter rigid endoscope is providing 1.5 - 2 µm nearly isotropic resolution over an extended field of depth. Spherical and chromatic aberrations are used to elongate the focus length. Simulation of the OCT image formation, suggests a better overall image quality in this range compared to a focused Gaussian beam. Total imaging depth at a reduced sensitivity and lateral resolution is more than 200 µm. Using a frame rate of 80 Hz cross-sectional images of concha nasalis were demonstrated in humans, which could resolve cilial motion, cellular structures of the epithelium, vessels and blood cells. Mucus transport velocity was successfully determined. The endoscope may be used for diagnosis and treatment control of different lung diseases like cystic fibrosis or primary ciliary dyskinesia, which manifest already at the nasal mucosa.

Fiber pattern removal and image reconstruction method for snapshot mosaic hyperspectral endoscopic images

Hyperspectral endoscopic imaging has the potential to enhance clinical diagnostics and outcome. Most commercial endoscopes utilize imaging fiber bundles to transmit the collected signal from the patient to the medical operator. These bundles consist of several fiber cores surrounded by a cladding layer creating comb structure-like artifacts, which complicate further analysis, both spatially and spectrally. Here we present an optical fiber pattern removal algorithm which we applied to hyperspectral bronchoscopic images robustly and quantitatively without the need for specific optical or electrical hardware. We validate the performance of the pattern removal by using a novel hyperspectral phasor approach. This algorithm can be generalized to all forms of fiber bundle hyperspectral endoscopy.

Methods for detecting host genetic modifiers of tumor vascular function using dynamic near-infrared fluorescence imaging

Vascular supply is a critical component of the tumor microenvironment (TME) and is essential for tumor growth and metastasis, yet the endogenous genetic modifiers that impact vascular function in the TME are largely unknown. To identify the host TME modifiers of tumor vascular function, we combined a novel genetic mapping strategy [Consomic Xenograft Model] with near-infrared (NIR) fluorescence imaging and multiparametric analysis of pharmacokinetic modeling. To detect vascular flow, an intensified cooled camera based dynamic NIR imaging system with 785 nm laser diode based excitation was used to image the whole-body fluorescence emission of intravenously injected indocyanine green dye. Principal component analysis was used to extract the spatial segmentation information for the lungs, liver, and tumor regions-of-interest. Vascular function was then quantified by pK modeling of the imaging data, which revealed significantly altered tissue perfusion and vascular permeability that were caused by host genetic modifiers in the TME. Collectively, these data demonstrate that NIR fluorescent imaging can be used as a non-invasive means for characterizing host TME modifiers of vascular function that have been linked with tumor risk, progression, and response to therapy.

Complex differential variance angiography with noise-bias correction for optical coherence tomography of the retina

Complex differential variance (CDV) provides phase-sensitive angiographic imaging for optical coherence tomography (OCT) with immunity to phase-instabilities of the imaging system and small-scale axial bulk motion. However, like all angiographic methods, measurement noise can result in erroneous indications of blood flow that confuse the interpretation of angiographic images. In this paper, a modified CDV algorithm that corrects for this noise-bias is presented. This is achieved by normalizing the CDV signal by analytically derived upper and lower limits. The noise-bias corrected CDV algorithm was implemented into an experimental 1 μm wavelength OCT system for retinal imaging that used an eye tracking scanner laser ophthalmoscope at 815 nm for compensation of lateral eye motions. The noise-bias correction improved the CDV imaging of the blood flow in tissue layers with a low signal-to-noise ratio and suppressed false indications of blood flow outside the tissue. In addition, the CDV signal normalization suppressed noise induced by galvanometer scanning errors and small-scale lateral motion. High quality cross-section and motion-corrected en face angiograms of the retina and choroid are presented.

Simultaneous acquisition of neuronal morphology and cytoarchitecture in the same Golgi-stained brain

Acquiring an accurate orientation reference is a prerequisite for precisely analysing the morphological features of Golgi-stained neurons in the whole brain. However, the same reflective imaging contrast of Golgi staining for morphology and Nissl staining for cytoarchitecture leads to the failure of distinguishing soma morphology and simultaneously co-locate cytoarchitecture. Here, we developed the dual-mode micro-optical sectioning tomography (dMOST) method to simultaneously image the reflective and fluorescent signals in three dimensions. We evaluated the feasibility of real-time fluorescent counterstaining on Golgi-stained brain tissue. With our system, we acquired whole-brain data sets of physiological and pathological Golgi-stained mouse model brains with fluorescence-labelled anatomical annotation at single-neuron resolution. We also obtained the neuronal morphology of macaque monkey brain tissue using this method. The results show that real-time acquisition of the co-located cytoarchitecture reference in the same brain greatly facilitates the precise morphological analysis of Golgi-stained neurons.

Optical mapping of brain activation during the English to Chinese and Chinese to English sight translation

Translating from Chinese into another language or vice versa is becoming a widespread phenomenon. However, current neuroimaging studies are insufficient to reveal the neural mechanism underlying translation asymmetry during Chinese/English sight translation. In this study, functional near infrared spectroscopy (fNIRS) was used to extract the brain activation patterns associated with Chinese/English sight translation. Eleven unbalanced Chinese (L1)/English (L2) bilinguals participated in this study based on an intra-group experimental design, in which two translation and two reading aloud tasks were administered: forward translation (from L1 to L2), backward translation (from L2 to L1), L1 reading, and L2 reading. As predicted, our findings revealed that forward translation elicited more pronounced brain activation in Broca's area, suggesting that neural correlates of translation vary according to the direction of translation. Additionally, significant brain activation in the left PFC was involved in backward translation, indicating the importance of this brain region during the translation process. The identical activation patterns could not be discovered in forward translation, indicating the cognitive processing of reading logographic languages (i.e. Chinese) might recruit incongruent brain regions.

Optical projection tomography for rapid whole mouse brain imaging

In recent years, three-dimensional mesoscopic imaging has gained significant importance in life sciences for fundamental studies at the whole-organ level. In this manuscript, we present an optical projection tomography (OPT) method designed for imaging of the intact mouse brain. The system features an isotropic resolution of ~50 µm and an acquisition time of four to eight minutes, using a 3-day optimized clearing protocol. Imaging of the brain autofluorescence in 3D reveals details of the neuroanatomy, while the use of fluorescent labels displays the vascular network and amyloid deposition in 5xFAD mice, an important model of Alzheimer's disease (AD). Finally, the OPT images are compared with histological slices.

In vivo real-time imaging of cutaneous hemoglobin concentration, oxygen saturation, scattering properties, melanin content, and epidermal thickness with visible spatially modulated light

We present the real-time single snapshot multiple frequency demodulation - spatial frequency domain imaging (SSMD-SFDI) platform implemented with a visible digital mirror device that is capable of imaging and monitoring dynamic turbid medium and processes over a large field of view. One challenge in quantitative imaging of biological tissue such as the skin is the complex structure rendering techniques based on homogeneous medium models to fail. To address this difficulty we have also developed a novel method that maps the layered structure to a homogeneous medium for spatial frequency domain imaging. The varying penetration depth of spatially modulated light on its wavelength and modulation frequency is used to resolve the layered structure. The efficacy of the real-time SSMD-SFDI platform and this two-layer model is demonstrated by imaging forearms of 6 healthy subjects under the reactive hyperemia protocol. The results show that our approach not only successfully decouples light absorption by melanin from that by hemoglobin and yields accurate determination of cutaneous hemoglobin concentration and oxygen saturation, but also provides reliable estimation of the scattering properties, the melanin content and the epidermal thickness in real time. Potential applications of our system in imaging skin physiological and functional states, cancer screening, and microcirculation monitoring are discussed at the end.

Spectroscopic imaging with spectral domain visible light optical coherence microscopy in Alzheimer's disease brain samples

A visible light spectral domain optical coherence microscopy system was developed. A high axial resolution of 0.88 μm in tissue was achieved using a broad visible light spectrum (425 - 685 nm). Healthy human brain tissue was imaged to quantify the difference between white (WM) and grey matter (GM) in intensity and attenuation. The high axial resolution enables the investigation of amyloid-beta plaques of various sizes in human brain tissue and animal models of Alzheimer's disease (AD). By performing a spectroscopic analysis of the OCM data, differences in the characteristics for WM, GM, and neuritic amyloid-beta plaques were found. To gain additional contrast, Congo red stained AD brain tissue was investigated. A first effort was made to investigate optically cleared mouse brain tissue to increase the penetration depth and visualize hyperscattering structures in deeper cortical regions.

Fluorescence depth estimation from wide-field optical imaging data for guiding brain tumor resection: a multi-inclusion phantom study

Studies have shown that fluorescent agents demarcate tumor from surrounding brain tissue and offer intraoperative guidance during resection. However, visualization of fluorescence signal from tumor below the surgical surface or through the appearance of blood in the surgical field is challenging. We have previously described red light imaging techniques for estimating fluorescent depths in turbid media. In this study, we evaluate these methods over a broader range of fluorophore concentrations, and investigate the ability to resolve multiple fluorescent emissions in the same plane or at different depths along the axis of imaging. A tungsten halogen lamp is used as a broadband white light source for reflectance imaging. Fluorescence from Alexa Fluor 647 is excited with a 635 nm diode laser. Reflectance and fluorescence spectral data are gathered between 670 and 720 nm with the use of a liquid crystal tunable filter and recorded on a sCMOS camera. Results show that two fluorescent emissions can be resolved within 2 mm if they are in the same plane or within 3 mm if they are at different depths along the axis of imaging up to 6 mm below the surface.

Histogram analysis for smartphone-based rapid hematocrit determination

A novel and rapid analysis technique using histogram has been proposed for the colorimetric quantification of blood hematocrits. A smartphone-based "Histogram" app for the detection of hematocrits has been developed integrating the smartphone embedded camera with a microfluidic chip via a custom-made optical platform. The developed histogram analysis shows its effectiveness in the automatic detection of sample channel including auto-calibration and can analyze the single-channel as well as multi-channel images. Furthermore, the analyzing method is advantageous to the quantification of blood-hematocrit both in the equal and varying optical conditions. The rapid determination of blood hematocrits carries enormous information regarding physiological disorders, and the use of such reproducible, cost-effective, and standard techniques may effectively help with the diagnosis and prevention of a number of human diseases.

Spectral-spatial feature-based neural network method for acute lymphoblastic leukemia cell identification via microscopic hyperspectral imaging technology

Microscopic examination is one of the most common methods for acute lymphoblastic leukemia (ALL) diagnosis. Most traditional methods of automized blood cell identification are based on RGB color or gray images captured by light microscopes. This paper presents an identification method combining both spectral and spatial features to identify lymphoblasts from lymphocytes in hyperspectral images. Normalization and encoding method is applied for spectral feature extraction and the support vector machine-recursive feature elimination (SVM-RFE) algorithm is presented for spatial feature determination. A marker-based learning vector quantization (MLVQ) neural network is proposed to perform identification with the integrated features. Experimental results show that this algorithm yields identification accuracy, sensitivity, and specificity of 92.9%, 93.3%, and 92.5%, respectively. Hyperspectral microscopic blood imaging combined with neural network identification technique has the potential to provide a feasible tool for ALL pre-diagnosis.

Design and evaluation of a compound acoustic lens for photoacoustic computed tomography

In photoacoustic computed tomography, the limited directivity of the detectors may cause deformation of off-center targets and lead to an imbalanced resolution in the imaging area. To improve the directivity of the acoustic detectors, several negative acoustic lenses have been proposed. In this study, we develop a new compound acoustic lens fabricated by integrating a concave polydimethylsiloxane (PDMS) lens and a convex epoxy lens. Both theoretical simulations and experimental evaluations demonstrate that the compound lens provides a larger directivity compared to single lenses made of PDMS, epoxy, and liquid. The measured acceptance angles of a 6-mm piezoelectric acoustic transducer equipped with the compound, epoxy, liquid, and PDMS lenses are 55°, 36°, 25°, and 20°, respectively. No deformation is observed in the off-center targets by using compound lens. However, serious deformation appears in the cases using single lenses.

Focus scanning with feedback-control for fiber-optic nonlinear endomicroscopy

Fiber-optic endomicroscopes open new avenues for the application of non-linear optics to novel in vivo applications. To achieve focus scanning in vivo, shape memory alloy (SMA) wires have been used to move optical elements in miniature endomicroscopes. However, this method has various limitations, making it difficult to achieve accurate and reliable depth scanning. Here we present a feedback-controlled SMA depth scanner. With a Hall effect sensor, contraction of the SMA wire can be tracked in real time, rendering accurate and robust control of motion. The SMA depth scanner can achieve up to 490 µm travel and with open-loop operation, it can move more than 350 µm within one second. With the feedback loop engaged, submicron positioning accuracy was achieved along with superior positioning stability. The high-precision positioning capability of the SMA depth scanner was verified by depth-resolved nonlinear endomicroscopic imaging of mouse brain samples.

Clinically compatible flexible wide-field multi-color fluorescence endoscopy with a porcine colon model

Early detection of structural or molecular changes in dysplastic epithelial tissues is crucial for cancer screening and surveillance. Multi-targeting molecular endoscopic fluorescence imaging may improve noninvasive detection of precancerous lesions in the colon. Here, we report the first clinically compatible, wide-field-of-view, multi-color fluorescence endoscopy with a leached fiber bundle scope using a porcine model. A porcine colon model that resembles the human colon is used for the detection of surrogate tumors composed of multiple biocompatible fluorophores (FITC, ICG, and heavy metal-free quantum dots (hfQDs)). With an ex vivo porcine colon tumor model, molecular imaging with hfQDs conjugated with MMP14 antibody was achieved by spraying molecular probes on a mucosa layer that contains xenograft tumors. With an in vivo porcine colon embedded with surrogate tumors, target-to-background ratios of 3.36 ± 0.43, 2.70 ± 0.72, and 2.10 ± 0.13 were achieved for FITC, ICG, and hfQD probes, respectively. This promising endoscopic technology with molecular contrast shows the capacity to reveal hidden tumors and guide treatment strategy decisions.

In vivo photoacoustic lipid imaging in mice using the second near-infrared window

Photoacoustic imaging has emerged as a promising technique to improve preclinical and clinical imaging by providing users with label-free optical contrast of tissue. Here, we present a proof-of-concept study for noninvasive in vivo murine lipid imaging using 1210 nm light to investigate differences in periaortic fat among mice of different gender, genotypes, and maturation. Acquired lipid signals suggest that adult male apoE^-/- mice have greater periaortic fat accumulation compared to adolescent males, apoE^-/- females, and wild-type mice. These results demonstrate the potential of photoacoustic tomography for studying vascular pathophysiology and improving the diagnosis of lipid-based diseases.

Gabor fusion master slave optical coherence tomography

This paper describes the application of the Gabor filtering protocol to a Master/Slave (MS) swept source optical coherence tomography (SS)-OCT system at 1300 nm. The MS-OCT system delivers information from selected depths, a property that allows operation similar to that of a time domain OCT system, where dynamic focusing is possible. The Gabor filtering processing following collection of multiple data from different focus positions is different from that utilized by a conventional swept source OCT system using a Fast Fourier transform (FFT) to produce an A-scan. Instead of selecting the bright parts of A-scans for each focus position, to be placed in a final B-scan image (or in a final volume), and discarding the rest, the MS principle can be employed to advantageously deliver signal from the depths within each focus range only. The MS procedure is illustrated on creating volumes of data of constant transversal resolution from a cucumber and from an insect by repeating data acquisition for 4 different focus positions. In addition, advantage is taken from the tolerance to dispersion of the MS principle that allows automatic compensation for dispersion created by layers above the object of interest. By combining the two techniques, Gabor filtering and Master/Slave, a powerful imaging instrument is demonstrated. The master/slave technique allows simultaneous display of three categories of images in one frame: multiple depth en-face OCT images, two cross-sectional OCT images and a confocal like image obtained by averaging the en-face ones. We also demonstrate the superiority of MS-OCT over its FFT based counterpart when used with a Gabor filtering OCT instrument in terms of the speed of assembling the fused volume. For our case, we show that when more than 4 focus positions are required to produce the final volume, MS is faster than the conventional FFT based procedure.

High-speed OCT light sources and systems [Invited]

Imaging speed is one of the most important parameters that define the performance of optical coherence tomography (OCT) systems. During the last two decades, OCT speed has increased by over three orders of magnitude. New developments in wavelength-swept lasers have repeatedly been crucial for this development. In this review, we discuss the historical evolution and current state of the art of high-speed OCT systems, with focus on wavelength swept light sources and swept source OCT systems.

Real-time volumetric lipid imaging in vivo by intravascular photoacoustics at 20 frames per second

Lipid deposition can be assessed with combined intravascular photoacoustic/ultrasound (IVPA/US) imaging. To date, the clinical translation of IVPA/US imaging has been stalled by a low imaging speed and catheter complexity. In this paper, we demonstrate imaging of lipid targets in swine coronary arteries in vivo, at a clinically useful frame rate of 20 s-1. We confirmed image contrast for atherosclerotic plaque in human samples ex vivo. The system is on a mobile platform and provides real-time data visualization during acquisition. We achieved an IVPA signal-to-noise ratio of 20 dB. These data show that clinical translation of IVPA is possible in principle.

Cellular resolution multiplexed FLIM tomography with dual-color Bessel beam

Fourier multiplexed FLIM (FmFLIM) tomography enables multiplexed 3D lifetime imaging of whole embryos. In our previous FmFLIM system, the spatial resolution was limited to 25 μm because of the trade-off between the spatial resolution and the imaging depth. In order to achieve cellular resolution imaging of thick specimens, we built a tomography system with dual-color Bessel beam. In combination with FmFLIM, the Bessel FmFLIM tomography system can perform parallel 3D lifetime imaging on multiple excitation-emission channels at a cellular resolution of 2.8 μm. The image capability of the Bessel FmFLIM tomography system was demonstrated by 3D lifetime imaging of dual-labeled transgenic zebrafish embryos.

Time-stretch microscopy on a DVD for high-throughput imaging cell-based assay

Cell-based assay based on time-stretch imaging is recognized to be well-suited for high-throughput phenotypic screening. However, this ultrafast imaging technique has primarily been limited to suspension-cell assay, leaving a wide range of solid-substrate assay formats uncharted. Moreover, time-stretch imaging is generally restricted to intrinsic biophysical phenotyping, but lacks the biomolecular signatures of the cells. To address these challenges, we develop a spinning time-stretch imaging assay platform based on the functionalized digital versatile disc (DVD). We demonstrate that adherent cell culture and biochemically-specific cell-capture can now be assayed with time-stretch microscopy, thanks to the high-speed DVD spinning motion that naturally enables on-the-fly cellular imaging at an ultrafast line-scan rate of >10MHz. As scanning the whole DVD at such a high speed enables ultra-large field-of-view imaging, it could be favorable for scaling both the assay throughput and content as demanded in many applications, e.g. drug discovery, and rare cancer cell screening.

Deep feature learning for automatic tissue classification of coronary artery using optical coherence tomography

Kawasaki disease (KD) is an acute childhood disease complicated by coronary artery aneurysms, intima thickening, thrombi, stenosis, lamellar calcifications, and disappearance of the media border. Automatic classification of the coronary artery layers (intima, media, and scar features) is important for analyzing optical coherence tomography (OCT) images recorded in pediatric patients. OCT has been known as an intracoronary imaging modality using near-infrared light which has recently been used to image the inner coronary artery tissues of pediatric patients, providing high spatial resolution (ranging from 10 to 20 μm). This study aims to develop a robust and fully automated tissue classification method by using the convolutional neural networks (CNNs) as feature extractor and comparing the predictions of three state-of-the-art classifiers, CNN, random forest (RF), and support vector machine (SVM). The results show the robustness of CNN as the feature extractor and random forest as the classifier with classification rate up to 96%, especially to characterize the second layer of coronary arteries (media), which is a very thin layer and it is challenging to be recognized and specified from other tissues.

Deep tissue photoacoustic computed tomography with a fast and compact laser system

Photoacoustic computed tomography (PACT) holds great promise for biomedical imaging, but wide-spread implementation is impeded by the bulkiness of flash-lamp-pumped laser systems, which typically weigh between 50 - 200 kg, require continuous water cooling, and operate at a low repetition rate. Here, we demonstrate that compact lasers based on emerging diode technologies are well-suited for preclinical and clinical PACT. The diode-pumped laser used in this study had a miniature footprint (13 × 14 × 7 cm³), weighed only 1.6 kg, and outputted up to 80 mJ per pulse at 1064 nm. In vitro, the laser system readily provided over 4 cm PACT depth in chicken breast tissue. In vivo, in addition to high resolution, non-invasive brain imaging in living mice, the system can operate at 50 Hz, which enabled high-speed cross-sectional imaging of murine cardiac and respiratory function. The system also provided high quality, high-frame rate, and non-invasive three-dimensional mapping of arm, palm, and breast vasculature at multi centimeter depths in living human subjects, demonstrating the clinical viability of compact lasers for PACT.

Non-invasive terahertz imaging of tissue water content for flap viability assessment

Accurate and early prediction of tissue viability is the most significant determinant of tissue flap survival in reconstructive surgery. Perturbation in tissue water content (TWC) is a generic component of the tissue response to such surgeries, and, therefore, may be an important diagnostic target for assessing the extent of flap viability in vivo. We have previously shown that reflective terahertz (THz) imaging, a non-ionizing technique, can generate spatially resolved maps of TWC in superficial soft tissues, such as cornea and wounds, on the order of minutes. Herein, we report the first in vivo pilot study to investigate the utility of reflective THz TWC imaging for early assessment of skin flap viability. We obtained longitudinal visible and reflective THz imagery comparing 3 bipedicled flaps (i.e. survival model) and 3 fully excised flaps (i.e. failure model) in the dorsal skin of rats over a postoperative period of 7 days. While visual differences between both models manifested 48 hr after surgery, statistically significant (p < 0.05, independent t-test) local differences in TWC contrast were evident in THz flap image sets as early as 24 hr. Excised flaps, histologically confirmed as necrotic, demonstrated a significant, yet localized, reduction in TWC in the flap region compared to non-traumatized skin. In contrast, bipedicled flaps, histologically verified as viable, displayed mostly uniform, unperturbed TWC across the flap tissue. These results indicate the practical potential of THz TWC sensing to accurately predict flap failure 24 hours earlier than clinical examination.

Volumetric optical mapping in early embryonic hearts using light-sheet microscopy

Optical mapping (OM) of electrical activity using voltage-sensitive fluorescent dyes is a powerful tool for the investigation of embryonic cardiac electrophysiology. However, because conventional OM integrates the signal in depth and projects it to a two-dimensional plane, information acquired is incomplete and dependent upon the orientation of the sample. This complicates interpretation of data, especially when comparing one heart to another. To overcome this limitation, we present volumetric OM using light-sheet microscopy, which enables high-speed capture of optically sectioned slices. Voltage-sensitive fluorescence images from multiple planes across entire early embryonic quail hearts were acquired, and complete, orientation-independent, four-dimensional maps of transmembrane potential are demonstrated. Volumetric OM data were collected while using optical pacing to control the heart rate, paving the way for physiological measurements and precise manipulation of the heartbeat in the future.

Efficient multi-site two-photon functional imaging of neuronal circuits

Two-photon imaging using high-speed multi-channel detectors is a promising approach for optical recording of cellular membrane dynamics at multiple sites. A main bottleneck of this technique is the limited number of photons captured within a short exposure time (~1ms). Here, we implement temporal gating to improve the two-photon fluorescence yield from holographically projected multiple foci whilst maintaining a biologically safe incident average power. We observed up to 6x improvement in the signal-to-noise ratio (SNR) in Fluorescein and cultured hippocampal neurons showing evoked calcium transients. With improved SNR, we could pave the way to achieving multi-site optical recording of fluorogenic probes with response times in the order of ~1ms.

Imaging behind opaque obstacle: a potential method for guided in vitro needle placement

We report a simple real time optical imaging concept using an axicon lens to image the object kept behind opaque obstacles in free space. The proposed concept underlines the importance and advantages of using an axicon lens compared to a conventional lens to image behind the obstacle. The potential of this imaging concept is demonstrated by imaging the insertion of surgical needle in biological specimen in real time, without blocking the field of view. It is envisaged that this proposed concepts and methodology can make a telling impact in a wide variety of areas especially for diagnostics, therapeutics and microscopy applications.

In vivo volumetric fluorescence sectioning microscopy with mechanical-scan-free hybrid illumination imaging

Optical sectioning microscopy in wide-field fashion has been widely used to obtain three-dimensional images of biological samples; however, it requires scanning in depth and considerable time to acquire multiple depth information of a volumetric sample. In this paper, in vivo optical sectioning microscopy with volumetric hybrid illumination, with no mechanical moving parts, is presented. The proposed system is configured such that the optical sectioning is provided by hybrid illumination using a digital micro-mirror device (DMD) for uniform and non-uniform pattern projection, while the depth of imaging planes is varied by using an electrically tunable-focus lens with invariant magnification and resolution. We present and characterize the design, implementation, and experimentally demonstrate the proposed system's ability through 3D imaging of in vivo Canenorhabditis elegans' growth cones.

Imaging in turbid media: a transmission detector gives 2-3 order of magnitude enhanced sensitivity compared to epi-detection schemes

Imaging depth in turbid media by two-photon fluorescence microscopy depends on the ability of the optical system to detect weak fluorescence signals. We have shown that use of a wide area detector in transmission geometry allows increasing imaging depth in turbid media due to efficient photon collection. Compared to the conventional epi-detection scheme used in most commercial microscopes, the transmission detector was found to be 2-3 orders of magnitude more sensitive when used for in depth imaging in scattering samples simulating brain optical properties.

In vivo fluorescence imaging of hepatocellular carcinoma xenograft using near-infrared labeled epidermal growth factor receptor (EGFR) peptide

Minimally-invasive surgery of hepatocellular carcinoma (HCC) can be limited by poor tumor visualization with white light. We demonstrate systemic administration of a Cy5.5-labeled peptide specific for epidermal growth factor receptor (EGFR) to target HCC in vivo in a mouse xenograft model. We attached a compact imaging module to the proximal end of a medical laparoscope to collect near-infrared fluorescence and reflectance images concurrently at 15 frames/sec. We measured a mean target-to-background ratio of 2.99 ± 0.22 from 13 surgically exposed subcutaneous human HCC tumors in vivo in 5 mice. This integrated imaging methodology is promising to guide laparoscopic resection of HCC.

Bundled-optode implementation for 3D imaging in functional near-infrared spectroscopy

The paper presents a functional near-infrared spectroscopy (fNIRS)-based bundled-optode method for detection of the changes of oxy-hemoglobin (HbO) and deoxy-hemoglobin (HbR) concentrations. fNIRS with 32 optodes is utilized to measure five healthy male subjects' brain-hemodynamic responses to arithmetic tasks. Specifically, the coordinates of 256 voxels in the three-dimensional (3D) volume are computed according to the known probe geometry. The mean path length factor in the Beer-Lambert equation is estimated as a function of the emitter-detector distance, which is utilized for computation of the absorption coefficient. The mean values of HbO and HbR obtained from the absorption coefficient are then applied for construction of a 3D fNIRS image. Our results show that the proposed method, as compared with the conventional approach, can detect brain activity with higher spatial resolution. This method can be extended for 3D fNIRS imaging in real-time applications.

Multi-spectral photoacoustic elasticity tomography

The goal of this work was to develop and validate a spectrally resolved photoacoustic imaging method, namely multi-spectral photoacoustic elasticity tomography (PAET) for quantifying the physiological parameters and elastic modulus of biological tissues. We theoretically and experimentally examined the PAET imaging method using simulations and in vitro experimental tests. Our simulation and in vitro experimental results indicated that the reconstructions were quantitatively accurate in terms of sizes, the physiological and elastic properties of the targets.

Augmented reality based real-time subcutaneous vein imaging system

A novel 3D reconstruction and fast imaging system for subcutaneous veins by augmented reality is presented. The study was performed to reduce the failure rate and time required in intravenous injection by providing augmented vein structures that back-project superimposed veins on the skin surface of the hand. Images of the subcutaneous vein are captured by two industrial cameras with extra reflective near-infrared lights. The veins are then segmented by a multiple-feature clustering method. Vein structures captured by the two cameras are matched and reconstructed based on the epipolar constraint and homographic property. The skin surface is reconstructed by active structured light with spatial encoding values and fusion displayed with the reconstructed vein. The vein and skin surface are both reconstructed in the 3D space. Results show that the structures can be precisely back-projected to the back of the hand for further augmented display and visualization. The overall system performance is evaluated in terms of vein segmentation, accuracy of vein matching, feature points distance error, duration times, accuracy of skin reconstruction, and augmented display. All experiments are validated with sets of real vein data. The imaging and augmented system produces good imaging and augmented reality results with high speed.

Arduino Due based tool to facilitate in vivo two-photon excitation microscopy

Two-photon excitation spectroscopy is a powerful technique for the characterization of the optical properties of genetically encoded and synthetic fluorescent molecules. Excitation spectroscopy requires tuning the wavelength of the Ti:sapphire laser while carefully monitoring the delivered power. To assist laser tuning and the control of delivered power, we developed an Arduino Due based tool for the automatic acquisition of high quality spectra. This tool is portable, fast, affordable and precise. It allowed studying the impact of scattering and of blood absorption on two-photon excitation light. In this way, we determined the wavelength-dependent deformation of excitation spectra occurring in deep tissues in vivo.

Polarization properties of single layers in the posterior eyes of mice and rats investigated using high resolution polarization sensitive optical coherence tomography

We present a high resolution polarization sensitive optical coherence tomography (PS-OCT) system for ocular imaging in rodents. The system operates at 840 nm and uses a broadband superluminescent diode providing an axial resolution of 5.1 µm in air. PS-OCT data was acquired at 83 kHz A-scan rate by two identical custom-made spectrometers for orthogonal polarization states. Pigmented (Brown Norway, Long Evans) and non-pigmented (Sprague Dawley) rats as well as pigmented mice (C57BL/6) were imaged. Melanin pigment related depolarization was analyzed in the retinal pigment epithelium (RPE) and choroid of these animals using the degree of polarization uniformity (DOPU). For all rat strains, significant differences between RPE and choroidal depolarization were observed. In contrast, DOPU characteristics of RPE and choroid were similar for C57BL/6 mice. Moreover, the depolarization within the same tissue type varied significantly between different rodent strains. Retinal nerve fiber layer thickness, phase retardation, and birefringence were mapped and quantitatively measured in Long Evans rats in vivo for the first time. In a circumpapillary annulus, retinal nerve fiber layer birefringence amounted to 0.16°/µm ± 0.02°/µm and 0.17°/µm ± 0.01°/µm for the left and right eyes, respectively.

Topical MMP beacon enabled fluorescence-guided resection of oral carcinoma

Each year almost 300,000 individuals worldwide are diagnosed with oral cancer, more than 90% of these being oral carcinoma [N. Engl. J. Med.328, 1841993]. Surgical resection is the standard of care, but accurate delineation of the tumor boundaries is challenging, resulting in either under-resection with risk of local recurrence or over-resection with increased functional loss and negative impact on quality of life. This study evaluates, in two pre-clinical in vivo tumor models, the potential of fluorescence-guided resection using molecular beacons activated by metalloproteinases, which are frequently upregulated in human oral cancer. In both models there was rapid (<15 min) beacon activation upon local application, allowing clear fluoresecence imaging in vivo and confirmed by ex vivo fluorescence microscopy and HPLC, with minimal activation in normal oral tissues. Although the tissue penetration was limited using topical application, these findings support further development of this approach towards translation to first-in-human trials.

Comparison of amplitude-decorrelation, speckle-variance and phase-variance OCT angiography methods for imaging the human retina and choroid

We compared the performance of three OCT angiography (OCTA) methods: speckle variance, amplitude decorrelation and phase variance for imaging of the human retina and choroid. Two averaging methods, split spectrum and volume averaging, were compared to assess the quality of the OCTA vascular images. All data were acquired using a swept-source OCT system at 1040 nm central wavelength, operating at 100,000 A-scans/s. We performed a quantitative comparison using a contrast-to-noise (CNR) metric to assess the capability of the three methods to visualize the choriocapillaris layer. For evaluation of the static tissue noise suppression in OCTA images we proposed to calculate CNR between the photoreceptor/RPE complex and the choriocapillaris layer. Finally, we demonstrated that implementation of intensity-based OCT imaging and OCT angiography methods allows for visualization of retinal and choroidal vascular layers known from anatomic studies in retinal preparations. OCT projection imaging of data flattened to selected retinal layers was implemented to visualize retinal and choroidal vasculature. User guided vessel tracing was applied to segment the retinal vasculature. The results were visualized in a form of a skeletonized 3D model.

High frame rate photoacoustic imaging at 7000 frames per second using clinical ultrasound system

Photoacoustic tomography, a hybrid imaging modality combining optical and ultrasound imaging, is gaining attention in the field of medical imaging. Typically, a Q-switched Nd:YAG laser is used to excite the tissue and generate photoacoustic signals. But, such photoacoustic imaging systems are difficult to translate into clinical applications owing to their high cost, bulky size often requiring an optical table to house such lasers. Moreover, the low pulse repetition rate of few tens of hertz prevents them from being used in high frame rate photoacoustic imaging. In this work, we have demonstrated up to 7000 Hz photoacoustic imaging (B-mode) and measured the flow rate of a fast moving object. We used a ~140 nanosecond pulsed laser diode as an excitation source and a clinical ultrasound imaging system to capture and display the photoacoustic images. The excitation laser is ~803 nm in wavelength with ~1.4 mJ energy per pulse. So far, the reported 2-dimensional photoacoustic B-scan imaging is only a few tens of frames per second using a clinical ultrasound system. Therefore, this is the first report on 2-dimensional photoacoustic B-scan imaging with 7000 frames per second. We have demonstrated phantom imaging to view and measure the flow rate of ink solution inside a tube. This fast photoacoustic imaging can be useful for various clinical applications including cardiac related problems, where the blood flow rate is quite high, or other dynamic studies.

Quantitative spatial frequency fluorescence imaging in the sub-diffusive domain for image-guided glioma resection

Intraoperative 5- aminolevulinic acid induced-Protoporphyrin IX (PpIX) fluorescence guidance enables maximum safe resection of glioblastomas by providing surgeons with real-time tumor optical contrast. However, visual assessment of PpIX fluorescence is subjective and limited by the distorting effects of light attenuation and tissue autofluorescence. We have previously shown that non-invasive point measurements of absolute PpIX concentration identifies residual tumor that is otherwise non-detectable. Here, we extend this approach to wide-field quantitative fluorescence imaging by implementing spatial frequency domain imaging to recover tissue optical properties across the field-of-view in phantoms and ex vivo tissue.

High-speed intravascular photoacoustic imaging at 1.7 μm with a KTP-based OPO

Lipid deposition inside the arterial wall is a hallmark of plaque vulnerability. Based on overtone absorption of C-H bonds, intravascular photoacoustic (IVPA) catheter is a promising technology for quantifying the amount of lipid and its spatial distribution inside the arterial wall. Thus far, the clinical translation of IVPA technology is limited by its slow imaging speed due to lack of a high-pulse-energy high-repetition-rate laser source for lipid-specific first overtone excitation at 1.7 μm. Here, we demonstrate a potassium titanyl phosphate (KTP)-based optical parametric oscillator with output pulse energy up to 2 mJ at a wavelength of 1724 nm and with a repetition rate of 500 Hz. Using this laser and a ring-shape transducer, IVPA imaging at speed of 1 frame per sec was demonstrated. Performance of the IVPA imaging system's resolution, sensitivity, and specificity were characterized by carbon fiber and a lipid-mimicking phantom. The clinical utility of this technology was further evaluated ex vivo in an excised atherosclerotic human femoral artery with comparison to histology.

Compact multi-band fluorescent microscope with an electrically tunable lens for autofocusing

Autofocusing is a routine technique in redressing focus drift that occurs in time-lapse microscopic image acquisition. To date, most automatic microscopes are designed on the distance detection scheme to fulfill the autofocusing operation, which may suffer from the low contrast of the reflected signal due to the refractive index mismatch at the water/glass interface. To achieve high autofocusing speed with minimal motion artifacts, we developed a compact multi-band fluorescent microscope with an electrically tunable lens (ETL) device for autofocusing. A modified searching algorithm based on equidistant scanning and curve fitting is proposed, which no longer requires a single-peak focus curve and then efficiently restrains the impact of external disturbance. This technique enables us to achieve an autofocusing time of down to 170 ms and the reproductivity of over 97%. The imaging head of the microscope has dimensions of 12 cm × 12 cm × 6 cm. This portable instrument can easily fit inside standard incubators for real-time imaging of living specimens.

Improved two-photon imaging of living neurons in brain tissue through temporal gating

We optimize two-photon imaging of living neurons in brain tissue by temporally gating an incident laser to reduce the photon flux while optimizing the maximum fluorescence signal from the acquired images. Temporal gating produces a bunch of ~10 femtosecond pulses and the fluorescence signal is improved by increasing the bunch-pulse energy. Gating is achieved using an acousto-optic modulator with a variable gating frequency determined as integral multiples of the imaging sampling frequency. We hypothesize that reducing the photon flux minimizes the photo-damage to the cells. Our results, however, show that despite producing a high fluorescence signal, cell viability is compromised when the gating and sampling frequencies are equal (or effectively one bunch-pulse per pixel). We found an optimum gating frequency range that maintains the viability of the cells while preserving a pre-set fluorescence signal of the acquired two-photon images. The neurons are imaged while under whole-cell patch, and the cell viability is monitored as a change in the membrane's input resistance.