High speed functional imaging with source localized multifocal two-photon microscopy

Multifocal two-photon microscopy (MTPM) increases imaging speed over single-focus scanning by parallelizing fluorescence excitation. The imaged fluorescence's susceptibility to crosstalk, however, severely degrades contrast in scattering tissue. Here we present a source-localized MTPM scheme optimized for high speed functional fluorescence imaging in scattering mammalian brain tissue. A rastered line array of beamlets excites fluorescence imaged with a complementary metal-oxide-semiconductor (CMOS) camera. We mitigate scattering-induced crosstalk by temporally oversampling the rastered image, generating grouped images with structured illumination, and applying Richardson-Lucy deconvolution to reassign scattered photons. Single images are then retrieved with a maximum intensity projection through the deconvolved image groups. This method increased image contrast at depths up to 112 μm in scattering brain tissue and reduced functional crosstalk between pixels during neuronal calcium imaging. Source-localization did not affect signal-to-noise ratio (SNR) in densely labeled tissue under our experimental conditions. SNR decreased at low frame rates in sparsely labeled tissue, with no effect at frame rates above 50 Hz. Our non-descanned source-localized MTPM system enables high SNR, 100 Hz capture of fluorescence transients in scattering brain, increasing the scope of MTPM to faster and smaller functional signals.

Hyperspectral imaging in highly scattering media by the spectral phasor approach using two filters

Hyperspectral imaging is a common technique in fluorescence microscopy to obtain the emission spectrum at each pixel of an image. However, methods to obtain spectral resolution based on diffraction gratings or integrated prisms work poorly when the sample is strongly scattering. We developed a microscope named the DIVER that collects the fluorescence emission over a very large angle. Since the fluorescence light after passing through the multiple scattering sample is not collimated, the use of grating or prisms strongly limits the amount of light that can be used with available hyperspectral devices. Here we show that 2 filters that accept uncollimated light over a large aperture are sufficient to calculate the spectral phasor rather than displaying the entire spectrum. Using the properties of the spectral phasors, we can resolve spectral components and perform the type of data analyses that are usually performed in hyperspectral image analysis.

On-chip light-sheet fluorescence imaging flow cytometry at a high flow speed of 1 m/s

We present on-chip fluorescence imaging flow cytometry by light-sheet excitation on a mirror-embedded microfluidic chip. The method allows us to obtain microscopy-grade fluorescence images of cells flowing at a high speed of 1 m/s, which is comparable to the flow speed of conventional non-imaging flow cytometers. To implement the light-sheet excitation of flowing cells in a microchannel, we designed and fabricated a mirror-embedded PDMS-based microfluidic chip. To show its broad utility, we used the method to classify large populations of microalgal cells (Euglena gracilis) and human cancer cells (human adenocarcinoma cells). Our method holds promise for large-scale single-cell analysis.

Erratum: Methods for detecting host genetic modifiers of tumor vascular function using dynamic near-infrared fluorescence imaging: errata

[This corrects the article on p. 543 in vol. 9, PMID: 29552392.].

Blood vessel detection, localization and estimation using a smart laparoscopic grasper: a Monte Carlo study

For centuries, surgeons have relied on their sense of touch to identify vital structures such as blood vessels in traditional open surgery. Over the past two decades, surgeons have shifted to minimally invasive surgical (MIS) approaches, including laparoscopic surgery, which include benefits such as less scarring, less risk for infection, and quicker recovery times. In fact, some surgeries such as cholecystectomies have seen more than an 80% adoption of this technique because of those benefits. However, due to the fundamental challenges associated with using laparoscopic surgery, there has been a lower adoption in more complex specialties, such as colorectal and thoracic surgery, where the field of surgery has bleeding, fat, scar tissue, and adhesions. These problems are exacerbated by complicating factors such as inflammation, cancer, chronic disease, obesity, and re-operations. Importantly, surgeons will often convert from laparoscopy to open surgery if they can no longer proceed using the minimally invasive approach because of issues described with these complicating factors, thereby negating the benefits that the patient would have seen. When the surgeon does attempt these procedures with those issues, the surgery takes on average 30 min - 1 hour longer. A new method by which surgeons can visualize structures like blood vessels could reduce the conversion rates and operating time, thereby driving a greater adoption of laparoscopic surgery in these complex procedures. Here, we show that by adding near infrared (NIR) LEDs and a linear image sensor onto the opposing jaws of the laparoscopic graspers, blood vessels that are embedded within tissues can be detected and localized efficiently, even those not visible using current imaging techniques. We show the results of Monte Carlo simulations to support our claim, including that blood vessels ranging from 2 to 6 mm and buried under up to 1 cm of tissue can be detected. We also report developing a smart grasper handheld prototype to run ex vivo experiments. The results of these experiments matched with those of the Monte Carlo simulations and the estimated blood vessel size showed a strong correlation with the actual size. This technology will be incorporated into already existing laparoscopic tools to assist surgeons during MIS procedures.

Ultrasound-mediation of self-illuminating reporters improves imaging resolution in optically scattering media

In vivo imaging of self-illuminating bio-and chemiluminescent reporters is used to observe the physiology of small animals. However, strong light scattering by biological tissues results in poor spatial resolution of the optical imaging, which also degrades the quantitative accuracy. To overcome this challenging problem, focused ultrasound is used to modulate the light from the reporter at the ultrasound frequency. This produces an ultrasound switchable light 'beacon' that reduces the influence of light scattering in order to improve spatial resolution. The experimental results demonstrate that apart from light modulation at the ultrasound frequency (AC signal at 3.5 MHz), ultrasound also increases the DC intensity of the reporters. This is shown to be due to a temperature rise caused by insonification that was minimized to be within acceptable mammalian tissue safety thresholds by adjusting the duty cycle of the ultrasound. Line scans of bio-and chemiluminescent objects embedded within a scattering medium were obtained using ultrasound modulated (AC) and ultrasound enhanced (DC) signals. Lateral resolution is improved by a factor of 12 and 7 respectively, as compared to conventional CCD imaging. Two chemiluminescent sources separated by ~10 mm at ~20 mm deep inside a 50 mm thick chicken breast have been successfully resolved with an average signal-to-noise ratio of approximately 8-10 dB.

50 Hz volumetric functional imaging with continuously adjustable depth of focus

Understanding how neural circuits control behavior requires monitoring a large population of neurons with high spatial resolution and volume rate. Here we report an axicon-based Bessel beam module with continuously adjustable depth of focus (CADoF), that turns frame rate into volume rate by extending the excitation focus in the axial direction while maintaining high lateral resolutions. Cost-effective and compact, this CADoF Bessel module can be easily integrated into existing two-photon fluorescence microscopes. Simply translating one of the relay lenses along its optical axis enabled continuous adjustment of the axial length of the Bessel focus. We used this module to simultaneously monitor activity of spinal projection neurons extending over 60 µm depth in larval zebrafish at 50 Hz volume rate with adjustable axial extent of the imaged volume.

50 Hz volumetric functional imaging with continuously adjustable depth of focus

Understanding how neural circuits control behavior requires monitoring a large population of neurons with high spatial resolution and volume rate. Here we report an axicon-based Bessel beam module with continuously adjustable depth of focus (CADoF), that turns frame rate into volume rate by extending the excitation focus in the axial direction while maintaining high lateral resolutions. Cost-effective and compact, this CADoF Bessel module can be easily integrated into existing two-photon fluorescence microscopes. Simply translating one of the relay lenses along its optical axis enabled continuous adjustment of the axial length of the Bessel focus. We used this module to simultaneously monitor activity of spinal projection neurons extending over 60 µm depth in larval zebrafish at 50 Hz volume rate with adjustable axial extent of the imaged volume.

Novel endoscope with increased depth of field for imaging human nasal tissue by microscopic optical coherence tomography

Intravital microscopy (IVM) offers the opportunity to visualize static and dynamic changes of tissue on a cellular level. It is a valuable tool in research and may considerably improve clinical diagnosis. In contrast to confocal and non-linear microscopy, optical coherence tomography (OCT) with microscopic resolution (mOCT) provides intrinsically cross-sectional imaging. Changing focus position is not needed, which simplifies especially endoscopic imaging. For in-vivo imaging, here we are presenting endo-microscopic OCT (emOCT). A graded-index-lens (GRIN) based 2.75 mm outer diameter rigid endoscope is providing 1.5 - 2 µm nearly isotropic resolution over an extended field of depth. Spherical and chromatic aberrations are used to elongate the focus length. Simulation of the OCT image formation, suggests a better overall image quality in this range compared to a focused Gaussian beam. Total imaging depth at a reduced sensitivity and lateral resolution is more than 200 µm. Using a frame rate of 80 Hz cross-sectional images of concha nasalis were demonstrated in humans, which could resolve cilial motion, cellular structures of the epithelium, vessels and blood cells. Mucus transport velocity was successfully determined. The endoscope may be used for diagnosis and treatment control of different lung diseases like cystic fibrosis or primary ciliary dyskinesia, which manifest already at the nasal mucosa.

Fiber pattern removal and image reconstruction method for snapshot mosaic hyperspectral endoscopic images

Hyperspectral endoscopic imaging has the potential to enhance clinical diagnostics and outcome. Most commercial endoscopes utilize imaging fiber bundles to transmit the collected signal from the patient to the medical operator. These bundles consist of several fiber cores surrounded by a cladding layer creating comb structure-like artifacts, which complicate further analysis, both spatially and spectrally. Here we present an optical fiber pattern removal algorithm which we applied to hyperspectral bronchoscopic images robustly and quantitatively without the need for specific optical or electrical hardware. We validate the performance of the pattern removal by using a novel hyperspectral phasor approach. This algorithm can be generalized to all forms of fiber bundle hyperspectral endoscopy.

Methods for detecting host genetic modifiers of tumor vascular function using dynamic near-infrared fluorescence imaging

Vascular supply is a critical component of the tumor microenvironment (TME) and is essential for tumor growth and metastasis, yet the endogenous genetic modifiers that impact vascular function in the TME are largely unknown. To identify the host TME modifiers of tumor vascular function, we combined a novel genetic mapping strategy [Consomic Xenograft Model] with near-infrared (NIR) fluorescence imaging and multiparametric analysis of pharmacokinetic modeling. To detect vascular flow, an intensified cooled camera based dynamic NIR imaging system with 785 nm laser diode based excitation was used to image the whole-body fluorescence emission of intravenously injected indocyanine green dye. Principal component analysis was used to extract the spatial segmentation information for the lungs, liver, and tumor regions-of-interest. Vascular function was then quantified by pK modeling of the imaging data, which revealed significantly altered tissue perfusion and vascular permeability that were caused by host genetic modifiers in the TME. Collectively, these data demonstrate that NIR fluorescent imaging can be used as a non-invasive means for characterizing host TME modifiers of vascular function that have been linked with tumor risk, progression, and response to therapy.

Complex differential variance angiography with noise-bias correction for optical coherence tomography of the retina

Complex differential variance (CDV) provides phase-sensitive angiographic imaging for optical coherence tomography (OCT) with immunity to phase-instabilities of the imaging system and small-scale axial bulk motion. However, like all angiographic methods, measurement noise can result in erroneous indications of blood flow that confuse the interpretation of angiographic images. In this paper, a modified CDV algorithm that corrects for this noise-bias is presented. This is achieved by normalizing the CDV signal by analytically derived upper and lower limits. The noise-bias corrected CDV algorithm was implemented into an experimental 1 μm wavelength OCT system for retinal imaging that used an eye tracking scanner laser ophthalmoscope at 815 nm for compensation of lateral eye motions. The noise-bias correction improved the CDV imaging of the blood flow in tissue layers with a low signal-to-noise ratio and suppressed false indications of blood flow outside the tissue. In addition, the CDV signal normalization suppressed noise induced by galvanometer scanning errors and small-scale lateral motion. High quality cross-section and motion-corrected en face angiograms of the retina and choroid are presented.

Simultaneous acquisition of neuronal morphology and cytoarchitecture in the same Golgi-stained brain

Acquiring an accurate orientation reference is a prerequisite for precisely analysing the morphological features of Golgi-stained neurons in the whole brain. However, the same reflective imaging contrast of Golgi staining for morphology and Nissl staining for cytoarchitecture leads to the failure of distinguishing soma morphology and simultaneously co-locate cytoarchitecture. Here, we developed the dual-mode micro-optical sectioning tomography (dMOST) method to simultaneously image the reflective and fluorescent signals in three dimensions. We evaluated the feasibility of real-time fluorescent counterstaining on Golgi-stained brain tissue. With our system, we acquired whole-brain data sets of physiological and pathological Golgi-stained mouse model brains with fluorescence-labelled anatomical annotation at single-neuron resolution. We also obtained the neuronal morphology of macaque monkey brain tissue using this method. The results show that real-time acquisition of the co-located cytoarchitecture reference in the same brain greatly facilitates the precise morphological analysis of Golgi-stained neurons.

Optical mapping of brain activation during the English to Chinese and Chinese to English sight translation

Translating from Chinese into another language or vice versa is becoming a widespread phenomenon. However, current neuroimaging studies are insufficient to reveal the neural mechanism underlying translation asymmetry during Chinese/English sight translation. In this study, functional near infrared spectroscopy (fNIRS) was used to extract the brain activation patterns associated with Chinese/English sight translation. Eleven unbalanced Chinese (L1)/English (L2) bilinguals participated in this study based on an intra-group experimental design, in which two translation and two reading aloud tasks were administered: forward translation (from L1 to L2), backward translation (from L2 to L1), L1 reading, and L2 reading. As predicted, our findings revealed that forward translation elicited more pronounced brain activation in Broca's area, suggesting that neural correlates of translation vary according to the direction of translation. Additionally, significant brain activation in the left PFC was involved in backward translation, indicating the importance of this brain region during the translation process. The identical activation patterns could not be discovered in forward translation, indicating the cognitive processing of reading logographic languages (i.e. Chinese) might recruit incongruent brain regions.

Optical projection tomography for rapid whole mouse brain imaging

In recent years, three-dimensional mesoscopic imaging has gained significant importance in life sciences for fundamental studies at the whole-organ level. In this manuscript, we present an optical projection tomography (OPT) method designed for imaging of the intact mouse brain. The system features an isotropic resolution of ~50 µm and an acquisition time of four to eight minutes, using a 3-day optimized clearing protocol. Imaging of the brain autofluorescence in 3D reveals details of the neuroanatomy, while the use of fluorescent labels displays the vascular network and amyloid deposition in 5xFAD mice, an important model of Alzheimer's disease (AD). Finally, the OPT images are compared with histological slices.

In vivo real-time imaging of cutaneous hemoglobin concentration, oxygen saturation, scattering properties, melanin content, and epidermal thickness with visible spatially modulated light

We present the real-time single snapshot multiple frequency demodulation - spatial frequency domain imaging (SSMD-SFDI) platform implemented with a visible digital mirror device that is capable of imaging and monitoring dynamic turbid medium and processes over a large field of view. One challenge in quantitative imaging of biological tissue such as the skin is the complex structure rendering techniques based on homogeneous medium models to fail. To address this difficulty we have also developed a novel method that maps the layered structure to a homogeneous medium for spatial frequency domain imaging. The varying penetration depth of spatially modulated light on its wavelength and modulation frequency is used to resolve the layered structure. The efficacy of the real-time SSMD-SFDI platform and this two-layer model is demonstrated by imaging forearms of 6 healthy subjects under the reactive hyperemia protocol. The results show that our approach not only successfully decouples light absorption by melanin from that by hemoglobin and yields accurate determination of cutaneous hemoglobin concentration and oxygen saturation, but also provides reliable estimation of the scattering properties, the melanin content and the epidermal thickness in real time. Potential applications of our system in imaging skin physiological and functional states, cancer screening, and microcirculation monitoring are discussed at the end.

Spectroscopic imaging with spectral domain visible light optical coherence microscopy in Alzheimer's disease brain samples

A visible light spectral domain optical coherence microscopy system was developed. A high axial resolution of 0.88 μm in tissue was achieved using a broad visible light spectrum (425 - 685 nm). Healthy human brain tissue was imaged to quantify the difference between white (WM) and grey matter (GM) in intensity and attenuation. The high axial resolution enables the investigation of amyloid-beta plaques of various sizes in human brain tissue and animal models of Alzheimer's disease (AD). By performing a spectroscopic analysis of the OCM data, differences in the characteristics for WM, GM, and neuritic amyloid-beta plaques were found. To gain additional contrast, Congo red stained AD brain tissue was investigated. A first effort was made to investigate optically cleared mouse brain tissue to increase the penetration depth and visualize hyperscattering structures in deeper cortical regions.

Fluorescence depth estimation from wide-field optical imaging data for guiding brain tumor resection: a multi-inclusion phantom study

Studies have shown that fluorescent agents demarcate tumor from surrounding brain tissue and offer intraoperative guidance during resection. However, visualization of fluorescence signal from tumor below the surgical surface or through the appearance of blood in the surgical field is challenging. We have previously described red light imaging techniques for estimating fluorescent depths in turbid media. In this study, we evaluate these methods over a broader range of fluorophore concentrations, and investigate the ability to resolve multiple fluorescent emissions in the same plane or at different depths along the axis of imaging. A tungsten halogen lamp is used as a broadband white light source for reflectance imaging. Fluorescence from Alexa Fluor 647 is excited with a 635 nm diode laser. Reflectance and fluorescence spectral data are gathered between 670 and 720 nm with the use of a liquid crystal tunable filter and recorded on a sCMOS camera. Results show that two fluorescent emissions can be resolved within 2 mm if they are in the same plane or within 3 mm if they are at different depths along the axis of imaging up to 6 mm below the surface.

Histogram analysis for smartphone-based rapid hematocrit determination

A novel and rapid analysis technique using histogram has been proposed for the colorimetric quantification of blood hematocrits. A smartphone-based "Histogram" app for the detection of hematocrits has been developed integrating the smartphone embedded camera with a microfluidic chip via a custom-made optical platform. The developed histogram analysis shows its effectiveness in the automatic detection of sample channel including auto-calibration and can analyze the single-channel as well as multi-channel images. Furthermore, the analyzing method is advantageous to the quantification of blood-hematocrit both in the equal and varying optical conditions. The rapid determination of blood hematocrits carries enormous information regarding physiological disorders, and the use of such reproducible, cost-effective, and standard techniques may effectively help with the diagnosis and prevention of a number of human diseases.

Spectral-spatial feature-based neural network method for acute lymphoblastic leukemia cell identification via microscopic hyperspectral imaging technology

Microscopic examination is one of the most common methods for acute lymphoblastic leukemia (ALL) diagnosis. Most traditional methods of automized blood cell identification are based on RGB color or gray images captured by light microscopes. This paper presents an identification method combining both spectral and spatial features to identify lymphoblasts from lymphocytes in hyperspectral images. Normalization and encoding method is applied for spectral feature extraction and the support vector machine-recursive feature elimination (SVM-RFE) algorithm is presented for spatial feature determination. A marker-based learning vector quantization (MLVQ) neural network is proposed to perform identification with the integrated features. Experimental results show that this algorithm yields identification accuracy, sensitivity, and specificity of 92.9%, 93.3%, and 92.5%, respectively. Hyperspectral microscopic blood imaging combined with neural network identification technique has the potential to provide a feasible tool for ALL pre-diagnosis.

Design and evaluation of a compound acoustic lens for photoacoustic computed tomography

In photoacoustic computed tomography, the limited directivity of the detectors may cause deformation of off-center targets and lead to an imbalanced resolution in the imaging area. To improve the directivity of the acoustic detectors, several negative acoustic lenses have been proposed. In this study, we develop a new compound acoustic lens fabricated by integrating a concave polydimethylsiloxane (PDMS) lens and a convex epoxy lens. Both theoretical simulations and experimental evaluations demonstrate that the compound lens provides a larger directivity compared to single lenses made of PDMS, epoxy, and liquid. The measured acceptance angles of a 6-mm piezoelectric acoustic transducer equipped with the compound, epoxy, liquid, and PDMS lenses are 55°, 36°, 25°, and 20°, respectively. No deformation is observed in the off-center targets by using compound lens. However, serious deformation appears in the cases using single lenses.

Focus scanning with feedback-control for fiber-optic nonlinear endomicroscopy

Fiber-optic endomicroscopes open new avenues for the application of non-linear optics to novel in vivo applications. To achieve focus scanning in vivo, shape memory alloy (SMA) wires have been used to move optical elements in miniature endomicroscopes. However, this method has various limitations, making it difficult to achieve accurate and reliable depth scanning. Here we present a feedback-controlled SMA depth scanner. With a Hall effect sensor, contraction of the SMA wire can be tracked in real time, rendering accurate and robust control of motion. The SMA depth scanner can achieve up to 490 µm travel and with open-loop operation, it can move more than 350 µm within one second. With the feedback loop engaged, submicron positioning accuracy was achieved along with superior positioning stability. The high-precision positioning capability of the SMA depth scanner was verified by depth-resolved nonlinear endomicroscopic imaging of mouse brain samples.

Clinically compatible flexible wide-field multi-color fluorescence endoscopy with a porcine colon model

Early detection of structural or molecular changes in dysplastic epithelial tissues is crucial for cancer screening and surveillance. Multi-targeting molecular endoscopic fluorescence imaging may improve noninvasive detection of precancerous lesions in the colon. Here, we report the first clinically compatible, wide-field-of-view, multi-color fluorescence endoscopy with a leached fiber bundle scope using a porcine model. A porcine colon model that resembles the human colon is used for the detection of surrogate tumors composed of multiple biocompatible fluorophores (FITC, ICG, and heavy metal-free quantum dots (hfQDs)). With an ex vivo porcine colon tumor model, molecular imaging with hfQDs conjugated with MMP14 antibody was achieved by spraying molecular probes on a mucosa layer that contains xenograft tumors. With an in vivo porcine colon embedded with surrogate tumors, target-to-background ratios of 3.36 ± 0.43, 2.70 ± 0.72, and 2.10 ± 0.13 were achieved for FITC, ICG, and hfQD probes, respectively. This promising endoscopic technology with molecular contrast shows the capacity to reveal hidden tumors and guide treatment strategy decisions.

In vivo photoacoustic lipid imaging in mice using the second near-infrared window

Photoacoustic imaging has emerged as a promising technique to improve preclinical and clinical imaging by providing users with label-free optical contrast of tissue. Here, we present a proof-of-concept study for noninvasive in vivo murine lipid imaging using 1210 nm light to investigate differences in periaortic fat among mice of different gender, genotypes, and maturation. Acquired lipid signals suggest that adult male apoE^-/- mice have greater periaortic fat accumulation compared to adolescent males, apoE^-/- females, and wild-type mice. These results demonstrate the potential of photoacoustic tomography for studying vascular pathophysiology and improving the diagnosis of lipid-based diseases.

Gabor fusion master slave optical coherence tomography

This paper describes the application of the Gabor filtering protocol to a Master/Slave (MS) swept source optical coherence tomography (SS)-OCT system at 1300 nm. The MS-OCT system delivers information from selected depths, a property that allows operation similar to that of a time domain OCT system, where dynamic focusing is possible. The Gabor filtering processing following collection of multiple data from different focus positions is different from that utilized by a conventional swept source OCT system using a Fast Fourier transform (FFT) to produce an A-scan. Instead of selecting the bright parts of A-scans for each focus position, to be placed in a final B-scan image (or in a final volume), and discarding the rest, the MS principle can be employed to advantageously deliver signal from the depths within each focus range only. The MS procedure is illustrated on creating volumes of data of constant transversal resolution from a cucumber and from an insect by repeating data acquisition for 4 different focus positions. In addition, advantage is taken from the tolerance to dispersion of the MS principle that allows automatic compensation for dispersion created by layers above the object of interest. By combining the two techniques, Gabor filtering and Master/Slave, a powerful imaging instrument is demonstrated. The master/slave technique allows simultaneous display of three categories of images in one frame: multiple depth en-face OCT images, two cross-sectional OCT images and a confocal like image obtained by averaging the en-face ones. We also demonstrate the superiority of MS-OCT over its FFT based counterpart when used with a Gabor filtering OCT instrument in terms of the speed of assembling the fused volume. For our case, we show that when more than 4 focus positions are required to produce the final volume, MS is faster than the conventional FFT based procedure.