Image restoration for three-dimensional fluorescence microscopy using an orthonormal basis for efficient representation of depth-variant point-spread functions

A depth-variant (DV) image restoration algorithm for wide field fluorescence microscopy, using an orthonormal basis decomposition of DV point-spread functions (PSFs), is investigated in this study. The efficient PSF representation is based on a previously developed principal component analysis (PCA), which is computationally intensive. We present an approach developed to reduce the number of DV PSFs required for the PCA computation, thereby making the PCA-based approach computationally tractable for thick samples. Restoration results from both synthetic and experimental images show consistency and that the proposed algorithm addresses efficiently depth-induced aberration using a small number of principal components. Comparison of the PCA-based algorithm with a previously-developed strata-based DV restoration algorithm demonstrates that the proposed method improves performance by 50% in terms of accuracy and simultaneously reduces the processing time by 64% using comparable computational resources.

Specific imaging of atherosclerotic plaque lipids with two-wavelength intravascular photoacoustics

The lipid content in plaques is an important marker for identifying atherosclerotic lesions and disease states. Intravascular photoacoustic (IVPA) imaging can be used to visualize lipids in the artery. In this study, we further investigated lipid detection in the 1.7-µm spectral range. By exploiting the relative difference between the IVPA signal strengths at 1718 and 1734 nm, we could successfully detect and differentiate between the plaque lipids and peri-adventitial fat in human coronary arteries ex vivo. Our study demonstrates that IVPA imaging can positively identify atherosclerotic plaques using only two wavelengths, which could enable rapid data acquisition in vivo.

Fast time-lens-based line-scan single-pixel camera with multi-wavelength source

A fast time-lens-based line-scan single-pixel camera with multi-wavelength source is proposed and experimentally demonstrated in this paper. A multi-wavelength laser instead of a mode-locked laser is used as the optical source. With a diffraction grating and dispersion compensating fibers, the spatial information of an object is converted into temporal waveforms which are then randomly encoded, temporally compressed and captured by a single-pixel photodetector. Two algorithms (the dictionary learning algorithm and the discrete cosine transform-based algorithm) for image reconstruction are employed, respectively. Results show that the dictionary learning algorithm has greater capability to reduce the number of compressive measurements than the DCT-based algorithm. The effective imaging frame rate increases from 200 kHz to 1 MHz, which shows a significant improvement in imaging speed over conventional single-pixel cameras.

InstantScope: a low-cost whole slide imaging system with instant focal plane detection

We report the development of a high-throughput whole slide imaging (WSI) system by adapting a cost-effective optomechanical add-on kit to existing microscopes. Inspired by the phase detection concept in professional photography, we attached two pinhole-modulated cameras at the eyepiece ports for instant focal plane detection. By adjusting the positions of the pinholes, we can effectively change the view angle for the sample, and as such, we can use the translation shift of the two pinhole-modulated images to identify the optimal focal position. By using a small pinhole size, the focal-plane-detection range is on the order of millimeter, orders of magnitude longer than the objective's depth of field. We also show that, by analyzing the phase correlation of the pinhole-modulated images, we can determine whether the sample contains one thin section, folded sections, or multiple layers separated by certain distances - an important piece of information prior to a detailed z scan. In order to achieve system automation, we deployed a low-cost programmable robotic arm to perform sample loading and $14 stepper motors to drive the microscope stage to perform x-y scanning. Using a 20X objective lens, we can acquire a 2 gigapixel image with 14 mm by 8 mm field of view in 90 seconds. The reported platform may find applications in biomedical research, telemedicine, and digital pathology. It may also provide new insights for the development of high-content screening instruments.

Macro-optical trapping for sample confinement in light sheet microscopy

Light sheet microscopy is a powerful approach to construct three-dimensional images of large specimens with minimal photo-damage and photo-bleaching. To date, the specimens are usually mounted in agents such as agarose, potentially restricting the development of live samples, and also highly mobile specimens need to be anaesthetized before imaging. To overcome these problems, here we demonstrate an integrated light sheet microscope which solely uses optical forces to trap and hold the sample using a counter-propagating laser beam geometry. Specifically, tobacco plant cells and living Spirobranchus lamarcki larvae were successfully trapped and sectional images acquired. This novel approach has the potential to significantly expand the range of applications for light sheet imaging.

MEMS-based multiphoton endomicroscope for repetitive imaging of mouse colon

We demonstrate a handheld multiphoton endomicroscope with 3.4 mm distal diameter that can repetitively image mouse colon in vivo. A 2D resonant MEMS mirror was developed to perform beam scanning in a Lissajous pattern. The instrument has an effective numerical aperture of 0.63, lateral and axial resolution of 2.03 and 9.02 μm, respectively, working distance of 60 μm, and image field-of-view of 300 × 300 μm(2). Hoechst was injected intravenously in mice to stain cell nuclei. We were able to collect histology-like images in vivo at 5 frames/sec, and distinguish between normal and pre-malignant colonic epithelium.

Multimodal nonlinear endo-microscopy probe design for high resolution, label-free intraoperative imaging

We present a portable, multimodal, nonlinear endo-microscopy probe designed for intraoperative oncological imaging. Application of a four-wave mixing noise suppression scheme using dual wavelength wave plates (DWW) and a polarization-maintaining fiber improves tissue signal collection efficiency, allowing for miniaturization. The probe, with a small 14 mm transversal diameter, includes a customized miniaturized two-axis MEMS (micro-electromechanical system) raster scanning mirror and micro-optics with an illumination laser delivered by a polarization-maintaining fiber. The probe can potentially be integrated into the arms of a surgical robot, such as da Vinci robotic surgery system, due to its minimal cross sectional area. It has the ability to incorporate multiple imaging modalities including CARS (coherent anti-Stokes Raman scattering), SHG (second harmonic generation), and TPEF (two-photon excited fluorescence) in order to allow the surgeon to locate tumor cells within the context of normal stromal tissue. The resolution of the endo-microscope is experimentally determined to be 0.78 µm, a high level of accuracy for such a compact probe setup. The expected resolution of the as-built multimodal, nonlinear, endo-microscopy probe is 1 µm based on the calculation tolerance allocation using Monte-Carlo simulation. The reported probe is intended for use in laparoscopic or radical prostatectomy, including detection of tumor margins and avoidance of nerve impairment during surgery.

Electrically tunable lens speeds up 3D orbital tracking

3D orbital particle tracking is a versatile and effective microscopy technique that allows following fast moving fluorescent objects within living cells and reconstructing complex 3D shapes using laser scanning microscopes. We demonstrated notable improvements in the range, speed and accuracy of 3D orbital particle tracking by replacing commonly used piezoelectric stages with Electrically Tunable Lens (ETL) that eliminates mechanical movement of objective lenses. This allowed tracking and reconstructing shape of structures extending 500 microns in the axial direction. Using the ETL, we tracked at high speed fluorescently labeled genomic loci within the nucleus of living cells with unprecedented temporal resolution of 8ms using a 1.42NA oil-immersion objective. The presented technology is cost effective and allows easy upgrade of scanning microscopes for fast 3D orbital tracking.

Dual-slit confocal light sheet microscopy for in vivo whole-brain imaging of zebrafish

In vivo functional imaging at single-neuron resolution is an important approach to visualize biological processes in neuroscience. Light sheet microscopy (LSM) is a cutting edge in vivo imaging technique that provides micron-scale spatial resolution at high frame rate. Due to the scattering and absorption of tissue, however, conventional LSM is inadequate to resolve cells because of the attenuated signal to noise ratio (SNR). Using dual-beam illumination and confocal dual-slit detection, here a dual-slit confocal LSM is demonstrated to obtain the SNR enhanced images with frame rate twice as high as line confocal LSM method. Through theoretical calculations and experiments, the correlation between the slit's width and SNR was determined to optimize the image quality. In vivo whole brain structural imaging stacks and the functional imaging sequences of single slice were obtained for analysis of calcium activities at single-cell resolution. A two-fold increase in imaging speed of conventional confocal LSM makes it possible to capture the sequence of the neurons' activities and help reveal the potential functional connections in the whole zebrafish's brain.

Detection of urinary bladder cancer cells using redox ratio and double excitation wavelengths autofluorescence

The optical redox ratio as a measure of cellular metabolism is determined by an altered ratio between endogenous fluorophores NADH and flavin adenine dinucleotide (FAD). Although reported for other cancer sites, differences in optical redox ratio between cancerous and normal urothelial cells have not previously been reported. Here, we report a method for the detection of cellular metabolic states using flow cytometry based on autofluorescence, and a statistically significant increase in the redox ratio of bladder cancer cells compared to healthy controls. Urinary bladder cancer and normal healthy urothelial cell lines were cultured and redox overview was assessed using flow cytometry. Further localisation of fluorescence in the same cells was carried out using confocal microscopy. Multiple experiments show correlation between cell type and redox ratio, clearly differentiating between healthy cells and cancer cells. Based on our preliminary results, therefore, we believe that this data contributes to current understanding of bladder tissue fluorescence and can inform the design of endoscopic probes. This approach also has significant potential as a diagnostic tool for discrimination of cancer cells among shed urothelial cells in voided urine, and could lay the groundwork for an automated system for population screening for bladder cancer.

Optimizing and extending light-sculpting microscopy for fast functional imaging in neuroscience

A number of questions in system biology such as understanding how dynamics of neuronal networks are related to brain function require the ability to capture the functional dynamics of large cellular populations at high speed. Recently, this has driven the development of a number of parallel and high speed imaging techniques such as light-sculpting microscopy, which has been used to capture neuronal dynamics at the whole brain and single cell level in small model organisms. However, the broader applicability of light-sculpting microcopy is limited by the size of volumes for which high speed imaging can be obtained and scattering in brain tissue. Here, we present strategies for optimizing the present tradeoffs in light-sculpting microscopy. Various scanning modalities in light-sculpting microscopy are theoretically and experimentally evaluated, and strategies to maximize the obtainable volume speeds, and depth penetration in brain tissue using different laser systems are provided. Design-choices, important parameters and their trade-offs are experimentally demonstrated by performing calcium-imaging in acute mouse-brain slices. We further show that synchronization of line-scanning techniques with rolling-shutter read-out of the camera can reduce scattering effects and enhance image contrast at depth.

Development of an integrated optical coherence tomography-gas nozzle system for surgical laser ablation applications: preliminary findings of in situ spinal cord deformation due to gas flow effects

Gas assisted laser machining of materials is a common practice in the manufacturing industry. Advantages in using gas assistance include reducing the likelihood of flare-ups in flammable materials and clearing away ablated material in the cutting path. Current surgical procedures and research do not take advantage of this and in the case for resecting osseous tissue, gas assisted ablation can help minimize charring and clear away debris from the surgical site. In the context of neurosurgery, the objective is to cut through osseous tissue without damaging the underlying neural structures. Different inert gas flow rates used in laser machining could cause deformations in compliant materials. Complications may arise during surgical procedures if the dura and spinal cord are damaged by these deformations. We present preliminary spinal deformation findings for various gas flow rates by using optical coherence tomography to measure the depression depth at the site of gas delivery.

A polarized multispectral imaging system for quantitative assessment of hypertrophic scars

Hypertrophic scars (HTS) are a pathologic reaction of the skin and soft tissue to burn or other traumatic injury. Scar tissue can cause patients serious functional and cosmetic issues. Scar management strategies, specifically scar assessment techniques, are vital to improve clinical outcome. To date, no entirely objective method for scar assessment has been embraced by the medical community. In this study, we introduce for the first time, a novel polarized multispectral imaging system combining out-of-plane Stokes polarimetry and Spatial Frequency Domain Imaging (SFDI). This imaging system enables us to assess the pathophysiology (hemoglobin, blood oxygenation, water, and melanin) and structural features (cellularity and roughness) of HTS. To apply the proposed technique in an in vivo experiment, dermal wounds were created in a porcine model and allowed to form into scars. The developed scars were then measured at various time points using the imaging system. Results showed a good agreement with clinical Vancouver Scar Scale assessment and histological examinations.

A high-efficiency fiber-based imaging system for co-registered autofluorescence and optical coherence tomography

We present a power-efficient fiber-based imaging system capable of co-registered autofluorescence imaging and optical coherence tomography (AF/OCT). The system employs a custom fiber optic rotary joint (FORJ) with an embedded dichroic mirror to efficiently combine the OCT and AF pathways. This three-port wavelength multiplexing FORJ setup has a throughput of more than 83% for collected AF emission, significantly more efficient compared to previously reported fiber-based methods. A custom 900 µm diameter catheter ‒ consisting of a rotating lens assembly, double-clad fiber (DCF), and torque cable in a stationary plastic tube ‒ was fabricated to allow AF/OCT imaging of small airways in vivo. We demonstrate the performance of this system ex vivo in resected porcine airway specimens and in vivo in human on fingers, in the oral cavity, and in peripheral airways.

Design of miniaturized illumination for transvaginal co-registered photoacoustic and ultrasound imaging

A novel lens-array based illumination design for a compact co-registered photoacoustic/ultrasound transvaginal probe has been demonstrated. The lens array consists of four cylindrical lenses that couple the laser beams into four 1-mm-core multi-mode optical fibers with optical coupling efficiency of ~87%. The feasibility of our lens array was investigated by simulating the lenses and laser beam profiles using Zemax. The laser fluence on the tissue surface was experimentally measured and was below the American National Standards Institute (ANSI) safety limit. Spatial distribution of hemoglobin oxygen saturation (sO2) of a mouse tumor was obtained in vivo using photoacoustic measurements at multiple wavelengths. Furthermore, benign and malignant ovaries were imaged ex vivo and evaluated histologically. The co-registered images clearly showed different patterns of blood vasculature. These results highlight the clinical potential of our system for noninvasive photoacoustic and ultrasound imaging of ovarian tissue and cancer detection and diagnosis.

High resolution three-dimensional photoacoutic tomography with CCD-camera based ultrasound detection

A photoacoustic tomograph based on optical ultrasound detection is demonstrated, which is capable of high resolution real-time projection imaging and fast three-dimensional (3D) imaging. Snapshots of the pressure field outside the imaged object are taken at defined delay times after photoacoustic excitation by use of a charge coupled device (CCD) camera in combination with an optical phase contrast method. From the obtained wave patterns photoacoustic projection images are reconstructed using a back propagation Fourier domain reconstruction algorithm. Applying the inverse Radon transform to a set of projections recorded over a half rotation of the sample provides 3D photoacoustic tomography images in less than one minute with a resolution below 100 µm. The sensitivity of the device was experimentally determined to be 5.1 kPa over a projection length of 1 mm. In vivo images of the vasculature of a mouse demonstrate the potential of the developed method for biomedical applications.

Fiber-based polarization-sensitive OCT of the human retina with correction of system polarization distortions

In polarization-sensitive optical coherence tomography (PS-OCT) the use of single-mode fibers causes unpredictable polarization distortions which can result in increased noise levels and erroneous changes in calculated polarization parameters. In the current paper this problem is addressed by a new Jones matrix analysis method that measures and corrects system polarization distortions as a function of wavenumber by spectral analysis of the sample surface polarization state and deeper located birefringent tissue structures. This method was implemented on a passive-component depth-multiplexed swept-source PS-OCT system at 1040 nm which was theoretically modeled using Jones matrix calculus. High-resolution B-scan images are presented of the double-pass phase retardation, diattenuation, and relative optic axis orientation to show the benefits of the new analysis method for in vivo imaging of the human retina. The correction of system polarization distortions yielded reduced phase retardation noise, and better estimates of the diattenuation and the relative optic axis orientation in weakly birefringent tissues. The clinical potential of the system is shown by en face visualization of the phase retardation and optic axis orientation of the retinal nerve fiber layer in a healthy volunteer and a glaucoma patient with nerve fiber loss.

Characterization and in-vivo evaluation of a multi-resolution foveated laparoscope for minimally invasive surgery

The state-of-the-art laparoscope lacks the ability to capture high-magnification and wide-angle images simultaneously, which introduces challenges when both close- up views for details and wide-angle overviews for orientation are required in clinical practice. A multi-resolution foveated laparoscope (MRFL) which can provide the surgeon both high-magnification close-up and wide-angle images was proposed to address the limitations of the state-of-art surgical laparoscopes. In this paper, we present the overall system design from both clinical and optical system perspectives along with a set of experiments to characterize the optical performances of our prototype system and describe our preliminary in-vivo evaluation of the prototype with a pig model. The experimental results demonstrate that at the optimum working distance of 120mm, the high-magnification probe has a resolution of 6.35lp/mm and image a surgical area of 53 × 40mm(2); the wide-angle probe provides a surgical area coverage of 160 × 120mm(2) with a resolution of 2.83lp/mm. The in-vivo evaluation demonstrates that MRFL has great potential in clinical applications for improving the safety and efficiency of the laparoscopic surgery.

Single camera imaging system for color and near-infrared fluorescence image guided surgery

Near-infrared (NIR) fluorescence imaging systems have been developed for image guided surgery in recent years. However, current systems are typically bulky and work only when surgical light in the operating room (OR) is off. We propose a single camera imaging system that is capable of capturing NIR fluorescence and color images under normal surgical lighting illumination. Using a new RGB-NIR sensor and synchronized NIR excitation illumination, we have demonstrated that the system can acquire both color information and fluorescence signal with high sensitivity under normal surgical lighting illumination. The experimental results show that ICG sample with concentration of 0.13 μM can be detected when the excitation irradiance is 3.92 mW/cm(2) at an exposure time of 10 ms.

Incorporating MRI structural information into bioluminescence tomography: system, heterogeneous reconstruction and in vivo quantification

Combining two or more imaging modalities to provide complementary information has become commonplace in clinical practice and in preclinical and basic biomedical research. By incorporating the structural information provided by computed tomography (CT) or magnetic resonance imaging (MRI), the ill poseness nature of bioluminescence tomography (BLT) can be reduced significantly, thus improve the accuracies of reconstruction and in vivo quantification. In this paper, we present a small animal imaging system combining multi-view and multi-spectral BLT with MRI. The independent MRI-compatible optical device is placed at the end of the clinical MRI scanner. The small animal is transferred between the light tight chamber of the optical device and the animal coil of MRI via a guide rail during the experiment. After the optical imaging and MRI scanning procedures are finished, the optical images are mapped onto the MRI surface by interactive registration between boundary of optical images and silhouette of MRI. Then, incorporating the MRI structural information, a heterogeneous reconstruction algorithm based on finite element method (FEM) with L 1 normalization is used to reconstruct the position, power and region of the light source. In order to validate the feasibility of the system, we conducted experiments of nude mice model implanted with artificial light source and quantitative analysis of tumor inoculation model with MDA-231-GFP-luc. Preliminary results suggest the feasibility and effectiveness of the prototype system.

Detection limits of confocal surface plasmon microscopy

This paper applies rigorous diffraction theory to evaluate the minimum mass sensitivity of a confocal optical microscope designed to excite and detect surface plasmons operating on a planar metallic substrate. The diffraction model is compared with an intuitive ray picture which gives remarkably similar predictions. The combination of focusing the surface plasmons and accurate phase measurement mean that under favorable but achievable conditions detection of small numbers of molecules is possible, however, we argue that reliable detection of single molecules will benefit from the use of structured surfaces. System configurations needed to optimize performance are discussed.

Fabricating low cost and high performance elastomer lenses using hanging droplets

Existing methods for low cost lenses using parallel mold stamping and high temperature reflow requires complex engineering controls to produce high quality lenses. These manufacturing techniques rely on expensive equipment. In this paper, we propose a low cost (< $ 0.01 per pc) flexible moldless lens fabrication method based on curing a hanging transparent polydimethylsiloxane (PDMS) elastomer droplet on a curved substrate. Additional deposition of hanging droplets in the same manner led to a substantial increase in the lens curvature and concomitant decrease in the focal length of the PDMS lenses down to ~2 mm. The shortest focal length lenses were shown to collimate light from a bare light emitting diode (LED) and image microscopic structures down to around 4 µm with 160x magnification. Our hanging droplet lens fabrication technique heralds a new paradigm in the manufacture of low cost, high performance optical lenses for the masses. Using these lenses, we were able to transform an ordinary commercial smartphone camera into a low-cost digital dermascope (60x magnification) that can readily visualize microscopic structures on skin such as sweat pores.

Shadowless-illuminated variable-angle TIRF (siva-TIRF) microscopy for the observation of spatial-temporal dynamics in live cells

Total-internal-reflection fluorescence (TIRF) microscopy provides high optical-sectioning capability and a good signal-contrast ratio for structures near the surfaces of cells. In recent years, several improvements have been developed, such as variable-angle TIRF (VA-TIRF) and spinning TIRF (sp-TIRF), which permit quantitative image analysis and address non-uniform scattering fringes, respectively. Here, we present a dual-color DMD-based shadowless-illuminated variable-angle TIRF (siva-TIRF) system that provides a uniform illumination field. By adjusting the incidence angle of the illuminating laser on the back focal plane (BFP) of the objective, we can rapidly illuminate biological samples in layers of various thicknesses in TIRF or hollow-cone epi-fluorescence mode. Compared with other methods of accomplishing VA-TIRF/sp-TIRF illumination, our system is simple to build and cost-effective, and it provides optimal multi-plane dual-color images. By showing spatiotemporal correlated movement of clathrin-coated structures with microtubule filaments from various layers of live cells, we demonstrate that cortical microtubules are important spatial regulators of clathrin-coated structures. Moreover, our system can be used to prove superb axial information of three-dimensional movement of structures near the plasma membrane within live cells.

Intravital imaging of mouse colonic adenoma using MMP-based molecular probes with multi-channel fluorescence endoscopy

Intravital imaging has provided molecular, cellular and anatomical insight into the study of tumor. Early detection and treatment of gastrointestinal (GI) diseases can be enhanced with specific molecular markers and endoscopic imaging modalities. We present a wide-field multi-channel fluorescence endoscope to screen GI tract for colon cancer using multiple molecular probes targeting matrix metalloproteinases (MMP) conjugated with quantum dots (QD) in AOM/DSS mouse model. MMP9 and MMP14 antibody (Ab)-QD conjugates demonstrate specific binding to colonic adenoma. The average target-to-background (T/B) ratios are 2.10 ± 0.28 and 1.78 ± 0.18 for MMP14 Ab-QD and MMP9 Ab-QD, respectively. The overlap between the two molecular probes is 67.7 ± 8.4%. The presence of false negative indicates that even more number of targeting could increase the sensitivity of overall detection given heterogeneous molecular expression in tumors. Our approach indicates potential for the screening of small or flat lesions that are precancerous.

Handheld Diffuse Reflectance Spectral Imaging (DRSi) for in-vivo characterization of skin

Diffuse reflectance spectroscopy provides a noninvasive means to measure optical and physiological properties of tissues. To expand on these measurements, we have developed a handheld diffuse reflectance spectral imaging (DRSi) system capable of acquiring wide field hyperspectral images of tissue. The image acquisition time was approximately 50 seconds for a 50x50 pixel image. A transport model was used to fit each spectra for reduced scattering coefficient, hemoglobin concentration and melanin concentration resulting in optical property maps. The system was validated across biologically relevant levels of reduced scattering (5.14% error) and absorption (8.34% error) using tissue simulating phantoms. DRSi optical property maps of a pigmented skin lesion were acquired in vivo. These trends in optical properties were consistent with previous observations using point probe devices.