AOTF microscope for imaging with increased speed and spectral versatility

Comparing Performance of Spectral Image Analysis Approaches for Detection of Cellular Signals in Time-Lapse Hyperspectral Imaging Fluorescence Excitation-Scanning Microscopy

Hyperspectral imaging (HSI) technology has been applied in a range of fields for target detection and mixture analysis. While HSI was originally developed for remote sensing applications, modern uses include agriculture, historical document authentication, and medicine. HSI has also shown great utility in fluorescence microscopy. However, traditional fluorescence microscopy HSI systems have suffered from limited signal strength due to the need to filter or disperse the emitted light across many spectral bands. We have previously demonstrated that sampling the fluorescence excitation spectrum may provide an alternative approach with improved signal strength. Here, we report on the use of excitation-scanning HSI for dynamic cell signaling studies-in this case, the study of the second messenger Ca2+. Time-lapse excitation-scanning HSI data of Ca2+ signals in human airway smooth muscle cells (HASMCs) were acquired and analyzed using four spectral analysis algorithms: linear unmixing (LU), spectral angle mapper (SAM), constrained energy minimization (CEM), and matched filter (MF), and the performances were compared. Results indicate that LU and MF provided similar linear responses to increasing Ca2+ and could both be effectively used for excitation-scanning HSI. A theoretical sensitivity framework was used to enable the filtering of analyzed images to reject pixels with signals below a minimum detectable limit. The results indicated that subtle kinetic features might be revealed through pixel filtering. Overall, the results suggest that excitation-scanning HSI can be employed for kinetic measurements of cell signals or other dynamic cellular events and that the selection of an appropriate analysis algorithm and pixel filtering may aid in the extraction of quantitative signal traces. These approaches may be especially helpful for cases where the signal of interest is masked by strong cellular autofluorescence or other competing signals.

Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging

Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogram sampling required. In this work, we apply deep learning to FTIS and show that the interferogram sampling can be drastically reduced by an order of magnitude without noticeable degradation in the image quality. For the demonstration, we use bovine pulmonary artery endothelial cells stained with three fluorescent dyes and 10 types of fluorescent beads with close emission peaks. Further, we show that the deep learning approach is more robust to the translation stage error and environmental vibrations. Thereby, the He-Ne correction, which is typically required for FTIS, can be bypassed, thus reducing the cost, size, and complexity of the FTIS system. Finally, we construct neural network models using Hyperband, an automatic hyperparameter selection algorithm, and compare the performance with our manually-optimized model.

Single wavelength colour tuning of spiropyran and dithienylethene based photochromic coatings

Controlling the transmission of thin films with external stimuli is an important goal in functional optical materials and devices. Tuning is especially challenging where both broad band (neutral density filtering) and spectrally varied (colour) transmission are required. The external control provided by photochemically driven switching, between transmission levels and colours, is functionally simple from a device perspective. The limits due to the spectral ranges of individual photochromic compounds can be overcome by combining several photochromes within one material or device. Here we show that a combination of photochromic molecular switches immobilised in a PMMA polymer matrix enables tuning of colour and transparency. We show that only a single excitation wavelength is required through the use of the primary inner filter effect and the layered construction of the films in which the photochromes nitrospiropyran (NSP), and nitrothiospiropyran (TSP) or 1,2-bis-terthienyl-hexafluorocyclopentene (DTE) are separated spatially. The approach taken circumvents the need to match photochemical quantum yields and thermal reactivity of the component photochromes. The photochemical switching of the films was characterised by UV/vis absorption spectroscopy and shows that switching rates and photostationary states are limited by inner filter effects rather than the intrinsic properties of photochromes, such as photochemical quantum yields and thermal stability. The photochemical behaviour and stability of the photochromes in solution and in the PMMA films were compared and the concentration range over which self-inhibition of photochemical switching occurs was established. The rate of photochemical switching and the difference in transmission between the spiropyran and merocyanine forms in solution enable prediction of the performance in the films and enable rational design of colour tuning ranges and responsivity in thin film filters.

Biomedical Applications of Translational Optical Imaging: From Molecules to Humans

Light is a powerful investigational tool in biomedicine, at all levels of structural organization. Its multitude of features (intensity, wavelength, polarization, interference, coherence, timing, non-linear absorption, and even interactions with itself) able to create contrast, and thus images that detail the makeup and functioning of the living state can and should be combined for maximum effect, especially if one seeks simultaneously high spatiotemporal resolution and discrimination ability within a living organism. The resulting high relevance should be directed towards a better understanding, detection of abnormalities, and ultimately cogent, precise, and effective intervention. The new optical methods and their combinations needed to address modern surgery in the operating room of the future, and major diseases such as cancer and neurodegeneration are reviewed here, with emphasis on our own work and highlighting selected applications focusing on quantitation, early detection, treatment assessment, and clinical relevance, and more generally matching the quality of the optical detection approach to the complexity of the disease. This should provide guidance for future advanced theranostics, emphasizing a tighter coupling-spatially and temporally-between detection, diagnosis, and treatment, in the hope that technologic sophistication such as that of a Mars rover can be translationally deployed in the clinic, for saving and improving lives.

Excitation spectral microscopy for highly multiplexed fluorescence imaging and quantitative biosensing

The multiplexing capability of fluorescence microscopy is severely limited by the broad fluorescence spectral width. Spectral imaging offers potential solutions, yet typical approaches to disperse the local emission spectra notably impede the attainable throughput. Here we show that using a single, fixed fluorescence emission detection band, through frame-synchronized fast scanning of the excitation wavelength from a white lamp via an acousto-optic tunable filter, up to six subcellular targets, labeled by common fluorophores of substantial spectral overlap, can be simultaneously imaged in live cells with low (~1%) crosstalks and high temporal resolutions (down to ~10 ms). The demonstrated capability to quantify the abundances of different fluorophores in the same sample through unmixing the excitation spectra next enables us to devise novel, quantitative imaging schemes for both bi-state and Förster resonance energy transfer fluorescent biosensors in live cells. We thus achieve high sensitivities and spatiotemporal resolutions in quantifying the mitochondrial matrix pH and intracellular macromolecular crowding, and further demonstrate, for the first time, the multiplexing of absolute pH imaging with three additional target organelles/proteins to elucidate the complex, Parkin-mediated mitophagy pathway. Together, excitation spectral microscopy provides exceptional opportunities for highly multiplexed fluorescence imaging. The prospect of acquiring fast spectral images without the need for fluorescence dispersion or care for the spectral response of the detector offers tremendous potential.

A theoretical-experimental methodology for assessing the sensitivity of biomedical spectral imaging platforms, assays, and analysis methods

Spectral imaging technologies have been used for many years by the remote sensing community. More recently, these approaches have been applied to biomedical problems, where they have shown great promise. However, biomedical spectral imaging has been complicated by the high variance of biological data and the reduced ability to construct test scenarios with fixed ground truths. Hence, it has been difficult to objectively assess and compare biomedical spectral imaging assays and technologies. Here, we present a standardized methodology that allows assessment of the performance of biomedical spectral imaging equipment, assays, and analysis algorithms. This methodology incorporates real experimental data and a theoretical sensitivity analysis, preserving the variability present in biomedical image data. We demonstrate that this approach can be applied in several ways: to compare the effectiveness of spectral analysis algorithms, to compare the response of different imaging platforms, and to assess the level of target signature required to achieve a desired performance. Results indicate that it is possible to compare even very different hardware platforms using this methodology. Future applications could include a range of optimization tasks, such as maximizing detection sensitivity or acquisition speed, providing high utility for investigators ranging from design engineers to biomedical scientists.

Chromatic aberrations correction for imaging spectrometer based on acousto-optic tunable filter with two transducers

The acousto-optic tunable filter (AOTF) with wide wavelength range and high spectral resolution has long crystal and two transducers. A longer crystal length leads to a bigger chromatic focal shift and the double-transducer arrangement induces angular mutation in diffracted beam, which increase difficulty in longitudinal and lateral chromatic aberration correction respectively. In this study, the two chromatic aberrations are analyzed quantitatively based on an AOTF optical model and a novel catadioptric dual-path configuration is proposed to correct both the chromatic aberrations. The test results exhibit effectiveness of the optical configuration for this type of AOTF-based imaging spectrometer.

Rapid microscopy measurement of very large spectral images

The spectral content of a sample provides important information that cannot be detected by the human eye or by using an ordinary RGB camera. The spectrum is typically a fingerprint of the chemical compound, its environmental conditions, phase and geometry. Thus measuring the spectrum at each point of a sample is important for a large range of applications from art preservation through forensics to pathological analysis of a tissue section. To date, however, there is no system that can measure the spectral image of a large sample in a reasonable time. Here we present a novel method for scanning very large spectral images of microscopy samples even if they cannot be viewed in a single field of view of the camera. The system is based on capturing information while the sample is being scanned continuously 'on the fly'. Spectral separation implements Fourier spectroscopy by using an interferometer mounted along the optical axis. High spectral resolution of ~5 nm at 500 nm could be achieved with a diffraction-limited spatial resolution. The acquisition time is fairly high and takes 6-8 minutes for a sample size of 10mm x 10mm measured under a bright-field microscope using a 20X magnification.

Improvements to a Grating-Based Spectral Imaging Microscope and Its Application to Reflectance Analysis of Blue Pen Inks

A modified design of a chromatically resolved optical microscope (CROMoscope), a grating-based spectral imaging microscope, is described. By altering the geometry and adding a beam splitter, a twisting aberration that was present in the first version of the CROMoscope has been removed. Wavelength adjustment has been automated to decrease analysis time. Performance of the new design in transmission-absorption spectroscopy has been evaluated and found to be generally similar to the performance of the previous design. Spectral bandpass was found to be dependent on the sizes of apertures, and the smallest measured spectral bandpass was 1.8 nm with 1.0 mm diameter apertures. Wavelength was found to be very linear with the sine of the grating angle (R(2) = 0.9999995), and wavelength repeatability was found to be much better than the spectral bandpass. Reflectance spectral imaging with a CROMoscope is reported for the first time, and this reflectance spectral imaging was applied to blue ink samples on white paper. As a proof of concept, linear discriminant analysis was used to classify the inks by brand. In a leave-one-out cross-validation, 97.6% of samples were correctly classified.

High-throughput, quantitative enzyme kinetic analysis in microdroplets using stroboscopic epifluorescence imaging

Droplet-based microfluidic systems offer a range of advantageous features for the investigation of enzyme kinetics, including high time resolution and the ability to probe extremely large numbers of discrete reactions while consuming low sample volumes. Kinetic measurements within droplet-based microfluidic systems are conventionally performed using single point detection schemes. Unfortunately, such an approach prohibits the measurement of an individual droplet over an extended period of time. Accordingly, we present a novel approach for the extensive characterization of enzyme-inhibitor reaction kinetics within a single experiment by tracking individual and rapidly moving droplets as they pass through an extended microfluidic channel. A series of heterogeneous and pL-volume droplets, containing varying concentrations of the fluorogenic substrate resorufin β-d-galactopyranoside and a constant amount of the enzyme β-galactosidase, is produced at frequencies in excess of 150 Hz. By stroboscopic manipulation of the excitation laser light and adoption of a dual view detection system, "blur-free" images containing up to 150 clearly distinguishable droplets per frame are extracted, which allow extraction of kinetic data from all formed droplets. The efficiency of this approach is demonstrated via a Michaelis-Menten analysis which yields a Michaelis constant, Km, of 353 μM. Additionally, the dissociation constant for the competitive inhibitor isopropyl β-d-1-thiogalactopyranoside is extracted using the same method.

Assessing the feasibility and accuracy of digitizing edentulous jaws

BACKGROUND

Despite the accuracy of intraoral scanners (IOSs) in producing single-unit scans and the possibility of generating complete dentures digitally, little is known about their feasibility and accuracy in digitizing edentulous jaws. The purpose of this in vitro investigation was to evaluate the feasibility and accuracy of digitizing edentulous jaw models with IOSs.

METHODS

The authors used an industrial laser scanner (reference scanner) and four IOSs to digitize two representative edentulous jaw models. They loaded the data sets obtained into three-dimensional evaluation software, superimposed the data sets and compared them for accuracy. The authors used a one-way analysis of variance to compute differences within groups (precision), as well as to compare values with those of the reference scanner (trueness) (statistical significance, P < .05).

RESULTS

Mean trueness values ranged from 44.1 to 591.8 micrometers. Data analysis yielded statistically significant differences in trueness between all scanners (P < .05). Mean precision values ranged from 21.6 to 698.0 μm. The study results showed statistically significant differences in precision between all scanners (P < .05), except for the CEREC AC Bluecam (Sirona, Bensheim, Germany) and the Zfx IntraScan (manufactured by MHT Italy, Negrar, Italy/ MHT Optic Research, Niederhasli, Switzerland; distributed by Zfx, Dachau, Germany) (P > .05).

CONCLUSIONS

Digitizing edentulous jaw models with the use of IOSs appears to be feasible, although the accuracy of the scanners differs significantly. The results of this study showed that only one scanner was sufficiently accurate to warrant further intraoral investigations. Further enhancements are necessary to recommend these IOSs for this particular indication. Practical Implications. On the basis of the results of this study, the authors cannot recommend these four IOSs for digitization of edentulous jaws in vivo.

Fabry-Perot-based Fourier-transform hyperspectral imaging allows multi-labeled fluorescence analysis

We demonstrate the ability of our hyperspectral imaging device, based on a scanning Fabry-Perot interferometer, to obtain a single hyper-image of a sample marked with different fluorescent molecules, and to unambiguously discriminate them by observing their spectral fingerprints. An experiment carried out with cyanines, fluorescein, and quantum dots emitting in the yellow-orange region, demonstrates the feasibility of multi-labeled fluorescence microscopy without the use of multiple filter sets or dispersive means.

Excitation-scanning hyperspectral imaging microscope

Hyperspectral imaging is a versatile tool that has recently been applied to a variety of biomedical applications, notably live-cell and whole-tissue signaling. Traditional hyperspectral imaging approaches filter the fluorescence emission over a broad wavelength range while exciting at a single band. However, these emission-scanning approaches have shown reduced sensitivity due to light attenuation from spectral filtering. Consequently, emission scanning has limited applicability for time-sensitive studies and photosensitive applications. In this work, we have developed an excitation-scanning hyperspectral imaging microscope that overcomes these limitations by providing high transmission with short acquisition times. This is achieved by filtering the fluorescence excitation rather than the emission. We tested the efficacy of the excitation-scanning microscope in a side-by-side comparison with emission scanning for detection of green fluorescent protein (GFP)-expressing endothelial cells in highly autofluorescent lung tissue. Excitation scanning provided higher signal-to-noise characteristics, as well as shorter acquisition times (300  ms/wavelength band with excitation scanning versus 3  s/wavelength band with emission scanning). Excitation scanning also provided higher delineation of nuclear and cell borders, and increased identification of GFP regions in highly autofluorescent tissue. These results demonstrate excitation scanning has utility in a wide range of time-dependent and photosensitive applications.

Thin-film tunable filters for hyperspectral fluorescence microscopy

Hyperspectral imaging is a powerful tool that acquires data from many spectral bands, forming a contiguous spectrum. Hyperspectral imaging was originally developed for remote sensing applications; however, hyperspectral techniques have since been applied to biological fluorescence imaging applications, such as fluorescence microscopy and small animal fluorescence imaging. The spectral filtering method largely determines the sensitivity and specificity of any hyperspectral imaging system. There are several types of spectral filtering hardware available for microscopy systems, most commonly acousto-optic tunable filters (AOTFs) and liquid crystal tunable filters (LCTFs). These filtering technologies have advantages and disadvantages. Here, we present a novel tunable filter for hyperspectral imaging-the thin-film tunable filter (TFTF). The TFTF presents several advantages over AOTFs and LCTFs, most notably, a high percentage transmission and a high out-of-band optical density (OD). We present a comparison of a TFTF-based hyperspectral microscopy system and a commercially available AOTF-based system. We have characterized the light transmission, wavelength calibration, and OD of both systems, and have then evaluated the capability of each system for discriminating between green fluorescent protein and highly autofluorescent lung tissue. Our results suggest that TFTFs are an alternative approach for hyperspectral filtering that offers improved transmission and out-of-band blocking. These characteristics make TFTFs well suited for other biomedical imaging devices, such as ophthalmoscopes or endoscopes.

AOTF based molecular hyperspectral imaging system and its applications on nerve morphometry

The neuroanatomical morphology of nerve fibers is an important description for understanding the pathological aspects of nerves. Different from the traditional automatic nerve morphometry methods, a molecular hyperspectral imaging system based on an acousto-optic tunable filter (AOTF) was developed and used to identify unstained nerve histological sections. The hardware, software, and system performance of the imaging system are presented and discussed. The gray correction coefficient was used to calibrate the system's spectral response and to remove the effects of noises and artifacts. A spatial-spectral kernel-based approach through the support vector machine formulation was proposed to identify nerve fibers. This algorithm can jointly use both the spatial and spectral information of molecular hyperspectral images for segmentation. Then, the morphological parameters such as fiber diameter, axon diameter, myelin sheath thickness, fiber area, and g-ratio were calculated and evaluated. Experimental results show that the hyperspectral-based method has the potential to recognize and measure the nerve fiber more accurately than traditional methods.

Active DLP hyperspectral illumination: a noninvasive, in vivo, system characterization visualizing tissue oxygenation at near video rates

We report use of a novel hyperspectral imaging system utilizing digital light processing (DLP) technology to noninvasively visualize in vivo tissue oxygenation during surgical procedures. The system's novelty resides in its method of illuminating tissue with precisely predetermined continuous complex spectra. The Texas Instruments digital micromirror device, DMD, chip consisting of 768 by 1024 mirrors, each 16 μm square, can be switched between two positions at 12.5 kHz. Switching the appropriate mirrors controls the intensity of light illuminating the tissue as a function of wavelength, active spectral illumination. Meaning, the tissue can be illuminated with a different spectrum of light within 80 μs. Precisely, predetermined spectral illumination penetrates into patient tissue, its chemical composition augments the spectral properties of the light, and its reflected spectra are detected and digitized at each pixel detector of a silicon charge-coupled device, CCD. Using complex spectral illumination, digital signal processing and chemometric methods produce chemically relevant images at near video rates. Specific to this work, tissue is illuminated spectrally with light spanning the visible electromagnetic spectrum (380 to 780 nm). Spectrophotometric images are detected and processed visualizing the percentage of oxyhemoglobin at each pixel detector and presented continuously, in real time, at 3 images per second. As a proof of principle application, kidneys of four live anesthetized pigs were imaged before, during, and after renal vascular occlusion. DLP Hyperspectral Imaging with active spectral illumination detected a 64.73 ± 1.5% drop in the oxygenation of hemoglobin within 30 s of renal arterial occlusion. Producing chemically encoded images at near video rate, time-resolved hyperspectral imaging facilitates monitoring renal blood flow during animal surgery and holds considerable promise for doing the same during human surgical interventions.

Multimodal spectral imaging of cells using a transmission diffraction grating on a light microscope

A multimodal methodology for spectral imaging of cells is presented. The spectral imaging setup uses a transmission diffraction grating on a light microscope to concurrently record spectral images of cells and cellular organelles by fluorescence, darkfield, brightfield, and differential interference contrast (DIC) spectral microscopy. Initially, the setup was applied for fluorescence spectral imaging of yeast and mammalian cells labeled with multiple fluorophores. Fluorescence signals originating from fluorescently labeled biomolecules in cells were collected through triple or single filter cubes, separated by the grating, and imaged using a charge-coupled device (CCD) camera. Cellular components such as nuclei, cytoskeleton, and mitochondria were spatially separated by the fluorescence spectra of the fluorophores present in them, providing detailed multi-colored spectral images of cells. Additionally, the grating-based spectral microscope enabled measurement of scattering and absorption spectra of unlabeled cells and stained tissue sections using darkfield and brightfield or DIC spectral microscopy, respectively. The presented spectral imaging methodology provides a readily affordable approach for multimodal spectral characterization of biological cells and other specimens.

Integrated spectrometer design with application to multiphoton microscopy

We present a prism-based spectrometer integrated into a multifocal, multiphoton microscope. The multifocal configuration facilitates interrogation of samples under different excitation conditions. Notably, the image plane of the microscope and the image plane of the spectrometer are coincident eliminating the need for an intermediate image plane containing an entrance slit. An EM-CCD detector provides sufficient gain for spectral interrogation of single-emitters. We employ this spectrometer to observe spectral shifts in the two-photon excitation fluorescence emission of single CdSe nanodots as a function of excitation polarization.

Identification of amyloid plaques in retinas from Alzheimer's patients and noninvasive in vivo optical imaging of retinal plaques in a mouse model

Noninvasive monitoring of β-amyloid (Aβ) plaques, the neuropathological hallmarks of Alzheimer's disease (AD), is critical for AD diagnosis and prognosis. Current visualization of Aβ plaques in brains of live patients and animal models is limited in specificity and resolution. The retina as an extension of the brain presents an appealing target for a live, noninvasive optical imaging of AD if disease pathology is manifested there. We identified retinal Aβ plaques in postmortem eyes from AD patients (n=8) and in suspected early stage cases (n=5), consistent with brain pathology and clinical reports; plaques were undetectable in age-matched non-AD individuals (n=5). In APP(SWE)/PS1(∆E9) transgenic mice (AD-Tg; n=18) but not in non-Tg wt mice (n=10), retinal Aβ plaques were detected following systemic administration of curcumin, a safe plaque-labeling fluorochrome. Moreover, retinal plaques were detectable earlier than in the brain and accumulated with disease progression. An immune-based therapy effective in reducing brain plaques, significantly reduced retinal Aβ plaque burden in immunized versus non-immunized AD mice (n=4 mice per group). In live AD-Tg mice (n=24), systemic administration of curcumin allowed noninvasive optical imaging of retinal Aβ plaques in vivo with high resolution and specificity; plaques were undetectable in non-Tg wt mice (n=11). Our discovery of Aβ specific plaques in retinas from AD patients, and the ability to noninvasively detect individual retinal plaques in live AD mice establish the basis for developing high-resolution optical imaging for early AD diagnosis, prognosis assessment and response to therapies.

Non-invasive, Contrast-enhanced Spectral Imaging of Breast Cancer Signatures in Preclinical Animal Models In vivo

We report here a non-invasive multispectral imaging platform for monitoring spectral reflectance and fluorescence images from primary breast carcinoma and metastatic lymph nodes in preclinical rat model in vivo. The system is built around a monochromator light source and an acousto-optic tunable filter (AOTF) for spectral selection. Quantitative analysis of the measured reflectance profiles in the presence of a widely-used lymphazurin dye clearly demonstrates the capability of the proposed imaging platform to detect tumor-associated spectral signatures in the primary tumors as well as metastatic lymphatics. Tumor-associated changes in vascular oxygenation and interstitial fluid pressure are reasoned to be the physiological sources of the measured reflectance profiles. We also discuss the translational potential of our imaging platform in intra-operative clinical setting.

Temporally resolved fluorescence spectroscopy of a microarray-based vapor sensing system

This paper describes a method to measure the complete fluorescence spectrum from numerous fluorescent microspheres in a microarray simultaneously during exposure to a vapor. The technique, called spectrally resolved sensor imaging (SRSI), positions a transmission grating directly in front of the microscope objective on a standard epi-fluorescence microscope. This modification produces a hybrid image on the CCD camera that contains a conventional fluorescence image in the zero-order diffracted light and a fluorescence spectral image in the first-order diffracted light. Three types of surface-functionalized silica microspheres were coated with a solvatochromic dye. The surface functionality on the microspheres influences the maximum emission wavelength of the dye and generates a fluorescence spectral signature that is used to identify each sensor type. These sensors were randomly distributed into a photolithographically fabricated microarray platform, and the spectral signature of each individual sensor was measured. The time resolution of spectral acquisition is short enough to capture dynamic changes in the fluorescence emission as a vapor is presented to the array. The ability to measure the entire fluorescence spectrum from each sensor simultaneously during a vapor exposure increases the dimensionality of the response data and significantly improves the classification accuracy of the system.

Spectral unmixing: analysis of performance in the olfactory bulb in vivo

Background

The generation of transgenic mice expressing combinations of fluorescent proteins has greatly aided the reporting of activity and identification of specific neuronal populations. Methods capable of separating multiple overlapping fluorescence emission spectra, deep in the living brain, with high sensitivity and temporal resolution are therefore required. Here, we investigate to what extent spectral unmixing addresses these issues.

Methodology/Principal Findings

Using fluorescence resonance energy transfer (FRET)-based reporters, and two-photon laser scanning microscopy with synchronous multichannel detection, we report that spectral unmixing consistently improved FRET signal amplitude, both in vitro and in vivo. Our approach allows us to detect odor-evoked FRET transients 180–250 µm deep in the brain, the first demonstration of in vivo spectral imaging and unmixing of FRET signals at depths greater than a few tens of micrometer. Furthermore, we determine the reporter efficiency threshold for which FRET detection is improved by spectral unmixing.

Conclusions/Significance

Our method allows the detection of small spectral variations in depth in the living brain, which is essential for imaging efficiently transgenic animals expressing combination of multiple fluorescent proteins.

Design of a prism to compensate the image-shifting error of the Acousto-Optic tunable filter

The Acousto-Optic Tunable Filter (AOTF) is a high-speed full-field monochromator which generates two spectrally filtered light beams with ordinary and extraordinary polarization state. The AOTF is widely used to build full-field spectral imaging systems or a spectral domain interferometer. The angle of diffracted light in the AOTF changes according to the scanning of wavelength, which causes an image shift on the CCD plane. An analytic design of a prism system to compensate for the image shift is proposed in this paper. Analysis of light paths in a prism and experimental results verified a proposed compensation method. Experimental results agreed with simulation results based on the suggested prism model. Image shifting errors of ordinary and extraordinary rays were simultaneously minimized at optimal conditions with the designed prism.

Optical filtering systems for wavelength selection in light microscopy

Because of its sensitivity and specificity, fluorescence-based detection is one of the foremost methods for microscopic imaging of biological tissues and cells. Dramatic improvements in filter system design and implementation coupled with development of an ever-widening range of sensitive fluorescent dyes have made multicolor imaging a powerful tool for structural and functional analysis. This revised and expanded unit reviews some of the main principles and developments of optical filtering.

Design and implementation of a sensitive high-resolution nonlinear spectral imaging microscope

Live tissue nonlinear microscopy based on multiphoton autofluorescence and second harmonic emission originating from endogenous fluorophores and noncentrosymmetric-structured proteins is rapidly gaining interest in biomedical applications. The advantage of this technique includes high imaging penetration depth and minimal phototoxic effects on tissues. Because fluorescent dyes are not used, discrimination between different components within the tissue is challenging. We have developed a nonlinear spectral imaging microscope based on a home-built multiphoton microscope, a prism spectrograph, and a high-sensitivity CCD camera for detection. The sensitivity of the microscope was optimized for autofluorescence and second harmonic imaging over a broad wavelength range. Importantly, the spectrograph lacks an entrance aperture; this improves the detection efficiency at deeper lying layers in the specimen. Application to the imaging of ex vivo and in vivo mouse skin tissues showed clear differences in spectral emission between skin tissue layers as well as biochemically different tissue components. Acceptable spectral images could be recorded up to an imaging depth of approximately 100 microm.

Mapping the architecture of secretin receptors with intramolecular fluorescence resonance energy transfer using acousto-optic tunable filter-based spectral imaging

The molecular structure and agonist-induced conformational changes of class II G protein-coupled receptors are poorly understood. In this work, we developed and characterized a series of dual cyan fluorescent protein (CFP)-tagged and yellow fluorescent protein (YFP)-tagged secretin receptor constructs for use in various functional and fluorescence analyses of receptor structural variants. CFP insertions within the first or second intracellular loop domains of this receptor were tolerated poorly or partially, respectively, in receptors tagged with a carboxyl-terminal yellow fluorescent protein that itself had no effect on secretin binding or cAMP production. A similar CFP insertion into the third intracellular loop resulted in a plasma membrane-localized receptor that bound secretin and signaled normally. This fully active third-loop variant exhibited a significant decrease in fluorescence resonance energy transfer signals that were recorded with an acousto-optic tunable filter microscope after exposure to secretin agonist but not to a receptor antagonist. These data demonstrate changes in the relative positions of intracellular structures that support a model for secretin receptor activation.

Priming by tumor necrosis factor-α of human neutrophil NADPH-oxidase activity induced by anti-proteinase-3 or anti-myeloperoxidase antibodies

Anti-proteinase-3 (anti-PR3) or anti-myeloperoxidase (anti-MPO) antibodies are capable of activating human neutrophils primed by TNF-alpha in vitro. We described previously the involvement of FcgammaRIIa and beta(2) integrins in this neutrophil activation. In the literature, the requirement of TNF priming has been attributed to an effect of TNF-alpha on the expression of PR3 or MPO on the cell surface. Under our experimental conditions, TNF-alpha (2 ng/ml) increased the binding of the antibody against PR3, whereas binding of the antibody against MPO could hardly be detected, not even after TNF-alpha treatment. The aim of this study was to consider (an)other(s) role(s) for TNF-alpha in facilitating the NADPH-oxidase activation by these antibodies. We demonstrate the early mobilization of the secretory vesicles as a result of TNF-induced increase in intracellular-free calcium ions, the parallel colocalization of gp91(phox), the main component of the NADPH oxidase with beta(2) integrins and FcgammaRIIa on the neutrophil surface, and the FcgammaRIIa clustering upon TNF priming. TNF-alpha also induced redistribution of FcgammaRIIa to the cytoskeleton in a dose- and time-dependent manner. Moreover, blocking CD18 MHM23 antibody, cytochalasin B, and D609 (an inhibitor of phosphatidylcholine phospholipase C) inhibited this redistribution and the respiratory burst in TNF-treated neutrophils exposed to anti-PR3 or anti-MPO antibodies. Our results indicate direct effects of TNF-alpha in facilitating neutrophil activation by these antibodies and further support the importance of cytoskeletal rearrangements in this priming process.

Quantitative in vivo microscopy: the return from the 'omics'

The confluence of recent advances in microscopy instrumentation and image analysis, coupled with the widespread use of GFP-like proteins as reporters of gene expression, has opened the door to high-throughput in vivo studies that can provide the morphological and temporal context to the biochemical pathways regulating cell function. We are now able to quantify the concentration and three-dimensional distribution of multiple spectrally resolved GFP-tagged proteins. Using automatic segmentation and tracking we can then measure the dynamics of the processes in which these elements are involved. In this way, parallel studies are feasible where multiple cell colonies treated with drugs or gene expression repressors can be monitored and analyzed to study the dynamics of relevant biological processes.

Practical three color live cell imaging by widefield microscopy

Live cell fluorescence microscopy using fluorescent protein tags derived from jellyfish and coral species has been a successful tool to image proteins and dynamics in many species. Multi-colored aequorea fluorescent protein (AFP) derivatives allow investigators to observe multiple proteins simultaneously, but overlapping spectral properties sometimes require the use of sophisticated and expensive microscopes. Here, we show that the aequorea coerulescens fluorescent protein derivative, PS-CFP2 has excellent practical properties as a blue fluorophore that are distinct from green or red fluorescent proteins and can be imaged with standard filter sets on a widefield microscope. We also find that by widefield illumination in live cells, that PS-CFP2 is very photostable. When fused to proteins that form concentrated puncta in either the cytoplasm or nucleus, PSCFP2 fusions do not artifactually interact with other AFP fusion proteins, even at very high levels of over-expression. PSCFP2 is therefore a good blue fluorophore for distinct three color imaging along with eGFP and mRFP using a relatively simple and inexpensive microscope.

Development of an advanced hyperspectral imaging (HSI) system with applications for cancer detection

An advanced hyper-spectral imaging (HSI) system has been developed having obvious applications for cancer detection. This HSI system is based on state-of-the-art liquid crystal tunable filter technology coupled to an endoscope. The goal of this unique HSI technology being developed is to obtain spatially resolved images of the slight differences in luminescent properties of malignant versus non-malignant tissues. In this report, the development of the instrument is discussed and the capability of the instrument is demonstrated by observing mouse carcinomas in-vivo. It is shown that the instrument successfully distinguishes between normal and malignant mouse skin. It is hoped that the results of this study will lead to advances in the optical diagnosis of cancer in humans.

Hyperchromatic cytometry principles for cytomics using slide based cytometry

BACKGROUND

Polychromatic analysis of biological specimens has become increasingly important because of the emerging new fields of high-content and high-throughput single cell analysis for systems biology and cytomics. Combining different technologies and staining methods, multicolor analysis can be pushed forward to measure anything stainable in a cell. We term this approach hyperchromatic cytometry and present different components suitable for achieving this task. For cell analysis, slide based cytometry (SBC) technologies are ideal as, unlike flow cytometry, they are non-consumptive, i.e. the analyzed sample is fixed on the slide and can be reanalyzed following restaining of the object.

METHODS AND RESULTS

We demonstrate various approaches for hyperchromatic analysis on a SBC instrument, the Laser Scanning Cytometer. The different components demonstrated here include (1) polychromatic cytometry (staining of the specimen with eight or more different fluorochromes simultaneously), (2) iterative restaining (using the same fluorochrome for restaining and subsequent reanalysis), (3) differential photobleaching (differentiating fluorochromes by their different photostability), (4) photoactivation (activating fluorescent nanoparticles or photocaged dyes), and (5) photodestruction (destruction of FRET dyes). Based on the ability to relocate cells that are immobilized on a microscope slide with a precision of approximately 1 microm, identical cells can be reanalyzed on the single cell level after manipulation steps.

CONCLUSION

With the intelligent combination of several different techniques, the hyperchromatic cytometry approach allows to quantify and analyze all components of relevance on the single cell level. The information gained per specimen is only limited by the number of available antibodies and sterical hindrance.

An AOTF-based dual-modality hyperspectral imaging system (DMHSI) capable of simultaneous fluorescence and reflectance imaging

An acousto-optic tunable filter (AOTF)-based system for dual-modality hyperspectral imaging (DMHSI) has been developed for use in characterization of normal and malignant mouse tissue. The system consists of a laser, endoscope, AOTF, and two cameras coupled with optics and electronics. Initial results show that the system can delineate normal and malignant mouse tissues real-time. The analysis shows that malignant tissues consistently exhibit less fluorescent intensity in the wavelength band from 440 to 540 nm with a peak intensity of around 490 nm. The analysis also shows key spectroscopic differences between normal and malignant tissues. Further, these results are compared to real-time spectroscopic data and show good correlation.

Single Color Fluorescent Indicators of Protein Phosphorylation for Multicolor Imaging of Intracellular Signal Flow Dynamics

Existing monitoring methods for protein phosphorylation involved in intracellular signal transduction in vivo are exclusively based on fluorescence resonance energy transfer, which needs the measurement of the change in fluorescence intensities at two wavelengths. Therefore, it is difficult to monitor protein phosphorylation together with other related signaling processes, such as second messengers and protein translocation. To overcome this problem, we developed novel fluorescent indicators, each containing a differently colored (cyan and green) single fluorophore. The present indicator is a tandem fusion protein containing a kinase substrate domain, a circularly permuted fluorescent protein (cpFP), and a phosphorylation recognition domain. The cpFP is obtained by dividing a green fluorescent protein mutant (GFP) at residue 144-145 and linking the carboxy and amino portions thereof with a peptide linker. The substrate domain used in this study is a peptide sequence that is phosphorylated by insulin receptor. Phosphorylation of the substrate domain induces its interaction with the phosphorylation recognition domain, which causes a conformational change in the cpFP and a change in its fluorescence. The cyan and green indicators exhibited 10% decrease and 15% increase, respectively, in their fluorescence intensities upon phosphorylation. Using this cyan indicator and GFP-tagged mitogen-activated protein kinase (MAPK), we found that insulin-induced protein phosphorylation occurred immediately upon the addition of insulin, whereas nuclear translocation of MAPK occurred 7 min later. By tailoring the substrate domains and the phosphorylation recognition domains in these cyan and green indicators, the present approach should be applicable to the in vivo analysis of a broad range of protein phosphorylation processes, together with other intracellular signaling processes.

Spatial Distribution of Calcium Entry Evoked by Single Action Potentials within the Presynaptic Active Zone

The nature of presynaptic calcium (Ca(2+)) signals that initiate neurotransmitter release makes these signals difficult to study, in part because of the small size of specialized active zones within most nerve terminals. Using the frog motor nerve terminal, which contains especially large active zones, we show that increases in intracellular Ca(2+) concentration within 1 msec of action potential invasion are attributable to Ca(2+) entry through N-type Ca(2+) channels and are not uniformly distributed throughout active zone regions. Furthermore, changes in the location and magnitude of Ca(2+) signals recorded before and after experimental manipulations (omega-conotoxin GVIA, diaminopyridine, and lowered extracellular Ca(2+)) support the hypothesis that there is a remarkably low probability of a single Ca(2+) channel opening within an active zone after an action potential. The trial-to-trial variability observed in the spatial distribution of presynaptic Ca(2+) entry also supports this conclusion, which differs from the conclusions of previous work in other synapses.

Quantitative fluorescent speckle microscopy: where it came from and where it is going

Fluorescent speckle microscopy (FSM) is a technology for analysing the dynamics of macromolecular assemblies. Originally, the effect of random speckle formation was discovered with microtubules. Since then, the method has been expanded to other proteins of the cytoskeleton such as f-actin and microtubule binding proteins. Newly developed, specialized software for analysing speckle movement and photometric fluctuation in the context of polymer transport and turnover has turned FSM into a powerful method for the study of cytoskeletal dynamics in cell migration, division, morphogenesis and neuronal path finding. In all these settings, FSM serves as the quantitative readout to link molecular and genetic interventions to complete maps of the cytoskeleton dynamics and thus can be used for the systematic deciphering of molecular regulation of the cytoskeleton. Fully automated FSM assays can also be applied to live-cell screens for toxins, chemicals, drugs and genes that affect cytoskeletal dynamics. We envision that FSM has the potential to become a core tool in automated, cell-based molecular diagnostics in cases where variations in cytoskeletal dynamics are a sensitive signal for the state of a disease, or the activity of a molecular perturbant. In this paper, we review the origins of FSM, discuss these most recent technical developments and give a glimpse to future directions and potentials of FSM. It is written as a complement to the recent review (Waterman-Storer & Danuser, 2002, Curr. Biol., 12, R633-R640), in which we emphasized the use of FSM in cell biological applications. Here, we focus on the technical aspects of making FSM a quantitative method.

A high-speed multispectral spinning-disk confocal microscope system for fluorescent speckle microscopy of living cells

Fluorescent speckle microscopy (FSM) uses a small fraction of fluorescently labeled subunits to give macromolecular assemblies such as the cytoskeleton fluorescence image properties that allow quantitative analysis of movement and subunit turnover. We describe a multispectral microscope system to analyze the dynamics of multiple cellular structures labeled with spectrally distinct fluorophores relative to one another over time in living cells. This required a high-resolution, highly sensitive, low-noise, and stable imaging system to visualize the small number of fluorophores making up each fluorescent speckle, a means by which to switch between excitation wavelengths rapidly, and a computer-based system to integrate image acquisition and illumination functions and to allow a convenient interface for viewing multispectral time-lapse data. To reduce out-of-focus fluorescence that degrades speckle contrast, we incorporated the optical sectioning capabilities of a dual-spinning-disk confocal scanner. The real-time, full-field scanning allows the use of a low-noise, fast, high-dynamic-range, and quantum-efficient cooled charge-coupled device (CCD) as a detector as opposed to the more noisy photomultiplier tubes used in laser-scanning confocal systems. For illumination, our system uses a 2.5-W Kr/Ar laser with 100-300mW of power at several convenient wavelengths for excitation of few fluorophores in dim FSM specimens and a four-channel polychromatic acousto-optical modulator fiberoptically coupled to the confocal to allow switching between illumination wavelengths and intensity control in a few microseconds. We present recent applications of this system for imaging the cytoskeleton in migrating tissue cells and neurons.

Multispectral imaging fluorescence microscopy for living cells

Multispectral imaging technologies have been widely used in fields of astronomy and remote sensing. Interdisciplinary approaches developed in, for example, the National Aeronautics and Space Administration (NASA, USA), the Jet Propulsion Laboratory (JPL, USA), or the Communications Research Laboratory (CRL, Japan) have extended the application areas of these technologies from planetary systems to cellular systems. Here we overview multispectral imaging systems that have been devised for microscope applications. We introduce these systems with particular interest in live cell imaging. Finally we demonstrate examples of spectral imaging of living cells using commercially available systems with no need for user engineering.

New directions for fluorescent speckle microscopy

Fluorescent Speckle Microscopy (FSM) is a technology for analyzing cytoskeleton dynamics, giving novel insight into their roles in living cells. New applications of FSM, together with the development of computer-based FSM image analysis, will make FSM the first microscopy-based method to deliver quantitative kinetic readouts at high spatial and temporal resolution for a wide variety of macromolecular systems. Here, we review the most recent applications and developments and give a glimpse of future directions and potentials of FSM.

Spectral imaging fluorescence microscopy

The spectral resolution of fluorescence microscope images in living cells is achieved by using a confocal laser scanning microscope equipped with grating optics. This capability of temporal and spectral resolution is especially useful for detecting spectral changes of a fluorescent dye; for example, those associated with fluorescence resonance energy transfer (FRET). Using the spectral imaging fluorescence microscope system, it is also possible to resolve emitted signals from fluorescent dyes that have spectra largely overlapping with each other, such as fluorescein isothiocyanate (FITC) and green fluorescent protein (GFP).

Large-image-format computed tomography imaging spectrometer for fluorescence microscopy

Multispectral imaging has significantly enhanced the analysis of fixed specimens in pathology and cytogenetics. However, application of this technology to in vivo studies has been limited. This is due in part to the increased temporal resolution required to analyze changes in cellular function. Here we present a non-scanning instrument that simultaneously acquires full spectral information (460 nm to 740 nm) from every pixel within its 2-D field of view (200 ìm x 200 ìm) during a single integration time (typically, 2 seconds). The current spatial and spectral sampling intervals of the spectrometer are 0.985 ìm and 5 nm, respectively. These properties allow for the analysis of physiological responses within living biological specimens.

Computed tomography-based spectral imaging for fluorescence microscopy

The computed tomography imaging spectrometer (CTIS) is a non-scanning instrument capable of simultaneously acquiring full spectral information (450-750 nm) from every position element within its field of view (75 microm x 75 microm). The current spatial and spectral sampling intervals of the spectrometer are 1.0 microm and 10 nm, respectively. This level of resolution is adequate to resolve signal responses from multiple fluorescence probes located within individual cells or different locations within the same cell. Spectral imaging results are presented from the CTIS combined with a commercial inverted fluorescence microscope. Results demonstrate the capability of the CTIS to monitor the spatiotemporal evolution of pH in rat insulinoma cells loaded with SNARF-1. The ability to analyze full spectral information for two-dimensional (x, y) images allows precise evaluation of heterogeneous physiological responses within cell populations. Due to low signal levels, integration times up to 2 s were required. However, reasonable modifications to the instrument design will provide higher system transmission efficiency with increased temporal and spatial resolution. Specifically, a custom optical design including the use of a larger format detector array is under development for a second-generation system.