Biochemical characterization of atherosclerotic plaques by endogenous multispectral fluorescence lifetime imaging microscopy

Dual-modality fluorescence lifetime imaging-optical coherence tomography intravascular catheter system with freeform catheter optics

SIGNIFICANCE

Intravascular imaging is key to investigations into atherosclerotic plaque pathobiology and cardiovascular diagnostics overall. The development of multimodal imaging devices compatible with intracoronary applications has the potential to address limitations of currently available single-modality systems.

AIM

We designed and characterized a robust, high performance multimodal imaging system that combines optical coherence tomography (OCT) and multispectral fluorescence lifetime imaging (FLIm) for intraluminal simultaneous assessment of structural and biochemical properties of coronary arteries.

APPROACH

Several shortcomings of existing FLIm-OCT catheter systems are addressed by adopting key features, namely (1) a custom fiber optic rotary joint based on an air bearing, (2) a broadband catheter using a freeform reflective optics, and (3) integrated solid-state FLIm detectors. Improvements are quantified using a combination of experimental characterization and simulations.

RESULTS

Excellent UV and IR coupling efficiencies and stability (IR: 75.7 % ± 0.4 % , UV: 45.7 % ± 0.35 % ) are achieved; high FLIm optical performance is obtained (UV beam FWHM: 50 μm) contemporaneously with excellent OCT beam quality (IR beam FWHM: 17 μm). High-quality FLIm OCT image of a human coronary artery specimen was acquired.

CONCLUSION

The ability of this intravascular imaging system to provide comprehensive structural and biochemical properties will be valuable to further our understanding of plaque pathophysiology and improve cardiovascular diagnostics.

Spectral and lifetime resolution of fundus autofluorescence in advanced age-related macular degeneration revealing different signal sources

PURPOSE

To determine the fundus autofluorescence (FAF) lifetimes and spectral characteristics of individual drusen and hyperpigmentation independent of those with retinal pigment epithelium (RPE) in geographic atrophy (GA) areas in late-stage age-related macular degeneration (AMD).

METHODS

Three consecutive patients with complete RPE and outer retinal atrophy (cRORA) exhibiting drusen that were calcified or associated with hyperpigmentation were investigated with multimodal non-invasive ophthalmic imaging including colour fundus photography (CFP), optical coherence tomography (OCT), near-infrared reflectance (NIR), blue FAF and fluorescence lifetime imaging ophthalmoscopy (FLIO). Fluorescence lifetimes were measured in two spectral channels (short-wavelength spectral channel (SSC): 500-560 nm and long-wavelength spectral channel (LSC): 560-720 nm).

RESULTS

Drusen lacking RPE coverage, as confirmed by CFP and OCT, had longer FAF lifetimes than surrounding cRORA by 127 ± 66 ps (SSC) and 113 ± 48 ps (LSC, both p = 0.008 in Wilcoxon test, N = 9) and by 209 ± 100 ps (SSC) and 121 ± 56 ps (LSC, p < 0.001, N = 14) in two patients. Hyperpigmentation in CFP in a third patient shows strong FAF with prolonged lifetimes. In the SSC, persistent FAF was found inside cRORA. A crescent-shaped hyperfluorescence in an area of continuous RPE but lacking outer retina was seen in one eye with a history of anti-VEGF treatment.

CONCLUSIONS

Short-wavelength fluorescence in cRORA points to fluorophores beyond RPE organelles. Fluorescence properties of drusen within cRORA differ from in vivo drusen covered by RPE. These limited findings from three patients give new insight into the sources of FAF that can be further elucidated in larger cohorts.

Comprehensive Assessment of High-Risk Plaques by Dual-Modal Imaging Catheter in Coronary Artery

•

Fluorescence lifetime imaging (FLIm) allows label-free biochemical visualization of atheromas; however, it remains unknown whether FLIm can characterize high-risk plaque features in coronary arteries in a beating heart. Also, implementation of a novel analytic methodology is required for multispectral FLIm because it yields massive biochemical readouts.

•

This study first demonstrated a simultaneous structural and biochemical assessment of high-risk plaques in the beating swine coronary arteries using a fully integrated optical coherence tomography-FLIm and a 2.9-F low-profile dual-modal catheter.

•

Biochemical components of atherosclerotic plaques, including lipids, macrophages, lipids+macrophages, and fibrotic tissues, had unique fluorescence lifetime signatures that were clearly distinguishable using multispectral FLIm.

•

Machine learning framework was successfully integrated with multispectral FLIm and enabled an automated, quantitative imaging of multiple key components associated with plaque destabilization.

Coronary plaque destabilization involves alterations in microstructure and biochemical composition; however, no imaging approach allows such comprehensive characterization. Herein, the authors demonstrated a simultaneous microstructural and biochemical assessment of high-risk plaques in the coronary arteries in a beating heart using a fully integrated optical coherence tomography and fluorescence lifetime imaging (FLIm). It was found that plaque components such as lipids, macrophages, lipids+macrophages, and fibrotic tissues had unique fluorescence lifetime signatures that were distinguishable using multispectral FLIm. Because FLIm yielded massive biochemical readouts, the authors incorporated machine learning framework into FLIm, and ultimately, their approach enabled an automated, quantitative imaging of multiple key components relevant for plaque destabilization.

Fluorescence Lifetimes and Spectra of RPE and Sub-RPE Deposits in Histology of Control and AMD Eyes

Purpose

To investigate fluorescence lifetimes as well as spectral characteristics of drusen and RPE autofluorescence in AMD.

Methods

Fluorescence lifetimes and spectra of five eyes with AMD and nine control eyes were analyzed in cryosections by means of two-photon excited fluorescence at 960 nm. Spectra were detected at 490 to 647 nm. Lifetimes were measured using time-correlated single photon counting in two spectral channels: 500 to 550 nm and 550 to 700 nm. Fluorescence decays over time were approximated by a series of three exponential functions. The amplitude-weighted mean fluorescence lifetime was determined.

Results

We identified 196 sub-RPE deposits (AMD, n = 76; control, n = 120) and recorded 241 RPE sites. The peak emission wavelength of sub-RPE deposits was significantly green shifted compared with RPE (peak at 570 nm vs. 610 nm), but did not differ between AMD and control donors. Sub-RPE deposits showed considerably longer mean fluorescence lifetimes than RPE (ch1, 581 ± 163 ps vs. 177 ± 25 ps; ch2, 541 ± 125 ps vs. 285 ± 31 ps; P < 0.001). Sub-RPE deposits found in AMD eyes had longer lifetimes than deposits of controls (ch1, 650 ± 167 ps vs. 537 ± 145 ps; ch2, 600 ± 125 ps vs. 504 ± 111 ps; P < 0.001). In AMD eyes, sub-RPE deposits showed a more homogenous autofluorescence distribution and more deposits were larger than 63 µm than in control eyes.

Conclusions

Ex vivo fluorescence imaging of sub-RPE deposits in cross-sections enables the separation of their autofluorescence from that of over- or underlying structures. Our analysis showed considerable variability of sub-RPE deposit lifetimes but not spectra. This indicates that sub-RPE deposits either consist of a variety of different fluorophores or expose the same fluorophores to different microenvironments.

Blind deconvolution estimation by multi-exponential models and alternated least squares approximations: Free-form and sparse approach

The deconvolution process is a key step for quantitative evaluation of fluorescence lifetime imaging microscopy (FLIM) samples. By this process, the fluorescence impulse responses (FluoIRs) of the sample are decoupled from the instrument response (InstR). In blind deconvolution estimation (BDE), the FluoIRs and InstR are jointly extracted from a dataset with minimal a priori information. In this work, two BDE algorithms are introduced based on linear combinations of multi-exponential functions to model each FluoIR in the sample. For both schemes, the InstR is assumed with a free-form and a sparse structure. The local perspective of the BDE methodology assumes that the characteristic parameters of the exponential functions (time constants and scaling coefficients) are estimated based on a single spatial point of the dataset. On the other hand, the same exponential functions are used in the whole dataset in the global perspective, and just the scaling coefficients are updated for each spatial point. A least squares formulation is considered for both BDE algorithms. To overcome the nonlinear interaction in the decision variables, an alternating least squares (ALS) methodology iteratively solves both estimation problems based on non-negative and constrained optimizations. The validation stage considered first synthetic datasets at different noise types and levels, and a comparison with the standard deconvolution techniques with a multi-exponential model for FLIM measurements, as well as, with two BDE methodologies in the state of the art: Laguerre basis, and exponentials library. For the experimental evaluation, fluorescent dyes and oral tissue samples were considered. Our results show that local and global perspectives are consistent with the standard deconvolution techniques, and they reached the fastest convergence responses among the BDE algorithms with the best compromise in FluoIRs and InstR estimation errors.

Label-Free Visualization and Quantification of Biochemical Markers of Atherosclerotic Plaque Progression Using Intravascular Fluorescence Lifetime

OBJECTIVES

This study aimed to systematically investigate whether plaque autofluorescence properties assessed with intravascular fluorescence lifetime imaging (FLIm) can provide qualitative and quantitative information about intimal composition and improve the characterization of atherosclerosis lesions.

BACKGROUND

Despite advances in cardiovascular diagnostics, the analytic tools and imaging technologies currently available have limited capabilities for evaluating in situ biochemical changes associated with luminal surface features. Earlier studies of small number of samples have shown differences among the autofluorescence lifetime signature of well-defined lesions, but a systematic pixel-level evaluation of fluorescence signatures associated with various histological features is lacking and needed to better understand the origins of fluorescence contrast.

METHODS

Human coronary artery segments (n = 32) were analyzed with a bimodal catheter system combining multispectral FLIm with intravascular ultrasonography compatible with in vivo coronary imaging. Various histological components present along the luminal surface (200-μm depth) were systematically tabulated (12 sectors) from each serial histological section (n = 204). Morphological information provided by ultrasonography allowed for the accurate registration of imaging data with histology data. The relationships between histological findings and FLIm parameters obtained from 3 spectral channels at each measurement location (n = 33,980) were characterized.

RESULTS

Our findings indicate that fluorescence lifetime from different spectral bands can be used to quantitatively predict the superficial presence of macrophage foam cells (mFCs) (area under the receiver-operator characteristic curve: 0.94) and extracellular lipid content in advanced lesions (lifetime increase in 540-nm band), detect superficial calcium (lifetime decrease in 450-nm band area under the receiver-operator characteristic curve: 0.90), and possibly detect lesions consistent with active plaque formation such as pathological intimal thickening and healed thrombus regions (lifetime increase in 390-nm band).

CONCLUSIONS

Our findings indicate that autofluorescence lifetime provides valuable information for characterizing atherosclerotic lesions in coronary arteries. Specifically, FLIm can be used to identify key phenomena linked with plaque progression (e.g., peroxidized-lipid-rich mFC accumulation and recent plaque formation).

Dual-modality optical coherence tomography and frequency-domain fluorescence lifetime imaging microscope system for intravascular imaging

SIGNIFICANCE

Detailed biochemical and morphological imaging of the plaque burdened coronary arteries holds the promise of improved understanding of atherosclerosis plaque development, ultimately leading to better diagnostics and therapies.

AIM

Development of a dual-modality intravascular catheter supporting swept-source optical coherence tomography (OCT) and frequency-domain fluorescence lifetime imaging (FD-FLIM) of endogenous fluorophores with UV excitation.

APPROACH

We instituted a refined approach to endoscope development that combines simulation in a commercial ray tracing program, fabrication, and a measurement method for optimizing ball-lens performance. With this approach, we designed and developed a dual-modality catheter endoscope based on a double-clad fiber supporting OCT through the core and fluorescence collection through the first cladding. We varied the relative percent of UV excitation launched into the core and first cladding to explore the potential resolution improvement for FD-FLIM. The developed catheter endoscope was optically characterized, including measurement of spatial resolution and fluorescent lifetimes of standard fluorophores. Finally, the system was demonstrated on fresh ex vivo human coronary arteries.

RESULTS

The developed endoscope was shown to have optical performance similar to predictions derived from the simulation approach. The FLIM resolution can be improved by over a factor of 4 by primarily illuminating through the core rather than the first cladding. However, time-dependent solarization losses need to be considered when choosing the relative percentage. We ultimately chose to illuminate with 7% of the power transmitting through the core. The resulting catheter endoscope had 40-μm lateral resolution for OCT and <100  μm lateral resolution for FD-FLIM. Images of ex vivo coronary arteries are consistent with expectations based on histopathology.

CONCLUSIONS

The results demonstrate that our approach for endoscope simulation produces reliable predictions of endoscope performance. Simulation results guided our development of a multimodal OCT/FD-FLIM catheter imaging system for investigating atherosclerosis in coronary arteries.

Investigating Origins of FLIm Contrast in Atherosclerotic Lesions Using Combined FLIm-Raman Spectroscopy

Background: Fluorescence lifetime imaging (FLIm) is a spectroscopic imaging technique able to characterize the composition of luminal surface of arterial vessels. Studies of human coronary samples demonstrated that distinct atherosclerotic lesion types are characterized by FLIm features associate with distinct tissue molecular makeup. While conventional histology has provided indications about potential sources of molecular contrast, specific information about the origin of FLIm signals is lacking. Here we investigate whether Raman spectroscopy, a technique able to evaluate chemical content of biological samples, can provide additional insight into the origin of FLIm contrast. Methods: Six human coronary artery samples were imaged using FLIm (355 nm excitation)-Raman spectroscopy (785 nm excitation) via a multimodal fiber optic probe. The spatial distribution of molecular contrast in FLIm images was analyzed in relationship with histological findings. Raman data was investigated using an endmember technique and compared with histological findings. A descriptive modeling approach based on multivariate regression was used to identify Raman bands related with changes in lifetime in four spectral channels (violet: 387/35 nm, blue: 443/29 nm, green: 546/38 nm, and red: 628/53 nm). Results: Fluorescence lifetime variations in the violet, blue and green spectral bands were observed for distinct areas of each tissue sample associated with distinct pathologies. Analysis of Raman signals from areas associated with normal, pathological intimal thickening, and fibrocalcific regions demonstrated the presence of hydroxyapatite, collagenous proteins, carotene, cholesterol, and triglycerides. The FLIm and Raman descriptive modeling analysis indicated that lifetime increase in the violet spectral band was associated with increased presence of cholesterol and carotenes, a new finding consistent with LDL accumulation in atherosclerotic lesions, and not with collagen proteins, as expected from earlier studies. Conclusions: The systematic, quantitative analysis of the multimodal FLIm-Raman dataset using a descriptive modeling approach led to the identification of LDL accumulation as the primary source of lifetime contrast in atherosclerotic lesions in the violet spectral range. Earlier FLIm validation studies relying on histopathological findings had associated this contrast to increased collagen content, also present in advanced lesions, thus demonstrating the benefits of alternative validation methods.

Direct frequency domain fluorescence lifetime imaging using field programmable gate arrays for real time processing

Frequency domain (FD) fluorescence lifetime imaging (FLIM) involves the excitation of the sample of interest with a modulated light source and digitization of the fluorescence emission for further analysis. Traditional FD-FLIM systems use heterodyne or homodyne detection, where the excitation light source and detector are modulated at specific frequency(s). More recently, FD-FLIM systems that use reflection of the light source as a trigger or phase reference for lifetime calculations have been developed. These detection schemes, however, require extra components that increase the cost and complexity of the FD-FLIM system. Here, we report a novel FD-FLIM detection scheme whereby the light source modulation and emission digitization are implemented using Field Programmable Gate Arrays (FPGAs), and fixed gain avalanche photodiodes are used for fluorescence detection. The reported FD-FLIM system was designed for probing nanosecond lifetime fluorophores (2-10 ns) at three emission bands simultaneously. The system utilizes a 375 nm diode laser for excitation at multiple simultaneous modulation frequencies (between 1 MHz and 83 MHz, bandwidth limited intentionally by using a lowpass filter) and three fixed gain avalanche photodiodes for simultaneous detection of three emission bands: 405/20 nm, 440/40 nm, and 525/50 nm (center/FWHM). Real-time computation of the modulation and phase lifetimes is simply performed by direct application of the discrete Fourier transform (max. of 10 frequencies) to the digitized fluorescence emission signals. The accuracy and sensitivity of this novel FD-FLIM detection scheme was demonstrated by imaging standard fluorophores and ex vivo unfixed human coronary artery tissue samples.

Improved label-free diagnostics and pathological assessment of atherosclerotic plaques through nonlinear microscopy

Coronary heart disease is the most common type of heart disease caused by atherosclerosis. In fact, an arterial wall lesion centered on the accumulation of cholesterol-rich lipids and the accompanying inflammatory response generates a plaque, whose rupture may result in a thrombus with fatal consequences. Plaque characterization for assessing the severity of atherosclerosis is generally performed through standard histopathological examination based on hematoxylin/eosin staining, which is operator-dependent and requires relatively long procedures. In this framework, nonlinear optical microscopy is a valid, label-free alternative to standard diagnostic methods. We combined second-harmonic generation (SHG), two-photon excited fluorescence (TPEF) and fluorescence lifetime imaging microscopy in a multimodal scheme for obtaining morphological and molecular information on human carotid ex vivo specimens affected by atherosclerosis. In this study, discrimination between different tissues within the atherosclerotic plaque was achieved based on both lifetime, TPEF-to-SHG ratio, and image pattern analysis. The presented methodology aims to be a starting point for future fully automated and fast characterization of atherosclerotic biopsies; moreover, it could be extended to the study of other tissues and pathologies. Combined TPEF/SHG mapping of a carotid specimen affected by atherosclerosis.

Comprehensive intravascular imaging of atherosclerotic plaque in vivo using optical coherence tomography and fluorescence lifetime imaging

Comprehensive imaging of both the structural and biochemical characteristics of atherosclerotic plaque is essential for the diagnosis and study of coronary artery disease because both a plaque's morphology and its biochemical composition affect the level of risk it poses. Optical coherence tomography (OCT) and fluorescence lifetime imaging (FLIm) are promising optical imaging methods for characterizing coronary artery plaques morphologically and biochemically, respectively. In this study, we present a hybrid intravascular imaging device, including a custom-built OCT/FLIm system, a hybrid optical rotary joint, and an imaging catheter, to visualize the structure and biochemical composition of the plaque in an atherosclerotic rabbit artery in vivo. Especially, the autofluorescence lifetime of the endogenous tissue molecules can be used to characterize the biochemical composition; thus no exogenous contrast agent is required. Also, the physical properties of the imaging catheter and the imaging procedures are similar to those already used clinically, facilitating rapid translation into clinical use. This new intravascular imaging catheter can open up new opportunities for clinicians and researchers to investigate and diagnose coronary artery disease by simultaneously providing tissue microstructure and biochemical composition data in vivo without the use of exogenous contrast agent.

Real-time visualization of two-photon fluorescence lifetime imaging microscopy using a wavelength-tunable femtosecond pulsed laser

A fluorescence lifetime imaging microscopy (FLIM) integrated with two-photon excitation technique was developed. A wavelength-tunable femtosecond pulsed laser with nominal pulse repetition rate of 76-MHz was used to acquire FLIM images with a high pixel rate of 3.91 MHz by processing the pulsed two-photon fluorescence signal. Analog mean-delay (AMD) method was adopted to accelerate the lifetime measurement process and to visualize lifetime map in real-time. As a result, rapid tomographic visualization of both structural and chemical properties of the tissues was possible with longer depth penetration and lower photo-damage compared to the conventional single-photon FLIM techniques.

Multispectral analog-mean-delay fluorescence lifetime imaging combined with optical coherence tomography

The pathophysiological progression of chronic diseases, including atherosclerosis and cancer, is closely related to compositional changes in biological tissues containing endogenous fluorophores such as collagen, elastin, and NADH, which exhibit strong autofluorescence under ultraviolet excitation. Fluorescence lifetime imaging (FLIm) provides robust detection of the compositional changes by measuring fluorescence lifetime, which is an inherent property of a fluorophore. In this paper, we present a dual-modality system combining a multispectral analog-mean-delay (AMD) FLIm and a high-speed swept-source optical coherence tomography (OCT) to simultaneously visualize the cross-sectional morphology and biochemical compositional information of a biological tissue. Experiments using standard fluorescent solutions showed that the fluorescence lifetime could be measured with a precision of less than 40 psec using the multispectral AMD-FLIm without averaging. In addition, we performed ex vivo imaging on rabbit iliac normal-looking and atherosclerotic specimens to demonstrate the feasibility of the combined FLIm-OCT system for atherosclerosis imaging. We expect that the combined FLIm-OCT will be a promising next-generation imaging technique for diagnosing atherosclerosis and cancer due to the advantages of the proposed label-free high-precision multispectral lifetime measurement.

Detection and characterization of early plaque formations by Raman probe spectroscopy and optical coherence tomography: an in vivo study on a rabbit model

Intravascular imaging techniques provide detailed specification about plaque appearance and morphology, but cannot deliver information about the biochemical composition of atherosclerotic plaques. As the biochemical composition is related to the plaque type, important aspects such as the risk of a plaque rupture and treatment are still difficult to assess. Currently, various spectroscopic techniques are tested for potential applications for the chemical analysis of plaque depositions. Here, we employ Raman spectroscopy in combination with optical coherence tomography (OCT) for the characterization of plaques on rabbits in vivo. Experiments were carried out on New Zealand white rabbits treated with a fat- and cholesterol-enriched diet, using a Raman probe setup with a 785-nm multimode laser as an excitation source. Subsequently, OCT images were acquired with a swept source at 1305±55  nm at 22.6 mW. Raman spectra were recorded from normal regions and regions with early plaque formations. The probe positioning was monitored by x-ray angiography. The spectral information identified plaque depositions consisting of lipids, with triglycerides as the major component. Afterward, OCT images of the spectroscopically investigated areas were obtained. The spectral information correlates well with the observed intravascular morphology and is in good agreement with histology. Raman spectroscopy can provide detailed biochemical specification of atherosclerotic plaques.

Portable fluorescence lifetime spectroscopy system for in-situ interrogation of biological tissues

Fluorescence spectroscopy and lifetime techniques are potential methods for optical diagnosis and characterization of biological tissues with an in-situ, fast, and noninvasive interrogation. Several diseases may be diagnosed due to differences in the fluorescence spectra of targeted fluorophores, when, these spectra are similar, considering steady-state fluorescence, others may be detected by monitoring their fluorescence lifetime. Despite this complementarity, most of the current fluorescence lifetime systems are not robust and portable, and not being feasible for clinical applications. We describe the assembly of a fluorescence lifetime spectroscopy system in a suitcase, its characterization, and validation with clinical measurements of skin lesions. The assembled system is all encased and robust, maintaining its mechanical, electrical, and optical stability during transportation, and is feasible for clinical measurements. The instrument response function measured was about 300 ps, and the system is properly calibrated. At the clinical study, the system showed to be reliable, and the achieved spectroscopy results support its potential use as an auxiliary tool for skin diagnostics.

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

Lensless, ultra-wideband fiber optic rotary joint for biomedical applications

The demands of optical fiber-based biomedical applications can, in many cases, outstrip the capabilities of lens-based commercially available fiber optic rotary joints. In some circumstances, it is necessary to use very broad spectral bandwidths (near UV to short-wave IR) and specialized optical fibers, such as double-clad fiber, and have the capacity to accommodate high rotational velocities. The broad spectrum, stretching down into the UV, presents two problems: (1) adequate chromatic correction in the lenses across the entire bandwidth and (2) strong UV absorption by the fluids used to lubricate the rotary joint. To accommodate these types of applications, we have developed an ultra-wideband lensless fiber optic rotary joint based on the principle that when two optical fibers are coaligned and placed in contact (or very close), the optical losses at the junction are very low. The advances demonstrated here enable excellent performance (<0.2  dB insertion loss), even down into the UV and spanning a wavelength range of at least 355-1360 nm with single-mode, multimode, and double-clad fibers. We also demonstrate excellent performance, ∼0.38  dB insertion loss, at rotational velocities up to 8800 rpm (146 Hz). To the best of our knowledge, this is the first demonstration of this type of rotary joint capable of such a wide bandwidth and high rotational velocities.

Deconvolution of fluorescence lifetime imaging microscopy by a library of exponentials

Fluorescence lifetime microscopy imaging (FLIM) is an optic technique that allows a quantitative characterization of the fluorescent components of a sample. However, for an accurate interpretation of FLIM, an initial processing step is required to deconvolve the instrument response of the system from the measured fluorescence decays. In this paper, we present a novel strategy for the deconvolution of FLIM data based on a library of exponentials. Our approach searches for the scaling coefficients of the library by non-negative least squares approximations plus Thikonov/l₂ or l₁ regularization terms. The parameters of the library are given by the lower and upper bounds in the characteristic lifetimes of the exponential functions and the size of the library, where we observe that this last variable is not a limiting factor in the resulting fitting accuracy. We compare our proposal to nonlinear least squares and global non-linear least squares estimations with a multi-exponential model, and also to constrained Laguerre-base expansions, where we visualize an advantage of our proposal based on Thikonov/l₂ regularization in terms of estimation accuracy, computational time, and tuning strategy. Our validation strategy considers synthetic datasets subject to both shot and Gaussian noise and samples with different lifetime maps, and experimental FLIM data of ex-vivo atherosclerotic plaques and human breast cancer cells.

Blind deconvolution estimation of fluorescence measurements through quadratic programming

Time-deconvolution of the instrument response from fluorescence lifetime imaging microscopy (FLIM) data is usually necessary for accurate fluorescence lifetime estimation. In many applications, however, the instrument response is not available. In such cases, a blind deconvolution approach is required. An iterative methodology is proposed to address the blind deconvolution problem departing from a dataset of FLIM measurements. A linear combination of a base conformed by Laguerre functions models the fluorescence impulse response of the sample at each spatial point in our formulation. Our blind deconvolution estimation (BDE) algorithm is formulated as a quadratic approximation problem, where the decision variables are the samples of the instrument response and the scaling coefficients of the basis functions. In the approximation cost function, there is a bilinear dependence on the decision variables. Hence, due to the nonlinear nature of the estimation process, an alternating least-squares scheme iteratively solves the approximation problem. Our proposal searches for the samples of the instrument response with a global perspective, and the scaling coefficients of the basis functions locally at each spatial point. First, the iterative methodology relies on a least-squares solution for the instrument response, and quadratic programming for the scaling coefficients applied just to a subset of the measured fluorescence decays to initially estimate the instrument response to speed up the convergence. After convergence, the final stage computes the fluorescence impulse response at all spatial points. A comprehensive validation stage considers synthetic and experimental FLIM datasets of ex vivo atherosclerotic plaques and human breast cancer cell samples that highlight the advantages of the proposed BDE algorithm under different noise and initial conditions in the iterative scheme and parameters of the proposal.

Extended output phasor representation of multi-spectral fluorescence lifetime imaging microscopy

In this paper, we investigate novel low-dimensional and model-free representations for multi-spectral fluorescence lifetime imaging microscopy (m-FLIM) data. We depart from the classical definition of the phasor in the complex plane to propose the extended output phasor (EOP) and extended phasor (EP) for multi-spectral information. The frequency domain properties of the EOP and EP are analytically studied based on a multiexponential model for the impulse response of the imaged tissue. For practical implementations, the EOP is more appealing since there is no need to perform deconvolution of the instrument response from the measured m-FLIM data, as in the case of EP. Our synthetic and experimental evaluations with m-FLIM datasets of human coronary atherosclerotic plaques show that low frequency indexes have to be employed for a distinctive representation of the EOP and EP, and to reduce noise distortion. The tissue classification of the m-FLIM datasets by EOP and EP also improves with low frequency indexes, and does not present significant differences by using either phasor.

Blind source separation of ex-vivo aorta tissue multispectral images

Blind Source Separation methods (BSS) aim for the decomposition of a given signal in its main components or source signals. Those techniques have been widely used in the literature for the analysis of biomedical images, in order to extract the main components of an organ or tissue under study. The analysis of skin images for the extraction of melanin and hemoglobin is an example of the use of BSS. This paper presents a proof of concept of the use of source separation of ex-vivo aorta tissue multispectral Images. The images are acquired with an interference filter-based imaging system. The images are processed by means of two algorithms: Independent Components analysis and Non-negative Matrix Factorization. In both cases, it is possible to obtain maps that quantify the concentration of the main chromophores present in aortic tissue. Also, the algorithms allow for spectral absorbance of the main tissue components. Those spectral signatures were compared against the theoretical ones by using correlation coefficients. Those coefficients report values close to 0.9, which is a good estimator of the method's performance. Also, correlation coefficients lead to the identification of the concentration maps according to the evaluated chromophore. The results suggest that Multi/hyper-spectral systems together with image processing techniques is a potential tool for the analysis of cardiovascular tissue.

Non-linear imaging and characterization of atherosclerotic arterial tissue using combined SHG and FLIM microscopy

Atherosclerosis is one of the leading causes of death in the Western World and its characterization is extremely interesting from the diagnostic point of view. Here, we employed combined SHG-FLIM microscopy to characterize arterial tissue with atherosclerosis. The shorter mean fluorescence lifetime measured within plaque depositions (1260 ± 80 ps) with respect to normal arterial wall (1480 ± 100 ps) allowed discriminating collagen from lipids. SHG measurements and image analysis demonstrated that the normal arterial wall has a more anisotropic Aspect Ratio (0.37 ± 0.02) with respect to plaque depositions (0.61 ± 0.02) and that the correlation length can be used for discriminating collagen fibre bundles (2.0 ± 0.6 µm) from cholesterol depositions (4.1 ± 0.6 µm). The presented method has the potential to find place in a clinical setting as well as to be applied in vivo in the near future. Graphic composition of SHG and FLIM images representing normal arterial wall and plaque depositions.

Simultaneous morphological and biochemical endogenous optical imaging of atherosclerosis

AIMS

The aim of this study was to validate novel imaging technology for simultaneous morphological and biochemical endogenous optical imaging of coronary atherosclerotic plaque.

METHODS AND RESULTS

Optical coherence tomography (OCT) generates high-resolution 3D images of plaque morphology and endogenous fluorescence lifetime imaging microscopy (FLIM) characterizes biochemical composition. Both imaging modalities rely on plaque's intrinsic optical characteristics, making contrast agents unnecessary. A multimodal OCT/FLIM system was utilized to generate luminal biochemical maps superimposed on high-resolution (7 µm axial and 13 µm lateral) structural volumetric images. Forty-seven fresh postmortem human coronary segments were imaged: pathological intimal thickening (PIT, n = 26), fibroatheroma (FA, n = 12), thin-cap FA (TCFA, n = 2), and fibrocalcific plaque (CA, n = 7), determined by histopathology. Multimodal images were evaluated, and each plaque identified as PIT, FA, TCFA, or CA based on expert OCT readers, and as having high-lipid (HL), high-collagen (HC), or low-collagen/low-lipid (LCL) luminal composition based on linear discriminant analysis of FLIM. Of 47 plaques, 89.4% (42/47) of the plaques were correctly identified based on OCT/FLIM evaluation using tissue histopathology and immunohistochemistry as the gold standard. Four of the misclassifications corresponded to confusing PIT with HL luminal composition for FA with HL cap. The other corresponded to confusing FA with a HC cap for FA with an LCL cap.

CONCLUSION

We have demonstrated the feasibility of accurate simultaneous OCT/FLIM morphological and biochemical characterization of coronary plaques at spatial resolutions and acquisition speeds compatible with catheter-based intravascular imaging. The success of this pilot study sets up future development of a multimodal intravascular imaging system that will enable studies that could help improve our understanding of plaque pathogenesis.

Application of time-resolved autofluorescence to label-free in vivo optical mapping of changes in tissue matrix and metabolism associated with myocardial infarction and heart failure

We investigate the potential of an instrument combining time-resolved spectrofluorometry and diffuse reflectance spectroscopy to measure structural and metabolic changes in cardiac tissue in vivo in a 16 week post-myocardial infarction heart failure model in rats. In the scar region, we observed changes in the fluorescence signal that can be explained by increased collagen content, which is in good agreement with histology. In areas remote from the scar tissue, we measured changes in the fluorescence signal (p < 0.001) that cannot be explained by differences in collagen content and we attribute this to altered metabolism within the myocardium. A linear discriminant analysis algorithm was applied to the measurements to predict the tissue disease state. When we combine all measurements, our results reveal high diagnostic accuracy in the infarcted area (100%) and border zone (94.44%) as well as in remote regions from the scar (> 77%). Overall, our results demonstrate the potential of our instrument to characterize structural and metabolic changes in a failing heart in vivo without using exogenous labels.

Blind end-member and abundance extraction for multispectral fluorescence lifetime imaging microscopy data

This paper proposes a new blind end-member and abundance extraction (BEAE) method for multispectral fluorescence lifetime imaging microscopy (m-FLIM) data. The chemometrical analysis relies on an iterative estimation of the fluorescence decay end-members and their abundances. The proposed method is based on a linear mixture model with positivity and sum-to-one restrictions on the abundances and end-members to compensate for signature variability. The synthesis procedure depends on a quadratic optimization problem, which is solved by an alternating least-squares structure over convex sets. The BEAE strategy only assumes that the number of components in the analyzed sample is known a spriori. The proposed method is first validated by using synthetic m-FLIM datasets at 15, 20, and 25 dB signal-to-noise ratios. The samples simulate the mixed response of tissue containing multiple fluorescent intensity decays. Furthermore, the results were also validated with six m-FLIM datasets from fresh postmortem human coronary atherosclerotic plaques. A quantitative evaluation of the BEAE was made against two popular techniques: minimum volume constrained nonnegative matrix factorization (MVC-NMF) and multivariate curve resolution-alternating least-squares (MCR-ALS). Our proposed method (BEAE) was able to provide more accurate estimations of the end-members: 0.32% minimum relative error and 13.82% worst-case scenario, despite different initial conditions in the iterative optimization procedure and noise effect. Meanwhile, MVC-NMF and MCR-ALS presented more variability in estimating the end-members: 0.35% and 0.34% for minimum errors and 15.31% and 13.25% in the worst-case scenarios, respectively. This tendency was also maintained for the abundances, where BEAE obtained 0.05 as the minimum absolute error and 0.12 in the worst-case scenario; MCR-ALS and MVC-NMF achieved 0.04 and 0.06 for the minimum absolute errors, and 0.15 and 0.17 under the worst-case conditions, respectively. In addition, the average computation time was evaluated for the synthetic datasets, where MVC-NMF achieved the fastest time, followed by BEAE and finally MCR-ALS. Consequently, BEAE improved MVC-NMF in convergence to a local optimal solution and robustness against signal variability, and it is roughly 3.6 time faster than MCR-ALS.

Estimation of the number of fluorescent end-members for quantitative analysis of multispectral FLIM data

Multispectral fluorescence lifetime imaging (m-FLIM) can potentially allow identifying the endogenous fluorophores present in biological tissue. Quantitative description of such data requires estimating the number of components in the sample, their characteristic fluorescent decays, and their relative contributions or abundances. Unfortunately, this inverse problem usually requires prior knowledge about the data, which is seldom available in biomedical applications. This work presents a new methodology to estimate the number of potential endogenous fluorophores present in biological tissue samples from time-domain m-FLIM data. Furthermore, a completely blind linear unmixing algorithm is proposed. The method was validated using both synthetic and experimental m-FLIM data. The experimental m-FLIM data include in-vivo measurements from healthy and cancerous hamster cheek-pouch epithelial tissue, and ex-vivo measurements from human coronary atherosclerotic plaques. The analysis of m-FLIM data from in-vivo hamster oral mucosa identified healthy from precancerous lesions, based on the relative concentration of their characteristic fluorophores. The algorithm also provided a better description of atherosclerotic plaques in term of their endogenous fluorophores. These results demonstrate the potential of this methodology to provide quantitative description of tissue biochemical composition.

Lipidomics applications in health, disease and nutrition research

The structural and functional diversity of lipids accounts for their involvement into a wide range of homeostatic processes and disease states, including lifestyle-related diseases as well as genetic conditions. Challenges presented by this diversity have been addressed to a great extent by the development of lipidomics, a platform that makes possible the detailed profiling and characterisation of lipid species present in any cell, organelle, tissue or body fluid, and allows for a wider appreciation of the biological role of lipid networks. Progress in the field of lipidomics has been greatly facilitated by recent advances in MS and includes a range of analytical platforms supporting applications spanning from qualitative and quantitative assessment of multiple species to lipid imaging. Here we review these MS techniques currently in routine use in lipidomics, alongside with new ones that have started making an impact in the field. Recent applications in health, disease and nutrition-related questions will also be discussed with a view to convey the importance of lipidomics contributions to biosciences and food technology.

A fully constrained optimization method for time-resolved multispectral fluorescence lifetime imaging microscopy data unmixing

This paper presents a new unmixing methodology of multispectral fluorescence lifetime imaging microscopy (m-FLIM) data, in which the spectrum is defined as the combination of time-domain fluorescence decays at multiple emission wavelengths. The method is based on a quadratic constrained optimization (CO) algorithm that provides a closed-form solution under equality and inequality restrictions. In this paper, it is assumed that the time-resolved fluorescence spectrum profiles of the constituent components are linearly independent and known a priori. For comparison purposes, the standard least squares (LS) solution and two constrained versions nonnegativity constrained least squares (NCLS) and fully constrained least squares (FCLS) (Heinz and Chang, 2001) are also tested. Their performance was evaluated by using synthetic simulations, as well as imaged samples from fluorescent dyes and ex vivo tissue. In all the synthetic evaluations, the CO obtained the best accuracy in the estimations of the proportional contributions. CO could achieve an improvement ranging between 41% and 59% in the relative error compared to LS, NCLS, and FCLS at different signal-to-noise ratios. A liquid mixture of fluorescent dyes was also prepared and imaged in order to provide a controlled scenario with real data, where CO and FCLS obtained the best performance. The CO and FCLS were also tested with 20 ex vivo samples of human coronary arteries, where the expected concentrations are qualitatively known. A certainty measure was employed to assess the confidence in the estimations made by each algorithm. The experiments confirmed a better performance of CO, since this method is optimal with respect to equality and inequality restrictions in the linear unmixing formulation. Thus, the evaluation showed that CO achieves an accurate characterization of the samples. Furthermore, CO is a computational efficient alternative to estimate the abundance of components in m-FLIM data, since a global optimal solution is always guaranteed in a closed form.

Application of non-negative matrix factorization to multispectral FLIM data analysis

Existing methods of interpreting fluorescence lifetime imaging microscopy (FLIM) images are based on comparing the intensity and lifetime values at each pixel with those of known fluorophores. This method becomes unwieldy and subjective in many practical applications where there are several fluorescing species contributing to the bulk fluorescence signal, and even more so in the case of multispectral FLIM. Non-negative matrix factorization (NMF) is a multivariate data analysis technique aimed at extracting non-negative signatures of pure components and their non-negative abundances from an additive mixture of those components. In this paper, we present the application of NMF to multispectral time-domain FLIM data to obtain a new set of FLIM features (relative abundance of constituent fluorophores). These features are more intuitive and easier to interpret than the standard fluorescence intensity and lifetime values. The proposed approach, unlike several FLIM data analysis methods, is not limited by the number of constituent fluorescing species or their possibly complex decay dynamics. Moreover, the new set of FLIM features can be obtained by processing raw multispectral FLIM intensity data, thereby rendering time deconvolution unnecessary and resulting in lesser computational time and relaxed SNR requirements. The performance of the NMF method was validated on simulated and experimental multispectral time-domain FLIM data. The NMF features were also compared against the standard intensity and lifetime features, in terms of their ability to discriminate between different types of atherosclerotic plaques.

A fluorescence lifetime imaging classification method to investigate the collagen to lipid ratio in fibrous caps of atherosclerotic plaque

BACKGROUND AND OBJECTIVE

This study describes a novel fluorescence lifetime imaging (FLIM) classification method to determine the ratio of collagen to lipid content in the fibrous cap of atherosclerotic plaques. Additionally, an analytical process to assess risk of plaque rupture based on this ratio is proposed. Collagen to lipid ratio has been shown to be an important parameter to evaluate structural integrity of the fibrous cap. FLIM and other time-resolved fluorescence techniques have recently been applied to the study of atherosclerosis based on the ability to assess biochemical composition.

STUDY DESIGN/MATERIALS AND METHODS

Autofluorescence of specimens retrieved during carotid endarterectomy procedures was measured through three optical filters, F377: 377/50 nm, F460: 460/66 nm, and F510: 510/84 nm (center wavelength/bandwidth). A Laguerre deconvolution technique was used for the evaluation of fluorescence decay dynamics. The resulting decay parameters (average fluorescence lifetime and 4 Laguerre coefficients at each of the recorded bandwidths) were used for sample characterization. Linear discriminant analysis (LDA) was used to classify each image into collagen or lipid-rich regions based on these parameters. Ultimately, a risk-level was assigned based on the ratio of collagen to lipid on the surface of the fibrous cap.

RESULTS

FLIM images were acquired in 18 carotid plaque specimens at 43 locations. Classification of collagen and lipid-rich regions within the fibrous cap was performed with sensitivity and specificity of 80% and 82%, respectively.

CONCLUSIONS

Results from this study show that an LDA method of classifying regions of FLIM images of carotid plaque into collagen and lipid-rich regions is capable of being automated and used to rate the risk of plaque rupture based on autofluorescence decay dynamics and without the need for fluorescence intensity or contrast agents.