1
|
Zang Z, Xiao D, Wang Q, Li Z, Xie W, Chen Y, Li DDU. Fast Analysis of Time-Domain Fluorescence Lifetime Imaging via Extreme Learning Machine. SENSORS 2022; 22:s22103758. [PMID: 35632167 PMCID: PMC9146214 DOI: 10.3390/s22103758] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 05/11/2022] [Accepted: 05/13/2022] [Indexed: 01/25/2023]
Abstract
We present a fast and accurate analytical method for fluorescence lifetime imaging microscopy (FLIM), using the extreme learning machine (ELM). We used extensive metrics to evaluate ELM and existing algorithms. First, we compared these algorithms using synthetic datasets. The results indicate that ELM can obtain higher fidelity, even in low-photon conditions. Afterwards, we used ELM to retrieve lifetime components from human prostate cancer cells loaded with gold nanosensors, showing that ELM also outperforms the iterative fitting and non-fitting algorithms. By comparing ELM with a computational efficient neural network, ELM achieves comparable accuracy with less training and inference time. As there is no back-propagation process for ELM during the training phase, the training speed is much higher than existing neural network approaches. The proposed strategy is promising for edge computing with online training.
Collapse
Affiliation(s)
- Zhenya Zang
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G4 0RE, UK; (Z.Z.); (D.X.); (Q.W.); (W.X.)
| | - Dong Xiao
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G4 0RE, UK; (Z.Z.); (D.X.); (Q.W.); (W.X.)
| | - Quan Wang
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G4 0RE, UK; (Z.Z.); (D.X.); (Q.W.); (W.X.)
| | - Zinuo Li
- Department of Physics, University of Strathclyde, Glasgow G4 0NG, UK; (Z.L.); (Y.C.)
| | - Wujun Xie
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G4 0RE, UK; (Z.Z.); (D.X.); (Q.W.); (W.X.)
| | - Yu Chen
- Department of Physics, University of Strathclyde, Glasgow G4 0NG, UK; (Z.L.); (Y.C.)
| | - David Day Uei Li
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G4 0RE, UK; (Z.Z.); (D.X.); (Q.W.); (W.X.)
- Correspondence:
| |
Collapse
|
2
|
Li Y, Sapermsap N, Yu J, Tian J, Chen Y, Day-Uei Li D. Histogram clustering for rapid time-domain fluorescence lifetime image analysis. BIOMEDICAL OPTICS EXPRESS 2021; 12:4293-4307. [PMID: 34457415 PMCID: PMC8367240 DOI: 10.1364/boe.427532] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 05/30/2021] [Accepted: 06/08/2021] [Indexed: 05/03/2023]
Abstract
We propose a histogram clustering (HC) method to accelerate fluorescence lifetime imaging (FLIM) analysis in pixel-wise and global fitting modes. The proposed method's principle was demonstrated, and the combinations of HC with traditional FLIM analysis were explained. We assessed HC methods with both simulated and experimental datasets. The results reveal that HC not only increases analysis speed (up to 106 times) but also enhances lifetime estimation accuracy. Fast lifetime analysis strategies were suggested with execution times around or below 30 μs per histograms on MATLAB R2016a, 64-bit with the Intel Celeron CPU (2950M @ 2GHz).
Collapse
Affiliation(s)
- Yahui Li
- Key Laboratory of Ultra-fast Photoelectric Diagnostics Technology, Xi'an Institute of Optics and Precision Mechanics, Xi'an Shaanxi 710049, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan Shanxi 030006, China
| | - Natakorn Sapermsap
- Department of Physics, Scottish Universities Physics Alliance, University of Strathclyde, Glasgow, G4 0NG, United Kingdom
| | - Jun Yu
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow G4 0RE, United Kingdom
| | - Jinshou Tian
- Key Laboratory of Ultra-fast Photoelectric Diagnostics Technology, Xi'an Institute of Optics and Precision Mechanics, Xi'an Shaanxi 710049, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan Shanxi 030006, China
| | - Yu Chen
- Department of Physics, Scottish Universities Physics Alliance, University of Strathclyde, Glasgow, G4 0NG, United Kingdom
| | - David Day-Uei Li
- Department of Biomedical Engineering, University of Strathclyde, Glasgow G1 0NW, United Kingdom
| |
Collapse
|
3
|
Mukherjee L, Sagar MAK, Ouellette JN, Watters JJ, Eliceiri KW. Joint regression-classification deep learning framework for analyzing fluorescence lifetime images using NADH and FAD. BIOMEDICAL OPTICS EXPRESS 2021; 12:2703-2719. [PMID: 34123498 PMCID: PMC8176805 DOI: 10.1364/boe.417108] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Revised: 02/21/2021] [Accepted: 03/30/2021] [Indexed: 06/12/2023]
Abstract
In this paper, we develop a deep neural network based joint classification-regression approach to identify microglia, a resident central nervous system macrophage, in the brain using fluorescence lifetime imaging microscopy (FLIM) data. Microglia are responsible for several key aspects of brain development and neurodegenerative diseases. Accurate detection of microglia is key to understanding their role and function in the CNS, and has been studied extensively in recent years. In this paper, we propose a joint classification-regression scheme that can incorporate fluorescence lifetime data from two different autofluorescent metabolic co-enzymes, FAD and NADH, in the same model. This approach not only represents the lifetime data more accurately but also provides the classification engine a more diverse data source. Furthermore, the two components of model can be trained jointly which combines the strengths of the regression and classification methods. We demonstrate the efficacy of our method using datasets generated using mouse brain tissue which show that our joint learning model outperforms results on the coenzymes taken independently, providing an efficient way to classify microglia from other cells.
Collapse
Affiliation(s)
- Lopamudra Mukherjee
- Department of Computer Science, University of Wisconsin Whitewater, Whitewater WI 53190, USA
- Co-corresponding authors
| | - Md Abdul Kader Sagar
- Laboratory for Optical and Computational Instrumentation, Department of Biomedical Engineering, University of Wisconsin Madison, Madison, WI 53705, USA
| | - Jonathan N Ouellette
- Laboratory for Optical and Computational Instrumentation, Department of Biomedical Engineering, University of Wisconsin Madison, Madison, WI 53705, USA
| | - Jyoti J Watters
- Department of Comparative Biosciences, University of Wisconsin Madison, Madison, WI 53705, USA
| | - Kevin W Eliceiri
- Laboratory for Optical and Computational Instrumentation, Department of Biomedical Engineering, University of Wisconsin Madison, Madison, WI 53705, USA
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI 53706, USA
- Morgridge Institute for Research, Madison, WI 53706, USA
- Co-corresponding authors
| |
Collapse
|
4
|
Laverny O, Masiello E, Maume-Deschamps V, Rullière D. Estimation of multivariate generalized gamma convolutions through Laguerre expansions. Electron J Stat 2021. [DOI: 10.1214/21-ejs1918] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Oskar Laverny
- Institut Camille Jordan - ICJ, Univ Lyon, Université Claude Bernard Lyon 1, CNRS UMR 5208, F-69622 Villeurbanne, France SCOR SE
| | - Esterina Masiello
- Institut Camille Jordan - ICJ, Univ Lyon, Université Claude Bernard Lyon 1, CNRS UMR 5208, F-69622 Villeurbanne, France
| | - Véronique Maume-Deschamps
- Institut Camille Jordan - ICJ, Univ Lyon, Université Claude Bernard Lyon 1, CNRS UMR 5208, F-69622 Villeurbanne, France
| | - Didier Rullière
- Mines Saint-Étienne, Univ Clermont Auvergne, CNRS, UMR 6158 LIMOS, Institut Henri Fayol, Saint-Etienne, France
| |
Collapse
|
5
|
Fereidouni F, Gorpas D, Ma D, Fatakdawala H, Marcu L. Rapid fluorescence lifetime estimation with modified phasor approach and Laguerre deconvolution: a comparative study. Methods Appl Fluoresc 2017; 5:035003. [PMID: 28644150 PMCID: PMC6043162 DOI: 10.1088/2050-6120/aa7b62] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Fluorescence lifetime imaging has been shown to serve as a valuable tool for interrogating and diagnosis of biological tissue at a mesoscopic level. The ability to analyze fluorescence decay curves to extract lifetime values in real-time is crucial for clinical translation and applications such as tumor margin delineation or intracoronary imaging of atherosclerotic plaques. In this work, we compare the performance of two popular non-parametric (fit-free) methods for determining lifetime values from fluorescence decays in real-time-the Phasor approach and Laguerre deconvolution. We demonstrate results from simulated and experimental data to compare the accuracy and speed of both methods and their dependence on noise and model parameters.
Collapse
Affiliation(s)
- Farzad Fereidouni
- Department of Pathology and Laboratory Medicine, 4400 V Street, CA 95817, United States of America
| | | | | | | | | |
Collapse
|
6
|
Le Marois A, Labouesse S, Suhling K, Heintzmann R. Noise-Corrected Principal Component Analysis of fluorescence lifetime imaging data. JOURNAL OF BIOPHOTONICS 2017; 10:1124-1133. [PMID: 27943625 DOI: 10.1002/jbio.201600160] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2016] [Revised: 09/23/2016] [Accepted: 11/14/2016] [Indexed: 05/08/2023]
Abstract
Fluorescence Lifetime Imaging (FLIM) is an attractive microscopy method in the life sciences, yielding information on the sample otherwise unavailable through intensity-based techniques. A novel Noise-Corrected Principal Component Analysis (NC-PCA) method for time-domain FLIM data is presented here. The presence and distribution of distinct microenvironments are identified at lower photon counts than previously reported, without requiring prior knowledge of their number or of the dye's decay kinetics. A noise correction based on the Poisson statistics inherent to Time-Correlated Single Photon Counting is incorporated. The approach is validated using simulated data, and further applied to experimental FLIM data of HeLa cells stained with membrane dye di-4-ANEPPDHQ. Two distinct lipid phases were resolved in the cell membranes, and the modification of the order parameters of the plasma membrane during cholesterol depletion was also detected. Noise-corrected Principal Component Analysis of FLIM data resolves distinct microenvironments in cell membranes of live HeLa cells.
Collapse
Affiliation(s)
- Alix Le Marois
- Department of Physics, King's College London, Strand, WC2R 2LS, London, United Kingdom
| | - Simon Labouesse
- Institute Fresnel, Avenue Escadrille Normandie Niemen, 13013, Marseille, France
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, 07745, Jena, Germany
| | - Klaus Suhling
- Department of Physics, King's College London, Strand, WC2R 2LS, London, United Kingdom
| | - Rainer Heintzmann
- Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, 07745, Jena, Germany
- Institute of Physical Chemistry, Abbe Centre of Photonics, Friedrich Schiller University Jena, Helmholtzweg 4, 07743, Jena, Germany
| |
Collapse
|
7
|
Zhang Y, Cuyt A, Lee WS, Lo Bianco G, Wu G, Chen Y, Li DDU. Towards unsupervised fluorescence lifetime imaging using low dimensional variable projection. OPTICS EXPRESS 2016; 24:26777-26791. [PMID: 27857408 DOI: 10.1364/oe.24.026777] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Analyzing large fluorescence lifetime imaging (FLIM) data is becoming overwhelming; the latest FLIM systems easily produce massive amounts of data, making an efficient analysis more challenging than ever. In this paper we propose the combination of a custom-fit variable projection method, with a Laguerre expansion based deconvolution, to analyze bi-exponential data obtained from time-domain FLIM systems. Unlike nonlinear least squares methods, which require a suitable initial guess from an experienced researcher, the new method is free from manual interventions and hence can support automated analysis. Monte Carlo simulations are carried out on synthesized FLIM data to demonstrate the performance compared to other approaches. The performance is also illustrated on real-life FLIM data obtained from the study of autofluorescence of daisy pollen and the endocytosis of gold nanorods (GNRs) in living cells. In the latter, the fluorescence lifetimes of the GNRs are much shorter than the full width at half maximum of the instrument response function. Overall, our proposed method contains simple steps and shows great promise in realising automated FLIM analysis of large data sets.
Collapse
|