1
|
Zhang Z, Liu X, He M, Huang Y, Xu L, Han Y, Zhu D, Hao X, Kuang C, Liu X. High-throughput multiplexed fluorescence lifetime microscopy. OPTICS LETTERS 2023; 48:5547-5550. [PMID: 37910699 DOI: 10.1364/ol.503136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 09/28/2023] [Indexed: 11/03/2023]
Abstract
Fluorescence lifetime microscopy has been widely used in quantifying cellular interaction or histopathological identification of different stained tissues. A novel, to the best of our knowledge, approach for high-throughput multiplexed fluorescence lifetime imaging is presented. To establish a high-throughput fluorescence lifetime acquisition system, a uniformed illumination optical focus array was generated by a novel computer-generated hologram algorithm based on matrix triple product. This, in conjunction with an array detector and multichannel time-correlated single-photon counting, enables the full use of the acquisition ability of each detector. By utilizing interval segmentation of photon time detection, a high-throughput multiplexed fluorescence lifetime imaging is achieved. Experimental results demonstrate that this method achieves a fivefold increase in the collection throughput of fluorescence lifetime and is capable of simultaneous dual-target fluorescence lifetime measurement.
Collapse
|
2
|
Barroso M, Monaghan MG, Niesner R, Dmitriev RI. Probing organoid metabolism using fluorescence lifetime imaging microscopy (FLIM): The next frontier of drug discovery and disease understanding. Adv Drug Deliv Rev 2023; 201:115081. [PMID: 37647987 PMCID: PMC10543546 DOI: 10.1016/j.addr.2023.115081] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 04/20/2023] [Accepted: 08/24/2023] [Indexed: 09/01/2023]
Abstract
Organoid models have been used to address important questions in developmental and cancer biology, tissue repair, advanced modelling of disease and therapies, among other bioengineering applications. Such 3D microenvironmental models can investigate the regulation of cell metabolism, and provide key insights into the mechanisms at the basis of cell growth, differentiation, communication, interactions with the environment and cell death. Their accessibility and complexity, based on 3D spatial and temporal heterogeneity, make organoids suitable for the application of novel, dynamic imaging microscopy methods, such as fluorescence lifetime imaging microscopy (FLIM) and related decay time-assessing readouts. Several biomarkers and assays have been proposed to study cell metabolism by FLIM in various organoid models. Herein, we present an expert-opinion discussion on the principles of FLIM and PLIM, instrumentation and data collection and analysis protocols, and general and emerging biosensor-based approaches, to highlight the pioneering work being performed in this field.
Collapse
Affiliation(s)
- Margarida Barroso
- Department of Molecular and Cellular Physiology, Albany Medical College, Albany, NY 12208, USA
| | - Michael G Monaghan
- Department of Mechanical, Manufacturing and Biomedical Engineering, Trinity College Dublin, Dublin 02, Ireland
| | - Raluca Niesner
- Dynamic and Functional In Vivo Imaging, Freie Universität Berlin and Biophysical Analytics, German Rheumatism Research Center, Berlin, Germany
| | - Ruslan I Dmitriev
- Tissue Engineering and Biomaterials Group, Department of Human Structure and Repair, Faculty of Medicine and Health Sciences, Ghent University, C. Heymanslaan 10, 9000 Ghent, Belgium; Ghent Light Microscopy Core, Ghent University, 9000 Ghent, Belgium.
| |
Collapse
|
3
|
Yu H, Wang L, Xu J, Chiang PY. A dToF Ranging Sensor with Accurate Photon Detector Measurements for LiDAR Applications. SENSORS (BASEL, SWITZERLAND) 2023; 23:3011. [PMID: 36991721 PMCID: PMC10052149 DOI: 10.3390/s23063011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/02/2023] [Accepted: 03/06/2023] [Indexed: 06/19/2023]
Abstract
Direct time-of-flight (dToF) ranging sensors based on single-photon avalanche diodes (SPADs) have been used as a prominent depth-sensing devices. Time-to-digital converters (TDCs) and histogram builders have become the standard for dToF sensors. However, one of the main current issues is the bin width of the histogram, which limits the accuracy of depth without TDC architecture modifications. SPAD-based light detection and ranging (LiDAR) systems require new methods to overcome their inherent drawbacks for accurate 3D ranging. In this work, we report an optimal matched filter to process the raw data of the histogram to obtain high-accuracy depth. This method is performed by feeding the raw data of the histogram into the different matched filters and using the Center-of-Mass (CoM) algorithm for depth extraction. Comparing the measurement results of different matched filters, the filter with the highest depth accuracy can be obtained. Finally, we implemented a dToF system-on-chip (SoC) ranging sensor. The sensor is made of a configurable array of 16 × 16 SPADs, a 940 nm vertical-cavity surface-emitting laser (VCSEL), an integrated VCSEL driver, and an embedded microcontroller unit (MCU) core to implement the best matched filter. To achieve suitably high reliability and low cost, the above-mentioned features are all packaged into one module for ranging. The system resulted in a precision of better than 5 mm within 6 m with 80% reflectance of the target, and had a precision better than 8 mm at a distance within 4 m with 18% reflectance of the target.
Collapse
Affiliation(s)
- Hengwei Yu
- State Key Laboratory of ASIC & System, Fudan University, Shanghai 201203, China
| | - Long Wang
- PhotonIC Technologies, Shanghai 201203, China
| | - Jiqing Xu
- State Key Laboratory of ASIC & System, Fudan University, Shanghai 201203, China
| | - Patrick Yin Chiang
- State Key Laboratory of ASIC & System, Fudan University, Shanghai 201203, China
| |
Collapse
|
4
|
Chen YH, Li J, Xie SP, Wang Q. Single-photon 3D imaging with a multi-stage network. OPTICS EXPRESS 2022; 30:29173-29188. [PMID: 36299098 DOI: 10.1364/oe.465071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Accepted: 07/11/2022] [Indexed: 06/16/2023]
Abstract
Active single-photon 3D imaging technology has been applied to 3D imaging of complex scenes in many frontier fields such as biomedicine, remote sensing mapping, etc. However, single-photon 3D imaging with strong background noise is still a major challenge. Several classical algorithms and machine learning methods have been proposed to solve the problem. In this paper, we propose a novel multi-stage synergistic recovery network to reconstruct an accurate depth map. In the model, we first extract multi-scale feature information using encoder and decoder architectures, then combine them with an original resolution network that retains complete spatial location information. Through this way, we can compensate the deficiencies of the original resolution network for multi-scale local feature extraction. Moreover, a self-supervised attention module (SAM) is constructed to weight local features between different stages, optimizing the feature exchange between different stages of the multi-stage architecture network. Our method currently performs the best of all the tested methods.
Collapse
|
5
|
Laine RF, Poudel C, Kaminski CF. A method for the fast and photon-efficient analysis of time-domain fluorescence lifetime image data over large dynamic ranges. J Microsc 2022; 287:138-147. [PMID: 35676768 PMCID: PMC9544871 DOI: 10.1111/jmi.13128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 05/30/2022] [Accepted: 05/31/2022] [Indexed: 11/29/2022]
Abstract
Fluorescence lifetime imaging (FLIM) allows the quantification of sub‐cellular processes in situ, in living cells. A number of approaches have been developed to extract the lifetime from time‐domain FLIM data, but they are often limited in terms of speed, photon efficiency, precision or the dynamic range of lifetimes they can measure. Here, we focus on one of the best performing methods in the field, the centre‐of‐mass method (CMM), that conveys advantages in terms of speed and photon efficiency over others. In this paper, however, we identify a loss of photon efficiency of CMM for short lifetimes when background noise is present. We subsequently present a new development and generalization of CMM that provides for the rapid and accurate extraction of fluorescence lifetime over a large lifetime dynamic range. We provide software tools to simulate, validate and analyse FLIM data sets and compare the performance of our approach against the standard CMM and the commonly employed least‐square minimization (LSM) methods. Our method features a better photon efficiency than standard CMM and LSM and is robust in the presence of background noise. The algorithm is applicable to any time‐domain FLIM data set.
Collapse
Affiliation(s)
- Romain F Laine
- Laser Analytics Group, Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, UK.,Medical Research Council Laboratory for Molecular Cell Biology (LMCB), University College London, Gower Street, London, WC1E 6BT
| | - Chetan Poudel
- Laser Analytics Group, Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, UK.,Department of Chemistry, University of Washington, Seattle, WA 98195, USA
| | - Clemens F Kaminski
- Laser Analytics Group, Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, UK
| |
Collapse
|
6
|
Netaev A, Schierbaum N, Seidl K. Advantages and Limitations of Fluorescence Lifetime Measurements Using Single-Photon Avalanche Diode (SPAD) Array Detector: A Comprehensive Theoretical and Experimental Study. SENSORS (BASEL, SWITZERLAND) 2022; 22:3822. [PMID: 35632231 PMCID: PMC9144122 DOI: 10.3390/s22103822] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 05/15/2022] [Accepted: 05/16/2022] [Indexed: 02/01/2023]
Abstract
Fast fluorescence lifetime (FL) determination is a major factor for studying dynamic processes. To achieve a required precision and accuracy a certain number of photon counts must be detected. FL methods based on single-photon counting have strongly limited count rates because of the detector's pile-up issue and are suffering from long measurement times in the order of tens of seconds. Here, we present an experimental and Monte Carlo simulation-based study of how this limitation can be overcome using array detectors based on single-photon avalanche diodes (SPADs). We investigated the maximum count rate per pixel to determine FL with a certain precision and accuracy before pile-up occurs. Based on that, we derived an analytical expression to calculate the total measurement time which is proportional to the FL and inversely proportional to the number of pixels. However, a higher number of pixels drastically increases data rate. This can be counteracted by lowering the time resolution. We found that even with a time resolution of four times the FL, an accuracy of 10% can be achieved. Taken all together, FLs between 10 ns and 3 ns can be determined with a 300-pixel SPAD array detector with a measurement time and data rate less than 1 µs and 700 Mbit/s, respectively. This shows the enormous potential of SPAD array detector for high-speed applications requiring continuous data read out.
Collapse
Affiliation(s)
- Alexander Netaev
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany; (N.S.); (K.S.)
| | - Nicolas Schierbaum
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany; (N.S.); (K.S.)
| | - Karsten Seidl
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany; (N.S.); (K.S.)
- Department of Electronic Components and Circuits, University of Duisburg-Essen, 47057 Duisburg, Germany
| |
Collapse
|
7
|
Avanzi E, Behera A, Contini D, Spinelli L, Dalla Mora A, Di Sieno L. Effects and correctability of pile-up distortion using established figures of merit in time-domain diffuse optics at extreme photon rates. Sci Rep 2022; 12:5417. [PMID: 35354888 PMCID: PMC8967884 DOI: 10.1038/s41598-022-09385-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 03/22/2022] [Indexed: 11/09/2022] Open
Abstract
Time-domain diffuse optics (TD-DO) allows one to probe diffusive media with recognized advantages over other working domains but suffers from a poor signal-to-noise ratio (SNR) resulting from the need to build-up the histogram of single-photon arrival times with maximum count rates (CR) of few percent of the laser pulse rate to avoid the so-called "pile-up" distortion. Here we explore the feasibility of TD-DO under severe pile-up conditions with a systematic in-silico/experimental study evaluating the effects and correctability of the distortion by means of shared figures of merit. In-silico, we demonstrate that pile-up correction allows one the retrieval of homogeneous optical properties with average error < 1% up to a CR > 99%, while the optimal CR needed to detect localized perturbation was found to be 83%. Experiments reported here confirm these findings despite exhibiting higher accuracy errors in the retrieval of homogeneous optical properties and higher noise in the detection of localized absorption perturbations, but in line with the state-of-the-art systems. This work validates a new working regime for TD-DO, demonstrating an increase of the SNR at constant acquisition time, but also potentially leading in the future to previously unrealizable measurements of dynamic phenomena or in spatial scanning applications.
Collapse
Affiliation(s)
- Elisabetta Avanzi
- Dipartimento di Fisica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Anurag Behera
- Dipartimento di Fisica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Davide Contini
- Dipartimento di Fisica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Lorenzo Spinelli
- Istituto di Fotonica e Nanotecnologie, Consiglio Nazionale delle Ricerche, Piazza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Alberto Dalla Mora
- Dipartimento di Fisica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133, Milan, Italy.
| | - Laura Di Sieno
- Dipartimento di Fisica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133, Milan, Italy
| |
Collapse
|
8
|
Farina S, Labanca I, Acconcia G, Ghezzi A, Farina A, D'Andrea C, Rech I. Above pile-up fluorescence microscopy with a 32 Mc/s single-channel time-resolved SPAD system. OPTICS LETTERS 2022; 47:82-85. [PMID: 34951886 DOI: 10.1364/ol.444815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Accepted: 11/15/2021] [Indexed: 06/14/2023]
Abstract
One of the major drawbacks of time-correlated single-photon counting (TCSPC) is generally represented by pile-up distortion, which strongly bounds the maximum acquisition speed to a few percent of the laser excitation rate. Based on a previous theoretical analysis, recently we presented the first, to the best of our knowledge, low-distortion and high-speed TCSPC system capable of overcoming the pile-up limitation by perfectly matching the single-photon avalanche diode (SPAD) dead time to the laser period. In this work, we validate the proposed system in a standard fluorescence measurement by comparing experimental data with the reference theoretical framework. As a result, a count rate of 32 Mc/s was achieved with a single-channel system still observing a negligible lifetime distortion.
Collapse
|
9
|
Moazeni S, Pollmann E, Boominathan V, Cardoso FA, Robinson J, Veeraraghavan A, Shepard K. A Mechanically Flexible, Implantable Neural Interface for Computational Imaging and Optogenetic Stimulation Over 5.4×5.4mm 2 FoV. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2021; 15:1295-1305. [PMID: 34951854 DOI: 10.1109/tbcas.2021.3138334] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Emerging optical functional imaging and optogenetics are among the most promising approaches in neuroscience to study neuronal circuits. Combining both methods into a single implantable device enables all-optical neural interrogation with immediate applications in freely-behaving animal studies. In this paper, we demonstrate such a device capable of optical neural recording and stimulation over large cortical areas. This implantable surface device exploits lens-less computational imaging and a novel packaging scheme to achieve an ultra-thin (250μm-thick), mechanically flexible form factor. The core of this device is a custom-designed CMOS integrated circuit containing a 160×160 array of time-gated single-photon avalanche photodiodes (SPAD) for low-light intensity imaging and an interspersed array of dual-color (blue and green) flip-chip bonded micro-LED (μLED) as light sources. We achieved 60μm lateral imaging resolution and 0.2mm3 volumetric precision for optogenetics over a 5.4×5.4mm2 field of view (FoV). The device achieves a 125-fps frame-rate and consumes 40 mW of total power.
Collapse
|
10
|
Camphausen R, Cuevas Á, Duempelmann L, Terborg RA, Wajs E, Tisa S, Ruggeri A, Cusini I, Steinlechner F, Pruneri V. A quantum-enhanced wide-field phase imager. SCIENCE ADVANCES 2021; 7:eabj2155. [PMID: 34788099 PMCID: PMC8598016 DOI: 10.1126/sciadv.abj2155] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Quantum techniques can be used to enhance the signal-to-noise ratio in optical imaging. Leveraging the latest advances in single-photon avalanche diode array cameras and multiphoton detection techniques, here, we introduce a supersensitive phase imager, which uses space-polarization hyperentanglement to operate over a large field of view without the need of scanning operation. We show quantum-enhanced imaging of birefringent and nonbirefringent phase samples over large areas, with sensitivity improvements over equivalent classical measurements carried out with equal number of photons. The potential applicability is demonstrated by imaging a biomedical protein microarray sample. Our technology is inherently scalable to high-resolution images and represents an essential step toward practical quantum-enhanced imaging.
Collapse
Affiliation(s)
- Robin Camphausen
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
- Corresponding author. (R.C.); (Á.C.); (V.P.)
| | - Álvaro Cuevas
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
- Corresponding author. (R.C.); (Á.C.); (V.P.)
| | - Luc Duempelmann
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
| | - Roland A. Terborg
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
| | - Ewelina Wajs
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
| | - Simone Tisa
- Micro Photon Device SRL, Via Waltraud Gebert Deeg 3f, 39100 Bolzano, Italy
| | - Alessandro Ruggeri
- Micro Photon Device SRL, Via Waltraud Gebert Deeg 3f, 39100 Bolzano, Italy
| | - Iris Cusini
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Via Giuseppe Ponzio, 34, 20133 Milano, Italy
| | - Fabian Steinlechner
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, Albert-Einstein-Str. 7, 07745 Jena, Germany
- Abbe Center of Photonics, Friedrich Schiller University Jena, Albert-Einstein-Str. 6, 07745 Jena, Germany
| | - Valerio Pruneri
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Av. Carl Friedrich Gauss, 3, 08860 Castelldefels, Barcelona, Spain
- ICREA-Institució Catalana de Recerca i Estudis Avançats, Passeig Lluís Companys 23, 08010 Barcelona, Spain
- Corresponding author. (R.C.); (Á.C.); (V.P.)
| |
Collapse
|
11
|
Incoronato A, Locatelli M, Zappa F. Statistical Modelling of SPADs for Time-of-Flight LiDAR. SENSORS 2021; 21:s21134481. [PMID: 34209114 PMCID: PMC8271703 DOI: 10.3390/s21134481] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Revised: 06/25/2021] [Accepted: 06/28/2021] [Indexed: 11/30/2022]
Abstract
Time-of-Flight (TOF) based Light Detection and Ranging (LiDAR) is a widespread technique for distance measurements in both single-spot depth ranging and 3D mapping. Single Photon Avalanche Diode (SPAD) detectors provide single-photon sensitivity and allow in-pixel integration of a Time-to-Digital Converter (TDC) to measure the TOF of single-photons. From the repetitive acquisition of photons returning from multiple laser shots, it is possible to accumulate a TOF histogram, so as to identify the laser pulse return from unwelcome ambient light and compute the desired distance information. In order to properly predict the TOF histogram distribution and design each component of the LiDAR system, from SPAD to TDC and histogram processing, we present a detailed statistical modelling of the acquisition chain and we show the perfect matching with Monte Carlo simulations in very different operating conditions and very high background levels. We take into consideration SPAD non-idealities such as hold-off time, afterpulsing, and crosstalk, and we show the heavy pile-up distortion in case of high background. Moreover, we also model non-idealities of timing electronics chain, namely, TDC dead-time, limited number of storage cells for TOF data, and TDC sharing. Eventually, we show how the exploit the modelling to reversely extract the original LiDAR return signal from the distorted measured TOF data in different operating conditions.
Collapse
Affiliation(s)
| | | | - Franco Zappa
- Correspondence: (A.I.); (F.Z.); Tel.: +39-02-2399-6149 (F.Z.)
| |
Collapse
|
12
|
Zang Z, Xiao D, Day-Uei Li D. Non-fusion time-resolved depth image reconstruction using a highly efficient neural network architecture. OPTICS EXPRESS 2021; 29:19278-19291. [PMID: 34266040 DOI: 10.1364/oe.425917] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 05/21/2021] [Indexed: 06/13/2023]
Abstract
Single-photon avalanche diodes (SPAD) are powerful sensors for 3D light detection and ranging (LiDAR) in low light scenarios due to their single-photon sensitivity. However, accurately retrieving ranging information from noisy time-of-arrival (ToA) point clouds remains a challenge. This paper proposes a photon-efficient, non-fusion neural network architecture that can directly reconstruct high-fidelity depth images from ToA data without relying on other guiding images. Besides, the neural network architecture was compressed via a low-bit quantization scheme so that it is suitable to be implemented on embedded hardware platforms. The proposed quantized neural network architecture achieves superior reconstruction accuracy and fewer parameters than previously reported networks.
Collapse
|
13
|
Tafone D, Huang I, Rehain P, Zhu S, Sua YM, Huang Y. Single-point material recognition by quantum parametric mode sorting and photon counting. APPLIED OPTICS 2021; 60:4109-4112. [PMID: 33983173 DOI: 10.1364/ao.423420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 04/14/2021] [Indexed: 06/12/2023]
Abstract
We explore an active illumination approach to remote material recognition, based on quantum parametric mode sorting and single-photon detection. By measuring a photon's time of flight at picosecond resolution, 97.8% recognition is demonstrated by illuminating only a single point on the materials. Thanks to the exceptional detection sensitivity and noise rejection, a high recognition accuracy of 96.1% is achieved even when the materials are occluded by a lossy and multiscattering obscurant.
Collapse
|
14
|
Fast Gating for Raman Spectroscopy. SENSORS 2021; 21:s21082579. [PMID: 33916972 PMCID: PMC8067580 DOI: 10.3390/s21082579] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 04/02/2021] [Accepted: 04/02/2021] [Indexed: 11/16/2022]
Abstract
Fast gating in Raman spectroscopy is used to reject the fluorescence contribution from the sample and/or the substrate. Several techniques have been set up in the last few decades aiming either to enhance the Raman signal (CARS, SERS or Resonant Raman scattering) or to cancel out the fluorescence contribution (SERDS), and a number of reviews have already been published on these sub-topics. However, for many reasons it is sometimes necessary to reject fluorescence in traditional Raman spectroscopy, and in the last few decades a variety of papers dealt with this issue, which is still challenging due to the time scales at stake (down to picoseconds). Fast gating (<1 ns) in the time domain allows one to cut off part of the fluorescence signal and retrieve the best Raman signal, depending on the fluorescence lifetime of the sample and laser pulse duration. In particular, three different techniques have been developed to accomplish this task: optical Kerr cells, intensified Charge Coupling Devices and systems based on Single Photon Avalanche Photodiodes. The utility of time domain fast gating will be discussed, and In this work, the utility of time domain fast gating is discussed, as well as the performances of the mentioned techniques as reported in literature.
Collapse
|
15
|
Hales JE, Aoudjane S, Aeppli G, Dalby PA. Proof-of-concept analytical instrument for label-free optical deconvolution of protein species in a mixture. J Chromatogr A 2021; 1641:461968. [PMID: 33611116 DOI: 10.1016/j.chroma.2021.461968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 01/18/2021] [Accepted: 02/01/2021] [Indexed: 11/27/2022]
Abstract
The adoption of process analytical technologies by the biopharmaceutical industry can reduce the cost of therapeutic drugs and facilitate investigation of new bioprocesses. Control of critical process parameters to retain critical product quality attributes within strict bounds is important for ensuring a consistently high product quality, but developing the sophisticated analytical technologies required has proven to be a major challenge. Here, we demonstrate a new optical technique for continuous monitoring of protein species as they are eluted from a chromatographic column, even when they fully co-elute with other protein species, without making any assumption about or peak-fitting to the elution profile. To achieve this, we designed and constructed a time-resolved intrinsic fluorescence lifetime chromatograph, and established an analytical framework for deconvolving and quantifying distinct but co-eluting protein species in real time. This proof-of-concept technology has potentially useful applications as a process analytical technology and more generally as an analytical technique for label-free quantification of proteins in mixtures.
Collapse
Affiliation(s)
- John E Hales
- Department of Biochemical Engineering, University College London, Bernard Katz Building, Gower Street, London, WC1E 6BT, UK.
| | - Samir Aoudjane
- Department of Biochemical Engineering, University College London, Bernard Katz Building, Gower Street, London, WC1E 6BT, UK
| | - Gabriel Aeppli
- London Centre for Nanotechnology, 17-19 Gordon Street, London, WC1H 0AH, UK
| | - Paul A Dalby
- Department of Biochemical Engineering, University College London, Bernard Katz Building, Gower Street, London, WC1E 6BT, UK.
| |
Collapse
|
16
|
Poudel C, Mela I, Kaminski CF. High-throughput, multi-parametric, and correlative fluorescence lifetime imaging. Methods Appl Fluoresc 2020; 8:024005. [PMID: 32028271 PMCID: PMC8208541 DOI: 10.1088/2050-6120/ab7364] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Revised: 12/18/2019] [Accepted: 02/06/2020] [Indexed: 12/11/2022]
Abstract
In this review, we discuss methods and advancements in fluorescence lifetime imaging microscopy that permit measurements to be performed at faster speed and higher resolution than previously possible. We review fast single-photon timing technologies and the use of parallelized detection schemes to enable high-throughput and high content imaging applications. We appraise different technological implementations of fluorescence lifetime imaging, primarily in the time-domain. We also review combinations of fluorescence lifetime with other imaging modalities to capture multi-dimensional and correlative information from a single sample. Throughout the review, we focus on applications in biomedical research. We conclude with a critical outlook on current challenges and future opportunities in this rapidly developing field.
Collapse
Affiliation(s)
- Chetan Poudel
- Department of Chemical Engineering and Biotechnology,
Philippa Fawcett Drive, University of
Cambridge, Cambridge CB3 0AS, United
Kingdom
| | - Ioanna Mela
- Department of Chemical Engineering and Biotechnology,
Philippa Fawcett Drive, University of
Cambridge, Cambridge CB3 0AS, United
Kingdom
| | - Clemens F Kaminski
- Department of Chemical Engineering and Biotechnology,
Philippa Fawcett Drive, University of
Cambridge, Cambridge CB3 0AS, United
Kingdom
| |
Collapse
|
17
|
Rehain P, Sua YM, Zhu S, Dickson I, Muthuswamy B, Ramanathan J, Shahverdi A, Huang YP. Noise-tolerant single photon sensitive three-dimensional imager. Nat Commun 2020; 11:921. [PMID: 32066725 PMCID: PMC7026101 DOI: 10.1038/s41467-020-14591-8] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Accepted: 01/17/2020] [Indexed: 11/09/2022] Open
Abstract
Active imagers capable of reconstructing 3-dimensional (3D) scenes in the presence of strong background noise are highly desirable for many sensing and imaging applications. A key to this capability is the time-resolving photon detection that distinguishes true signal photons from the noise. To this end, quantum parametric mode sorting (QPMS) can achieve signal to noise exceeding by far what is possible with typical linear optics filters, with outstanding performance in isolating temporally and spectrally overlapping noise. Here, we report a QPMS-based 3D imager with exceptional detection sensitivity and noise tolerance. With only 0.0006 detected signal photons per pulse, we reliably reconstruct the 3D profile of an obscured scene, despite 34-fold spectral-temporally overlapping noise photons, within the 6 ps detection window (amounting to 113,000 times noise per 20 ns detection period). Our results highlight a viable approach to suppress background noise and measurement errors of single photon imager operation in high-noise environments. Imagers capable of reconstructing three-dimensional scenes in the presence of strong background noise are desirable for many remote sensing and imaging applications. Here, the authors report an imager operating in photon-starved and noise-polluted environments through quantum parametric mode sorting.
Collapse
Affiliation(s)
- Patrick Rehain
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Yong Meng Sua
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA. .,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.
| | - Shenyu Zhu
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Ivan Dickson
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Bharathwaj Muthuswamy
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Jeevanandha Ramanathan
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Amin Shahverdi
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA
| | - Yu-Ping Huang
- Department of Physics, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA. .,Center for Quantum Science and Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ, 07030, USA.
| |
Collapse
|
18
|
Lin CW, Bachilo SM, Weisman RB. Synchro-Excited Free-Running Single Photon Counting: A Novel Method for Measuring Short-Wave Infrared Emission Kinetics. Anal Chem 2019; 91:12484-12491. [PMID: 31483990 DOI: 10.1021/acs.analchem.9b03207] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
Time-resolved measurements of short-wave infrared (SWIR) photoluminescence on the submicrosecond to millisecond scale are needed for physical and chemical studies involving singlet oxygen, single-walled carbon nanotubes, and other samples with weak, slow emission. We present here an alternative to the common method of time-correlated single photon counting (TCSPC) that is well suited to indium gallium arsenide avalanche photodiode (APD) detectors operated in Geiger mode. In the new method, termed synchro-excited free-running single photon counting (SEFR-SPC), excitation pulses from inexpensive laser diodes (providing a variety of wavelengths) are synchronized to detection events from a free-running detector covering the 900 to 1700 nm range. In contrast to traditional TCSPC, data from this method can be rigorously corrected for pile-up distortions, allowing operation with high excitation powers and low repetition rates. A technique is described to extend the system's dynamic range to approximately 108. We also show that SEFR-SPC provides state-of-the-art sensitivity in the SWIR spectral region and that spectrally filtered kinetic data can offer additional insights. A six-step correction protocol has been developed and implemented as a LabVIEW program for very accurate acquisition of kinetic shapes. The SEFR-SPC method will be a valuable tool for studies of weak, long-lived emission sources.
Collapse
Affiliation(s)
- Ching-Wei Lin
- Department of Chemistry and the Smalley-Curl Institute , Rice University , Houston , Texas 77005 , United States
| | - Sergei M Bachilo
- Department of Chemistry and the Smalley-Curl Institute , Rice University , Houston , Texas 77005 , United States
| | - R Bruce Weisman
- Department of Chemistry and the Smalley-Curl Institute , Rice University , Houston , Texas 77005 , United States.,Department of Materials Science and NanoEngineering , Rice University , Houston , Texas 77005 , United States
| |
Collapse
|
19
|
Bruschini C, Homulle H, Antolovic IM, Burri S, Charbon E. Single-photon avalanche diode imagers in biophotonics: review and outlook. LIGHT, SCIENCE & APPLICATIONS 2019; 8:87. [PMID: 31645931 PMCID: PMC6804596 DOI: 10.1038/s41377-019-0191-5] [Citation(s) in RCA: 129] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 07/30/2019] [Accepted: 08/07/2019] [Indexed: 05/08/2023]
Abstract
Single-photon avalanche diode (SPAD) arrays are solid-state detectors that offer imaging capabilities at the level of individual photons, with unparalleled photon counting and time-resolved performance. This fascinating technology has progressed at a very fast pace in the past 15 years, since its inception in standard CMOS technology in 2003. A host of architectures have been investigated, ranging from simpler implementations, based solely on off-chip data processing, to progressively "smarter" sensors including on-chip, or even pixel level, time-stamping and processing capabilities. As the technology has matured, a range of biophotonics applications have been explored, including (endoscopic) FLIM, (multibeam multiphoton) FLIM-FRET, SPIM-FCS, super-resolution microscopy, time-resolved Raman spectroscopy, NIROT and PET. We will review some representative sensors and their corresponding applications, including the most relevant challenges faced by chip designers and end-users. Finally, we will provide an outlook on the future of this fascinating technology.
Collapse
|
20
|
Trinh AL, Ber S, Howitt A, Valls PO, Fries MW, Venkitaraman AR, Esposito A. Fast single-cell biochemistry: theory, open source microscopy and applications. Methods Appl Fluoresc 2019; 7:044001. [PMID: 31422954 PMCID: PMC7000240 DOI: 10.1088/2050-6120/ab3bd2] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Fluorescence lifetime sensing enables researchers to probe the physicochemical environment of a fluorophore providing a window through which we can observe the complex molecular make-up of the cell. Fluorescence lifetime imaging microscopy (FLIM) quantifies and maps cell biochemistry, a complex ensemble of dynamic processes. Unfortunately, typical high-resolution FLIM systems exhibit rather limited acquisition speeds, often insufficient to capture the time evolution of biochemical processes in living cells. Here, we describe the theoretical background that justifies the developments of high-speed single photon counting systems. We show that systems with low dead-times not only result in faster acquisition throughputs but also improved dynamic range and spatial resolution. We also share the implementation of hardware and software as an open platform, show applications of fast FLIM biochemical imaging on living cells and discuss strategies to balance precision and accuracy in FLIM. The recent innovations and commercialisation of fast time-domain FLIM systems are likely to popularise FLIM within the biomedical community, to impact biomedical research positively and to foster the adoption of other FLIM techniques as well. While supporting and indeed pursuing these developments, with this work we also aim to warn the community about the possible shortcomings of fast single photon counting techniques and to highlight strategies to acquire data of high quality.
Collapse
|
21
|
Lüders C, Thewes J, Assmann M. Real time g (2) monitoring with 100 kHz sampling rate. OPTICS EXPRESS 2018; 26:24854-24863. [PMID: 30469596 DOI: 10.1364/oe.26.024854] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2018] [Accepted: 07/14/2018] [Indexed: 06/09/2023]
Abstract
We introduce a technique to determine photon correlations of optical light fields in real time. The method is based on ultrafast phase-randomized homodyne detection and allows us to follow the temporal evolution of the second-order correlation function g(2)(0) of a light field. We demonstrate the capabilities of our approach by applying it to a laser diode operated in the threshold region. In particular, we are able to monitor the emission dynamics of the diode switching back and forth between lasing and spontaneous emission with a g(2)(0)-sampling rate of 100 kHz.
Collapse
|
22
|
Cominelli A, Acconcia G, Peronio P, Ghioni M, Rech I. High-speed and low-distortion solution for time-correlated single photon counting measurements: A theoretical analysis. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2017; 88:123701. [PMID: 29289210 DOI: 10.1063/1.4996690] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
In this paper, we describe a novel solution to increase the speed of Time-Correlated Single Photon Counting (TCSPC) measurements by almost an order of magnitude while providing, in principle, zero distortion regardless of the experimental conditions. Typically, the relatively long dead time associated with the conversion electronics requires a proper tune of the excitation power in order to avoid distortions of the reconstructed waveform due to pileup and counting loss. As a result, the maximum operating rate of a TCSPC channel is now limited between 1% and 5% of the excitation frequency, thus leading to relatively long acquisition times. We show that negligible distortion (below 1%) is guaranteed if the dead time associated with the converter is kept below the dead time of the detector, and at the same time the detector dead time is matched to the duration of the excitation period. In this way, unprecedented high-speed operation is possible. In this paper, we provide a theoretical analysis of the technique, including the main non-idealities which are introduced by a generic physical implementation. The results are supported by both numerical simulations and analytical calculations.
Collapse
Affiliation(s)
- A Cominelli
- Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Piazza Leonardo da Vinci 32, 20133 Milano, Italy
| | - G Acconcia
- Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Piazza Leonardo da Vinci 32, 20133 Milano, Italy
| | - P Peronio
- Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Piazza Leonardo da Vinci 32, 20133 Milano, Italy
| | - M Ghioni
- Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Piazza Leonardo da Vinci 32, 20133 Milano, Italy
| | - I Rech
- Politecnico di Milano, Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Piazza Leonardo da Vinci 32, 20133 Milano, Italy
| |
Collapse
|
23
|
Time-Resolved Diffuse Optical Spectroscopy and Imaging Using Solid-State Detectors: Characteristics, Present Status, and Research Challenges. SENSORS 2017; 17:s17092115. [PMID: 28906462 PMCID: PMC5621067 DOI: 10.3390/s17092115] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/23/2017] [Revised: 09/03/2017] [Accepted: 09/06/2017] [Indexed: 02/06/2023]
Abstract
Diffuse optical spectroscopy (DOS) and diffuse optical imaging (DOI) are emerging non-invasive imaging modalities that have wide spread potential applications in many fields, particularly for structural and functional imaging in medicine. In this article, we review time-resolved diffuse optical imaging (TR-DOI) systems using solid-state detectors with a special focus on Single-Photon Avalanche Diodes (SPADs) and Silicon Photomultipliers (SiPMs). These TR-DOI systems can be categorized into two types based on the operation mode of the detector (free-running or time-gated). For the TR-DOI prototypes, the physical concepts, main components, figures-of-merit of detectors, and evaluation parameters are described. The performance of TR-DOI prototypes is evaluated according to the parameters used in common protocols to test DOI systems particularly basic instrumental performance (BIP). In addition, the potential features of SPADs and SiPMs to improve TR-DOI systems and expand their applications in the foreseeable future are discussed. Lastly, research challenges and future developments for TR-DOI are discussed for each component in the prototype separately and also for the entire system.
Collapse
|
24
|
Kufcsák A, Erdogan A, Walker R, Ehrlich K, Tanner M, Megia-Fernandez A, Scholefield E, Emanuel P, Dhaliwal K, Bradley M, Henderson RK, Krstajić N. Time-resolved spectroscopy at 19,000 lines per second using a CMOS SPAD line array enables advanced biophotonics applications. OPTICS EXPRESS 2017; 25:11103-11123. [PMID: 28788793 DOI: 10.1364/oe.25.011103] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
A SPAD-based line sensor fabricated in 130 nm CMOS technology capable of acquiring time-resolved fluorescence spectra (TRFS) in 8.3 milliseconds is presented. To the best of our knowledge, this is the fastest time correlated single photon counting (TCSPC) TRFS acquisition reported to date. The line sensor is an upgrade to our prior work and incorporates: i) parallelized interface from sensor to surrounding circuitry enabling high line rate to the PC (19,000 lines/s) and ii) novel time-gating architecture where detected photons in the OFF region are rejected digitally after the output stage of the SPAD. The time-gating architecture was chosen to avoid electrical transients on the SPAD high voltage supplies when gating is achieved by excess bias modulation. The time-gate has an adjustable location and time window width allowing the user to focus on time-events of interest. On-chip integrated center-of-mass (CMM) calculations provide efficient acquisition of photon arrivals and direct lifetime estimation of fluorescence decays. Furthermore, any of the SPC, TCSPC and on-chip CMM modes can be used in conjunction with the time-gating. The higher readout rate and versatile architecture greatly empower the user and will allow widespread applications across many techniques and disciplines. Here we focused on 3 examples of TRFS and time-gated Raman spectroscopy: i) kinetics of chlorophyll A fluorescence from an intact leaf; ii) kinetics of a thrombin biosensor FRET probe from quenched to fluorescence states; iii) ex vivo mouse lung tissue autofluorescence TRFS; iv) time-gated Raman spectroscopy of toluene at 3056 cm-1 peak. To the best of our knowledge, we detect spectrally for the first time the fast rise in fluorescence lifetime of chlorophyll A in a measurement over single fluorescent transient.
Collapse
|
25
|
Conway JRW, Warren SC, Timpson P. Context-dependent intravital imaging of therapeutic response using intramolecular FRET biosensors. Methods 2017; 128:78-94. [PMID: 28435000 DOI: 10.1016/j.ymeth.2017.04.014] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Revised: 03/13/2017] [Accepted: 04/08/2017] [Indexed: 12/18/2022] Open
Abstract
Intravital microscopy represents a more physiologically relevant method for assessing therapeutic response. However, the movement into an in vivo setting brings with it several additional considerations, the primary being the context in which drug activity is assessed. Microenvironmental factors, such as hypoxia, pH, fibrosis, immune infiltration and stromal interactions have all been shown to have pronounced effects on drug activity in a more complex setting, which is often lost in simpler two- or three-dimensional assays. Here we present a practical guide for the application of intravital microscopy, looking at the available fluorescent reporters and their respective expression systems and analysis considerations. Moving in vivo, we also discuss the microscopy set up and methods available for overlaying microenvironmental context to the experimental readouts. This enables a smooth transition into applying higher fidelity intravital imaging to improve the drug discovery process.
Collapse
Affiliation(s)
- James R W Conway
- Garvan Institute of Medical Research and The Kinghorn Cancer Centre, Cancer Division, Sydney, NSW 2010, Australia; St Vincent's Clinical School, Faculty of Medicine, University of NSW, Sydney, NSW 2010, Australia
| | - Sean C Warren
- Garvan Institute of Medical Research and The Kinghorn Cancer Centre, Cancer Division, Sydney, NSW 2010, Australia; St Vincent's Clinical School, Faculty of Medicine, University of NSW, Sydney, NSW 2010, Australia
| | - Paul Timpson
- Garvan Institute of Medical Research and The Kinghorn Cancer Centre, Cancer Division, Sydney, NSW 2010, Australia; St Vincent's Clinical School, Faculty of Medicine, University of NSW, Sydney, NSW 2010, Australia.
| |
Collapse
|
26
|
Characterization of SPAD Array for Multifocal High-Content Screening Applications. PHOTONICS 2016. [DOI: 10.3390/photonics3040056] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
27
|
Isbaner S, Karedla N, Ruhlandt D, Stein SC, Chizhik A, Gregor I, Enderlein J. Dead-time correction of fluorescence lifetime measurements and fluorescence lifetime imaging. OPTICS EXPRESS 2016; 24:9429-45. [PMID: 27137558 DOI: 10.1364/oe.24.009429] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
We present a comprehensive theory of dead-time effects on Time-Correlated Single Photon Counting (TCSPC) as used for fluorescence lifetime measurements, and develop a correction algorithm to remove these artifacts. We apply this algorithm to fluorescence lifetime measurements as well as to Fluorescence Lifetime Imaging Microscopy (FLIM), where rapid data acquisition is necessarily connected with high count rates. There, dead-time effects cannot be neglected, and lead to distortions in the observed lifetime image. The algorithm is quite general and completely independent of the particular nature of the measured signal. It can also be applied to any other single-event counting measurement with detector and/or electronics dead-time.
Collapse
|
28
|
A Full Parallel Event Driven Readout Technique for Area Array SPAD FLIM Image Sensors. SENSORS 2016; 16:160. [PMID: 26828490 PMCID: PMC4801538 DOI: 10.3390/s16020160] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2015] [Revised: 01/16/2016] [Accepted: 01/22/2016] [Indexed: 11/16/2022]
Abstract
This paper presents a full parallel event driven readout method which is implemented in an area array single-photon avalanche diode (SPAD) image sensor for high-speed fluorescence lifetime imaging microscopy (FLIM). The sensor only records and reads out effective time and position information by adopting full parallel event driven readout method, aiming at reducing the amount of data. The image sensor includes four 8 × 8 pixel arrays. In each array, four time-to-digital converters (TDCs) are used to quantize the time of photons’ arrival, and two address record modules are used to record the column and row information. In this work, Monte Carlo simulations were performed in Matlab in terms of the pile-up effect induced by the readout method. The sensor’s resolution is 16 × 16. The time resolution of TDCs is 97.6 ps and the quantization range is 100 ns. The readout frame rate is 10 Mfps, and the maximum imaging frame rate is 100 fps. The chip’s output bandwidth is 720 MHz with an average power of 15 mW. The lifetime resolvability range is 5–20 ns, and the average error of estimated fluorescence lifetimes is below 1% by employing CMM to estimate lifetimes.
Collapse
|
29
|
|
30
|
Lu Y, Lu J, Zhao J, Cusido J, Raymo FM, Yuan J, Yang S, Leif RC, Huo Y, Piper JA, Paul Robinson J, Goldys EM, Jin D. On-the-fly decoding luminescence lifetimes in the microsecond region for lanthanide-encoded suspension arrays. Nat Commun 2014; 5:3741. [PMID: 24796249 PMCID: PMC4024748 DOI: 10.1038/ncomms4741] [Citation(s) in RCA: 119] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2014] [Accepted: 03/27/2014] [Indexed: 12/23/2022] Open
Abstract
Significant multiplexing capacity of optical time-domain coding has been recently demonstrated by tuning luminescence lifetimes of the upconversion nanoparticles called 'τ-Dots'. It provides a large dynamic range of lifetimes from microseconds to milliseconds, which allows creating large libraries of nanotags/microcarriers. However, a robust approach is required to rapidly and accurately measure the luminescence lifetimes from the relatively slow-decaying signals. Here we show a fast algorithm suitable for the microsecond region with precision closely approaching the theoretical limit and compatible with the rapid scanning cytometry technique. We exploit this approach to further extend optical time-domain multiplexing to the downconversion luminescence, using luminescence microspheres wherein lifetimes are tuned through luminescence resonance energy transfer. We demonstrate real-time discrimination of these microspheres in the rapid scanning cytometry, and apply them to the multiplexed probing of pathogen DNA strands. Our results indicate that tunable luminescence lifetimes have considerable potential in high-throughput analytical sciences.
Collapse
Affiliation(s)
- Yiqing Lu
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
| | - Jie Lu
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
| | - Jiangbo Zhao
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
| | - Janet Cusido
- Laboratory for Molecular Photonics, University of Miami, 1301 Memorial Drive, Coral Gables, Florida 33146-0431, USA
| | - Françisco M Raymo
- Laboratory for Molecular Photonics, University of Miami, 1301 Memorial Drive, Coral Gables, Florida 33146-0431, USA
| | - Jingli Yuan
- State Key Laboratory of Fine Chemicals, School of Chemistry, Dalian University of Technology, Dalian 116024, China
| | - Sean Yang
- Newport Instruments, 3345 Hopi Place, San Diego, California 92117-3516, USA
| | - Robert C. Leif
- Newport Instruments, 3345 Hopi Place, San Diego, California 92117-3516, USA
| | - Yujing Huo
- Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
| | - James A. Piper
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
| | - J Paul Robinson
- Purdue University Cytometry Laboratories, Bindley Bioscience Center, Purdue University, West Lafayette, Indiana 47907, USA
| | - Ewa M. Goldys
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
| | - Dayong Jin
- Advanced Cytometry Laboratories, ARC Centre of Excellence for Nanoscale BioPhotonics (CNBP), Macquarie University, Sydney, New South Wales 2109, Australia
- Purdue University Cytometry Laboratories, Bindley Bioscience Center, Purdue University, West Lafayette, Indiana 47907, USA
| |
Collapse
|