1
|
Iyer RR, Applegate CC, Arogundade OH, Bangru S, Berg IC, Emon B, Porras-Gomez M, Hsieh PH, Jeong Y, Kim Y, Knox HJ, Moghaddam AO, Renteria CA, Richard C, Santaliz-Casiano A, Sengupta S, Wang J, Zambuto SG, Zeballos MA, Pool M, Bhargava R, Gaskins HR. Inspiring a convergent engineering approach to measure and model the tissue microenvironment. Heliyon 2024; 10:e32546. [PMID: 38975228 PMCID: PMC11226808 DOI: 10.1016/j.heliyon.2024.e32546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Revised: 05/22/2024] [Accepted: 06/05/2024] [Indexed: 07/09/2024] Open
Abstract
Understanding the molecular and physical complexity of the tissue microenvironment (TiME) in the context of its spatiotemporal organization has remained an enduring challenge. Recent advances in engineering and data science are now promising the ability to study the structure, functions, and dynamics of the TiME in unprecedented detail; however, many advances still occur in silos that rarely integrate information to study the TiME in its full detail. This review provides an integrative overview of the engineering principles underlying chemical, optical, electrical, mechanical, and computational science to probe, sense, model, and fabricate the TiME. In individual sections, we first summarize the underlying principles, capabilities, and scope of emerging technologies, the breakthrough discoveries enabled by each technology and recent, promising innovations. We provide perspectives on the potential of these advances in answering critical questions about the TiME and its role in various disease and developmental processes. Finally, we present an integrative view that appreciates the major scientific and educational aspects in the study of the TiME.
Collapse
Affiliation(s)
- Rishyashring R. Iyer
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Catherine C. Applegate
- Division of Nutritional Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Opeyemi H. Arogundade
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Sushant Bangru
- Department of Biochemistry, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Ian C. Berg
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Bashar Emon
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Marilyn Porras-Gomez
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Pei-Hsuan Hsieh
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Yoon Jeong
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Yongdeok Kim
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Hailey J. Knox
- Department of Chemistry, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Amir Ostadi Moghaddam
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Carlos A. Renteria
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Craig Richard
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Ashlie Santaliz-Casiano
- Division of Nutritional Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Sourya Sengupta
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Jason Wang
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Samantha G. Zambuto
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Maria A. Zeballos
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - Marcia Pool
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Cancer Center at Illinois, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
| | - Rohit Bhargava
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Chemistry, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Chemical and Biochemical Engineering, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Cancer Center at Illinois, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
- NIH/NIBIB P41 Center for Label-free Imaging and Multiscale Biophotonics (CLIMB), University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| | - H. Rex Gaskins
- Division of Nutritional Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Cancer Center at Illinois, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Animal Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Biomedical and Translational Sciences, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Pathobiology, University of Illinois Urbana-Champaign, Urbana, IL, 61801, USA
| |
Collapse
|
2
|
Park J, Gao L. Advancements in fluorescence lifetime imaging microscopy Instrumentation: Towards high speed and 3D. CURRENT OPINION IN SOLID STATE & MATERIALS SCIENCE 2024; 30:101147. [PMID: 39086551 PMCID: PMC11290093 DOI: 10.1016/j.cossms.2024.101147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 08/02/2024]
Abstract
Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging tool offering molecular specific insights into samples through the measurement of fluorescence decay time, with promising applications in diverse research fields. However, to acquire two-dimensional lifetime images, conventional FLIM relies on extensive scanning in both the spatial and temporal domain, resulting in much slower acquisition rates compared to intensity-based approaches. This problem is further magnified in three-dimensional imaging, as it necessitates additional scanning along the depth axis. Recent advancements have aimed to enhance the speed and three-dimensional imaging capabilities of FLIM. This review explores the progress made in addressing these challenges and discusses potential directions for future developments in FLIM instrumentation.
Collapse
Affiliation(s)
- Jongchan Park
- Department of Bioengineering, University of California, Los Angeles, CA 90025, USA
| | - Liang Gao
- Department of Bioengineering, University of California, Los Angeles, CA 90025, USA
| |
Collapse
|
3
|
Iyer RR, Sorrells JE, Tan KKD, Yang L, Wang G, Tu H, Boppart SA. Analog multiplexing of a laser clock and computational photon counting for fast fluorescence lifetime imaging microscopy. BIOMEDICAL OPTICS EXPRESS 2024; 15:2048-2062. [PMID: 38633095 PMCID: PMC11019682 DOI: 10.1364/boe.514813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 02/16/2024] [Accepted: 02/25/2024] [Indexed: 04/19/2024]
Abstract
The dynamic range and fluctuations of fluorescence intensities and lifetimes in biological samples are large, demanding fast, precise, and versatile techniques. Among the high-speed fluorescence lifetime imaging microscopy (FLIM) techniques, directly sampling the output of analog single-photon detectors at GHz rates combined with computational photon counting can handle a larger range of photon rates. Traditionally, the laser clock is not sampled explicitly in fast FLIM; rather the detection is synchronized to the laser clock so that the excitation pulse train can be inferred from the cumulative photon statistics of several pixels. This has two disadvantages for sparse or weakly fluorescent samples: inconsistencies in inferring the laser clock within a frame and inaccuracies in aligning the decay curves from different frames for averaging. The data throughput is also very inefficient in systems with repetition rates much larger than the fluorescence lifetime due to significant silent regions where no photons are expected. We present a method for registering the photon arrival times to the excitation using time-domain multiplexing for fast FLIM. The laser clock is multiplexed with photocurrents into the silent region. Our technique does not add to the existing data bottleneck, has the sub-nanosecond dead time of computational photon counting based fast FLIM, works with various detectors, lasers, and electronics, and eliminates the errors in lifetime estimation in photon-starved conditions. We demonstrate this concept on two multiphoton setups of different laser repetition rates for single and multichannel FLIM multiplexed into a single digitizer channel for real-time imaging of biological samples.
Collapse
Affiliation(s)
- Rishyashring R. Iyer
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Janet E. Sorrells
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Kevin K. D. Tan
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Lingxiao Yang
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Geng Wang
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Haohua Tu
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- P41 Center for Label-free Imaging and Multiscale Biophotonics (CLIMB), University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Cancer Center at Illinois, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Carle Illinois College of Medicine, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| |
Collapse
|
4
|
Yang L, Iyer RR, Sorrells JE, Renteria CA, Boppart SA. Temporally optimized and spectrally shaped hyperspectral coherent anti-Stokes Raman scattering microscopy. OPTICS EXPRESS 2024; 32:11474-11490. [PMID: 38570994 PMCID: PMC11021045 DOI: 10.1364/oe.517417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 04/05/2024]
Abstract
Coherent anti-Stokes Raman scattering (CARS) microscopy offers label-free chemical contrasts based on molecular vibrations. Hyperspectral CARS (HS-CARS) microscopy enables comprehensive microscale chemical characterization of biological samples. Various HS-CARS methods have been developed with individual advantages and disadvantages. We present what we believe to be a new temporally optimized and spectrally shaped (TOSS) HS-CARS method to overcome the limitations of existing techniques by providing precise control of the spatial and temporal profiles of the excitation beams for efficient and accurate measurements. This method uniquely uses Fourier transform pulse shaping based on a two-dimensional spatial light modulator to control the phase and amplitude of the excitation beams. TOSS-HS-CARS achieves fast, stable, and flexible acquisition, minimizes photodamage, and is highly adaptable to a multimodal multiphoton imaging system.
Collapse
Affiliation(s)
- Lingxiao Yang
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Rishyashring R. Iyer
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Janet E. Sorrells
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Carlos A. Renteria
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- NIH/NIBIB Center for Label-free Imaging and Multiscale Biophotonics, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Cancer Center at Illinois, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Interdisciplinary Health Sciences Institute, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| |
Collapse
|
5
|
Mai H, Jarman A, Erdogan AT, Treacy C, Finlayson N, Henderson RK, Poland SP. Development of a high-speed line-scanning fluorescence lifetime imaging microscope for biological imaging. OPTICS LETTERS 2023; 48:2042-2045. [PMID: 37058637 DOI: 10.1364/ol.482403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 01/25/2023] [Indexed: 06/19/2023]
Abstract
We report the development of a novel line-scanning microscope capable of acquiring high-speed time-correlated single-photon counting (TCSPC)-based fluorescence lifetime imaging microscopy (FLIM) imaging. The system consists of a laser-line focus, which is optically conjugated to a 1024 × 8 single-photon avalanche diode (SPAD)-based line-imaging complementary metal-oxide semiconductor (CMOS), with 23.78 µm pixel pitch at 49.31% fill factor. Incorporation of on-chip histogramming on the line-sensor enables acquisition rates 33 times faster than our previously reported bespoke high-speed FLIM platforms. We demonstrate the imaging capability of the high-speed FLIM platform in a number of biological applications.
Collapse
|
6
|
Chen P, Kang Q, Niu J, Jing Y, Zhang X, Yu B, Qu J, Lin D. Fluorescence lifetime tracking and imaging of single moving particles assisted by a low-photon-count analysis algorithm. BIOMEDICAL OPTICS EXPRESS 2023; 14:1718-1731. [PMID: 37078048 PMCID: PMC10110318 DOI: 10.1364/boe.485729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 05/03/2023]
Abstract
Fluorescence lifetime imaging microscopy (FLIM) has been widely used in the field of biological research because of its high specificity, sensitivity, and quantitative ability in the sensing cellular microenvironment. The most commonly used FLIM technology is based on time-correlated single photon counting (TCSPC). Although the TCSPC method has the highest temporal resolution, the data acquisition time is usually long, and the imaging speed is slow. In this work, we proposed a fast FLIM technology for fluorescence lifetime tracking and imaging of single moving particles, named single particle tracking FLIM (SPT-FLIM). We used feedback-controlled addressing scanning and Mosaic FLIM mode imaging to reduce the number of scanned pixels and the data readout time, respectively. Moreover, we developed a compressed sensing analysis algorithm based on alternating descent conditional gradient (ADCG) for low-photon-count data. We applied the ADCG-FLIM algorithm on both simulated and experimental datasets to evaluate its performance. The results showed that ADCG-FLIM could achieve reliable lifetime estimation with high accuracy and precision in the case of a photon count less than 100. By reducing the photon count requirement for each pixel from, typically, 1000 to 100, the acquisition time for a single frame lifetime image could be significantly shortened, and the imaging speed could be improved to a great extent. On this basis, we obtained lifetime trajectories of moving fluorescent beads using the SPT-FLIM technique. Overall, our work offers a powerful tool for fluorescence lifetime tracking and imaging of single moving particles, which will promote the application of TCSPC-FLIM in biological research.
Collapse
|
7
|
Junek J, Žídek K. Nanosecond compressive fluorescence lifetime microscopy imaging via the RATS method with a direct reconstruction of lifetime maps. OPTICS EXPRESS 2023; 31:5181-5199. [PMID: 36823806 DOI: 10.1364/oe.474453] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 01/10/2023] [Indexed: 06/18/2023]
Abstract
The RAndom Temporal Signals (RATS) method has proven to be a useful and versatile method for measuring photoluminescence (PL) dynamics and fluorescence lifetime imaging (FLIM). Here, we present two fundamental development steps in the method. First, we demonstrate that by using random digital laser modulation in RATS, it is possible to implement the measurement of PL dynamics with temporal resolution in units of nanoseconds. Secondly, we propose an alternative approach to evaluating FLIM measurements based on a single-pixel camera experiment. In contrast to the standard evaluation, which requires a lengthy iterative reconstruction of PL maps for each timepoint, here we use a limited set of predetermined PL lifetimes and calculate the amplitude maps corresponding to each lifetime. The alternative approach significantly saves post-processing time and, in addition, in a system with noise present, it shows better stability in terms of the accuracy of the FLIM spectrogram. Besides simulations that confirmed the functionality of the extension, we implemented the new advancements into a microscope optical setup for mapping PL dynamics on the micrometer scale. The presented principles were also verified experimentally by mapping a LuAG:Ce crystal surface.
Collapse
|
8
|
The unperturbed picture: Label-free real-time optical monitoring of cells and extracellular vesicles for therapy. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2022. [DOI: 10.1016/j.cobme.2022.100414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
9
|
Iyer RR, Renteria CA, Yang L, Sorrells JE, Park J, Sun L, Yu Z, Huang Y, Marjanovic M, Mirica LM, Boppart SA. Tracking the binding of multi-functional fluorescent tags for Alzheimer's disease using quantitative multiphoton microscopy. JOURNAL OF BIOPHOTONICS 2022; 15:e202200105. [PMID: 35686672 PMCID: PMC9728943 DOI: 10.1002/jbio.202200105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 06/08/2022] [Indexed: 06/15/2023]
Abstract
A recent theranostic approach to address Alzheimer's disease (AD) utilizes multifunctional targets that both tag and negate the toxicity of AD biomarkers. These compounds, which emit fluorescence with both an activation and a spectral shift in the presence of Aβ, were previously characterized with traditional fluorescence imaging for binary characterization. However, these multifunctional compounds have broad and dynamic emission spectra that are dependent on factors such as the local environment, presence of Aβ deposits, etc. Since quantitative multiphoton microscopy is sensitive to the binding dynamics of molecules, we characterized the performance of two such compounds, LS-4 and ZY-12-OMe, using Simultaneous Label-free Autofluorescence Multi-harmonic (SLAM) microscopy and Fast Optical Coherence, Autofluorescence Lifetime imaging and Second harmonic generation (FOCALS) microscopy. This study shows that the combination of quantitative multiphoton imaging with multifunctional tags for AD offers new insights into the interaction of these tags with AD biomarkers and the theranostic mechanisms.
Collapse
Affiliation(s)
- Rishyashring R. Iyer
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Carlos A. Renteria
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Lingxiao Yang
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Janet E. Sorrells
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Jaena Park
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Liang Sun
- Department of Chemistry, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Zhengxin Yu
- Department of Chemistry, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Yiran Huang
- Department of Chemistry, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Marina Marjanovic
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- The Neuroscience Program, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Liviu M. Mirica
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Chemistry, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- The Neuroscience Program, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Hope Center for Neurological Disorders, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- The Neuroscience Program, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Carle Illinois College of Medicine, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Cancer Center at Illinois, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| |
Collapse
|
10
|
Sorrells J, Iyer RR, Yang L, Martin EM, Wang G, Tu H, Marjanovic M, Boppart SA. Computational Photon Counting Using Multithreshold Peak Detection for Fast Fluorescence Lifetime Imaging Microscopy. ACS PHOTONICS 2022; 9:2748-2755. [PMID: 35996369 PMCID: PMC9389606 DOI: 10.1021/acsphotonics.2c00505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Time-resolved photon counting methods have a finite bandwidth that restricts the acquisition speed of techniques like fluorescence lifetime imaging microscopy (FLIM). To enable faster imaging, computational methods can be employed to count photons when the output of a detector is directly digitized at a high sampling rate. Here, we present computational photon counting using a hybrid photodetector in conjunction with multithreshold peak detection to count instances where one or more photons arrive at the detector within the detector response time. This method can be used to distinguish up to five photon counts per digitized point, whereas previous demonstrations of computational photon counting on data acquired with photomultiplier tubes have only counted one photon at a time. We demonstrate in both freely moving C. elegans and a human breast cancer cell line undergoing apoptosis that this novel multithreshold peak detection method can accurately characterize the intensity and fluorescence lifetime of samples producing photon rates up to 223%, higher than previously demonstrated photon counting FLIM systems.
Collapse
Affiliation(s)
- Janet
E. Sorrells
- Department
of Bioengineering, University of Illinois
at Urbana-Champaign, Urbana, Illinois 61801, United States
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Rishyashring R. Iyer
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
- Department
of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Lingxiao Yang
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
- Department
of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Elisabeth M. Martin
- Department
of Bioengineering, University of Illinois
at Urbana-Champaign, Urbana, Illinois 61801, United States
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Geng Wang
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Haohua Tu
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
- Department
of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Marina Marjanovic
- Department
of Bioengineering, University of Illinois
at Urbana-Champaign, Urbana, Illinois 61801, United States
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| | - Stephen A. Boppart
- Department
of Bioengineering, University of Illinois
at Urbana-Champaign, Urbana, Illinois 61801, United States
- Beckman
Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
- Department
of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
- Cancer
Center at Illinois, Urbana, Illinois 61801, United States
- Carle
Illinois College of Medicine, University
of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| |
Collapse
|
11
|
Yang L, Park J, Chaney EJ, Sorrells JE, Marjanovic M, Phillips H, Spillman DR, Boppart SA. Label-free multimodal nonlinear optical imaging of needle biopsy cores for intraoperative cancer diagnosis. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-220031GR. [PMID: 35643823 PMCID: PMC9142840 DOI: 10.1117/1.jbo.27.5.056504] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 05/09/2022] [Indexed: 05/29/2023]
Abstract
SIGNIFICANCE Needle biopsy (NB) procedures are important for the initial diagnosis of many types of cancer. However, the possibility of NB specimens being unable to provide diagnostic information, (i.e., non-diagnostic sampling) and the time-consuming histological evaluation process can cause delays in diagnoses that affect patient care. AIM We aim to demonstrate the advantages of this label-free multimodal nonlinear optical imaging (NLOI) technique as a non-destructive point-of-procedure evaluation method for NB tissue cores, for the visualization and characterization of the tissue microenvironment. APPROACH A portable, label-free, multimodal NLOI system combined second-harmonic generation (SHG) and third-harmonic generation and two- and three-photon autofluorescence (2PF, 3PF) microscopy. It was used for intraoperative imaging of fresh NB tissue cores acquired during canine cancer surgeries, which involved liver, lung, and mammary tumors as well as soft-tissue sarcoma; in total, eight canine patients were recruited. An added tissue culture chamber enabled the use of this NLOI system for longitudinal imaging of fresh NB tissue cores taken from an induced rat mammary tumor and healthy mouse livers. RESULTS The intraoperative NLOI system was used to assess fresh canine NB specimens during veterinary cancer surgeries. Histology-like morphological features were visualized by the combination of four NLOI modalities at the point-of-procedure. The NLOI results provided quantitative information on the tissue microenvironment such as the collagen fiber orientation using Fourier-domain SHG analysis and metabolic profiling by optical redox ratio (ORR) defined by 2PF/(2PF + 3PF). The analyses showed that the canine mammary tumor had more randomly oriented collagen fibers compared to the tumor margin, and hepatocarcinoma had a wider distribution of ORR with a lower mean value compared to the liver fibrosis and the normal-appearing liver. Moreover, the loss of metabolic information during tissue degradation of fresh murine NB specimens was shown by overall intensity decreases in all channels and an increase of mean ORR from 0.94 (standard deviation 0.099) to 0.97 (standard deviation 0.077) during 1-h longitudinal imaging of a rat mammary tumor NB specimen. The tissue response to staurosporine (STS), an apoptotic inducer, from fresh murine liver NB specimens was also observed. The mean ORR decreased from 0.86 to 0.74 in the first 40 min and then increased to 0.8 during the rest of the hour of imaging, compared to the imaging results without the addition of STS, which showed a continuous increase of ORR from 0.72 to 0.75. CONCLUSIONS A label-free, multimodal NLOI platform reveals microstructural and metabolic information of the fresh NB cores during intraoperative cancer imaging. This system has been demonstrated on animal models to show its potential to provide a more comprehensive histological assessment and a better understanding of the unperturbed tumor microenvironment. Considering tissue degradation, or loss of viability upon fixation, this intraoperative NLOI system has the advantage of immediate assessment of freshly excised tissue specimens at the point of procedure.
Collapse
Affiliation(s)
- Lingxiao Yang
- University of Illinois at Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
| | - Jaena Park
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
| | - Eric J. Chaney
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
| | - Janet E. Sorrells
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
| | - Marina Marjanovic
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Carle Illinois College of Medicine, Champaign, Illinois, United States
| | - Heidi Phillips
- University of Illinois at Urbana-Champaign, College of Veterinary Medicine, Urbana, Illinois, United States
| | - Darold R. Spillman
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
| | - Stephen A. Boppart
- University of Illinois at Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Beckman Institute for Advanced Science and Technology, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
- University of Illinois at Urbana-Champaign, Carle Illinois College of Medicine, Champaign, Illinois, United States
- University of Illinois at Urbana-Champaign, Cancer Center at Illinois, Urbana, Illinois, United States
| |
Collapse
|
12
|
Ke J, Alieva T, Oktem FS, Silveira PEX, Wetzstein G, Willomitzer F. Computational optical sensing and imaging 2021: feature issue introduction. OPTICS EXPRESS 2022; 30:11394-11399. [PMID: 35473085 DOI: 10.1364/oe.456132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Indexed: 06/14/2023]
Abstract
This Feature Issue includes 2 reviews and 34 research articles that highlight recent works in the field of Computational Optical Sensing and Imaging. Many of the works were presented at the 2021 OSA Topical Meeting on Computational Optical Sensing and Imaging, held virtually from July 19 to July 23, 2021. Articles in the feature issue cover a broad scope of computational imaging topics, such as microscopy, 3D imaging, phase retrieval, non-line-of-sight imaging, imaging through scattering media, ghost imaging, compressed sensing, and applications with new types of sensors. Deep learning approaches for computational imaging and sensing are also a focus of this feature issue.
Collapse
|
13
|
Ke J, Alieva T, Oktem FS, Silveira PEX, Wetzstein G, Willomitzer F. Computational Optical Sensing and Imaging 2021: introduction to the feature issue. APPLIED OPTICS 2022; 61:COSI1-COSI4. [PMID: 35333228 DOI: 10.1364/ao.456133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Indexed: 06/14/2023]
Abstract
This feature issue includes two reviews and 34 research papers that highlight recent works in the field of computational optical sensing and imaging. Many of the works were presented at the 2021 Optica (formerly OSA) Topical Meeting on Computational Optical Sensing and Imaging, held virtually from 19 July to 23 July 2021. Papers in the feature issue cover a broad scope of computational imaging topics, such as microscopy, 3D imaging, phase retrieval, non-line-of-sight imaging, imaging through scattering media, ghost imaging, compressed sensing, and applications with new types of sensors. Deep learning approaches for computational imaging and sensing are also a focus of this feature issue.
Collapse
|