1
|
Dan M, Zhang Y, Gao F. Extended Kalman filtering for enhancing a cyclic pattern-updating scheme of single-pixel dynamic fluorescence spatial frequency domain imaging. OPTICS LETTERS 2023; 48:5443-5446. [PMID: 37910673 DOI: 10.1364/ol.495099] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Accepted: 09/26/2023] [Indexed: 11/03/2023]
Abstract
A single-pixel imaging technique applied to fluorescence spatial frequency domain imaging (f-SFDI) brings many positive benefits, but its low frame rate will also lead to severe quantitative degradation when dynamically imaging a vibrant target. This work presents a novel, to the best of our knowledge, single-pixel imaging approach that combines the extended Kalman filtering (EKF) and a cyclic one-pattern updating for an enhanced dynamic f-SFDI. The cyclic one-pattern updating scheme enables the dynamic imaging at a high frame rate, and on this basis, the imaging process of an intensity temporally varying target (assuming no structure motion in the scene) is dynamically modelled, and accordingly, the surface intensities and images at each sampling time point simultaneously estimated via the EKF. Simulation and phantom validations demonstrate that the method can improve the quantitative accuracy of the results. An in vivo experiment performed on two mice for dynamic monitoring of photosensitizer doses in a photodynamic therapy further demonstrates the clinical feasibility of the proposed method.
Collapse
|
2
|
Walter AB, Jansen ED. Development of a platform for broadband, spectra-fitted, tissue optical phantoms. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:025001. [PMID: 36814953 PMCID: PMC9940728 DOI: 10.1117/1.jbo.28.2.025001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 01/24/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE Current methods of producing optical phantoms are incapable of accurately capturing the wavelength-dependent properties of tissue critical for many optical modalities. AIM We aim to introduce a method of producing solid, inorganic phantoms whose wavelength-dependent optical properties can be matched to those of tissue over the wavelength range of 370 to 950 nm. APPROACH The concentration-dependent optical properties of 20 pigments were characterized and used to determine combinations that result in optimal fits compared to the target properties over the full spectrum. Phantoms matching the optical properties of muscle and nerve, the diffuse reflectance of pale and melanistic skin, and the chromophore concentrations of a computational skin model with varying oxygen saturation ( StO 2 ) were made with this method. RESULTS Both optical property phantoms were found to accurately mimic their respective tissues' absorption and scattering properties across the entire spectrum. The diffuse reflectance phantoms were able to closely approximate skin reflectance regardless of skin type. All three computational skin phantoms were found to have emulated chromophore concentrations close to the model, with an average percent error for the StO 2 of 4.31%. CONCLUSIONS This multipigment phantom platform represents a powerful tool for creating spectrally accurate tissue phantoms, which should increase the availability of standards for many optical techniques.
Collapse
Affiliation(s)
- Alec B. Walter
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States
- Vanderbilt University, Biophotonics Center, Nashville, Tennessee, United States
| | - E. Duco Jansen
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States
- Vanderbilt University, Biophotonics Center, Nashville, Tennessee, United States
- Vanderbilt University Medical Center, Department of Neurosurgery, Nashville, Tennessee, United States
| |
Collapse
|
3
|
Martins IS, Silva HF, Lazareva EN, Chernomyrdin NV, Zaytsev KI, Oliveira LM, Tuchin VV. Measurement of tissue optical properties in a wide spectral range: a review [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:249-298. [PMID: 36698664 PMCID: PMC9841994 DOI: 10.1364/boe.479320] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 11/29/2022] [Accepted: 11/29/2022] [Indexed: 06/17/2023]
Abstract
A distinctive feature of this review is a critical analysis of methods and results of measurements of the optical properties of tissues in a wide spectral range from deep UV to terahertz waves. Much attention is paid to measurements of the refractive index of biological tissues and liquids, the knowledge of which is necessary for the effective application of many methods of optical imaging and diagnostics. The optical parameters of healthy and pathological tissues are presented, and the reasons for their differences are discussed, which is important for the discrimination of pathologies and the demarcation of their boundaries. When considering the interaction of terahertz radiation with tissues, the concept of an effective medium is discussed, and relaxation models of the effective optical properties of tissues are presented. Attention is drawn to the manifestation of the scattering properties of tissues in the THz range and the problems of measuring the optical properties of tissues in this range are discussed. In conclusion, a method for the dynamic analysis of the optical properties of tissues under optical clearing using an application of immersion agents is presented. The main mechanisms and technologies of optical clearing, as well as examples of the successful application for differentiation of healthy and pathological tissues, are analyzed.
Collapse
Affiliation(s)
- Inês S. Martins
- Center for Innovation in Engineering and Industrial Technology, ISEP, Porto, Portugal
| | - Hugo F. Silva
- Porto University, School of Engineering, Porto, Portugal
| | - Ekaterina N. Lazareva
- Science Medical Center, Saratov State University, Saratov, Russia
- Laboratory of Laser Molecular Imaging and Machine Learning, Tomsk State University, Tomsk, Russia
| | | | - Kirill I. Zaytsev
- Prokhorov General Physics Institute of the Russian Academy of Sciences, Moscow, Russia
| | - Luís M. Oliveira
- Physics Department, Polytechnic of Porto – School of Engineering (ISEP), Porto, Portugal
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Porto, Portugal
| | - Valery V. Tuchin
- Science Medical Center, Saratov State University, Saratov, Russia
- Laboratory of Laser Molecular Imaging and Machine Learning, Tomsk State University, Tomsk, Russia
| |
Collapse
|
4
|
Smith JT, Ochoa M, Faulkner D, Haskins G, Intes X. Deep learning in macroscopic diffuse optical imaging. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-210288VRR. [PMID: 35218169 PMCID: PMC8881080 DOI: 10.1117/1.jbo.27.2.020901] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 02/09/2022] [Indexed: 05/02/2023]
Abstract
SIGNIFICANCE Biomedical optics system design, image formation, and image analysis have primarily been guided by classical physical modeling and signal processing methodologies. Recently, however, deep learning (DL) has become a major paradigm in computational modeling and has demonstrated utility in numerous scientific domains and various forms of data analysis. AIM We aim to comprehensively review the use of DL applied to macroscopic diffuse optical imaging (DOI). APPROACH First, we provide a layman introduction to DL. Then, the review summarizes current DL work in some of the most active areas of this field, including optical properties retrieval, fluorescence lifetime imaging, and diffuse optical tomography. RESULTS The advantages of using DL for DOI versus conventional inverse solvers cited in the literature reviewed herein are numerous. These include, among others, a decrease in analysis time (often by many orders of magnitude), increased quantitative reconstruction quality, robustness to noise, and the unique capability to learn complex end-to-end relationships. CONCLUSIONS The heavily validated capability of DL's use across a wide range of complex inverse solving methodologies has enormous potential to bring novel DOI modalities, otherwise deemed impractical for clinical translation, to the patient's bedside.
Collapse
Affiliation(s)
- Jason T Smith
- Rensselaer Polytechnic Institute, Department of Biomedical Engineering, Troy, New York, United States
| | - Marien Ochoa
- Rensselaer Polytechnic Institute, Department of Biomedical Engineering, Troy, New York, United States
| | - Denzel Faulkner
- Rensselaer Polytechnic Institute, Department of Biomedical Engineering, Troy, New York, United States
| | - Grant Haskins
- Rensselaer Polytechnic Institute, Department of Biomedical Engineering, Troy, New York, United States
| | - Xavier Intes
- Rensselaer Polytechnic Institute, Center for Modeling, Simulation and Imaging for Medicine, Troy, Ne, United States
| |
Collapse
|
5
|
Aguénounon E, Smith JT, Al-Taher M, Diana M, Intes X, Gioux S. Real-time, wide-field and high-quality single snapshot imaging of optical properties with profile correction using deep learning. BIOMEDICAL OPTICS EXPRESS 2020; 11:5701-5716. [PMID: 33149980 PMCID: PMC7587245 DOI: 10.1364/boe.397681] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 08/28/2020] [Accepted: 08/28/2020] [Indexed: 05/06/2023]
Abstract
The development of real-time, wide-field and quantitative diffuse optical imaging methods to visualize functional and structural biomarkers of living tissues is a pressing need for numerous clinical applications including image-guided surgery. In this context, Spatial Frequency Domain Imaging (SFDI) is an attractive method allowing for the fast estimation of optical properties using the Single Snapshot of Optical Properties (SSOP) approach. Herein, we present a novel implementation of SSOP based on a combination of deep learning network at the filtering stage and Graphics Processing Units (GPU) capable of simultaneous high visual quality image reconstruction, surface profile correction and accurate optical property (OP) extraction in real-time across large fields of view. In the most optimal implementation, the presented methodology demonstrates megapixel profile-corrected OP imaging with results comparable to that of profile-corrected SFDI, with a processing time of 18 ms and errors relative to SFDI method less than 10% in both profilometry and profile-corrected OPs. This novel processing framework lays the foundation for real-time multispectral quantitative diffuse optical imaging for surgical guidance and healthcare applications. All code and data used for this work is publicly available at www.healthphotonics.org under the resources tab.
Collapse
Affiliation(s)
- Enagnon Aguénounon
- University of Strasbourg, ICube Laboratory, 300 Boulevard Sébastien Brant, 67412 Illkirch, France
| | - Jason T. Smith
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| | - Mahdi Al-Taher
- Institute of Image-Guided Surgery, IHU Strasbourg, Strasbourg, France
- Maastricht University Medical Center, Maastricht, The Netherlands
| | - Michele Diana
- University of Strasbourg, ICube Laboratory, 300 Boulevard Sébastien Brant, 67412 Illkirch, France
- Institute of Image-Guided Surgery, IHU Strasbourg, Strasbourg, France
- Research Institute against Digestive Cancer, IRCAD, Strasbourg, France
| | - Xavier Intes
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| | - Sylvain Gioux
- University of Strasbourg, ICube Laboratory, 300 Boulevard Sébastien Brant, 67412 Illkirch, France
| |
Collapse
|
6
|
Smith JT, Aguénounon E, Gioux S, Intes X. Macroscopic fluorescence lifetime topography enhanced via spatial frequency domain imaging. OPTICS LETTERS 2020; 45:4232-4235. [PMID: 32735266 PMCID: PMC7935427 DOI: 10.1364/ol.397605] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
We report on a macroscopic fluorescence lifetime imaging (MFLI) topography computational framework based around machine learning with the main goal of retrieving the depth of fluorescent inclusions deeply seated in bio-tissues. This approach leverages the depth-resolved information inherent to time-resolved fluorescence data sets coupled with the retrieval of in situ optical properties as obtained via spatial frequency domain imaging (SFDI). Specifically, a Siamese network architecture is proposed with optical properties (OPs) and time-resolved fluorescence decays as input followed by simultaneous retrieval of lifetime maps and depth profiles. We validate our approach using comprehensive in silico data sets as well as with a phantom experiment. Overall, our results demonstrate that our approach can retrieve the depth of fluorescence inclusions, especially when coupled with optical properties estimation, with high accuracy. We expect the presented computational approach to find great utility in applications such as optical-guided surgery.
Collapse
Affiliation(s)
- Jason T. Smith
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, New York 12180, USA
| | - Enagnon Aguénounon
- University of Strasbourg, ICube Laboratory, 300 Boulevard Sebastien Brant, 67412 Illkirch, France
| | - Sylvain Gioux
- University of Strasbourg, ICube Laboratory, 300 Boulevard Sebastien Brant, 67412 Illkirch, France
| | - Xavier Intes
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, New York 12180, USA
- Corresponding author:
| |
Collapse
|