1
|
Seesan T, Mukherjee P, Abd El-Sadek I, Lim Y, Zhu L, Makita S, Yasuno Y. Optical-coherence-tomography-based deep-learning scatterer-density estimator using physically accurate noise model. BIOMEDICAL OPTICS EXPRESS 2024; 15:2832-2848. [PMID: 38855681 PMCID: PMC11161371 DOI: 10.1364/boe.519743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 03/19/2024] [Accepted: 03/26/2024] [Indexed: 06/11/2024]
Abstract
We demonstrate a deep-learning-based scatterer density estimator (SDE) that processes local speckle patterns of optical coherence tomography (OCT) images and estimates the scatterer density behind each speckle pattern. The SDE is trained using large quantities of numerically simulated OCT images and their associated scatterer densities. The numerical simulation uses a noise model that incorporates the spatial properties of three types of noise, i.e., shot noise, relative-intensity noise, and non-optical noise. The SDE's performance was evaluated numerically and experimentally using two types of scattering phantom and in vitro tumor spheroids. The results confirmed that the SDE estimates scatterer densities accurately. The estimation accuracy improved significantly when compared with our previous deep-learning-based SDE, which was trained using numerical speckle patterns generated from a noise model that did not account for the spatial properties of noise.
Collapse
Affiliation(s)
- Thitiya Seesan
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| | - Pradipta Mukherjee
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| | - Ibrahim Abd El-Sadek
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
- Department of Physics, Faculty of Science, Damietta University, New Damietta City 34517, Damietta, Egypt
| | - Yiheng Lim
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| | - Lida Zhu
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki 305-8573, Japan
| |
Collapse
|
2
|
Puyo L, Pfäffle C, Spahr H, Franke J, Bublitz D, Hillmann D, Hüttmann G. Diffuse-illumination holographic optical coherence tomography. OPTICS EXPRESS 2023; 31:33500-33517. [PMID: 37859131 DOI: 10.1364/oe.498654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 09/11/2023] [Indexed: 10/21/2023]
Abstract
Holographic optical coherence tomography (OCT) is a powerful imaging technique, but its ability to reveal low-reflectivity features is limited. In this study, we performed holographic OCT by incoherently averaging volumes with changing diffuse illumination of numerical aperture (NA) equal to the detection NA. While the reduction of speckle from singly scattered light is only modest, we discovered that speckle from multiply scattered light can be arbitrarily reduced, resulting in substantial improvements in image quality. This technique also offers the advantage of suppressing noises arising from spatial coherence, and can be implemented with a partially spatially incoherent light source for further mitigation of multiple scattering. Finally, we show that although holographic reconstruction capabilities are increasingly lost with decreasing spatial coherence, they can be retained over an axial range sufficient to standard OCT applications.
Collapse
|
3
|
Samaei S, Nowacka K, Gerega A, Pastuszak Ż, Borycki D. Continuous-wave parallel interferometric near-infrared spectroscopy (CW πNIRS) with a fast two-dimensional camera. BIOMEDICAL OPTICS EXPRESS 2022; 13:5753-5774. [PMID: 36733725 PMCID: PMC9872890 DOI: 10.1364/boe.472643] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 09/16/2022] [Accepted: 10/01/2022] [Indexed: 06/02/2023]
Abstract
Interferometric near-infrared spectroscopy (iNIRS) is an optical method that noninvasively measures the optical and dynamic properties of the human brain in vivo. However, the original iNIRS technique uses single-mode fibers for light collection, which reduces the detected light throughput. The reduced light throughput is compensated by the relatively long measurement or integration times (∼1 sec), which preclude monitoring of rapid blood flow changes that could be linked to neural activation. Here, we propose parallel interferometric near-infrared spectroscopy (πNIRS) to overcome this limitation. In πNIRS we use multi-mode fibers for light collection and a high-speed, two-dimensional camera for light detection. Each camera pixel acts effectively as a single iNIRS channel. So, the processed signals from each pixel are spatially averaged to reduce the overall integration time. Moreover, interferometric detection provides us with the unique capability of accessing complex information (amplitude and phase) about the light remitted from the sample, which with more than 8000 parallel channels, enabled us to sense the cerebral blood flow with only a 10 msec integration time (∼100x faster than conventional iNIRS). In this report, we have described the theoretical foundations and possible ways to implement πNIRS. Then, we developed a prototype continuous wave (CW) πNIRS system and validated it in liquid phantoms. We used our CW πNIRS to monitor the pulsatile blood flow in a human forearm in vivo. Finally, we demonstrated that CW πNIRS could monitor activation of the prefrontal cortex by recording the change in blood flow in the forehead of the subject while he was reading an unknown text.
Collapse
Affiliation(s)
- Saeed Samaei
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warsaw, Poland
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Ks. Trojdena 4, 02-109, Warsaw, Poland
| | - Klaudia Nowacka
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230 Warsaw, Poland
| | - Anna Gerega
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Ks. Trojdena 4, 02-109, Warsaw, Poland
| | - Żanna Pastuszak
- Department of Neurosurgery, Mossakowski Medical Research Center Polish Academy of Sciences, Pawińskiego 5, 02-106 Warsaw, Poland
| | - Dawid Borycki
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warsaw, Poland
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230 Warsaw, Poland
| |
Collapse
|
4
|
Pfäffle C, Spahr H, Gercke K, Puyo L, Höhl S, Melenberg D, Miura Y, Hüttmann G, Hillmann D. Phase-Sensitive Measurements of Depth-Dependent Signal Transduction in the Inner Plexiform Layer. Front Med (Lausanne) 2022; 9:885187. [PMID: 35721092 PMCID: PMC9198552 DOI: 10.3389/fmed.2022.885187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Accepted: 05/10/2022] [Indexed: 12/01/2022] Open
Abstract
Non-invasive spatially resolved functional imaging in the human retina has recently attracted considerable attention. Particularly functional imaging of bipolar and ganglion cells could aid in studying neuronal activity in humans, including an investigation of processes of the central nervous system. Recently, we imaged the activity of the inner neuronal layers by measuring nanometer-size changes of the cells within the inner plexiform layer (IPL) using phase-sensitive optical coherence tomography (OCT). In the IPL, there are connections between the neuronal cells that are dedicated to the processing of different aspects of the visual information, such as edges in the image or temporal changes. Still, so far, it was not possible to assign functional changes to single cells or cell classes in living humans, which is essential for studying the vision process. One characteristic of signal processing in the IPL is that different aspects of the visual impression are only processed in specific sub-layers (strata). Here, we present an investigation of these functional signals for three different sub-layers in the IPL with the aim to separate different properties of the visual signal processing. Whereas the inner depth-layer, closest to the ganglion cells, exhibits an increase in the optical path length, the outer depth-layer, closest to the bipolar cell layer, exhibits a decrease in the optical path length. Additionally, we found that the central depth is sensitive to temporal changes, showing a maximum response at a stimulation frequency of around 12.5 Hz. The results demonstrate that the signals from different cell types can be distinguished by phase-sensitive OCT.
Collapse
Affiliation(s)
- Clara Pfäffle
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany
| | - Hendrik Spahr
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany
| | - Katharina Gercke
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany
| | - Léo Puyo
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany.,Medical Laser Center Lübeck GmbH, Lübeck, Germany
| | - Svea Höhl
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany
| | - David Melenberg
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany
| | - Yoko Miura
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany.,Department of Ophthalmology, University of Lübeck, Lübeck, Germany
| | - Gereon Hüttmann
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany.,Airway Research Center North, Member of the German Center for Lung Research, Grosshansdorf, Germany.,Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Dierck Hillmann
- Institute of Biomedical Optic, University of Lübeck, Lübeck, Germany.,Thorlabs GmbH, Lübeck, Germany.,Department of Physics, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
5
|
Zhu L, Makita S, Oida D, Miyazawa A, Oikawa K, Mukherjee P, Lichtenegger A, Distel M, Yasuno Y. Computational refocusing of Jones matrix polarization-sensitive optical coherence tomography and investigation of defocus-induced polarization artifacts. BIOMEDICAL OPTICS EXPRESS 2022; 13:2975-2994. [PMID: 35774308 PMCID: PMC9203103 DOI: 10.1364/boe.454975] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 04/13/2022] [Accepted: 04/13/2022] [Indexed: 06/15/2023]
Abstract
Here we demonstrate a long-depth-of-focus imaging method using polarization sensitive optical coherence tomography (PS-OCT). This method involves a combination of Fresnel-diffraction-model-based phase sensitive computational refocusing and Jones-matrix based PS-OCT (JM-OCT). JM-OCT measures four complex OCT images corresponding to four polarization channels. These OCT images are computationally refocused as preserving the mutual phase consistency. This method is validated using a static phantom, postmortem zebrafish, and ex vivo porcine muscle samples. All the samples demonstrated successful computationally-refocused birefringence and degree-of-polarization-uniformity (DOPU) images. We found that defocusing induces polarization artifacts, i.e., incorrectly high birefringence values and low DOPU values, which are substantially mitigated by computational refocusing.
Collapse
Affiliation(s)
- Lida Zhu
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Daisuke Oida
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Arata Miyazawa
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
- Sky technology Inc., Tsukuba, Ibaraki, Japan
| | - Kensuke Oikawa
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Pradipta Mukherjee
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Antonia Lichtenegger
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Martin Distel
- Innovative Cancer Models, St. Anna Children’s Cancer Research Institute, Vienna, Austria
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, Tsukuba, Ibaraki, Japan
| |
Collapse
|
6
|
Tomczewski S, Węgrzyn P, Borycki D, Auksorius E, Wojtkowski M, Curatolo A. Light-adapted flicker optoretinograms captured with a spatio-temporal optical coherence-tomography (STOC-T) system. BIOMEDICAL OPTICS EXPRESS 2022; 13:2186-2201. [PMID: 35519256 PMCID: PMC9045926 DOI: 10.1364/boe.444567] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 02/20/2022] [Accepted: 02/23/2022] [Indexed: 06/14/2023]
Abstract
For many years electroretinography (ERG) has been used for obtaining information about the retinal physiological function. More recently, a new technique called optoretinography (ORG) has been developed. In one form of this technique, the physiological response of retinal photoreceptors to visible light, resulting in a nanometric photoreceptor optical path length change, is measured by phase-sensitive optical coherence tomography (OCT). To date, a limited number of studies with phase-based ORG measured the retinal response to a flickering light stimulation. In this work, we use a spatio-temporal optical coherence tomography (STOC-T) system to capture optoretinograms with a flickering stimulus over a 1.7 × 0.85 mm2 area of a light-adapted retina located between the fovea and the optic nerve. We show that we can detect statistically-significant differences in the photoreceptor optical path length (OPL) modulation amplitudes in response to different flicker frequencies and with better signal to noise ratios (SNRs) than for a dark-adapted eye. We also demonstrate the ability to spatially map such response to a patterned stimulus with light stripes flickering at different frequencies, highlighting the prospect of characterizing the spatially-resolved temporal-frequency response of the retina with ORG.
Collapse
Affiliation(s)
- Sławomir Tomczewski
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
- Equal contributors
| | - Piotr Węgrzyn
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
- Faculty of Physics, University of Warsaw, Pasteura 5, 02-093 Warszawa, Poland
- Equal contributors
| | - Dawid Borycki
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
| | - Egidijus Auksorius
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
- Center for Physical Sciences and Technology (FTMC), Saulėtekio al. 3, LT-10257 Vilnius, Lithuania
| | - Maciej Wojtkowski
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
| | - Andrea Curatolo
- International Centre for Translational Eye Research, Skierniewicka 10A, 01-230, Warszawa, Poland
- Institute of Physical Chemistry, Polish Academy of Sciences, Kasprzaka 44/52, 01-224 Warszawa, Poland
| |
Collapse
|