1
|
Zuo R, Wei S, Wang Y, Irsch K, Kang JU. High-resolution in vivo 4D-OCT fish-eye imaging using 3D-UNet with multi-level residue decoder. BIOMEDICAL OPTICS EXPRESS 2024; 15:5533-5546. [PMID: 39296392 PMCID: PMC11407266 DOI: 10.1364/boe.532258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Revised: 07/18/2024] [Accepted: 08/09/2024] [Indexed: 09/21/2024]
Abstract
Optical coherence tomography (OCT) allows high-resolution volumetric imaging of biological tissues in vivo. However, 3D-image acquisition often suffers from motion artifacts due to slow frame rates and involuntary and physiological movements of living tissue. To solve these issues, we implement a real-time 4D-OCT system capable of reconstructing near-distortion-free volumetric images based on a deep learning-based reconstruction algorithm. The system initially collects undersampled volumetric images at a high speed and then upsamples the images in real-time by a convolutional neural network (CNN) that generates high-frequency features using a deep learning algorithm. We compare and analyze both dual-2D- and 3D-UNet-based networks for the OCT 3D high-resolution image reconstruction. We refine the network architecture by incorporating multi-level information to accelerate convergence and improve accuracy. The network is optimized by utilizing the 16-bit floating-point precision for network parameters to conserve GPU memory and enhance efficiency. The result shows that the refined and optimized 3D-network is capable of retrieving the tissue structure more precisely and enable real-time 4D-OCT imaging at a rate greater than 10 Hz with a root mean square error (RMSE) of ∼0.03.
Collapse
Affiliation(s)
- Ruizhi Zuo
- Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Shuwen Wei
- Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Yaning Wang
- Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Kristina Irsch
- CNRS, Vision Institute, Paris, France
- School of Medicine, Johns Hopkins University, Baltimore, MD, USA
| | - Jin U Kang
- Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, USA
- School of Medicine, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
2
|
Wang L, Chen Z, Zhu Z, Yu X, Mo J. Compressive-sensing swept-source optical coherence tomography angiography with reduced noise. JOURNAL OF BIOPHOTONICS 2022; 15:e202200087. [PMID: 35488181 DOI: 10.1002/jbio.202200087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 04/25/2022] [Accepted: 04/28/2022] [Indexed: 06/14/2023]
Abstract
Optical coherence tomography angiography (OCTA), as a functional extension of optical coherence tomography (OCT), has exhibited a great potential to aid in clinical diagnostics. Currently, OCTA still suffers from motion artifact and noise. Therefore, in this article, we propose to implement compressive sensing (CS) on B-scans to reduce motion artifact by increasing B-scan rate. Meanwhile, a noise reduction filter is specially designed by combining CS, Gaussian filter and median filter. Specially, CS filtering is realized by averaging multiple CS repetitions on en-face OCTA images with varied sampling functions. The method is evaluated on in vivo OCTA images of human skin. The results show that vasculature structures can be reconstructed well through CS on B-scans with a sampling rate of 70%. Moreover, the noise can be significantly eliminated by the developed filter. This implies that our method has a good potential to expedite OCTA imaging and improve the image quality.
Collapse
Affiliation(s)
- Lingyun Wang
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Ziye Chen
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Zhanyu Zhu
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Xiaojun Yu
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Jianhua Mo
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| |
Collapse
|
3
|
Alexopoulos P, Madu C, Wollstein G, Schuman JS. The Development and Clinical Application of Innovative Optical Ophthalmic Imaging Techniques. Front Med (Lausanne) 2022; 9:891369. [PMID: 35847772 PMCID: PMC9279625 DOI: 10.3389/fmed.2022.891369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 05/23/2022] [Indexed: 11/22/2022] Open
Abstract
The field of ophthalmic imaging has grown substantially over the last years. Massive improvements in image processing and computer hardware have allowed the emergence of multiple imaging techniques of the eye that can transform patient care. The purpose of this review is to describe the most recent advances in eye imaging and explain how new technologies and imaging methods can be utilized in a clinical setting. The introduction of optical coherence tomography (OCT) was a revolution in eye imaging and has since become the standard of care for a plethora of conditions. Its most recent iterations, OCT angiography, and visible light OCT, as well as imaging modalities, such as fluorescent lifetime imaging ophthalmoscopy, would allow a more thorough evaluation of patients and provide additional information on disease processes. Toward that goal, the application of adaptive optics (AO) and full-field scanning to a variety of eye imaging techniques has further allowed the histologic study of single cells in the retina and anterior segment. Toward the goal of remote eye care and more accessible eye imaging, methods such as handheld OCT devices and imaging through smartphones, have emerged. Finally, incorporating artificial intelligence (AI) in eye images has the potential to become a new milestone for eye imaging while also contributing in social aspects of eye care.
Collapse
Affiliation(s)
- Palaiologos Alexopoulos
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Chisom Madu
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Gadi Wollstein
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
| | - Joel S. Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
- Department of Electrical and Computer Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
| |
Collapse
|
4
|
Rabbani H, Teyfouri N, Jabbari I. Low-dose cone-beam computed tomography reconstruction through a fast three-dimensional compressed sensing method based on the three-dimensional pseudo-polar fourier transform. JOURNAL OF MEDICAL SIGNALS & SENSORS 2022; 12:8-24. [PMID: 35265461 PMCID: PMC8804585 DOI: 10.4103/jmss.jmss_114_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 04/24/2021] [Accepted: 08/20/2021] [Indexed: 12/02/2022]
Abstract
Background: Reconstruction of high quality two dimensional images from fan beam computed tomography (CT) with a limited number of projections is already feasible through Fourier based iterative reconstruction method. However, this article is focused on a more complicated reconstruction of three dimensional (3D) images in a sparse view cone beam computed tomography (CBCT) by utilizing Compressive Sensing (CS) based on 3D pseudo polar Fourier transform (PPFT). Method: In comparison with the prevalent Cartesian grid, PPFT re gridding is potent to remove rebinning and interpolation errors. Furthermore, using PPFT based radon transform as the measurement matrix, reduced the computational complexity. Results: In order to show the computational efficiency of the proposed method, we compare it with an algebraic reconstruction technique and a CS type algorithm. We observed convergence in <20 iterations in our algorithm while others would need at least 50 iterations for reconstructing a qualified phantom image. Furthermore, using a fast composite splitting algorithm solver in each iteration makes it a fast CBCT reconstruction algorithm. The algorithm will minimize a linear combination of three terms corresponding to a least square data fitting, Hessian (HS) Penalty and l1 norm wavelet regularization. We named it PP-based compressed sensing-HS-W. In the reconstruction range of 120 projections around the 360° rotation, the image quality is visually similar to reconstructed images by Feldkamp-Davis-Kress algorithm using 720 projections. This represents a high dose reduction. Conclusion: The main achievements of this work are to reduce the radiation dose without degrading the image quality. Its ability in removing the staircase effect, preserving edges and regions with smooth intensity transition, and producing high-resolution, low-noise reconstruction results in low-dose level are also shown.
Collapse
|
5
|
Wang J, Chaney EJ, Aksamitiene E, Marjanovic M, Boppart SA. Compressive sensing for polarization sensitive optical coherence tomography. JOURNAL OF PHYSICS D: APPLIED PHYSICS 2021; 54:294005. [PMID: 38222471 PMCID: PMC10786634 DOI: 10.1088/1361-6463/abf958] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/16/2024]
Abstract
In this report, we report on the implementation of compressive sensing (CS) and sparse sampling in polarization sensitive optical coherence tomography (PS-OCT) to reduce the number of B-scans (frames consisting of an array of A-scans, where each represents a single depth profile of reflections) required for effective volumetric (3D dataset composed of an array of B-scans) PS-OCT measurements (i.e. OCT intensity, and phase retardation) reconstruction. Sparse sampling of PS-OCT is achieved through randomization of step sizes along the slow-axis of PS-OCT imaging, covering the same spatial ranges as those with equal slow-axis step sizes, but with a reduced number of B-scans. Tested on missing B-scan rates of 25%, 50% and 75%, we found CS could reconstruct reasonably good (as evidenced by a correlation coefficient >0.6) PS-OCT measurements with a maximum reduced B-scan rate of 50%, thereby accelerating and doubling the rate of volumetric PS-OCT measurements.
Collapse
Affiliation(s)
- Jianfeng Wang
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
| | - Eric J Chaney
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
| | - Edita Aksamitiene
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
| | - Marina Marjanovic
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
- Carle Illinois College of Medicine, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
| | - Stephen A Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
- Carle Illinois College of Medicine, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States of America
| |
Collapse
|
6
|
McLean JP, Hendon CP. 3-D compressed sensing optical coherence tomography using predictive coding. BIOMEDICAL OPTICS EXPRESS 2021; 12:2531-2549. [PMID: 33996246 PMCID: PMC8086477 DOI: 10.1364/boe.421848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Revised: 03/24/2021] [Accepted: 03/25/2021] [Indexed: 05/05/2023]
Abstract
We present a compressed sensing (CS) algorithm and sampling strategy for reconstructing 3-D Optical Coherence Tomography (OCT) image volumes from as little as 10% of the original data. Reconstruction using the proposed method, Denoising Predictive Coding (DN-PC), is demonstrated for five clinically relevant tissue types including human heart, retina, uterus, breast, and bovine ligament. DN-PC reconstructs the difference between adjacent b-scans in a volume and iteratively applies Gaussian filtering to improve image sparsity. An a-line sampling strategy was developed that can be easily implemented in existing Spectral-Domain OCT systems and reduce scan time by up to 90%.
Collapse
|
7
|
Daneshmand PG, Mehridehnavi A, Rabbani H. Reconstruction of Optical Coherence Tomography Images Using Mixed Low Rank Approximation and Second Order Tensor Based Total Variation Method. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:865-878. [PMID: 33232227 DOI: 10.1109/tmi.2020.3040270] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This paper proposes a mixed low-rank approximation and second-order tensor-based total variation (LRSOTTV) approach for the super-resolution and denoising of retinal optical coherence tomography (OCT) images through effective utilization of nonlocal spatial correlations and local smoothness properties. OCT imaging relies on interferometry, which explains why OCT images suffer from a high level of noise. In addition, data subsampling is conducted during OCT A-scan and B-scan acquisition. Therefore, using effective super-resolution algorithms is necessary for reconstructing high-resolution clean OCT images. In this paper, a low-rank regularization approach is proposed for exploiting nonlocal self-similarity prior to OCT image reconstruction. To benefit from the advantages of the redundancy of multi-slice OCT data, we construct a third-order tensor by extracting the nonlocal similar three-dimensional blocks and grouping them by applying the k-nearest-neighbor method. Next, the nuclear norm is used as a regularization term to shrink the singular values of the constructed tensor in the non-local correlation direction. Further, the regularization approaches of the first-order tensor-based total variation (FOTTV) and SOTTV are proposed for better preservation of retinal layers and suppression of artifacts in OCT images. The alternative direction method of multipliers (ADMM) technique is then used to solve the resulting optimization problem. Our experiments show that integrating SOTTV instead of FOTTV into a low-rank approximation model can achieve noticeably improved results. Our experimental results on the denoising and super-resolution of OCT images demonstrate that the proposed model can provide images whose numerical and visual qualities are higher than those obtained by using state-of-the-art methods.
Collapse
|
8
|
Atalar O, Millar DS, Wang P, Koike-Akino T, Kojima K, Orlik PV, Parsons K. Spectrally sparse optical coherence tomography. OPTICS EXPRESS 2020; 28:37798-37810. [PMID: 33379608 DOI: 10.1364/oe.409539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Accepted: 11/18/2020] [Indexed: 06/12/2023]
Abstract
Swept-source optical coherence tomography (OCT) typically relies on expensive and complex swept-source lasers, the cost of which currently limits the suitability of OCT for new applications. In this work, we demonstrate spectrally sparse OCT utilizing randomly spaced low-bandwidth optical chirps, suitable for low-cost implementation with telecommunications grade devices. Micron scale distance estimation accuracy with a resolution of 40 μm at a standoff imaging distance greater than 10 cm is demonstrated using a stepped chirp approach with approximately 23% occupancy of 4 THz bandwidth. For imaging of sparse scenes, comparable performance to full bandwidth occupancy is verified for metallic targets.
Collapse
|
9
|
Daneshmand PG, Rabbani H, Mehridehnavi A. Super-Resolution of Optical Coherence Tomography Images by Scale Mixture Models. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2020; 29:5662-5676. [PMID: 32275595 DOI: 10.1109/tip.2020.2984896] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this paper, a new statistical model is proposed for the single image super-resolution of retinal Optical Coherence Tomography (OCT) images. OCT imaging relies on interfero-metry, which explains why OCT images suffer from a high level of noise. Moreover, data subsampling is carried out during the acquisition of OCT A-scans and B-scans. So, it is necessary to utilize effective super-resolution algorithms to reconstruct high-resolution clean OCT images. In this paper, a nonlocal sparse model-based Bayesian framework is proposed for OCT restoration. For this reason, by characterizing nonlocal patches with similar structures, known as a group, the sparse coefficients of each group of OCT images are modeled by the scale mixture models. In this base, the coefficient vector is decomposed into the point-wise product of a random vector and a positive scaling variable. Estimation of the sparse coefficients depends on the proposed distribution for the random vector and scaling variable where the Laplacian random vector and Generalized Extreme-Value (GEV) scale parameter (Laplacian+GEV model) show the best goodness of fit for each group of OCT images. Finally, a new OCT super-resolution method based on this new scale mixture model is introduced, where the maximum a posterior estimation of both sparse coefficients and scaling variables are calculated efficiently by applying an alternating minimization method. Our experimental results prove that the proposed OCT super-resolution method based on the Laplacian+GEV model outperforms other competing methods in terms of both subjective and objective visual qualities.
Collapse
|
10
|
Stroud JR, Liu L, Chin S, Tran TD, Foster MA. Optical coherence tomography using physical domain data compression to achieve MHz A-scan rates. OPTICS EXPRESS 2019; 27:36329-36339. [PMID: 31873414 DOI: 10.1364/oe.27.036329] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2019] [Accepted: 11/06/2019] [Indexed: 06/10/2023]
Abstract
The three-dimensional volumetric imaging capability of optical coherence tomography (OCT) leads to the generation of large amounts of data, which necessitates high speed acquisition followed by high dimensional image processing and visualization. This signal acquisition and processing pipeline demands high A-scan rates on the front end, which has driven researchers to push A-scan acquisition rates into the MHz regime. To this end, the optical time-stretch approach uses a mode locked laser (MLL) source, dispersion in optical fiber, and a single analog-to-digital converter (ADC) to achieve multi-MHz A-scan rates. While enabling impressive performance this Nyquist sampling approach is ultimately constrained by the sampling rate and bandwidth of the ADC. Additionally such an approach generates massive amounts of data. Here we present a compressed sensing (CS) OCT system that uses a MLL, electro-optic modulation, and optical dispersion to implement data compression in the physical domain and rapidly acquire real-time compressed measurements of the OCT signals. Compression in the analog domain prior to digitization allows for the use of lower bandwidth ADCs, which reduces cost and decreases the required data capacity of the sampling interface. By leveraging a compressive A-scan optical sampling approach and the joint sparsity of C-scan data we demonstrate 14.4-MHz to 144-MHz A-scan acquisition speeds using a sub-Nyquist 1.44 Gsample/sec ADC sampling rate. Furthermore we evaluate the impact of data compression and resulting imaging speed on image quality.
Collapse
|
11
|
Structural and Functional Sensing of Bio-Tissues Based on Compressive Sensing Spectral Domain Optical Coherence Tomography. SENSORS 2019; 19:s19194208. [PMID: 31569799 PMCID: PMC6807266 DOI: 10.3390/s19194208] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Revised: 09/17/2019] [Accepted: 09/24/2019] [Indexed: 11/16/2022]
Abstract
In this paper, a full depth 2D CS-SDOCT approach is proposed, which combines two-dimensional (2D) compressive sensing spectral-domain optical coherence tomography (CS-SDOCT) and dispersion encoding (ED) technologies, and its applications in structural imaging and functional sensing of bio-tissues are studied. Specifically, by introducing a large dispersion mismatch between the reference arm and sample arm in SD-OCT system, the reconstruction of the under-sampled A-scan data and the removal of the conjugated images can be achieved simultaneously by only two iterations. The under-sampled B-scan data is then reconstructed using the classic CS reconstruction algorithm. For a 5 mm × 3.2 mm fish-eye image, the conjugated image was reduced by 31.4 dB using 50% × 50% sampled data (250 depth scans and 480 spectral sampling points per depth scan), and all A-scan data was reconstructed in only 1.2 s. In addition, we analyze the application performance of the CS-SDOCT in functional sensing of locally homogeneous tissue. Simulation and experimental results show that this method can correctly reconstruct the extinction coefficient spectrum under reasonable iteration times. When 8 iterations were used to reconstruct the A-scan data in the imaging experiment of fisheye, the extinction coefficient spectrum calculated using 50% × 50% data was approximately consistent with that obtained with 100% data.
Collapse
|