1
|
Song Cho DM, Jerome MJ, Hendon CP. Compressed sensing of human breast optical coherence 3-D image volume data using predictive coding. BIOMEDICAL OPTICS EXPRESS 2023; 14:5720-5734. [PMID: 38021138 PMCID: PMC10659800 DOI: 10.1364/boe.502851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 09/26/2023] [Accepted: 10/03/2023] [Indexed: 12/01/2023]
Abstract
There are clinical needs for optical coherence tomography (OCT) of large areas within a short period of time, such as imaging resected breast tissue for the evaluation of cancer. We report on the use of denoising predictive coding (DN-PC), a novel compressed sensing (CS) algorithm for reconstruction of OCT volumes of human normal breast and breast cancer tissue. The DN-PC algorithm has been rewritten to allow for computational parallelization and efficient memory transfer, resulting in a net reduction of computation time by a factor of 20. We compress image volumes at decreasing A-line sampling rates to evaluate a relation between reconstruction behavior and image features of breast tissue.
Collapse
Affiliation(s)
- Diego M. Song Cho
- Department of Biomedical Engineering, Columbia University, 500 W 120th Street, New York, NY 10027, USA
| | - Manuel J. Jerome
- Department of Electrical Engineering, Columbia University, 500 W 120th Street, New York, NY 10027, USA
| | - Christine P. Hendon
- Department of Electrical Engineering, Columbia University, 500 W 120th Street, New York, NY 10027, USA
| |
Collapse
|
2
|
Wang L, Chen Z, Zhu Z, Yu X, Mo J. Compressive-sensing swept-source optical coherence tomography angiography with reduced noise. JOURNAL OF BIOPHOTONICS 2022; 15:e202200087. [PMID: 35488181 DOI: 10.1002/jbio.202200087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 04/25/2022] [Accepted: 04/28/2022] [Indexed: 06/14/2023]
Abstract
Optical coherence tomography angiography (OCTA), as a functional extension of optical coherence tomography (OCT), has exhibited a great potential to aid in clinical diagnostics. Currently, OCTA still suffers from motion artifact and noise. Therefore, in this article, we propose to implement compressive sensing (CS) on B-scans to reduce motion artifact by increasing B-scan rate. Meanwhile, a noise reduction filter is specially designed by combining CS, Gaussian filter and median filter. Specially, CS filtering is realized by averaging multiple CS repetitions on en-face OCTA images with varied sampling functions. The method is evaluated on in vivo OCTA images of human skin. The results show that vasculature structures can be reconstructed well through CS on B-scans with a sampling rate of 70%. Moreover, the noise can be significantly eliminated by the developed filter. This implies that our method has a good potential to expedite OCTA imaging and improve the image quality.
Collapse
Affiliation(s)
- Lingyun Wang
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Ziye Chen
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Zhanyu Zhu
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| | - Xiaojun Yu
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Jianhua Mo
- School of Electronics and Information Engineering, Soochow University, Suzhou, China
| |
Collapse
|
3
|
Alexopoulos P, Madu C, Wollstein G, Schuman JS. The Development and Clinical Application of Innovative Optical Ophthalmic Imaging Techniques. Front Med (Lausanne) 2022; 9:891369. [PMID: 35847772 PMCID: PMC9279625 DOI: 10.3389/fmed.2022.891369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 05/23/2022] [Indexed: 11/22/2022] Open
Abstract
The field of ophthalmic imaging has grown substantially over the last years. Massive improvements in image processing and computer hardware have allowed the emergence of multiple imaging techniques of the eye that can transform patient care. The purpose of this review is to describe the most recent advances in eye imaging and explain how new technologies and imaging methods can be utilized in a clinical setting. The introduction of optical coherence tomography (OCT) was a revolution in eye imaging and has since become the standard of care for a plethora of conditions. Its most recent iterations, OCT angiography, and visible light OCT, as well as imaging modalities, such as fluorescent lifetime imaging ophthalmoscopy, would allow a more thorough evaluation of patients and provide additional information on disease processes. Toward that goal, the application of adaptive optics (AO) and full-field scanning to a variety of eye imaging techniques has further allowed the histologic study of single cells in the retina and anterior segment. Toward the goal of remote eye care and more accessible eye imaging, methods such as handheld OCT devices and imaging through smartphones, have emerged. Finally, incorporating artificial intelligence (AI) in eye images has the potential to become a new milestone for eye imaging while also contributing in social aspects of eye care.
Collapse
Affiliation(s)
- Palaiologos Alexopoulos
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Chisom Madu
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Gadi Wollstein
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
| | - Joel S. Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
- Department of Electrical and Computer Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
| |
Collapse
|
4
|
Past, present and future role of retinal imaging in neurodegenerative disease. Prog Retin Eye Res 2021; 83:100938. [PMID: 33460813 PMCID: PMC8280255 DOI: 10.1016/j.preteyeres.2020.100938] [Citation(s) in RCA: 62] [Impact Index Per Article: 20.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 12/11/2020] [Accepted: 12/17/2020] [Indexed: 02/08/2023]
Abstract
Retinal imaging technology is rapidly advancing and can provide ever-increasing amounts of information about the structure, function and molecular composition of retinal tissue in humans in vivo. Most importantly, this information can be obtained rapidly, non-invasively and in many cases using Food and Drug Administration-approved devices that are commercially available. Technologies such as optical coherence tomography have dramatically changed our understanding of retinal disease and in many cases have significantly improved their clinical management. Since the retina is an extension of the brain and shares a common embryological origin with the central nervous system, there has also been intense interest in leveraging the expanding armamentarium of retinal imaging technology to understand, diagnose and monitor neurological diseases. This is particularly appealing because of the high spatial resolution, relatively low-cost and wide availability of retinal imaging modalities such as fundus photography or OCT compared to brain imaging modalities such as magnetic resonance imaging or positron emission tomography. The purpose of this article is to review and synthesize current research about retinal imaging in neurodegenerative disease by providing examples from the literature and elaborating on limitations, challenges and future directions. We begin by providing a general background of the most relevant retinal imaging modalities to ensure that the reader has a foundation on which to understand the clinical studies that are subsequently discussed. We then review the application and results of retinal imaging methodologies to several prevalent neurodegenerative diseases where extensive work has been done including sporadic late onset Alzheimer's Disease, Parkinson's Disease and Huntington's Disease. We also discuss Autosomal Dominant Alzheimer's Disease and cerebrovascular small vessel disease, where the application of retinal imaging holds promise but data is currently scarce. Although cerebrovascular disease is not generally considered a neurodegenerative process, it is both a confounder and contributor to neurodegenerative disease processes that requires more attention. Finally, we discuss ongoing efforts to overcome the limitations in the field and unmet clinical and scientific needs.
Collapse
|
5
|
McLean JP, Hendon CP. 3-D compressed sensing optical coherence tomography using predictive coding. BIOMEDICAL OPTICS EXPRESS 2021; 12:2531-2549. [PMID: 33996246 PMCID: PMC8086477 DOI: 10.1364/boe.421848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Revised: 03/24/2021] [Accepted: 03/25/2021] [Indexed: 05/05/2023]
Abstract
We present a compressed sensing (CS) algorithm and sampling strategy for reconstructing 3-D Optical Coherence Tomography (OCT) image volumes from as little as 10% of the original data. Reconstruction using the proposed method, Denoising Predictive Coding (DN-PC), is demonstrated for five clinically relevant tissue types including human heart, retina, uterus, breast, and bovine ligament. DN-PC reconstructs the difference between adjacent b-scans in a volume and iteratively applies Gaussian filtering to improve image sparsity. An a-line sampling strategy was developed that can be easily implemented in existing Spectral-Domain OCT systems and reduce scan time by up to 90%.
Collapse
|
6
|
Daneshmand PG, Rabbani H, Mehridehnavi A. Super-Resolution of Optical Coherence Tomography Images by Scale Mixture Models. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2020; 29:5662-5676. [PMID: 32275595 DOI: 10.1109/tip.2020.2984896] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this paper, a new statistical model is proposed for the single image super-resolution of retinal Optical Coherence Tomography (OCT) images. OCT imaging relies on interfero-metry, which explains why OCT images suffer from a high level of noise. Moreover, data subsampling is carried out during the acquisition of OCT A-scans and B-scans. So, it is necessary to utilize effective super-resolution algorithms to reconstruct high-resolution clean OCT images. In this paper, a nonlocal sparse model-based Bayesian framework is proposed for OCT restoration. For this reason, by characterizing nonlocal patches with similar structures, known as a group, the sparse coefficients of each group of OCT images are modeled by the scale mixture models. In this base, the coefficient vector is decomposed into the point-wise product of a random vector and a positive scaling variable. Estimation of the sparse coefficients depends on the proposed distribution for the random vector and scaling variable where the Laplacian random vector and Generalized Extreme-Value (GEV) scale parameter (Laplacian+GEV model) show the best goodness of fit for each group of OCT images. Finally, a new OCT super-resolution method based on this new scale mixture model is introduced, where the maximum a posterior estimation of both sparse coefficients and scaling variables are calculated efficiently by applying an alternating minimization method. Our experimental results prove that the proposed OCT super-resolution method based on the Laplacian+GEV model outperforms other competing methods in terms of both subjective and objective visual qualities.
Collapse
|
7
|
Baumann B, Merkle CW, Leitgeb RA, Augustin M, Wartak A, Pircher M, Hitzenberger CK. Signal averaging improves signal-to-noise in OCT images: But which approach works best, and when? BIOMEDICAL OPTICS EXPRESS 2019; 10:5755-5775. [PMID: 31799045 PMCID: PMC6865101 DOI: 10.1364/boe.10.005755] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 09/04/2019] [Accepted: 09/26/2019] [Indexed: 05/22/2023]
Abstract
The high acquisition speed of state-of-the-art optical coherence tomography (OCT) enables massive signal-to-noise ratio (SNR) improvements by signal averaging. Here, we investigate the performance of two commonly used approaches for OCT signal averaging. We present the theoretical SNR performance of (a) computing the average of OCT magnitude data and (b) averaging the complex phasors, and substantiate our findings with simulations and experimentally acquired OCT data. We show that the achieved SNR performance strongly depends on both the SNR of the input signals and the number of averaged signals when the signal bias caused by the noise floor is not accounted for. Therefore we also explore the SNR for the two averaging approaches after correcting for the noise bias and, provided that the phases of the phasors are accurately aligned prior to averaging, then find that complex phasor averaging always leads to higher SNR than magnitude averaging.
Collapse
|
8
|
Structural and Functional Sensing of Bio-Tissues Based on Compressive Sensing Spectral Domain Optical Coherence Tomography. SENSORS 2019; 19:s19194208. [PMID: 31569799 PMCID: PMC6807266 DOI: 10.3390/s19194208] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Revised: 09/17/2019] [Accepted: 09/24/2019] [Indexed: 11/16/2022]
Abstract
In this paper, a full depth 2D CS-SDOCT approach is proposed, which combines two-dimensional (2D) compressive sensing spectral-domain optical coherence tomography (CS-SDOCT) and dispersion encoding (ED) technologies, and its applications in structural imaging and functional sensing of bio-tissues are studied. Specifically, by introducing a large dispersion mismatch between the reference arm and sample arm in SD-OCT system, the reconstruction of the under-sampled A-scan data and the removal of the conjugated images can be achieved simultaneously by only two iterations. The under-sampled B-scan data is then reconstructed using the classic CS reconstruction algorithm. For a 5 mm × 3.2 mm fish-eye image, the conjugated image was reduced by 31.4 dB using 50% × 50% sampled data (250 depth scans and 480 spectral sampling points per depth scan), and all A-scan data was reconstructed in only 1.2 s. In addition, we analyze the application performance of the CS-SDOCT in functional sensing of locally homogeneous tissue. Simulation and experimental results show that this method can correctly reconstruct the extinction coefficient spectrum under reasonable iteration times. When 8 iterations were used to reconstruct the A-scan data in the imaging experiment of fisheye, the extinction coefficient spectrum calculated using 50% × 50% data was approximately consistent with that obtained with 100% data.
Collapse
|
9
|
Liao W, Hsieh J, Wang C, Zhang W, Ai S, Peng Z, Chen Z, He B, Zhang X, Zhang N, Tang B, Xue P. Compressed sensing spectral domain optical coherence tomography with a hardware sparse-sampled camera. OPTICS LETTERS 2019; 44:2955-2958. [PMID: 31199354 DOI: 10.1364/ol.44.002955] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2019] [Accepted: 05/03/2019] [Indexed: 05/21/2023]
Abstract
We present a sparse-sampled camera for compressed sensing spectral domain optical coherence tomography (CS SD-OCT), which is mainly composed of a novel mask with specially designed coating and a commercially available CCD camera. The sparse-sampled camera under-samples the SD-OCT spectrum in hardware, thus reduces the acquired image data and can achieve faster A-scan speed than conventional CCD camera with the same pixel number. Compared with a conventional SD-OCT system, the CS SD-OCT system equipped with the sparse-sampled camera has better fall-off and SNR performance. CS-OCT imaging of bio-tissue is also demonstrated.
Collapse
|
10
|
Wang J, Hu Y, Wu J. Three-dimensional endoscopic OCT using sparse sampling with a miniature magnetic-driven scanning probe. APPLIED OPTICS 2018; 57:10056-10061. [PMID: 30645270 DOI: 10.1364/ao.57.010056] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2018] [Accepted: 10/31/2018] [Indexed: 05/21/2023]
Abstract
We propose to apply sparse sampling and compressive sensing (CS) reconstruction in three-dimensional (3D) endoscopic optical coherence tomography (OCT) to reduce the amount of data required in the imaging process. We used a homemade miniature side-imaging magnetic-driven scanning probe with an outer diameter of 1.4 mm in a 1310 nm swept-source OCT system to acquire two-dimensional (2D) circumferential cross-sectional images of an ex vivo pigeon trachea sample. 3D imaging is then achieved by reconstruction from the multiple 2D images acquired while pulling the sample with a translation stage. Given a total translation distance, we achieved sparse sampling by randomizing the step sizes of the translation stage such that the total number of the acquired 2D frames was reduced compared with conventional 3D imaging with equally spaced step positions. We tested the CS reconstruction with reduced 2D frame numbers of 40%, 60%, and 80% compared with the case of equally spaced step positions. The results show that it is possible to recover reasonable OCT images using sparse sampling with CS reconstruction. Compared with the conventional equally spaced sampling method, our method provides a novel way for image acquisition and reconstruction that could significantly reduce the amount of 3D OCT imaging data, and thus the acquisition time.
Collapse
|
11
|
Yi L, Sun L. Full-depth compressive sensing spectral-domain optical coherence tomography based on a compressive dispersion encoding method. APPLIED OPTICS 2018; 57:9316-9321. [PMID: 30461979 DOI: 10.1364/ao.57.009316] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2018] [Accepted: 10/03/2018] [Indexed: 05/21/2023]
Abstract
By combining the advantages of compressive sensing optical coherence tomography (OCT) and full-depth OCT in terms of imaging time and imaging depth, we demonstrate how compressive sampling and dispersion encoding can be simultaneously used to reconstruct a full-depth OCT image. Moreover, by considering the image processing speed, we propose a two-step compressive dispersion encoding (TCDE) method, in which a large dispersion imbalance is introduced between the reference arm and the sample arm and two iterations are performed. The first iteration selects the signals with higher intensity and then removes their conjugate items and incoherent aliasing artifacts caused by undersampling based on the least squares method. The second iteration selects the signals with lower intensity. Experimental results show that nearly the same conjugate inhibition ratio can be obtained with 50% sampled data and 100% sampled data using the TCDE method. Full-depth images of a glass slide, an onion, and a live fish eye are obtained from 50% and 100% sampled data using the TCDE method. For a 1.4 mm×3.6 mm fish eye image, the conjugate items are reduced by 33.2 and 31.7 dB using 50% sampled data and 100% sampled data, respectively.
Collapse
|
12
|
Tan B, Wong A, Bizheva K. Enhancement of morphological and vascular features in OCT images using a modified Bayesian residual transform. BIOMEDICAL OPTICS EXPRESS 2018; 9:2394-2406. [PMID: 29760996 PMCID: PMC5946797 DOI: 10.1364/boe.9.002394] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Revised: 04/19/2018] [Accepted: 04/19/2018] [Indexed: 05/05/2023]
Abstract
A novel image processing algorithm based on a modified Bayesian residual transform (MBRT) was developed for the enhancement of morphological and vascular features in optical coherence tomography (OCT) and OCT angiography (OCTA) images. The MBRT algorithm decomposes the original OCT image into multiple residual images, where each image presents information at a unique scale. Scale selective residual adaptation is used subsequently to enhance morphological features of interest, such as blood vessels and tissue layers, and to suppress irrelevant image features such as noise and motion artefacts. The performance of the proposed MBRT algorithm was tested on a series of cross-sectional and enface OCT and OCTA images of retina and brain tissue that were acquired in-vivo. Results show that the MBRT reduces speckle noise and motion-related imaging artefacts locally, thus improving significantly the contrast and visibility of morphological features in the OCT and OCTA images.
Collapse
Affiliation(s)
- Bingyao Tan
- Department of Physics and Astronomy, University of Waterloo, Ontario, N2L 3G1, Canada
- Authors contributed equally to this article
| | - Alexander Wong
- Department of System Design Engineering, University of Waterloo, Ontario, N2L 3G1, Canada
- Authors contributed equally to this article
| | - Kostadinka Bizheva
- Department of Physics and Astronomy, University of Waterloo, Ontario, N2L 3G1, Canada
- Department of System Design Engineering, University of Waterloo, Ontario, N2L 3G1, Canada
- School of Optometry and Vision Science, University of Waterloo, Ontario, N2L 3G1, Canada
| |
Collapse
|
13
|
Abbasi A, Monadjemi A, Fang L, Rabbani H. Optical coherence tomography retinal image reconstruction via nonlocal weighted sparse representation. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-11. [PMID: 29575829 DOI: 10.1117/1.jbo.23.3.036011] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2018] [Accepted: 03/06/2018] [Indexed: 06/08/2023]
Abstract
We present a nonlocal weighted sparse representation (NWSR) method for reconstruction of retinal optical coherence tomography (OCT) images. To reconstruct a high signal-to-noise ratio and high-resolution OCT images, utilization of efficient denoising and interpolation algorithms are necessary, especially when the original data were subsampled during acquisition. However, the OCT images suffer from the presence of a high level of noise, which makes the estimation of sparse representations a difficult task. Thus, the proposed NWSR method merges sparse representations of multiple similar noisy and denoised patches to better estimate a sparse representation for each patch. First, the sparse representation of each patch is independently computed over an overcomplete dictionary, and then a nonlocal weighted sparse coefficient is computed by averaging representations of similar patches. Since the sparsity can reveal relevant information from noisy patches, combining noisy and denoised patches' representations is beneficial to obtain a more robust estimate of the unknown sparse representation. The denoised patches are obtained by applying an off-the-shelf image denoising method and our method provides an efficient way to exploit information from noisy and denoised patches' representations. The experimental results on denoising and interpolation of spectral domain OCT images demonstrated the effectiveness of the proposed NWSR method over existing state-of-the-art methods.
Collapse
Affiliation(s)
- Ashkan Abbasi
- University of Isfahan, Department of Artificial Intelligence, Faculty of Computer Engineering, Isfah, Iran
| | - Amirhassan Monadjemi
- University of Isfahan, Department of Artificial Intelligence, Faculty of Computer Engineering, Isfah, Iran
| | - Leyuan Fang
- Hunan University, College of Electrical and Information Engineering, Changsha, China
| | - Hossein Rabbani
- Isfahan University of Medical Sciences, School of Advanced Technologies in Medicine, Medical Image a, Iran
| |
Collapse
|
14
|
Zhang A, Xi J, Sun J, Li X. Pixel-based speckle adjustment for noise reduction in Fourier-domain OCT images. BIOMEDICAL OPTICS EXPRESS 2017; 8:1721-1730. [PMID: 28663860 PMCID: PMC5480575 DOI: 10.1364/boe.8.001721] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2016] [Revised: 02/15/2017] [Accepted: 02/15/2017] [Indexed: 05/29/2023]
Abstract
Speckle resides in OCT signals and inevitably effects OCT image quality. In this work, we present a novel method for speckle noise reduction in Fourier-domain OCT images, which utilizes the phase information of complex OCT data. In this method, speckle area is pre-delineated pixelwise based on a phase-domain processing method and then adjusted by the results of wavelet shrinkage of the original image. Coefficient shrinkage method such as wavelet or contourlet is applied afterwards for further suppressing the speckle noise. Compared with conventional methods without speckle adjustment, the proposed method demonstrates significant improvement of image quality.
Collapse
Affiliation(s)
- Anqi Zhang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
- This work was performed when Dr. Anqi Zhang was with the Johns Hopkins University, Baltimore, MD. Currently Dr. Anqi Zhang is with PhotoniCare Inc., Champaign, IL 61820, USA
| | - Jiefeng Xi
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
| | - Jitao Sun
- Department of Mathematics, Tongji University, Shanghai, 200092, China
| | - Xingde Li
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
| |
Collapse
|
15
|
Fang L, Li S, Cunefare D, Farsiu S. Segmentation Based Sparse Reconstruction of Optical Coherence Tomography Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:407-421. [PMID: 27662673 PMCID: PMC5363080 DOI: 10.1109/tmi.2016.2611503] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
We demonstrate the usefulness of utilizing a segmentation step for improving the performance of sparsity based image reconstruction algorithms. In specific, we will focus on retinal optical coherence tomography (OCT) reconstruction and propose a novel segmentation based reconstruction framework with sparse representation, termed segmentation based sparse reconstruction (SSR). The SSR method uses automatically segmented retinal layer information to construct layer-specific structural dictionaries. In addition, the SSR method efficiently exploits patch similarities within each segmented layer to enhance the reconstruction performance. Our experimental results on clinical-grade retinal OCT images demonstrate the effectiveness and efficiency of the proposed SSR method for both denoising and interpolation of OCT images.
Collapse
|
16
|
Liu X, Zhang L, Kirby M, Becker R, Qi S, Zhao F. Iterative l(1)-min algorithm for fixed pattern noise removal in fiber-bundle-based endoscopic imaging. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2016; 33:630-6. [PMID: 27140773 DOI: 10.1364/josaa.33.000630] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
In this study, we developed a signal processing method for fixed pattern noise removal in fiber-bundle-based endoscopic imaging. We physically acquired the fixed pattern of the fiber bundle and used it as a prior image in an l1 norm minimization (l1-min) algorithm. We chose an iterative shrinkage thresholding algorithm for l1 norm minimization. In addition to fixed pattern noise removal, this method also improved image contrast while preserving spatial resolution. The effectiveness of this method was demonstrated on images obtained from a dark-field illuminated reflectance fiber-optic microscope (DRFM). The iterative l1-min algorithm presented in this paper, in combination with the DRFM system that we previously developed, enables high-resolution, high-sensitivity, intrinsic-contrast, and in situ cellular imaging which has great potential in clinical diagnosis and biomedical research.
Collapse
|
17
|
Yu H, Gao J, Li A. Probability-based non-local means filter for speckle noise suppression in optical coherence tomography images. OPTICS LETTERS 2016; 41:994-7. [PMID: 26974099 DOI: 10.1364/ol.41.000994] [Citation(s) in RCA: 43] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
In this Letter, a probability-based non-local means filter is proposed for speckle reduction in optical coherence tomography (OCT). Originally developed for additive white Gaussian noise, the non-local means filter is not suitable for multiplicative speckle noise suppression. This Letter presents a two-stage non-local means algorithm using the uncorrupted probability of each pixel to effectively reduce speckle noise in OCT. Experiments on real OCT images demonstrate that the proposed filter is competitive with other state-of-the-art speckle removal techniques and able to accurately preserve edges and structural details with small computational cost.
Collapse
|
18
|
Xu D, Huang Y, Kang JU. Volumetric (3D) compressive sensing spectral domain optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2014; 5:3921-34. [PMID: 25426320 PMCID: PMC4242027 DOI: 10.1364/boe.5.003921] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2014] [Revised: 10/01/2014] [Accepted: 10/01/2014] [Indexed: 05/21/2023]
Abstract
In this work, we proposed a novel three-dimensional compressive sensing (CS) approach for spectral domain optical coherence tomography (SD OCT) volumetric image acquisition and reconstruction. Instead of taking a spectral volume whose size is the same as that of the volumetric image, our method uses a sub set of the original spectral volume that is under-sampled in all three dimensions, which reduces the amount of spectral measurements to less than 20% of that required by the Shan-non/Nyquist theory. The 3D image is recovered from the under-sampled spectral data dimension-by-dimension using the proposed three-step CS reconstruction strategy. Experimental results show that our method can significantly reduce the sampling rate required for a volumetric SD OCT image while preserving the image quality.
Collapse
|
19
|
Xu D, Huang Y, Kang JU. Real-time dispersion-compensated image reconstruction for compressive sensing spectral domain optical coherence tomography. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2014; 31:2064-9. [PMID: 25401447 DOI: 10.1364/josaa.31.002064] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
In this work, we propose a novel dispersion compensation method that enables real-time compressive sensing (CS) spectral domain optical coherence tomography (SD OCT) image reconstruction. We show that dispersion compensation can be incorporated into CS SD OCT by multiplying the dispersion-correcting terms by the undersampled spectral data before CS reconstruction. High-quality SD OCT imaging with dispersion compensation was demonstrated at a speed in excess of 70 frames per s using 40% of the spectral measurements required by the well-known Shannon/Nyquist theory. The data processing and image display were performed on a conventional workstation having three graphics processing units.
Collapse
|
20
|
Xu D, Huang Y, Kang JU. GPU-accelerated non-uniform fast Fourier transform-based compressive sensing spectral domain optical coherence tomography. OPTICS EXPRESS 2014; 22:14871-84. [PMID: 24977582 PMCID: PMC4083058 DOI: 10.1364/oe.22.014871] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
We implemented the graphics processing unit (GPU) accelerated compressive sensing (CS) non-uniform in k-space spectral domain optical coherence tomography (SD OCT). Kaiser-Bessel (KB) function and Gaussian function are used independently as the convolution kernel in the gridding-based non-uniform fast Fourier transform (NUFFT) algorithm with different oversampling ratios and kernel widths. Our implementation is compared with the GPU-accelerated modified non-uniform discrete Fourier transform (MNUDFT) matrix-based CS SD OCT and the GPU-accelerated fast Fourier transform (FFT)-based CS SD OCT. It was found that our implementation has comparable performance to the GPU-accelerated MNUDFT-based CS SD OCT in terms of image quality while providing more than 5 times speed enhancement. When compared to the GPU-accelerated FFT based-CS SD OCT, it shows smaller background noise and less side lobes while eliminating the need for the cumbersome k-space grid filling and the k-linear calibration procedure. Finally, we demonstrated that by using a conventional desktop computer architecture having three GPUs, real-time B-mode imaging can be obtained in excess of 30 fps for the GPU-accelerated NUFFT based CS SD OCT with frame size 2048(axial) × 1,000(lateral).
Collapse
|
21
|
Xu D, Huang Y, Kang JU. Real-time compressive sensing spectral domain optical coherence tomography. OPTICS LETTERS 2014; 39:76-9. [PMID: 24365826 PMCID: PMC4114772 DOI: 10.1364/ol.39.000076] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
We developed and demonstrated real-time compressive sensing (CS) spectral domain optical coherence tomography (SD-OCT) B-mode imaging at excess of 70 fps. The system was implemented using a conventional desktop computer architecture having three graphics processing units. This result shows speed gain of 459 and 112 times compared to the best CS implementations based on the MATLAB and C++, respectively, and that real-time CS SD-OCT imaging can finally be realized.
Collapse
|
22
|
Fang L, Li S, McNabb RP, Nie Q, Kuo AN, Toth CA, Izatt JA, Farsiu S. Fast acquisition and reconstruction of optical coherence tomography images via sparse representation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:2034-49. [PMID: 23846467 PMCID: PMC4000559 DOI: 10.1109/tmi.2013.2271904] [Citation(s) in RCA: 108] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
In this paper, we present a novel technique, based on compressive sensing principles, for reconstruction and enhancement of multi-dimensional image data. Our method is a major improvement and generalization of the multi-scale sparsity based tomographic denoising (MSBTD) algorithm we recently introduced for reducing speckle noise. Our new technique exhibits several advantages over MSBTD, including its capability to simultaneously reduce noise and interpolate missing data. Unlike MSBTD, our new method does not require an a priori high-quality image from the target imaging subject and thus offers the potential to shorten clinical imaging sessions. This novel image restoration method, which we termed sparsity based simultaneous denoising and interpolation (SBSDI), utilizes sparse representation dictionaries constructed from previously collected datasets. We tested the SBSDI algorithm on retinal spectral domain optical coherence tomography images captured in the clinic. Experiments showed that the SBSDI algorithm qualitatively and quantitatively outperforms other state-of-the-art methods.
Collapse
Affiliation(s)
- Leyuan Fang
- College of Electrical and Information Engineering, Hunan
University, Changsha 410082, China, and also with the Department of
Ophthalmology, Duke University Medical Center, Durham, NC 27710 USA
| | - Shutao Li
- College of Electrical and Information Engineering, Hunan
University, Changsha 410082, China
| | - Ryan P. McNabb
- Department of Biomedical Engineering, Duke University, Durham, NC
27708 USA
| | - Qing Nie
- Department of Ophthalmology, Duke University Medical Center,
Durham, NC 27710 USA
| | - Anthony N. Kuo
- Department of Ophthalmology, Duke University Medical Center,
Durham, NC 27710 USA
| | - Cynthia A. Toth
- Department of Ophthalmology, Duke University Medical Center,
Durham, NC 27710 USA, and also with the Department of Biomedical
Engineering, Duke University, Durham, NC 27708 USA
| | - Joseph A. Izatt
- Department of Ophthalmology, Duke University Medical Center,
Durham, NC 27710 USA, and also with the Department of Biomedical
Engineering, Duke University, Durham, NC 27708 USA
| | - Sina Farsiu
- Department of Ophthalmology, Duke University Medical Center,
Durham, NC 27710 USA, and also with the Departments of Biomedical
Engineering and Electrical and Computer Engineering, Duke University,
Durham, NC 27708 USA
| |
Collapse
|
23
|
Xu D, Huang Y, Kang JU. Compressive sensing with dispersion compensation on non-linear wavenumber sampled spectral domain optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2013; 4:1519-32. [PMID: 24049674 PMCID: PMC3771824 DOI: 10.1364/boe.4.001519] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2013] [Revised: 07/12/2013] [Accepted: 07/21/2013] [Indexed: 05/21/2023]
Abstract
We propose a novel compressive sensing (CS) method on spectral domain optical coherence tomography (SDOCT). By replacing the widely used uniform discrete Fourier transform (UDFT) matrix with a new sensing matrix which is a modification of the non-uniform discrete Fourier transform (NUDFT) matrix, it is shown that undersampled non-linear wavenumber spectral data can be used directly in the CS reconstruction. Thus k-space grid filling and k-linear mask calibration which were proposed to obtain linear wavenumber sampling from the non-linear wavenumber interferometric spectra in previous studies of CS in SDOCT (CS-SDOCT) are no longer needed. The NUDFT matrix is modified to promote the sparsity of reconstructed A-scans by making them symmetric while preserving the value of the desired half. In addition, we show that dispersion compensation can be implemented by multiplying the frequency-dependent correcting phase directly to the real spectra, eliminating the need for constructing complex component of the real spectra. This enables the incorporation of dispersion compensation into the CS reconstruction by adding the correcting term to the modified NUDFT matrix. With this new sensing matrix, A-scan with dispersion compensation can be reconstructed from undersampled non-linear wavenumber spectral data by CS reconstruction. Experimental results show that proposed method can achieve high quality imaging with dispersion compensation.
Collapse
|