1
|
Daneshmand PG, Rabbani H. Tensor Ring Decomposition Guided Dictionary Learning for OCT Image Denoising. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2547-2562. [PMID: 38393847 DOI: 10.1109/tmi.2024.3369176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2024]
Abstract
Optical coherence tomography (OCT) is a non-invasive and effective tool for the imaging of retinal tissue. However, the heavy speckle noise, resulting from multiple scattering of the light waves, obscures important morphological structures and impairs the clinical diagnosis of ocular diseases. In this paper, we propose a novel and powerful model known as tensor ring decomposition-guided dictionary learning (TRGDL) for OCT image denoising, which can simultaneously utilize two useful complementary priors, i.e., three-dimensional low-rank and sparsity priors, under a unified framework. Specifically, to effectively use the strong correlation between nearby OCT frames, we construct the OCT group tensors by extracting cubic patches from OCT images and clustering similar patches. Then, since each created OCT group tensor has a low-rank structure, to exploit spatial, non-local, and its temporal correlations in a balanced way, we enforce the TR decomposition model on each OCT group tensor. Next, to use the beneficial three-dimensional inter-group sparsity, we learn shared dictionaries in both spatial and temporal dimensions from all of the stacked OCT group tensors. Furthermore, we develop an effective algorithm to solve the resulting optimization problem by using two efficient optimization approaches, including proximal alternating minimization and the alternative direction method of multipliers. Finally, extensive experiments on OCT datasets from various imaging devices are conducted to prove the generality and usefulness of the proposed TRGDL model. Experimental simulation results show that the suggested TRGDL model outperforms state-of-the-art approaches for OCT image denoising both qualitatively and quantitatively.
Collapse
|
2
|
Cheng S, Chang S, Li Y, Novoseltseva A, Lin S, Wu Y, Zhu J, McKee AC, Rosene DL, Wang H, Bigio IJ, Boas DA, Tian L. Enhanced Multiscale Human Brain Imaging by Semi-supervised Digital Staining and Serial Sectioning Optical Coherence Tomography. RESEARCH SQUARE 2024:rs.3.rs-4014687. [PMID: 38562721 PMCID: PMC10984089 DOI: 10.21203/rs.3.rs-4014687/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
A major challenge in neuroscience is to visualize the structure of the human brain at different scales. Traditional histology reveals micro- and meso-scale brain features, but suffers from staining variability, tissue damage and distortion that impedes accurate 3D reconstructions. Here, we present a new 3D imaging framework that combines serial sectioning optical coherence tomography (S-OCT) with a deep-learning digital staining (DS) model. We develop a novel semi-supervised learning technique to facilitate DS model training on weakly paired images. The DS model performs translation from S-OCT to Gallyas silver staining. We demonstrate DS on various human cerebral cortex samples with consistent staining quality. Additionally, we show that DS enhances contrast across cortical layer boundaries. Furthermore, we showcase geometry-preserving 3D DS on cubic-centimeter tissue blocks and visualization of meso-scale vessel networks in the white matter. We believe that our technique offers the potential for high-throughput, multiscale imaging of brain tissues and may facilitate studies of brain structures.
Collapse
Affiliation(s)
- Shiyi Cheng
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Shuaibin Chang
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Yunzhe Li
- Department of Electrical Engineering and Computer Sciences, University of California, Cory Hall, Berkeley, California, 94720, USA
| | - Anna Novoseltseva
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
| | - Sunni Lin
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
| | - Yicun Wu
- Department of Computer Science, Boston University, 665 Commonwealth Ave, Boston, MA, 02215, USA
| | - Jiahui Zhu
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Ann C. McKee
- Boston University Alzheimer’s Disease Research Center and CTE Center, Boston University, Chobanian and Avedisian School of Medicine, Boston, MA, 02118, USA
- Department of Neurology, Boston University, Chobanian and Avedisian School of Medicine, Boston, MA, 02118, USA
- VA Boston Healthcare System, U.S. Department of Veteran Affairs, Jamaica Plain, MA, 02130, USA
- Department of Psychiatry and Ophthalmology, Boston University School of Medicine, Boston, MA, 02118, USA
- Department of Pathology and Laboratory Medicine, Boston University School of Medicine, Boston, MA, 02118, USA
| | - Douglas L. Rosene
- Department of Anatomy & Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, Massachusetts, USA
| | - Hui Wang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Charlestown, MA, 02129, USA
| | - Irving J. Bigio
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - David A. Boas
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - Lei Tian
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| |
Collapse
|
3
|
CHINTADA BHASKARARAO, RUIZ-LOPERA SEBASTIÁN, RESTREPO RENÉ, BOUMA BRETTE, VILLIGER MARTIN, URIBE-PATARROYO NÉSTOR. Probabilistic volumetric speckle suppression in OCT using deep learning. ARXIV 2023:arXiv:2312.04460v1. [PMID: 38106457 PMCID: PMC10723542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
We present a deep learning framework for volumetric speckle reduction in optical coherence tomography (OCT) based on a conditional generative adversarial network (cGAN) that leverages the volumetric nature of OCT data. In order to utilize the volumetric nature of OCT data, our network takes partial OCT volumes as input, resulting in artifact-free despeckled volumes that exhibit excellent speckle reduction and resolution preservation in all three dimensions. Furthermore, we address the ongoing challenge of generating ground truth data for supervised speckle suppression deep learning frameworks by using volumetric non-local means despeckling-TNode to generate training data. We show that, while TNode processing is computationally demanding, it serves as a convenient, accessible gold-standard source for training data; our cGAN replicates efficient suppression of speckle while preserving tissue structures with dimensions approaching the system resolution of non-local means despeckling while being two orders of magnitude faster than TNode. We demonstrate fast, effective, and high-quality despeckling of the proposed network in different tissue types acquired with three different OCT systems compared to existing deep learning methods. The open-source nature of our work facilitates re-training and deployment in any OCT system with an all-software implementation, working around the challenge of generating high-quality, speckle-free training data.
Collapse
Affiliation(s)
- BHASKARA RAO CHINTADA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - SEBASTIÁN RUIZ-LOPERA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - RENÉ RESTREPO
- Applied Optics Group, Universidad EAFIT, Carrera 49 # 7 Sur-50, Medellín, Colombia
| | - BRETT E. BOUMA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
- Institute of Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - MARTIN VILLIGER
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - NÉSTOR URIBE-PATARROYO
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| |
Collapse
|