1
|
Yuan Z, Yang D, Zhao J, Liang Y. Enhancement of OCT en faceimages by unsupervised deep learning. Phys Med Biol 2024; 69:115042. [PMID: 38749469 DOI: 10.1088/1361-6560/ad4c52] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 05/15/2024] [Indexed: 05/31/2024]
Abstract
Objective. The quality of optical coherence tomography (OCT)en faceimages is crucial for clinical visualization of early disease. As a three dimensional and coherent imaging, defocus and speckle noise are inevitable, which seriously affect evaluation of microstructure of bio-samples in OCT images. The deep learning has demonstrated great potential in OCT refocusing and denoising, but it is limited by the difficulty of sufficient paired training data. This work aims to develop an unsupervised method to enhance the quality of OCTen faceimages.Approach. We proposed an unsupervised deep learning-based pipeline. The unregistered defocused conventional OCT images and focused speckle-free OCT images were collected by a home-made speckle modulating OCT system to construct the dataset. The image enhancement model was trained with the cycle training strategy. Finally, the speckle noise and defocus were both effectively improved.Main results. The experimental results on complex bio-samples indicated that the proposed method is effective and generalized in enhancing the quality of OCTen faceimages.Significance. The proposed unsupervised deep learning method helps to reduce the complexity of data construction, which is conducive to practical applications in OCT bio-sample imaging.
Collapse
Affiliation(s)
- Zhuoqun Yuan
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| | - Di Yang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| | - Jingzhu Zhao
- Department of Thyroid and Neck Tumor, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Yanmei Liang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| |
Collapse
|
2
|
Komninos C, Pissas T, Flores B, Bloch E, Vercauteren T, Ourselin S, Da Cruz L, Bergeles C. Unpaired intra-operative OCT (iOCT) video super-resolution with contrastive learning. BIOMEDICAL OPTICS EXPRESS 2024; 15:772-788. [PMID: 38404298 PMCID: PMC10890864 DOI: 10.1364/boe.501743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/30/2023] [Accepted: 09/22/2023] [Indexed: 02/27/2024]
Abstract
Regenerative therapies show promise in reversing sight loss caused by degenerative eye diseases. Their precise subretinal delivery can be facilitated by robotic systems alongside with Intra-operative Optical Coherence Tomography (iOCT). However, iOCT's real-time retinal layer information is compromised by inferior image quality. To address this limitation, we introduce an unpaired video super-resolution methodology for iOCT quality enhancement. A recurrent network is proposed to leverage temporal information from iOCT sequences, and spatial information from pre-operatively acquired OCT images. Additionally, a patchwise contrastive loss enables unpaired super-resolution. Extensive quantitative analysis demonstrates that our approach outperforms existing state-of-the-art iOCT super-resolution models. Furthermore, ablation studies showcase the importance of temporal aggregation and contrastive loss in elevating iOCT quality. A qualitative study involving expert clinicians also confirms this improvement. The comprehensive evaluation demonstrates our method's potential to enhance the iOCT image quality, thereby facilitating successful guidance for regenerative therapies.
Collapse
Affiliation(s)
- Charalampos Komninos
- School of Biomedical Engineering & Imaging Sciences, King’s College London, SE1 7EU, London, UK
| | - Theodoros Pissas
- School of Biomedical Engineering & Imaging Sciences, King’s College London, SE1 7EU, London, UK
| | | | | | - Tom Vercauteren
- School of Biomedical Engineering & Imaging Sciences, King’s College London, SE1 7EU, London, UK
| | - Sébastien Ourselin
- School of Biomedical Engineering & Imaging Sciences, King’s College London, SE1 7EU, London, UK
| | - Lyndon Da Cruz
- Moorfields Eye Hospital, EC1V 2PD, London, UK
- Institute of Ophthalmology, University College London, EC1V 9EL, London, UK
| | - Christos Bergeles
- School of Biomedical Engineering & Imaging Sciences, King’s College London, SE1 7EU, London, UK
| |
Collapse
|
3
|
Song K, Bian Y, Zeng F, Liu Z, Han S, Li J, Tian J, Li K, Shi X, Xiao L. Photon-level single-pixel 3D tomography with masked attention network. OPTICS EXPRESS 2024; 32:4387-4399. [PMID: 38297641 DOI: 10.1364/oe.510706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/11/2024] [Indexed: 02/02/2024]
Abstract
Tomography plays an important role in characterizing the three-dimensional structure of samples within specialized scenarios. In the paper, a masked attention network is presented to eliminate interference from different layers of the sample, substantially enhancing the resolution for photon-level single-pixel tomographic imaging. The simulation and experimental results have demonstrated that the axial resolution and lateral resolution of the imaging system can be improved by about 3 and 2 times respectively, with a sampling rate of 3.0 %. The scheme is expected to be seamlessly integrated into various tomography systems, which is conducive to promoting the tomographic imaging for biology, medicine, and materials science.
Collapse
|