1
|
Fang J, Xing A, Chen Y, Zhou F. SeqCorr-EUNet: A sequence correction dual-flow network for segmentation and quantification of anterior segment OCT image. Comput Biol Med 2024; 171:108143. [PMID: 38364662 DOI: 10.1016/j.compbiomed.2024.108143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Revised: 01/16/2024] [Accepted: 02/12/2024] [Indexed: 02/18/2024]
Abstract
The accurate segmentation of AS-OCT images is a prerequisite for the morphological details analysis of anterior segment structure and the extraction of clinical biological parameters, which play an essential role in the diagnosis, evaluation, and preoperative prognosis management of many ophthalmic diseases. Manually marking the boundaries of the anterior segment tissue is time-consuming and error-prone, with inherent speckle noise, various artifacts, and some low-quality scanned images further increasing the difficulty of the segmentation task. In this work, we propose a novel model called SeqCorr-EUNet with a dual-flow architecture based on convolutional gated recursive sequence correction for semantic segmentation and quantification of AS-OCT images. An EfficientNet encoder is employed to enhance the intra-slice features extraction ability of semantic segmentation flow. The sequence correction flow based on ConvGRU is introduced to extract inter-slice features from consecutive adjacent slices. Spatio-temporal information is fused to correct the morphological details of pre-segmentation results. And the channel attention gate is inserted into the skip-connection between encoder and decoder to enrich the contextual information and suppress the noise of irrelevant regions. Based on the segmentation results of the anterior segment structures, we achieved automatic extraction of essential clinical parameters, 3D reconstruction of the anterior chamber structure, and measurement of anterior chamber volume. The proposed SeqCorr-EUNet has been evaluated on the public AS-OCT dataset. The experimental results show that our method is competitive compared with the existing methods and significantly improves the segmentation and quantification performance of low-quality imaging structures in AS-OCT images.
Collapse
Affiliation(s)
- Jing Fang
- School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, 230601, Anhui, China.
| | - Aoyu Xing
- School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, 230601, Anhui, China.
| | - Ying Chen
- Department of Ophthalmology, Hospital of University of Science and Technology of China, Hefei, 230026, Anhui, China.
| | - Fang Zhou
- School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, 230601, Anhui, China.
| |
Collapse
|
2
|
Garcia Marin YF, Alonso-Caneiro D, Vincent SJ, Collins MJ. Anterior segment optical coherence tomography (AS-OCT) image analysis methods and applications: A systematic review. Comput Biol Med 2022; 146:105471. [DOI: 10.1016/j.compbiomed.2022.105471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 03/27/2022] [Accepted: 03/28/2022] [Indexed: 11/03/2022]
|
3
|
Wang L, Shen M, Shi C, Zhou Y, Chen Y, Pu J, Chen H. EE-Net: An edge-enhanced deep learning network for jointly identifying corneal micro-layers from optical coherence tomography. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103213] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
|
4
|
Wang L, Shen M, Chang Q, Shi C, Chen Y, Zhou Y, Zhang Y, Pu J, Chen H. Automated delineation of corneal layers on OCT images using a boundary-guided CNN. PATTERN RECOGNITION 2021; 120:108158. [PMID: 34421131 PMCID: PMC8372529 DOI: 10.1016/j.patcog.2021.108158] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Accurate segmentation of corneal layers depicted on optical coherence tomography (OCT) images is very helpful for quantitatively assessing and diagnosing corneal diseases (e.g., keratoconus and dry eye). In this study, we presented a novel boundary-guided convolutional neural network (CNN) architecture (BG-CNN) to simultaneously extract different corneal layers and delineate their boundaries. The developed BG-CNN architecture used three convolutional blocks to construct two network modules on the basis of the classical U-Net network. We trained and validated the network on a dataset consisting of 1,712 OCT images acquired on 121 subjects using a 10-fold cross-validation method. Our experiments showed an average dice similarity coefficient (DSC) of 0.9691, an intersection over union (IOU) of 0.9411, and a Hausdorff distance (HD) of 7.4423 pixels. Compared with several other classical networks, namely U-Net, Attention U-Net, Asymmetric U-Net, BiO-Net, CE-Net, CPFnte, M-Net, and Deeplabv3, on the same dataset, the developed network demonstrated a promising performance, suggesting its unique strength in segmenting corneal layers depicted on OCT images.
Collapse
Affiliation(s)
- Lei Wang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
- Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, China
- Corresponding author. (L. Wang)
| | - Meixiao Shen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Qian Chang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Ce Shi
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yang Chen
- Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, China
| | - Yuheng Zhou
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yanchun Zhang
- Department of Ophthalmology, Xi’an People’s Hospital (Xi’an Fourth Hospital), Xi’an, China
| | - Jiantao Pu
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, United States
| | - Hao Chen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
5
|
|
6
|
Liu AS, Brown DM, Conn RE, McNabb RP, Pardue MT, Kuo AN. Topography and pachymetry maps for mouse corneas using optical coherence tomography. Exp Eye Res 2020; 190:107868. [PMID: 31704241 PMCID: PMC6961820 DOI: 10.1016/j.exer.2019.107868] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 10/04/2019] [Accepted: 11/04/2019] [Indexed: 12/28/2022]
Abstract
The majority of the eye's refractive power lies in the cornea, and pathological changes in its shape can affect vision. Small animal models offer an unparalleled degree of control over genetic and environmental factors that can help elucidate mechanisms of diseases affecting corneal shape. However, there is not currently a method to characterize the corneal shape of small animal eyes with topography or pachymetry maps, as is done clinically for humans. We bridge this gap by demonstrating methods using optical coherence tomography (OCT) to generate the first topography and pachymetry (thickness) maps of mouse corneas. Radii of curvature acquired using OCT were validated using calibration spheres as well as in vivo mouse corneas with a mouse keratometer. The resulting topography and pachymetry maps are analogous to those used diagnostically in clinic and potentially allow for characterization of genetically modified mice that replicate key features of human corneal disease.
Collapse
Affiliation(s)
- Alice S Liu
- Ophthalmology, Duke University, Durham, NC, USA.
| | - Dillon M Brown
- Biomedical Engineering, Georgia Institute of Technology/Emory University, Atlanta, GA, USA
| | | | | | - Machelle T Pardue
- Biomedical Engineering, Georgia Institute of Technology/Emory University, Atlanta, GA, USA; Neuroscience, Emory University, Atlanta, GA, USA; Center for Visual and Neurocognitive Rehabilitation, Atlanta VA Healthcare System, Decatur, GA, USA
| | - Anthony N Kuo
- Ophthalmology, Duke University, Durham, NC, USA; Biomedical Engineering, Duke University, Durham, NC, USA.
| |
Collapse
|
7
|
Cabaleiro P, de Moura J, Novo J, Charlón P, Ortega M. Automatic Identification and Representation of the Cornea-Contact Lens Relationship Using AS-OCT Images. SENSORS (BASEL, SWITZERLAND) 2019; 19:s19235087. [PMID: 31766394 PMCID: PMC6929080 DOI: 10.3390/s19235087] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Revised: 11/15/2019] [Accepted: 11/18/2019] [Indexed: 06/10/2023]
Abstract
The clinical study of the cornea-contact lens relationship is widely used in the process of adaptation of the scleral contact lens (SCL) to the ocular morphology of patients. In that sense, the measurement of the adjustment between the SCL and the cornea can be used to study the comfort or potential damage that the lens may produce in the eye. The current analysis procedure implies the manual inspection of optical coherence tomography of the anterior segment images (AS-OCT) by the clinical experts. This process presents several limitations such as the inability to obtain complex metrics, the inaccuracies of the manual measurements or the requirement of a time-consuming process by the expert in a tedious process, among others. This work proposes a fully-automatic methodology for the extraction of the areas of interest in the study of the cornea-contact lens relationship and the measurement of representative metrics that allow the clinicians to measure quantitatively the adjustment between the lens and the eye. In particular, three distance metrics are herein proposed: Vertical, normal to the tangent of the region of interest and by the nearest point. Moreover, the images are classified to characterize the analysis as belonging to the central cornea, peripheral cornea, limbus or sclera (regions where the inner layer of the lens has already joined the cornea). Finally, the methodology graphically presents the results of the identified segmentations using an intuitive visualization that facilitates the analysis and diagnosis of the patients by the clinical experts.
Collapse
Affiliation(s)
- Pablo Cabaleiro
- Centro de investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain; (P.C.); (J.N.); (M.O.)
- VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, 15006 A Coruña, Spain
| | - Joaquim de Moura
- Centro de investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain; (P.C.); (J.N.); (M.O.)
- VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, 15006 A Coruña, Spain
| | - Jorge Novo
- Centro de investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain; (P.C.); (J.N.); (M.O.)
- VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, 15006 A Coruña, Spain
| | - Pablo Charlón
- Instituto Oftalmológico Victoria de Rojas, 15009 A Coruña, Spain;
- Hospital HM Rosaleda, 15701 Santiago de Compostela, Spain
| | - Marcos Ortega
- Centro de investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain; (P.C.); (J.N.); (M.O.)
- VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, 15006 A Coruña, Spain
| |
Collapse
|
8
|
Ouyang J, Mathai TS, Lathrop K, Galeotti J. Accurate tissue interface segmentation via adversarial pre-segmentation of anterior segment OCT images. BIOMEDICAL OPTICS EXPRESS 2019; 10:5291-5324. [PMID: 31646047 PMCID: PMC6788614 DOI: 10.1364/boe.10.005291] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2019] [Revised: 07/10/2019] [Accepted: 07/10/2019] [Indexed: 05/24/2023]
Abstract
Optical Coherence Tomography (OCT) is an imaging modality that has been widely adopted for visualizing corneal, retinal and limbal tissue structure with micron resolution. It can be used to diagnose pathological conditions of the eye, and for developing pre-operative surgical plans. In contrast to the posterior retina, imaging the anterior tissue structures, such as the limbus and cornea, results in B-scans that exhibit increased speckle noise patterns and imaging artifacts. These artifacts, such as shadowing and specularity, pose a challenge during the analysis of the acquired volumes as they substantially obfuscate the location of tissue interfaces. To deal with the artifacts and speckle noise patterns and accurately segment the shallowest tissue interface, we propose a cascaded neural network framework, which comprises of a conditional Generative Adversarial Network (cGAN) and a Tissue Interface Segmentation Network (TISN). The cGAN pre-segments OCT B-scans by removing undesired specular artifacts and speckle noise patterns just above the shallowest tissue interface, and the TISN combines the original OCT image with the pre-segmentation to segment the shallowest interface. We show the applicability of the cascaded framework to corneal datasets, demonstrate that it precisely segments the shallowest corneal interface, and also show its generalization capacity to limbal datasets. We also propose a hybrid framework, wherein the cGAN pre-segmentation is passed to a traditional image analysis-based segmentation algorithm, and describe the improved segmentation performance. To the best of our knowledge, this is the first approach to remove severe specular artifacts and speckle noise patterns (prior to the shallowest interface) that affects the interpretation of anterior segment OCT datasets, thereby resulting in the accurate segmentation of the shallowest tissue interface. To the best of our knowledge, this is the first work to show the potential of incorporating a cGAN into larger deep learning frameworks for improved corneal and limbal OCT image segmentation. Our cGAN design directly improves the visualization of corneal and limbal OCT images from OCT scanners, and improves the performance of current OCT segmentation algorithms.
Collapse
Affiliation(s)
- Jiahong Ouyang
- The Robotics Institute, Carnegie Mellon University, PA 15213, USA
- Equal contribution
| | | | - Kira Lathrop
- Department of Bioengineering, University of Pittsburgh, PA 15213, USA
- Department of Ophthalmology, University of Pittsburgh, PA 15213, USA
| | - John Galeotti
- The Robotics Institute, Carnegie Mellon University, PA 15213, USA
- Department of Bioengineering, University of Pittsburgh, PA 15213, USA
| |
Collapse
|
9
|
Rose JS, Eldrina J, Joshua A, Amalan S, Sebastian T, Solomon S, Korah S. Objective quantification of corneal haziness using anterior segment optical coherence tomography. J Curr Ophthalmol 2018; 30:54-57. [PMID: 29564409 PMCID: PMC5859339 DOI: 10.1016/j.joco.2017.08.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2017] [Revised: 06/27/2017] [Accepted: 08/01/2017] [Indexed: 11/29/2022] Open
Abstract
Purpose To quantify normal corneal transparency by anterior segment optical coherence tomography (AS-OCT) by measuring the average pixel intensity. To analyze the variation in the average pixel intensity in mild and severe grades of corneal opacities. Methods This is an observational, cross-sectional study of 38 eyes from 19 patients with mild or severe grades of corneal opacities greater than 3 mm and a normal contralateral cornea. AS-OCT was performed centered on the opacity with a 3 mm cruciate protocol. A similar image is taken of the contralateral clear cornea in the same quadrant. The average pixel intensity was calculated in a standardized manner using MATLAB software. Result The average pixel intensity of the normal cornea was 99.6 ± 10.9 [standard deviation (SD)]. The average pixel intensity of the mild and severe corneal opacities was 115.5 ± 9.1 and 141.1 ± 10.3, respectively. The differences were statistically significant. Conclusions AS-OCT images can be used to quantify corneal transparency. Average pixel intensity is a measure that varies significantly with varying corneal opacification.
Collapse
Affiliation(s)
| | - Juliet Eldrina
- Department of Ophthalmology, Christian Medical College, Vellore, India
| | - Aarwin Joshua
- Center for Stem Cell Research, Christian Medical College, Vellore, India
| | - S Amalan
- Department of Bioengineering, Christian Medical College, Vellore, India
| | - Tunny Sebastian
- Department of Biostatistics, Christian Medical College, Vellore, India
| | - Satheesh Solomon
- Department of Ophthalmology, Christian Medical College, Vellore, India
| | - Sanita Korah
- Department of Ophthalmology, Christian Medical College, Vellore, India
| |
Collapse
|
10
|
Thrimawithana TR, Rupenthal ID, Räsch SS, Lim JC, Morton JD, Bunt CR. Drug delivery to the lens for the management of cataracts. Adv Drug Deliv Rev 2018; 126:185-194. [PMID: 29604375 DOI: 10.1016/j.addr.2018.03.009] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 03/02/2018] [Accepted: 03/20/2018] [Indexed: 11/16/2022]
Abstract
Cataracts are one of the most prevalent diseases of the lens, affecting its transparency and are the leading cause of reversible blindness in the world. The clarity of the lens is essential for its normal physiological function of refracting light onto the retina. Currently there is no pharmaceutical treatment for prevention or cure of cataracts and surgery to replace the affected lens remains the gold standard in the management of cataracts. Pharmacological treatment for prevention of cataracts is hindered by many physiological barriers that must be overcome by a therapeutic agent to reach the avascular lens. Various therapeutic agents and formulation strategies are currently being investigated to prevent cataract formation as access to surgery is limited. This review provides a summary of recent research in the field of drug delivery to the lens for the management of cataracts including models used to study cataract treatments and discusses the future perspectives in the field.
Collapse
Affiliation(s)
- Thilini R Thrimawithana
- Discipline of Pharmacy, School Health and Biomedical Sciences, RMIT University, Bundoora, VIC 3083, Australia.
| | - Ilva D Rupenthal
- Buchanan Ocular Therapeutics Unit, Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, The University of Auckland, Private Bag 92019, Auckland 1142, New Zealand
| | - Simon S Räsch
- Buchanan Ocular Therapeutics Unit, Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, The University of Auckland, Private Bag 92019, Auckland 1142, New Zealand
| | - Julie C Lim
- Department of Physiology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, The University of Auckland, Private Bag 92019, Auckland 1142, New Zealand
| | - James D Morton
- Faculty of Agricultural Sciences, Lincoln University, P O Box 85084, New Zealand
| | - Craig R Bunt
- Faculty of Agricultural Sciences, Lincoln University, P O Box 85084, New Zealand
| |
Collapse
|
11
|
Pekel G, Özbakış F, Bahar A, Pekel E, Çetin EN. Correlations of Corneal Optical Densitometry, Endothelial Hexagonality Percentage, and Epithelium Thickness. Curr Eye Res 2017; 43:170-174. [DOI: 10.1080/02713683.2017.1387271] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Gökhan Pekel
- Pamukkale University, Ophthalmology Department, Denizli, Turkey
| | - Fatih Özbakış
- Pamukkale University, Ophthalmology Department, Denizli, Turkey
| | - Alperen Bahar
- Pamukkale University, Ophthalmology Department, Denizli, Turkey
| | - Evre Pekel
- Eye Clinic, Denizli State Hospital, Denizli, Turkey
| | | |
Collapse
|
12
|
Isfahan MISP Dataset. JOURNAL OF MEDICAL SIGNALS AND SENSORS 2017; 7:43-48. [PMID: 28487832 PMCID: PMC5394805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
An online depository was introduced to share clinical ground truth with the public and provide open access for researchers to evaluate their computer-aided algorithms. PHP was used for web programming and MySQL for database managing. The website was entitled "biosigdata.com." It was a fast, secure, and easy-to-use online database for medical signals and images. Freely registered users could download the datasets and could also share their own supplementary materials while maintaining their privacies (citation and fee). Commenting was also available for all datasets, and automatic sitemap and semi-automatic SEO indexing have been set for the site. A comprehensive list of available websites for medical datasets is also presented as a Supplementary (http://journalonweb.com/tempaccess/4800.584.JMSS_55_16I3253.pdf).
Collapse
|