1
|
Zheng Q, Li Z, Zhang J, Mei C, Li G, Wang L. Automated segmentation of palpebral fissures from eye videography using a texture fusion neural network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2023]
|
2
|
Zheng Q, Zhang X, Zhang J, Bai F, Huang S, Pu J, Chen W, Wang L. A texture-aware U-Net for identifying incomplete blinking from eye videography. Biomed Signal Process Control 2022; 75. [DOI: 10.1016/j.bspc.2022.103630] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
3
|
Shi C, Zhang J, Zhang X, Shen M, Chen H, Wang L. A recurrent skip deep learning network for accurate image segmentation. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103533] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
4
|
Wang L, Shen M, Shi C, Zhou Y, Chen Y, Pu J, Chen H. EE-Net: An edge-enhanced deep learning network for jointly identifying corneal micro-layers from optical coherence tomography. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103213] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
|
5
|
Wang L, Shen M, Chang Q, Shi C, Chen Y, Zhou Y, Zhang Y, Pu J, Chen H. Automated delineation of corneal layers on OCT images using a boundary-guided CNN. PATTERN RECOGNITION 2021; 120:108158. [PMID: 34421131 PMCID: PMC8372529 DOI: 10.1016/j.patcog.2021.108158] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Accurate segmentation of corneal layers depicted on optical coherence tomography (OCT) images is very helpful for quantitatively assessing and diagnosing corneal diseases (e.g., keratoconus and dry eye). In this study, we presented a novel boundary-guided convolutional neural network (CNN) architecture (BG-CNN) to simultaneously extract different corneal layers and delineate their boundaries. The developed BG-CNN architecture used three convolutional blocks to construct two network modules on the basis of the classical U-Net network. We trained and validated the network on a dataset consisting of 1,712 OCT images acquired on 121 subjects using a 10-fold cross-validation method. Our experiments showed an average dice similarity coefficient (DSC) of 0.9691, an intersection over union (IOU) of 0.9411, and a Hausdorff distance (HD) of 7.4423 pixels. Compared with several other classical networks, namely U-Net, Attention U-Net, Asymmetric U-Net, BiO-Net, CE-Net, CPFnte, M-Net, and Deeplabv3, on the same dataset, the developed network demonstrated a promising performance, suggesting its unique strength in segmenting corneal layers depicted on OCT images.
Collapse
Affiliation(s)
- Lei Wang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
- Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, China
- Corresponding author. (L. Wang)
| | - Meixiao Shen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Qian Chang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Ce Shi
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yang Chen
- Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, China
| | - Yuheng Zhou
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yanchun Zhang
- Department of Ophthalmology, Xi’an People’s Hospital (Xi’an Fourth Hospital), Xi’an, China
| | - Jiantao Pu
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, United States
| | - Hao Chen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
6
|
Cai Q, Qian Y, Zhou S, Li J, Yang YH, Wu F, Zhang D. AVLSM: Adaptive Variational Level Set Model for Image Segmentation in the Presence of Severe Intensity Inhomogeneity and High Noise. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2021; 31:43-57. [PMID: 34793300 DOI: 10.1109/tip.2021.3127848] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Intensity inhomogeneity and noise are two common issues in images but inevitably lead to significant challenges for image segmentation and is particularly pronounced when the two issues simultaneously appear in one image. As a result, most existing level set models yield poor performance when applied to this images. To this end, this paper proposes a novel hybrid level set model, named adaptive variational level set model (AVLSM) by integrating an adaptive scale bias field correction term and a denoising term into one level set framework, which can simultaneously correct the severe inhomogeneous intensity and denoise in segmentation. Specifically, an adaptive scale bias field correction term is first defined to correct the severe inhomogeneous intensity by adaptively adjusting the scale according to the degree of intensity inhomogeneity while segmentation. More importantly, the proposed adaptive scale truncation function in the term is model-agnostic, which can be applied to most off-the-shelf models and improves their performance for image segmentation with severe intensity inhomogeneity. Then, a denoising energy term is constructed based on the variational model, which can remove not only common additive noise but also multiplicative noise often occurred in medical image during segmentation. Finally, by integrating the two proposed energy terms into a variational level set framework, the AVLSM is proposed. The experimental results on synthetic and real images demonstrate the superiority of AVLSM over most state-of-the-art level set models in terms of accuracy, robustness and running time.
Collapse
|
7
|
Weng G, Dong B. A new active contour model driven by pre-fitting bias field estimation and clustering technique for image segmentation. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2021; 104:104299. [DOI: 10.1016/j.engappai.2021.104299] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
8
|
A survey on regional level set image segmentation models based on the energy functional similarity measure. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.07.141] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
9
|
Wang L, Gu J, Chen Y, Liang Y, Zhang W, Pu J, Chen H. Automated segmentation of the optic disc from fundus images using an asymmetric deep learning network. PATTERN RECOGNITION 2021; 112:107810. [PMID: 34354302 PMCID: PMC8336919 DOI: 10.1016/j.patcog.2020.107810] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Accurate segmentation of the optic disc (OD) regions from color fundus images is a critical procedure for computer-aided diagnosis of glaucoma. We present a novel deep learning network to automatically identify the OD regions. On the basis of the classical U-Net framework, we define a unique sub-network and a decoding convolutional block. The sub-network is used to preserve important textures and facilitate their detections, while the decoding block is used to improve the contrast of the regions-of-interest with their background. We integrate these two components into the classical U-Net framework to improve the accuracy and reliability of segmenting the OD regions depicted on color fundus images. We train and evaluate the developed network using three publicly available datasets (i.e., MESSIDOR, ORIGA, and REFUGE). The results on an independent testing set (n=1,970 images) show a segmentation performance with an average Dice similarity coefficient (DSC), intersection over union (IOU), and Matthew's correlation coefficient (MCC) of 0.9377, 0.8854, and 0.9383 when trained on the global field-of-view images, respectively, and 0.9735, 0.9494, and 0.9594 when trained on the local disc region images. When compared with the other three classical networks (i.e., the U-Net, M-Net, and Deeplabv3) on the same testing datasets, the developed network demonstrates a relatively higher performance.
Collapse
Affiliation(s)
- Lei Wang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
- Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 211189, China
| | - Juan Gu
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| | - Yize Chen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| | - Yuanbo Liang
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| | - Weijie Zhang
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Jiantao Pu
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Hao Chen
- School of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| |
Collapse
|
10
|
A hybrid active contour model for ultrasound image segmentation. Soft comput 2020. [DOI: 10.1007/s00500-020-05097-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
11
|
A coarse-to-fine deep learning framework for optic disc segmentation in fundus images. Biomed Signal Process Control 2019; 51:82-89. [PMID: 33850515 DOI: 10.1016/j.bspc.2019.01.022] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Accurate segmentation of the optic disc (OD) depicted on color fundus images may aid in the early detection and quantitative diagnosis of retinal diseases, such as glaucoma and optic atrophy. In this study, we proposed a coarse-to-fine deep learning framework on the basis of a classical convolutional neural network (CNN), known as the U-net model, to accurately identify the optic disc. This network was trained separately on color fundus images and their grayscale vessel density maps, leading to two different segmentation results from the entire image. We combined the results using an overlap strategy to identify a local image patch (disc candidate region), which was then fed into the U-net model for further segmentation. Our experiments demonstrated that the developed framework achieved an average intersection over union (IoU) and a dice similarity coefficient (DSC) of 89.1% and 93.9%, respectively, based on 2,978 test images from our collected dataset and six public datasets, as compared to 87.4% and 92.5% obtained by only using the sole U-net model. The comparison with available approaches demonstrated a reliable and relatively high performance of the proposed deep learning framework in automated OD segmentation.
Collapse
|
12
|
Wang L, Chen G, Shi D, Chang Y, Chan S, Pu J, Yang X. Active contours driven by edge entropy fitting energy for image segmentation. SIGNAL PROCESSING 2018; 149:27-35. [PMID: 31289417 PMCID: PMC6615709 DOI: 10.1016/j.sigpro.2018.02.025] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Active contour models have been widely used for image segmentation purposes. However, they may fail to delineate objects of interest depicted on images with intensity inhomogeneity. To resolve this issue, a novel image feature, termed as local edge entropy, is proposed in this study to reduce the negative impact of inhomogeneity on image segmentation. An active contour model is developed on the basis of this feature, where an edge entropy fitting (EEF) energy is defined with the combination of a redesigned regularization term. Minimizing the energy in a variational level set formulation can successfully drive the motion of an initial contour curve towards optimal object boundaries. Experiments on a number of test images demonstrate that the proposed model has the capability of handling intensity inhomogeneity with reasonable segmentation accuracy.
Collapse
Affiliation(s)
- Lei Wang
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, USA
| | - Guangqiang Chen
- Department of Radiology, The Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Dai Shi
- Department of Radiology, The Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Yan Chang
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China
| | - Sixian Chan
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
| | - Jiantao Pu
- Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, USA
| | - Xiaodong Yang
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China
| |
Collapse
|
13
|
Kharma N, Mazhurin A, Saigol K, Sabahi F. Adaptable image segmentation via simple pixel classification. Comput Intell 2018. [DOI: 10.1111/coin.12173] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Affiliation(s)
- Nawwaf Kharma
- Department of Electrical and Computer Engineering; Concordia University; Montréal QC Canada
| | | | - Kamil Saigol
- Institute for Robotics and Intelligent Machines; Georgia Institute of Technology; Atlanta GA USA
| | - Farzad Sabahi
- Department of Electrical and Computer Engineering; Concordia University; Montréal QC Canada
| |
Collapse
|