1
|
Matloob Abbasi M, Iqbal S, Aurangzeb K, Alhussein M, Khan TM. LMBiS-Net: A lightweight bidirectional skip connection based multipath CNN for retinal blood vessel segmentation. Sci Rep 2024; 14:15219. [PMID: 38956117 PMCID: PMC11219784 DOI: 10.1038/s41598-024-63496-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 05/29/2024] [Indexed: 07/04/2024] Open
Abstract
Blinding eye diseases are often related to changes in retinal structure, which can be detected by analysing retinal blood vessels in fundus images. However, existing techniques struggle to accurately segment these delicate vessels. Although deep learning has shown promise in medical image segmentation, its reliance on specific operations can limit its ability to capture crucial details such as the edges of the vessel. This paper introduces LMBiS-Net, a lightweight convolutional neural network designed for the segmentation of retinal vessels. LMBiS-Net achieves exceptional performance with a remarkably low number of learnable parameters (only 0.172 million). The network used multipath feature extraction blocks and incorporates bidirectional skip connections for the information flow between the encoder and decoder. In addition, we have optimised the efficiency of the model by carefully selecting the number of filters to avoid filter overlap. This optimisation significantly reduces training time and improves computational efficiency. To assess LMBiS-Net's robustness and ability to generalise to unseen data, we conducted comprehensive evaluations on four publicly available datasets: DRIVE, STARE, CHASE_DB1, and HRF The proposed LMBiS-Net achieves significant performance metrics in various datasets. It obtains sensitivity values of 83.60%, 84.37%, 86.05%, and 83.48%, specificity values of 98.83%, 98.77%, 98.96%, and 98.77%, accuracy (acc) scores of 97.08%, 97.69%, 97.75%, and 96.90%, and AUC values of 98.80%, 98.82%, 98.71%, and 88.77% on the DRIVE, STARE, CHEASE_DB, and HRF datasets, respectively. In addition, it records F1 scores of 83.43%, 84.44%, 83.54%, and 78.73% on the same datasets. Our evaluations demonstrate that LMBiS-Net achieves high segmentation accuracy (acc) while exhibiting both robustness and generalisability across various retinal image datasets. This combination of qualities makes LMBiS-Net a promising tool for various clinical applications.
Collapse
Affiliation(s)
- Mufassir Matloob Abbasi
- Department of Electrical Engineering, Abasyn University Islamabad Campus (AUIC), Islamabad, 44000, Pakistan
| | - Shahzaib Iqbal
- Department of Electrical Engineering, Abasyn University Islamabad Campus (AUIC), Islamabad, 44000, Pakistan.
| | - Khursheed Aurangzeb
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, P. O. Box 51178, 11543, Saudi Arabia
| | - Musaed Alhussein
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, P. O. Box 51178, 11543, Saudi Arabia
| | - Tariq M Khan
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
2
|
Ye Z, Liu Y, Jing T, He Z, Zhou L. A High-Resolution Network with Strip Attention for Retinal Vessel Segmentation. SENSORS (BASEL, SWITZERLAND) 2023; 23:8899. [PMID: 37960597 PMCID: PMC10650600 DOI: 10.3390/s23218899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 10/27/2023] [Accepted: 10/30/2023] [Indexed: 11/15/2023]
Abstract
Accurate segmentation of retinal vessels is an essential prerequisite for the subsequent analysis of fundus images. Recently, a number of methods based on deep learning have been proposed and shown to demonstrate promising segmentation performance, especially U-Net and its variants. However, tiny vessels and low-contrast vessels are hard to detect due to the issues of a loss of spatial details caused by consecutive down-sample operations and inadequate fusion of multi-level features caused by vanilla skip connections. To address these issues and enhance the segmentation precision of retinal vessels, we propose a novel high-resolution network with strip attention. Instead of the U-Net-shaped architecture, the proposed network follows an HRNet-shaped architecture as the basic network, learning high-resolution representations throughout the training process. In addition, a strip attention module including a horizontal attention mechanism and a vertical attention mechanism is designed to obtain long-range dependencies in the horizontal and vertical directions by calculating the similarity between each pixel and all pixels in the same row and the same column, respectively. For effective multi-layer feature fusion, we incorporate the strip attention module into the basic network to dynamically guide adjacent hierarchical features. Experimental results on the DRIVE and STARE datasets show that the proposed method can extract more tiny vessels and low-contrast vessels compared with existing mainstream methods, achieving accuracies of 96.16% and 97.08% and sensitivities of 82.68% and 89.36%, respectively. The proposed method has the potential to aid in the analysis of fundus images.
Collapse
Affiliation(s)
- Zhipin Ye
- Research Center of Fluid Machinery Engineering & Technology, Jiangsu University, Zhenjiang 212013, China
| | - Yingqian Liu
- Research Center of Fluid Machinery Engineering & Technology, Jiangsu University, Zhenjiang 212013, China
| | - Teng Jing
- Research Center of Fluid Machinery Engineering & Technology, Jiangsu University, Zhenjiang 212013, China
| | - Zhaoming He
- Department of Mechanical Engineering, Texas Tech University, Lubbock, TX 79411, USA
| | - Ling Zhou
- Research Center of Fluid Machinery Engineering & Technology, Jiangsu University, Zhenjiang 212013, China
| |
Collapse
|
3
|
Huang Y, Deng T. Multi-level spatial-temporal and attentional information deep fusion network for retinal vessel segmentation. Phys Med Biol 2023; 68:195026. [PMID: 37567227 DOI: 10.1088/1361-6560/acefa0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 08/11/2023] [Indexed: 08/13/2023]
Abstract
Objective.Automatic segmentation of fundus vessels has the potential to enhance the judgment ability of intelligent disease diagnosis systems. Even though various methods have been proposed, it is still a demanding task to accurately segment the fundus vessels. The purpose of our study is to develop a robust and effective method to segment the vessels in human color retinal fundus images.Approach.We present a novel multi-level spatial-temporal and attentional information deep fusion network for the segmentation of retinal vessels, called MSAFNet, which enhances segmentation performance and robustness. Our method utilizes the multi-level spatial-temporal encoding module to obtain spatial-temporal information and the Self-Attention module to capture feature correlations in different levels of our network. Based on the encoder and decoder structure, we combine these features to get the final segmentation results.Main results.Through abundant experiments on four public datasets, our method achieves preferable performance compared with other SOTA retinal vessel segmentation methods. Our Accuracy and Area Under Curve achieve the highest scores of 96.96%, 96.57%, 96.48% and 98.78%, 98.54%, 98.27% on DRIVE, CHASE_DB1, and HRF datasets. Our Specificity achieves the highest score of 98.58% and 99.08% on DRIVE and STARE datasets.Significance.The experimental results demonstrate that our method has strong learning and representation capabilities and can accurately detect retinal blood vessels, thereby serving as a potential tool for assisting in diagnosis.
Collapse
Affiliation(s)
- Yi Huang
- School of Information Science and Technology, Southwest Jiaotong University, 611756, Chengdu, People's Republic of China
| | - Tao Deng
- School of Information Science and Technology, Southwest Jiaotong University, 611756, Chengdu, People's Republic of China
| |
Collapse
|
4
|
Ryu J, Rehman MU, Nizami IF, Chong KT. SegR-Net: A deep learning framework with multi-scale feature fusion for robust retinal vessel segmentation. Comput Biol Med 2023; 163:107132. [PMID: 37343468 DOI: 10.1016/j.compbiomed.2023.107132] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/12/2023] [Accepted: 06/04/2023] [Indexed: 06/23/2023]
Abstract
Retinal vessel segmentation is an important task in medical image analysis and has a variety of applications in the diagnosis and treatment of retinal diseases. In this paper, we propose SegR-Net, a deep learning framework for robust retinal vessel segmentation. SegR-Net utilizes a combination of feature extraction and embedding, deep feature magnification, feature precision and interference, and dense multiscale feature fusion to generate accurate segmentation masks. The model consists of an encoder module that extracts high-level features from the input images and a decoder module that reconstructs the segmentation masks by combining features from the encoder module. The encoder module consists of a feature extraction and embedding block that enhances by dense multiscale feature fusion, followed by a deep feature magnification block that magnifies the retinal vessels. To further improve the quality of the extracted features, we use a group of two convolutional layers after each DFM block. In the decoder module, we utilize a feature precision and interference block and a dense multiscale feature fusion block (DMFF) to combine features from the encoder module and reconstruct the segmentation mask. We also incorporate data augmentation and pre-processing techniques to improve the generalization of the trained model. Experimental results on three fundus image publicly available datasets (CHASE_DB1, STARE, and DRIVE) demonstrate that SegR-Net outperforms state-of-the-art models in terms of accuracy, sensitivity, specificity, and F1 score. The proposed framework can provide more accurate and more efficient segmentation of retinal blood vessels in comparison to the state-of-the-art techniques, which is essential for clinical decision-making and diagnosis of various eye diseases.
Collapse
Affiliation(s)
- Jihyoung Ryu
- Electronics and Telecommunications Research Institute, 176-11 Cheomdan Gwagi-ro, Buk-gu, Gwangju 61012, Republic of Korea.
| | - Mobeen Ur Rehman
- Department of Electronics and Information Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea.
| | - Imran Fareed Nizami
- Department of Electrical Engineering, Bahria University, Islamabad, Pakistan.
| | - Kil To Chong
- Electronics and Telecommunications Research Institute, 176-11 Cheomdan Gwagi-ro, Buk-gu, Gwangju 61012, Republic of Korea; Advances Electronics and Information Research Center, Jeonbuk National University, Jeonju 54896, Republic of Korea.
| |
Collapse
|
5
|
GDF-Net: A multi-task symmetrical network for retinal vessel segmentation. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
6
|
Kumar KS, Singh NP. An efficient registration-based approach for retinal blood vessel segmentation using generalized Pareto and fatigue pdf. Med Eng Phys 2022; 110:103936. [PMID: 36529622 DOI: 10.1016/j.medengphy.2022.103936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/05/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
Segmentation of Retinal Blood Vessel (RBV) extraction in the retina images and Registration of segmented RBV structure is implemented to identify changes in vessel structure by ophthalmologists in diagnosis of various illnesses like Glaucoma, Diabetes, and Hypertension's. The Retinal Blood Vessel provides blood to the inner retinal neurons, RBV are located mainly in internal retina but it may partly in the ganglion cell layer, following network failure haven't been identified with past methods. Classifications of accurate RBV and Registration of segmented blood vessels are challenging tasks in the low intensity background of Retinal Image. So, we projected a novel approach of segmentation of RBV extraction used matched filter of Generalized Pareto Probability Distribution Function (pdf) and Registration approach on feature-based segmented retinal blood vessel of Binary Robust Invariant Scalable Key point (BRISK). The BRISK provides the predefined sampling pattern as compared to Pdf. The BRISK feature is implemented for attention point recognition & matching approach for change in vessel structure. The proposed approaches contain 3 levels: pre-processing, matched filter-based Generalized Pareto pdf as a source along with the novel approach of fatigue pdf as a target, and BRISK framework is used for Registration on segmented retinal images of supply & intention images. This implemented system's performance is estimated in experimental analysis by the Average accuracy, Normalized Cross-Correlation (NCC), and computation time process of the segmented retinal source and target image. The NCC is main element to give more statistical information about retinal image segmentation. The proposed approach of Generalized Pareto value pdf has Average Accuracy of 95.21%, NCC of both image pairs is 93%, and Average accuracy of Registration of segmented source images and the target image is 98.51% respectively. The proposed approach of average computational time taken is around 1.4 s, which has been identified on boundary condition of Pdf function.
Collapse
Affiliation(s)
- K Susheel Kumar
- GITAM University, Bengaluru, 561203, India; National Institute of Technology Hamirpur, Himachal Pradesh 177005, India.
| | | |
Collapse
|
7
|
Biswas S, Khan MIA, Hossain MT, Biswas A, Nakai T, Rohdin J. Which Color Channel Is Better for Diagnosing Retinal Diseases Automatically in Color Fundus Photographs? LIFE (BASEL, SWITZERLAND) 2022; 12:life12070973. [PMID: 35888063 PMCID: PMC9321111 DOI: 10.3390/life12070973] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 05/25/2022] [Accepted: 06/01/2022] [Indexed: 11/22/2022]
Abstract
Color fundus photographs are the most common type of image used for automatic diagnosis of retinal diseases and abnormalities. As all color photographs, these images contain information about three primary colors, i.e., red, green, and blue, in three separate color channels. This work aims to understand the impact of each channel in the automatic diagnosis of retinal diseases and abnormalities. To this end, the existing works are surveyed extensively to explore which color channel is used most commonly for automatically detecting four leading causes of blindness and one retinal abnormality along with segmenting three retinal landmarks. From this survey, it is clear that all channels together are typically used for neural network-based systems, whereas for non-neural network-based systems, the green channel is most commonly used. However, from the previous works, no conclusion can be drawn regarding the importance of the different channels. Therefore, systematic experiments are conducted to analyse this. A well-known U-shaped deep neural network (U-Net) is used to investigate which color channel is best for segmenting one retinal abnormality and three retinal landmarks.
Collapse
Affiliation(s)
- Sangeeta Biswas
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
- Correspondence: or
| | - Md. Iqbal Aziz Khan
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
| | - Md. Tanvir Hossain
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
| | - Angkan Biswas
- CAPM Company Limited, Bonani, Dhaka 1213, Bangladesh;
| | - Takayoshi Nakai
- Faculty of Engineering, Shizuoka University, Hamamatsu 432-8561, Japan;
| | - Johan Rohdin
- Faculty of Information Technology, Brno University of Technology, 61200 Brno, Czech Republic;
| |
Collapse
|
8
|
Shi W, Xu T, Yang H, Xi Y, Du Y, Li J, Li J. Attention Gate based dual-pathway Network for Vertebra Segmentation of X-ray Spine images. IEEE J Biomed Health Inform 2022; 26:3976-3987. [PMID: 35290194 DOI: 10.1109/jbhi.2022.3158968] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Automatic spine and vertebra segmentation from X-ray spine images is a critical and challenging problem in many computer-aid spinal image analysis and disease diagnosis applications. In this paper, a two-stage automatic segmentation framework for spine X-ray images is proposed, which can firstly locate the spine regions (including backbone, sacrum and illum) in the coarse stage and then identify eighteen vertebrae (i.e., cervical vertebra 1, thoracic vertebra 1-12 and lumbar vertebra 1-5) with isolate and clear boundary in the fine stage. A novel Attention Gate based dual-pathway Network (AGNet) composed of context and edge pathways is designed to extract semantic and boundary information for segmentation of both spine and vertebra regions. Multi-scale supervision mechanism is applied to explore comprehensive features and an Edge aware Fusion Mechanism (EFM) is proposed to fuse features extracted from the two pathways. Some other image processing skills, such as centralized backbone clipping, patch cropping and convex hull detection are introduced to further refine the vertebra segmentation results. Experimental validations on spine X-ray images dataset and vertebrae dataset suggest that the proposed AGNet achieves superior performance compared with state-of-the-art segmentation methods, and the coarse-to-fine framework can be implemented in real spinal diagnosis systems.
Collapse
|
9
|
Kovács G, Fazekas A. A new baseline for retinal vessel segmentation: Numerical identification and correction of methodological inconsistencies affecting 100+ papers. Med Image Anal 2021; 75:102300. [PMID: 34814057 DOI: 10.1016/j.media.2021.102300] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Revised: 09/20/2021] [Accepted: 11/04/2021] [Indexed: 12/18/2022]
Abstract
In the last 15 years, the segmentation of vessels in retinal images has become an intensively researched problem in medical imaging, with hundreds of algorithms published. One of the de facto benchmarking data sets of vessel segmentation techniques is the DRIVE data set. Since DRIVE contains a predefined split of training and test images, the published performance results of the various segmentation techniques should provide a reliable ranking of the algorithms. Including more than 100 papers in the study, we performed a detailed numerical analysis of the coherence of the published performance scores. We found inconsistencies in the reported scores related to the use of the field of view (FoV), which has a significant impact on the performance scores. We attempted to eliminate the biases using numerical techniques to provide a more realistic picture of the state of the art. Based on the results, we have formulated several findings, most notably: despite the well-defined test set of DRIVE, most rankings in published papers are based on non-comparable figures; in contrast to the near-perfect accuracy scores reported in the literature, the highest accuracy score achieved to date is 0.9582 in the FoV region, which is 1% higher than that of human annotators. The methods we have developed for identifying and eliminating the evaluation biases can be easily applied to other domains where similar problems may arise.
Collapse
Affiliation(s)
- György Kovács
- Analytical Minds Ltd., Árpád street 5, Beregsurány 4933, Hungary.
| | - Attila Fazekas
- University of Debrecen, Faculty of Informatics, P.O.BOX 400, Debrecen 4002, Hungary.
| |
Collapse
|
10
|
Toptaş B, Hanbay D. Retinal blood vessel segmentation using pixel-based feature vector. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.103053] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
11
|
Lin Z, Huang J, Chen Y, Zhang X, Zhao W, Li Y, Lu L, Zhan M, Jiang X, Liang X. A high resolution representation network with multi-path scale for retinal vessel segmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106206. [PMID: 34146772 DOI: 10.1016/j.cmpb.2021.106206] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 05/23/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVES Automatic retinal vessel segmentation (RVS) in fundus images is expected to be a vital step in the early image diagnosis of ophthalmologic diseases. However, it is a challenging task to detect the retinal vessel accurately mainly due to the vascular intricacies, lesion areas and optic disc edges in retinal fundus images. METHODS In this paper, we propose a high resolution representation network with multi-path scale (MPS-Net) for RVS aiming to improve the performance of extracting the retinal blood vessels. In the MPS-Net, there exist one high resolution main road and two lower resolution branch roads where the proposed multi-path scale modules are embedded to enhance the representation ability of network. Besides, in order to guide the network focus on learning the features of hard examples in retinal images, we design a hard-focused cross-entropy loss function. RESULTS We evaluate our network structure on DRIVE, STARE, CHASE and synthetic images and the quantitative comparisons with respect to the existing methods are presented. The experimental results show that our approach is superior to most methods in terms of F1-score, sensitivity, G-mean and Matthews correlation coefficient. CONCLUSIONS The promising segmentation performances reveal that our method has potential in real-world applications and can be exploited for other medical images with further analysis.
Collapse
Affiliation(s)
- Zefang Lin
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| | - Jianping Huang
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| | - Yingyin Chen
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| | - Xiao Zhang
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China
| | - Wei Zhao
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China
| | - Yong Li
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China
| | - Ligong Lu
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China
| | - Meixiao Zhan
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| | - Xiaofei Jiang
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China; Department of Cardiology, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| | - Xiong Liang
- Department of Obstetrics, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, Guangdong 519000, PR China.
| |
Collapse
|
12
|
Blood Vessel Segmentation of Fundus Retinal Images Based on Improved Frangi and Mathematical Morphology. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:4761517. [PMID: 34122614 PMCID: PMC8172282 DOI: 10.1155/2021/4761517] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 05/09/2021] [Accepted: 05/17/2021] [Indexed: 11/25/2022]
Abstract
An improved blood vessel segmentation algorithm on the basis of traditional Frangi filtering and the mathematical morphological method was proposed to solve the low accuracy of automatic blood vessel segmentation of fundus retinal images and high complexity of algorithms. First, a global enhanced image was generated by using the contrast-limited adaptive histogram equalization algorithm of the retinal image. An improved Frangi Hessian model was constructed by introducing the scale equivalence factor and eigenvector direction angle of the Hessian matrix into the traditional Frangi filtering algorithm to enhance blood vessels of the global enhanced image. Next, noise interferences surrounding small blood vessels were eliminated through the improved mathematical morphological method. Then, blood vessels were segmented using the Otsu threshold method. The improved algorithm was tested by the public DRIVE and STARE data sets. According to the test results, the average segmentation accuracy, sensitivity, and specificity of retinal images in DRIVE and STARE are 95.54%, 69.42%, and 98.02% and 94.92%, 70.19%, and 97.71%, respectively. The improved algorithm achieved high average segmentation accuracy and low complexity while promising segmentation sensitivity. This improved algorithm can segment retinal vessels more accurately than other algorithms.
Collapse
|
13
|
Zhou Y, Chen Z, Shen H, Zheng X, Zhao R, Duan X. A refined equilibrium generative adversarial network for retinal vessel segmentation. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.06.143] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
14
|
Ringel MJ, Tang EM, Tao YK. Advances in multimodal imaging in ophthalmology. Ther Adv Ophthalmol 2021; 13:25158414211002400. [PMID: 35187398 PMCID: PMC8855415 DOI: 10.1177/25158414211002400] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 02/23/2021] [Indexed: 12/12/2022] Open
Abstract
Multimodality ophthalmic imaging systems aim to enhance the contrast, resolution, and functionality of existing technologies to improve disease diagnostics and therapeutic guidance. These systems include advanced acquisition and post-processing methods using optical coherence tomography (OCT), combined scanning laser ophthalmoscopy and OCT systems, adaptive optics, surgical guidance, and photoacoustic technologies. Here, we provide an overview of these ophthalmic imaging systems and their clinical and basic science applications.
Collapse
Affiliation(s)
- Morgan J. Ringel
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Eric M. Tang
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Yuankai K. Tao
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235, USA
| |
Collapse
|
15
|
Abstract
Accurate segmentation of retinal blood vessels is a key step in the diagnosis of fundus diseases, among which cataracts, glaucoma, and diabetic retinopathy (DR) are the main diseases that cause blindness. Most segmentation methods based on deep convolutional neural networks can effectively extract features. However, convolution and pooling operations also filter out some useful information, and the final segmented retinal vessels have problems such as low classification accuracy. In this paper, we propose a multi-scale residual attention network called MRA-UNet. Multi-scale inputs enable the network to learn features at different scales, which increases the robustness of the network. In the encoding phase, we reduce the negative influence of the background and eliminate noise by using the residual attention module. We use the bottom reconstruction module to aggregate the feature information under different receptive fields, so that the model can extract the information of different thicknesses of blood vessels. Finally, the spatial activation module is used to process the up-sampled image to further increase the difference between blood vessels and background, which promotes the recovery of small blood vessels at the edges. Our method was verified on the DRIVE, CHASE, and STARE datasets. Respectively, the segmentation accuracy rates reached 96.98%, 97.58%, and 97.63%; the specificity reached 98.28%, 98.54%, and 98.73%; and the F-measure scores reached 82.93%, 81.27%, and 84.22%. We compared the experimental results with some state-of-art methods, such as U-Net, R2U-Net, and AG-UNet in terms of accuracy, sensitivity, specificity, F-measure, and AUCROC. Particularly, MRA-UNet outperformed U-Net by 1.51%, 3.44%, and 0.49% on DRIVE, CHASE, and STARE datasets, respectively.
Collapse
|
16
|
Mookiah MRK, Hogg S, MacGillivray TJ, Prathiba V, Pradeepa R, Mohan V, Anjana RM, Doney AS, Palmer CNA, Trucco E. A review of machine learning methods for retinal blood vessel segmentation and artery/vein classification. Med Image Anal 2020; 68:101905. [PMID: 33385700 DOI: 10.1016/j.media.2020.101905] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 11/10/2020] [Accepted: 11/11/2020] [Indexed: 12/20/2022]
Abstract
The eye affords a unique opportunity to inspect a rich part of the human microvasculature non-invasively via retinal imaging. Retinal blood vessel segmentation and classification are prime steps for the diagnosis and risk assessment of microvascular and systemic diseases. A high volume of techniques based on deep learning have been published in recent years. In this context, we review 158 papers published between 2012 and 2020, focussing on methods based on machine and deep learning (DL) for automatic vessel segmentation and classification for fundus camera images. We divide the methods into various classes by task (segmentation or artery-vein classification), technique (supervised or unsupervised, deep and non-deep learning, hand-crafted methods) and more specific algorithms (e.g. multiscale, morphology). We discuss advantages and limitations, and include tables summarising results at-a-glance. Finally, we attempt to assess the quantitative merit of DL methods in terms of accuracy improvement compared to other methods. The results allow us to offer our views on the outlook for vessel segmentation and classification for fundus camera images.
Collapse
Affiliation(s)
| | - Stephen Hogg
- VAMPIRE project, Computing (SSEN), University of Dundee, Dundee DD1 4HN, UK
| | - Tom J MacGillivray
- VAMPIRE project, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh EH16 4SB, UK
| | - Vijayaraghavan Prathiba
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Rajendra Pradeepa
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Viswanathan Mohan
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Ranjit Mohan Anjana
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Alexander S Doney
- Division of Population Health and Genomics, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, UK
| | - Colin N A Palmer
- Division of Population Health and Genomics, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, UK
| | - Emanuele Trucco
- VAMPIRE project, Computing (SSEN), University of Dundee, Dundee DD1 4HN, UK
| |
Collapse
|
17
|
Shoba SG, Therese AB. Detection of glaucoma disease in fundus images based on morphological operation and finite element method. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101986] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
18
|
Shukla AK, Pandey RK, Pachori RB. A fractional filter based efficient algorithm for retinal blood vessel segmentation. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101883] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
19
|
Javidi M, Harati A, Pourreza H. Retinal image assessment using bi-level adaptive morphological component analysis. Artif Intell Med 2019; 99:101702. [PMID: 31606110 DOI: 10.1016/j.artmed.2019.07.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Revised: 07/25/2019] [Accepted: 07/26/2019] [Indexed: 10/26/2022]
Abstract
The automated analysis of retinal images is a widely researched area which can help to diagnose several diseases like diabetic retinopathy in early stages of the disease. More specifically, separation of vessels and lesions is very critical as features of these structures are directly related to the diagnosis and treatment process of diabetic retinopathy. The complexity of the retinal image contents especially in images with severe diabetic retinopathy makes detection of vascular structure and lesions difficult. In this paper, a novel framework based on morphological component analysis (MCA) is presented which benefits from the adaptive representations obtained via dictionary learning. In the proposed Bi-level Adaptive MCA (BAMCA), MCA is extended to locally deal with sparse representation of the retinal images at patch level whereas the decomposition process occurs globally at the image level. BAMCA method with appropriately offline learnt dictionaries is adopted to work on retinal images with severe diabetic retinopathy in order to simultaneously separate vessels and exudate lesions as diagnostically useful morphological components. To obtain the appropriate dictionaries, K-SVD dictionary learning algorithm is modified to use a gated error which guides the process toward learning the main structures of the retinal images using vessel or lesion maps. Computational efficiency of the proposed framework is also increased significantly through some improvement leading to noticeable reduction in run time. We experimentally show how effective dictionaries can be learnt which help BAMCA to successfully separate exudate and vessel components from retinal images even in severe cases of diabetic retinopathy. In this paper, in addition to visual qualitative assessment, the performance of the proposed method is quantitatively measured in the framework of vessel and exudate segmentation. The reported experimental results on public datasets demonstrate that the obtained components can be used to achieve competitive results with regard to the state-of-the-art vessel and exudate segmentation methods.
Collapse
Affiliation(s)
- Malihe Javidi
- Computer Engineering Department, Quchan University of Technology, Quchan, Iran.
| | - Ahad Harati
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran.
| | - HamidReza Pourreza
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran.
| |
Collapse
|
20
|
Jiménez-García J, Romero-Oraá R, García M, López-Gálvez MI, Hornero R. Combination of Global Features for the Automatic Quality Assessment of Retinal Images. ENTROPY 2019; 21:e21030311. [PMID: 33267025 PMCID: PMC7514792 DOI: 10.3390/e21030311] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 03/14/2019] [Accepted: 03/18/2019] [Indexed: 02/02/2023]
Abstract
Diabetic retinopathy (DR) is one of the most common causes of visual loss in developed countries. Computer-aided diagnosis systems aimed at detecting DR can reduce the workload of ophthalmologists in screening programs. Nevertheless, a large number of retinal images cannot be analyzed by physicians and automatic methods due to poor quality. Automatic retinal image quality assessment (RIQA) is needed before image analysis. The purpose of this study was to combine novel generic quality features to develop a RIQA method. Several features were calculated from retinal images to achieve this goal. Features derived from the spatial and spectral entropy-based quality (SSEQ) and the natural images quality evaluator (NIQE) methods were extracted. They were combined with novel sharpness and luminosity measures based on the continuous wavelet transform (CWT) and the hue saturation value (HSV) color model, respectively. A subset of non-redundant features was selected using the fast correlation-based filter (FCBF) method. Subsequently, a multilayer perceptron (MLP) neural network was used to obtain the quality of images from the selected features. Classification results achieved 91.46% accuracy, 92.04% sensitivity, and 87.92% specificity. Results suggest that the proposed RIQA method could be applied in a more general computer-aided diagnosis system aimed at detecting a variety of retinal pathologies such as DR and age-related macular degeneration.
Collapse
Affiliation(s)
- Jorge Jiménez-García
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
- Correspondence: ; Tel.: +34-983-18-47-16
| | - Roberto Romero-Oraá
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - María García
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - María I. López-Gálvez
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
- Department of Ophthalmology, Hospital Clínico Universitario de Valladolid, Avenida Ramón y Cajal 3, 47003 Valladolid, Spain
- Instituto de Oftalmobiología Aplicada, University of Valladolid, Paseo de Belén 17, 47011 Valladolid, Spain
| | - Roberto Hornero
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
- Instituto de Investigación en Matemáticas (IMUVA), University of Valladolid, 47011 Valladolid, Spain
- Instituto de Neurociencias de Castilla y León (INCYL), University of Salamanca, 37007 Salamanca, Spain
| |
Collapse
|
21
|
Kamranian Z, Naghsh Nilchi AR, Monadjemi A, Navab N. Iterative algorithm for interactive co-segmentation using semantic information propagation. APPL INTELL 2018. [DOI: 10.1007/s10489-018-1221-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
22
|
Khan KB, Khaliq AA, Jalil A, Iftikhar MA, Ullah N, Aziz MW, Ullah K, Shahid M. A review of retinal blood vessels extraction techniques: challenges, taxonomy, and future trends. Pattern Anal Appl 2018. [DOI: 10.1007/s10044-018-0754-8] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
|
23
|
Thamer Mitib Al Sariera, Rangarajan L. Extraction of Blood Vessels in Retina. JOURNAL OF INFORMATION TECHNOLOGY RESEARCH 2018. [DOI: 10.4018/jitr.2018100108] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This article presents a novel method to extract retinal vascular tree automatically. The proposed method consists of four steps; smoothing image using low pass spatial filter to reduce spurious noise in the image; extracting candidate borders of the vessels based on a local window property; tracking process, starting with a candidate pixel and following in the optimum direction with monitoring the connectivity of the vessel twin border; constructing the whole tree of retinal blood vessels by connecting the vessel segments based on their spatial locations, widths and directions. The algorithm was trained with 20 images from the DRIVE dataset, and tested using the remaining 20 images.
Collapse
|
24
|
Eladawi N, Elmogy M, Khalifa F, Ghazal M, Ghazi N, Aboelfetouh A, Riad A, Sandhu H, Schaal S, El-Baz A. Early diabetic retinopathy diagnosis based on local retinal blood vessel analysis in optical coherence tomography angiography (OCTA) images. Med Phys 2018; 45:4582-4599. [DOI: 10.1002/mp.13142] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 08/13/2018] [Accepted: 08/15/2018] [Indexed: 11/10/2022] Open
Affiliation(s)
- Nabila Eladawi
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| | - Mohammed Elmogy
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| | - Fahmi Khalifa
- Electronics and Communications Engineering Department; Mansoura University; Mansoura Egypt
| | - Mohammed Ghazal
- Electrical and Computer Engineering Department; Abu Dhabi University; Abu Dhabi UAE
| | - Nicola Ghazi
- Eye Institute at Cleveland Clinic; Abu Dhabi UAE
| | - Ahmed Aboelfetouh
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
| | - Alaa Riad
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
| | - Harpal Sandhu
- Ophthalmology and Visual Sciences Department; School of Medicine; University of Louisville; Louisville KY USA
| | - Shlomit Schaal
- Department of Ophthalmology and Visual Sciences; University of Massachusetts Medical School; Worcester MA USA
| | - Ayman El-Baz
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| |
Collapse
|
25
|
Zhou L, Yu Q, Xu X, Gu Y, Yang J. Improving dense conditional random field for retinal vessel segmentation by discriminative feature learning and thin-vessel enhancement. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 148:13-25. [PMID: 28774435 DOI: 10.1016/j.cmpb.2017.06.016] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Revised: 05/28/2017] [Accepted: 06/23/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND AND OBJECTIVES As retinal vessels in color fundus images are thin and elongated structures, standard pairwise based random fields, which always suffer the "shrinking bias" problem, are not competent for such segmentation task. Recently, a dense conditional random field (CRF) model has been successfully used in retinal vessel segmentation. Its corresponding energy function is formulated as a linear combination of several unary features and a pairwise term. However, the hand-crafted unary features can be suboptimal in terms of linear models. Here we propose to learn discriminative unary features and enhance thin vessels for pairwise potentials to further improve the segmentation performance. METHODS Our proposed method comprises four main steps: firstly, image preprocessing is applied to eliminate the strong edges around the field of view (FOV) and normalize the luminosity and contrast inside FOV; secondly, a convolutional neural network (CNN) is properly trained to generate discriminative features for linear models; thirdly, a combo of filters are applied to enhance thin vessels, reducing the intensity difference between thin and wide vessels; fourthly, by taking the discriminative features for unary potentials and the thin-vessel enhanced image for pairwise potentials, we adopt the dense CRF model to achieve the final retinal vessel segmentation. The segmentation performance is evaluated on four public datasets (i.e. DRIVE, STARE, CHASEDB1 and HRF). RESULTS Experimental results show that our proposed method improves the performance of the dense CRF model and outperforms other methods when evaluated in terms of F1-score, Matthews correlation coefficient (MCC) and G-mean, three effective metrics for the evaluation of imbalanced binary classification. Specifically, the F1-score, MCC and G-mean are 0.7942, 0.7656, 0.8835 for the DRIVE dataset respectively; 0.8017, 0.7830, 0.8859 for STARE respectively; 0.7644, 0.7398, 0.8579 for CHASEDB1 respectively; and 0.7627, 0.7402, 0.8812 for HRF respectively. CONCLUSIONS The discriminative features learned in CNNs are more effective than hand-crafted ones. Our proposed method performs well in retinal vessel segmentation. The architecture of our method is trainable and can be integrated into computer-aided diagnostic (CAD) systems in the future.
Collapse
Affiliation(s)
- Lei Zhou
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, SEIEE Building 2-427, No. 800, Dongchuan Road, Minhang District, Shanghai, 200240 China.
| | - Qi Yu
- Shanghai General Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Xun Xu
- Shanghai General Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Yun Gu
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, SEIEE Building 2-427, No. 800, Dongchuan Road, Minhang District, Shanghai, 200240 China
| | - Jie Yang
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, SEIEE Building 2-427, No. 800, Dongchuan Road, Minhang District, Shanghai, 200240 China.
| |
Collapse
|
26
|
Automatic blood vessels segmentation based on different retinal maps from OCTA scans. Comput Biol Med 2017; 89:150-161. [PMID: 28806613 DOI: 10.1016/j.compbiomed.2017.08.008] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2017] [Revised: 08/03/2017] [Accepted: 08/04/2017] [Indexed: 11/23/2022]
Abstract
The retinal vascular network reflects the health of the retina, which is a useful diagnostic indicator of systemic vascular. Therefore, the segmentation of retinal blood vessels is a powerful method for diagnosing vascular diseases. This paper presents an automatic segmentation system for retinal blood vessels from Optical Coherence Tomography Angiography (OCTA) images. The system segments blood vessels from the superficial and deep retinal maps for normal and diabetic cases. Initially, we reduced the noise and improved the contrast of the OCTA images by using the Generalized Gauss-Markov random field (GGMRF) model. Secondly, we proposed a joint Markov-Gibbs random field (MGRF) model to segment the retinal blood vessels from other background tissues. It integrates both appearance and spatial models in addition to the prior probability model of OCTA images. The higher order MGRF (HO-MGRF) model in addition to the 1st-order intensity model are used to consider the spatial information in order to overcome the low contrast between vessels and other tissues. Finally, we refined the segmentation by extracting connected regions using a 2D connectivity filter. The proposed segmentation system was trained and tested on 47 data sets, which are 23 normal data sets and 24 data sets for diabetic patients. To evaluate the accuracy and robustness of the proposed segmentation framework, we used three different metrics, which are Dice similarity coefficient (DSC), absolute vessels volume difference (VVD), and area under the curve (AUC). The results on OCTA data sets (DSC=95.04±3.75%, VVD=8.51±1.49%, and AUC=95.20±1.52%) show the promise of the proposed segmentation approach.
Collapse
|
27
|
Rodrigues LC, Marengoni M. Segmentation of optic disc and blood vessels in retinal images using wavelets, mathematical morphology and Hessian-based multi-scale filtering. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2017.03.014] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
28
|
Abstract
Retinal vessel tree extraction is a crucial step for analyzing the microcirculation, a frequently needed process in the study of relevant diseases. To date, this has normally been done by using 2D image capture paradigms, offering a restricted visualization of the real layout of the retinal vasculature. In this work, we propose a new approach that automatically segments and reconstructs the 3D retinal vessel tree by combining near-infrared reflectance retinography information with Optical Coherence Tomography (OCT) sections. Our proposal identifies the vessels, estimates their calibers, and obtains the depth at all the positions of the entire vessel tree, thereby enabling the reconstruction of the 3D layout of the complete arteriovenous tree for subsequent analysis. The method was tested using 991 OCT images combined with their corresponding near-infrared reflectance retinography. The different stages of the methodology were validated using the opinion of an expert as a reference. The tests offered accurate results, showing coherent reconstructions of the 3D vasculature that can be analyzed in the diagnosis of relevant diseases affecting the retinal microcirculation, such as hypertension or diabetes, among others.
Collapse
|
29
|
Szilágyi SM, Popovici MM, Szilágyi L. Review. Automatic Segmentation Techniques of the Coronary Artery Using CT Images in Acute Coronary Syndromes. JOURNAL OF CARDIOVASCULAR EMERGENCIES 2017. [DOI: 10.1515/jce-2017-0002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Abstract
Coronary artery disease represents one of the leading reasons of death worldwide, and acute coronary syndromes are their most devastating consequences. It is extremely important to identify the patients at risk for developing an acute myocardial infarction, and this goal can be achieved using noninvasive imaging techniques. Coronary computed tomography angiography (CCTA) is currently one of the most reliable methods used for assessing the coronary arteries; however, its use in emergency settings is sometimes limited due to time constraints. This paper presents the main characteristics of plaque vulnerability, the role of CCTA in the assessment of vulnerable plaques, and automatic segmentation techniques of the coronary artery tree based on CT angiography images. A detailed inventory of existing methods is given, representing the state-of-the-art of computational methods applied in vascular system segmentation, focusing on the current applications in acute coronary syndromes.
Collapse
Affiliation(s)
| | - Monica Marton Popovici
- Swedish Medical Center, Department of Internal Medicine and Critical Care, 21601, 76th Ave W, Edmonds, Washington , 98026, USA
| | - László Szilágyi
- Department of Electrical Engineering, Sapientia University, Tîrgu Mureș , Romania
| |
Collapse
|
30
|
L Srinidhi C, Aparna P, Rajan J. Recent Advancements in Retinal Vessel Segmentation. J Med Syst 2017; 41:70. [DOI: 10.1007/s10916-017-0719-2] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2017] [Accepted: 03/01/2017] [Indexed: 11/28/2022]
|
31
|
Javidi M, Pourreza HR, Harati A. Vessel segmentation and microaneurysm detection using discriminative dictionary learning and sparse representation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 139:93-108. [PMID: 28187898 DOI: 10.1016/j.cmpb.2016.10.015] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/28/2016] [Revised: 09/22/2016] [Accepted: 10/18/2016] [Indexed: 06/06/2023]
Abstract
Diabetic retinopathy (DR) is a major cause of visual impairment, and the analysis of retinal image can assist patients to take action earlier when it is more likely to be effective. The accurate segmentation of blood vessels in the retinal image can diagnose DR directly. In this paper, a novel scheme for blood vessel segmentation based on discriminative dictionary learning (DDL) and sparse representation has been proposed. The proposed system yields a strong representation which contains the semantic concept of the image. To extract blood vessel, two separate dictionaries, for vessel and non-vessel, capable of providing reconstructive and discriminative information of the retinal image are learned. In the test step, an unseen retinal image is divided into overlapping patches and classified to vessel and non-vessel patches. Then, a voting scheme is applied to generate the binary vessel map. The proposed vessel segmentation method can achieve the accuracy of 95% and a sensitivity of 75% in the same range of specificity 97% on two public datasets. The results show that the proposed method can achieve comparable results to existing methods and decrease false positive vessels in abnormal retinal images with pathological regions. Microaneurysm (MA) is the earliest sign of DR that appears as a small red dot on the surface of the retina. Despite several attempts to develop automated MA detection systems, it is still a challenging problem. In this paper, a method for MA detection, which is similar to our vessel segmentation approach, is proposed. In our method, a candidate detection algorithm based on the Morlet wavelet is applied to identify all possible MA candidates. In the next step, two discriminative dictionaries with the ability to distinguish MA from non-MA object are learned. These dictionaries are then used to classify the detected candidate objects. The evaluations indicate that the proposed MA detection method achieves higher average sensitivity about 2-15%, compared to existing methods.
Collapse
Affiliation(s)
- Malihe Javidi
- Faculty of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran; Machine Vision Lab, Eye Image Analysis Research Group (EIARG), Ferdowsi University of Mashhad, Mashhad, Iran
| | - Hamid-Reza Pourreza
- Faculty of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran; Machine Vision Lab, Eye Image Analysis Research Group (EIARG), Ferdowsi University of Mashhad, Mashhad, Iran.
| | - Ahad Harati
- Faculty of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran; Robot Perception Lab, Ferdowsi University of Mashhad, Mashhad, Iran
| |
Collapse
|
32
|
Orlando JI, Prokofyeva E, Blaschko MB. A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images. IEEE Trans Biomed Eng 2017; 64:16-27. [DOI: 10.1109/tbme.2016.2535311] [Citation(s) in RCA: 291] [Impact Index Per Article: 41.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
33
|
Cruz-Aceves I, Hernandez-Aguirre A, Valdez SI. On the performance of nature inspired algorithms for the automatic segmentation of coronary arteries using Gaussian matched filters. Appl Soft Comput 2016. [DOI: 10.1016/j.asoc.2016.01.030] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
34
|
Automatic segmentation of coronary arteries using Gabor filters and thresholding based on multiobjective optimization. Biomed Signal Process Control 2016. [DOI: 10.1016/j.bspc.2015.11.001] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
35
|
Dai P, Luo H, Sheng H, Zhao Y, Li L, Wu J, Zhao Y, Suzuki K. A New Approach to Segment Both Main and Peripheral Retinal Vessels Based on Gray-Voting and Gaussian Mixture Model. PLoS One 2015; 10:e0127748. [PMID: 26047128 PMCID: PMC4457795 DOI: 10.1371/journal.pone.0127748] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2015] [Accepted: 04/19/2015] [Indexed: 11/19/2022] Open
Abstract
Vessel segmentation in retinal fundus images is a preliminary step to clinical diagnosis for some systemic diseases and some eye diseases. The performances of existing methods for segmenting small vessels which are usually of more importance than the main vessels in a clinical diagnosis are not satisfactory in clinical use. In this paper, we present a method for both main and peripheral vessel segmentation. A local gray-level change enhancement algorithm called gray-voting is used to enhance the small vessels, while a two-dimensional Gabor wavelet is used to extract the main vessels. We fuse the gray-voting results with the 2D-Gabor filter results as pre-processing outcome. A Gaussian mixture model is then used to extract vessel clusters from the pre-processing outcome, while small vessels fragments are obtained using another gray-voting process, which complements the vessel cluster extraction already performed. At the last step, we eliminate the fragments that do not belong to the vessels based on the shape of the fragments. We evaluated the approach with two publicly available DRIVE (Staal et al., 2004) and STARE (Hoover et at., 2000) datasets with manually segmented results. For the STARE dataset, when using the second manually segmented results which include much more small vessels than the first manually segmented results as the "gold standard," this approach achieved an average sensitivity, accuracy and specificity of 65.0%, 92.1% and 97.0%, respectively. The sensitivities of this approach were much higher than those of the other existing methods, with comparable specificities; these results thus demonstrated that this approach was sensitive to detection of small vessels.
Collapse
Affiliation(s)
- Peishan Dai
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Hanyuan Luo
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Hanwei Sheng
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Yali Zhao
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Ling Li
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Jing Wu
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Yuqian Zhao
- Department of Biomedical Engineering, School of Geoscience and Info-Physics, Central South University, Changsha, Hunan, P. R. China
| | - Kenji Suzuki
- Department of Radiology, The University of Chicago, Chicago, Illinois, United States of America
| |
Collapse
|
36
|
MAHENDRAN G, DHANASEKARAN R. DETECTION AND LOCALIZATION OF RETINAL EXUDATES FOR DIABETIC RETINOPATHY. J BIOL SYST 2015. [DOI: 10.1142/s0218339015500102] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Diabetic retinopathy (DR) is a complication of diabetes caused by changes in the blood vessels of the retina. Initially, the DR causes trivial changes in the retinal capillary. The symptoms can blur or distort patients' vision, which are the main causes of blindness. The DR is characterized by the presence of exudates at the nonproliferative stage. Once damaged by DR, the effects will be permanent and hence an earlier treatment is considered as vital. The presence of exudates is detected by ophthalmologists from the dilated retinal images, which are captured by dropping chemical solution into the patient's eye that leads to irritation. Therefore, there is a need for an alternative method toward the detection of exudates using image processing algorithms from the nondilated images. In this paper, an automated method is proposed for the detection of exudates using the fuzzy C-Means (FCM) clustering technique and reconstruction through a superimposition process in the absence of dilating patient's eye. The segmented result of FCM is compared with the result obtained using the Fuzzy K-Means segmentation algorithm. The sensitivity and specificity values for the exudates detection using the FCM algorithm are 87.38% and 96.94%, respectively. On the other hand, sensitivity and specificity values for the exudates detection using the K-Means algorithm are 75.04% and 93.73%, respectively.
Collapse
Affiliation(s)
- G. MAHENDRAN
- Department of Electronics and Communication Engineering, Syed Ammal Engineering College, Ramanathapuram, Tamilnadu, India
| | - R. DHANASEKARAN
- Department of Electrical and Electronics Engineering, Syed Ammal Engineering College, Ramanathapuram, Tamilnadu, India
| |
Collapse
|
37
|
Ganjee R, Azmi R, Gholizadeh B. An Improved Retinal Vessel Segmentation Method Based on High Level Features for Pathological Images. J Med Syst 2014; 38:108. [DOI: 10.1007/s10916-014-0108-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2014] [Accepted: 07/07/2014] [Indexed: 11/28/2022]
|
38
|
A fusion method of Gabor wavelet transform and unsupervised clustering algorithms for tissue edge detection. ScientificWorldJournal 2014; 2014:964870. [PMID: 24790590 PMCID: PMC3982282 DOI: 10.1155/2014/964870] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2013] [Accepted: 02/20/2014] [Indexed: 11/23/2022] Open
Abstract
This paper proposes two edge detection methods for medical images by integrating the advantages of Gabor wavelet transform (GWT) and unsupervised clustering algorithms. The GWT is used to enhance the edge information in an image while suppressing noise. Following this, the k-means and Fuzzy c-means (FCM) clustering algorithms are used to convert a gray level image into a binary image. The proposed methods are tested using medical images obtained through Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) devices, and a phantom image. The results prove that the proposed methods are successful for edge detection, even in noisy cases.
Collapse
|