1
|
Mahapatra S, Agrawal S, Mishro PK, Panda R, Dora L, Pachori RB. A Review on Retinal Blood Vessel Enhancement and Segmentation Techniques for Color Fundus Photography. Crit Rev Biomed Eng 2024; 52:41-69. [PMID: 37938183 DOI: 10.1615/critrevbiomedeng.2023049348] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2023]
Abstract
The retinal image is a trusted modality in biomedical image-based diagnosis of many ophthalmologic and cardiovascular diseases. Periodic examination of the retina can help in spotting these abnormalities in the early stage. However, to deal with today's large population, computerized retinal image analysis is preferred over manual inspection. The precise extraction of the retinal vessel is the first and decisive step for clinical applications. Every year, many more articles are added to the literature that describe new algorithms for the problem at hand. The majority of the review article is restricted to a fairly small number of approaches, assessment indices, and databases. In this context, a comprehensive review of different vessel extraction methods is inevitable. It includes the development of a first-hand classification of these methods. A bibliometric analysis of these articles is also presented. The benefits and drawbacks of the most commonly used techniques are summarized. The primary challenges, as well as the scope of possible changes, are discussed. In order to make a fair comparison, numerous assessment indices are considered. The findings of this survey could provide a new path for researchers for further work in this domain.
Collapse
Affiliation(s)
- Sakambhari Mahapatra
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Sanjay Agrawal
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Pranaba K Mishro
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Rutuparna Panda
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Lingraj Dora
- Department of Electrical and Electronics Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Ram Bilas Pachori
- Department of Electrical Engineering, Indian Institute of Technology Indore, Indore, India
| |
Collapse
|
2
|
Kv R, Prasad K, Peralam Yegneswaran P. Segmentation and Classification Approaches of Clinically Relevant Curvilinear Structures: A Review. J Med Syst 2023; 47:40. [PMID: 36971852 PMCID: PMC10042761 DOI: 10.1007/s10916-023-01927-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 02/25/2023] [Indexed: 03/29/2023]
Abstract
Detection of curvilinear structures from microscopic images, which help the clinicians to make an unambiguous diagnosis is assuming paramount importance in recent clinical practice. Appearance and size of dermatophytic hyphae, keratitic fungi, corneal and retinal vessels vary widely making their automated detection cumbersome. Automated deep learning methods, endowed with superior self-learning capacity, have superseded the traditional machine learning methods, especially in complex images with challenging background. Automatic feature learning ability using large input data with better generalization and recognition capability, but devoid of human interference and excessive pre-processing, is highly beneficial in the above context. Varied attempts have been made by researchers to overcome challenges such as thin vessels, bifurcations and obstructive lesions in retinal vessel detection as revealed through several publications reviewed here. Revelations of diabetic neuropathic complications such as tortuosity, changes in the density and angles of the corneal fibers have been successfully sorted in many publications reviewed here. Since artifacts complicate the images and affect the quality of analysis, methods addressing these challenges have been described. Traditional and deep learning methods, that have been adapted and published between 2015 and 2021 covering retinal vessels, corneal nerves and filamentous fungi have been summarized in this review. We find several novel and meritorious ideas and techniques being put to use in the case of retinal vessel segmentation and classification, which by way of cross-domain adaptation can be utilized in the case of corneal and filamentous fungi also, making suitable adaptations to the challenges to be addressed.
Collapse
Affiliation(s)
- Rajitha Kv
- Department of Biomedical Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India
| | - Keerthana Prasad
- Manipal School of Information Sciences, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India.
| | - Prakash Peralam Yegneswaran
- Department of Microbiology, Kasturba Medical College, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India
| |
Collapse
|
3
|
Kumar KS, Singh NP. An efficient registration-based approach for retinal blood vessel segmentation using generalized Pareto and fatigue pdf. Med Eng Phys 2022; 110:103936. [PMID: 36529622 DOI: 10.1016/j.medengphy.2022.103936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/05/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
Segmentation of Retinal Blood Vessel (RBV) extraction in the retina images and Registration of segmented RBV structure is implemented to identify changes in vessel structure by ophthalmologists in diagnosis of various illnesses like Glaucoma, Diabetes, and Hypertension's. The Retinal Blood Vessel provides blood to the inner retinal neurons, RBV are located mainly in internal retina but it may partly in the ganglion cell layer, following network failure haven't been identified with past methods. Classifications of accurate RBV and Registration of segmented blood vessels are challenging tasks in the low intensity background of Retinal Image. So, we projected a novel approach of segmentation of RBV extraction used matched filter of Generalized Pareto Probability Distribution Function (pdf) and Registration approach on feature-based segmented retinal blood vessel of Binary Robust Invariant Scalable Key point (BRISK). The BRISK provides the predefined sampling pattern as compared to Pdf. The BRISK feature is implemented for attention point recognition & matching approach for change in vessel structure. The proposed approaches contain 3 levels: pre-processing, matched filter-based Generalized Pareto pdf as a source along with the novel approach of fatigue pdf as a target, and BRISK framework is used for Registration on segmented retinal images of supply & intention images. This implemented system's performance is estimated in experimental analysis by the Average accuracy, Normalized Cross-Correlation (NCC), and computation time process of the segmented retinal source and target image. The NCC is main element to give more statistical information about retinal image segmentation. The proposed approach of Generalized Pareto value pdf has Average Accuracy of 95.21%, NCC of both image pairs is 93%, and Average accuracy of Registration of segmented source images and the target image is 98.51% respectively. The proposed approach of average computational time taken is around 1.4 s, which has been identified on boundary condition of Pdf function.
Collapse
Affiliation(s)
- K Susheel Kumar
- GITAM University, Bengaluru, 561203, India; National Institute of Technology Hamirpur, Himachal Pradesh 177005, India.
| | | |
Collapse
|
4
|
Iqbal S, Khan TM, Naveed K, Naqvi SS, Nawaz SJ. Recent trends and advances in fundus image analysis: A review. Comput Biol Med 2022; 151:106277. [PMID: 36370579 DOI: 10.1016/j.compbiomed.2022.106277] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 10/19/2022] [Accepted: 10/30/2022] [Indexed: 11/05/2022]
Abstract
Automated retinal image analysis holds prime significance in the accurate diagnosis of various critical eye diseases that include diabetic retinopathy (DR), age-related macular degeneration (AMD), atherosclerosis, and glaucoma. Manual diagnosis of retinal diseases by ophthalmologists takes time, effort, and financial resources, and is prone to error, in comparison to computer-aided diagnosis systems. In this context, robust classification and segmentation of retinal images are primary operations that aid clinicians in the early screening of patients to ensure the prevention and/or treatment of these diseases. This paper conducts an extensive review of the state-of-the-art methods for the detection and segmentation of retinal image features. Existing notable techniques for the detection of retinal features are categorized into essential groups and compared in depth. Additionally, a summary of quantifiable performance measures for various important stages of retinal image analysis, such as image acquisition and preprocessing, is provided. Finally, the widely used in the literature datasets for analyzing retinal images are described and their significance is emphasized.
Collapse
Affiliation(s)
- Shahzaib Iqbal
- Department of Electrical and Computer Engineering, COMSATS University Islamabad (CUI), Islamabad, Pakistan
| | - Tariq M Khan
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia.
| | - Khuram Naveed
- Department of Electrical and Computer Engineering, COMSATS University Islamabad (CUI), Islamabad, Pakistan; Department of Electrical and Computer Engineering, Aarhus University, Aarhus, Denmark
| | - Syed S Naqvi
- Department of Electrical and Computer Engineering, COMSATS University Islamabad (CUI), Islamabad, Pakistan
| | - Syed Junaid Nawaz
- Department of Electrical and Computer Engineering, COMSATS University Islamabad (CUI), Islamabad, Pakistan
| |
Collapse
|
5
|
Panda NR, Sahoo AK. A Detailed Systematic Review on Retinal Image Segmentation Methods. J Digit Imaging 2022; 35:1250-1270. [PMID: 35508746 PMCID: PMC9582172 DOI: 10.1007/s10278-022-00640-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Revised: 04/12/2022] [Accepted: 04/14/2022] [Indexed: 11/27/2022] Open
Abstract
The separation of blood vessels in the retina is a major aspect in detecting ailment and is carried out by segregating the retinal blood vessels from the fundus images. Moreover, it helps to provide earlier therapy for deadly diseases and prevent further impacts due to diabetes and hypertension. Many reviews already exist for this problem, but those reviews have presented the analysis of a single framework. Hence, this article on retinal segmentation review has revealed distinct methodologies with diverse frameworks that are utilized for blood vessel separation. The novelty of this review research lies in finding the best neural network model by comparing its efficiency. For that, machine learning (ML) and deep learning (DL) were compared and have been reported as the best model. Moreover, different datasets were used to segment the retinal blood vessels. The execution of each approach is compared based on the performance metrics such as sensitivity, specificity, and accuracy using publically accessible datasets like STARE, DRIVE, ROSE, REFUGE, and CHASE. This article discloses the implementation capacity of distinct techniques implemented for each segmentation method. Finally, the finest accuracy of 98% and sensitivity of 96% were achieved for the technique of Convolution Neural Network with Ranking Support Vector Machine (CNN-rSVM). Moreover, this technique has utilized public datasets to verify efficiency. Hence, the overall review of this article has revealed a method for earlier diagnosis of diseases to deliver earlier therapy.
Collapse
Affiliation(s)
- Nihar Ranjan Panda
- Department of Electronics and Communication Engineering, Silicon Institute of Technology, Bhubaneswar, Orissa, 751024, India.
| | - Ajit Kumar Sahoo
- Department of Electronics and Communication Engineering, National Institute of Technology, Rourkela, Odisha, 769008, India
| |
Collapse
|
6
|
Dubey S, Dixit M. Recent developments on computer aided systems for diagnosis of diabetic retinopathy: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:14471-14525. [PMID: 36185322 PMCID: PMC9510498 DOI: 10.1007/s11042-022-13841-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 04/27/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Diabetes is a long-term condition in which the pancreas quits producing insulin or the body's insulin isn't utilised properly. One of the signs of diabetes is Diabetic Retinopathy. Diabetic retinopathy is the most prevalent type of diabetes, if remains unaddressed, diabetic retinopathy can affect all diabetics and become very serious, raising the chances of blindness. It is a chronic systemic condition that affects up to 80% of patients for more than ten years. Many researchers believe that if diabetes individuals are diagnosed early enough, they can be rescued from the condition in 90% of cases. Diabetes damages the capillaries, which are microscopic blood vessels in the retina. On images, blood vessel damage is usually noticeable. Therefore, in this study, several traditional, as well as deep learning-based approaches, are reviewed for the classification and detection of this particular diabetic-based eye disease known as diabetic retinopathy, and also the advantage of one approach over the other is also described. Along with the approaches, the dataset and the evaluation metrics useful for DR detection and classification are also discussed. The main finding of this study is to aware researchers about the different challenges occurs while detecting diabetic retinopathy using computer vision, deep learning techniques. Therefore, a purpose of this review paper is to sum up all the major aspects while detecting DR like lesion identification, classification and segmentation, security attacks on the deep learning models, proper categorization of datasets and evaluation metrics. As deep learning models are quite expensive and more prone to security attacks thus, in future it is advisable to develop a refined, reliable and robust model which overcomes all these aspects which are commonly found while designing deep learning models.
Collapse
Affiliation(s)
- Shradha Dubey
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| | - Manish Dixit
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| |
Collapse
|
7
|
Khandouzi A, Ariafar A, Mashayekhpour Z, Pazira M, Baleghi Y. Retinal Vessel Segmentation, a Review of Classic and Deep Methods. Ann Biomed Eng 2022; 50:1292-1314. [PMID: 36008569 DOI: 10.1007/s10439-022-03058-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Accepted: 08/15/2022] [Indexed: 11/01/2022]
Abstract
Retinal illnesses such as diabetic retinopathy (DR) are the main causes of vision loss. In the early recognition of eye diseases, the segmentation of blood vessels in retina images plays an important role. Different symptoms of ocular diseases can be identified by the geometric features of ocular arteries. However, due to the complex construction of the blood vessels and their different thicknesses, segmenting the retina image is a challenging task. There are a number of algorithms that helped the detection of retinal diseases. This paper presents an overview of papers from 2016 to 2022 that discuss machine learning and deep learning methods for automatic vessel segmentation. The methods are divided into two groups: Deep learning-based, and classic methods. Algorithms, classifiers, pre-processing and specific techniques of each group is described, comprehensively. The performances of recent works are compared based on their achieved accuracy in different datasets in inclusive tables. A survey of most popular datasets like DRIVE, STARE, HRF and CHASE_DB1 is also given in this paper. Finally, a list of findings from this review is presented in the conclusion section.
Collapse
Affiliation(s)
- Ali Khandouzi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| | - Ali Ariafar
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| | - Zahra Mashayekhpour
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| | - Milad Pazira
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| | - Yasser Baleghi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran.
| |
Collapse
|
8
|
Mahapatra S, Agrawal S, Mishro PK, Pachori RB. A novel framework for retinal vessel segmentation using optimal improved frangi filter and adaptive weighted spatial FCM. Comput Biol Med 2022; 147:105770. [DOI: 10.1016/j.compbiomed.2022.105770] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 06/08/2022] [Accepted: 06/19/2022] [Indexed: 11/28/2022]
|
9
|
Glaucoma Detection Using Image Processing and Supervised Learning for Classification. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:2988262. [PMID: 35273784 PMCID: PMC8904131 DOI: 10.1155/2022/2988262] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 12/27/2021] [Accepted: 01/24/2022] [Indexed: 11/22/2022]
Abstract
A difficult challenge in the realm of biomedical engineering is the detection of physiological changes occurring inside the human body, which is a difficult undertaking. At the moment, these irregularities are graded manually, which is very difficult, time-consuming, and tiresome due to the many complexities associated with the methods involved in their identification. In order to identify illnesses at an early stage, the use of computer-assisted diagnostics has acquired increased attention as a result of the requirement of a disease detection system. The major goal of this proposed work is to build a computer-aided design (CAD) system to help in the early identification of glaucoma as well as the screening and treatment of the disease. The fundus camera is the most affordable image analysis modality available, and it meets the financial needs of the general public. The extraction of structural characteristics from the segmented optic disc and the segmented optic cup may be used to characterize glaucoma and determine its severity. For this study, the primary goal is to estimate the potential of the image analysis model for the early identification and diagnosis of glaucoma, as well as for the evaluation of ocular disorders. The suggested CAD system would aid the ophthalmologist in the diagnosis of ocular illnesses by providing a second opinion as a judgment made by human specialists in a controlled environment. An ensemble-based deep learning model for the identification and diagnosis of glaucoma is in its early stages now. This method's initial module is an ensemble-based deep learning model for glaucoma diagnosis, which is the first of its kind ever developed. It was decided to use three pretrained convolutional neural networks for the categorization of glaucoma. These networks included the residual network (ResNet), the visual geometry group network (VGGNet), and the GoogLeNet. It was necessary to use five different data sets in order to determine how well the proposed algorithm performed. These data sets included the DRISHTI-GS, the Optic Nerve Segmentation Database (DRIONS-DB), and the High-Resolution Fundus (HRF). Accuracy of 91.11% for the PSGIMSR data set and the sensitivity of 85.55% and specificity of 95.20% for the suggested ensemble architecture on the PSGIMSR data set were achieved. Similarly, accuracy rates of 95.63%, 98.67%, 95.64%, and 88.96% were achieved using the DRIONS-DB, HRF, DRISHTI-GS, and combined data sets, respectively.
Collapse
|
10
|
Toptaş B, Toptaş M, Hanbay D. Detection of Optic Disc Localization from Retinal Fundus Image Using Optimized Color Space. J Digit Imaging 2022; 35:302-319. [PMID: 35018540 PMCID: PMC8921449 DOI: 10.1007/s10278-021-00566-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Revised: 11/25/2021] [Accepted: 12/06/2021] [Indexed: 10/19/2022] Open
Abstract
Optic disc localization offers an important clue in detecting other retinal components such as the macula, fovea, and retinal vessels. With the correct detection of this area, sudden vision loss caused by diseases such as age-related macular degeneration and diabetic retinopathy can be prevented. Therefore, there is an increase in computer-aided diagnosis systems in this field. In this paper, an automated method for detecting optic disc localization is proposed. In the proposed method, the fundus images are moved from RGB color space to a new color space by using an artificial bee colony algorithm. In the new color space, the localization of the optical disc is clearer than in the RGB color space. In this method, a matrix called the feature matrix is created. This matrix is obtained from the color pixel values of the image patches containing the optical disc and the image patches not containing the optical disc. Then, the conversion matrix is created. The initial values of this matrix are randomly determined. These two matrices are processed in the artificial bee colony algorithm. Ultimately, the conversion matrix becomes optimal and is applied over the original fundus images. Thus, the images are moved to the new color space. Thresholding is applied to these images, and the optic disc localization is obtained. The success rate of the proposed method has been tested on three general datasets. The accuracy success rate for the DRIVE, DRIONS, and MESSIDOR datasets, respectively, is 100%, 96.37%, and 94.42% for the proposed method.
Collapse
Affiliation(s)
- Buket Toptaş
- Computer Eng. Dept, Engineering and Natural Science Faculty, Bandırma Onyedi Eylül University, Balıkesir, Turkey.
| | - Murat Toptaş
- Software Eng. Dept, Engineering and Natural Science Faculty, Bandırma Onyedi Eylül University, Balıkesir, Turkey
| | - Davut Hanbay
- Computer Eng. Dept., Engineering Faculty, Inonu University, 44280, Malatya, Turkey
| |
Collapse
|
11
|
Badawi SA, Fraz MM, Shehzad M, Mahmood I, Javed S, Mosalam E, Nileshwar AK. Detection and Grading of Hypertensive Retinopathy Using Vessels Tortuosity and Arteriovenous Ratio. J Digit Imaging 2022; 35:281-301. [PMID: 35013827 PMCID: PMC8921404 DOI: 10.1007/s10278-021-00545-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 11/09/2021] [Accepted: 11/11/2021] [Indexed: 10/19/2022] Open
Abstract
Hypertensive retinopathy (HR) refers to changes in the morphological diameter of the retinal vessels due to persistent high blood pressure. Early detection of such changes helps in preventing blindness or even death due to stroke. These changes can be quantified by computing the arteriovenous ratio and the tortuosity severity in the retinal vasculature. This paper presents a decision support system for detecting and grading HR using morphometric analysis of retinal vasculature, particularly measuring the arteriovenous ratio (AVR) and retinal vessel tortuosity. In the first step, the retinal blood vessels are segmented and classified as arteries and veins. Then, the width of arteries and veins is measured within the region of interest around the optic disk. Next, a new iterative method is proposed to compute the AVR from the caliber measurements of arteries and veins using Parr-Hubbard and Knudtson methods. Moreover, the retinal vessel tortuosity severity index is computed for each image using 14 tortuosity severity metrics. In the end, a hybrid decision support system is proposed for the detection and grading of HR using AVR and tortuosity severity index. Furthermore, we present a new publicly available retinal vessel morphometry (RVM) dataset to evaluate the proposed methodology. The RVM dataset contains 504 retinal images with pixel-level annotations for vessel segmentation, artery/vein classification, and optic disk localization. The image-level labels for vessel tortuosity index and HR grade are also available. The proposed methods of iterative AVR measurement, tortuosity index, and HR grading are evaluated using the new RVM dataset. The results indicate that the proposed method gives superior performance than existing methods. The presented methodology is a novel advancement in automated detection and grading of HR, which can potentially be used as a clinical decision support system.
Collapse
Affiliation(s)
- Sufian A Badawi
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Muhammad Moazam Fraz
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad, Pakistan.
| | - Muhammad Shehzad
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Imran Mahmood
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Sajid Javed
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
| | - Emad Mosalam
- Department of Ophthalmology, RAK Medical and Health Sciences University, Ras Al Khaimah, UAE.,Department of Ophthalmology, Saqr Hospital, Ministry of Health and Prevention, Ras Al Khaimah, UAE
| | - Ajay Kamath Nileshwar
- Department of Ophthalmology, RAK Medical and Health Sciences University, Ras Al Khaimah, UAE.,Department of Ophthalmology, Saqr Hospital, Ministry of Health and Prevention, Ras Al Khaimah, UAE
| |
Collapse
|
12
|
Khaing TT, Aimmanee P, Makhanov S, Haneishi H. Vessel-based hybrid optic disk segmentation applied to mobile phone camera retinal images. Med Biol Eng Comput 2022; 60:421-437. [PMID: 34988764 DOI: 10.1007/s11517-021-02484-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 12/04/2021] [Indexed: 11/26/2022]
Abstract
Precise detection of the optic disk (OD) is an important task in the diagnosis of diabetic retinopathy. To manage the massive diabetic population, there is a significant demand for efficient and remote retinal imaging techniques. In this regard, the use of handheld mobile cameras attached to a smartphone is a promising approach. However, smartphone retinal images are often of low quality, compared to those obtained on standard equipment. They also have a narrow field of view and an incomplete/unbalanced vessel structure. Hence, we propose a new, fully automatic hybrid method for OD localization (HLM). It is designed for and verified on mobile camera/smartphone retinal images. The HLM analyzes the vessel structure and finds the OD locations by using the exclusion method when an image has a complete vessel system, and a newly proposed line detection method, otherwise. For OD segmentation, an active contour model followed by the circle fitting approach is integrated into the HLM. The proposed method was tested on three mobile camera datasets and four datasets obtained by standard equipment. For mobile camera datasets, the HLM achieves an average accuracy of 98% for OD localization. The segmentation routine obtains an average precision of 92.64% and an average recall of 82.38%. Testing against the recent state-of-the-art methods on the standard datasets shows comparable performance. The proposed framework for OD localization and segmentation designed for and verified on mobile camera retinal datasets and standard datasets. (EM - "Exclusion Method", LDM - "Line Detection Method", OD - "Optic Disk" and PPV - "Positive Predictive Value").
Collapse
Affiliation(s)
- Tin Tin Khaing
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand
- Division of Fundamental Engineering, Graduate School of Science and Engineering, Chiba University, 1-33 Yayoicho, Inage Ward, Chiba, 263-8522, Japan
| | - Pakinee Aimmanee
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand.
| | - Stanislav Makhanov
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand
| | - Hideaki Haneishi
- Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoicho, Inage Ward, Chiba, 263-8522, Japan
| |
Collapse
|
13
|
|
14
|
Xu S, Chen Z, Cao W, Zhang F, Tao B. Retinal Vessel Segmentation Algorithm Based on Residual Convolution Neural Network. Front Bioeng Biotechnol 2021; 9:786425. [PMID: 34957078 PMCID: PMC8702809 DOI: 10.3389/fbioe.2021.786425] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 11/25/2021] [Indexed: 11/26/2022] Open
Abstract
Retinal vessels are the only deep micro vessels that can be observed in human body, the accurate identification of which has great significance on the diagnosis of hypertension, diabetes and other diseases. To this end, a retinal vessel segmentation algorithm based on residual convolution neural network is proposed according to the characteristics of the retinal vessels on fundus images. Improved residual attention module and deep supervision module are utilized, in which the low-level and high-level feature graphs are joined to construct the encoder-decoder network structure, and atrous convolution is introduced to the pyramid pooling. The experiments result on the fundus image data set DRIVE and STARE show that this algorithm can obtain complete retinal vessel segmentation as well as connected vessel stems and terminals. The average accuracy on DRIVE and STARE reaches 95.90 and 96.88%, and the average specificity is 98.85 and 97.85%, which shows superior performance compared to other methods. This algorithm is verified feasible and effective for retinal vessel segmentation of fundus images and has the ability to detect more capillaries.
Collapse
Affiliation(s)
- Shuang Xu
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan, China
- Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China
| | - Zhiqiang Chen
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan, China
- Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China
| | - Weiyi Cao
- Precision Manufacturing Institute, Wuhan University of Science and Technology, Wuhan, China
| | - Feng Zhang
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan, China
- Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China
| | - Bo Tao
- Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China
- Precision Manufacturing Institute, Wuhan University of Science and Technology, Wuhan, China
| |
Collapse
|
15
|
A Hybrid Method to Enhance Thick and Thin Vessels for Blood Vessel Segmentation. Diagnostics (Basel) 2021; 11:diagnostics11112017. [PMID: 34829365 PMCID: PMC8621384 DOI: 10.3390/diagnostics11112017] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 10/25/2021] [Accepted: 10/25/2021] [Indexed: 11/16/2022] Open
Abstract
Retinal blood vessels have been presented to contribute confirmation with regard to tortuosity, branching angles, or change in diameter as a result of ophthalmic disease. Although many enhancement filters are extensively utilized, the Jerman filter responds quite effectively at vessels, edges, and bifurcations and improves the visualization of structures. In contrast, curvelet transform is specifically designed to associate scale with orientation and can be used to recover from noisy data by curvelet shrinkage. This paper describes a method to improve the performance of curvelet transform further. A distinctive fusion of curvelet transform and the Jerman filter is presented for retinal blood vessel segmentation. Mean-C thresholding is employed for the segmentation purpose. The suggested method achieves average accuracies of 0.9600 and 0.9559 for DRIVE and CHASE_DB1, respectively. Simulation results establish a better performance and faster implementation of the suggested scheme in comparison with similar approaches seen in the literature.
Collapse
|
16
|
Toptaş B, Hanbay D. Retinal blood vessel segmentation using pixel-based feature vector. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.103053] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
17
|
Valizadeh A, Jafarzadeh Ghoushchi S, Ranjbarzadeh R, Pourasad Y. Presentation of a Segmentation Method for a Diabetic Retinopathy Patient's Fundus Region Detection Using a Convolutional Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:7714351. [PMID: 34354746 PMCID: PMC8331281 DOI: 10.1155/2021/7714351] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 06/30/2021] [Accepted: 07/18/2021] [Indexed: 01/16/2023]
Abstract
Diabetic retinopathy is characteristic of a local distribution that involves early-stage risk factors and can forecast the evolution of the illness or morphological lesions related to the abnormality of retinal blood flows. Regional variations in retinal blood flow and modulation of retinal capillary width in the macular area and the retinal environment are also linked to the course of diabetic retinopathy. Despite the fact that diabetic retinopathy is frequent nowadays, it is hard to avoid. An ophthalmologist generally determines the seriousness of the retinopathy of the eye by directly examining color photos and evaluating them by visually inspecting the fundus. It is an expensive process because of the vast number of diabetic patients around the globe. We used the IDRiD data set that contains both typical diabetic retinopathic lesions and normal retinal structures. We provided a CNN architecture for the detection of the target region of 80 patients' fundus imagery. Results demonstrate that the approach described here can nearly detect 83.84% of target locations. This result can potentially be utilized to monitor and regulate patients.
Collapse
Affiliation(s)
- Amin Valizadeh
- Department of Mechanical Engineering, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Saeid Jafarzadeh Ghoushchi
- Department of Industrial Engineering, Urmia University of Technology (UUT), P.O. Box 57166-419, Urmia, Iran
| | - Ramin Ranjbarzadeh
- Department of Telecommunications Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran
| | - Yaghoub Pourasad
- Department of Electrical Engineering, Urmia University of Technology (UUT), P.O. Box 57166-419, Urmia, Iran
| |
Collapse
|
18
|
Liang L, Lan Z, Xiong W, Sheng X. Retinal Vessel Segmentation Based on W-Net Conditional Generative Adversarial Nets. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3633] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Accurate extraction of retinal vessels is one important factor to computer-aided diagnosis for ophthalmologic diseases. Due to the low sensitivity and insufficient segmentation of tiny blood vessels within the existing segmentation algorithms, a novel retinal vessel segmentation algorithm
is proposed, and its basis is on conditional generative adversarial nets, using W-net as generator. More specifically, firstly, the U-net is expanded to W-net through the skip connection, as the U-net is beneficial to the microvascular information transmission in the skip connection layer,
then the network convergence is accelerated and the parameter utilization is improved. Secondly, the standard convolutions are replaced by the depth-wise separable convolutions, thus expanding the network and reducing the number of the parameters. Thirdly, the residual blocks are employed
to mitigate the gradient disappearance and the explosion. Fourthly, during the proposed algorithm, each skip connection follows Squeeze-and-Excitation blocks so that the shallow features and deep features can be effectively fused through learning the interdependence of feature channel. Generally,
the loss function of the conditional generative adversarial nets is modified to make the overall segmentation performance be optimal, while having strong global penalty ability in the whole game learning model. Finally, one experiment is carried out on the DRIVE dataset with image enhancement
and data expansion. From the experiment results, the segmentation sensitivity reaches 87.18%, further the specificity, accuracy and AUC are 98.19%, 96.95% and 98.42% respectively, which show the overall performance and sensitivity are better than the existing algorithms.
Collapse
Affiliation(s)
- Liming Liang
- Jiangxi University of Science and Technology, School of Electrical Engineering and Automation, Ganzhou, 341000, China
| | - Zhimin Lan
- Jiangxi University of Science and Technology, School of Electrical Engineering and Automation, Ganzhou, 341000, China
| | - Wen Xiong
- Jiangxi University of Science and Technology, School of Electrical Engineering and Automation, Ganzhou, 341000, China
| | - Xiaoqi Sheng
- Jiangxi University of Science and Technology, School of Electrical Engineering and Automation, Ganzhou, 341000, China
| |
Collapse
|
19
|
Ashraf MN, Hussain M, Habib Z. Review of Various Tasks Performed in the Preprocessing Phase of a Diabetic Retinopathy Diagnosis System. Curr Med Imaging 2021; 16:397-426. [PMID: 32410541 DOI: 10.2174/1573405615666190219102427] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2018] [Revised: 12/31/2018] [Accepted: 01/20/2019] [Indexed: 12/15/2022]
Abstract
Diabetic Retinopathy (DR) is a major cause of blindness in diabetic patients. The increasing population of diabetic patients and difficulty to diagnose it at an early stage are limiting the screening capabilities of manual diagnosis by ophthalmologists. Color fundus images are widely used to detect DR lesions due to their comfortable, cost-effective and non-invasive acquisition procedure. Computer Aided Diagnosis (CAD) of DR based on these images can assist ophthalmologists and help in saving many sight years of diabetic patients. In a CAD system, preprocessing is a crucial phase, which significantly affects its performance. Commonly used preprocessing operations are the enhancement of poor contrast, balancing the illumination imbalance due to the spherical shape of a retina, noise reduction, image resizing to support multi-resolution, color normalization, extraction of a field of view (FOV), etc. Also, the presence of blood vessels and optic discs makes the lesion detection more challenging because these two artifacts exhibit specific attributes, which are similar to those of DR lesions. Preprocessing operations can be broadly divided into three categories: 1) fixing the native defects, 2) segmentation of blood vessels, and 3) localization and segmentation of optic discs. This paper presents a review of the state-of-the-art preprocessing techniques related to three categories of operations, highlighting their significant aspects and limitations. The survey is concluded with the most effective preprocessing methods, which have been shown to improve the accuracy and efficiency of the CAD systems.
Collapse
Affiliation(s)
| | - Muhammad Hussain
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Zulfiqar Habib
- Department of Computer Science, COMSATS University Islamabad, Lahore, Pakistan
| |
Collapse
|
20
|
Blood Vessel Segmentation of Fundus Retinal Images Based on Improved Frangi and Mathematical Morphology. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:4761517. [PMID: 34122614 PMCID: PMC8172282 DOI: 10.1155/2021/4761517] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 05/09/2021] [Accepted: 05/17/2021] [Indexed: 11/25/2022]
Abstract
An improved blood vessel segmentation algorithm on the basis of traditional Frangi filtering and the mathematical morphological method was proposed to solve the low accuracy of automatic blood vessel segmentation of fundus retinal images and high complexity of algorithms. First, a global enhanced image was generated by using the contrast-limited adaptive histogram equalization algorithm of the retinal image. An improved Frangi Hessian model was constructed by introducing the scale equivalence factor and eigenvector direction angle of the Hessian matrix into the traditional Frangi filtering algorithm to enhance blood vessels of the global enhanced image. Next, noise interferences surrounding small blood vessels were eliminated through the improved mathematical morphological method. Then, blood vessels were segmented using the Otsu threshold method. The improved algorithm was tested by the public DRIVE and STARE data sets. According to the test results, the average segmentation accuracy, sensitivity, and specificity of retinal images in DRIVE and STARE are 95.54%, 69.42%, and 98.02% and 94.92%, 70.19%, and 97.71%, respectively. The improved algorithm achieved high average segmentation accuracy and low complexity while promising segmentation sensitivity. This improved algorithm can segment retinal vessels more accurately than other algorithms.
Collapse
|
21
|
Mao Q, Zhao S, Tong D, Su S, Li Z, Cheng X. Hessian-MRLoG: Hessian information and multi-scale reverse LoG filter for pulmonary nodule detection. Comput Biol Med 2021; 131:104272. [PMID: 33636420 DOI: 10.1016/j.compbiomed.2021.104272] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 02/02/2021] [Accepted: 02/06/2021] [Indexed: 12/29/2022]
Abstract
Computer-aided detection (CADe) of pulmonary nodules is an effective approach for early detection of lung cancer. However, due to the low contrast of lung computed tomography (CT) images, the interference of blood vessels and classifications, CADe has the problems of low detection rate and high false-positive rate (FPR). To solve these problems, a novel method using Hessian information and multi-scale reverse Laplacian of Gaussian (LoG) (Hessian-MRLoG) is proposed and developed in this work. Also, since the intensity distribution of the LoG operator and the lung nodule in CT images are inconsistent, and their shapes are mismatched, a multi-scale reverse Laplacian of Gaussian (MRLoG) is constructed. In addition, in order to enhance the effectiveness of target detection, the second-order partial derivatives of MRLoG are partially adjusted by introducing an adjustment factor. On this basis, the Hessian-MRLoG model is developed, and a novel elliptic filter is designed. Ultimately, in this study, the method of Hessian-MRLoG filtering is proposed and developed for pulmonary nodule detection. To verify its effectiveness and accuracy, the proposed method was used to analyze the LUNA16 dataset. The experimental results revealed that the proposed method had an accuracy of 93.6% and produced 1.0 false positives per scan (FPs/scan), indicating that the proposed method can improve the detection rate and significantly reduce the FPR. Therefore, the proposed method has the potential for application in the detection, localization and labeling of other lesion areas.
Collapse
Affiliation(s)
- Qi Mao
- School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, 201620, China; College of Information Science and Technology, Donghua University, Shanghai, 201620, China.
| | - Shuguang Zhao
- College of Information Science and Technology, Donghua University, Shanghai, 201620, China
| | - Dongbing Tong
- School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, 201620, China
| | - Shengchao Su
- School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, 201620, China
| | - Zhiwei Li
- School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, 201620, China; College of Information Science and Technology, Donghua University, Shanghai, 201620, China
| | - Xiang Cheng
- Computer Department, Jingdezhen Ceramic Institute, Jingdezhen, 333403, China
| |
Collapse
|
22
|
Towards Automated Eye Diagnosis: An Improved Retinal Vessel Segmentation Framework Using Ensemble Block Matching 3D Filter. Diagnostics (Basel) 2021; 11:diagnostics11010114. [PMID: 33445723 PMCID: PMC7828181 DOI: 10.3390/diagnostics11010114] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2020] [Revised: 01/07/2021] [Accepted: 01/08/2021] [Indexed: 12/11/2022] Open
Abstract
Automated detection of vision threatening eye disease based on high resolution retinal fundus images requires accurate segmentation of the blood vessels. In this regard, detection and segmentation of finer vessels, which are obscured by a considerable degree of noise and poor illumination, is particularly challenging. These noises include (systematic) additive noise and multiplicative (speckle) noise, which arise due to various practical limitations of the fundus imaging systems. To address this inherent issue, we present an efficient unsupervised vessel segmentation strategy as a step towards accurate classification of eye diseases from the noisy fundus images. To that end, an ensemble block matching 3D (BM3D) speckle filter is proposed for removal of unwanted noise leading to improved detection. The BM3D-speckle filter, despite its ability to recover finer details (i.e., vessels in fundus images), yields a pattern of checkerboard artifacts in the aftermath of multiplicative (speckle) noise removal. These artifacts are generally ignored in the case of satellite images; however, in the case of fundus images, these artifacts have a degenerating effect on the segmentation or detection of fine vessels. To counter that, an ensemble of BM3D-speckle filter is proposed to suppress these artifacts while further sharpening the recovered vessels. This is subsequently used to devise an improved unsupervised segmentation strategy that can detect fine vessels even in the presence of dominant noise and yields an overall much improved accuracy. Testing was carried out on three publicly available databases namely Structured Analysis of the Retina (STARE), Digital Retinal Images for Vessel Extraction (DRIVE) and CHASE_DB1. We have achieved a sensitivity of 82.88, 81.41 and 82.03 on DRIVE, SATARE, and CHASE_DB1, respectively. The accuracy is also boosted to 95.41, 95.70 and 95.61 on DRIVE, SATARE, and CHASE_DB1, respectively. The performance of the proposed methods on images with pathologies was observed to be more convincing than the performance of similar state-of-the-art methods.
Collapse
|
23
|
Retinal blood vessels segmentation using classical edge detection filters and the neural network. INFORMATICS IN MEDICINE UNLOCKED 2021. [DOI: 10.1016/j.imu.2021.100521] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
|
24
|
A Hybrid Unsupervised Approach for Retinal Vessel Segmentation. BIOMED RESEARCH INTERNATIONAL 2020; 2020:8365783. [PMID: 33381585 PMCID: PMC7749777 DOI: 10.1155/2020/8365783] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Accepted: 11/26/2020] [Indexed: 12/04/2022]
Abstract
Retinal vessel segmentation (RVS) is a significant source of useful information for monitoring, identification, initial medication, and surgical development of ophthalmic disorders. Most common disorders, i.e., stroke, diabetic retinopathy (DR), and cardiac diseases, often change the normal structure of the retinal vascular network. A lot of research has been committed to building an automatic RVS system. But, it is still an open issue. In this article, a framework is recommended for RVS with fast execution and competing outcomes. An initial binary image is obtained by the application of the MISODATA on the preprocessed image. For vessel structure enhancement, B-COSFIRE filters are utilized along with thresholding to obtain another binary image. These two binary images are combined by logical AND-type operation. Then, it is fused with the enhanced image of B-COSFIRE filters followed by thresholding to obtain the vessel location map (VLM). The methodology is verified on four different datasets: DRIVE, STARE, HRF, and CHASE_DB1, which are publicly accessible for benchmarking and validation. The obtained results are compared with the existing competing methods.
Collapse
|
25
|
Yang J, Huang M, Fu J, Lou C, Feng C. Frangi based multi-scale level sets for retinal vascular segmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105752. [PMID: 32971487 DOI: 10.1016/j.cmpb.2020.105752] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Accepted: 09/05/2020] [Indexed: 06/11/2023]
Abstract
Retinal vascular disease has always been the focus of medical attention. However, segmentation of the retinal vessels from fundus images is still an open problem due to intensity inhomogeneity in the image and thickness diversity of the retinal vessels. In this paper, we propose Frangi based multi-scale level sets to segment retinal vessels from fundus images. Vascular structures are first enhanced by the Frangi filter with local optimal scales being obtained at the same time. The enhanced image and local optimal scales are taken considered as inputs of the proposed level set models. Effectiveness of the proposed multi-scale level sets to their scale fixed versions has been evaluated using DRIVE and STARE image repositories. In addition, the proposed level set models have been tested on the DRIVE and STARE images. Experiments show that the proposed models produce segmentation accuracy at the same level with state-of-the-art methods.
Collapse
Affiliation(s)
- Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image (MIIC), Ministry of Education, Northeastern University, Shenyang, Liaoning 110169, China; School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning 110169, China
| | - Mingxu Huang
- Key Laboratory of Intelligent Computing in Medical Image (MIIC), Ministry of Education, Northeastern University, Shenyang, Liaoning 110169, China; School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning 110169, China
| | - Jie Fu
- Key Laboratory of Medical Image Computing (MIC), Liaoning Province, Shenyang, Liaoning 110169, China; School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning 110169, China
| | - Chunhui Lou
- Key Laboratory of Intelligent Computing in Medical Image (MIIC), Ministry of Education, Northeastern University, Shenyang, Liaoning 110169, China; School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning 110169, China
| | - Chaolu Feng
- Key Laboratory of Intelligent Computing in Medical Image (MIIC), Ministry of Education, Northeastern University, Shenyang, Liaoning 110169, China; Key Laboratory of Medical Image Computing (MIC), Liaoning Province, Shenyang, Liaoning 110169, China; School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning 110169, China.
| |
Collapse
|
26
|
Mookiah MRK, Hogg S, MacGillivray TJ, Prathiba V, Pradeepa R, Mohan V, Anjana RM, Doney AS, Palmer CNA, Trucco E. A review of machine learning methods for retinal blood vessel segmentation and artery/vein classification. Med Image Anal 2020; 68:101905. [PMID: 33385700 DOI: 10.1016/j.media.2020.101905] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 11/10/2020] [Accepted: 11/11/2020] [Indexed: 12/20/2022]
Abstract
The eye affords a unique opportunity to inspect a rich part of the human microvasculature non-invasively via retinal imaging. Retinal blood vessel segmentation and classification are prime steps for the diagnosis and risk assessment of microvascular and systemic diseases. A high volume of techniques based on deep learning have been published in recent years. In this context, we review 158 papers published between 2012 and 2020, focussing on methods based on machine and deep learning (DL) for automatic vessel segmentation and classification for fundus camera images. We divide the methods into various classes by task (segmentation or artery-vein classification), technique (supervised or unsupervised, deep and non-deep learning, hand-crafted methods) and more specific algorithms (e.g. multiscale, morphology). We discuss advantages and limitations, and include tables summarising results at-a-glance. Finally, we attempt to assess the quantitative merit of DL methods in terms of accuracy improvement compared to other methods. The results allow us to offer our views on the outlook for vessel segmentation and classification for fundus camera images.
Collapse
Affiliation(s)
| | - Stephen Hogg
- VAMPIRE project, Computing (SSEN), University of Dundee, Dundee DD1 4HN, UK
| | - Tom J MacGillivray
- VAMPIRE project, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh EH16 4SB, UK
| | - Vijayaraghavan Prathiba
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Rajendra Pradeepa
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Viswanathan Mohan
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Ranjit Mohan Anjana
- Madras Diabetes Research Foundation and Dr. Mohan's Diabetes Specialities Centre, Gopalapuram, Chennai 600086, India
| | - Alexander S Doney
- Division of Population Health and Genomics, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, UK
| | - Colin N A Palmer
- Division of Population Health and Genomics, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, UK
| | - Emanuele Trucco
- VAMPIRE project, Computing (SSEN), University of Dundee, Dundee DD1 4HN, UK
| |
Collapse
|
27
|
Escorcia-Gutierrez J, Torrents-Barrena J, Gamarra M, Romero-Aroca P, Valls A, Puig D. Convexity shape constraints for retinal blood vessel segmentation and foveal avascular zone detection. Comput Biol Med 2020; 127:104049. [PMID: 33099218 DOI: 10.1016/j.compbiomed.2020.104049] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 10/06/2020] [Accepted: 10/07/2020] [Indexed: 11/17/2022]
Abstract
Diabetic retinopathy (DR) has become a major worldwide health problem due to the increase in blindness among diabetics at early ages. The detection of DR pathologies such as microaneurysms, hemorrhages and exudates through advanced computational techniques is of utmost importance in patient health care. New computer vision techniques are needed to improve upon traditional screening of color fundus images. The segmentation of the entire anatomical structure of the retina is a crucial phase in detecting these pathologies. This work proposes a novel framework for fast and fully automatic blood vessel segmentation and fovea detection. The preprocessing method involved both contrast limited adaptive histogram equalization and the brightness preserving dynamic fuzzy histogram equalization algorithms to enhance image contrast and eliminate noise artifacts. Afterwards, the color spaces and their intrinsic components were examined to identify the most suitable color model to reveal the foreground pixels against the entire background. Several samples were then collected and used by the renowned convexity shape prior segmentation algorithm. The proposed methodology achieved an average vasculature segmentation accuracy exceeding 96%, 95%, 98% and 94% for the DRIVE, STARE, HRF and Messidor publicly available datasets, respectively. An additional validation step reached an average accuracy of 94.30% using an in-house dataset provided by the Hospital Sant Joan of Reus (Spain). Moreover, an outstanding detection accuracy of over 98% was achieved for the foveal avascular zone. An extensive state-of-the-art comparison was also conducted. The proposed approach can thus be integrated into daily clinical practice to assist medical experts in the diagnosis of DR.
Collapse
Affiliation(s)
- José Escorcia-Gutierrez
- Electronic and Telecommunications Program, Universidad Autónoma Del Caribe, Barranquilla, Colombia; Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Jordina Torrents-Barrena
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Margarita Gamarra
- Departament of Computational Science and Electronic, Universidad de La Costa, CUC, Barranquilla, Colombia
| | - Pedro Romero-Aroca
- Ophthalmology Service, Universitari Hospital Sant Joan, Institut de Investigacio Sanitaria Pere Virgili [IISPV], Reus, Spain
| | - Aida Valls
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Domenec Puig
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| |
Collapse
|
28
|
Shoba SG, Therese AB. Detection of glaucoma disease in fundus images based on morphological operation and finite element method. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101986] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
29
|
Noah Akande O, Christiana Abikoye O, Anthonia Kayode A, Lamari Y. Implementation of a Framework for Healthy and Diabetic Retinopathy Retinal Image Recognition. SCIENTIFICA 2020; 2020:4972527. [PMID: 32509373 PMCID: PMC7254094 DOI: 10.1155/2020/4972527] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2019] [Accepted: 04/10/2020] [Indexed: 06/11/2023]
Abstract
The feature extraction stage remains a major component of every biometric recognition system. In most instances, the eventual accuracy of a recognition system is dependent on the features extracted from the biometric trait and the feature extraction technique adopted. The widely adopted technique employs features extracted from healthy retinal images in training retina recognition system. However, literature has shown that certain eye diseases such as diabetic retinopathy (DR), hypertensive retinopathy, glaucoma, and cataract could alter the recognition accuracy of the retina recognition system. This connotes that a robust retina recognition system should be designed to accommodate healthy and diseased retinal images. A framework with two different approaches for retina image recognition is presented in this study. The first approach employed structural features for healthy retinal image recognition while the second employed vascular and lesion-based features for DR retinal image recognition. Any input retinal image was first examined for the presence of DR symptoms before the appropriate feature extraction technique was adopted. Recognition rates of 100% and 97.23% were achieved for the healthy and DR retinal images, respectively, and a false acceptance rate of 0.0444 and a false rejection rate of 0.0133 were also achieved.
Collapse
Affiliation(s)
| | | | | | - Yema Lamari
- Computer Science Department, University of Carthage, Tunis, Tunisia
| |
Collapse
|
30
|
Shukla AK, Pandey RK, Pachori RB. A fractional filter based efficient algorithm for retinal blood vessel segmentation. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101883] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
31
|
Abstract
The steepest descent method is frequently used for neural network tuning. Mini-batches are commonly used to get better tuning of the steepest descent in the neural network. Nevertheless, steepest descent with mini-batches could be delayed in reaching a minimum. The Hessian could be quicker than the steepest descent in reaching a minimum, and it is easier to achieve this goal by using the Hessian with mini-batches. In this article, the Hessian is combined with mini-batches for neural network tuning. The discussed algorithm is applied for electrical demand prediction.
Collapse
|
32
|
Automated detection of optic disc contours in fundus images using decision tree classifier. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2019.11.003] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
33
|
Zhang Y, Lian J, Rong L, Jia W, Li C, Zheng Y. Even faster retinal vessel segmentation via accelerated singular value decomposition. Neural Comput Appl 2019. [DOI: 10.1007/s00521-019-04505-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
34
|
Arsalan M, Owais M, Mahmood T, Cho SW, Park KR. Aiding the Diagnosis of Diabetic and Hypertensive Retinopathy Using Artificial Intelligence-Based Semantic Segmentation. J Clin Med 2019; 8:E1446. [PMID: 31514466 PMCID: PMC6780110 DOI: 10.3390/jcm8091446] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Revised: 09/04/2019] [Accepted: 09/07/2019] [Indexed: 12/13/2022] Open
Abstract
Automatic segmentation of retinal images is an important task in computer-assisted medical image analysis for the diagnosis of diseases such as hypertension, diabetic and hypertensive retinopathy, and arteriosclerosis. Among the diseases, diabetic retinopathy, which is the leading cause of vision detachment, can be diagnosed early through the detection of retinal vessels. The manual detection of these retinal vessels is a time-consuming process that can be automated with the help of artificial intelligence with deep learning. The detection of vessels is difficult due to intensity variation and noise from non-ideal imaging. Although there are deep learning approaches for vessel segmentation, these methods require many trainable parameters, which increase the network complexity. To address these issues, this paper presents a dual-residual-stream-based vessel segmentation network (Vess-Net), which is not as deep as conventional semantic segmentation networks, but provides good segmentation with few trainable parameters and layers. The method takes advantage of artificial intelligence for semantic segmentation to aid the diagnosis of retinopathy. To evaluate the proposed Vess-Net method, experiments were conducted with three publicly available datasets for vessel segmentation: digital retinal images for vessel extraction (DRIVE), the Child Heart Health Study in England (CHASE-DB1), and structured analysis of retina (STARE). Experimental results show that Vess-Net achieved superior performance for all datasets with sensitivity (Se), specificity (Sp), area under the curve (AUC), and accuracy (Acc) of 80.22%, 98.1%, 98.2%, and 96.55% for DRVIE; 82.06%, 98.41%, 98.0%, and 97.26% for CHASE-DB1; and 85.26%, 97.91%, 98.83%, and 96.97% for STARE dataset.
Collapse
Affiliation(s)
- Muhammad Arsalan
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea.
| | - Muhammad Owais
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea.
| | - Tahir Mahmood
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea.
| | - Se Woon Cho
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea.
| | - Kang Ryoung Park
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea.
| |
Collapse
|
35
|
Robust intensity variation and inverse surface adaptive thresholding techniques for detection of optic disc and exudates in retinal fundus images. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.07.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
36
|
Primitivo D, Alma R, Erik C, Arturo V, Edgar C, Marco PC, Daniel Z. A hybrid method for blood vessel segmentation in images. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.06.009] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
37
|
Uribe-Valencia LJ, Martínez-Carballido JF. Automated Optic Disc region location from fundus images: Using local multi-level thresholding, best channel selection, and an Intensity Profile Model. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.02.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
38
|
Hashemzadeh M, Adlpour Azar B. Retinal blood vessel extraction employing effective image features and combination of supervised and unsupervised machine learning methods. Artif Intell Med 2019; 95:1-15. [PMID: 30904129 DOI: 10.1016/j.artmed.2019.03.001] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2018] [Revised: 12/08/2018] [Accepted: 03/01/2019] [Indexed: 11/30/2022]
Abstract
In medicine, retinal vessel analysis of fundus images is a prominent task for the screening and diagnosis of various ophthalmological and cardiovascular diseases. In this research, a method is proposed for extracting the retinal blood vessels employing a set of effective image features and combination of supervised and unsupervised machine learning techniques. Further to the common features used in extracting blood vessels, three strong features having a significant influence on the accuracy of the vessel extraction are utilized. The selected combination of the different types of individually efficient features results in a rich local information with better discrimination for vessel and non-vessel pixels. The proposed method first extracts the thick and clear vessels in an unsupervised manner, and then, it extracts the thin vessels in a supervised way. The goal of the combination of the supervised and unsupervised methods is to deal with the problem of intra-class high variance of image features calculated from various vessel pixels. The proposed method is evaluated on three publicly available databases DRIVE, STARE and CHASE_DB1. The obtained results (DRIVE: Acc = 0.9531, AUC = 0.9752; STARE: Acc = 0.9691, AUC = 0.9853; CHASE_DB1: Acc = 0.9623, AUC = 0.9789) demonstrate the better performance of the proposed method compared to the state-of-the-art methods.
Collapse
Affiliation(s)
- Mahdi Hashemzadeh
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz-Azarshahr Road, 5375171379, Tabriz, Iran.
| | - Baharak Adlpour Azar
- Department of Computer Engineering, Tabriz Branch, Azad University, Tabriz, Iran.
| |
Collapse
|
39
|
Diabetic retinopathy techniques in retinal images: A review. Artif Intell Med 2018; 97:168-188. [PMID: 30448367 DOI: 10.1016/j.artmed.2018.10.009] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 10/08/2018] [Accepted: 10/24/2018] [Indexed: 12/23/2022]
Abstract
The diabetic retinopathy is the main reason of vision loss in people. Medical experts recognize some clinical, geometrical and haemodynamic features of diabetic retinopathy. These features include the blood vessel area, exudates, microaneurysm, hemorrhages and neovascularization, etc. In Computer Aided Diagnosis (CAD) systems, these features are detected in fundus images using computer vision techniques. In this paper, we review the methods of low, middle and high level vision for automatic detection and classification of diabetic retinopathy.We give a detailed review of 79 algorithms for detecting different features of diabetic retinopathy during the last eight years.
Collapse
|
40
|
Srinidhi CL, Aparna P, Rajan J. A visual attention guided unsupervised feature learning for robust vessel delineation in retinal images. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.04.016] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
41
|
Automated fuzzy optic disc detection algorithm using branching of vessels and color properties in fundus images. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.08.003] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
42
|
Muangnak N, Aimmanee P, Makhanov S. Automatic optic disk detection in retinal images using hybrid vessel phase portrait analysis. Med Biol Eng Comput 2017; 56:583-598. [PMID: 28836125 DOI: 10.1007/s11517-017-1705-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Accepted: 08/03/2017] [Indexed: 01/23/2023]
Abstract
We propose vessel vector-based phase portrait analysis (VVPPA) and a hybrid between VVPPA and a clustering method proposed earlier for automatic optic disk (OD) detection called the vessel transform (VT). The algorithms are based primarily on the location and direction of retinal blood vessels and work equally well on fine and poor quality images. To localize the OD, the direction vectors derived from the vessel network are constructed, and points of convergence of the resulting vector field are examined by phase portrait analysis. The hybrid method (HM) uses a set of rules acquired from the decision model to alternate the use of VVPPA and VT. To identify the OD contour, the scale space (SS) approach is integrated with VVPPA, HM, and the circular approximation (SSVVPPAC and SSHMC). We test the proposed combination against state-of-the-art OD detection methods. The results show that the proposed algorithms outperform the benchmark methods, especially on poor quality images. Specifically, the HM gets the highest accuracy of 98% for localization of the OD regardless of the image quality. Testing the segmentation routines SSVVPPAC and SSHMC against the conventional methods shows that SSHMC performs better than the existing methods, achieving the highest PPV of 71.81% and the highest sensitivity of 70.67% for poor quality images. Furthermore, the HM can supplement practically any segmentation model as long as it offers multiple OD candidates. In order to prove this claim, we test the efficiency of the HM in detecting retinal abnormalities in a real clinical setting. The images have been obtained by portable lens connected to a smart phone. In detecting the abnormalities related to diabetic retinopathy (DR), the algorithm provided 94.67 and 98.13% for true negatives and true positives, respectively.
Collapse
Affiliation(s)
- Nittaya Muangnak
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand
| | - Pakinee Aimmanee
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand.
| | - Stanislav Makhanov
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand
| |
Collapse
|