1
|
Das D, Biswas SK, Bandyopadhyay S. A critical review on diagnosis of diabetic retinopathy using machine learning and deep learning. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:25613-25655. [PMID: 35342328 PMCID: PMC8940593 DOI: 10.1007/s11042-022-12642-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 06/29/2021] [Accepted: 02/09/2022] [Indexed: 06/12/2023]
Abstract
Diabetic Retinopathy (DR) is a health condition caused due to Diabetes Mellitus (DM). It causes vision problems and blindness due to disfigurement of human retina. According to statistics, 80% of diabetes patients battling from long diabetic period of 15 to 20 years, suffer from DR. Hence, it has become a dangerous threat to the health and life of people. To overcome DR, manual diagnosis of the disease is feasible but overwhelming and cumbersome at the same time and hence requires a revolutionary method. Thus, such a health condition necessitates primary recognition and diagnosis to prevent DR from developing into severe stages and prevent blindness. Innumerable Machine Learning (ML) models are proposed by researchers across the globe, to achieve this purpose. Various feature extraction techniques are proposed for extraction of DR features for early detection. However, traditional ML models have shown either meagre generalization throughout feature extraction and classification for deploying smaller datasets or consumes more of training time causing inefficiency in prediction while using larger datasets. Hence Deep Learning (DL), a new domain of ML, is introduced. DL models can handle a smaller dataset with help of efficient data processing techniques. However, they generally incorporate larger datasets for their deep architectures to enhance performance in feature extraction and image classification. This paper gives a detailed review on DR, its features, causes, ML models, state-of-the-art DL models, challenges, comparisons and future directions, for early detection of DR.
Collapse
Affiliation(s)
- Dolly Das
- National Institute of Technology Silchar, Cachar, Assam India
| | | | | |
Collapse
|
2
|
Khaing TT, Aimmanee P, Makhanov S, Haneishi H. Vessel-based hybrid optic disk segmentation applied to mobile phone camera retinal images. Med Biol Eng Comput 2022; 60:421-437. [PMID: 34988764 DOI: 10.1007/s11517-021-02484-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 12/04/2021] [Indexed: 11/26/2022]
Abstract
Precise detection of the optic disk (OD) is an important task in the diagnosis of diabetic retinopathy. To manage the massive diabetic population, there is a significant demand for efficient and remote retinal imaging techniques. In this regard, the use of handheld mobile cameras attached to a smartphone is a promising approach. However, smartphone retinal images are often of low quality, compared to those obtained on standard equipment. They also have a narrow field of view and an incomplete/unbalanced vessel structure. Hence, we propose a new, fully automatic hybrid method for OD localization (HLM). It is designed for and verified on mobile camera/smartphone retinal images. The HLM analyzes the vessel structure and finds the OD locations by using the exclusion method when an image has a complete vessel system, and a newly proposed line detection method, otherwise. For OD segmentation, an active contour model followed by the circle fitting approach is integrated into the HLM. The proposed method was tested on three mobile camera datasets and four datasets obtained by standard equipment. For mobile camera datasets, the HLM achieves an average accuracy of 98% for OD localization. The segmentation routine obtains an average precision of 92.64% and an average recall of 82.38%. Testing against the recent state-of-the-art methods on the standard datasets shows comparable performance. The proposed framework for OD localization and segmentation designed for and verified on mobile camera retinal datasets and standard datasets. (EM - "Exclusion Method", LDM - "Line Detection Method", OD - "Optic Disk" and PPV - "Positive Predictive Value").
Collapse
Affiliation(s)
- Tin Tin Khaing
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand
- Division of Fundamental Engineering, Graduate School of Science and Engineering, Chiba University, 1-33 Yayoicho, Inage Ward, Chiba, 263-8522, Japan
| | - Pakinee Aimmanee
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand.
| | - Stanislav Makhanov
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Meung, Pathum Thani, 12000, Thailand
| | - Hideaki Haneishi
- Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoicho, Inage Ward, Chiba, 263-8522, Japan
| |
Collapse
|
3
|
Dietter J, Haq W, Ivanov IV, Norrenberg LA, Völker M, Dynowski M, Röck D, Ziemssen F, Leitritz MA, Ueffing M. Optic disc detection in the presence of strong technical artifacts. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.04.012] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
4
|
Optic Disc Localization in Complicated Environment of Retinal Image Using Circular-Like Estimation. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2019. [DOI: 10.1007/s13369-019-03756-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
5
|
Panda R, Puhan N, Rao A, Padhy D, Panda G. Automated retinal nerve fiber layer defect detection using fundus imaging in glaucoma. Comput Med Imaging Graph 2018; 66:56-65. [DOI: 10.1016/j.compmedimag.2018.02.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2017] [Revised: 01/30/2018] [Accepted: 02/27/2018] [Indexed: 10/17/2022]
|
6
|
Béouche-Hélias B, Helbert D, de Malézieu C, Leveziel N, Fernandez-Maloigne C. Neovascularization detection in diabetic retinopathy from fluorescein angiograms. J Med Imaging (Bellingham) 2017; 4:044503. [PMID: 29181431 DOI: 10.1117/1.jmi.4.4.044503] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2017] [Accepted: 10/27/2017] [Indexed: 12/29/2022] Open
Abstract
Although a lot of work has been done on optical coherence tomography and color images in order to detect and quantify diseases such as diabetic retinopathy, exudates, or neovascularizations, none of them is able to evaluate the diffusion of the neovascularizations in retinas. Our work has been to develop a tool that is able to quantify a neovascularization and the fluorescein leakage during an angiography. The proposed method has been developed following a clinical trial protocol; images are taken by a Spectralis (Heidelberg Engineering). Detections are done using a supervised classification using specific features. Images and their detected neovascularizations are then spatially matched by an image registration. We compute the expansion speed of the liquid that we call diffusion index. This last one specifies the state of the disease, permits indication of the activity of neovascularizations, and allows a follow-up of patients. The method proposed in this paper has been built to be robust, even with laser impacts, to compute a diffusion index.
Collapse
Affiliation(s)
| | - David Helbert
- XLIM-ASALI University of Poitiers, UMR CNRS 7252, Futuroscope Chasseneuil Cedex, France
| | | | - Nicolas Leveziel
- CHU Poitiers, Department of Ophthalmology, Poitiers Cedex, France
| | | |
Collapse
|
7
|
Muangnak N, Aimmanee P, Makhanov S. Automatic optic disk detection in retinal images using hybrid vessel phase portrait analysis. Med Biol Eng Comput 2017; 56:583-598. [PMID: 28836125 DOI: 10.1007/s11517-017-1705-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Accepted: 08/03/2017] [Indexed: 01/23/2023]
Abstract
We propose vessel vector-based phase portrait analysis (VVPPA) and a hybrid between VVPPA and a clustering method proposed earlier for automatic optic disk (OD) detection called the vessel transform (VT). The algorithms are based primarily on the location and direction of retinal blood vessels and work equally well on fine and poor quality images. To localize the OD, the direction vectors derived from the vessel network are constructed, and points of convergence of the resulting vector field are examined by phase portrait analysis. The hybrid method (HM) uses a set of rules acquired from the decision model to alternate the use of VVPPA and VT. To identify the OD contour, the scale space (SS) approach is integrated with VVPPA, HM, and the circular approximation (SSVVPPAC and SSHMC). We test the proposed combination against state-of-the-art OD detection methods. The results show that the proposed algorithms outperform the benchmark methods, especially on poor quality images. Specifically, the HM gets the highest accuracy of 98% for localization of the OD regardless of the image quality. Testing the segmentation routines SSVVPPAC and SSHMC against the conventional methods shows that SSHMC performs better than the existing methods, achieving the highest PPV of 71.81% and the highest sensitivity of 70.67% for poor quality images. Furthermore, the HM can supplement practically any segmentation model as long as it offers multiple OD candidates. In order to prove this claim, we test the efficiency of the HM in detecting retinal abnormalities in a real clinical setting. The images have been obtained by portable lens connected to a smart phone. In detecting the abnormalities related to diabetic retinopathy (DR), the algorithm provided 94.67 and 98.13% for true negatives and true positives, respectively.
Collapse
Affiliation(s)
- Nittaya Muangnak
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand
| | - Pakinee Aimmanee
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand.
| | - Stanislav Makhanov
- Sirindhorn International Institute of Technology, Thammasat University, 131 Moo 5, Tiwanont Road, Bangkadi, Muang, Pathum Thani, 12000, Thailand
| |
Collapse
|
8
|
Giachetti A, Ballerini L, Trucco E. Accurate and reliable segmentation of the optic disc in digital fundus images. J Med Imaging (Bellingham) 2014; 1:024001. [PMID: 26158034 DOI: 10.1117/1.jmi.1.2.024001] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2013] [Revised: 05/27/2014] [Accepted: 06/16/2014] [Indexed: 11/14/2022] Open
Abstract
We describe a complete pipeline for the detection and accurate automatic segmentation of the optic disc in digital fundus images. This procedure provides separation of vascular information and accurate inpainting of vessel-removed images, symmetry-based optic disc localization, and fitting of incrementally complex contour models at increasing resolutions using information related to inpainted images and vessel masks. Validation experiments, performed on a large dataset of images of healthy and pathological eyes, annotated by experts and partially graded with a quality label, demonstrate the good performances of the proposed approach. The method is able to detect the optic disc and trace its contours better than the other systems presented in the literature and tested on the same data. The average error in the obtained contour masks is reasonably close to the interoperator errors and suitable for practical applications. The optic disc segmentation pipeline is currently integrated in a complete software suite for the semiautomatic quantification of retinal vessel properties from fundus camera images (VAMPIRE).
Collapse
Affiliation(s)
- Andrea Giachetti
- Università di Verona , Dipartimento di Informatica, Strada Le Grazie 15 Verona 37134, Italy
| | - Lucia Ballerini
- University of Dundee , VAMPIRE, School of Computing, School of Computing, Queen Mother Building, Balfour Street, Dundee DD1 4HN, United Kingdom
| | - Emanuele Trucco
- University of Dundee , VAMPIRE, School of Computing, School of Computing, Queen Mother Building, Balfour Street, Dundee DD1 4HN, United Kingdom
| |
Collapse
|
9
|
Welfer D, Scharcanski J, Marinho DR. A morphologic two-stage approach for automated optic disk detection in color eye fundus images. Pattern Recognit Lett 2013. [DOI: 10.1016/j.patrec.2012.12.011] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
10
|
Mookiah MRK, Acharya UR, Chua CK, Min LC, Ng EYK, Mushrif MM, Laude A. Automated detection of optic disk in retinal fundus images using intuitionistic fuzzy histon segmentation. Proc Inst Mech Eng H 2012; 227:37-49. [DOI: 10.1177/0954411912458740] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The human eye is one of the most sophisticated organs, with perfectly interrelated retina, pupil, iris cornea, lens, and optic nerve. Automatic retinal image analysis is emerging as an important screening tool for early detection of eye diseases. Uncontrolled diabetic retinopathy (DR) and glaucoma may lead to blindness. The identification of retinal anatomical regions is a prerequisite for the computer-aided diagnosis of several retinal diseases. The manual examination of optic disk (OD) is a standard procedure used for detecting different stages of DR and glaucoma. In this article, a novel automated, reliable, and efficient OD localization and segmentation method using digital fundus images is proposed. General-purpose edge detection algorithms often fail to segment the OD due to fuzzy boundaries, inconsistent image contrast, or missing edge features. This article proposes a novel and probably the first method using the Attanassov intuitionistic fuzzy histon (A-IFSH)–based segmentation to detect OD in retinal fundus images. OD pixel intensity and column-wise neighborhood operation are employed to locate and isolate the OD. The method has been evaluated on 100 images comprising 30 normal, 39 glaucomatous, and 31 DR images. Our proposed method has yielded precision of 0.93, recall of 0.91, F-score of 0.92, and mean segmentation accuracy of 93.4%. We have also compared the performance of our proposed method with the Otsu and gradient vector flow (GVF) snake methods. Overall, our result shows the superiority of proposed fuzzy segmentation technique over other two segmentation methods.
Collapse
Affiliation(s)
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore
| | - Chua Kuang Chua
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore
| | - Lim Choo Min
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore
| | - EYK Ng
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore
| | - Milind M Mushrif
- Department of Electronics and Telecommunication Engineering, Y. C. College of Engineering, Nagpur, India
| | - Augustinus Laude
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore
| |
Collapse
|