1
|
Amin J, Shazadi I, Sharif M, Yasmin M, Almujally NA, Nam Y. Localization and grading of NPDR lesions using ResNet-18-YOLOv8 model and informative features selection for DR classification based on transfer learning. Heliyon 2024; 10:e30954. [PMID: 38779022 PMCID: PMC11109848 DOI: 10.1016/j.heliyon.2024.e30954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 05/04/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024] Open
Abstract
Complications in diabetes lead to diabetic retinopathy (DR) hence affecting the vision. Computerized methods performed a significant role in DR detection at the initial phase to cure vision loss. Therefore, a method is proposed in this study that consists of three models for localization, segmentation, and classification. A novel technique is designed with the combination of pre-trained ResNet-18 and YOLOv8 models based on the selection of optimum layers for the localization of DR lesions. The localized images are passed to the designed semantic segmentation model on selected layers and trained on optimized learning hyperparameters. The segmentation model performance is evaluated on the Grand-challenge IDRID segmentation dataset. The achieved results are computed in terms of mean IoU 0.95,0.94, 0.96, 0.94, and 0.95 on OD, SoftExs, HardExs, HAE, and MAs respectively. Another classification model is developed in which deep features are derived from the pre-trained Efficientnet-b0 model and optimized using a Genetic algorithm (GA) based on the selected parameters for grading of NPDR lesions. The proposed model achieved greater than 98 % accuracy which is superior to previous methods.
Collapse
Affiliation(s)
- Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Irum Shazadi
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | - Mussarat Yasmin
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | - Nouf Abdullah Almujally
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia
| | - Yunyoung Nam
- Department of ICT Convergence, Soonchunhyang University, Asan, 31538, South Korea
| |
Collapse
|
2
|
Sajid MZ, Hamid MF, Youssef A, Yasmin J, Perumal G, Qureshi I, Naqi SM, Abbas Q. DR-NASNet: Automated System to Detect and Classify Diabetic Retinopathy Severity Using Improved Pretrained NASNet Model. Diagnostics (Basel) 2023; 13:2645. [PMID: 37627904 PMCID: PMC10453689 DOI: 10.3390/diagnostics13162645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 07/25/2023] [Accepted: 08/09/2023] [Indexed: 08/27/2023] Open
Abstract
Diabetes is a widely spread disease that significantly affects people's lives. The leading cause is uncontrolled levels of blood glucose, which develop eye defects over time, including Diabetic Retinopathy (DR), which results in severe visual loss. The primary factor causing blindness is considered to be DR in diabetic patients. DR treatment tries to control the disease's severity, as it is irreversible. The primary goal of this effort is to create a reliable method for automatically detecting the severity of DR. This paper proposes a new automated system (DR-NASNet) to detect and classify DR severity using an improved pretrained NASNet Model. To develop the DR-NASNet system, we first utilized a preprocessing technique that takes advantage of Ben Graham and CLAHE to lessen noise, emphasize lesions, and ultimately improve DR classification performance. Taking into account the imbalance between classes in the dataset, data augmentation procedures were conducted to control overfitting. Next, we have integrated dense blocks into the NASNet architecture to improve the effectiveness of classification results for five severity levels of DR. In practice, the DR-NASNet model achieves state-of-the-art results with a smaller model size and lower complexity. To test the performance of the DR-NASNet system, a combination of various datasets is used in this paper. To learn effective features from DR images, we used a pretrained model on the dataset. The last step is to put the image into one of five categories: No DR, Mild, Moderate, Proliferate, or Severe. To carry this out, the classifier layer of a linear SVM with a linear activation function must be added. The DR-NASNet system was tested using six different experiments. The system achieves 96.05% accuracy with the challenging DR dataset. The results and comparisons demonstrate that the DR-NASNet system improves a model's performance and learning ability. As a result, the DR-NASNet system provides assistance to ophthalmologists by describing an effective system for classifying early-stage levels of DR.
Collapse
Affiliation(s)
- Muhammad Zaheer Sajid
- Department of Computer Software Engineering, Military College of Signals (MCS), National University of Science and Technology, Islamabad 44000, Pakistan; (M.Z.S.)
| | - Muhammad Fareed Hamid
- Department of Electrical Engineering, Military College of Signals (MCS), National University of Science and Technology, Islamabad 44000, Pakistan
| | - Ayman Youssef
- Department of Computers and Systems, Electronics Research Institute, Cairo 12622, Egypt;
| | - Javeria Yasmin
- Department of Computer Software Engineering, Military College of Signals (MCS), National University of Science and Technology, Islamabad 44000, Pakistan; (M.Z.S.)
| | - Ganeshkumar Perumal
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (G.P.); (I.Q.)
| | - Imran Qureshi
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (G.P.); (I.Q.)
| | - Syed Muhammad Naqi
- Department of Computer Science, Quaid-i-Azam University, Islamabad 44000, Pakistan;
| | - Qaisar Abbas
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (G.P.); (I.Q.)
| |
Collapse
|
3
|
Alwakid G, Gouda W, Humayun M. Enhancement of Diabetic Retinopathy Prognostication Using Deep Learning, CLAHE, and ESRGAN. Diagnostics (Basel) 2023; 13:2375. [PMID: 37510123 PMCID: PMC10378524 DOI: 10.3390/diagnostics13142375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 07/07/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023] Open
Abstract
One of the primary causes of blindness in the diabetic population is diabetic retinopathy (DR). Many people could have their sight saved if only DR were detected and treated in time. Numerous Deep Learning (DL)-based methods have been presented to improve human analysis. Using a DL model with three scenarios, this research classified DR and its severity stages from fundus images using the "APTOS 2019 Blindness Detection" dataset. Following the adoption of the DL model, augmentation methods were implemented to generate a balanced dataset with consistent input parameters across all test scenarios. As a last step in the categorization process, the DenseNet-121 model was employed. Several methods, including Enhanced Super-resolution Generative Adversarial Networks (ESRGAN), Histogram Equalization (HIST), and Contrast Limited Adaptive HIST (CLAHE), have been used to enhance image quality in a variety of contexts. The suggested model detected the DR across all five APTOS 2019 grading process phases with the highest test accuracy of 98.36%, top-2 accuracy of 100%, and top-3 accuracy of 100%. Further evaluation criteria (precision, recall, and F1-score) for gauging the efficacy of the proposed model were established with the help of APTOS 2019. Furthermore, comparing CLAHE + ESRGAN against both state-of-the-art technology and other recommended methods, it was found that its use was more effective in DR classification.
Collapse
Affiliation(s)
- Ghadah Alwakid
- Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakakah 72341, Al Jouf, Saudi Arabia
| | - Walaa Gouda
- Department of Electrical Engineering, Faculty of Engineering at Shoubra, Benha University, Cairo 11672, Egypt
| | - Mamoona Humayun
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakakah 72341, Al Jouf, Saudi Arabia
| |
Collapse
|
4
|
Nilashi M, Abumalloh RA, Alyami S, Alghamdi A, Alrizq M. A Combined Method for Diabetes Mellitus Diagnosis Using Deep Learning, Singular Value Decomposition, and Self-Organizing Map Approaches. Diagnostics (Basel) 2023; 13:diagnostics13101821. [PMID: 37238305 DOI: 10.3390/diagnostics13101821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/10/2023] [Accepted: 04/12/2023] [Indexed: 05/28/2023] Open
Abstract
Diabetes in humans is a rapidly expanding chronic disease and a major crisis in modern societies. The classification of diabetics is a challenging and important procedure that allows the interpretation of diabetic data and diagnosis. Missing values in datasets can impact the prediction accuracy of the methods for the diagnosis. Due to this, a variety of machine learning techniques has been studied in the past. This research has developed a new method using machine learning techniques for diabetes risk prediction. The method was developed through the use of clustering and prediction learning techniques. The method uses Singular Value Decomposition for missing value predictions, a Self-Organizing Map for clustering the data, STEPDISC for feature selection, and an ensemble of Deep Belief Network classifiers for diabetes mellitus prediction. The performance of the proposed method is compared with the previous prediction methods developed by machine learning techniques. The results reveal that the deployed method can accurately predict diabetes mellitus for a set of real-world datasets.
Collapse
Affiliation(s)
- Mehrbakhsh Nilashi
- UCSI Graduate Business School, UCSI University, No. 1 Jalan Menara Gading, UCSI Heights, Cheras, Kuala Lumpur 56000, Malaysia
- Centre for Global Sustainability Studies (CGSS), Universiti Sains Malaysia (USM), George Town 11800, Malaysia
| | - Rabab Ali Abumalloh
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar
| | - Sultan Alyami
- Computer Science Department, College of Computer Science and Information Systems, Najran University, Najran 55461, Saudi Arabia
| | - Abdullah Alghamdi
- Information Systems Department, College of Computer Science and Information Systems, Najran University, Najran 55461, Saudi Arabia
| | - Mesfer Alrizq
- Information Systems Department, College of Computer Science and Information Systems, Najran University, Najran 55461, Saudi Arabia
| |
Collapse
|
5
|
Alwakid G, Gouda W, Humayun M. Deep Learning-Based Prediction of Diabetic Retinopathy Using CLAHE and ESRGAN for Enhancement. Healthcare (Basel) 2023; 11:healthcare11060863. [PMID: 36981520 PMCID: PMC10048517 DOI: 10.3390/healthcare11060863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 03/11/2023] [Accepted: 03/13/2023] [Indexed: 03/17/2023] Open
Abstract
Vision loss can be avoided if diabetic retinopathy (DR) is diagnosed and treated promptly. The main five DR stages are none, moderate, mild, proliferate, and severe. In this study, a deep learning (DL) model is presented that diagnoses all five stages of DR with more accuracy than previous methods. The suggested method presents two scenarios: case 1 with image enhancement using a contrast limited adaptive histogram equalization (CLAHE) filtering algorithm in conjunction with an enhanced super-resolution generative adversarial network (ESRGAN), and case 2 without image enhancement. Augmentation techniques were then performed to generate a balanced dataset utilizing the same parameters for both cases. Using Inception-V3 applied to the Asia Pacific Tele-Ophthalmology Society (APTOS) datasets, the developed model achieved an accuracy of 98.7% for case 1 and 80.87% for case 2, which is greater than existing methods for detecting the five stages of DR. It was demonstrated that using CLAHE and ESRGAN improves a model’s performance and learning ability.
Collapse
Affiliation(s)
- Ghadah Alwakid
- Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakakah 72341, Al Jouf, Saudi Arabia;
| | - Walaa Gouda
- Department of Electrical Engineering, Faculty of Engineering at Shoubra, Benha University, Cairo 11672, Egypt;
| | - Mamoona Humayun
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakakah 72341, Al Jouf, Saudi Arabia
- Correspondence:
| |
Collapse
|
6
|
Panda SP, Reddy PH, Gorla US, Prasanth D. Neuroinflammation and neovascularization in diabetic eye diseases (DEDs): identification of potential pharmacotherapeutic targets. Mol Biol Rep 2023; 50:1857-1869. [PMID: 36513866 DOI: 10.1007/s11033-022-08113-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 11/09/2022] [Indexed: 12/15/2022]
Abstract
The goal of this review is to increase public knowledge of the etiopathogenesis of diabetic eye diseases (DEDs), such as diabetic retinopathy (DR) and ocular angiosarcoma (ASO), and the likelihood of blindness among elderly widows. A widow's life in North India, in general, is fraught with peril because of the economic and social isolation it brings, as well as the increased risk of death from heart disease, hypertension, diabetes, depression, and dementia. Neovascularization, neuroinflammation, and edema in the ocular tissue are hallmarks of the ASO, a rare form of malignant tumor. When diabetes, hypertension, and aging all contribute to increased oxidative stress, the DR can proceed to ASO. Microglia in the retina of the optic nerve head are responsible for causing inflammation, discomfort, and neurodegeneration. Those that come into contact with them will get blind as a result of this. Advanced glycation end products (AGE), vascular endothelial growth factor (VEGF), protein kinase C (PKC), poly-ADP-ribose polymerase (PARP), metalloproteinase9 (MMP9), nuclear factor kappaB (NFkB), program death ligand1 (PDL-1), factor VIII (FVIII), and von Willebrand factor (VWF) are potent agents for ocular neovascularisation (ONV), neuroinflammation and edema in the ocular tissue. AGE/VEGF, DAG/PKC, PARP/NFkB, RAS/VEGF, PDL-1/PD-1, VWF/FVIII/VEGF, and RAS/VEGF are all linked to the pathophysiology of DEDs. The interaction between ONV and ASO is mostly determined by the VWF/FVIII/VEGF and PDL-1/PD-1 axis. This study focused on retinoprotective medications that can pass the blood-retinal barrier and cure DEDs, as well as the factors that influence the etiology of neovascularization and neuroinflammation in the eye.
Collapse
Affiliation(s)
- Siva Prasad Panda
- Pharmacology Research Division, Institute of Pharmaceutical Research, GLA University, 281406, Mathura, Uttar Pradesh, India.
| | - P Hemachandra Reddy
- Department of Internal Medicine, Texas Tech University Health Sciences Center, 79430, Lubbock, TX, USA
- Department of Pharmacology and Neuroscience, Texas Tech University Health Sciences Center, 79430, Lubbock, TX, USA
- Department of Neurology, Texas Tech University Health Sciences Center, 79430, Lubbock, TX, USA
- Department of Public Health, Graduate School of Biomedical Sciences, Texas Tech University Health Sciences Center, 79430, Lubbock, TX, USA
- Department of Speech, Language, and Hearing Sciences, Texas Tech University Health Sciences Center, 79430, Lubbock, TX, USA
| | - Uma Sankar Gorla
- College of Pharmacy, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Guntur, AP, India
| | - Dsnbk Prasanth
- Department of Pharmacognosy, KVSR Siddhartha College of Pharmaceutical Sciences, Vijayawada, AP, India
| |
Collapse
|
7
|
Selvachandran G, Quek SG, Paramesran R, Ding W, Son LH. Developments in the detection of diabetic retinopathy: a state-of-the-art review of computer-aided diagnosis and machine learning methods. Artif Intell Rev 2023; 56:915-964. [PMID: 35498558 PMCID: PMC9038999 DOI: 10.1007/s10462-022-10185-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/04/2022] [Indexed: 02/02/2023]
Abstract
The exponential increase in the number of diabetics around the world has led to an equally large increase in the number of diabetic retinopathy (DR) cases which is one of the major complications caused by diabetes. Left unattended, DR worsens the vision and would lead to partial or complete blindness. As the number of diabetics continue to increase exponentially in the coming years, the number of qualified ophthalmologists need to increase in tandem in order to meet the demand for screening of the growing number of diabetic patients. This makes it pertinent to develop ways to automate the detection process of DR. A computer aided diagnosis system has the potential to significantly reduce the burden currently placed on the ophthalmologists. Hence, this review paper is presented with the aim of summarizing, classifying, and analyzing all the recent development on automated DR detection using fundus images from 2015 up to this date. Such work offers an unprecedentedly thorough review of all the recent works on DR, which will potentially increase the understanding of all the recent studies on automated DR detection, particularly on those that deploys machine learning algorithms. Firstly, in this paper, a comprehensive state-of-the-art review of the methods that have been introduced in the detection of DR is presented, with a focus on machine learning models such as convolutional neural networks (CNN) and artificial neural networks (ANN) and various hybrid models. Each AI will then be classified according to its type (e.g. CNN, ANN, SVM), its specific task(s) in performing DR detection. In particular, the models that deploy CNN will be further analyzed and classified according to some important properties of the respective CNN architectures of each model. A total of 150 research articles related to the aforementioned areas that were published in the recent 5 years have been utilized in this review to provide a comprehensive overview of the latest developments in the detection of DR. Supplementary Information The online version contains supplementary material available at 10.1007/s10462-022-10185-6.
Collapse
Affiliation(s)
- Ganeshsree Selvachandran
- Department of Actuarial Science and Applied Statistics, Faculty of Business & Management, UCSI University, Jalan Menara Gading, Cheras, 56000 Kuala Lumpur, Malaysia
| | - Shio Gai Quek
- Department of Actuarial Science and Applied Statistics, Faculty of Business & Management, UCSI University, Jalan Menara Gading, Cheras, 56000 Kuala Lumpur, Malaysia
| | - Raveendran Paramesran
- Institute of Computer Science and Digital Innovation, UCSI University, Jalan Menara Gading, Cheras, 56000 Kuala Lumpur, Malaysia
| | - Weiping Ding
- School of Information Science and Technology, Nantong University, Nantong, 226019 People’s Republic of China
| | - Le Hoang Son
- VNU Information Technology Institute, Vietnam National University, Hanoi, Vietnam
| |
Collapse
|
8
|
Saleem S, Amin J, Sharif M, Mallah GA, Kadry S, Gandomi AH. Leukemia segmentation and classification: A comprehensive survey. Comput Biol Med 2022; 150:106028. [PMID: 36126356 DOI: 10.1016/j.compbiomed.2022.106028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 07/11/2022] [Accepted: 08/20/2022] [Indexed: 11/30/2022]
Abstract
Blood is made up of leukocytes (WBCs), erythrocytes (RBCs), and thrombocytes. The ratio of blood cancer diseases is increasing rapidly, among which leukemia is one of the famous cancer which may lead to death. Leukemia cancer is initiated by the unnecessary growth of immature WBCs present in the sponge tissues of bone marrow. It is generally analyzed by etiologists by perceiving slides of blood smear images under a microscope. The morphological features and blood cells count facilitated the etiologists to detect leukemia. Due to the late detection and expensive instruments used for leukemia analysis, the death rate has risen significantly. The fluorescence-based cell sorting technique and manual recounts using a hemocytometer are error-prone and imprecise. Leukemia detection methods consist of pre-processing, segmentation, features extraction, and classification. In this article, recent deep learning methodologies and challenges for leukemia detection are discussed. These methods are helpful to examine the microscopic blood smears images and for the detection of leukemia more accurately.
Collapse
Affiliation(s)
- Saba Saleem
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | | | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, Kristiansand, Norway; Department of Electrical and Computer Engineering, Lebanese American University, Byblos, Lebanon
| | - Amir H Gandomi
- Faculty of Engineering & Information Technology, University of Technology Sydney, Ultimo, NSW, 2007, Australia.
| |
Collapse
|
9
|
Umer MJ, Sharif MI. A Comprehensive Survey on Quantum Machine Learning and Possible Applications. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS 2022. [DOI: 10.4018/ijehmc.315730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Machine learning is a branch of artificial intelligence that is being used at a large scale to solve science, engineering, and medical tasks. Quantum computing is an emerging technology that has a very high computational ability to solve complex problems. Classical machine learning with traditional systems has some limitations for problem-solving due to a large amount of data availability. Quantum machine learning has high performance and computational ability that can effectively be used to solve computation tasks. This study reviews the latest articles in quantum computing and quantum machine learning. Building blocks of quantum computing and different flavors of quantum algorithms are also discussed. The latest work in quantum neural networks is also presented. In the end, different possible applications of quantum computing are also discussed.
Collapse
|
10
|
Dubey S, Dixit M. Recent developments on computer aided systems for diagnosis of diabetic retinopathy: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:14471-14525. [PMID: 36185322 PMCID: PMC9510498 DOI: 10.1007/s11042-022-13841-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 04/27/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Diabetes is a long-term condition in which the pancreas quits producing insulin or the body's insulin isn't utilised properly. One of the signs of diabetes is Diabetic Retinopathy. Diabetic retinopathy is the most prevalent type of diabetes, if remains unaddressed, diabetic retinopathy can affect all diabetics and become very serious, raising the chances of blindness. It is a chronic systemic condition that affects up to 80% of patients for more than ten years. Many researchers believe that if diabetes individuals are diagnosed early enough, they can be rescued from the condition in 90% of cases. Diabetes damages the capillaries, which are microscopic blood vessels in the retina. On images, blood vessel damage is usually noticeable. Therefore, in this study, several traditional, as well as deep learning-based approaches, are reviewed for the classification and detection of this particular diabetic-based eye disease known as diabetic retinopathy, and also the advantage of one approach over the other is also described. Along with the approaches, the dataset and the evaluation metrics useful for DR detection and classification are also discussed. The main finding of this study is to aware researchers about the different challenges occurs while detecting diabetic retinopathy using computer vision, deep learning techniques. Therefore, a purpose of this review paper is to sum up all the major aspects while detecting DR like lesion identification, classification and segmentation, security attacks on the deep learning models, proper categorization of datasets and evaluation metrics. As deep learning models are quite expensive and more prone to security attacks thus, in future it is advisable to develop a refined, reliable and robust model which overcomes all these aspects which are commonly found while designing deep learning models.
Collapse
Affiliation(s)
- Shradha Dubey
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| | - Manish Dixit
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| |
Collapse
|
11
|
Shaukat N, Amin J, Sharif M, Azam F, Kadry S, Krishnamoorthy S. Three-Dimensional Semantic Segmentation of Diabetic Retinopathy Lesions and Grading Using Transfer Learning. J Pers Med 2022; 12:jpm12091454. [PMID: 36143239 PMCID: PMC9501488 DOI: 10.3390/jpm12091454] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2022] [Revised: 08/18/2022] [Accepted: 08/20/2022] [Indexed: 11/23/2022] Open
Abstract
Diabetic retinopathy (DR) is a drastic disease. DR embarks on vision impairment when it is left undetected. In this article, learning-based techniques are presented for the segmentation and classification of DR lesions. The pre-trained Xception model is utilized for deep feature extraction in the segmentation phase. The extracted features are fed to Deeplabv3 for semantic segmentation. For the training of the segmentation model, an experiment is performed for the selection of the optimal hyperparameters that provided effective segmentation results in the testing phase. The multi-classification model is developed for feature extraction using the fully connected (FC) MatMul layer of efficient-net-b0 and pool-10 of the squeeze-net. The extracted features from both models are fused serially, having the dimension of N × 2020, amidst the best N × 1032 features chosen by applying the marine predictor algorithm (MPA). The multi-classification of the DR lesions into grades 0, 1, 2, and 3 is performed using neural network and KNN classifiers. The proposed method performance is validated on open access datasets such as DIARETDB1, e-ophtha-EX, IDRiD, and Messidor. The obtained results are better compared to those of the latest published works.
Collapse
Affiliation(s)
- Natasha Shaukat
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Wah Cantt 47010, Pakistan
| | - Javeria Amin
- Department of Computer Science, University of Wah, Wah Campus, Wah Cantt 47010, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Wah Cantt 47010, Pakistan
- Correspondence: (M.S.); (S.K.)
| | - Faisal Azam
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Wah Cantt 47010, Pakistan
| | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, 4612 Kristiansand, Norway
| | - Sujatha Krishnamoorthy
- Zhejiang Bioinformatics International Science and Technology Cooperation Center, Wenzhou-Kean University, Wenzhou 325060, China
- Wenzhou Municipal Key Lab of Applied Biomedical and Biopharmaceutical Informatics, Wenzhou-Kean University, Wenzhou 325060, China
- Correspondence: (M.S.); (S.K.)
| |
Collapse
|
12
|
Evaluation of Morphological Changes in Retinal Vessels in Type 1 Diabetes Mellitus Patients with the Use of Adaptive Optics. Biomedicines 2022; 10:biomedicines10081926. [PMID: 36009472 PMCID: PMC9406131 DOI: 10.3390/biomedicines10081926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Revised: 08/02/2022] [Accepted: 08/04/2022] [Indexed: 12/05/2022] Open
Abstract
Introduction. Diabetes mellitus contributes to the development of microvascular complications in the eye. Moreover, it affects multiple end organs, including brain damage, leading to premature death. The use of adaptive optics technique allows to perform non-invasive in vivo assessment of retinal vessels and to identify changes in arterioles about 100 μm in diameter. The retinal vasculature may be a model of the cerebral vessels both morphologically and functionally. Aim. To evaluate morphological parameters of retinal arterioles in patients with type 1 diabetes mellitus (DM1). Material and methods. The study included 22 DM1 patients (13 females) aged 43.00 ± 9.45 years with a mean diabetes duration of 22.55 ± 10.05 years, and 23 healthy volunteers (10 females) aged 41.09 ± 10.99 years. Blood pressure, BMI, waist circumference, and metabolic control markers of diabetes were measured in both groups. Vascular examinations were performed using an rtx1 adaptive optics retinal camera (Imagine Eyes, Orsay, France); the vessel wall thickness (WT), lumen diameter (LD), wall-to-lumen ratio (WLR), and vascular wall cross-sectional area (WCSA) were assessed. Statistical analysis was performed with the application of IMB SPSS version 23 software. Results. The DM1 group did not differ significantly in age, BMI, waist circumference, blood pressure, or axial length of the eye compared to the control group. Intraocular pressure (IOP) in both groups was normal, but in the DM1 group it was significantly higher. The DM1 group had significantly higher WT, WLR, and WCSA. These parameters correlated significantly with the duration of diabetes, but not with IOP. Conclusions. The presented study demonstrates the presence of significant morphological changes in retinal vessels in DM1 patients without previously diagnosed diabetic retinopathy. Similar changes may occur in the brain and may be early indicators of cardiovascular risk, but further investigation is required to confirm that.
Collapse
|
13
|
O-GlcNAc Modification and Its Role in Diabetic Retinopathy. Metabolites 2022; 12:metabo12080725. [PMID: 36005597 PMCID: PMC9415332 DOI: 10.3390/metabo12080725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 08/01/2022] [Accepted: 08/03/2022] [Indexed: 11/17/2022] Open
Abstract
Diabetic retinopathy (DR) is a leading complication in type 1 and type 2 diabetes and has emerged as a significant health problem. Currently, there are no effective therapeutic strategies owing to its inconspicuous early lesions and complex pathological mechanisms. Therefore, the mechanism of molecular pathogenesis requires further elucidation to identify potential targets that can aid in the prevention of DR. As a type of protein translational modification, O-linked β-N-acetylglucosamine (O-GlcNAc) modification is involved in many diseases, and increasing evidence suggests that dysregulated O-GlcNAc modification is associated with DR. The present review discusses O-GlcNAc modification and its molecular mechanisms involved in DR. O-GlcNAc modification might represent a novel alternative therapeutic target for DR in the future.
Collapse
|
14
|
Multi-Label Fundus Image Classification Using Attention Mechanisms and Feature Fusion. MICROMACHINES 2022; 13:mi13060947. [PMID: 35744561 PMCID: PMC9230753 DOI: 10.3390/mi13060947] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 06/09/2022] [Accepted: 06/13/2022] [Indexed: 01/27/2023]
Abstract
Fundus diseases can cause irreversible vision loss in both eyes if not diagnosed and treated immediately. Due to the complexity of fundus diseases, the probability of fundus images containing two or more diseases is extremely high, while existing deep learning-based fundus image classification algorithms have low diagnostic accuracy in multi-labeled fundus images. In this paper, a multi-label classification of fundus disease with binocular fundus images is presented, using a neural network algorithm model based on attention mechanisms and feature fusion. The algorithm highlights detailed features in binocular fundus images, and then feeds them into a ResNet50 network with attention mechanisms to extract fundus image lesion features. The model obtains global features of binocular images through feature fusion and uses Softmax to classify multi-label fundus images. The ODIR binocular fundus image dataset was used to evaluate the network classification performance and conduct ablation experiments. The model’s backend is the Tensorflow framework. Through experiments on the test images, this method achieved accuracy, precision, recall, and F1 values of 94.23%, 99.09%, 99.23%, and 99.16%, respectively.
Collapse
|
15
|
Cardiovascular Risk Stratification in Diabetic Retinopathy via Atherosclerotic Pathway in COVID-19/non-COVID-19 Frameworks using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:diagnostics12051234. [PMID: 35626389 PMCID: PMC9140106 DOI: 10.3390/diagnostics12051234] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 05/11/2022] [Accepted: 05/11/2022] [Indexed: 11/18/2022] Open
Abstract
Diabetes is one of the main causes of the rising cases of blindness in adults. This microvascular complication of diabetes is termed diabetic retinopathy (DR) and is associated with an expanding risk of cardiovascular events in diabetes patients. DR, in its various forms, is seen to be a powerful indicator of atherosclerosis. Further, the macrovascular complication of diabetes leads to coronary artery disease (CAD). Thus, the timely identification of cardiovascular disease (CVD) complications in DR patients is of utmost importance. Since CAD risk assessment is expensive for low-income countries, it is important to look for surrogate biomarkers for risk stratification of CVD in DR patients. Due to the common genetic makeup between the coronary and carotid arteries, low-cost, high-resolution imaging such as carotid B-mode ultrasound (US) can be used for arterial tissue characterization and risk stratification in DR patients. The advent of artificial intelligence (AI) techniques has facilitated the handling of large cohorts in a big data framework to identify atherosclerotic plaque features in arterial ultrasound. This enables timely CVD risk assessment and risk stratification of patients with DR. Thus, this review focuses on understanding the pathophysiology of DR, retinal and CAD imaging, the role of surrogate markers for CVD, and finally, the CVD risk stratification of DR patients. The review shows a step-by-step cyclic activity of how diabetes and atherosclerotic disease cause DR, leading to the worsening of CVD. We propose a solution to how AI can help in the identification of CVD risk. Lastly, we analyze the role of DR/CVD in the COVID-19 framework.
Collapse
|
16
|
Amin J, Anjum MA, Sharif M, Kadry S, Nadeem A, Ahmad SF. Liver Tumor Localization Based on YOLOv3 and 3D-Semantic Segmentation Using Deep Neural Networks. Diagnostics (Basel) 2022; 12:diagnostics12040823. [PMID: 35453870 PMCID: PMC9025116 DOI: 10.3390/diagnostics12040823] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/18/2022] [Accepted: 03/22/2022] [Indexed: 12/17/2022] Open
Abstract
Worldwide, more than 1.5 million deaths are occur due to liver cancer every year. The use of computed tomography (CT) for early detection of liver cancer could save millions of lives per year. There is also an urgent need for a computerized method to interpret, detect and analyze CT scans reliably, easily, and correctly. However, precise segmentation of minute tumors is a difficult task because of variation in the shape, intensity, size, low contrast of the tumor, and the adjacent tissues of the liver. To address these concerns, a model comprised of three parts: synthetic image generation, localization, and segmentation, is proposed. An optimized generative adversarial network (GAN) is utilized for generation of synthetic images. The generated images are localized by using the improved localization model, in which deep features are extracted from pre-trained Resnet-50 models and fed into a YOLOv3 detector as an input. The proposed modified model localizes and classifies the minute liver tumor with 0.99 mean average precision (mAp). The third part is segmentation, in which pre-trained Inceptionresnetv2 employed as a base-Network of Deeplabv3 and subsequently is trained on fine-tuned parameters with annotated ground masks. The experiments reflect that the proposed approach has achieved greater than 95% accuracy in the testing phase and it is proven that, in comparison to the recently published work in this domain, this research has localized and segmented the liver and minute liver tumor with more accuracy.
Collapse
Affiliation(s)
- Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt 47040, Pakistan;
| | | | - Muhammad Sharif
- Department of Computer Science, Comsats University Islamabad, Wah Campus, Wah Cantt 47040, Pakistan;
| | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, 4609 Kristiansand, Norway
- Correspondence:
| | - Ahmed Nadeem
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| | - Sheikh F. Ahmad
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| |
Collapse
|
17
|
Shaik NS, Cherukuri TK. Hinge attention network: A joint model for diabetic retinopathy severity grading. APPL INTELL 2022. [DOI: 10.1007/s10489-021-03043-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
|
18
|
Tariq H, Rashid M, Javed A, Zafar E, Alotaibi SS, Zia MYI. Performance Analysis of Deep-Neural-Network-Based Automatic Diagnosis of Diabetic Retinopathy. SENSORS (BASEL, SWITZERLAND) 2021; 22:205. [PMID: 35009747 PMCID: PMC8749542 DOI: 10.3390/s22010205] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 12/13/2021] [Accepted: 12/22/2021] [Indexed: 06/14/2023]
Abstract
Diabetic retinopathy (DR) is a human eye disease that affects people who are suffering from diabetes. It causes damage to their eyes, including vision loss. It is treatable; however, it takes a long time to diagnose and may require many eye exams. Early detection of DR may prevent or delay the vision loss. Therefore, a robust, automatic and computer-based diagnosis of DR is essential. Currently, deep neural networks are being utilized in numerous medical areas to diagnose various diseases. Consequently, deep transfer learning is utilized in this article. We employ five convolutional-neural-network-based designs (AlexNet, GoogleNet, Inception V4, Inception ResNet V2 and ResNeXt-50). A collection of DR pictures is created. Subsequently, the created collections are labeled with an appropriate treatment approach. This automates the diagnosis and assists patients through subsequent therapies. Furthermore, in order to identify the severity of DR retina pictures, we use our own dataset to train deep convolutional neural networks (CNNs). Experimental results reveal that the pre-trained model Se-ResNeXt-50 obtains the best classification accuracy of 97.53% for our dataset out of all pre-trained models. Moreover, we perform five different experiments on each CNN architecture. As a result, a minimum accuracy of 84.01% is achieved for a five-degree classification.
Collapse
Affiliation(s)
- Hassan Tariq
- Department of Electrical Engineering, School of Engineering, University of Management and Technology (UMT), Lahore 54770, Pakistan; (H.T.); (A.J.); (E.Z.)
| | - Muhammad Rashid
- Department of Computer Engineering, Umm Al-Qura University, Makkah 21955, Saudi Arabia;
| | - Asfa Javed
- Department of Electrical Engineering, School of Engineering, University of Management and Technology (UMT), Lahore 54770, Pakistan; (H.T.); (A.J.); (E.Z.)
| | - Eeman Zafar
- Department of Electrical Engineering, School of Engineering, University of Management and Technology (UMT), Lahore 54770, Pakistan; (H.T.); (A.J.); (E.Z.)
| | - Saud S. Alotaibi
- Department of Information Systems, Umm Al-Qura University, Makkah 21955, Saudi Arabia;
| | | |
Collapse
|
19
|
Ashraf MN, Hussain M, Habib Z. Review of Various Tasks Performed in the Preprocessing Phase of a Diabetic Retinopathy Diagnosis System. Curr Med Imaging 2021; 16:397-426. [PMID: 32410541 DOI: 10.2174/1573405615666190219102427] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2018] [Revised: 12/31/2018] [Accepted: 01/20/2019] [Indexed: 12/15/2022]
Abstract
Diabetic Retinopathy (DR) is a major cause of blindness in diabetic patients. The increasing population of diabetic patients and difficulty to diagnose it at an early stage are limiting the screening capabilities of manual diagnosis by ophthalmologists. Color fundus images are widely used to detect DR lesions due to their comfortable, cost-effective and non-invasive acquisition procedure. Computer Aided Diagnosis (CAD) of DR based on these images can assist ophthalmologists and help in saving many sight years of diabetic patients. In a CAD system, preprocessing is a crucial phase, which significantly affects its performance. Commonly used preprocessing operations are the enhancement of poor contrast, balancing the illumination imbalance due to the spherical shape of a retina, noise reduction, image resizing to support multi-resolution, color normalization, extraction of a field of view (FOV), etc. Also, the presence of blood vessels and optic discs makes the lesion detection more challenging because these two artifacts exhibit specific attributes, which are similar to those of DR lesions. Preprocessing operations can be broadly divided into three categories: 1) fixing the native defects, 2) segmentation of blood vessels, and 3) localization and segmentation of optic discs. This paper presents a review of the state-of-the-art preprocessing techniques related to three categories of operations, highlighting their significant aspects and limitations. The survey is concluded with the most effective preprocessing methods, which have been shown to improve the accuracy and efficiency of the CAD systems.
Collapse
Affiliation(s)
| | - Muhammad Hussain
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Zulfiqar Habib
- Department of Computer Science, COMSATS University Islamabad, Lahore, Pakistan
| |
Collapse
|
20
|
A review of diabetic retinopathy: Datasets, approaches, evaluation metrics and future trends. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2021. [DOI: 10.1016/j.jksuci.2021.06.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
21
|
Gour N, Khanna P. Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102329] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
22
|
Li HL, Hao GM, Tang SJ, Sun HH, Fang YS, Pang X, Liu H, Ji Q, Wang XR, Tian JY, Jiang KX, Song XZ, Zhu RX, Han J, Wang W. HuoXue JieDu formula improves diabetic retinopathy in rats by regulating microRNAs. JOURNAL OF ETHNOPHARMACOLOGY 2021; 268:113616. [PMID: 33271246 DOI: 10.1016/j.jep.2020.113616] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Revised: 11/18/2020] [Accepted: 11/20/2020] [Indexed: 06/12/2023]
Abstract
ETHNOPHARMACOLOGICAL RELEVANCE HuoXue JieDu Formula (HXJDF) originates from classical formulas and was formed based on clinical experience. It is composed of Euonymus alatus (Thunb.) Siebold, Panax notoginseng (Burkill) F.H. Chen, the roots of Anguina kirilowii (Maxim.) Kuntze, and Coptis omeiensis (C. Chen) C.Y.Cheng. HXJDF prevents the deterioration of diabetic retinopathy. AIM OF THE STUDY To evaluate the effects of HXJDF on diabetic retinopathy in rats and investigate the roles of miRNAs in the effects of HXJDF. MATERIALS AND METHODS A single intraperitoneal injection of streptozotocin (STZ) (65 mg/kg) was used to induce diabetes in rats. Rats were divided into three groups: normal, diabetic, and diabetic + HXJDF. Rats were treated with HXJDF (15.4 g/kg) or water by oral gavage for twelve weeks. At the end of the treatment, rats were anaesthetized, and retinal haemodynamic changes were measured. Then, the retinas were removed and examined by haematoxylin and eosin (HE) staining and TUNEL assays. In addition, miRNA expression profiling was performed using miRNA microarrays and further validated by quantitative real-time PCR (qRT-PCR). RESULTS Diabetes reduced peak systolic velocity (PSV), end-diastolic velocity (EDV), mean velocity (MV) and central retinal vein velocity (CRV) but increased the resistance index (RI) and pulsatility index (PI). In addition, in the diabetic group, retinal cell arrangement was disordered and loosely arranged, the retinal thickness and retinal ganglion cell (RGC) number decreased, and retinal cell apoptosis increased. In addition, 11 miRNAs were upregulated and 4 miRNAs were downregulated. After treatment, HXJDF improved retinal haemodynamics and morphologic changes, restored retinal thickness and RGC number and decreased retinal cell apoptosis. Furthermore, the changes in miRNA expression were significantly abolished by HXJDF. CONCLUSION HXJDF may prevent DR by regulating the expression of miRNAs.
Collapse
Affiliation(s)
- Hong-Li Li
- College of Traditional Chinese, Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Gai-Mei Hao
- Institute of Basic Theory for Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
| | - Shi-Jie Tang
- Key Laboratory of Systems Biology, CAS Center for Excellence in Molecular Cell Science, Innovation Center for Cell Signaling Network, Institute of Biochemistry and Cell Biology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai, China.
| | - Hui-Hui Sun
- College of Traditional Chinese, Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Yong-Sheng Fang
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Xinxin Pang
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Hanying Liu
- College of Traditional Chinese, Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Qingxuan Ji
- College of Traditional Chinese, Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Xi-Rui Wang
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Jing-Yun Tian
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Kun-Xiu Jiang
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Xing-Zhuo Song
- College of Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Rui-Xin Zhu
- Department of Bioinformatics, School of Life Sciences and Technology, Tongji University, Shanghai, China.
| | - Jing Han
- Institute of Traditional Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China.
| | - Wei Wang
- College of Traditional Chinese, Medicine, Beijing University of Chinese Medicine, Beijing, China.
| |
Collapse
|
23
|
Bilal A, Sun G, Mazhar S. Survey on recent developments in automatic detection of diabetic retinopathy. J Fr Ophtalmol 2021; 44:420-440. [PMID: 33526268 DOI: 10.1016/j.jfo.2020.08.009] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 08/24/2020] [Indexed: 12/13/2022]
Abstract
Diabetic retinopathy (DR) is a disease facilitated by the rapid spread of diabetes worldwide. DR can blind diabetic individuals. Early detection of DR is essential to restoring vision and providing timely treatment. DR can be detected manually by an ophthalmologist, examining the retinal and fundus images to analyze the macula, morphological changes in blood vessels, hemorrhage, exudates, and/or microaneurysms. This is a time consuming, costly, and challenging task. An automated system can easily perform this function by using artificial intelligence, especially in screening for early DR. Recently, much state-of-the-art research relevant to the identification of DR has been reported. This article describes the current methods of detecting non-proliferative diabetic retinopathy, exudates, hemorrhage, and microaneurysms. In addition, the authors point out future directions in overcoming current challenges in the field of DR research.
Collapse
Affiliation(s)
- A Bilal
- Faculty of Information Technology, Beijing University of Technology, Chaoyang District, Beijing 100124, China.
| | - G Sun
- Faculty of Information Technology, Beijing University of Technology, Chaoyang District, Beijing 100124, China
| | - S Mazhar
- Faculty of Information Technology, Beijing University of Technology, Chaoyang District, Beijing 100124, China
| |
Collapse
|
24
|
Transfer Learning with Convolutional Neural Networks for Diabetic Retinopathy Image Classification. A Review. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10062021] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Diabetic retinopathy (DR) is a dangerous eye condition that affects diabetic patients. Without early detection, it can affect the retina and may eventually cause permanent blindness. The early diagnosis of DR is crucial for its treatment. However, the diagnosis of DR is a very difficult process that requires an experienced ophthalmologist. A breakthrough in the field of artificial intelligence called deep learning can help in giving the ophthalmologist a second opinion regarding the classification of the DR by using an autonomous classifier. To accurately train a deep learning model to classify DR, an enormous number of images is required, and this is an important limitation in the DR domain. Transfer learning is a technique that can help in overcoming the scarcity of images. The main idea that is exploited by transfer learning is that a deep learning architecture, previously trained on non-medical images, can be fine-tuned to suit the DR dataset. This paper reviews research papers that focus on DR classification by using transfer learning to present the best existing methods to address this problem. This review can help future researchers to find out existing transfer learning methods to address the DR classification task and to show their differences in terms of performance.
Collapse
|
25
|
Sharif MI, Li JP, Naz J, Rashid I. A comprehensive review on multi-organs tumor detection based on machine learning. Pattern Recognit Lett 2020. [DOI: 10.1016/j.patrec.2019.12.006] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
26
|
Akbar S, Sharif M, Akram MU, Saba T, Mahmood T, Kolivand M. Automated techniques for blood vessels segmentation through fundus retinal images: A review. Microsc Res Tech 2019; 82:153-170. [DOI: 10.1002/jemt.23172] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2018] [Revised: 09/26/2018] [Accepted: 10/17/2018] [Indexed: 11/09/2022]
Affiliation(s)
- Shahzad Akbar
- Department of Computer ScienceCOMSATS University Islamabad, Wah Campus Wah Pakistan
| | - Muhammad Sharif
- Department of Computer ScienceCOMSATS University Islamabad, Wah Campus Wah Pakistan
| | - Muhammad Usman Akram
- Department of Computer EngineeringCollege of E&ME, National University of Sciences and Technology Islamabad Pakistan
| | - Tanzila Saba
- College of Computer and Information SciencesPrince Sultan University Riyadh Saudi Arabia
| | - Toqeer Mahmood
- Department of Computer ScienceUniversity of Engineering and Technology Taxila Pakistan
| | | |
Collapse
|
27
|
Amin J, Sharif M, Rehman A, Raza M, Mufti MR. Diabetic retinopathy detection and classification using hybrid feature set. Microsc Res Tech 2018; 81:990-996. [DOI: 10.1002/jemt.23063] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2018] [Revised: 04/25/2018] [Accepted: 05/15/2018] [Indexed: 12/25/2022]
Affiliation(s)
- Javeria Amin
- Department of Computer ScienceUniversity of WahPakistan
| | - Muhammad Sharif
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Amjad Rehman
- College of Computer and Information Systems, Al‐Yamamah University Riyadh 11512 Saudi Arabia
| | - Mudassar Raza
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Muhammad Rafiq Mufti
- Department of Computer ScienceCOMSATS Institute of Information Technology Vehari Pakistan
| |
Collapse
|
28
|
Saba T, Bokhari STF, Sharif M, Yasmin M, Raza M. Fundus image classification methods for the detection of glaucoma: A review. Microsc Res Tech 2018; 81:1105-1121. [DOI: 10.1002/jemt.23094] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2018] [Revised: 06/07/2018] [Accepted: 06/19/2018] [Indexed: 01/31/2023]
Affiliation(s)
- Tanzila Saba
- College of Computer and Information SciencesPrince Sultan University Riyadh Saudi Arabia
| | | | - Muhammad Sharif
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Mussarat Yasmin
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Mudassar Raza
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| |
Collapse
|
29
|
Badgujar R, Deore P. MBO-SVM-based exudate classification in fundus retinal images of diabetic patients. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2018. [DOI: 10.1080/21681163.2018.1487338] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Ravindra Badgujar
- Department of Electronics & Telecommunication Engineering, R C Patel Institute of Technology, Shirpur, India
| | - Pramod Deore
- Department of Electronics & Telecommunication Engineering, R C Patel Institute of Technology, Shirpur, India
| |
Collapse
|