1
|
Alotaibi NS. Micro aneurysm detection using optimized residual-based temporal attention Convolutional Neural Network with Inception-V3 transfer learning. Microsc Res Tech 2024; 87:908-921. [PMID: 38168879 DOI: 10.1002/jemt.24478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 10/27/2023] [Accepted: 12/09/2023] [Indexed: 01/05/2024]
Abstract
In this manuscript micro aneurysm detection using residual-based temporal attention Convolutional Neural Network (CNN) with Inception-V3 transfer learning optimized with equilibrium optimization algorithm (MA-RTCNN-Inception V3-EOA) is proposed. The proposed research work contains four phases: (1) pre-processing, (2) segmentation, (3) post-processing, and (4) classification. At first, guided box filtering for contrast enhancement and background exclusion of input image. The proposed MA-RTCNN-Inception V3-EOA based classification framework is implemented in MATLAB using several performances evaluating metrics like precision, sensitivity, f-measure, specificity, accuracy, classification error rate, and Matthews's correlation coefficient and RoC analysis. The experimental outcome demonstrates that the proposed method provides 23.56%, 14.99%, and 21.37% higher accuracy and 31.26%, 57.69%, and 21.14% minimum classification error rate compared to existing methods, such as diabetic retinopathy identification utilizing prognosis of micro aneurysm and early diagnosis for non-proliferative diabetic retinopathy depending on deep learning approaches (DRD-CNN-NPDR), a magnified adaptive feature pyramid network for automatic micro aneurysms identification (MAFPN-AMD-MAFP-Net) respectively. RESEARCH HIGHLIGHTS: Micro aneurysm detection using residual-based temporal attention Convolutional Neural Network (CNN) is proposed. To get rid of the retina background, guided box filtering is applied. COAT is used for segmenting the images into smaller parts RTCNN is used for accurate micro aneurysms disease classification. RT-CNN algorithm successfully identifies the micro aneurysms using EOA.
Collapse
|
2
|
Zhang X, Ma Y, Gong Q, Yao J. Automatic detection of microaneurysms in fundus images based on multiple preprocessing fusion to extract features. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
|
3
|
Bai Y, Zhang X, Wang C, Gu H, Zhao M, Shi F. Microaneurysms detection in retinal fundus images based on shape constraint with region-context features. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
4
|
Soares I, Castelo-Branco M, Pinheiro A. Microaneurysms detection in retinal images using a multi-scale approach. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Dubey S, Dixit M. Recent developments on computer aided systems for diagnosis of diabetic retinopathy: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:14471-14525. [PMID: 36185322 PMCID: PMC9510498 DOI: 10.1007/s11042-022-13841-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 04/27/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Diabetes is a long-term condition in which the pancreas quits producing insulin or the body's insulin isn't utilised properly. One of the signs of diabetes is Diabetic Retinopathy. Diabetic retinopathy is the most prevalent type of diabetes, if remains unaddressed, diabetic retinopathy can affect all diabetics and become very serious, raising the chances of blindness. It is a chronic systemic condition that affects up to 80% of patients for more than ten years. Many researchers believe that if diabetes individuals are diagnosed early enough, they can be rescued from the condition in 90% of cases. Diabetes damages the capillaries, which are microscopic blood vessels in the retina. On images, blood vessel damage is usually noticeable. Therefore, in this study, several traditional, as well as deep learning-based approaches, are reviewed for the classification and detection of this particular diabetic-based eye disease known as diabetic retinopathy, and also the advantage of one approach over the other is also described. Along with the approaches, the dataset and the evaluation metrics useful for DR detection and classification are also discussed. The main finding of this study is to aware researchers about the different challenges occurs while detecting diabetic retinopathy using computer vision, deep learning techniques. Therefore, a purpose of this review paper is to sum up all the major aspects while detecting DR like lesion identification, classification and segmentation, security attacks on the deep learning models, proper categorization of datasets and evaluation metrics. As deep learning models are quite expensive and more prone to security attacks thus, in future it is advisable to develop a refined, reliable and robust model which overcomes all these aspects which are commonly found while designing deep learning models.
Collapse
Affiliation(s)
- Shradha Dubey
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| | - Manish Dixit
- Madhav Institute of Technology & Science (Department of Computer Science and Engineering), Gwalior, M.P. India
| |
Collapse
|
6
|
Detection of microaneurysms in color fundus images based on local Fourier transform. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103648] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
7
|
Du J, Zou B, Ouyang P, Zhao R. Retinal microaneurysm detection based on transformation splicing and multi-context ensemble learning. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103536] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
|
8
|
Mateen M, Malik TS, Hayat S, Hameed M, Sun S, Wen J. Deep Learning Approach for Automatic Microaneurysms Detection. SENSORS (BASEL, SWITZERLAND) 2022; 22:542. [PMID: 35062506 PMCID: PMC8781897 DOI: 10.3390/s22020542] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 01/04/2022] [Accepted: 01/05/2022] [Indexed: 02/01/2023]
Abstract
In diabetic retinopathy (DR), the early signs that may lead the eyesight towards complete vision loss are considered as microaneurysms (MAs). The shape of these MAs is almost circular, and they have a darkish color and are tiny in size, which means they may be missed by manual analysis of ophthalmologists. In this case, accurate early detection of microaneurysms is helpful to cure DR before non-reversible blindness. In the proposed method, early detection of MAs is performed using a hybrid feature embedding approach of pre-trained CNN models, named as VGG-19 and Inception-v3. The performance of the proposed approach was evaluated using publicly available datasets, namely "E-Ophtha" and "DIARETDB1", and achieved 96% and 94% classification accuracy, respectively. Furthermore, the developed approach outperformed the state-of-the-art approaches in terms of sensitivity and specificity for microaneurysms detection.
Collapse
Affiliation(s)
- Muhammad Mateen
- Department of Computer Science, Air University Multan Campus, Multan 60000, Pakistan; (M.M.); (T.S.M.)
| | - Tauqeer Safdar Malik
- Department of Computer Science, Air University Multan Campus, Multan 60000, Pakistan; (M.M.); (T.S.M.)
| | - Shaukat Hayat
- Department of Computer Science, Iqra National University, Peshawar 25000, Pakistan;
| | - Musab Hameed
- Department of Electrical & Computer Engineering, Sahiwal Campus, COMSATS University Islamabad, Sahiwal 57000, Pakistan;
| | - Song Sun
- School of Big Data & Software Engineering, Chongqing University, Chongqing 401331, China;
| | - Junhao Wen
- School of Big Data & Software Engineering, Chongqing University, Chongqing 401331, China;
| |
Collapse
|
9
|
Local Structure Awareness-Based Retinal Microaneurysm Detection with Multi-Feature Combination. Biomedicines 2022; 10:biomedicines10010124. [PMID: 35052803 PMCID: PMC8773350 DOI: 10.3390/biomedicines10010124] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 12/31/2021] [Accepted: 01/03/2022] [Indexed: 01/02/2023] Open
Abstract
Retinal microaneurysm (MA) is the initial symptom of diabetic retinopathy (DR). The automatic detection of MA is helpful to assist doctors in diagnosis and treatment. Previous algorithms focused on the features of the target itself; however, the local structural features of the target and background are also worth exploring. To achieve MA detection, an efficient local structure awareness-based retinal MA detection with the multi-feature combination (LSAMFC) is proposed in this paper. We propose a novel local structure feature called a ring gradient descriptor (RGD) to describe the structural differences between an object and its surrounding area. Then, a combination of RGD with the salience and texture features is used by a Gradient Boosting Decision Tree (GBDT) for candidate classification. We evaluate our algorithm on two public datasets, i.e., the e-ophtha MA dataset and retinopathy online challenge (ROC) dataset. The experimental results show that the performance of the trained model significantly improved after combining traditional features with RGD, and the area under the receiver operating characteristic curve (AUC) values in the test results of the datasets e-ophtha MA and ROC increased from 0.9615 to 0.9751 and from 0.9066 to 0.9409, respectively.
Collapse
|
10
|
Sun S, Cao Z, Liao D, Lv R. A Magnified Adaptive Feature Pyramid Network for automatic microaneurysms detection. Comput Biol Med 2021; 139:105000. [PMID: 34741905 DOI: 10.1016/j.compbiomed.2021.105000] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 10/27/2021] [Accepted: 10/27/2021] [Indexed: 10/19/2022]
Abstract
Diabetic retinopathy (DR), as an important complication of diabetes, is the primary cause of blindness in adults. Automatic DR detection poses a challenge which is crucial for early DR screening. Currently, the vast majority of DR is diagnosed through fundus images, where the microaneurysm (MA) has been widely used as the most distinguishable marker. Research works on automatic DR detection have traditionally utilized manually designed operators, while a few recent researchers have explored deep learning techniques for this topic. But due to issues such as the extremely small size of microaneurysms, low resolution of fundus pictures, and insufficient imaging depth, the DR detection problem is quite challenging and remains unsolved. To address these issues, this research proposes a new deep learning model (Magnified Adaptive Feature Pyramid Network, MAFP-Net) for DR detection, which conducts super-resolution on low quality fundus images and integrates an improved feature pyramid structure while utilizing a standard two-stage detection network as the backbone. Our proposed detection model needs no pre-segmented patches to train the CNN network. When tested on the E-ophtha-MA dataset, the sensitivity value of our method reached as high as 83.5% at false positives per image (FPI) of 8 and the F1 value achieved 0.676, exceeding all those of the state-of-the-art algorithms as well as the human performance of experienced physicians. Similar results were achieved on another public dataset of IDRiD.
Collapse
Affiliation(s)
- Song Sun
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China
| | - Zhicheng Cao
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China
| | - Dingying Liao
- Health Science Center, Xi'an Jiaotong University, Xi'an, 710061, China
| | - Ruichan Lv
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China.
| |
Collapse
|
11
|
Jiao S, Jia Y, Yao X. Emerging imaging developments in experimental vision sciences and ophthalmology. Exp Biol Med (Maywood) 2021; 246:2137-2139. [PMID: 34404253 PMCID: PMC8718248 DOI: 10.1177/15353702211038891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Affiliation(s)
- Shuliang Jiao
- Department of Biomedical Engineering, Florida International University, Miami, FL 33174, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Xincheng Yao
- Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL 60607, USA
| |
Collapse
|
12
|
Liao Y, Xia H, Song S, Li H. Microaneurysm detection in fundus images based on a novel end-to-end convolutional neural network. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.04.005] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|