1
|
Zhang Y, Ye X, Wu W, Luo Y, Chen M, Du Y, Wen Y, Song H, Liu Y, Zhang G, Wang L. Morphological Rule-Constrained Object Detection of Key Structures in Infant Fundus Image. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2024; 21:1031-1041. [PMID: 37018340 DOI: 10.1109/tcbb.2023.3234100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
The detection of optic disc and macula is an essential step for ROP (Retinopathy of prematurity) zone segmentation and disease diagnosis. This paper aims to enhance deep learning-based object detection with domain-specific morphological rules. Based on the fundus morphology, we define five morphological rules, i.e., number restriction (maximum number of optic disc and macula is one), size restriction (e.g., optic disc width: 1.05 +/- 0.13 mm), distance restriction (distance between the optic disc and macula/fovea: 4.4 +/- 0.4 mm), angle/slope restriction (optic disc and macula should roughly be positioned in the same horizontal line), position restriction (In OD, the macula is on the left side of the optic disc; vice versa for OS). A case study on 2953 infant fundus images (with 2935 optic disc instances and 2892 macula instances) proves the effectiveness of the proposed method. Without the morphological rules, naïve object detection accuracies of optic disc and macula are 0.955 and 0.719, respectively. With the proposed method, false-positive ROIs (region of interest) are further ruled out, and the accuracy of the macula is raised to 0.811. The IoU (intersection over union) and RCE (relative center error) metrics are also improved .
Collapse
|
2
|
Amin J, Shazadi I, Sharif M, Yasmin M, Almujally NA, Nam Y. Localization and grading of NPDR lesions using ResNet-18-YOLOv8 model and informative features selection for DR classification based on transfer learning. Heliyon 2024; 10:e30954. [PMID: 38779022 PMCID: PMC11109848 DOI: 10.1016/j.heliyon.2024.e30954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 05/04/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024] Open
Abstract
Complications in diabetes lead to diabetic retinopathy (DR) hence affecting the vision. Computerized methods performed a significant role in DR detection at the initial phase to cure vision loss. Therefore, a method is proposed in this study that consists of three models for localization, segmentation, and classification. A novel technique is designed with the combination of pre-trained ResNet-18 and YOLOv8 models based on the selection of optimum layers for the localization of DR lesions. The localized images are passed to the designed semantic segmentation model on selected layers and trained on optimized learning hyperparameters. The segmentation model performance is evaluated on the Grand-challenge IDRID segmentation dataset. The achieved results are computed in terms of mean IoU 0.95,0.94, 0.96, 0.94, and 0.95 on OD, SoftExs, HardExs, HAE, and MAs respectively. Another classification model is developed in which deep features are derived from the pre-trained Efficientnet-b0 model and optimized using a Genetic algorithm (GA) based on the selected parameters for grading of NPDR lesions. The proposed model achieved greater than 98 % accuracy which is superior to previous methods.
Collapse
Affiliation(s)
- Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Irum Shazadi
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | - Mussarat Yasmin
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | - Nouf Abdullah Almujally
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia
| | - Yunyoung Nam
- Department of ICT Convergence, Soonchunhyang University, Asan, 31538, South Korea
| |
Collapse
|
3
|
Gibbon S, Muniz-Terrera G, Yii FSL, Hamid C, Cox S, Maccormick IJC, Tatham AJ, Ritchie C, Trucco E, Dhillon B, MacGillivray TJ. PallorMetrics: Software for Automatically Quantifying Optic Disc Pallor in Fundus Photographs, and Associations With Peripapillary RNFL Thickness. Transl Vis Sci Technol 2024; 13:20. [PMID: 38780955 PMCID: PMC11127490 DOI: 10.1167/tvst.13.5.20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 04/10/2024] [Indexed: 05/25/2024] Open
Abstract
Purpose We sough to develop an automatic method of quantifying optic disc pallor in fundus photographs and determine associations with peripapillary retinal nerve fiber layer (pRNFL) thickness. Methods We used deep learning to segment the optic disc, fovea, and vessels in fundus photographs, and measured pallor. We assessed the relationship between pallor and pRNFL thickness derived from optical coherence tomography scans in 118 participants. Separately, we used images diagnosed by clinical inspection as pale (n = 45) and assessed how measurements compared with healthy controls (n = 46). We also developed automatic rejection thresholds and tested the software for robustness to camera type, image format, and resolution. Results We developed software that automatically quantified disc pallor across several zones in fundus photographs. Pallor was associated with pRNFL thickness globally (β = -9.81; standard error [SE] = 3.16; P < 0.05), in the temporal inferior zone (β = -29.78; SE = 8.32; P < 0.01), with the nasal/temporal ratio (β = 0.88; SE = 0.34; P < 0.05), and in the whole disc (β = -8.22; SE = 2.92; P < 0.05). Furthermore, pallor was significantly higher in the patient group. Last, we demonstrate the analysis to be robust to camera type, image format, and resolution. Conclusions We developed software that automatically locates and quantifies disc pallor in fundus photographs and found associations between pallor measurements and pRNFL thickness. Translational Relevance We think our method will be useful for the identification, monitoring, and progression of diseases characterized by disc pallor and optic atrophy, including glaucoma, compression, and potentially in neurodegenerative disorders.
Collapse
Affiliation(s)
- Samuel Gibbon
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Robert O Curle Ophthalmology Suite, Institute for Regeneration and Repair, University of Edinburgh, UK, Edinburgh, UK
| | | | - Fabian S. L. Yii
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Robert O Curle Ophthalmology Suite, Institute for Regeneration and Repair, University of Edinburgh, UK, Edinburgh, UK
| | | | - Simon Cox
- Lothian Birth Cohorts, Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Ian J. C. Maccormick
- Centre for Inflammation Research, University of Edinburgh, Edinburgh, UK
- Institute for Adaptive and Neural Computation, University of Edinburgh, Edinburgh, UK
| | - Andrew J. Tatham
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Princess Alexandra Eye Pavilion, Chalmers Street, Edinburgh, UK
| | - Craig Ritchie
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Centre for Dementia Prevention, University of Edinburgh, Edinburgh, UK
| | - Emanuele Trucco
- VAMPIRE Project, Computing (SSEN), University of Dundee, Dundee, UK
| | - Baljean Dhillon
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Princess Alexandra Eye Pavilion, Chalmers Street, Edinburgh, UK
| | - Thomas J. MacGillivray
- Centre for Clinical Brain Sciences, Edinburgh, UK
- Robert O Curle Ophthalmology Suite, Institute for Regeneration and Repair, University of Edinburgh, UK, Edinburgh, UK
- VAMPIRE Project, Edinburgh Clinical Research facility, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
4
|
Guo T, Liu K, Zou H, Xu X, Yang J, Yu Q. Refined image quality assessment for color fundus photography based on deep learning. Digit Health 2024; 10:20552076231207582. [PMID: 38425654 PMCID: PMC10903193 DOI: 10.1177/20552076231207582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/26/2023] [Indexed: 03/02/2024] Open
Abstract
Purpose Color fundus photography is widely used in clinical and screening settings for eye diseases. Poor image quality greatly affects the reliability of further evaluation and diagnosis. In this study, we developed an automated assessment module for color fundus photography image quality assessment using deep learning. Methods A total of 55,931 color fundus photography images from multiple centers in Shanghai and the public database were collected and annotated as training, validation, and testing data sets. The pre-diagnosis image quality assessment module based on the multi-task deep neural network was designed. The detailed criterion of color fundus photography image quality including three subcategories with three levels of grading was applied to improve precision and objectivity. The auxiliary tasks such as the localization of the optic nerve head and macula, the classification of laterality, and the field of view were also included to assist the quality assessment. Finally, we validated our module internally and externally by evaluating the area under the receiver operating characteristic curve, sensitivity, specificity, accuracy, and quadratic weighted Kappa. Results The "Location" subcategory achieved area under the receiver operating characteristic curves of 0.991, 0.920, and 0.946 for the three grades, respectively. The "Clarity" subcategory achieved area under the receiver operating characteristic curves of 0.980, 0.917, and 0.954 for the three grades, respectively. The "Artifact" subcategory achieved area under the receiver operating characteristic curves of 0.976, 0.952, and 0.986 for the three grades, respectively. The accuracy and Kappa of overall quality reach 88.15% and 89.70%, respectively, on the internal set. These two indicators on the external set were 86.63% and 88.55%, respectively, which were very close to that of the internal set. Conclusions This work showed that our deep module was able to evaluate the color fundus photography image quality using more detailed three subcategories with three grade criteria. The promising results on both internal and external validation indicated the strength and generalizability of our module.
Collapse
Affiliation(s)
- Tianjiao Guo
- Institute of Medical Robotics, Shanghai Jiao Tong University, China
- Department of Automation, Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, China
- School of Biomedical Engineering, Shanghai Jiao Tong University, China
| | - Kun Liu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, China
- National Clinical Research Center for Eye Diseases, Shanghai, China
- Shanghai Clinical Research Center for Eye Diseases, China
| | - Haidong Zou
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, China
- National Clinical Research Center for Eye Diseases, Shanghai, China
- Shanghai Clinical Research Center for Eye Diseases, China
| | - Xun Xu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, China
- National Clinical Research Center for Eye Diseases, Shanghai, China
- Shanghai Clinical Research Center for Eye Diseases, China
| | - Jie Yang
- Department of Automation, Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, China
| | - Qi Yu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, China
- National Clinical Research Center for Eye Diseases, Shanghai, China
- Shanghai Clinical Research Center for Eye Diseases, China
| |
Collapse
|
5
|
Morís DI, de Moura J, Aslani S, Jacob J, Novo J, Ortega M. Multi-task localization of the hemidiaphragms and lung segmentation in portable chest X-ray images of COVID-19 patients. Digit Health 2024; 10:20552076231225853. [PMID: 38313365 PMCID: PMC10836150 DOI: 10.1177/20552076231225853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 12/05/2023] [Indexed: 02/06/2024] Open
Abstract
Background The COVID-19 can cause long-term symptoms in the patients after they overcome the disease. Given that this disease mainly damages the respiratory system, these symptoms are often related with breathing problems that can be caused by an affected diaphragm. The diaphragmatic function can be assessed with imaging modalities like computerized tomography or chest X-ray. However, this process must be performed by expert clinicians with manual visual inspection. Moreover, during the pandemic, the clinicians were asked to prioritize the use of portable devices, preventing the risk of cross-contamination. Nevertheless, the captures of these devices are of a lower quality. Objectives The automatic quantification of the diaphragmatic function can determine the damage of COVID-19 on each patient and assess their evolution during the recovery period, a task that could also be complemented with the lung segmentation. Methods We propose a novel multi-task fully automatic methodology to simultaneously localize the position of the hemidiaphragms and to segment the lung boundaries with a convolutional architecture using portable chest X-ray images of COVID-19 patients. For that aim, the hemidiaphragms' landmarks are located adapting the paradigm of heatmap regression. Results The methodology is exhaustively validated with four analyses, achieving an 82.31% ± 2.78% of accuracy when localizing the hemidiaphragms' landmarks and a Dice score of 0.9688 ± 0.0012 in lung segmentation. Conclusions The results demonstrate that the model is able to perform both tasks simultaneously, being a helpful tool for clinicians despite the lower quality of the portable chest X-ray images.
Collapse
Affiliation(s)
- Daniel I Morís
- Centro de Investigación CITIC, Universidade da Coruña, A Coruña, Spain
- Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, A Coruña, Spain
| | - Joaquim de Moura
- Centro de Investigación CITIC, Universidade da Coruña, A Coruña, Spain
- Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, A Coruña, Spain
| | - Shahab Aslani
- Department of Computer Science, Centre for Medical Image Computing, University College London, UK
| | - Joseph Jacob
- Department of Computer Science, Centre for Medical Image Computing, University College London, UK
- Satsuma Lab, Centre for Medical Image Computing, University College London, UK
| | - Jorge Novo
- Centro de Investigación CITIC, Universidade da Coruña, A Coruña, Spain
- Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, A Coruña, Spain
| | - Marcos Ortega
- Centro de Investigación CITIC, Universidade da Coruña, A Coruña, Spain
- Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, A Coruña, Spain
| |
Collapse
|
6
|
Yi Y, Jiang Y, Zhou B, Zhang N, Dai J, Huang X, Zeng Q, Zhou W. C2FTFNet: Coarse-to-fine transformer network for joint optic disc and cup segmentation. Comput Biol Med 2023; 164:107215. [PMID: 37481947 DOI: 10.1016/j.compbiomed.2023.107215] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 06/07/2023] [Accepted: 06/25/2023] [Indexed: 07/25/2023]
Abstract
Glaucoma is a leading cause of worldwide blindness and visual impairment, making early screening and diagnosis is crucial to prevent vision loss. Cup-to-Disk Ratio (CDR) evaluation serves as a widely applied approach for effective glaucoma screening. At present, deep learning methods have exhibited outstanding performance in optic disk (OD) and optic cup (OC) segmentation and maturely deployed in CAD system. However, owning to the complexity of clinical data, these techniques could be constrained. Therefore, an original Coarse-to-Fine Transformer Network (C2FTFNet) is designed to segment OD and OC jointly , which is composed of two stages. In the coarse stage, to eliminate the effects of irrelevant organization on the segmented OC and OD regions, we employ U-Net and Circular Hough Transform (CHT) to segment the Region of Interest (ROI) of OD. Meanwhile, a TransUnet3+ model is designed in the fine segmentation stage to extract the OC and OD regions more accurately from ROI. In this model, to alleviate the limitation of the receptive field caused by traditional convolutional methods, a Transformer module is introduced into the backbone to capture long-distance dependent features for retaining more global information. Then, a Multi-Scale Dense Skip Connection (MSDC) module is proposed to fuse the low-level and high-level features from different layers for reducing the semantic gap among different level features. Comprehensive experiments conducted on DRIONS-DB, Drishti-GS, and REFUGE datasets validate the superior effectiveness of the proposed C2FTFNet compared to existing state-of-the-art approaches.
Collapse
Affiliation(s)
- Yugen Yi
- School of Software, Jiangxi Normal University, Nanchang, 330022, China; Jiangxi Provincial Engineering Research Center of Blockchain Data Security and Governance, Nanchang, 330022, China
| | - Yan Jiang
- School of Software, Jiangxi Normal University, Nanchang, 330022, China
| | - Bin Zhou
- School of Software, Jiangxi Normal University, Nanchang, 330022, China
| | - Ningyi Zhang
- School of Software, Jiangxi Normal University, Nanchang, 330022, China
| | - Jiangyan Dai
- School of Computer Engineering, Weifang University, 261061, China.
| | - Xin Huang
- School of Software, Jiangxi Normal University, Nanchang, 330022, China
| | - Qinqin Zeng
- Department of Ophthalmology, The Second Affiliated Hospital of Nanchang University, Nanchang, 330006, China
| | - Wei Zhou
- College of Computer Science, Shenyang Aerospace University, Shenyang, 110136, China.
| |
Collapse
|
7
|
Calabrèse A, Fournet V, Dours S, Matonti F, Castet E, Kornprobst P. A New Vessel-Based Method to Estimate Automatically the Position of the Nonfunctional Fovea on Altered Retinography From Maculopathies. Transl Vis Sci Technol 2023; 12:9. [PMID: 37418249 PMCID: PMC10337789 DOI: 10.1167/tvst.12.7.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 06/01/2023] [Indexed: 07/08/2023] Open
Abstract
Purpose The purpose of this study was to validate a new automated method to locate the fovea on normal and pathological fundus images. Compared to the normative anatomic measures (NAMs), our vessel-based fovea localization (VBFL) approach relies on the retina's vessel structure to make predictions. Methods The spatial relationship between the fovea location and vessel characteristics is learnt from healthy fundus images and then used to predict fovea location in new images. We evaluate the VBFL method on three categories of fundus images: healthy images acquired with different head orientations and fixation locations, healthy images with simulated macular lesions, and pathological images from age-related macular degeneration (AMD). Results For healthy images taken with the head tilted to the side, the NAM estimation error is significantly multiplied by 4, whereas VBFL yields no significant increase, representing a 73% reduction in prediction error. With simulated lesions, VBFL performance decreases significantly as lesion size increases and remains better than NAM until lesion size reaches 200 degrees2. For pathological images, average prediction error was 2.8 degrees, with 64% of the images yielding an error of 2.5 degrees or less. VBFL was not robust for images showing darker regions and/or incomplete representation of the optic disk. Conclusions The vascular structure provides enough information to precisely locate the fovea in fundus images in a way that is robust to head tilt, eccentric fixation location, missing vessels, and actual macular lesions. Translational Relevance The VBFL method should allow researchers and clinicians to assess automatically the eccentricity of a newly developed area of fixation in fundus images with macular lesions.
Collapse
Affiliation(s)
- Aurélie Calabrèse
- Aix-Marseille Univ, CNRS, LPC, Marseille, France
- Université Côte d'Azur, Inria, France
| | | | | | - Frédéric Matonti
- Centre Monticelli Paradis d'Ophtalmologie, Marseille, France
- Aix-Marseille Univ, CNRS, INT, Marseille, France
- Groupe Almaviva Santé, Clinique Juge, Marseille, France
| | - Eric Castet
- Aix-Marseille Univ, CNRS, LPC, Marseille, France
| | | |
Collapse
|
8
|
Integrating convolutional neural networks, kNN, and Bayesian optimization for efficient diagnosis of Alzheimer's disease in magnetic resonance images. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
9
|
Zhao W, Zhang Z, Wang Z, Guo Y, Xie J, Xu X. ECLNet: Center localization of eye structures based on Adaptive Gaussian Ellipse Heatmap. Comput Biol Med 2023; 153:106485. [PMID: 36586229 DOI: 10.1016/j.compbiomed.2022.106485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/17/2022] [Accepted: 12/25/2022] [Indexed: 12/29/2022]
Abstract
Accurately localizing the center of specific biological structures in medical images is of great significance for clinical treatment. The center localization task can be viewed as an estimation problem of keypoints, and the heatmap is often used to describe the probability of the location of keypoints during estimation. Existing methods construct the heatmap from a Gaussian kernel function with a fixed standard deviation, therefore cannot adapt to morphologic changes of the target region. In this paper, we build a deep network, ECLNet, to localize the center of eye-related structures in medical images. Meanwhile, we propose a method called Adaptive Gaussian Ellipse Heatmap (AGEH), which can efficiently utilize the gradient feature of the target region to adjust the morphology of the heatmap. The ECLNet localizes the optic disc and fovea center with mean Euclidean Distance of 17.995 and 39.446 pixels, respectively, for IDRiD dataset. The ECLNet also successfully localizes the eye center with the mean absolute Position Error of 0.186±0.027 mm for CATARACT dataset. The results show that our proposed method has a better performance compared with some state-of-the-art methods.
Collapse
Affiliation(s)
- Wentao Zhao
- College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan, 030024, China.
| | - Zhe Zhang
- College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan, 030024, China
| | - Zhao Wang
- School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Yan Guo
- Beijing University of Chinese Medicine Third Affiliated Hospital, Beijing, 100029, China
| | - Jun Xie
- College of Information and Computer, Taiyuan University of Technology, Jinzhong, 030600, China
| | - Xinying Xu
- College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan, 030024, China.
| |
Collapse
|
10
|
Guo T, Liang Z, Gu Y, Liu K, Xu X, Yang J, Yu Q. Learning for retinal image quality assessment with label regularization. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 228:107238. [PMID: 36423485 DOI: 10.1016/j.cmpb.2022.107238] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 10/03/2022] [Accepted: 11/08/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE The assessment of the image quality is crucial before the computer-aided diagnosis of fundus images. This task is very challenging. Firstly, the subjective judgments of graders on image quality lead to ambiguous labels. Secondly, despite being treated as classification in existing works, grading has regression properties that cannot be ignored. Solving the ambiguity problem and regression problem in the label space, and extracting discriminative features, have become the keys to quality assessment. METHODS In this paper, we proposed a framework that can assess the quality of fundus images accurately and reasonably based on deep convolutional neural networks. Drawing on the experience of human graders, a dual-path convolutional neural network with attention blocks is designed to better extract discriminative features and present the bases of decision. Label smoothing and cost-sensitive regularization are designed to solve the label ambiguity problem and the potential regression problem respectively. Besides, a large number of images are annotated by us to further improve the results. RESULTS We conducted our experiments on the largest retinal image quality assessment dataset with 28,792 retinal images. Our approach achieves 0.8868 precision, 0.8786 recall, 0.8820 F1, and 0.9138 Kappa score. Results show that our approach outperforms state-of-the-art methods. CONCLUSIONS The promising performances reveal that our methods are beneficial to retinal image quality assessment and have potential in other grading tasks.
Collapse
Affiliation(s)
- Tianjiao Guo
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China; Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China; School of Biomedical Engineering, Shanghai Jiao Tong Univeristy, Shanghai, China.
| | - Ziyun Liang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China; Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China
| | - Yun Gu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China; Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China
| | - Kun Liu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine,Shanghai, China; National Clinical Research Center for Eye Diseases, Shanghai, China
| | - Xun Xu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine,Shanghai, China; National Clinical Research Center for Eye Diseases, Shanghai, China
| | - Jie Yang
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China.
| | - Qi Yu
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine,Shanghai, China; National Clinical Research Center for Eye Diseases, Shanghai, China.
| |
Collapse
|
11
|
Wibawa HA, Harjoko A, Sumiharto R, Sasongko MB. Efficient and Robust Method to Detect the Location of Macular Center Based on Optimal Temporal Determination. J Imaging 2022; 8:jimaging8120313. [PMID: 36547478 PMCID: PMC9781226 DOI: 10.3390/jimaging8120313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 11/04/2022] [Accepted: 11/11/2022] [Indexed: 11/24/2022] Open
Abstract
The location of the macular central is very important for the examination of macular edema when using an automated screening system. The erratic character of the macular light intensity and the absence of a clear border make this anatomical structure difficult to detect. This paper presents a new method for detecting the macular center based on its geometrical location in the temporal direction of the optic disc. Also, a new method of determining the temporal direction using the vascular features visible on the optic disc is proposed. After detecting the optic disc, the temporal direction is determined by considering blood vessel positions. The macular center is detected using thresholding and simple morphology operations with optimum macular region of interest (ROI) direction. The results show that the proposed method has a low computation time of 0.34 s/image with 100% accuracy for the DRIVE dataset, while that of DiaretDB1 was 0.57 s/image with 98.87% accuracy.
Collapse
Affiliation(s)
- Helmie Arif Wibawa
- Department of Informatics, Faculty of Science and Mathematics, Diponegoro University, Semarang 50275, Indonesia
- Department of Computer Science and Electronics, Faculty of Mathematics and Natural Sciences, Gadjah Mada University, Yogyakarta 55281, Indonesia
| | - Agus Harjoko
- Department of Computer Science and Electronics, Faculty of Mathematics and Natural Sciences, Gadjah Mada University, Yogyakarta 55281, Indonesia
- Correspondence:
| | - Raden Sumiharto
- Department of Computer Science and Electronics, Faculty of Mathematics and Natural Sciences, Gadjah Mada University, Yogyakarta 55281, Indonesia
| | - Muhammad Bayu Sasongko
- Department of Ophthalmology, Faculty of Public Health Medicine and Nursing, Gadjah Mada University, Yogyakarta 55281, Indonesia
| |
Collapse
|
12
|
Biswas S, Khan MIA, Hossain MT, Biswas A, Nakai T, Rohdin J. Which Color Channel Is Better for Diagnosing Retinal Diseases Automatically in Color Fundus Photographs? LIFE (BASEL, SWITZERLAND) 2022; 12:life12070973. [PMID: 35888063 PMCID: PMC9321111 DOI: 10.3390/life12070973] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 05/25/2022] [Accepted: 06/01/2022] [Indexed: 11/22/2022]
Abstract
Color fundus photographs are the most common type of image used for automatic diagnosis of retinal diseases and abnormalities. As all color photographs, these images contain information about three primary colors, i.e., red, green, and blue, in three separate color channels. This work aims to understand the impact of each channel in the automatic diagnosis of retinal diseases and abnormalities. To this end, the existing works are surveyed extensively to explore which color channel is used most commonly for automatically detecting four leading causes of blindness and one retinal abnormality along with segmenting three retinal landmarks. From this survey, it is clear that all channels together are typically used for neural network-based systems, whereas for non-neural network-based systems, the green channel is most commonly used. However, from the previous works, no conclusion can be drawn regarding the importance of the different channels. Therefore, systematic experiments are conducted to analyse this. A well-known U-shaped deep neural network (U-Net) is used to investigate which color channel is best for segmenting one retinal abnormality and three retinal landmarks.
Collapse
Affiliation(s)
- Sangeeta Biswas
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
- Correspondence: or
| | - Md. Iqbal Aziz Khan
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
| | - Md. Tanvir Hossain
- Faculty of Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh; (M.I.A.K.); (M.T.H.)
| | - Angkan Biswas
- CAPM Company Limited, Bonani, Dhaka 1213, Bangladesh;
| | - Takayoshi Nakai
- Faculty of Engineering, Shizuoka University, Hamamatsu 432-8561, Japan;
| | - Johan Rohdin
- Faculty of Information Technology, Brno University of Technology, 61200 Brno, Czech Republic;
| |
Collapse
|
13
|
Automated method for real-time AMD screening of fundus images dedicated for mobile devices. Med Biol Eng Comput 2022; 60:1449-1479. [DOI: 10.1007/s11517-022-02546-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Accepted: 03/06/2022] [Indexed: 01/01/2023]
|
14
|
Das D, Biswas SK, Bandyopadhyay S. A critical review on diagnosis of diabetic retinopathy using machine learning and deep learning. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:25613-25655. [PMID: 35342328 PMCID: PMC8940593 DOI: 10.1007/s11042-022-12642-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 06/29/2021] [Accepted: 02/09/2022] [Indexed: 06/12/2023]
Abstract
Diabetic Retinopathy (DR) is a health condition caused due to Diabetes Mellitus (DM). It causes vision problems and blindness due to disfigurement of human retina. According to statistics, 80% of diabetes patients battling from long diabetic period of 15 to 20 years, suffer from DR. Hence, it has become a dangerous threat to the health and life of people. To overcome DR, manual diagnosis of the disease is feasible but overwhelming and cumbersome at the same time and hence requires a revolutionary method. Thus, such a health condition necessitates primary recognition and diagnosis to prevent DR from developing into severe stages and prevent blindness. Innumerable Machine Learning (ML) models are proposed by researchers across the globe, to achieve this purpose. Various feature extraction techniques are proposed for extraction of DR features for early detection. However, traditional ML models have shown either meagre generalization throughout feature extraction and classification for deploying smaller datasets or consumes more of training time causing inefficiency in prediction while using larger datasets. Hence Deep Learning (DL), a new domain of ML, is introduced. DL models can handle a smaller dataset with help of efficient data processing techniques. However, they generally incorporate larger datasets for their deep architectures to enhance performance in feature extraction and image classification. This paper gives a detailed review on DR, its features, causes, ML models, state-of-the-art DL models, challenges, comparisons and future directions, for early detection of DR.
Collapse
Affiliation(s)
- Dolly Das
- National Institute of Technology Silchar, Cachar, Assam India
| | | | | |
Collapse
|
15
|
Google’s new AI technology detects cardiac issues using retinal scan. APPLIED NANOSCIENCE 2022. [DOI: 10.1007/s13204-021-02208-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
16
|
Camara J, Neto A, Pires IM, Villasana MV, Zdravevski E, Cunha A. Literature Review on Artificial Intelligence Methods for Glaucoma Screening, Segmentation, and Classification. J Imaging 2022; 8:19. [PMID: 35200722 PMCID: PMC8878383 DOI: 10.3390/jimaging8020019] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 01/11/2022] [Accepted: 01/17/2022] [Indexed: 12/20/2022] Open
Abstract
Artificial intelligence techniques are now being applied in different medical solutions ranging from disease screening to activity recognition and computer-aided diagnosis. The combination of computer science methods and medical knowledge facilitates and improves the accuracy of the different processes and tools. Inspired by these advances, this paper performs a literature review focused on state-of-the-art glaucoma screening, segmentation, and classification based on images of the papilla and excavation using deep learning techniques. These techniques have been shown to have high sensitivity and specificity in glaucoma screening based on papilla and excavation images. The automatic segmentation of the contours of the optic disc and the excavation then allows the identification and assessment of the glaucomatous disease's progression. As a result, we verified whether deep learning techniques may be helpful in performing accurate and low-cost measurements related to glaucoma, which may promote patient empowerment and help medical doctors better monitor patients.
Collapse
Affiliation(s)
- José Camara
- R. Escola Politécnica, Universidade Aberta, 1250-100 Lisboa, Portugal;
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
| | - Alexandre Neto
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
| | - Ivan Miguel Pires
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
- Instituto de Telecomunicações, Universidade da Beira Interior, 6200-001 Covilhã, Portugal
| | - María Vanessa Villasana
- Centro Hospitalar Universitário Cova da Beira, 6200-251 Covilhã, Portugal;
- UICISA:E Research Centre, School of Health, Polytechnic Institute of Viseu, 3504-510 Viseu, Portugal
| | - Eftim Zdravevski
- Faculty of Computer Science and Engineering, University Ss Cyril and Methodius, 1000 Skopje, North Macedonia;
| | - António Cunha
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
| |
Collapse
|
17
|
Gour N, Tanveer M, Khanna P. Challenges for ocular disease identification in the era of artificial intelligence. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06770-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
18
|
Lalitha S, Shanthi N, Gopinath S. A Detection of Amblyopia Medical Condition in Biomedical Datasets Using Image Segmentation and Detection Processing. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
The recent past, the data volume in a media field is growing at a rapid rate, and conventional methods fail to manage such a large volume of data in healthcare systems, biomedical field, medical diagnostic systems etc. The main challenges associated with biomedical computation are the
problems associated with management, storage, and analysis on extensive biomedical data. To play a significant role over such extensive data, the machine learning approach provides faster access to medical data with an improved framework. The main objective involves the detection of amblyopia
condition from input images and comparing it with conventional image detection methods. The proposed method is examined in terms of detection accuracy, sensitivity, specificity, Hausdorff distance computation and Dice Coefficient. Also, the detection of an Amblyopic or Lazy Eye diseased images
is still not prevalent in the field of image segmentation and detection. In this paper, we introduce a framework to process the Amblyopia image datasets using machine learning, and similarity comparison approach. The proposed image processing involves the segmentation of eye images using Recurrent
Neural Networks (RNN), and the detection of Amblyopia disease is carried out with Hausdorff Distance computation and Dice coefficient similarity comparison on the segmented image. The initial subset points and threshold values are calculated from a set of 50 normal eye images. A set of 100
Amblyopic diseased image dataset is used for testing the proposed system, out of which 70 images are used for training the system. To evaluate the experimental results shows that proposed method obtains improved detection than existing Deeply-Learned Gaze Shifting Path (DLGSP), Cascade Regression
Framework (CRF) and Mobile Iris Recognition System (MIRS) methods. The presence of Hausdorff Distance computation and Dice coefficient similarity comparison is used for reducing the overhead in the proposed method, and this can be used for computing large sets of images.
Collapse
Affiliation(s)
- S. Lalitha
- Department of Computer Science and Engineering, Gnanamani College of Technology, Namakkal 637018, Tamil Nadu, India
| | - N. Shanthi
- Department of Computer Science and Engineering, Kongu Engineering College, Erode 638052, Tamil Nadu, India
| | - S. Gopinath
- Department of Computer Science and Engineering, Gnanamani College of Technology, Namakkal 637018, Tamil Nadu, India
| |
Collapse
|
19
|
M. S, R. M, M. SM, R. S. Sequential Convolutional Neural Networks for classification of cognitive tasks from EEG signals. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107664] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
|
20
|
Shabbir A, Rasheed A, Shehraz H, Saleem A, Zafar B, Sajid M, Ali N, Dar SH, Shehryar T. Detection of glaucoma using retinal fundus images: A comprehensive review. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:2033-2076. [PMID: 33892536 DOI: 10.3934/mbe.2021106] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Content-based image analysis and computer vision techniques are used in various health-care systems to detect the diseases. The abnormalities in a human eye are detected through fundus images captured through a fundus camera. Among eye diseases, glaucoma is considered as the second leading case that can result in neurodegeneration illness. The inappropriate intraocular pressure within the human eye is reported as the main cause of this disease. There are no symptoms of glaucoma at earlier stages and if the disease remains unrectified then it can lead to complete blindness. The early diagnosis of glaucoma can prevent permanent loss of vision. Manual examination of human eye is a possible solution however it is dependant on human efforts. The automatic detection of glaucoma by using a combination of image processing, artificial intelligence and computer vision can help to prevent and detect this disease. In this review article, we aim to present a comprehensive review about the various types of glaucoma, causes of glaucoma, the details about the possible treatment, details about the publicly available image benchmarks, performance metrics, and various approaches based on digital image processing, computer vision, and deep learning. The review article presents a detailed study of various published research models that aim to detect glaucoma from low-level feature extraction to recent trends based on deep learning. The pros and cons of each approach are discussed in detail and tabular representations are used to summarize the results of each category. We report our findings and provide possible future research directions to detect glaucoma in conclusion.
Collapse
Affiliation(s)
- Amsa Shabbir
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Aqsa Rasheed
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Huma Shehraz
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Aliya Saleem
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Bushra Zafar
- Department of Computer Science, Government College University, Faisalabad 38000, Pakistan
| | - Muhammad Sajid
- Department of Electrical Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Nouman Ali
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Saadat Hanif Dar
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| | - Tehmina Shehryar
- Department of Software Engineering, Mirpur University of Science and Technology (MUST), Mirpur- AJK 10250, Pakistan
| |
Collapse
|
21
|
Xie H, Tang C, Xu M, Lei Z. Improved SSD network for accurate detection of optic disc and fovea and application in excyclotropia screening. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:10-18. [PMID: 33362147 DOI: 10.1364/josaa.403850] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 11/11/2020] [Indexed: 06/12/2023]
Abstract
The detection of the optic disc (OD) and fovea is essential to many automatic diagnosis systems for retinal diseases. The single shot multibox detector (SSD) can generate predictions from feature maps of various resolutions, which has not been introduced into the OD and fovea detection. To enhance the detection performance, we propose an improved SSD network, which has strengthened information flow enabled by the dense connections. The proposed method can achieve multiscale detection of the OD and fovea with strengthened feature propagation. Extensive experiments on the publicly available Messidor database and local fundus images are performed to evaluate the performance of the proposed method. Compared with seven types of representative solutions in the Messidor database, the proposed method can achieve competitive performance compared to state-of-the-art algorithms. Furthermore, the proposed method is applied to the excyclotropia screening. The screening results demonstrate promising application prospects for the proposed method in medical practice.
Collapse
|
22
|
Xie R, Liu J, Cao R, Qiu CS, Duan J, Garibaldi J, Qiu G. End-to-End Fovea Localisation in Colour Fundus Images With a Hierarchical Deep Regression Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:116-128. [PMID: 32915729 DOI: 10.1109/tmi.2020.3023254] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Accurately locating the fovea is a prerequisite for developing computer aided diagnosis (CAD) of retinal diseases. In colour fundus images of the retina, the fovea is a fuzzy region lacking prominent visual features and this makes it difficult to directly locate the fovea. While traditional methods rely on explicitly extracting image features from the surrounding structures such as the optic disc and various vessels to infer the position of the fovea, deep learning based regression technique can implicitly model the relation between the fovea and other nearby anatomical structures to determine the location of the fovea in an end-to-end fashion. Although promising, using deep learning for fovea localisation also has many unsolved challenges. In this paper, we present a new end-to-end fovea localisation method based on a hierarchical coarse-to-fine deep regression neural network. The innovative features of the new method include a multi-scale feature fusion technique and a self-attention technique to exploit location, semantic, and contextual information in an integrated framework, a multi-field-of-view (multi-FOV) feature fusion technique for context-aware feature learning and a Gaussian-shift-cropping method for augmenting effective training data. We present extensive experimental results on two public databases and show that our new method achieved state-of-the-art performances. We also present a comprehensive ablation study and analysis to demonstrate the technical soundness and effectiveness of the overall framework and its various constituent components.
Collapse
|
23
|
Hasan MK, Alam MA, Elahi MTE, Roy S, Martí R. DRNet: Segmentation and localization of optic disc and Fovea from diabetic retinopathy image. Artif Intell Med 2020; 111:102001. [PMID: 33461693 DOI: 10.1016/j.artmed.2020.102001] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2020] [Revised: 11/22/2020] [Accepted: 12/06/2020] [Indexed: 12/18/2022]
Abstract
BACKGROUND AND OBJECTIVE In modern ophthalmology, automated Computer-aided Screening Tools (CSTs) are crucial non-intrusive diagnosis methods, where an accurate segmentation of Optic Disc (OD) and localization of OD and Fovea centers are substantial integral parts. However, designing such an automated tool remains challenging due to small dataset sizes, inconsistency in spatial, texture, and shape information of the OD and Fovea, and the presence of different artifacts. METHODS This article proposes an end-to-end encoder-decoder network, named DRNet, for the segmentation and localization of OD and Fovea centers. In our DRNet, we propose a skip connection, named residual skip connection, for compensating the spatial information lost due to pooling in the encoder. Unlike the earlier skip connection in the UNet, the proposed skip connection does not directly concatenate low-level feature maps from the encoder's beginning layers with the corresponding same scale decoder. We validate DRNet using different publicly available datasets, such as IDRiD, RIMONE, DRISHTI-GS, and DRIVE for OD segmentation; IDRiD and HRF for OD center localization; and IDRiD for Fovea center localization. RESULTS The proposed DRNet, for OD segmentation, achieves mean Intersection over Union (mIoU) of 0.845, 0.901, 0.933, and 0.920 for IDRiD, RIMONE, DRISHTI-GS, and DRIVE, respectively. Our OD segmentation result, in terms of mIoU, outperforms the state-of-the-art results for IDRiD and DRIVE datasets, whereas it outperforms state-of-the-art results concerning mean sensitivity for RIMONE and DRISHTI-GS datasets. The DRNet localizes the OD center with mean Euclidean Distance (mED) of 20.23 and 13.34 pixels, respectively, for IDRiD and HRF datasets; it outperforms the state-of-the-art by 4.62 pixels for IDRiD dataset. The DRNet also successfully localizes the Fovea center with mED of 41.87 pixels for the IDRiD dataset, outperforming the state-of-the-art by 1.59 pixels for the same dataset. CONCLUSION As the proposed DRNet exhibits excellent performance even with limited training data and without intermediate intervention, it can be employed to design a better-CST system to screen retinal images. Our source codes, trained models, and ground-truth heatmaps for OD and Fovea center localization will be made publicly available upon publication at GitHub.1.
Collapse
Affiliation(s)
- Md Kamrul Hasan
- Department of Electrical and Electronic Engineering, Khulna University of Engineering & Technology, Khulna 9203, Bangladesh.
| | - Md Ashraful Alam
- Department of Electrical and Electronic Engineering, Khulna University of Engineering & Technology, Khulna 9203, Bangladesh.
| | - Md Toufick E Elahi
- Department of Electrical and Electronic Engineering, Khulna University of Engineering & Technology, Khulna 9203, Bangladesh.
| | - Shidhartho Roy
- Department of Electrical and Electronic Engineering, Khulna University of Engineering & Technology, Khulna 9203, Bangladesh.
| | - Robert Martí
- Computer Vision and Robotics Institute, University of Girona, Spain.
| |
Collapse
|
24
|
Romero-Oraá R, García M, Oraá-Pérez J, López MI, Hornero R. A robust method for the automatic location of the optic disc and the fovea in fundus images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 196:105599. [PMID: 32574904 DOI: 10.1016/j.cmpb.2020.105599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Accepted: 06/01/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE The location of the optic disc (OD) and the fovea is usually crucial in automatic screening systems for diabetic retinopathy. Previous methods aimed at their location often fail when these structures do not have the standard appearance. The purpose of this work is to propose novel, robust methods for the automatic detection of the OD and the fovea. METHODS The proposed method comprises a preprocessing stage, a method for retinal background extraction, a vasculature segmentation phase and the computation of various novel saliency maps. The main novelty of this work is the combination of the proposed saliency maps, which represent the spatial relationships between some structures of the retina and the visual appearance of the OD and fovea. Another contribution is the method to extract the retinal background, based on region-growing. RESULTS The proposed methods were evaluated over a proprietary database and three public databases: DRIVE, DiaretDB1 and Messidor. For the OD, we achieved 100% accuracy for all databases except Messidor (99.50%). As for the fovea location, we also reached 100% accuracy for all databases except Messidor (99.67%). CONCLUSIONS Our results suggest that the proposed methods are robust and effective to automatically detect the OD and the fovea. This way, they can be useful in automatic screening systems for diabetic retinopathy as well as other retinal diseases.
Collapse
Affiliation(s)
- Roberto Romero-Oraá
- Biomedical Engineering Group, E.T.S. Ingenieros de Telecomunicación, Universidad de Valladolid, Paseo Belén 15, Valladolid 47011, Spain.; Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Spain.
| | - María García
- Biomedical Engineering Group, E.T.S. Ingenieros de Telecomunicación, Universidad de Valladolid, Paseo Belén 15, Valladolid 47011, Spain.; Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Spain.
| | - Javier Oraá-Pérez
- Biomedical Engineering Group, E.T.S. Ingenieros de Telecomunicación, Universidad de Valladolid, Paseo Belén 15, Valladolid 47011, Spain..
| | - María I López
- Biomedical Engineering Group, E.T.S. Ingenieros de Telecomunicación, Universidad de Valladolid, Paseo Belén 15, Valladolid 47011, Spain.; Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Spain; Department of Ophthalmology, Hospital Clínico Universitario de Valladolid, Valladolid 47003, Spain.; Instituto Universitario de Oftalmobiología Aplicada (IOBA), Universidad de Valladolid, Valladolid 47011, Spain..
| | - Roberto Hornero
- Biomedical Engineering Group, E.T.S. Ingenieros de Telecomunicación, Universidad de Valladolid, Paseo Belén 15, Valladolid 47011, Spain.; Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Spain; Instituto de Investigación en Matemáticas (IMUVA), Universidad de Valladolid, Valladolid 47011, Spain..
| |
Collapse
|
25
|
Escorcia-Gutierrez J, Torrents-Barrena J, Gamarra M, Romero-Aroca P, Valls A, Puig D. Convexity shape constraints for retinal blood vessel segmentation and foveal avascular zone detection. Comput Biol Med 2020; 127:104049. [PMID: 33099218 DOI: 10.1016/j.compbiomed.2020.104049] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 10/06/2020] [Accepted: 10/07/2020] [Indexed: 11/17/2022]
Abstract
Diabetic retinopathy (DR) has become a major worldwide health problem due to the increase in blindness among diabetics at early ages. The detection of DR pathologies such as microaneurysms, hemorrhages and exudates through advanced computational techniques is of utmost importance in patient health care. New computer vision techniques are needed to improve upon traditional screening of color fundus images. The segmentation of the entire anatomical structure of the retina is a crucial phase in detecting these pathologies. This work proposes a novel framework for fast and fully automatic blood vessel segmentation and fovea detection. The preprocessing method involved both contrast limited adaptive histogram equalization and the brightness preserving dynamic fuzzy histogram equalization algorithms to enhance image contrast and eliminate noise artifacts. Afterwards, the color spaces and their intrinsic components were examined to identify the most suitable color model to reveal the foreground pixels against the entire background. Several samples were then collected and used by the renowned convexity shape prior segmentation algorithm. The proposed methodology achieved an average vasculature segmentation accuracy exceeding 96%, 95%, 98% and 94% for the DRIVE, STARE, HRF and Messidor publicly available datasets, respectively. An additional validation step reached an average accuracy of 94.30% using an in-house dataset provided by the Hospital Sant Joan of Reus (Spain). Moreover, an outstanding detection accuracy of over 98% was achieved for the foveal avascular zone. An extensive state-of-the-art comparison was also conducted. The proposed approach can thus be integrated into daily clinical practice to assist medical experts in the diagnosis of DR.
Collapse
Affiliation(s)
- José Escorcia-Gutierrez
- Electronic and Telecommunications Program, Universidad Autónoma Del Caribe, Barranquilla, Colombia; Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Jordina Torrents-Barrena
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Margarita Gamarra
- Departament of Computational Science and Electronic, Universidad de La Costa, CUC, Barranquilla, Colombia
| | - Pedro Romero-Aroca
- Ophthalmology Service, Universitari Hospital Sant Joan, Institut de Investigacio Sanitaria Pere Virgili [IISPV], Reus, Spain
| | - Aida Valls
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| | - Domenec Puig
- Departament D'Enginyeria Informàtica I Matemàtiques, Escola Técnica Superior D'Enginyeria, Universitat Rovira I Virgili, Tarragona, Spain.
| |
Collapse
|
26
|
Abdou AD, Ngom NF, Niang O. Arrhythmias Prediction Using an Hybrid Model Based on Convolutional Neural Network and Nonlinear Regression. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS 2020. [DOI: 10.1142/s1469026820500248] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
In biomedical signal processing, artificial intelligence techniques are used for identifying and extracting relevant information. However, it lacks effective solutions based on machine learning for the prediction of cardiac arrhythmias. The heart diseases diagnosis rests essentially on the analysis of various properties of ECG signal. The arrhythmia is one of the most common heart diseases. A cardiac arrhythmia is a disturbance of the heart rhythm. It occurs when the heart beats too slowly, too fast or anarchically, with no apparent cause. The diagnosis of cardiac arrhythmias is based on the analysis of the ECG properties, especially, the durations (P, QRS, T), the amplitudes (P, Q, R, S, T), the intervals (PQ, QT, RR), the cardiac frequency and the rhythm. In this paper we propose a system of arrhythmias diagnosis assistance based on the analysis of the temporal and frequential properties of the ECG signal. After the features extraction step, the ECG properties are then used as input for a convolutional neural network to detect and classify the arrhythmias. Finally, the classification results are used to perform a prediction of arrhythmias with nonlinear regression model. The method is illustrated using the MIT-BIH database.
Collapse
Affiliation(s)
| | - Ndeye Fatou Ngom
- Laboratoire Traitement de l’Inforrmation et Systémes Intelligents, Ecole Polytechnique de Thies, Thies, Sénégal
| | - Oumar Niang
- Laboratoire Traitement de l’Inforrmation et Systémes Intelligents, Ecole Polytechnique de Thies, Thies, Sénégal
| |
Collapse
|
27
|
Efficient and robust optic disc detection and fovea localization using region proposal network and cascaded network. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101939] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
28
|
Hybrid deep learning convolutional neural networks and optimal nonlinear support vector machine to detect presence of hemorrhage in retina. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101978] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
29
|
Hervella ÁS, Rouco J, Novo J, Ortega M. Learning the retinal anatomy from scarce annotated data using self-supervised multimodal reconstruction. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2020.106210] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
30
|
Ramachandran S, Kochitty S, Vinekar A, John R. A fully convolutional neural network approach for the localization of optic disc in retinopathy of prematurity diagnosis. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-179708] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Affiliation(s)
- Sivakumar Ramachandran
- Department of Electronics and Communication, College of Engineering Trivandrum, Kerala, India
| | - Shymol Kochitty
- Department of Electronics and Communication, College of Engineering Trivandrum, Kerala, India
| | - Anand Vinekar
- Department of Pediatric and Tele-ROP Services, Narayana Nethralaya Eye Hospital, Bangalore, India
| | - Renu John
- Department of Biomedical Engineering, Indian Institute of Technology Hyderabad, Telangana, India
| |
Collapse
|
31
|
Barros DMS, Moura JCC, Freire CR, Taleb AC, Valentim RAM, Morais PSG. Machine learning applied to retinal image processing for glaucoma detection: review and perspective. Biomed Eng Online 2020; 19:20. [PMID: 32293466 PMCID: PMC7160894 DOI: 10.1186/s12938-020-00767-2] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Accepted: 04/06/2020] [Indexed: 02/07/2023] Open
Abstract
INTRODUCTION This is a systematic review on the main algorithms using machine learning (ML) in retinal image processing for glaucoma diagnosis and detection. ML has proven to be a significant tool for the development of computer aided technology. Furthermore, secondary research has been widely conducted over the years for ophthalmologists. Such aspects indicate the importance of ML in the context of retinal image processing. METHODS The publications that were chosen to compose this review were gathered from Scopus, PubMed, IEEEXplore and Science Direct databases. Then, the papers published between 2014 and 2019 were selected . Researches that used the segmented optic disc method were excluded. Moreover, only the methods which applied the classification process were considered. The systematic analysis was performed in such studies and, thereupon, the results were summarized. DISCUSSION Based on architectures used for ML in retinal image processing, some studies applied feature extraction and dimensionality reduction to detect and isolate important parts of the analyzed image. Differently, other works utilized a deep convolutional network. Based on the evaluated researches, the main difference between the architectures is the number of images demanded for processing and the high computational cost required to use deep learning techniques. CONCLUSIONS All the analyzed publications indicated it was possible to develop an automated system for glaucoma diagnosis. The disease severity and its high occurrence rates justify the researches which have been carried out. Recent computational techniques, such as deep learning, have shown to be promising technologies in fundus imaging. Although such a technique requires an extensive database and high computational costs, the studies show that the data augmentation and transfer learning techniques have been applied as an alternative way to optimize and reduce networks training.
Collapse
Affiliation(s)
- Daniele M S Barros
- Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte, Natal, Brazil.
| | - Julio C C Moura
- Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte, Natal, Brazil
| | - Cefas R Freire
- Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte, Natal, Brazil
| | | | - Ricardo A M Valentim
- Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte, Natal, Brazil
| | - Philippi S G Morais
- Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte, Natal, Brazil
| |
Collapse
|
32
|
Guo X, Wang H, Lu X, Hu X, Che S, Lu Y. Robust Fovea Localization Based on Symmetry Measure. IEEE J Biomed Health Inform 2020; 24:2315-2326. [PMID: 32031956 DOI: 10.1109/jbhi.2020.2971593] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Automatic fovea localization is a challenging issue. In this article, we focus on the study of fovea localization and propose a robust fovea localization method. We propose concentric circular sectional symmetry measure (CCSSM) for symmetry axis detection, and region of interest (ROI) determination, which is a global feature descriptor robust against local feature changes, to solve the lesion interference issue, i.e., fovea visibility interference from lesions, using both structure features and morphological features. We propose the index of convexity and concavity (ICC) as the convexity-concavity measure of the surface and provide a quantitative evaluation tool for ophthalmologists to learn whether the occurrence of lesion within the ROI. We propose the weighted gradient accumulation map, which is insensitive to local intensity changes and can overcome the influence of noise and contamination, to perform refined localization. The advantages of the proposed method lies in two aspects. First, the accuracy and robustness can be achieved without typical sophisticated manner, i.e., blood vessel segmentation and parabola fitting. Second, the lesion interference is considered in our plan of fovea localization. Our proposed symmetry-based method is innovative in the solution of fovea detection, and it is simple, practical, and controllable. Experiment results show that the proposed method can resist the interference of unbalanced illumination and lesions, and achieve high accuracy rate in five datasets. Compared to the state-of-the-art methods, high robustness and accuracy of the proposed method guarantees its reliability.
Collapse
|
33
|
Celik N, O'Brien F, Brennan S, Rainbow RD, Dart C, Zheng Y, Coenen F, Barrett-Jolley R. Deep-Channel uses deep neural networks to detect single-molecule events from patch-clamp data. Commun Biol 2020; 3:3. [PMID: 31925311 PMCID: PMC6946689 DOI: 10.1038/s42003-019-0729-3] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2019] [Accepted: 12/06/2019] [Indexed: 12/05/2022] Open
Abstract
Single-molecule research techniques such as patch-clamp electrophysiology deliver unique biological insight by capturing the movement of individual proteins in real time, unobscured by whole-cell ensemble averaging. The critical first step in analysis is event detection, so called "idealisation", where noisy raw data are turned into discrete records of protein movement. To date there have been practical limitations in patch-clamp data idealisation; high quality idealisation is typically laborious and becomes infeasible and subjective with complex biological data containing many distinct native single-ion channel proteins gating simultaneously. Here, we show a deep learning model based on convolutional neural networks and long short-term memory architecture can automatically idealise complex single molecule activity more accurately and faster than traditional methods. There are no parameters to set; baseline, channel amplitude or numbers of channels for example. We believe this approach could revolutionise the unsupervised automatic detection of single-molecule transition events in the future.
Collapse
Affiliation(s)
- Numan Celik
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Fiona O'Brien
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Sean Brennan
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Richard D Rainbow
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Caroline Dart
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Yalin Zheng
- Faculty of Health and Life Science, University of Liverpool, Liverpool, UK
| | - Frans Coenen
- Department of Computer Science, University of Liverpool, Liverpool, UK
| | | |
Collapse
|
34
|
Automated detection of optic disc contours in fundus images using decision tree classifier. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2019.11.003] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
35
|
|
36
|
Hu S, Zhang C, Chen P, Gu P, Zhang J, Wang B. Predicting drug-target interactions from drug structure and protein sequence using novel convolutional neural networks. BMC Bioinformatics 2019; 20:689. [PMID: 31874614 PMCID: PMC6929541 DOI: 10.1186/s12859-019-3263-x] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Background Accurate identification of potential interactions between drugs and protein targets is a critical step to accelerate drug discovery. Despite many relative experimental researches have been done in the past decades, detecting drug-target interactions (DTIs) remains to be extremely resource-intensive and time-consuming. Therefore, many computational approaches have been developed for predicting drug-target associations on a large scale. Results In this paper, we proposed an deep learning-based method to predict DTIs only using the information of drug structures and protein sequences. The final results showed that our method can achieve good performance with the accuracies up to 92.0%, 90.0%, 92.0% and 90.7% for the target families of enzymes, ion channels, GPCRs and nuclear receptors of our created dataset, respectively. Another dataset derived from DrugBank was used to further assess the generalization of the model, which yielded an accuracy of 0.9015 and an AUC value of 0.9557. Conclusion It was elucidated that our model shows improved performance in comparison with other state-of-the-art computational methods on the common benchmark datasets. Experimental results demonstrated that our model successfully extracted more nuanced yet useful features, and therefore can be used as a practical tool to discover new drugs. Availability http://deeplearner.ahu.edu.cn/web/CnnDTI.htm.
Collapse
Affiliation(s)
- ShanShan Hu
- School of Computer Science and Technology, Anhui University, Jiulong Road, Hefei, 230601, China
| | - Chenglin Zhang
- Institutes of Physical Science and Information Technology, Anhui University, Jiulong Road, Hefei, 230601, China
| | - Peng Chen
- School of Computer Science and Technology, Anhui University, Jiulong Road, Hefei, 230601, China. .,Institutes of Physical Science and Information Technology, Anhui University, Jiulong Road, Hefei, 230601, China. .,Cadre's Ward (South District), The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230001, China.
| | - Pengying Gu
- Cadre's Ward (South District), The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230001, China.
| | - Jun Zhang
- School of Electrical and Information Engineering, Anhui University, Hefei, 230601, China
| | - Bing Wang
- School of Electrical and Information Engineering, Anhui University of Technology, Ma'anshan, 243032, China
| |
Collapse
|
37
|
Sengupta S, Singh A, Leopold HA, Gulati T, Lakshminarayanan V. Ophthalmic diagnosis using deep learning with fundus images - A critical review. Artif Intell Med 2019; 102:101758. [PMID: 31980096 DOI: 10.1016/j.artmed.2019.101758] [Citation(s) in RCA: 64] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2019] [Revised: 11/04/2019] [Accepted: 11/05/2019] [Indexed: 12/23/2022]
Abstract
An overview of the applications of deep learning for ophthalmic diagnosis using retinal fundus images is presented. We describe various retinal image datasets that can be used for deep learning purposes. Applications of deep learning for segmentation of optic disk, optic cup, blood vessels as well as detection of lesions are reviewed. Recent deep learning models for classification of diseases such as age-related macular degeneration, glaucoma, and diabetic retinopathy are also discussed. Important critical insights and future research directions are given.
Collapse
Affiliation(s)
- Sourya Sengupta
- Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Ontario, Canada; Department of Systems Design Engineering, University of Waterloo, Ontario, Canada.
| | - Amitojdeep Singh
- Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Ontario, Canada; Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| | - Henry A Leopold
- Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Ontario, Canada; Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| | - Tanmay Gulati
- Department of Computer Science and Engineering, Manipal Institute of Technology, India
| | - Vasudevan Lakshminarayanan
- Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Ontario, Canada; Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| |
Collapse
|
38
|
Dietter J, Haq W, Ivanov IV, Norrenberg LA, Völker M, Dynowski M, Röck D, Ziemssen F, Leitritz MA, Ueffing M. Optic disc detection in the presence of strong technical artifacts. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.04.012] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
39
|
Recent Development on Detection Methods for the Diagnosis of Diabetic Retinopathy. Symmetry (Basel) 2019. [DOI: 10.3390/sym11060749] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Diabetic retinopathy (DR) is a complication of diabetes that exists throughout the world. DR occurs due to a high ratio of glucose in the blood, which causes alterations in the retinal microvasculature. Without preemptive symptoms of DR, it leads to complete vision loss. However, early screening through computer-assisted diagnosis (CAD) tools and proper treatment have the ability to control the prevalence of DR. Manual inspection of morphological changes in retinal anatomic parts are tedious and challenging tasks. Therefore, many CAD systems were developed in the past to assist ophthalmologists for observing inter- and intra-variations. In this paper, a recent review of state-of-the-art CAD systems for diagnosis of DR is presented. We describe all those CAD systems that have been developed by various computational intelligence and image processing techniques. The limitations and future trends of current CAD systems are also described in detail to help researchers. Moreover, potential CAD systems are also compared in terms of statistical parameters to quantitatively evaluate them. The comparison results indicate that there is still a need for accurate development of CAD systems to assist in the clinical diagnosis of diabetic retinopathy.
Collapse
|
40
|
Optic Disc Localization in Complicated Environment of Retinal Image Using Circular-Like Estimation. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2019. [DOI: 10.1007/s13369-019-03756-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
41
|
Statistical Edge Detection and Circular Hough Transform for Optic Disk Localization. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9020350] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Accurate and efficient localization of the optic disk (OD) in retinal images is an essential process for the diagnosis of retinal diseases, such as diabetic retinopathy, papilledema, and glaucoma, in automatic retinal analysis systems. This paper presents an effective and robust framework for automatic detection of the OD. The framework begins with the process of elimination of the pixels below the average brightness level of the retinal images. Next, a method based on the modified robust rank order was used for edge detection. Finally, the circular Hough transform (CHT) was performed on the obtained retinal images for OD localization. Three public datasets were used to evaluate the performance of the proposed method. The optic disks were successfully located with the success rates of 100%, 96.92%, and 98.88% for the DRIVE, DIARETDB0, and DIARETDB1 datasets, respectively.
Collapse
|
42
|
Automatic Optic Disc Detection in Color Retinal Images by Local Feature Spectrum Analysis. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:1942582. [PMID: 30013614 PMCID: PMC6022274 DOI: 10.1155/2018/1942582] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Revised: 05/15/2018] [Accepted: 05/23/2018] [Indexed: 11/17/2022]
Abstract
The optic disc is a key anatomical structure in retinal images. The ability to detect optic discs in retinal images plays an important role in automated screening systems. Inspired by the fact that humans can find optic discs in retinal images by observing some local features, we propose a local feature spectrum analysis (LFSA) that eliminates the influence caused by the variable spatial positions of local features. In LFSA, a dictionary of local features is used to reconstruct new optic disc candidate images, and the utilization frequencies of every atom in the dictionary are considered as a type of "spectrum" that can be used for classification. We also employ the sparse dictionary selection approach to construct a compact and representative dictionary. Unlike previous approaches, LFSA does not require the segmentation of vessels, and its method of considering the varying information in the retinal images is both simple and robust, making it well-suited for automated screening systems. Experimental results on the largest publicly available dataset indicate the effectiveness of our proposed approach.
Collapse
|
43
|
Mitra A, Banerjee PS, Roy S, Roy S, Setua SK. The region of interest localization for glaucoma analysis from retinal fundus image using deep learning. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 165:25-35. [PMID: 30337079 DOI: 10.1016/j.cmpb.2018.08.003] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2018] [Revised: 07/14/2018] [Accepted: 08/07/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVES Retinal fundus image analysis without manual intervention has been rising as an imperative analytical approach for early detection of eye-related diseases such as glaucoma and diabetic retinopathy. For analysis and detection of Glaucoma and some other disease from retinal image, there is a significant role of predicting the bounding box coordinates of Optic Disc (OD) that acts as a Region of Interest (ROI). METHODS We reframe ROI detection as a solitary regression predicament, from image pixel values to ROI coordinates including class probabilities. A Convolution Neural Network (CNN) has trained on full images to predict bounding boxes along with their analogous probabilities and confidence scores. The publically available MESSIDOR and Kaggle datasets have been used to train the network. We adopted various data augmentation techniques to amplify our dataset so that our network becomes less sensitive to noise. From a very high-level perspective, every image is divided into a 13 × 13 grid. Every grid cell envisages 5 bounding boxes along with the corresponding class probability and a confidence score. Before training, the network and the bounding box priors or anchors are initialized using k-means clustering on the original dataset using a distance metric based on Intersection of the Union (IOU) over ground-truth bounding boxes. During training in fact, a sum-squared loss function is used as the prediction's error function. Finally, Non-maximum suppression is applied by the proposed methodology to reach the concluding prediction. RESULTS The following projected method accomplish an accuracy of 99.05% and 98.78% on the Kaggle and MESSIDOR test sets for ROI detection. Results of proposed methodology indicates that proposed network is able to perceive ROI in fundus images in 0.0045 s at 25 ms of latency, which is far better than the recent-time and using no handcrafted features. CONCLUSIONS The network predicts accurate results even on low-quality images without being biased towards any particular type of image. The network prepared to see more summed up depiction rather than past works in the field. Going by the results, our novel method has better diagnosis of eye diseases in the future in a faster and reliable way.
Collapse
Affiliation(s)
- Anirban Mitra
- Department of Computer Science and Engineering, Calcutta University Technology Campus, JD-2, Sector-III, Salt Lake, Kolkata 700098, India; Department of Computer Science and Engineering, Academy of Technology, Adisaptagram 712121, West Bengal, India
| | - Priya Shankar Banerjee
- Department of Computer Science and Engineering, Academy of Technology, Adisaptagram 712121, West Bengal, India
| | - Sudipta Roy
- Department of Computer Science and Engineering, Calcutta University Technology Campus, JD-2, Sector-III, Salt Lake, Kolkata 700098, India; Mallinckrodt Institute of Radiology Department (MIR), Washington University School of Medicine, Campus Box 8225, 510 South Kingshighway Boulevard, Saint Louis, MO 63110-1076, USA.
| | - Somasis Roy
- Department of Computer Science and Engineering, Calcutta University Technology Campus, JD-2, Sector-III, Salt Lake, Kolkata 700098, India
| | - Sanjit Kumar Setua
- Department of Computer Science and Engineering, Calcutta University Technology Campus, JD-2, Sector-III, Salt Lake, Kolkata 700098, India
| |
Collapse
|
44
|
Schmidt-Erfurth U, Sadeghipour A, Gerendas BS, Waldstein SM, Bogunović H. Artificial intelligence in retina. Prog Retin Eye Res 2018; 67:1-29. [PMID: 30076935 DOI: 10.1016/j.preteyeres.2018.07.004] [Citation(s) in RCA: 358] [Impact Index Per Article: 59.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2018] [Revised: 07/24/2018] [Accepted: 07/31/2018] [Indexed: 02/08/2023]
Abstract
Major advances in diagnostic technologies are offering unprecedented insight into the condition of the retina and beyond ocular disease. Digital images providing millions of morphological datasets can fast and non-invasively be analyzed in a comprehensive manner using artificial intelligence (AI). Methods based on machine learning (ML) and particularly deep learning (DL) are able to identify, localize and quantify pathological features in almost every macular and retinal disease. Convolutional neural networks thereby mimic the path of the human brain for object recognition through learning of pathological features from training sets, supervised ML, or even extrapolation from patterns recognized independently, unsupervised ML. The methods of AI-based retinal analyses are diverse and differ widely in their applicability, interpretability and reliability in different datasets and diseases. Fully automated AI-based systems have recently been approved for screening of diabetic retinopathy (DR). The overall potential of ML/DL includes screening, diagnostic grading as well as guidance of therapy with automated detection of disease activity, recurrences, quantification of therapeutic effects and identification of relevant targets for novel therapeutic approaches. Prediction and prognostic conclusions further expand the potential benefit of AI in retina which will enable personalized health care as well as large scale management and will empower the ophthalmologist to provide high quality diagnosis/therapy and successfully deal with the complexity of 21st century ophthalmology.
Collapse
Affiliation(s)
- Ursula Schmidt-Erfurth
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Vienna Reading Center, Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria.
| | - Amir Sadeghipour
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Vienna Reading Center, Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Bianca S Gerendas
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Vienna Reading Center, Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Sebastian M Waldstein
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Vienna Reading Center, Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Hrvoje Bogunović
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Vienna Reading Center, Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| |
Collapse
|
45
|
Dense Fully Convolutional Segmentation of the Optic Disc and Cup in Colour Fundus for Glaucoma Diagnosis. Symmetry (Basel) 2018. [DOI: 10.3390/sym10040087] [Citation(s) in RCA: 93] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
46
|
Wang SH, Phillips P, Sui Y, Liu B, Yang M, Cheng H. Classification of Alzheimer's Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling. J Med Syst 2018; 42:85. [PMID: 29577169 DOI: 10.1007/s10916-018-0932-7] [Citation(s) in RCA: 103] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Accepted: 03/06/2018] [Indexed: 01/19/2023]
Abstract
Alzheimer's disease (AD) is a progressive brain disease. The goal of this study is to provide a new computer-vision based technique to detect it in an efficient way. The brain-imaging data of 98 AD patients and 98 healthy controls was collected using data augmentation method. Then, convolutional neural network (CNN) was used, CNN is the most successful tool in deep learning. An 8-layer CNN was created with optimal structure obtained by experiences. Three activation functions (AFs): sigmoid, rectified linear unit (ReLU), and leaky ReLU. The three pooling-functions were also tested: average pooling, max pooling, and stochastic pooling. The numerical experiments demonstrated that leaky ReLU and max pooling gave the greatest result in terms of performance. It achieved a sensitivity of 97.96%, a specificity of 97.35%, and an accuracy of 97.65%, respectively. In addition, the proposed approach was compared with eight state-of-the-art approaches. The method increased the classification accuracy by approximately 5% compared to state-of-the-art methods.
Collapse
Affiliation(s)
- Shui-Hua Wang
- Department of Informatics, University of Leicester, Leicester, LE1 7RH, UK.
- Department of Electrical Engineering, The City College of New York, CUNY, New York, NY, 10031, USA.
| | - Preetha Phillips
- West Virginia School of Osteopathic Medicine, 400 N Lee St, Lewisburg, WV, 24901, USA.
| | - Yuxiu Sui
- Department of Psychiatry, Affiliated Nanjing Brain Hospital of Nanjing Medical University, Nanjing, People's Republic of China
| | - Bin Liu
- Department of Radiology, Zhong-Da Hospital of Southeast University, Nanjing, 210009, China
| | - Ming Yang
- Department of Radiology, Children's Hospital of Nanjing Medical University, Nanjing, 210008, People's Republic of China
| | - Hong Cheng
- Department of Neurology, First Affiliated Hospital of Nanjing Medical University, Nanjing, 210029, China.
| |
Collapse
|
47
|
Automated fuzzy optic disc detection algorithm using branching of vessels and color properties in fundus images. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.08.003] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|