1
|
Guo H, Meng J, Zhao Y, Zhang H, Dai C. High-precision retinal blood vessel segmentation based on a multi-stage and dual-channel deep learning network. Phys Med Biol 2024; 69:045007. [PMID: 38198716 DOI: 10.1088/1361-6560/ad1cf6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Accepted: 01/10/2024] [Indexed: 01/12/2024]
Abstract
Objective.The high-precision segmentation of retinal vessels in fundus images is important for the early diagnosis of ophthalmic diseases. However, the extraction for microvessels is challenging due to their characteristics of low contrast and high structural complexity. Although some works have been developed to improve the segmentation ability in thin vessels, they have only been successful in recognizing small vessels with relatively high contrast.Approach.Therefore, we develop a deep learning (DL) framework with a multi-stage and dual-channel network model (MSDC_NET) to further improve the thin-vessel segmentation with low contrast. Specifically, an adaptive image enhancement strategy combining multiple preprocessing and the DL method is firstly proposed to elevate the contrast of thin vessels; then, a two-channel model with multi-scale perception is developed to implement whole- and thin-vessel segmentation; and finally, a series of post-processing operations are designed to extract more small vessels in the predicted maps from thin-vessel channels.Main results.Experiments on DRIVE, STARE and CHASE_DB1 demonstrate the superiorities of the proposed MSDC_NET in extracting more thin vessels in fundus images, and quantitative evaluations on several parameters based on the advanced ground truth further verify the advantages of our proposed DL model. Compared with the previous multi-branch method, the specificity and F1score are improved by about 2.18%, 0.68%, 1.73% and 2.91%, 0.24%, 8.38% on the three datasets, respectively.Significance.This work may provide richer information to ophthalmologists for the diagnosis and treatment of vascular-related ophthalmic diseases.
Collapse
Affiliation(s)
- Hui Guo
- School of Computer, Qufu Normal University, 276826 Rizhao, People's Republic of China
| | - Jing Meng
- School of Computer, Qufu Normal University, 276826 Rizhao, People's Republic of China
| | - Yongfu Zhao
- School of Computer, Qufu Normal University, 276826 Rizhao, People's Republic of China
| | - Hongdong Zhang
- School of Computer, Qufu Normal University, 276826 Rizhao, People's Republic of China
| | - Cuixia Dai
- College of Science, Shanghai Institute of Technology, 201418 Shanghai, People's Republic of China
| |
Collapse
|
2
|
Krzywicki T, Brona P, Zbrzezny AM, Grzybowski AE. A Global Review of Publicly Available Datasets Containing Fundus Images: Characteristics, Barriers to Access, Usability, and Generalizability. J Clin Med 2023; 12:jcm12103587. [PMID: 37240693 DOI: 10.3390/jcm12103587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 04/29/2023] [Accepted: 05/17/2023] [Indexed: 05/28/2023] Open
Abstract
This article provides a comprehensive and up-to-date overview of the repositories that contain color fundus images. We analyzed them regarding availability and legality, presented the datasets' characteristics, and identified labeled and unlabeled image sets. This study aimed to complete all publicly available color fundus image datasets to create a central catalog of available color fundus image datasets.
Collapse
Affiliation(s)
- Tomasz Krzywicki
- Faculty of Mathematics and Computer Science, University of Warmia and Mazury, 10-710 Olsztyn, Poland
| | - Piotr Brona
- Department of Ophthalmology, Poznan City Hospital, 61-285 Poznań, Poland
| | - Agnieszka M Zbrzezny
- Faculty of Mathematics and Computer Science, University of Warmia and Mazury, 10-710 Olsztyn, Poland
- Faculty of Design, SWPS University of Social Sciences and Humanities, Chodakowska 19/31, 03-815 Warsaw, Poland
| | - Andrzej E Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, 60-836 Poznań, Poland
| |
Collapse
|
3
|
Luo Z, Ding X, Hou N, Wan J. A Deep-Learning-Based Collaborative Edge-Cloud Telemedicine System for Retinopathy of Prematurity. SENSORS (BASEL, SWITZERLAND) 2022; 23:276. [PMID: 36616874 PMCID: PMC9824555 DOI: 10.3390/s23010276] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 12/22/2022] [Accepted: 12/22/2022] [Indexed: 06/17/2023]
Abstract
Retinopathy of prematurity is an ophthalmic disease with a very high blindness rate. With its increasing incidence year by year, its timely diagnosis and treatment are of great significance. Due to the lack of timely and effective fundus screening for premature infants in remote areas, leading to an aggravation of the disease and even blindness, in this paper, a deep learning-based collaborative edge-cloud telemedicine system is proposed to mitigate this issue. In the proposed system, deep learning algorithms are mainly used for classification of processed images. Our algorithm is based on ResNet101 and uses undersampling and resampling to improve the data imbalance problem in the field of medical image processing. Artificial intelligence algorithms are combined with a collaborative edge-cloud architecture to implement a comprehensive telemedicine system to realize timely screening and diagnosis of retinopathy of prematurity in remote areas with shortages or a complete lack of expert medical staff. Finally, the algorithm is successfully embedded in a mobile terminal device and deployed through the support of a core hospital of Guangdong Province. The results show that we achieved 75% ACC and 60% AUC. This research is of great significance for the development of telemedicine systems and aims to mitigate the lack of medical resources and their uneven distribution in rural areas.
Collapse
Affiliation(s)
- Zeliang Luo
- College of Electro-Mechanical Engineering, Zhuhai City Polytechnic, Zhuhai 519090, China
| | - Xiaoxuan Ding
- Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou 510641, China
| | - Ning Hou
- Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou 510641, China
| | - Jiafu Wan
- Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou 510641, China
| |
Collapse
|
4
|
A Hybrid Fusion Method Combining Spatial Image Filtering with Parallel Channel Network for Retinal Vessel Segmentation. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2022. [DOI: 10.1007/s13369-022-07311-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
5
|
Klauser AS, Strobl S, Schwabl C, Klotz W, Feuchtner G, Moriggl B, Held J, Taljanovic M, Weaver JS, Reijnierse M, Gizewski ER, Stofferin H. Prevalence of Monosodium Urate (MSU) Deposits in Cadavers Detected by Dual-Energy Computed Tomography (DECT). Diagnostics (Basel) 2022; 12:diagnostics12051240. [PMID: 35626395 PMCID: PMC9139977 DOI: 10.3390/diagnostics12051240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/06/2022] [Accepted: 05/13/2022] [Indexed: 02/06/2023] Open
Abstract
Background: Dual-energy computed tomography (DECT) allows direct visualization of monosodium urate (MSU) deposits in joints and soft tissues. Purpose: To describe the distribution of MSU deposits in cadavers using DECT in the head, body trunk, and feet. Materials and Methods: A total of 49 cadavers (41 embalmed and 8 fresh cadavers; 20 male, 29 female; mean age, 79.5 years; SD ± 11.3; range 52–95) of unknown clinical history underwent DECT to assess MSU deposits in the head, body trunk, and feet. Lens, thoracic aorta, and foot tendon dissections of fresh cadavers were used to verify MSU deposits by polarizing light microscopy. Results: 33/41 embalmed cadavers (80.5%) showed MSU deposits within the thoracic aorta. 11/41 cadavers (26.8%) showed MSU deposits within the metatarsophalangeal (MTP) joints and 46.3% of cadavers demonstrated MSU deposits within foot tendons, larger than and equal to 5 mm. No MSU deposits were detected in the cranium/intracerebral vessels, or the coronary arteries. Microscopy used as a gold standard could verify the presence of MSU deposits within the lens, thoracic aorta, or foot tendons in eight fresh cadavers. Conclusions: Microscopy confirmed the presence of MSU deposits in fresh cadavers within the lens, thoracic aorta, and foot tendons, whereas no MSU deposits could be detected in cranium/intracerebral vessels or coronary arteries. DECT may offer great potential as a screening tool to detect MSU deposits and measure the total uric acid burden in the body. The clinical impact of this cadaver study in terms of assessment of MSU burden should be further proven.
Collapse
Affiliation(s)
- Andrea S. Klauser
- Department of Radiology, Medical University Innsbruck, 6020 Innsbruck, Austria; (A.S.K.); (G.F.); (E.R.G.)
| | - Sylvia Strobl
- Department of Radiology, Medical University Innsbruck, 6020 Innsbruck, Austria; (A.S.K.); (G.F.); (E.R.G.)
| | - Christoph Schwabl
- Department of Radiology, Medical University Innsbruck, 6020 Innsbruck, Austria; (A.S.K.); (G.F.); (E.R.G.)
- Correspondence:
| | - Werner Klotz
- Department of Internal Medicine II, Medical University Innsbruck, 6020 Innsbruck, Austria; (W.K.); (J.H.)
| | - Gudrun Feuchtner
- Department of Radiology, Medical University Innsbruck, 6020 Innsbruck, Austria; (A.S.K.); (G.F.); (E.R.G.)
| | - Bernhard Moriggl
- Department of Anatomy, Histology and Embryology, Institute of Clinical and Functional Anatomy, Medical University Innsbruck, 6020 Innsbruck, Austria; (B.M.); (H.S.)
| | - Julia Held
- Department of Internal Medicine II, Medical University Innsbruck, 6020 Innsbruck, Austria; (W.K.); (J.H.)
| | - Mihra Taljanovic
- Department of Medical Imaging, Banner University Medical Center, College of Medicine, The University of Arizona, Tucson, AZ 85724, USA;
| | - Jennifer S. Weaver
- Department of Radiology, University of New Mexico, Albuquerque, NM 87131, USA;
| | - Monique Reijnierse
- Division of Musculoskeletal Radiology, Department of Radiology, Leiden University Medical Center, 2333 ZC Leiden, The Netherlands;
| | - Elke R. Gizewski
- Department of Radiology, Medical University Innsbruck, 6020 Innsbruck, Austria; (A.S.K.); (G.F.); (E.R.G.)
| | - Hannes Stofferin
- Department of Anatomy, Histology and Embryology, Institute of Clinical and Functional Anatomy, Medical University Innsbruck, 6020 Innsbruck, Austria; (B.M.); (H.S.)
| |
Collapse
|
6
|
Huang J, Lin Z, Chen Y, Zhang X, Zhao W, Zhang J, Li Y, He X, Zhan M, Lu L, Jiang X, Peng Y. DBFU-Net: Double branch fusion U-Net with hard example weighting train strategy to segment retinal vessel. PeerJ Comput Sci 2022; 8:e871. [PMID: 35494791 PMCID: PMC9044242 DOI: 10.7717/peerj-cs.871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 01/10/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Many fundus imaging modalities measure ocular changes. Automatic retinal vessel segmentation (RVS) is a significant fundus image-based method for the diagnosis of ophthalmologic diseases. However, precise vessel segmentation is a challenging task when detecting micro-changes in fundus images, e.g., tiny vessels, vessel edges, vessel lesions and optic disc edges. METHODS In this paper, we will introduce a novel double branch fusion U-Net model that allows one of the branches to be trained by a weighting scheme that emphasizes harder examples to improve the overall segmentation performance. A new mask, we call a hard example mask, is needed for those examples that include a weighting strategy that is different from other methods. The method we propose extracts the hard example mask by morphology, meaning that the hard example mask does not need any rough segmentation model. To alleviate overfitting, we propose a random channel attention mechanism that is better than the drop-out method or the L2-regularization method in RVS. RESULTS We have verified the proposed approach on the DRIVE, STARE and CHASE datasets to quantify the performance metrics. Compared to other existing approaches, using those dataset platforms, the proposed approach has competitive performance metrics. (DRIVE: F1-Score = 0.8289, G-Mean = 0.8995, AUC = 0.9811; STARE: F1-Score = 0.8501, G-Mean = 0.9198, AUC = 0.9892; CHASE: F1-Score = 0.8375, G-Mean = 0.9138, AUC = 0.9879). DISCUSSION The segmentation results showed that DBFU-Net with RCA achieves competitive performance in three RVS datasets. Additionally, the proposed morphological-based extraction method for hard examples can reduce the computational cost. Finally, the random channel attention mechanism proposed in this paper has proven to be more effective than other regularization methods in the RVS task.
Collapse
Affiliation(s)
- Jianping Huang
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Zefang Lin
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Yingyin Chen
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Xiao Zhang
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Wei Zhao
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Jie Zhang
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Department of Nuclear Medicine, Zhuhai, China
| | - Yong Li
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Xu He
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Meixiao Zhan
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Ligong Lu
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai, China
| | - Xiaofei Jiang
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Department of cardiology, Zhuhai, China
| | - Yongjun Peng
- Zhuhai People’s Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Department of Nuclear Medicine, Zhuhai, China
| |
Collapse
|
7
|
Akbar S, Hassan SA, Shoukat A, Alyami J, Bahaj SA. Detection of microscopic glaucoma through fundus images using deep transfer learning approach. Microsc Res Tech 2022; 85:2259-2276. [PMID: 35170136 DOI: 10.1002/jemt.24083] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Revised: 01/05/2022] [Accepted: 01/27/2022] [Indexed: 11/07/2022]
Abstract
Glaucoma disease in humans can lead to blindness if it progresses to the point where it affects the oculus' optic nerve head. It is not easily detected since there are no symptoms, but it can be detected using tonometry, ophthalmoscopy, and perimeter. However, advances in artificial intelligence approaches have permitted machine learning techniques to diagnose at an early stage. Numerous methods have been proposed using Machine Learning to diagnose glaucoma with different data sets and techniques but these are complex methods. Although, medical imaging instruments are used as glaucoma screening methods, fundus imaging specifically is the most used screening technique for glaucoma detection. This study presents a novel DenseNet and DarkNet combination to classify normal and glaucoma affected fundus image. These frameworks have been trained and tested on three data sets of high-resolution fundus (HRF), RIM 1, and ACRIMA. A total of 658 images have been used for healthy eyes and 612 images for glaucoma-affected eyes classification. It has also been observed that the fusion of DenseNet and DarkNet outperforms the two CNN networks and achieved 99.7% accuracy, 98.9% sensitivity, 100% specificity for the HRF database. In contrast, for the RIM1 database, 89.3% accuracy, 93.3% sensitivity, 88.46% specificity has been attained. Moreover, for the ACRIMA database, 99% accuracy, 100% sensitivity, 99% specificity has been achieved. Therefore, the proposed method is robust and efficient with less computational time and complexity compared to the literature available.
Collapse
Affiliation(s)
- Shahzad Akbar
- Riphah College of Computing, Riphah International University, Faisalabad Campus, Faisalabad, Pakistan
| | - Syed Ale Hassan
- Riphah College of Computing, Riphah International University, Faisalabad Campus, Faisalabad, Pakistan
| | - Ayesha Shoukat
- Riphah College of Computing, Riphah International University, Faisalabad Campus, Faisalabad, Pakistan
| | - Jaber Alyami
- Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah, 21589, Saudi Arabia.,Imaging Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, 21589, Saudi Arabia
| | - Saeed Ali Bahaj
- MIS Department, College of Business Administration, Prince Sattam Bin Abdulaziz University, Alkharj, 11942, Saudi Arabia
| |
Collapse
|
8
|
Macular Edema and Visual Acuity Observation after Cataract Surgery in Patients with Diabetic Retinopathy. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:3311751. [PMID: 35126918 PMCID: PMC8808216 DOI: 10.1155/2022/3311751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 01/04/2022] [Accepted: 01/07/2022] [Indexed: 11/17/2022]
Abstract
Objective. The purpose was to explore the effect of cataract surgery on postoperative macular edema and visual acuity in patients with diabetic retinopathy. Methods. 88 patients with diabetic retinopathy treated in our hospital (December 2019–December 2020) were chosen as research subjects and divided into experimental group of 44 patients (52 eyes) and control group of 44 patients (54 eyes) according to the odd and even admission numbers. The control group received laser photocoagulation treatment, while the experimental group underwent cataract surgery. The central macular thickness (CMT) and visual acuity of the two groups after treatment were detected to evaluate the therapeutic effect of different treatment methods on diabetic retinopathy. Results. No obvious differences in sex ratio, average age, average course of disease, average weight, average BMI, average glycosylated hemoglobin, and residence were found between the two groups
. The total clinical effective rate in the experimental group was obviously higher compared with the control group
. The CMT at T1, T2, and T3 in the experimental group was obviously lower compared with the control group
. The BCVA in the experimental group at 1 month and 3 months after treatment was obviously higher compared with the control group
. The VEGF levels of both groups after treatment were obviously lower
, and the VEGF level in the experimental group after treatment was obviously lower compared with the control group
. The total incidence of complications in the experimental group was obviously lower compared with the control group
. Conclusion. Cataract surgery is a reliable method to improve visual acuity and reduce serum inflammatory indicators in patients with diabetic retinopathy, with better clinical effect than laser photocoagulation, which is recommended for the treatment of diabetic retinopathy.
Collapse
|
9
|
Rehman A, Harouni M, Karimi M, Saba T, Bahaj SA, Awan MJ. Microscopic retinal blood vessels detection and segmentation using support vector machine and K-nearest neighbors. Microsc Res Tech 2022; 85:1899-1914. [PMID: 35037735 DOI: 10.1002/jemt.24051] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 11/14/2021] [Accepted: 12/12/2021] [Indexed: 01/08/2023]
Abstract
The retina is the deepest layer of texture covering the rear of the eye, recorded by fundus images. Vessel detection and segmentation are useful in disease diagnosis. The retina's blood vessels could help diagnose maladies such as glaucoma, diabetic retinopathy, and blood pressure. A mix of supervised and unsupervised strategies exists for the detection and segmentation of blood vessels images. The tree structure of retinal blood vessels, their random area, and different thickness have caused vessel detection difficulties at machine learning calculations. Since the green band of retinal images conveys more information about the vessels, they are utilized for microscopic vessels detection. The current research proposes an administered calculation for segmentation of retinal vessels, where two upgrading stages depending on filtering and comparative histogram were applied after pre-processing and image quality improvement. At that point, statistical features of vessel tracking, maximum curvature and curvelet coefficient are extracted for each pixel. The extracted features are classified by support vector machine and the k-nearest neighbors. The morphological operators then enhance the classified image at the final stage to segment with higher accuracy. The dice coefficient is utilized for the evaluation of the proposed method. The proposed approach is concluded to be better than different strategies with a normal of 92%.
Collapse
Affiliation(s)
- Amjad Rehman
- Artificial Intelligence & Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Majid Harouni
- Department of Computer Engineering, Dolatabad Branch, Islamic Azad University, Isfahan, Iran
| | - Mohsen Karimi
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan, University of Medical Sciences, Isfahan, Iran
| | - Tanzila Saba
- Artificial Intelligence & Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Saeed Ali Bahaj
- MIS Department College of Business Administration, Prince Sattam Bin Abdulaziz University, Alkharj, Saudi Arabia
| | - Mazar Javed Awan
- Department of Software Engineering, University of Management and Technology, Lahore, Pakistan
| |
Collapse
|
10
|
MSC-Net: Multitask Learning Network for Retinal Vessel Segmentation and Centerline Extraction. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app12010403] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Automatic segmentation and centerline extraction of blood vessels from retinal fundus images is an essential step to measure the state of retinal blood vessels and achieve the goal of auxiliary diagnosis. Combining the information of blood vessel segments and centerline can help improve the continuity of results and performance. However, previous studies have usually treated these two tasks as separate research topics. Therefore, we propose a novel multitask learning network (MSC-Net) for retinal vessel segmentation and centerline extraction. The network uses a multibranch design to combine information between two tasks. Channel and atrous spatial fusion block (CAS-FB) is designed to fuse and correct the features of different branches and different scales. The clDice loss function is also used to constrain the topological continuity of blood vessel segments and centerline. Experimental results on different fundus blood vessel datasets (DRIVE, STARE, and CHASE) show that our method can obtain better segmentation and centerline extraction results at different scales and has better topological continuity than state-of-the-art methods.
Collapse
|
11
|
Hao Y, Xie H, Qiu R. Construction and application of color fundus image segmentation algorithm based on Multi-Scale local combined global enhancement. Pak J Med Sci 2021; 37:1595-1599. [PMID: 34712289 PMCID: PMC8520383 DOI: 10.12669/pjms.37.6-wit.4848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2021] [Revised: 06/08/2021] [Accepted: 07/05/2021] [Indexed: 11/15/2022] Open
Abstract
Objective Aiming at the problem of low accuracy in extracting small blood vessels from existing retinal blood vessel images, a retinal blood vessel segmentation method based on a combination of a multi-scale linear detector and local and global enhancement is proposed. Methods The multi-scale line detector is studied, and it is divided into two parts: small scale and large scale. The small scale is used to detect the locally enhanced image and the large scale is used to detect the globally enhanced image. Fusion the response functions at different scales to get the final retinal vascular structure. Results Experiments on two databases STARE and DRIVE, show that the average vascular accuracy rates obtained by the algorithm reach 96.62% and 96.45%, and the average true positive rates reach 75.52% and 83.07%, respectively. Conclusion The segmentation accuracy is high, and better blood vessel segmentation results can be obtained.
Collapse
Affiliation(s)
- Yanjie Hao
- Yanjie Hao, Associate Chief Physician, Department of Ophthalmology, Jiaozhou Central Hospital of Qingdao, Qingdao, 266300, Shandong, China
| | - Hongbo Xie
- Hongbo Xie, Attending Physician, Department of Ophthalmology, Qingdao Women's and Children's Hospital, Qingdao, 266000, Shandong, China
| | - Rong Qiu
- Rong Qiu, Associate Chief Physician, Department of Ophthalmology, Zhucheng People's Hospital, Zhucheng, Shandong, China
| |
Collapse
|
12
|
Saba T, Akbar S, Kolivand H, Ali Bahaj S. Automatic detection of papilledema through fundus retinal images using deep learning. Microsc Res Tech 2021; 84:3066-3077. [PMID: 34236733 DOI: 10.1002/jemt.23865] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2021] [Revised: 04/22/2021] [Accepted: 05/29/2021] [Indexed: 11/09/2022]
Abstract
Papilledema is a syndrome of the retina in which retinal optic nerve is inflated by elevation of intracranial pressure. The papilledema abnormalities such as retinal nerve fiber layer (RNFL) opacification may lead to blindness. These abnormalities could be seen through capturing of retinal images by means of fundus camera. This paper presents a deep learning-based automated system that detects and grades the papilledema through U-Net and Dense-Net architectures. The proposed approach has two main stages. First, optic disc and its surrounding area in fundus retinal image are localized and cropped for input to Dense-Net which classifies the optic disc as papilledema or normal. Second, consists of preprocessing of Dense-Net classified papilledema fundus image by Gabor filter. The preprocessed papilledema image is input to U-Net to achieve the segmented vascular network from which the vessel discontinuity index (VDI) and vessel discontinuity index to disc proximity (VDIP) are calculated for grading of papilledema. The VDI and VDIP are standard parameter to check the severity and grading of papilledema. The proposed system is evaluated on 60 papilledema and 40 normal fundus images taken from STARE dataset. The experimental results for classification of papilledema through Dense-Net are much better in terms of sensitivity 98.63%, specificity 97.83%, and accuracy 99.17%. Similarly, the grading results for mild and severe papilledema classification through U-Net are also much better in terms of sensitivity 99.82%, specificity 98.65%, and accuracy 99.89%. The deep learning-based automated detection and grading of papilledema for clinical purposes is first effort in state of art.
Collapse
Affiliation(s)
- Tanzila Saba
- Artificial Intelligence & Data Analytics (AIDA) Lab CCIS, Prince Sultan University, Riyadh, 11586, Saudi Arabia
| | - Shahzad Akbar
- Department of Computing, Riphah International University, Faisalabad Campus, Faisalabad, 38000, Pakistan
| | - Hoshang Kolivand
- School of Computer Science and Mathematics, Liverpool John Moores University, Liverpool, United Kingdom.,School of Computing and Digital Technologies, Staffordshire University, Staffordshire, United Kingdom
| | - Saeed Ali Bahaj
- MIS Department, College of Business Administration, Prince Sattam bin Abdulaziz University, Al-Kharj, Saudi Arabia
| |
Collapse
|
13
|
Stepanov A, Thorstensen J, Tschudi J. Impact of illumination spectrum and eye pigmentation on image quality from a fundus camera using transscleral illumination. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-210054RR. [PMID: 34240587 PMCID: PMC8265822 DOI: 10.1117/1.jbo.26.7.076003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Accepted: 06/24/2021] [Indexed: 06/13/2023]
Abstract
SIGNIFICANCE The use of the transscleral illumination approach has the potential to simplify the optical design of fundus cameras. In particular, this approach could allow the use of smaller and cheaper cameras that are easier to use by non-specialists, thereby facilitating a wider spread of eye disease screening programs. AIM Our aim was to investigate the suitability of transscleral illumination in a fundus camera system. In particular, we explored the impact of the illumination spectrum and the eye pigmentation on the quality of the image. These factors have never been systematically investigated before in the literature on transscleral illumination. APPROACH A fundus camera was constructed using transscleral illumination. We studied the influence of eye pigmentation and choice of illumination spectra on the image quality for a group of 10 individuals with varied skin pigmentation, ranging from pale white (North-European) to darkest brown (African). The influence of the light source spectrum on the image quality was assessed using wavelength filters. RESULTS There was a difference of a factor of 100 in the signal level of retinal images between individuals with low and high skin pigmentation. The image contrast was highest using illumination wavelengths of 500 to 600 nm. The illumination level can be adjusted to obtain high-quality images for highly pigmented eyes while keeping the system eye-safe. CONCLUSIONS We have demonstrated that a fundus camera with transscleral illumination can provide high-quality images. However, the variations observed in scleral and retinal pigmentation in a practical setting require a system that must be able to adapt illumination and/or exposure to the individual patient.
Collapse
|
14
|
Werfel S, Günthner R, Hapfelmeier A, Hanssen H, Kotliar K, Heemann U, Schmaderer C. Identification of cardiovascular high risk groups from dynamic retinal vessel signals using untargeted machine learning. Cardiovasc Res 2021; 118:612-621. [PMID: 33576412 DOI: 10.1093/cvr/cvab040] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Accepted: 02/09/2021] [Indexed: 12/11/2022] Open
Abstract
AIMS Dynamic retinal vessel analysis (DVA) provides a noninvasive way to asses microvascular function in patients and potentially to improve predictions of individual cardiovascular (CV) risk. The aim of our study was to use untargeted machine learning on DVA in order to improve CV mortality prediction and to identify corresponding response alterations. METHODS AND RESULTS We adopted a workflow consisting of noise reduction and extraction of independent components within DVA signals. Predictor performance was assessed in survival random forest models. Applying our technique to the prediction of all-cause mortality in a cohort of 214 hemodialysis patients resulted in the selection of a component which was highly correlated to maximal venous dilation following flicker stimulation (vMax), a previously identified predictor, confirming the validity of our approach. When fitting for CV mortality as the outcome of interest, a combination of three components derived from the arterial signal resulted in a marked improvement in predictive performance. Clustering analysis suggested that these independent components identified groups of patients with substantially higher CV mortality. CONCLUSIONS Our results provide a machine learning workflow to improve the predictive performance of DVA and identify groups of hemodialysis patients at high risk of CV mortality. Our approach may also prove to be promising for DVA signal analysis in other CV disease states. TRANSLATIONAL PERSPECTIVE DVA is a noninvasive technique which can help to assess microvascular dysfunction, one of the driving factors of CV disease. This study demonstrates a machine learning method which improves DVA interpretation for the estimation of CV risk in hemodialysis patients. Similar techniques can help doctors to identify high risk patients for timely therapeutic interventions and to monitor the effects of these interventions.
Collapse
Affiliation(s)
- Stanislas Werfel
- Department of Nephrology, Klinikum Rechts der Isar, Technical University Munich, Ismaninger Straße 22, 81675 Munich, Germany
| | - Roman Günthner
- Department of Nephrology, Klinikum Rechts der Isar, Technical University Munich, Ismaninger Straße 22, 81675 Munich, Germany
| | - Alexander Hapfelmeier
- Institute of Medical Informatics, Statistics and Epidemiology, School of Medicine, Technical University Munich, Munich, Germany
- Institute of General Practice and Health Services Research, School of Medicine, Technical University Munich, Munich, Germany
| | - Henner Hanssen
- Division of Sports Medicine, Institute of Exercise and Health Sciences (ISSW), University of Basel, Basel, Switzerland
| | - Konstantin Kotliar
- Department of Biomedical Engineering and Technomathematics, Aachen University of Applied Sciences, Juelich, Germany
| | - Uwe Heemann
- Department of Nephrology, Klinikum Rechts der Isar, Technical University Munich, Ismaninger Straße 22, 81675 Munich, Germany
| | - Christoph Schmaderer
- Department of Nephrology, Klinikum Rechts der Isar, Technical University Munich, Ismaninger Straße 22, 81675 Munich, Germany
| |
Collapse
|
15
|
Abstract
PURPOSE OF REVIEW The retina is growingly recognized as a window into cerebrovascular and systemic vascular conditions. The utility of noninvasive retinal vessel biomarkers in cerebrovascular risk assessment has expanded due to advances in retinal imaging techniques and machine learning-based digital analysis. The purpose of this review is to underscore the latest evidence linking retinal vascular abnormalities with stroke and vascular-related cognitive disorders; to highlight modern developments in retinal vascular imaging modalities and software-based vasculopathy quantification. RECENT FINDINGS Longitudinal studies undertaken for extended periods indicate that retinal vascular changes can predict cerebrovascular disorders (CVD). Cerebrovascular ties to dementia provoked recent explorations of retinal vessel imaging tools for conceivable early cognitive decline detection. Innovative biomedical engineering technologies and advanced dynamic and functional retinal vascular imaging methods have recently been added to the armamentarium, allowing an unbiased and comprehensive analysis of the retinal vasculature. Improved artificial intelligence-based deep learning algorithms have boosted the application of retinal imaging as a clinical and research tool to screen, risk stratify, and monitor with precision CVD and vascular cognitive impairment. SUMMARY Mounting evidence supports the use of quantitative retinal vessel analysis in predicting CVD, from clinical stroke to neuroimaging markers of stroke and neurodegeneration.
Collapse
|
16
|
Wang D, Haytham A, Pottenburgh J, Saeedi O, Tao Y. Hard Attention Net for Automatic Retinal Vessel Segmentation. IEEE J Biomed Health Inform 2020; 24:3384-3396. [DOI: 10.1109/jbhi.2020.3002985] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
17
|
Invernizzi A, Torre A, Parrulli S, Zicarelli F, Schiuma M, Colombo V, Giacomelli A, Cigada M, Milazzo L, Ridolfo A, Faggion I, Cordier L, Oldani M, Marini S, Villa P, Rizzardini G, Galli M, Antinori S, Staurenghi G, Meroni L. Retinal findings in patients with COVID-19: Results from the SERPICO-19 study. EClinicalMedicine 2020; 27:100550. [PMID: 32984785 PMCID: PMC7502280 DOI: 10.1016/j.eclinm.2020.100550] [Citation(s) in RCA: 166] [Impact Index Per Article: 41.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Revised: 08/29/2020] [Accepted: 09/03/2020] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Coronavirus disease 2019 (COVID-19) has been associated to microvascular alterations. We screened the fundus of patients with COVID-19 to detect alterations of the retina and its vasculature and to assess possible correlations with clinical parameters. METHODS Cross-sectional study. The presence of retinal alterations in patients with COVID-19 and subjects unexposed to the virus was assessed using fundus photographs and their prevalence was compared. Mean arteries diameter (MAD) and mean veins diameter (MVD) were compared between patients and unexposed subjects with multiple linear regression including age, sex, ethnicity, body mass index, smoking/alcohol consumption, hypertension, hyperlipidaemia, diabetes as covariates. The influence of clinical/lab parameters on retinal findings was tested in COVID-19 patients. FINDINGS 54 patients and 133 unexposed subjects were enrolled. Retinal findings in COVID-19 included: haemorrhages (9·25%), cotton wools spots (7·4%), dilated veins (27·7%), tortuous vessels (12·9%). Both MAD and MVD were higher in COVID-19 patients compared to unexposed subjects (98·3 ± 15·3 µm vs 91·9 ± 11·7 µm, p = 0.006 and 138·5 ± 21·5 µm vs 123·2 ± 13·0 µm, p<0.0001, respectively). In multiple regression accounting for covariates MVD was positively associated with COVID-19 both in severe (coefficient 30·3, CI95% 18·1-42·4) and non-severe (coefficient 10·3, CI95% 1·6-19·0) cases compared to unexposed subjects. In COVID-19 patients MVD was negatively correlated with the time from symptoms onset (coefficient -1·0, CI 95% -1·89 to -0·20) and positively correlated with disease severity (coefficient 22·0, CI 95% 5·2-38·9). INTERPRETATION COVID-19 can affect the retina. Retinal veins diameter seems directly correlated with the disease severity. Its assessment could have possible applications in the management of COVID-19. FUNDING None.
Collapse
Affiliation(s)
- Alessandro Invernizzi
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
- The Discipline of Clinical Ophthalmology and Eye Health, Save Sight Institute, Sydney Eye Hospital, Faculty of Medicine and Health, The University of Sydney, 8 Macquarie Street, Sydney, NSW 2001, Australia
- Corresponding author at: Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy.
| | - Alessandro Torre
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Salvatore Parrulli
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
| | - Federico Zicarelli
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
| | - Marco Schiuma
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Valeria Colombo
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Andrea Giacomelli
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Mario Cigada
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
| | - Laura Milazzo
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Annalisa Ridolfo
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Ivano Faggion
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Laura Cordier
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Marta Oldani
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Sara Marini
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Paolo Villa
- Emergency Unit, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Giuliano Rizzardini
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Massimo Galli
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Spinello Antinori
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Giovanni Staurenghi
- Eye Clinic, Luigi Sacco Hospital, ASST Fatebenefratelli-Sacco, Milan, Italy
- Department of Biomedical and Clinical Sciences “L. Sacco”, Luigi Sacco Hospital, University of Milan, Milan, Italy
| | - Luca Meroni
- Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Milan, Italy
| |
Collapse
|
18
|
Sharif MI, Li JP, Naz J, Rashid I. A comprehensive review on multi-organs tumor detection based on machine learning. Pattern Recognit Lett 2020. [DOI: 10.1016/j.patrec.2019.12.006] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
19
|
Nazir T, Irtaza A, Shabbir Z, Javed A, Akram U, Mahmood MT. Diabetic retinopathy detection through novel tetragonal local octa patterns and extreme learning machines. Artif Intell Med 2019; 99:101695. [PMID: 31606114 DOI: 10.1016/j.artmed.2019.07.003] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2018] [Revised: 01/17/2019] [Accepted: 07/15/2019] [Indexed: 12/13/2022]
Abstract
Diabetic retinopathy (DR) is an eye disease that victimize the people suffering from diabetes from many years. The severe form of DR results in form of the blindness that can initially be controlled by the DR-screening oriented treatment. The effective screening programs require the trained human resource that manually grade the fundus images to understand the severity of the disease. But due to the complexity of this process, and the insufficient number of the trained workers, the precise manual grading is an expensive process. The CAD-based solutions try to address these limitations but most of the existing DR detection systems are as evaluated over small sets and become ineffective when applied in real scenarios. Therefore, in this paper we proposed a novel technique to precisely detect the various stages of the DR by extending the research of the content-based image retrieval domain. To achieve the human-level performance over the large-scale DR-datasets (i.e. Kaggle-DR), the fundus images are represented by the novel tetragonal local octa pattern (T-LOP) features, that are then classified through the extreme learning machine (ELM). To justify the significance of the method, the proposed scheme is compared against several state-of-the-art methods including the deep learning-based methods over four DR-datasets of variational lengths (i.e. Kaggle-DR, DRIVE, Review-DB, STARE). The experimental results confirm the significance of the DR-detection scheme to serve as a stand-alone solution for providing the precise information of the severity of the DR in an efficient manner.
Collapse
Affiliation(s)
- Tahira Nazir
- Department of Computer Science, University of Engineering and Technology Taxila, Pakistan
| | - Aun Irtaza
- Department of Computer Science, University of Engineering and Technology Taxila, Pakistan
| | - Zain Shabbir
- Department of Electrical, Electronics and Communication Engineering, University of Engineering and Technology, Lahore (Faisalabad Campus), Pakistan
| | - Ali Javed
- Department of Software Engineering, University of Engineering and Technology Taxila, Pakistan
| | - Usman Akram
- Department of Computer and Software Engineering, National University of Science and Technology, Islamabad, Pakistan
| | - Muhammad Tariq Mahmood
- School of Computer Science and Engineering, Korea University of Technology and Education, 1600 Chungjeolno, Byeogchunmyun, 31253 Cheonan, South Korea.
| |
Collapse
|