1
|
Mahapatra S, Agrawal S, Mishro PK, Panda R, Dora L, Pachori RB. A Review on Retinal Blood Vessel Enhancement and Segmentation Techniques for Color Fundus Photography. Crit Rev Biomed Eng 2024; 52:41-69. [PMID: 37938183 DOI: 10.1615/critrevbiomedeng.2023049348] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2023]
Abstract
The retinal image is a trusted modality in biomedical image-based diagnosis of many ophthalmologic and cardiovascular diseases. Periodic examination of the retina can help in spotting these abnormalities in the early stage. However, to deal with today's large population, computerized retinal image analysis is preferred over manual inspection. The precise extraction of the retinal vessel is the first and decisive step for clinical applications. Every year, many more articles are added to the literature that describe new algorithms for the problem at hand. The majority of the review article is restricted to a fairly small number of approaches, assessment indices, and databases. In this context, a comprehensive review of different vessel extraction methods is inevitable. It includes the development of a first-hand classification of these methods. A bibliometric analysis of these articles is also presented. The benefits and drawbacks of the most commonly used techniques are summarized. The primary challenges, as well as the scope of possible changes, are discussed. In order to make a fair comparison, numerous assessment indices are considered. The findings of this survey could provide a new path for researchers for further work in this domain.
Collapse
Affiliation(s)
- Sakambhari Mahapatra
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Sanjay Agrawal
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Pranaba K Mishro
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Rutuparna Panda
- Department of Electronics and Telecommunication Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Lingraj Dora
- Department of Electrical and Electronics Engineering, Veer Surendra Sai University of Technology, Burla, India
| | - Ram Bilas Pachori
- Department of Electrical Engineering, Indian Institute of Technology Indore, Indore, India
| |
Collapse
|
2
|
Rong Y, Xiong Y, Li C, Chen Y, Wei P, Wei C, Fan Z. Segmentation of retinal vessels in fundus images based on U-Net with self-calibrated convolutions and spatial attention modules. Med Biol Eng Comput 2023:10.1007/s11517-023-02806-1. [PMID: 36899285 DOI: 10.1007/s11517-023-02806-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Accepted: 02/08/2023] [Indexed: 03/12/2023]
Abstract
Automated and accurate segmentation of retinal vessels in fundus images is an important step for screening and diagnosing various ophthalmologic diseases. However, many factors, including the variations of vessels in color, shape and size, make this task become an intricate challenge. One kind of the most popular methods for vessel segmentation is U-Net based methods. However, in the U-Net based methods, the size of the convolution kernels is generally fixed. As a result, the receptive field for an individual convolution operation is single, which is not conducive to the segmentation of retinal vessels with various thicknesses. To overcome this problem, in this paper, we employed self-calibrated convolutions to replace the traditional convolutions for the U-Net, which can make the U-Net learn discriminative representations from different receptive fields. Besides, we proposed an improved spatial attention module, instead of using traditional convolutions, to connect the encoding part and decoding part of the U-Net, which can improve the ability of the U-Net to detect thin vessels. The proposed method has been tested on Digital Retinal Images for Vessel Extraction (DRIVE) database and Child Heart and Health Study in England Database (CHASE DB1). The metrics used to evaluate the performance of the proposed method are accuracy (ACC), sensitivity (SE), specificity (SP), F1-score (F1) and the area under the receiver operating characteristic curve (AUC). The ACC, SE, SP, F1 and AUC obtained by the proposed method are 0.9680, 0.8036, 0.9840, 0.8138 and 0.9840 respectively on DRIVE database, and 0.9756, 0.8118, 0.9867, 0.8068 and 0.9888 respectively on CHASE DB1, which are better than those obtained by the traditional U-Net (the ACC, SE, SP, F1 and AUC obtained by U-Net are 0.9646, 0.7895, 0.9814, 0.7963 and 0.9791 respectively on DRIVE database, and 0.9733, 0.7817, 0.9862, 0.7870 and 0.9810 respectively on CHASE DB1). The experimental results indicate that the proposed modifications in the U-Net are effective for vessel segmentation. The structure of the proposed network.
Collapse
Affiliation(s)
- YiBiao Rong
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
| | - Yu Xiong
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
| | - Chong Li
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
| | - Ying Chen
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
| | - Peiwei Wei
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
- Department of Microbiology and Immunology, Shantou University Medical College, Guangdong, 515041, China
| | - Chuliang Wei
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China
| | - Zhun Fan
- Department of Electronic and Information Engineering, Shantou University, 515063, Guangdong, China.
- Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou University, 515063, Guangdong, China.
| |
Collapse
|
3
|
Computational intelligence in eye disease diagnosis: a comparative study. Med Biol Eng Comput 2023; 61:593-615. [PMID: 36595155 DOI: 10.1007/s11517-022-02737-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Accepted: 12/09/2022] [Indexed: 01/04/2023]
Abstract
In recent years, eye disorders are an important health issue among older people. Generally, individuals with eye diseases are unaware of the gradual growth of symptoms. Therefore, routine eye examinations are required for early diagnosis. Usually, eye disorders are identified by an ophthalmologist via a slit-lamp investigation. Slit-lamp interpretations are inadequate due to the differences in the analytical skills of the ophthalmologist, inconsistency in eye disorder analysis, and record maintenance issues. Therefore, digital images of an eye and computational intelligence (CI)-based approaches are preferred as assistive methods for eye disease diagnosis. A comparative study of CI-based decision support models for eye disorder diagnosis is presented in this paper. The CI-based decision support systems used for eye abnormalities diagnosis were grouped as anterior and retinal eye abnormalities diagnostic systems, and numerous algorithms used for diagnosing the eye abnormalities were also briefed. Various eye imaging modalities, pre-processing methods such as reflection removal, contrast enhancement, region of interest segmentation methods, and public eye image databases used for CI-based eye disease diagnosis system development were also discussed in this paper. In this comparative study, the reliability of various CI-based systems used for anterior eye and retinal disorder diagnosis was compared based on the precision, sensitivity, and specificity in eye disease diagnosis. The outcomes of the comparative analysis indicate that the CI-based anterior and retinal disease diagnosis systems attained significant prediction accuracy. Hence, these CI-based diagnosis systems can be used in clinics to reduce the burden on physicians, minimize fatigue-related misdetection, and take precise clinical decisions.
Collapse
|
4
|
Zhou H, Shu D, Wu C, Wang Q, Wang Q. Image Illumination Adaptive Correction Algorithm Based on a Combined Model of Bottom-Hat and Improved Gamma Transformation. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2022. [DOI: 10.1007/s13369-022-07368-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
5
|
|
6
|
Multi-layer segmentation framework for cell nuclei using improved GVF Snake model, Watershed, and ellipse fitting. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102516] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
7
|
Ramos-Soto O, Rodríguez-Esparza E, Balderas-Mata SE, Oliva D, Hassanien AE, Meleppat RK, Zawadzki RJ. An efficient retinal blood vessel segmentation in eye fundus images by using optimized top-hat and homomorphic filtering. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 201:105949. [PMID: 33567382 DOI: 10.1016/j.cmpb.2021.105949] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Accepted: 01/18/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE Automatic segmentation of retinal blood vessels makes a major contribution in CADx of various ophthalmic and cardiovascular diseases. A procedure to segment thin and thick retinal vessels is essential for medical analysis and diagnosis of related diseases. In this article, a novel methodology for robust vessel segmentation is proposed, handling the existing challenges presented in the literature. METHODS The proposed methodology consists of three stages, pre-processing, main processing, and post-processing. The first stage consists of applying filters for image smoothing. The main processing stage is divided into two configurations, the first to segment thick vessels through the new optimized top-hat, homomorphic filtering, and median filter. Then, the second configuration is used to segment thin vessels using the proposed optimized top-hat, homomorphic filtering, matched filter, and segmentation using the MCET-HHO multilevel algorithm. Finally, morphological image operations are carried out in the post-processing stage. RESULTS The proposed approach was assessed by using two publicly available databases (DRIVE and STARE) through three performance metrics: specificity, sensitivity, and accuracy. Analyzing the obtained results, an average of 0.9860, 0.7578 and 0.9667 were respectively achieved for DRIVE dataset and 0.9836, 0.7474 and 0.9580 for STARE dataset. CONCLUSIONS The numerical results obtained by the proposed technique, achieve competitive average values with the up-to-date techniques. The proposed approach outperform all leading unsupervised methods discussed in terms of specificity and accuracy. In addition, it outperforms most of the state-of-the-art supervised methods without the computational cost associated with these algorithms. Detailed visual analysis has shown that a more precise segmentation of thin vessels was possible with the proposed approach when compared with other procedures.
Collapse
Affiliation(s)
- Oscar Ramos-Soto
- División de Electrónica y Computación, Universidad de Guadalajara, CUCEI, Av. Revolución 1500, C.P. 44430, Guadalajara, Jal., Mexico.
| | - Erick Rodríguez-Esparza
- División de Electrónica y Computación, Universidad de Guadalajara, CUCEI, Av. Revolución 1500, C.P. 44430, Guadalajara, Jal., Mexico; DeustoTech, Faculty of Engineering, University of Deusto, Av. Universidades, 24, 48007 Bilbao, Spain.
| | - Sandra E Balderas-Mata
- División de Electrónica y Computación, Universidad de Guadalajara, CUCEI, Av. Revolución 1500, C.P. 44430, Guadalajara, Jal., Mexico.
| | - Diego Oliva
- División de Electrónica y Computación, Universidad de Guadalajara, CUCEI, Av. Revolución 1500, C.P. 44430, Guadalajara, Jal., Mexico; IN3 - Computer Science Dept., Universitat Oberta de Catalunya, Castelldefels, Spain.
| | | | - Ratheesh K Meleppat
- UC Davis Eyepod Imaging Laboratory, Dept. of Cell Biology and Human Anatomy, University of California Davis, Davis, CA 95616, USA; Dept. of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA, USA.
| | - Robert J Zawadzki
- UC Davis Eyepod Imaging Laboratory, Dept. of Cell Biology and Human Anatomy, University of California Davis, Davis, CA 95616, USA; Dept. of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA, USA.
| |
Collapse
|
8
|
Pore-Structural Characteristics of Tight Fractured-Vuggy Carbonates and Its Effects on the P- and S-Wave Velocity: A Micro-CT Study on Full-Diameter Cores. ENERGIES 2020. [DOI: 10.3390/en13226148] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Pore structure has been widely observed to affect the seismic wave velocity of rocks. Although taking lab measurements on 1.0-inch core plugs is popular, it is not representative of the fractured-vuggy carbonates because many fractures and vugs are on a scale up to several hundred microns (and greater) and are spatially heterogeneous. To overcome this shortage, we carried out the lab measurements on full-diameter cores (about 6.5–7.5 cm in diameter). The micro-CT (micro computed tomography) scanning technique is used to characterize the pore space of the carbonates and image processing methods are applied to filter the noise and enhance the responses of the fractures so that the constructed pore spaces are reliable. The wave velocities of P- and S-waves are determined then and the effects of the pore structure on the velocity are analyzed. The results show that the proposed image processing method is effective in constructing and quantitatively characterizing the pore space of the full-diameter fractured-vuggy carbonates. The porosity of all the collected tight carbonate samples is less than 4%. Fractures and vugs are well-developed and the spatial distributions of them are heterogeneous causing, even the samples having similar porosity, the pore structure characteristics of the samples being significantly different. The pores and vugs mainly contribute to the porosity of the samples and the fractures contribute to the change in the wave velocities more than pores and vugs.
Collapse
|
9
|
Zhou C, Zhang X, Chen H. A new robust method for blood vessel segmentation in retinal fundus images based on weighted line detector and hidden Markov model. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 187:105231. [PMID: 31786454 DOI: 10.1016/j.cmpb.2019.105231] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2019] [Revised: 11/08/2019] [Accepted: 11/17/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Automatic vessel segmentation is a crucial preliminary processing step to facilitate ophthalmologist diagnosis in some diseases. But, due to the complexity of retinal fundus image, there are some problems on accurate segmentation of retinal vessel. In this paper, a new method for retinal vessel segmentation is proposed to handle two main problems: thin vessel missing and false detection in difficult regions. METHODS First, an improved line detector is proposed and used to fast extract the major structures of vessels. Then, Hidden Markov model (HMM) is applied to effectively detect vessel centerlines that include thin vessels. Finally, a denoising approach is presented to remove noises and two types of vessels are unified to obtain the complete segmentation results. RESULTS Our method is tested on two public databases (DRIVE and STARE databases), and five measures namely accuracy (Acc), sensitivity (Se), specificity (Sp), Dice coefficient (Dc), structural similarity index (SSIM) and feature similarity index (FSIM) are used to evaluate our segmentation performance. The respective values of the performance measures are 0.9475, 0.7262, 0.9803, 0.7781, 0.9992 and 0.9793 for DRIVE dataset and 0.9535, 0.7865, 0.9730, 0.7764, 0.9987 and 0.9742 for STARE dataset. CONCLUSIONS The experiment results show that our method outperforms most published state-of-the-art methods and is better the result of a human observer. Moreover, in term of specificity, our proposed algorithm can obtain the best score among the unsupervised methods. Meanwhile, there are excellent structure and feature similarities between our result and the ground truth according to achieved SSIM and FSIM. Visual inspection on the segmentation results shows that the proposed method produces more accurate segmentations on some difficult regions such as optic disc and central light reflex while detecting thin vessels effectively compared with the other methods.
Collapse
Affiliation(s)
- Chao Zhou
- College of Computer Science and Electronic Engineering, Hunan University, Changsha, 410082 China.
| | - Xiaogang Zhang
- College of Electrical and Information Engineering, Hunan University, Changsha, 410082 China.
| | - Hua Chen
- College of Computer Science and Electronic Engineering, Hunan University, Changsha, 410082 China.
| |
Collapse
|
10
|
A New Method for Detecting Architectural Distortion in Mammograms by NonSubsampled Contourlet Transform and Improved PCNN. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9224916] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Breast cancer is the leading cause of cancer death in women, and early detection can reduce mortality. Architectural distortion (AD) is a feature of clinical manifestations for breast cancer, however, due to its complex structure and low detection accuracy, which cause a high mortality of breast cancer. In order to improve the accuracy of AD detection and reduce the mortality of breast cancer, this paper proposes a new method by combining the non-subsampled contourlet transform (NSCT) with the improved pulse coupled neural network (PCNN). Firstly, the top–bottom hat transformation and the exponential transformation are employed to enhance the image. Secondly, the NSCT is employed to expand the overall contrast of the mammograms and filter out the noise. Finally, the improved PCNN by the maximum inter-class variance threshold selection method is employed to complete the AD detection. This proposed approach is tested on the public and authoritative database—Digital Database for Screening Mammography (DDSM). The specificity of the method is 98.73%, the accuracy is 93.16%, and the F1-score is 79.80%, and the area under curve (AUC) of the receiver operating characteristic (ROC) curve is 0.93, these results clearly demonstrate that the proposed method is comparable with those methods in recent literatures. This proposed method is simple, furthermore it can achieve high accuracy and help doctors to perform computer-aided detection of AD effectively.
Collapse
|