1
|
Liang J, Jiang W. A ResNet50-DPA model for tomato leaf disease identification. FRONTIERS IN PLANT SCIENCE 2023; 14:1258658. [PMID: 37908831 PMCID: PMC10614023 DOI: 10.3389/fpls.2023.1258658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 09/18/2023] [Indexed: 11/02/2023]
Abstract
Tomato leaf disease identification is difficult owing to the variety of diseases and complex causes, for which the method based on the convolutional neural network is effective. While it is challenging to capture key features or tends to lose a large number of features when extracting image features by applying this method, resulting in low accuracy of disease identification. Therefore, the ResNet50-DPA model is proposed to identify tomato leaf diseases in the paper. Firstly, an improved ResNet50 is included in the model, which replaces the first layer of convolution in the basic ResNet50 model with the cascaded atrous convolution, facilitating to obtaining of leaf features with different scales. Secondly, in the model, a dual-path attention (DPA) mechanism is proposed to search for key features, where the stochastic pooling is employed to eliminate the influence of non-maximum values, and two convolutions with one dimension are introduced to replace the MLP layer for effectively reducing the damage to leaf information. In addition, to quickly and accurately identify the type of leaf disease, the DPA module is incorporated into the residual module of the improved ResNet50 to obtain an enhanced tomato leaf feature map, which helps to reduce economic losses. Finally, the visualization results of Grad-CAM are presented to show that the ResNet50-DPA model proposed can identify diseases more accurately and improve the interpretability of the model, meeting the need for precise identification of tomato leaf diseases.
Collapse
Affiliation(s)
| | - Wenping Jiang
- School of Electrical and Electronic Engineering, Shanghai Institute of Technology, Shanghai, China
| |
Collapse
|
2
|
Jiang J, Cai J, Zhang Q, Lan K, Jiang X, Wu J. Group theoretic particle swarm optimization for gray-level medical image enhancement. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:10479-10494. [PMID: 37322944 DOI: 10.3934/mbe.2023462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
As a principal category in the promising field of medical image processing, medical image enhancement has a powerful influence on the intermedia features and final results of the computer aided diagnosis (CAD) system by increasing the capacity to transfer the image information in the optimal form. The enhanced region of interest (ROI) would contribute to the early diagnosis and the survival rate of patients. Meanwhile, the enhancement schema can be treated as the optimization approach of image grayscale values, and metaheuristics are adopted popularly as the mainstream technologies for medical image enhancement. In this study, we propose an innovative metaheuristic algorithm named group theoretic particle swarm optimization (GT-PSO) to tackle the optimization problem of image enhancement. Based on the mathematical foundation of symmetric group theory, GT-PSO comprises particle encoding, solution landscape, neighborhood movement and swarm topology. The corresponding search paradigm takes place simultaneously under the guidance of hierarchical operations and random components, and it could optimize the hybrid fitness function of multiple measurements of medical images and improve the contrast of intensity distribution. The numerical results generated from the comparative experiments show that the proposed GT-PSO has outperformed most other methods on the real-world dataset. The implication also indicates that it would balance both global and local intensity transformations during the enhancement process.
Collapse
Affiliation(s)
- Jinyun Jiang
- College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
| | - Jianchen Cai
- College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
| | - Qile Zhang
- Department of Rehabilitation, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou People's Hospital, Quzhou 324000, China
| | - Kun Lan
- College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
| | - Xiaoliang Jiang
- College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
| | - Jun Wu
- College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
| |
Collapse
|
3
|
Guo J, Ma J, García-Fernández ÁF, Zhang Y, Liang H. A survey on image enhancement for Low-light images. Heliyon 2023; 9:e14558. [PMID: 37025779 PMCID: PMC10070385 DOI: 10.1016/j.heliyon.2023.e14558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 01/22/2023] [Accepted: 03/09/2023] [Indexed: 03/17/2023] Open
Abstract
In real scenes, due to the problems of low light and unsuitable views, the images often exhibit a variety of degradations, such as low contrast, color distortion, and noise. These degradations affect not only visual effects but also computer vision tasks. This paper focuses on the combination of traditional algorithms and machine learning algorithms in the field of image enhancement. The traditional methods, including their principles and improvements, are introduced from three categories: gray level transformation, histogram equalization, and Retinex methods. Machine learning based algorithms are not only divided into end-to-end learning and unpaired learning, but also concluded to decomposition-based learning and fusion based learning based on the applied image processing strategies. Finally, the involved methods are comprehensively compared by multiple image quality assessment methods, including mean square error, natural image quality evaluator, structural similarity, peak signal to noise ratio, etc.
Collapse
Affiliation(s)
- Jiawei Guo
- Department of Computer Science, University of Liverpool, Liverpool, UK
- School of Advanced Technology, Xi'an Jiaotong-Liverpool University (XJTLU), Suzhou, China
| | - Jieming Ma
- School of Advanced Technology, Xi'an Jiaotong-Liverpool University (XJTLU), Suzhou, China
- Corresponding author.
| | - Ángel F. García-Fernández
- Department of Electrical Engineering and Electronics, University of Liverpool, Liverpool, UK
- ARIES research center, Universidad Antonio de Nebrija, Madrid, Spain
| | - Yungang Zhang
- School of Information Science Yunnan Normal University, Kunming, China
| | - Haining Liang
- School of Advanced Technology, Xi'an Jiaotong-Liverpool University (XJTLU), Suzhou, China
| |
Collapse
|
4
|
Dyke RM, Hormann K. Histogram equalization using a selective filter. THE VISUAL COMPUTER 2022; 39:6221-6235. [PMID: 37969935 PMCID: PMC10635952 DOI: 10.1007/s00371-022-02723-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 10/30/2022] [Indexed: 11/17/2023]
Abstract
Many popular modern image processing software packages implement a naïve form of histogram equalization. This implementation is known to produce histograms that are not truly uniform. While exact histogram equalization techniques exist, these may produce undesirable artifacts in some scenarios. In this paper we consider the link between the established continuous theory for global histogram equalization and its discrete implementation, and we formulate a novel histogram equalization technique that builds upon and considerably improves the naïve approach. We show that we can linearly interpolate the cumulative distribution of a low-bit image by approximately dequantizing its intensities using a selective box filter. This helps to distribute the intensities more evenly. The proposed algorithm is subsequently evaluated and compared with existing works in the literature. We find that the method is capable of producing an equalized histogram that has a high entropy, while distances between similar intensities are preserved. The described approach has implications on several related image processing problems, e.g., edge detection.
Collapse
Affiliation(s)
- Roberto M. Dyke
- Faculty of Informatics, Università della Svizzera italiana, Via Buffi 13, 6900 Lugano, Switzerland
| | - Kai Hormann
- Faculty of Informatics, Università della Svizzera italiana, Via Buffi 13, 6900 Lugano, Switzerland
| |
Collapse
|
5
|
Kumar R, Bhandari AK. Spatial mutual information based detail preserving magnetic resonance image enhancement. Comput Biol Med 2022; 146:105644. [DOI: 10.1016/j.compbiomed.2022.105644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Revised: 05/08/2022] [Accepted: 05/14/2022] [Indexed: 11/28/2022]
|
6
|
Zhou J, Wang Y, Zhang W, Li C. Underwater image restoration via feature priors to estimate background light and optimized transmission map. OPTICS EXPRESS 2021; 29:28228-28245. [PMID: 34614959 DOI: 10.1364/oe.432900] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 08/04/2021] [Indexed: 06/13/2023]
Abstract
Underwater images frequently suffer from color casts and poor contrast, due to the absorption and scattering of light in water medium. To address these two degradation issues, we propose an underwater image restoration method based on feature priors inspired by underwater scene prior. Concretely, we first develop a robust model to estimate the background light according to feature priors of flatness, hue, and brightness, which can effectively relieve color distortion. Next, we compensate the red channel of color corrected image to revise the transmission map of it. Coupled with the structure-guided filter, the coarse transmission map is refined. The refined transmission map preserves the edge information while improving the contrast. Extensive experiments on diverse degradation scenes demonstrate that our method achieves superior performance against several state-of-the-art methods.
Collapse
|
7
|
Reddy E. An Efficient and Novel Image Enhancement Technique to Control the Saturation of Intensities Without Any Plateau Limit. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES INDIA SECTION A-PHYSICAL SCIENCES 2021. [DOI: 10.1007/s40010-021-00744-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
8
|
Kumar S, Bhandari AK, Raj A, Swaraj K. Triple Clipped Histogram-Based Medical Image Enhancement Using Spatial Frequency. IEEE Trans Nanobioscience 2021; 20:278-286. [PMID: 33661735 DOI: 10.1109/tnb.2021.3064077] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this paper, a novel triple clipped histogram model-based fusion approach has been proposed to improve the basics features, brightness preservation and contrast of the medical images. This incorporates the features of the equalized image and input image together. In the initial step, the low-contrast medical image is equalized using the triple clipped dynamic histogram equalization technique for which the histogram of the input medical image is split into three sections on the basis of standard deviation with almost equal number of pixels. The clipping process of the histogram is performed on every histogram section and mapped to a new dynamic range using simple calculations. In the second step, the sub-histogram equalization process is performed separately. Approximation and detail coefficients of equalized and input images are separated using discrete wavelet transform (DWT). Thereafter, the approximation coefficients are modified using some basic calculation-based fusion which involves singular value decomposition (SVD) and its inverse. Detail coefficients are fused using spatial frequency features. This yields modified approximation and detail coefficients for an enhanced image. Finally, inverse discrete wavelet transform (IDWT) has been applied to the modified coefficients which result in an enhanced image with improved visual quality. These improvements are analyzed qualitatively and quantitatively.
Collapse
|
9
|
Study on Local to Global Radiometric Balance for Remotely Sensed Imagery. REMOTE SENSING 2021. [DOI: 10.3390/rs13112068] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Due to the difference of factors, such as lighting conditions, shooting environments, and time, there is compound brightness difference between adjacent images, which includes local brightness difference and radiometric difference. This paper proposed a method to eliminate the compound brightness difference of adjacent images after mosaicking, named local to global radiometric balance. It includes the brightness compensation model and brightness approach model. Firstly, the weighted average value of each row and column of image are calculated to express the brightness change; secondly, according to weighted average value, the brightness compensation model is built; thirdly, combined with the blocking method, the brightness compensation model is applied to image. Based on the value after above process, the brightness approach model is established to make the gray value of adjacent images approach to the mosaic line. In the paper, the standard deviation, MSE (mean square error) and mean value are used as the measure indices of the effect of brightness balance. The three groups of experimental results show that compared with the brightness stretch method, the histogram equalization method and the radiometric balance method, the local to global radiometric balance method not only realizes compound brightness balance, but also has better visual effects than others.
Collapse
|
10
|
V.R. S, Edla DR, Joseph J, Kuppili V. Parameter-free fuzzy histogram equalisation with illumination preserving characteristics dedicated for contrast enhancement of magnetic resonance images. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2020.106364] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
11
|
Liu F, Li G, Yang S, Yan W, He G, Lin L. Recognition of Heterogeneous Edges in Multiwavelength Transmission Images Based on the Weighted Constraint Decision Method. APPLIED SPECTROSCOPY 2020; 74:883-893. [PMID: 32073301 DOI: 10.1177/0003702820908951] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Multiwavelength light transmission imaging provides a possibility for early detection of breast cancer. However, due to strong scattering during the transmission process of breast tissue analysis, the transmitted image signal is weak and the image is blurred and this makes heterogeneous edge detection difficult. This paper proposes a method based on the weighted constraint decision (WCD) method to eliminate the erosion and checkerboard effects in image histogram equalization (HE) enhancement and to improve the recognition of heterogeneous edge. Multiwavelength transmission images of phantom are acquired on the designed experimental system and the mask image with high signal-to-noise ratio (SNR) is obtained by frame accumulation and an Otsu thresholding model. Then, during image enhancement the image is divided into low-gray-level (LGL) and high-gray-level (HGL) regions according to the distribution of light intensity in image. And the probability density distribution of gray level in the LGL and HGL regions are redefined respectively according to the WCD method. Finally, the reconstructed image is obtained based on the modified HE. The experimental results show that compared with traditional image enhancement methods, the WCD method proposed in this paper can greatly improve the contrast between heterogeneous region and normal region. Moreover, the correlation between the original image data is maintained to the greatest extent, so that the edge of the heterogeneity can be detected more accurately. In conclusion, the WCD method not only accurately identifies the edge of heterogeneity in multiwavelength transmission images, but it also could improve the clinical application of multiwavelength transmission images in the early detection of breast cancer.
Collapse
Affiliation(s)
- Fulong Liu
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Gang Li
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Shuqiang Yang
- School of physics and electronic information, Luoyang Normal University, Luoyang, China
| | - Wenjuan Yan
- School of Electronic Information Engineering, Yangtze Normal University, Chongqing, China
| | - Guoquan He
- School of Electronic Information Engineering, Yangtze Normal University, Chongqing, China
| | - Ling Lin
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| |
Collapse
|
12
|
Improved PSO Algorithm Based on Exponential Center Symmetric Inertia Weight Function and Its Application in Infrared Image Enhancement. Symmetry (Basel) 2020. [DOI: 10.3390/sym12020248] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
In this paper, an improved PSO (Particle Swarm Optimization) algorithm is proposed and applied to the infrared image enhancement. The contrast of infrared image is enhanced while the image details are preserved. A new exponential center symmetry inertia weight function is constructed and the local optimal solution jumping mechanism is introduced to make the algorithm consider both global search and local search. A new image enhancement method is proposed based on the advantages of bi-histogram equalization algorithm and dual-domain image decomposition algorithm. The fitness function is constructed by using five kinds of image quality evaluation factors, and the parameters are optimized by the proposed PSO algorithm, so that the parameters are determined to enhance the image. Experiments showed that the proposed PSO algorithm has good performance, and the proposed image enhancement method can not only improve the contrast of the image, but also preserve the details of the image, which has a good visual effect.
Collapse
|
13
|
A novel reformed histogram equalization based medical image contrast enhancement using krill herd optimization. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101677] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
14
|
kansal S, Tripathi RK. Adaptive Geometric Filtering Based on Average Brightness of the Image and Discrete Cosine Transform Coefficient Adjustment for Gray and Color Image Enhancement. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2019. [DOI: 10.1007/s13369-019-04151-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
15
|
Abstract
An effective method to enhance the contrast of digital images is proposed in this paper. A histogram function is developed to make the histogram curve smoother, which can be used to avoid the loss of information in the processed image. Besides the histogram function, an adaptive gamma correction for the histogram is proposed to stretch the brightness contrast. Moreover, the log-exp transformation strategy is presented to progressively increase the low intensity while suppressing the decrement of the high intensity. In order to further widen the dynamic range of the image, the nonlinear normalization transformation is put forward to make the output image more natural and clearer. In the experiment on non-uniform illumination images, the average contrast per pixel (CPP), root mean square (RMS), and discrete entropy (DE) metrics of the developed approach are shown to be superior to selected state-of-the-art methods.
Collapse
|
16
|
Zhuang L, Guan Y. Improvement of Face Recognition with Gabor, PCA, and SVM Under Complex Illumination Conditions. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS 2019. [DOI: 10.20965/jaciii.2019.p0465] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Complex illumination condition is one of the most critical challenging problems for practical face recognition. However, numerous studies have had no effective solutions reported for full illumination variation of face images in the facial recognition research field. In order to effectively solve full illumination variation problem, we propose a novel approach for illumination normalization for facial images based on the enhanced contrast method of histogram equalization (HE) and fusion of illumination estimations (FOIE). Then, feature extraction is applied with consideration of both Gabor wavelet and principal component analysis methods to process illumination normalization. Next, a support vector machine classifier (SVM) is used for face classification. Experimental results show that superior performance can be obtained in the developed approach by comparisons with some state-of-the-arts.
Collapse
|
17
|
Adaptive Image Enhancement Using Entropy-Based Subhistogram Equalization. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2018; 2018:3837275. [PMID: 30186315 PMCID: PMC6110038 DOI: 10.1155/2018/3837275] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 07/19/2018] [Indexed: 11/18/2022]
Abstract
A novel image enhancement approach called entropy-based adaptive subhistogram equalization (EASHE) is put forward in this paper. The proposed algorithm divides the histogram of input image into four segments based on the entropy value of the histogram, and the dynamic range of each subhistogram is adjusted. A novel algorithm to adjust the probability density function of the gray level is proposed, which can adaptively control the degree of image enhancement. Furthermore, the final contrast-enhanced image is obtained by equalizing each subhistogram independently. The proposed algorithm is compared with some state-of-the-art HE-based algorithms. The quantitative results for a public image database named CVG-UGR-Database are statistically analyzed. The quantitative and visual assessments show that the proposed algorithm outperforms most of the existing contrast-enhancement algorithms. The proposed method can make the contrast of image more effectively enhanced as well as the mean brightness and details well preserved.
Collapse
|
18
|
Garcia-Lamont F, Cervantes J, López A, Rodriguez L. Segmentation of images by color features: A survey. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.01.091] [Citation(s) in RCA: 49] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
19
|
Image Enhancement via Subimage Histogram Equalization Based on Mean and Variance. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2017; 2017:6029892. [PMID: 29403529 PMCID: PMC5748324 DOI: 10.1155/2017/6029892] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2017] [Accepted: 11/08/2017] [Indexed: 11/22/2022]
Abstract
This paper puts forward a novel image enhancement method via Mean and Variance based Subimage Histogram Equalization (MVSIHE), which effectively increases the contrast of the input image with brightness and details well preserved compared with some other methods based on histogram equalization (HE). Firstly, the histogram of input image is divided into four segments based on the mean and variance of luminance component, and the histogram bins of each segment are modified and equalized, respectively. Secondly, the result is obtained via the concatenation of the processed subhistograms. Lastly, the normalization method is deployed on intensity levels, and the integration of the processed image with the input image is performed. 100 benchmark images from a public image database named CVG-UGR-Database are used for comparison with other state-of-the-art methods. The experiment results show that the algorithm can not only enhance image information effectively but also well preserve brightness and details of the original image.
Collapse
|