1
|
Zhang Y, Zhou P, Chen L. Dual-branch feature encoding framework for infrared images super-resolution reconstruction. Sci Rep 2024; 14:9379. [PMID: 38654133 DOI: 10.1038/s41598-024-60238-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Accepted: 04/19/2024] [Indexed: 04/25/2024] Open
Abstract
Infrared thermal imaging is a passive non-contact detection and identification technology, which is not subject to electromagnetic infection and good concealment, is widely used in military and commercial fields. However, due to the limitations of the existing infrared imaging system mechanisms, the spatial resolution of the acquired infrared images is low and the edge details are blurred, which in turn leads to poor performance in downstream missions based on infrared images. In this paper, in order to better solve the above problems, we propose a new super-resolution reconstruction framework for infrared images, called DBFE, which extracts and retains abundant structure and textual information for robust infrared image high-resolution reconstruction with a novel structure-textual encoder module. Extensive experiment demonstrates that our proposed method achieves significantly superior contraband high-resolution reconstruction results on the multiple dataset compared to progressive methods for high resolution infrared image reconstruction, effectively proving the practicability of the method proposed in this paper.
Collapse
Affiliation(s)
- Yuke Zhang
- Tropical Agriculture and Forestry School, Hainan University, Haikou, 570228, China.
| | - Peizi Zhou
- Tropical Agriculture and Forestry School, Hainan University, Haikou, 570228, China
| | - Lizhu Chen
- Tropical Agriculture and Forestry School, Hainan University, Haikou, 570228, China
| |
Collapse
|
2
|
Yan F, Wu S, Zhang Q, Liu Y, Sun H. Destriping of Remote Sensing Images by an Optimized Variational Model. SENSORS (BASEL, SWITZERLAND) 2023; 23:7529. [PMID: 37687987 PMCID: PMC10490704 DOI: 10.3390/s23177529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/26/2023] [Accepted: 08/28/2023] [Indexed: 09/10/2023]
Abstract
Satellite sensors often capture remote sensing images that contain various types of stripe noise. The presence of these stripes significantly reduces the quality of the remote images and severely affects their subsequent applications in other fields. Despite the existence of many stripe noise removal methods in the research, they often result in the loss of fine details during the destriping process, and some methods even generate artifacts. In this paper, we proposed a new unidirectional variational model to remove horizontal stripe noise. The proposed model fully considered the directional characteristics and structural sparsity of the stripe noise, as well as the prior features of the underlying image, to design different sparse constraints, and the ℓp quasinorm was introduced in these constraints to better describe these sparse characteristics, thus achieving a more excellent destriping effect. Moreover, we employed the fast alternating direction method of multipliers (ADMM) to solve the proposed non-convex model. This significantly improved the efficiency and robustness of the proposed method. The qualitative and quantitative results from simulated and real data experiments confirm that our method outperforms existing destriping approaches in terms of stripe noise removal and preservation of image details.
Collapse
Affiliation(s)
- Fei Yan
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China; (F.Y.); (S.W.); (Y.L.); (H.S.)
- Jilin Provincial Science and Technology Innovation Center of Intelligent Perception and Information Processing, Changchun 130022, China
| | - Siyuan Wu
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China; (F.Y.); (S.W.); (Y.L.); (H.S.)
| | - Qiong Zhang
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China; (F.Y.); (S.W.); (Y.L.); (H.S.)
| | - Yunqing Liu
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China; (F.Y.); (S.W.); (Y.L.); (H.S.)
- Jilin Provincial Science and Technology Innovation Center of Intelligent Perception and Information Processing, Changchun 130022, China
| | - Haonan Sun
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China; (F.Y.); (S.W.); (Y.L.); (H.S.)
| |
Collapse
|
3
|
Lin YH, Lu YC. Low-Light Enhancement Using a Plug-and-Play Retinex Model With Shrinkage Mapping for Illumination Estimation. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2022; 31:4897-4908. [PMID: 35839183 DOI: 10.1109/tip.2022.3189805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Low-light photography conditions degrade image quality. This study proposes a novel Retinex-based low-light enhancement method to correctly decompose an input image into reflectance and illumination. Subsequently, we can improve the viewing experience by adjusting the illumination using intensity and contrast enhancement. Because image decomposition is a highly ill-posed problem, constraints must be properly imposed on the optimization framework. To meet the criteria of ideal Retinex decomposition, we design a nonconvex Lp norm and apply shrinkage mapping to the illumination layer. In addition, edge-preserving filters are introduced using the plug-and-play technique to improve illumination. Pixel-wise weights based on variance and image gradients are adopted to suppress noise and preserve details in the reflectance layer. We choose the alternating direction method of multipliers (ADMM) to solve the problem efficiently. Experimental results on several challenging low-light datasets show that our proposed method can more effectively enhance image brightness as compared with state-of-the-art methods. In addition to subjective observations, the proposed method also achieved competitive performance in objective image quality assessments.
Collapse
|
4
|
Zhang T, Peng Z, Wu H, He Y, Li C, Yang C. Infrared small target detection via self-regularized weighted sparse model. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.08.065] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
5
|
Cirrus Detection Based on RPCA and Fractal Dictionary Learning in Infrared imagery. REMOTE SENSING 2020. [DOI: 10.3390/rs12010142] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In earth observation systems, especially in the detection of small and weak targets, the detection and recognition of long-distance infrared targets plays a vital role in the military and civil fields. However, there are a large number of high radiation areas on the earth’s surface, in which cirrus clouds, as high radiation areas or abnormal objects, will interfere with the military early warning system. In order to improve the performance of the system and the accuracy of small target detection, the method proposed in this paper uses the suppression of the cirrus cloud as an auxiliary means of small target detection. An infrared image was modeled and decomposed into thin parts such as the cirrus cloud, noise and clutter, and low-order background parts. In order to describe the cirrus cloud more accurately, robust principal component analysis (RPCA) was used to get the sparse components of the cirrus cloud, and only the sparse components of infrared image were studied. The texture of the cirrus cloud was found to have fractal characteristics, and a random fractal based infrared image signal component dictionary was constructed. The k-cluster singular value decomposition (KSVD) dictionary was used to train the sparse representation of sparse components to detect cirrus clouds. Through the simulation test, it was found that the algorithm proposed in this paper performed better on the the receiver operating characteristic (ROC) curve and Precision-Recall (PR) curve, had higher accuracy rate under the same recall rate, and its F-measure value and Intersection-over-Union (IOU) value were greater than other algorithms, which shows that it has better detection effect.
Collapse
|
6
|
Structure-Adaptive Clutter Suppression for Infrared Small Target Detection: Chain-Growth Filtering. REMOTE SENSING 2019. [DOI: 10.3390/rs12010047] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Robust detection of infrared small target is an important and challenging task in many photoelectric detection systems. Using the difference of a specific feature between the target and the background, various detection methods were proposed in recent decades. However, most methods extract the feature in a region with fixed shape, especially in a rectangular region, which causes a problem: when faced with complex-shape clutters, the rectangular region involves the pixels inside and outside the clutters, and the significant grey-level difference among these pixels leads to a relatively large feature in the clutter area, interfering with the target detection. In this paper, we propose a structure-adaptive clutter suppression method, called chain-growth filtering, for robust infrared small target detection. The well-designed filtering model can adjust its shape to fit various clutter structures such as lines, curves and irregular edges, and thus has a more robust clutter suppression capability than the fixed-shape feature extraction strategy. In addition, the proposed method achieves a considerable anti-noise ability by employing guided filter as a preprocessing approach and enjoys the capability of multi-scale target detection without complex parameter tuning. In the experiment, we evaluate the performance of the detection method through 12 typical infrared scenes which contain different types of clutters. Compared with seven state-of-the-art methods, the proposed method shows the superior clutter-suppression effects for various types of clutters and the excellent detection performance for various scenes.
Collapse
|
7
|
Liu X, Chen Y, Peng Z, Wu J. Infrared Image Super-Resolution Reconstruction Based on Quaternion and High-Order Overlapping Group Sparse Total Variation. SENSORS (BASEL, SWITZERLAND) 2019; 19:E5139. [PMID: 31771234 PMCID: PMC6928699 DOI: 10.3390/s19235139] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2019] [Revised: 11/20/2019] [Accepted: 11/21/2019] [Indexed: 12/18/2022]
Abstract
Owing to the limitations of imaging principles and system imaging characteristics, infrared images generally have some shortcomings, such as low resolution, insufficient details, and blurred edges. Therefore, it is of practical significance to improve the quality of infrared images. To make full use of the information on adjacent points, preserve the image structure, and avoid staircase artifacts, this paper proposes a super-resolution reconstruction method for infrared images based on quaternion total variation and high-order overlapping group sparse. The method uses a quaternion total variation method to utilize the correlation between adjacent points to improve image anti-noise ability and reconstruction effect. It uses the sparsity of a higher-order gradient to reconstruct a clear image structure and restore smooth changes. In addition, we performed regularization by using the denoising method, alternating direction method of multipliers, and fast Fourier transform theory to improve the efficiency and robustness of our method. Our experimental results show that this method has excellent performance in objective evaluation and subjective visual effects.
Collapse
Affiliation(s)
- Xingguo Liu
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
- Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China
- Chongqing College of Electronic Engineering, Chongqing 401331, China;
| | - Yingpin Chen
- School of Physics and Information Engineering, Minnan Normal University, Zhangzhou 363000, China;
| | - Zhenming Peng
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
- Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Juan Wu
- Chongqing College of Electronic Engineering, Chongqing 401331, China;
| |
Collapse
|
8
|
A Vehicle Target Recognition Algorithm for Wide-Angle SAR Based on Joint Feature Set Matching. ELECTRONICS 2019. [DOI: 10.3390/electronics8111252] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Target recognition is an important area in Synthetic Aperture Radar (SAR) research. Wide-angle Synthetic Aperture Radar (WSAR) has obvious advantages in target imaging resolution. This paper presents a vehicle target recognition algorithm for wide-angle SAR, which is based on joint feature set matching (JFSM). In this algorithm, firstly, the modulus stretch step is added in the imaging process of wide-angle SAR to obtain the thinned image of vehicle contour. Secondly, the gravitational-based speckle reduction algorithm is used to obtain a clearer contour image. Thirdly, the image is rotated to obtain a standard orientation image. Subsequently, the image and projection feature sets are extracted. Finally, the JFSM algorithm, which combines the image and projection sets, is used to identify the vehicle model. Experiments show that the recognition accuracy of the proposed algorithm is up to 85%. The proposed algorithm is demonstrated on the Gotcha WSAR dataset.
Collapse
|
9
|
Modulus Stretch-Based Circular SAR Imaging with Contour Thinning. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9132728] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This paper presents a modulus stretch-based circular Synthetic Aperture Radar (SAR) imaging method. This method improves the traditional backprojection algorithm for circular SAR imaging, and introduces the modulus stretch transformation function in the imaging process. By performing a modulus stretch transformation on the intermediate results, the target contour in the final imaging result is thinner and clearer. A thinner and clearer contour can help to increase the recognizability of the target and provide a basis for subsequent target recognition. The proposed method is demonstrated on the line target imaging simulations and Gothca dataset.
Collapse
|
10
|
Infrared Dim Target Detection Using Shearlet’s Kurtosis Maximization under Non-Uniform Background. Symmetry (Basel) 2019. [DOI: 10.3390/sym11050723] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
A novel method based on multiscale and multidirectional feature fusion in the shearlet transform domain and kurtosis maximization for detecting the dim target in infrared images with a low signal-to-noise ratio (SNR) and serious interference caused by a cluttered and non-uniform background is presented in this paper. First, an original image is decomposed using the shearlet transform with translation invariance. Second, various directions of high-frequency subbands are fused and the corresponding kurtosis of fused image is computed. The targets can be enhanced by strengthening the column with maximum kurtosis. Then, processed high-frequency subbands on different scales of images are merged. Finally, the dim targets are detected by an adaptive threshold with a maximum contrast criterion (MCC). The experimental results show that the proposed method has good performance for infrared target detection in comparison with the nonsubsampled contourlet transform (NSCT) method.
Collapse
|
11
|
Infrared Small Target Detection Based on Non-Convex Optimization with Lp-Norm Constraint. REMOTE SENSING 2019. [DOI: 10.3390/rs11050559] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The infrared search and track (IRST) system has been widely used, and the field of infrared small target detection has also received much attention. Based on this background, this paper proposes a novel infrared small target detection method based on non-convex optimization with Lp-norm constraint (NOLC). The NOLC method strengthens the sparse item constraint with Lp-norm while appropriately scaling the constraints on low-rank item, so the NP-hard problem is transformed into a non-convex optimization problem. First, the infrared image is converted into a patch image and is secondly solved by the alternating direction method of multipliers (ADMM). In this paper, an efficient solver is given by improving the convergence strategy. The experiment shows that NOLC can accurately detect the target and greatly suppress the background, and the advantages of the NOLC method in detection efficiency and computational efficiency are verified.
Collapse
|