Underwater image quality enhancement through integrated color model with Rayleigh distribution

Underwater Image Enhancement Based on Luminance Reconstruction by Multi-Resolution Fusion of RGB Channels

Underwater image enhancement technology is crucial for the human exploration and exploitation of marine resources. The visibility of underwater images is affected by visible light attenuation. This paper proposes an image reconstruction method based on the decomposition-fusion of multi-channel luminance data to enhance the visibility of underwater images. The proposed method is a single-image approach to cope with the condition that underwater paired images are difficult to obtain. The original image is first divided into its three RGB channels. To reduce artifacts and inconsistencies in the fused images, a multi-resolution fusion process based on the Laplace-Gaussian pyramid guided by a weight map is employed. Image saliency analysis and mask sharpening methods are also introduced to color-correct the fused images. The results indicate that the method presented in this paper effectively enhances the visibility of dark regions in the original image and globally improves its color, contrast, and sharpness compared to current state-of-the-art methods. Our method can enhance underwater images in engineering practice, laying the foundation for in-depth research on underwater images.

PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators

Due to the light absorption and scattering induced by the water medium, underwater images usually suffer from some degradation problems, such as low contrast, color distortion, and blurring details, which aggravate the difficulty of downstream underwater understanding tasks. Therefore, how to obtain clear and visually pleasant images has become a common concern of people, and the task of underwater image enhancement (UIE) has also emerged as the times require. Among existing UIE methods, Generative Adversarial Networks (GANs) based methods perform well in visual aesthetics, while the physical model-based methods have better scene adaptability. Inheriting the advantages of the above two types of models, we propose a physical model-guided GAN model for UIE in this paper, referred to as PUGAN. The entire network is under the GAN architecture. On the one hand, we design a Parameters Estimation subnetwork (Par-subnet) to learn the parameters for physical model inversion, and use the generated color enhancement image as auxiliary information for the Two-Stream Interaction Enhancement sub-network (TSIE-subnet). Meanwhile, we design a Degradation Quantization (DQ) module in TSIE-subnet to quantize scene degradation, thereby achieving reinforcing enhancement of key regions. On the other hand, we design the Dual-Discriminators for the style-content adversarial constraint, promoting the authenticity and visual aesthetics of the results. Extensive experiments on three benchmark datasets demonstrate that our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics. The code and results can be found from the link of https://rmcong.github.io/proj_PUGAN.html.

Weibull Tone Mapping (WTM) for the Enhancement of Underwater Imagery

Domain experts prefer interactive and targeted control-point tone mapping operations (TMOs) to enhance underwater image quality and feature visibility; though this comes at the expense of time and training. In this paper, we provide end-users with a simpler and faster interactive tone-mapping approach. This is built upon Weibull Tone Mapping (WTM) theory; introduced in previous work as a preferred tool to describe and improve domain expert TMOs. We allow end-users to easily shape brightness distributions according to the Weibull distribution, using two parameter sliders which modify the distribution peak and spread. Our experiments showed that 10 domain experts found the two-slider Weibull manipulation sufficed to make a desired adjustment in >80% of images in a large dataset. For the remaining ∼20%, observers opted for a control-point TMO which can, broadly, encompass many global tone mapping algorithms. Importantly, 91% of these control-point TMOs can actually be visually well-approximated by our Weibull slider manipulation, despite users not identifying slider parameters themselves. Our work stresses the benefit of the Weibull distribution and significance of image purpose in underwater image enhancement.

Underwater image enhancement using adaptive color restoration and dehazing

Underwater images captured by optical cameras can be degraded by light attenuation and scattering, which leads to deteriorated visual image quality. The technique of underwater image enhancement plays an important role in a wide range of subsequent applications such as image segmentation and object detection. To address this issue, we propose an underwater image enhancement framework which consists of an adaptive color restoration module and a haze-line based dehazing module. First, we employ an adaptive color restoration method to compensate the deteriorated color channels and restore the colors. The color restoration module consists of three steps: background light estimation, color recognition, and color compensation. The background light estimation determines the image is blueish or greenish, and the compensation is applied in red-green or red-blue channels. Second, the haze-line technique is employed to remove the haze and enhance the image details. Experimental results show that the proposed method can restore the color and remove the haze at the same time, and it also outperforms several state-of-the-art methods on three publicly available datasets. Moreover, experiments on an underwater object detection dataset show that the proposed underwater image enhancement method is able to improve the accuracy of the subsequent underwater object detection framework.

FMAGAN:Fusing multiple attention and generative adversarial network to enhance underwater image

Underwater image enhancement has always been a hot spot in underwater vision research. However, due to complicated underwater environment, a lot of problems such as the color distortion and low brightness of underwater raw images are very likely to occur. In response to the above situation, we proposed a generative adversarial network that integrated multiple attention to enhance underwater images. In the generator, we introduced multi-layer dense connections and CSAM modules, of which the former could capture more detailed features and make use of previous features, while the latter could improve the utilization of the feature map. Meanwhile, we improved the enhancement effect of the generated image by combining VGG19 content loss function and SmoothL1 loss function. Finally, we verified the effectiveness of the proposed model through qualitative and quantitative experiments, and compared the results with the performance of several latest models. The results show that the methods proposed in this paper are superior to the existing methods.

The Color Improvement of Underwater Images Based on Light Source and Detector

As one of the most direct approaches to perceive the world, optical images can provide plenty of useful information for underwater applications. However, underwater images often present color deviation due to the light attenuation in the water, which reduces the efficiency and accuracy in underwater applications. To improve the color reproduction of underwater images, we proposed a method with adjusting the spectral component of the light source and the spectral response of the detector. Then, we built the experimental setup to study the color deviation of underwater images with different lamps and different cameras. The experimental results showed that, a) in terms of light source, the color deviation of an underwater image with warm light LED (Light Emitting Diode) (with the value of Δa*2+Δb*2 being 26.58) was the smallest compared with other lamps, b) in terms of detectors, the color deviation of images with the 3×CMOS RGB camera (a novel underwater camera with three CMOS sensors developed for suppressing the color deviation in our team) (with the value of Δa*2+Δb*2 being 25.25) was the smallest compared with other cameras. The experimental result (i.e., the result of color improvement between different lamps or between different cameras) verified our assumption that the underwater image color could be improved by adjusting the spectral component of the light source and the spectral response of the detector. Differing from the color improvement method with image processing, this color-improvement method was based on hardware, which had advantages, including more image information being retained and less-time being consumed.

Estimation of Stress-Strength Reliability for Multicomponent System with Rayleigh Data

Inference is investigated for a multicomponent stress-strength reliability (MSR) under Type-II censoring when the latent failure times follow two-parameter Rayleigh distribution. With a context that the lifetimes of the strength and stress variables have common location parameters, maximum likelihood estimator of MSR along with the existence and uniqueness is established. The associated approximate confidence interval is provided via the asymptotic distribution theory and delta method. Meanwhile, alternative generalized pivotal quantities-based point and confidence interval estimators are also constructed for MSR. More generally, when the lifetimes of strength and stress variables follow Rayleigh distributions with unequal location parameters, likelihood and generalized pivotal-based estimators are provided for MSR as well. In addition, to compare the equivalence of different strength and stress parameters, a likelihood ratio test is provided. Finally, simulation studies and a real data example are presented for illustration.

Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding

Underwater images suffer from color casts and low contrast due to wavelength- and distance-dependent attenuation and scattering. To solve these two degradation issues, we present an underwater image enhancement network via medium transmission-guided multi-color space embedding, called Ucolor. Concretely, we first propose a multi-color space encoder network, which enriches the diversity of feature representations by incorporating the characteristics of different color spaces into a unified structure. Coupled with an attention mechanism, the most discriminative features extracted from multiple color spaces are adaptively integrated and highlighted. Inspired by underwater imaging physical models, we design a medium transmission (indicating the percentage of the scene radiance reaching the camera)-guided decoder network to enhance the response of network towards quality-degraded regions. As a result, our network can effectively improve the visual quality of underwater images by exploiting multiple color spaces embedding and the advantages of both physical model-based and learning-based methods. Extensive experiments demonstrate that our Ucolor achieves superior performance against state-of-the-art methods in terms of both visual quality and quantitative metrics. The code is publicly available at: https://li-chongyi.github.io/Proj_Ucolor.html.

Underwater Image Enhancement Based on Multi-Scale Fusion and Global Stretching of Dual-Model

Aimed at the two problems of color deviation and poor visibility of the underwater image, this paper proposes an underwater image enhancement method based on the multi-scale fusion and global stretching of dual-model (MFGS), which does not rely on the underwater optical imaging model. The proposed method consists of three stages: Compared with other color correction algorithms, white-balancing can effectively eliminate the undesirable color deviation caused by medium attenuation, so it is selected to correct the color deviation in the first stage. Then, aimed at the problem of the poor performance of the saliency weight map in the traditional fusion processing, this paper proposed an updated strategy of saliency weight coefficient combining contrast and spatial cues to achieve high-quality fusion. Finally, by analyzing the characteristics of the results of the above steps, it is found that the brightness and clarity need to be further improved. The global stretching of the full channel in the red, green, blue (RGB) model is applied to enhance the color contrast, and the selective stretching of the L channel in the Commission International Eclairage-Lab (CIE-Lab) model is implemented to achieve a better de-hazing effect. Quantitative and qualitative assessments on the underwater image enhancement benchmark dataset (UIEBD) show that the enhanced images of the proposed approach achieve significant and sufficient improvements in color and visibility.

Enhancement of Nonuniformly Illuminated Underwater Images

Underwater image capturing is a challenging task due to attenuation of light in water. Scattering and absorption are the results of light attenuation which lead to faded colors and reduced contrast of images, respectively. To deal with these issues and to provide better visual quality image, various enhancement methods have been proposed. This paper proposes the Dual Domain-based Underwater Image Enhancement (DDUIE) method. DDUIE method provides contrast stretching in approximation band of discrete wavelet transformed image followed by intensity adjustment of different color channels in spatial domain. To further improve the color quality, the image is processed in HSV (Hue–Saturation–Value) color space. Result analysis indicates better results for DDUIE method over state-of-the-art methods. Subjective results of DDUIE method show minimization of the bluish-green effect and reduction of nonuniform illumination up to a certain extent. These lead to enhanced color and image details. Quantitative results show that the Underwater Image Quality Measure (UIQM) and Underwater Color Image Quality Evaluation (UCIQE) values between 1 and 2 and between 0 and 1 have been achieved, respectively, which significantly illustrate that images have been enhanced efficiently and also entropy values between 7 and 8 depict the effectiveness of the proposed method in terms of image details.

Underwater Image Enhancement Using Successive Color Correction and Superpixel Dark Channel Prior

Underwater images generally suffer from quality degradations, such as low contrast, color cast, blurring, and hazy effect due to light absorption and scattering in the water medium. In applying these images to various vision tasks, single image-based underwater image enhancement has been challenging. Thus, numerous efforts have been made in the field of underwater image restoration. In this paper, we propose a successive color correction method with a minimal reddish artifact and a superpixel-based restoration using a color-balanced underwater image. The proposed successive color correction method comprises an effective underwater white balance based on the standard deviation ratio, followed by a new image normalization. The corrected image based on this color balance algorithm barely produces a reddish artifact. The superpixel-based dark channel prior is exploited to enhance the color-corrected underwater image. We introduce an image-adaptive weight factor using the mean of backscatter lights to estimate the transmission map. We perform intensive experiments for various underwater images and compare the performance of the proposed method with those of 10 state-of-the-art underwater image-enhancement methods. The simulation results show that the proposed enhancement scheme outperforms the existing approaches in terms of both subjective and objective quality.

An Underwater Image Enhancement Benchmark Dataset and Beyond

Underwater image enhancement has been attracting much attention due to its significance in marine engineering and aquatic robotics. Numerous underwater image enhancement algorithms have been proposed in the last few years. However, these algorithms are mainly evaluated using either synthetic datasets or few selected real-world images. It is thus unclear how these algorithms would perform on images acquired in the wild and how we could gauge the progress in the field. To bridge this gap, we present the first comprehensive perceptual study and analysis of underwater image enhancement using large-scale real-world images. In this paper, we construct an Underwater Image Enhancement Benchmark (UIEB) including 950 real-world underwater images, 890 of which have the corresponding reference images. We treat the rest 60 underwater images which cannot obtain satisfactory reference images as challenging data. Using this dataset, we conduct a comprehensive study of the state-of-the-art underwater image enhancement algorithms qualitatively and quantitatively. In addition, we propose an underwater image enhancement network (called Water-Net) trained on this benchmark as a baseline, which indicates the generalization of the proposed UIEB for training Convolutional Neural Networks (CNNs). The benchmark evaluations and the proposed Water-Net demonstrate the performance and limitations of state-of-the-art algorithms, which shed light on future research in underwater image enhancement. The dataset and code are available at.

A Fast Image Deformity Correction Algorithm for Underwater Turbulent Image Distortion

An algorithm correcting distortion based on estimating the pixel shift is proposed for the degradation caused by underwater turbulence. The distorted image is restored and reconstructed by reference frame selection and two-dimensional pixel registration. A support vector machine-based kernel correlation filtering algorithm is proposed and applied to improve the speed and efficiency of the correction algorithm. In order to validate the algorithm, laboratory experiments on a controlled simulation system of turbulent water and field experiments in rivers and oceans are carried out, and the experimental results are compared with traditional, theoretical model-based and particle image velocimetry-based restoration and reconstruction algorithms. Using subjective visual evaluation, image distortion has been effectively suppressed; based on an objective performance statistical analysis, the measured values are better than the traditional and formerly studied restoration and reconstruction algorithms. The method proposed in this paper is also much faster than the other algorithms. It can be concluded that the proposed algorithm can effectively improve the de-distortion effect of the underwater turbulence degraded image, and provide potential techniques for the accurate operation of underwater target detection in real time.

Enhancing underwater optical imaging by using a low-pass polarization filter

Object identification in highly turbid optical media depends mainly on the quality of collected images. Underwater images acquired in a turbid environment are generally of very poor quality. Attenuation and backscattering of light by water, by materials dissolved in the water, and by particulate material are the main causes of the degradation of underwater images. It is therefore essential to improve the quality of such images to facilitate object identification. The focus of this paper is to report the principle and validation of a fast and effective method of improving the quality of underwater images. On the one hand, this method uses a polarimetric imaging optical system to reduce the effect of diffusion on the image acquisition. On the other hand, it is based on an optimized version of the dark channel prior (DCP) method that has received a great deal of attention for image dehazing. Results derived from images obtained in a controlled laboratory water tank environment with different turbidity conditions and images from tests using the proposed method at sea demonstrate an ability to significantly improve visibility and reduce runtime by a factor of about 50 for a 4K image when compared to conventional DCP methods.

Adaptive Multi-Scale Entropy Fusion De-Hazing Based on Fractional Order

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled color correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to the illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields a better edge and contrast enhancement results without a halo effect, without color degradation, and is faster and more adaptive than all other algorithms from the literature.

Adaptive Stretching Method for Underwater Image Color Correction

The physical properties of water lead to attenuation of light that travels through the water channel. The attenuation is dependent on the color spectrum wavelength, that results in low contrast and color cast in image acquisition. Several methods have been proposed to handle these problems, such as Linear Stretching, Histogram Equalization (HE) and their variants. Considering the advantages of HE and Linear Stretching, this paper presents a new Adaptive Linear Stretch method (ALS) which can efficiently improve the subjective impression of the traditional Linear Stretching and keep the computational cost low at the same time. To achieve adaptability, the adaptable threshold is deduced from the histogram of image. Performance analysis reveals that the proposed method significantly enhances the image contrast, reduces the color cast and meanwhile, keeps the computational consumption low.