Single-shot retinal image enhancement using untrained and pretrained neural networks priors integrated with analytical image priors

Untrained Neural Network Priors for Inverse Imaging Problems: A Survey

In recent years, advancements in machine learning (ML) techniques, in particular, deep learning (DL) methods have gained a lot of momentum in solving inverse imaging problems, often surpassing the performance provided by hand-crafted approaches. Traditionally, analytical methods have been used to solve inverse imaging problems such as image restoration, inpainting, and superresolution. Unlike analytical methods for which the problem is explicitly defined and the domain knowledge is carefully engineered into the solution, DL models do not benefit from such prior knowledge and instead make use of large datasets to predict an unknown solution to the inverse problem. Recently, a new paradigm of training deep models using a single image, named untrained neural network prior (UNNP) has been proposed to solve a variety of inverse tasks, e.g., restoration and inpainting. Since then, many researchers have proposed various applications and variants of UNNP. In this paper, we present a comprehensive review of such studies and various UNNP applications for different tasks and highlight various open research problems which require further research.

Group theoretic particle swarm optimization for gray-level medical image enhancement

As a principal category in the promising field of medical image processing, medical image enhancement has a powerful influence on the intermedia features and final results of the computer aided diagnosis (CAD) system by increasing the capacity to transfer the image information in the optimal form. The enhanced region of interest (ROI) would contribute to the early diagnosis and the survival rate of patients. Meanwhile, the enhancement schema can be treated as the optimization approach of image grayscale values, and metaheuristics are adopted popularly as the mainstream technologies for medical image enhancement. In this study, we propose an innovative metaheuristic algorithm named group theoretic particle swarm optimization (GT-PSO) to tackle the optimization problem of image enhancement. Based on the mathematical foundation of symmetric group theory, GT-PSO comprises particle encoding, solution landscape, neighborhood movement and swarm topology. The corresponding search paradigm takes place simultaneously under the guidance of hierarchical operations and random components, and it could optimize the hybrid fitness function of multiple measurements of medical images and improve the contrast of intensity distribution. The numerical results generated from the comparative experiments show that the proposed GT-PSO has outperformed most other methods on the real-world dataset. The implication also indicates that it would balance both global and local intensity transformations during the enhancement process.

Enhancement method with naturalness preservation and artifact suppression based on an improved Retinex variational model for color retinal images

Retinal images are widely used for the diagnosis of various diseases. However, low-quality retinal images with uneven illumination, low contrast, or blurring may seriously interfere with diagnosis by ophthalmologists. This study proposes an enhancement method for low-quality retinal color images. In this paper, an improved variational Retinex model for color retinal images is first proposed and applied to each channel of the RGB color space to obtain the illuminance and reflectance layers. Subsequently, the Naka-Rushton equation is introduced to correct the illumination layer, and an enhancement operator is constructed to improve the clarity of the reflectance layer. Finally, the corrected illuminance and enhanced reflectance are recombined. Contrast-limited adaptive histogram equalization is introduced to further improve the clarity and contrast. To demonstrate the effectiveness of the proposed method, this method is tested on 527 images from four publicly available datasets and 40 local clinical images from Tianjin Eye Hospital (China). Experimental results show that the proposed method outperforms the other four enhancement methods and has obvious advantages in naturalness preservation and artifact suppression.