Depth-assisted calibration on learning-based factorization for a compressive light field display

Real-time decomposition technique for compressive light field display using the multiplex correlations

How to compress and decompose the high-dimensional light field information in real time is still a challenging task for compressive light field display. Traditional iterative algorithms suffer from slow convergence speed and limited image quality. Therefore, a real-time decomposition technique for compressive light field display using multiplex correlations is proposed. Firstly, the iteration initial value of the algorithm is optimized, by utilizing the spatial correlations of pixel multiplex light fields, which significantly improves the convergence speed and reduces noise. Secondly, the iterative task of high-dimensional matrix in the non-negative matrix factorization (NMF) algorithm is divided into highly parallel linear iterative tasks. A stochastic gradient descent (SGD) optimizer and GPU are used to parallel compress and decompose the light fields. Thirdly, addresses of light field data are reordered using the sign distance field (SDF) transformation in sheared camera frustum space, making the addressing process of compression and decomposition more efficient. A rendering pipeline is constructed that renders the compressive light fields using 3D model data directly. For a light field containing 5 × 5 viewpoints and 1024 × 1024 × 2 pixels, only 2-3 iterations are needed to approach the optimal solution. The decomposition efficiency is increased by 15.24 times. The frame rate of decomposition exceeds 30 frames per second (fps). A compressive light field display system has been built to realize 3D display, verifying the feasibility of the technique.

High-brightness hybrid compressive light field display with improved image quality

Previous LCD-based multiplicative compressive light field (CLF) display has the trade-off between the brightness and the depth of field (DOF). In this paper, we propose a hybrid CLF display using a reflective polarizer and RGB mini-LED panel. By the polarization-multiplexing and the reflector dam (RD) designed on the mini-LED panel, the proposed system can preserve high brightness while enhancing the DOF. Then, a decomposition algorithm is proposed to improve the image quality by depth segmentation and limiting the motion parallax. Compared to the conventional hybrid CLF display, the brightness of the proposed system reaches 348 nits and the reconstruction quality achieves structural similarity index measure (SSIM) improvement by 0.12. The experiments also demonstrate that the proposed method could achieve a higher brightness, larger depth of field, and higher image quality.

Focus Issue Introduction: 3D Image Acquisition and Display: Technology, Perception and Applications

This Feature Issue of Optics Express is organized in conjunction with the 2022 Optica conference on 3D Image Acquisition and Display: Technology, Perception and Applications which was held in hybrid format from 11 to 15, July 2022 as part of the Imaging and Applied Optics Congress and Optical Sensors and Sensing Congress 2022 in Vancouver, Canada. This Feature Issue presents 31 articles which cover the topics and scope of the 2022 3D Image Acquisition and Display conference. This Introduction provides a summary of these published articles that appear in this Feature Issue.