An electrically tunable plenoptic camera using a liquid crystal microlens array

LC-based lightfield camera prototype for rapidly creating target images optimized by finely adjusting several key coefficients and a LC-guided refocusing-rendering

A lightfield camera prototype is constructed by directly coupling a liquid-crystal (LC) microlens array with an arrayed photosensitive sensor for performing a LC-guided refocusing-rendering imaging attached by computing disparity map and extracting featured contours of targets. The proposed camera prototype presents a capability of efficiently selecting the imaging clarity value of the electronic targets interested. Two coefficients of the calibration coefficient k and the rendering coefficient C are defined for quantitively adjusting LC-guided refocusing-rendering operations about the images acquired. A parameter Dp is also introduced for exactly expressing the local disparity of the electronic patterns selected. A parallel computing architecture based on common GPU through the OpenCL platform is adopted for improving the real-time performance of the imaging algorithms proposed, which can effectively be used to extract the pixel-leveled disparity and the featured target contours. In the proposed lightfield imaging strategy, the focusing plane can be easily selected and/or further adjusted by loading and/or varying the signal voltage applied over the LC microlenses for realizing a rapid or even intelligent autofocusing. The research lays a solid foundation for continuously developing or upgrading current lightfield imaging approaches.

Fabrication and characterization of a two-dimensional individually addressable electrowetting microlens array

We demonstrate a two-dimensional, individually tunable electrowetting microlens array fabricated using standard microfabrication techniques. Each lens in our array has a large range of focal tunability from -1.7 mm to -∞ in the diverging regime, which we verify experimentally from 0 to 75 V for a device coated in Parylene C. Additionally, each lens can be actuated to within 1% of their steady-state value within 1.5 ms. To justify the use of our device in a phase-sensitive optical system, we measure the wavefront of a beam passing through the center of a single lens in our device over the actuation range and show that these devices have a surface quality comparable to static microlens arrays. The large range of tunability, fast response time, and excellent surface quality of these devices open the door to potential applications in compact optical imaging systems, transmissive wavefront shaping, and beam steering.

Photoelectric hybrid neural network based on ZnO nematic liquid crystal microlens array for hyperspectral imaging

The miniaturized imaging spectrometers face bottlenecks in reconstructing the high-resolution spectral image. In this study, we have proposed an optoelectronic hybrid neural network based on zinc oxide (ZnO) nematic liquid crystal (LC) microlens array (MLA). This architecture optimizes the parameters of the neural network by constructing the TV-L1-L2 objective function and using mean square error as a loss function, giving full play to the advantages of ZnO LC MLA. It adopts the ZnO LC-MLA as optical convolution to reduce the volume of the network. Experimental results show that the proposed architecture has reconstructed a 1536 × 1536 pixels resolution enhancement hyperspectral image in the wavelength range of [400 nm, 700 nm] in a relatively short time, and the spectral accuracy of reconstruction has reached just 1 nm.

Adaptive lens for foveal vision, imaging, and projection over large clear apertures

We report an electrically tunable liquid crystal device that enables the generation of lenses the diameters of which may be dynamically changed from sub-millimeter to multiple millimeter sizes. These lenses can be created in different regions of interest over very large (above 50 mm) optical clear apertures. The approach is based on the activation of periodically spaced contacts on a single serpentine-shaped electrode with phase-shifted electrical signals. It enables a highly reconfigurable operation of locally created lenses with variable position, diameter, optical power (OP) and aberrations. The preliminary demonstration of the capabilities of the proposed device is presented here by creating a local lens, moving its center over an area of 25 mm x 25 mm, gradually changing its diameter from 1.3 mm to 4.55 mm as well as by tuning its OP value from zero up to, respectively, ≈ 40 and ≈3.5 diopters. Typical driving signals are at the order of 3.5 V. We think that such lenses can be used for ophthalmic or augmented reality applications as well as in microscopy, adaptive panoramic cameras with large distorted field of view, dynamic projection, etc.

Electrically addressed focal stack plenoptic camera based on a liquid-crystal microlens array for all-in-focus imaging

Focal stack cameras are capable of capturing a stack of images focused at different spatial distance, which can be further integrated to present a depth of field (DoF) effect beyond the range restriction of conventional camera's optics. To date, all of the proposed focal stack cameras are essentially 2D imaging architecture to shape 2D focal stacks with several selected focal lengths corresponding to limited objective distance range. In this paper, a new type of electrically addressed focal stack plenoptic camera (EAFSPC) based on a functional liquid-crystal microlens array for all-in-focus imaging is proposed. As a 3D focal stack camera, a sequence of raw light-field images can be rapidly manipulated through rapidly shaping a 3D focal stack. The electrically addressed focal stack strategy relies on the electric tuning of the focal length of the liquid-crystal microlens array by efficiently selecting or adjusting or jumping the signal voltage applied over the microlenses. An algorithm based on the Laplacian operator is utilized to composite the electrically addressed focal stack leading to raw light-field images with an extended DoF and then the all-in-focus refocused images. The proposed strategy does not require any macroscopic movement of the optical apparatus, so as to thoroughly avoid the registration of different image sequence. Experiments demonstrate that the DoF of the refocused images can be significantly extended into the entire tomography depth of the EAFSPC, which means a significant step for an all-in-focus imaging based on the electrically controlled 3D focal stack. Moreover, the proposed approach also establishes a high correlation between the voltage signal and the depth of in-focus plane, so as to construct a technical basis for a new type of 3D light-field imaging with an obvious intelligent feature.

A Light Field Display Realization with a Nematic Liquid Crystal Microlens Array and a Polymer Dispersed Liquid Crystal Film

This study demonstrates a light field display system using a nematic liquid crystal (LC) microlens array (MLA) and a polymer dispersed liquid crystal (PDLC) film. LC-MLA without polarization effects presented high-resolution intermediate 3D images by adopting a depolarization algorithm. The adopted PDLC film modulated the reconstructed 3D images to deliver full-parallax images efficiently with a wide FOV. The experimental result shows that the peak signal to noise ratio (PSNR) value of photograph accurate display results improves compared to the pure LC-MLA method. The proposed method is an essential step toward high-quality light field display.

Spatial separation of azimuthally and radially polarized beams from non-polarized light waves based on the electrically controlled birefringence effect

Based on the electrically controlled birefringence effect in liquid crystal materials, an effective method for spatially separating azimuthally and radially polarized beams from non-polarized incident light waves is proposed. The radially polarized beam was highly converged by using a microhole-patterned electrode and a planar photo-alignment layer to shape the initial liquid-crystal radial alignment and a gradient refractive index distribution with central axial symmetry after applying a voltage signal. Due to the intrinsic polarization sensitivity of nematic liquid-crystal materials, the shaped gradient refractive index only applies to extraordinary light waves, which then converge into a spot. Thus, the azimuthally and radially polarized beams are effectively separated. The proposed method demonstrates some advantages, such as low cost, miniaturization, and easy fabrication and integration with other functional devices. Thanks to the wideband electrically controlled birefringence of liquid-crystal materials, this light-wave manipulation to spatially separate azimuthally and radially polarized beams can also be performed over a wide wavelength range.

Arrayed dual-mode integrated liquid crystal microlens driven jointly by both independent signal voltages

A new type of liquid crystal microlens array (LCMLA) constructed by a single-layered LC material is proposed. The basic dual-mode integrated LC microlens includes a concentric microhole electrode and a central plate electrode. Compared with traditional LC microlenses driven electrically, the dual-mode integrated LC microlens presents a better light control effect, such as being flexibly adjusted between the beam convergence and divergence modes, enlarging both the tunable range of the signal voltage and the focal length and also reducing the focal spot assisted by a convex electric-field generated by the central plate electrode, acquiring a sharper beam diverging microring formed by the concave LC microlens assisted by a concave electric-field generated by the microhole electrode. At the same time, we have also verified that the electric-field filling factor of the dual-mode integrated LCMLA can be obviously increased through jointly tuning the signal voltages applied independently over both the microhole electrode and the central plate electrode. This research has laid a solid foundation for continuously developing LCMLA technology.

Design of a digitally switchable multifocal microlens array for integral imaging systems

This paper presents the optical design of a digitally switchable multi-focal microlens array which can be used to extend the depth of field in integral imaging systems. The proposed switchable multi-focal microlens array consists of a customized freeform multi-focal microlens array (MLA) and a programmable spatial light modulator. By switching among the different optical powers of the switchable multi-focal MLA, an integral imaging system can render or capture a 3D scene at a large depth range around several central depth planes. We demonstrate the design considerations for a dual-focal microlens array with a primary and secondary focal lengths of 4mm and 4.06mm, respectively. We further validated the design by providing both interferometric measurements of the surface profiles and image contrast and resolution tests of a manufactured MLA prototype.

Electrically Controlled Liquid Crystal Microlens Array Based on Single-Crystal Graphene Coupling Alignment for Plenoptic Imaging

As a unique electric-optics material, liquid crystals (LCs) have been used in various light-control applications. In LC-based light-control devices, the structural alignment of LC molecules is of great significance. Generally, additional alignment layers are required for LC lens and microlens, such as rubbed polyimide (PI) layers or photoalignment layers. In this paper, an electrically controlled liquid crystal microlens array (EC-LCMLA) based on single-crystal graphene (SCG) coupling alignment is proposed. A monolayer SCG with high conductivity and initial anchoring of LC molecules was used as a functional electrode, thus no additional alignment layer is needed, which effectively simplifies the basic structure and process flow of conventional LCMLA. Experiments indicated that a uniform LC alignment can be acquired in the EC-LCMLA cell by the SCG coupling alignment effect. The common optical properties including focal lengths and point spread function (PSF) were measured experimentally. Experiments demonstrated that the proposed EC-LCMLA has good focusing performance in the visible to near-infrared range. Moreover, the plenoptic imaging in Galilean mode was achieved by integrating the proposed EC-LCMLA with photodetectors. Digital refocusing was performed to obtain a rendering image of the target.

Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Plenoptic cameras have received a wide range of research interest because it can record the 4D plenoptic function or radiance including the radiation power and ray direction. One of its important applications is digital refocusing, which can obtain 2D images focused at different depths. To achieve digital refocusing in a wide range, a large depth of field (DOF) is needed, but there are fundamental optical limitations to this. In this paper, we proposed a plenoptic camera with an extended DOF by integrating a main lens, a tunable multi-focus liquid-crystal microlens array (TMF-LCMLA), and a complementary metal oxide semiconductor (CMOS) sensor together. The TMF-LCMLA was fabricated by traditional photolithography and standard microelectronic techniques, and its optical characteristics including interference patterns, focal lengths, and point spread functions (PSFs) were experimentally analyzed. Experiments demonstrated that the proposed plenoptic camera has a wider range of digital refocusing compared to the plenoptic camera based on a conventional liquid-crystal microlens array (LCMLA) with only one corresponding focal length at a certain voltage, which is equivalent to the extension of DOF. In addition, it also has a 2D/3D switchable function, which is not available with conventional plenoptic cameras.

Improvements of resolution of light field imaging based on four-dimensional optical framing via a semi-transparent mirror

A simple light field imaging system is proposed, which could improve the resolution of light field imaging and enhance the signal-to-noise ratio of the result image. In the experiment, the light field imaging system consists of a single CCD with a microlens array and a semi-transparent mirror. The Fourier slice theorem has been used to transform the four-dimensional (4D) light field information into an infinite number of two-dimensional (2D) slices. With the use of the semi-transparent mirror, the high spatial resolution image can be reconstructed on the terminal sensor. The proposed method can not only reduce the aliasing defocus degree in the imaging process but also improve the slice image resolution to meet the requirement of image definition.

Electrically controlled liquid-crystal microlens matrix with a nested electrode array for efficiently tuning and swinging focus

A new type of electrically controlled liquid-crystal microlens matrix (EC-LCMM) with a nested electrode array for efficiently tuning and swinging focus, which means that the focus position can be adjusted in three dimensions, is proposed. The EC-LCMM is constructed by a 10 × 10 arrayed annular-sector-shaped aluminum electrode with a central microhole of 140μm diameter and three annular-sectors of 210μm external diameter and the period length of 280μm. To the arrangement of the patterned electrode, both the 10 × 10 LC microlens array based on the annular-sector-shaped aluminum electrode and the 9 × 9 LC microlens array based on an arrayed quasi-quadrilateral-ring-shaped electrode can be obtained. The 9 × 9 LC microlens array is formed by matching adjacent four annular-sector-shaped sub-electrodes in the 10 × 10 LC microlenses. The developed EC-LCMM can be used to electrically tune focus along the optical axis and also swing focus over a focal plane selected. The typical performances include: electrically tunable focusing in a driving voltage range of 3~7V_rms, the focal length in a range of 2~0.6mm, and the maximum focus swing distance being 16μm. For effectively describing the focus swing efficiency, the parameters of SF and SA are defined, which are the ratios between the focus swinging distance and the current focal length along the optical axis, and between the focus swinging extent and the external diameter of a single annular-sector-shaped aluminum electrode, respectively. The SF and SA of the EC-LCMM are ~16‰ and ~7.6%, respectively. It can be expected that the complex wavefront can be more efficiently measured and adjusted according to the EC-LCMM-based Shack-Hartmann wavefront measuring and adjusting architecture.

Scalable and ultrafast epitaxial growth of single-crystal graphene wafers for electrically tunable liquid-crystal microlens arrays

The scalable growth of wafer-sized single-crystal graphene in an energy-efficient manner and compatible with wafer process is critical for the killer applications of graphene in high-performance electronics and optoelectronics. Here, ultrafast epitaxial growth of single-crystal graphene wafers is realized on single-crystal Cu₉₀Ni₁₀(1 1 1) thin films fabricated by a tailored two-step magnetron sputtering and recrystallization process. The minor nickel (Ni) content greatly enhances the catalytic activity of Cu, rendering the growth of a 4 in. single-crystal monolayer graphene wafer in 10 min on Cu₉₀Ni₁₀(1 1 1), 50 folds faster than graphene growth on Cu(1 1 1). Through the carbon isotope labeling experiments, graphene growth on Cu₉₀Ni₁₀(1 1 1) is proved to be exclusively surface-reaction dominated, which is ascribed to the Cu surface enrichment in the CuNi alloy, as indicated by element in-depth profile. One of the best benefits of our protocol is the compatibility with wafer process and excellent scalability. A pilot-scale chemical vapor deposition (CVD) system is designed and built for the mass production of single-crystal graphene wafers, with productivity of 25 pieces in one process cycle. Furthermore, we demonstrate the application of single-crystal graphene in electrically controlled liquid-crystal microlens arrays (LCMLA), which exhibit highly tunable focal lengths near 2 mm under small driving voltages. By integration of the graphene based LCMLA and a CMOS sensor, a prototype camera is proposed that is available for simultaneous light-field and light intensity imaging. The single-crystal graphene wafers could hold great promising for high-performance electronics and optoelectronics that are compatible with wafer process.

Depth of field extension and objective space depth measurement based on wavefront imaging

When all the parts of the wavefront imaging system are kept static after wavefront measuring, the target's images are blurry, because the depth of field (DOF) of the system affects the imaging quality. In this paper, the method for extending the DOF of the wavefront imaging system through an integrated architecture of a liquid-crystal microlens array (LCMLA) powered by electricity and a common photosensitive array, is presented. The DOF can be extended remarkably only by stitching together several sub-images of the LCMLA. The problem that the wavefronts and imaging results are insensitive to the objective depth is also solved. Optimal driving voltage signals are found out according to Sobel mean gradient to efficiently calibrate the depth of objective space in order to quantitatively measure the depth. The approach indicates a viable way to effectively extend the DOF of imaging micro-systems and to measure the geometrical depth of targets at the same time.

Long working range light field microscope with fast scanning multifocal liquid crystal microlens array

The light field microscope has the potential of recording the 3D information of biological specimens in real time with a conventional light source. To further extend the depth of field to broaden its applications, in this paper, we proposed a multifocal high-resistance liquid crystal microlens array instead of the fixed microlens array. The developed multifocal liquid crystal microlens array can provide high quality point spread function in multiple focal lengths. By adjusting the focal length of the liquid crystal microlens array sequentially, the total working range of the light field microscope can be much extended. Furthermore, in our proposed system, the intermediate image was placed in the virtual image space of the microlens array, where the condition of the lenslets numerical aperture was considerably smaller. Consequently, a thin-cell-gap liquid crystal microlens array with fast response time can be implemented for time-multiplexed scanning.

Dual-polarized light-field imaging micro-system via a liquid-crystal microlens array for direct three-dimensional observation

Light-field imaging is a crucial and straightforward way of measuring and analyzing surrounding light worlds. In this paper, a dual-polarized light-field imaging micro-system based on a twisted nematic liquid-crystal microlens array (TN-LCMLA) for direct three-dimensional (3D) observation is fabricated and demonstrated. The prototyped camera has been constructed by integrating a TN-LCMLA with a common CMOS sensor array. By switching the working state of the TN-LCMLA, two orthogonally polarized light-field images can be remapped through the functioned imaging sensors. The imaging micro-system in conjunction with the electric-optical microstructure can be used to perform polarization and light-field imaging, simultaneously. Compared with conventional plenoptic cameras using liquid-crystal microlens array, the polarization-independent light-field images with a high image quality can be obtained in the arbitrary polarization state selected. We experimentally demonstrate characters including a relatively wide operation range in the manipulation of incident beams and the multiple imaging modes, such as conventional two-dimensional imaging, light-field imaging, and polarization imaging. Considering the obvious features of the TN-LCMLA, such as very low power consumption, providing multiple imaging modes mentioned, simple and low-cost manufacturing, the imaging micro-system integrated with this kind of liquid-crystal microstructure driven electrically presents the potential capability of directly observing a 3D object in typical scattering media.

Tunable liquid crystal multifocal microlens array

A novel liquid crystal microlens array with tunable multifocal capability, high optical power and fill-factor is proposed and experimentally demonstrated. A specific hole pattern design produces a multifocal array with only one voltage control. Three operations modes are possible, “Off”, “Tunable Multifocal” and “Unifocal”. The design is patterned in both substrates. Then, the substrates are arranged in symmetrical configuration. The result is a high optical power in comparison with typical hole patterned structures. Besides, it is proposed a hexagonal pattern that produces a high fill factor, specially indicated for some applications as Integral Imaging. The array has several useful characteristics for this type of application: tunability for the loss of resolution; multifocal for extended DOF; high fill factor for increase the number of views; and low power consumption for integration in portable devices. Moreover, the optical characteristics of the proposed device could bring new applications in other fields.

An Electrically Tunable Liquid Crystal Lens with Coaxial Bi-Focus and Single Focus Switching Modes

A hole-patterned electrode liquid crystal (LC) lens with electrically switching coaxial bi-focus and single focus modes of tuning is demonstrated. The proposed LC lens mainly consists of a two LC layer (TLCL) structure with different thicknesses to achieve higher focusing power than the conventional hole-patterned electrode LC lens with the same aperture size. In the TLCL structure, one LC layer, doped with 3 wt % RM257, was photopolymerized to achieve a fixed focusing power of 18.5 Diopter. Due to polarization dependence in TLCL lenses, an additional 90° twisted nematic (TN) cell was used to change the incident polarization in order to switch lens functions on or off. As a result, a fixed focusing power of 18.5 Diopter was achieved when voltages of 10 Vrms were applied to the 90° TN cell. In addition, the switching capabilities of the bi-focus and single focus modes were achieved when operating individually with applied voltages from 20 Vrms to 90 Vrms, and higher voltages of over 90 Vrms, respectively. The maximum focusing power in the fabricated TLCL lens is 30.9 Diopter.

Multi-focused microlens array optimization and light field imaging study based on Monte Carlo method

Plenoptic cameras are used for capturing flames in studies of high-temperature phenomena. However, simulations of plenoptic camera models can be used prior to the experiment improve experimental efficiency and reduce cost. In this work, microlens arrays, which are based on the established light field camera model, are optimized into a hexagonal structure with three types of microlenses. With this improved plenoptic camera model, light field imaging of static objects and flame are simulated using the calibrated parameters of the Raytrix camera (R29). The optimized models improve the image resolution, imaging screen utilization, and shooting range of depth of field.

Three dimensional measurement with an electrically tunable focused plenoptic camera

A liquid crystal microlens array (LCMLA) with an arrayed microhole pattern electrode based on nematic liquid crystal materials using a fabrication method including traditional UV-photolithography and wet etching is presented. Its focusing performance is measured under different voltage signals applied between the electrodes of the LCMLA. The experimental outcome shows that the focal length of the LCMLA can be tuned easily by only changing the root mean square value of the voltage signal applied. The developed LCMLA is further integrated with a main lens and an imaging sensor to construct a LCMLA-based focused plenoptic camera (LCFPC) prototype. The focused range of the LCFPC can be shifted electrically along the optical axis of the imaging system. The principles and methods for acquiring several key parameters such as three dimensional (3D) depth, positioning, and motion expression are given. The depth resolution is discussed in detail. Experiments are carried out to obtain the static and dynamic 3D information of objects chosen.

Arrayed optical switches based on integrated liquid-crystal microlens arrays driven and adjusted electrically

Based on our fundamental work on liquid-crystal microlens arrays (LCMAs) driven and adjusted electrically, a new kind of arrayed optical switch (AOS) constructed by a key LCMA with a special dual-mode function of converging and diverging incident beams according to electrical signals applied over the LCMA is proposed. The LCMA leading to the AOS is constructed by a microcavity with a couple of paralleled electrodes. The top electrodes of the LCMA are fabricated by depositing a layer of indium-tin-oxide (ITO) film and a layer of aluminum film, respectively. The aluminum film is continuously patterned into a circular microhole array, and the ITO film only acts as a planar conductor. Both functioning films are effectively separated by the SiO₂ wafer. Another SiO₂ wafer is also coated by an ITO film as a planar conductor. The measurements show that the developed AOS can effectively switch on or off beams propagating in arrayed fibers by applying proper voltage signals to them. Compared with other conventional AOSs, the developed AOS demonstrates several merits, including greater integration level, lower cost, and suitability to high-power propagating beams.

Dual-mode photosensitive arrays based on the integration of liquid crystal microlenses and CMOS sensors for obtaining the intensity images and wavefronts of objects

In this paper, we present a kind of dual-mode photosensitive arrays (DMPAs) constructed by hybrid integration a liquid crystal microlens array (LCMLA) driven electrically and a CMOS sensor array, which can be used to measure both the conventional intensity images and corresponding wavefronts of objects. We utilize liquid crystal materials to shape the microlens array with the electrically tunable focal length. Through switching the voltage signal on and off, the wavefronts and the intensity images can be acquired through the DMPAs, sequentially. We use white light to obtain the object's wavefronts for avoiding losing important wavefront information. We separate the white light wavefronts with a large number of spectral components and then experimentally compare them with single spectral wavefronts of typical red, green and blue lasers, respectively. Then we mix the red, green and blue wavefronts to a composite wavefront containing more optical information of the object.