Dual layer electrode liquid crystal lens for 2D/3D tunable endoscopy imaging system

Advances in Real-Time 3D Reconstruction for Medical Endoscopy

This contribution is intended to provide researchers with a comprehensive overview of the current state-of-the-art concerning real-time 3D reconstruction methods suitable for medical endoscopy. Over the past decade, there have been various technological advancements in computational power and an increased research effort in many computer vision fields such as autonomous driving, robotics, and unmanned aerial vehicles. Some of these advancements can also be adapted to the field of medical endoscopy while coping with challenges such as featureless surfaces, varying lighting conditions, and deformable structures. To provide a comprehensive overview, a logical division of monocular, binocular, trinocular, and multiocular methods is performed and also active and passive methods are distinguished. Within these categories, we consider both flexible and non-flexible endoscopes to cover the state-of-the-art as fully as possible. The relevant error metrics to compare the publications presented here are discussed, and the choice of when to choose a GPU rather than an FPGA for camera-based 3D reconstruction is debated. We elaborate on the good practice of using datasets and provide a direct comparison of the presented work. It is important to note that in addition to medical publications, publications evaluated on the KITTI and Middlebury datasets are also considered to include related methods that may be suited for medical 3D reconstruction.

Electrically addressed focal stack plenoptic camera based on a liquid-crystal microlens array for all-in-focus imaging

Focal stack cameras are capable of capturing a stack of images focused at different spatial distance, which can be further integrated to present a depth of field (DoF) effect beyond the range restriction of conventional camera's optics. To date, all of the proposed focal stack cameras are essentially 2D imaging architecture to shape 2D focal stacks with several selected focal lengths corresponding to limited objective distance range. In this paper, a new type of electrically addressed focal stack plenoptic camera (EAFSPC) based on a functional liquid-crystal microlens array for all-in-focus imaging is proposed. As a 3D focal stack camera, a sequence of raw light-field images can be rapidly manipulated through rapidly shaping a 3D focal stack. The electrically addressed focal stack strategy relies on the electric tuning of the focal length of the liquid-crystal microlens array by efficiently selecting or adjusting or jumping the signal voltage applied over the microlenses. An algorithm based on the Laplacian operator is utilized to composite the electrically addressed focal stack leading to raw light-field images with an extended DoF and then the all-in-focus refocused images. The proposed strategy does not require any macroscopic movement of the optical apparatus, so as to thoroughly avoid the registration of different image sequence. Experiments demonstrate that the DoF of the refocused images can be significantly extended into the entire tomography depth of the EAFSPC, which means a significant step for an all-in-focus imaging based on the electrically controlled 3D focal stack. Moreover, the proposed approach also establishes a high correlation between the voltage signal and the depth of in-focus plane, so as to construct a technical basis for a new type of 3D light-field imaging with an obvious intelligent feature.

Spatial separation of azimuthally and radially polarized beams from non-polarized light waves based on the electrically controlled birefringence effect

Based on the electrically controlled birefringence effect in liquid crystal materials, an effective method for spatially separating azimuthally and radially polarized beams from non-polarized incident light waves is proposed. The radially polarized beam was highly converged by using a microhole-patterned electrode and a planar photo-alignment layer to shape the initial liquid-crystal radial alignment and a gradient refractive index distribution with central axial symmetry after applying a voltage signal. Due to the intrinsic polarization sensitivity of nematic liquid-crystal materials, the shaped gradient refractive index only applies to extraordinary light waves, which then converge into a spot. Thus, the azimuthally and radially polarized beams are effectively separated. The proposed method demonstrates some advantages, such as low cost, miniaturization, and easy fabrication and integration with other functional devices. Thanks to the wideband electrically controlled birefringence of liquid-crystal materials, this light-wave manipulation to spatially separate azimuthally and radially polarized beams can also be performed over a wide wavelength range.

Liquid crystal microlenses based on binary surface alignment controlled by focused ion beam treatment

We report the formation of high optical power microlenses in the near-surface region of the liquid crystal layer. Such microlenses, possessing a very small focal length f at a rather large aperture A (f/A∼2), are able to focus the light into spots of a characteristic size comparable with the wavelength. Using numerical modeling, a specific patterning profile of a liquid crystal (LC) alignment surface by an ion beam is proposed to provide the aligning properties necessary for the formation of an array of microlenses with a focal length comparable to the LC cell thickness. The proposed microlens arrays are produced, and their optical properties are discussed.

Liquid Crystal Devices for Beam Steering Applications

Liquid crystals are valuable materials for applications in beam steering devices. In this paper, an overview of the use of liquid crystals in the field of adaptive optics specifically for beam steering and lensing devices is presented. The paper introduces the properties of liquid crystals that have made them useful in this field followed by a more detailed discussion of specific liquid crystal devices that act as switchable optical components of refractive and diffractive types. The relative advantages and disadvantages of the different devices and techniques are summarised.

Electrically Controlled Liquid Crystal Microlens Array Based on Single-Crystal Graphene Coupling Alignment for Plenoptic Imaging

As a unique electric-optics material, liquid crystals (LCs) have been used in various light-control applications. In LC-based light-control devices, the structural alignment of LC molecules is of great significance. Generally, additional alignment layers are required for LC lens and microlens, such as rubbed polyimide (PI) layers or photoalignment layers. In this paper, an electrically controlled liquid crystal microlens array (EC-LCMLA) based on single-crystal graphene (SCG) coupling alignment is proposed. A monolayer SCG with high conductivity and initial anchoring of LC molecules was used as a functional electrode, thus no additional alignment layer is needed, which effectively simplifies the basic structure and process flow of conventional LCMLA. Experiments indicated that a uniform LC alignment can be acquired in the EC-LCMLA cell by the SCG coupling alignment effect. The common optical properties including focal lengths and point spread function (PSF) were measured experimentally. Experiments demonstrated that the proposed EC-LCMLA has good focusing performance in the visible to near-infrared range. Moreover, the plenoptic imaging in Galilean mode was achieved by integrating the proposed EC-LCMLA with photodetectors. Digital refocusing was performed to obtain a rendering image of the target.

Resolution Improvement of Light Field Imaging via a Nematic Liquid Crystal Microlens with Added Multi-Walled Carbon Nanotubes

A relatively simple method to improve the image resolution of light field based on a liquid crystal (LC) microlens doped with multi-walled carbon nanotubes (MWCNTs) was developed and evaluated. As the nanoparticles were doped in LC, its electro-optical features could enhance, leading to a short response time compared to the pure LC microlens. With the maximum use of the proposed LC microlens, a method combining aperiodicity extraction and weighted average algorithm was adopted to realize the high-resolution light field imaging. The aperiodicity extraction method was proposed, which could effectively improve resolution of view angle image. For synthesizing the full resolution image at 0 Vrms and the extracted view angle image of light field imaging at 2.0 Vrms, the final high-resolution light field imaging could be obtained in a short time by weighted average algorithm. In this way, the common problem of low resolution in light field imaging could be solved. This proposed method was in good agreement with our experimental results. And it was also in line with the development of the trend of the smart imaging sensor combining algorithm with hardware.

Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Plenoptic cameras have received a wide range of research interest because it can record the 4D plenoptic function or radiance including the radiation power and ray direction. One of its important applications is digital refocusing, which can obtain 2D images focused at different depths. To achieve digital refocusing in a wide range, a large depth of field (DOF) is needed, but there are fundamental optical limitations to this. In this paper, we proposed a plenoptic camera with an extended DOF by integrating a main lens, a tunable multi-focus liquid-crystal microlens array (TMF-LCMLA), and a complementary metal oxide semiconductor (CMOS) sensor together. The TMF-LCMLA was fabricated by traditional photolithography and standard microelectronic techniques, and its optical characteristics including interference patterns, focal lengths, and point spread functions (PSFs) were experimentally analyzed. Experiments demonstrated that the proposed plenoptic camera has a wider range of digital refocusing compared to the plenoptic camera based on a conventional liquid-crystal microlens array (LCMLA) with only one corresponding focal length at a certain voltage, which is equivalent to the extension of DOF. In addition, it also has a 2D/3D switchable function, which is not available with conventional plenoptic cameras.

Fabrication of aspherical polymeric lenses using tunable ferrogel molds

The majority of optical lenses have spherical surface profiles because they are convenient to fabricate. Replacing spherical optics with aspheric optics leads to smaller size, lighter weight, and less complicated optical systems with a superior imaging quality. However, fabrication of aspheric lenses is expensive and time-consuming. Here, we introduce a straightforward and low-cost casting method to fabricate polymeric aspheric lenses. An elastomeric ferrogel was formed into an aspherical profile by using a designed magnetic field and then was used as a mold. Different types of aspherical profiles from parabola to hyperbola can be formed with this method by tuning the magnetic field. A home-built Shack-Hartmann sensor was employed to characterize the cast polymeric lenses. The effects of magnetic field intensity, gradient of the magnetic field, and magnetic susceptibility of the ferrogel on the lens profiles were investigated. This technique can be used for rapid-forming polymeric aspherical lenses with different sizes and shapes.

Fast-switching laterally virtual-moving microlens array for enhancing spatial resolution in light-field imaging system without degradation of angular sampling resolution

We present an electrically controllable fast-switching virtual-moving microlens array (MLA) consisting of a stacked structure of two polarization-dependent microlens arrays (PDMLAs) with optical orthogonality, where the position of the two stacked PDMLAs is shifted by half the elemental pitch in the diagonal direction. By controlling the polarization of the incident light without the physical movement of the molecules comprising the virtual-moving MLA, the periodic sampling position of the MLA can be switched fast using a polarization-switching layer based on a fast-switching liquid crystal cell. Using the fast-switching virtual-moving MLA, the spatial-resolution-enhanced light-field (LF) imaging system was demonstrated without a decrease in the angular sampling resolution as compared to the conventional LF imaging system comprising a passive MLA; two sets of elemental image arrays were captured quickly owing to the short switching time of the virtual-moving MLA of 450 μs. From the two captured sets of the elemental array image, four-times resolution-enhanced reconstruction images of the directional-view and depth-slice images could be obtained.

Recent Advances in Adaptive Liquid Crystal Lenses

An adaptive-focus lens is a device that is capable of tuning its focal length by means of an external stimulus. Numerous techniques for the demonstration of such devices have been reported thus far. Moving beyond traditional solutions, several new approaches have been proposed in recent years based on the use of liquid crystals, which can have a great impact in emerging applications. This work focuses on the recent advances in liquid crystal lenses with diameters larger than 1 mm. Recent demonstrations and their performance characteristics are reviewed, discussing the advantages and disadvantages of the reported technologies and identifying the challenges and future prospects in the active research field of adaptive-focus liquid crystal (LC) lenses.

An Electrically Tunable Liquid Crystal Lens with Coaxial Bi-Focus and Single Focus Switching Modes

A hole-patterned electrode liquid crystal (LC) lens with electrically switching coaxial bi-focus and single focus modes of tuning is demonstrated. The proposed LC lens mainly consists of a two LC layer (TLCL) structure with different thicknesses to achieve higher focusing power than the conventional hole-patterned electrode LC lens with the same aperture size. In the TLCL structure, one LC layer, doped with 3 wt % RM257, was photopolymerized to achieve a fixed focusing power of 18.5 Diopter. Due to polarization dependence in TLCL lenses, an additional 90° twisted nematic (TN) cell was used to change the incident polarization in order to switch lens functions on or off. As a result, a fixed focusing power of 18.5 Diopter was achieved when voltages of 10 Vrms were applied to the 90° TN cell. In addition, the switching capabilities of the bi-focus and single focus modes were achieved when operating individually with applied voltages from 20 Vrms to 90 Vrms, and higher voltages of over 90 Vrms, respectively. The maximum focusing power in the fabricated TLCL lens is 30.9 Diopter.