1
|
Shmilovich S, Oiknine Y, AbuLeil M, Abdulhalim I, Blumberg DG, Stern A. Dual-camera design for hyperspectral and panchromatic imaging, using a wedge shaped liquid crystal as a spectral multiplexer. Sci Rep 2020; 10:3455. [PMID: 32103101 PMCID: PMC7044303 DOI: 10.1038/s41598-020-60413-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Accepted: 02/04/2020] [Indexed: 02/08/2023] Open
Abstract
In this paper, we present a new hyperspectral compact camera which is designed to have high spatial and spectral resolutions, to be vibrations tolerant, and to achieve state-of-the-art high optical throughput values compared to existing nanosatellite hyperspectral imaging payloads with space heritage. These properties make it perfect for airborne and spaceborne remote sensing tasks. The camera has both hyperspectral and panchromatic imaging capabilities, achieved by employing a wedge-shaped liquid crystal cell together with computational image processing. The hyperspectral images are acquired through passive along-track spatial scanning when no voltage is applied to the cell, and the panchromatic images are quickly acquired in a single snapshot at a high signal-to-noise ratio when the cell is voltage driven.
Collapse
Affiliation(s)
- Shauli Shmilovich
- Department of Electrical and Computer Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel.
| | - Yaniv Oiknine
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel.
| | - Marwan AbuLeil
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel
| | - Ibrahim Abdulhalim
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel
- The Ilse Katz Institute for Nanoscale Science and Technology, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel
| | - Dan G Blumberg
- Department of Geography and Environmental Development, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel
| | - Adrian Stern
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, 8410501, Israel
| |
Collapse
|
2
|
Shmilovich S, Revah L, Oiknine Y, August I, Abdulhalim I, Stern A. Fast Method for Liquid Crystal Cell Spatial Variations Estimation Based on Modeling the Spectral Transmission. SENSORS (BASEL, SWITZERLAND) 2019; 19:E3874. [PMID: 31500369 PMCID: PMC6766903 DOI: 10.3390/s19183874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2019] [Revised: 09/05/2019] [Accepted: 09/05/2019] [Indexed: 11/23/2022]
Abstract
Liquid crystal phase retarders are utilized by photonic devices and imaging systems for various applications, such as tunable filtering, light modulation, polarimetric imaging, remote sensing and quality inspection. Due to technical difficulties in the manufacturing process, these phase retarders may suffer from spatial non-uniformities, which degrade the performance of the systems. These non-uniformities can be characterized by measuring the spectral transmission at each voltage and each point on the liquid crystal cell, which is time consuming. In this work, we present a new fast and simple method for measuring and computationally estimating the spatial variations of a liquid crystal phase retarder with planar alignment. The method is based on measuring the spectral transmission of the phase retarder at several spatial locations and estimating it at others. The experimental results show that the method provides an accurate spatial description of the phase retarder and can be employed for calibrating relevant systems.
Collapse
Affiliation(s)
- Shauli Shmilovich
- Department of Electrical and Computer Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel.
| | - Liat Revah
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel
| | - Yaniv Oiknine
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel
| | - Isaac August
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel
| | - Ibrahim Abdulhalim
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel
| | - Adrian Stern
- Department of Electro-Optics and Photonics Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva 8410501, Israel
| |
Collapse
|
3
|
Compressive Sensing Hyperspectral Imaging by Spectral Multiplexing with Liquid Crystal. J Imaging 2018; 5:jimaging5010003. [PMID: 34470182 PMCID: PMC8320867 DOI: 10.3390/jimaging5010003] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2018] [Revised: 11/25/2018] [Accepted: 12/18/2018] [Indexed: 11/16/2022] Open
Abstract
Hyperspectral (HS) imaging involves the sensing of a scene’s spectral properties, which are often redundant in nature. The redundancy of the information motivates our quest to implement Compressive Sensing (CS) theory for HS imaging. This article provides a review of the Compressive Sensing Miniature Ultra-Spectral Imaging (CS-MUSI) camera, its evolution, and its different applications. The CS-MUSI camera was designed within the CS framework and uses a liquid crystal (LC) phase retarder in order to modulate the spectral domain. The outstanding advantage of the CS-MUSI camera is that the entire HS image is captured from an order of magnitude fewer measurements of the sensor array, compared to conventional HS imaging methods.
Collapse
|
4
|
Wang X, Zhang Y, Ma X, Xu T, Arce GR. Compressive spectral imaging system based on liquid crystal tunable filter. OPTICS EXPRESS 2018; 26:25226-25243. [PMID: 30469627 DOI: 10.1364/oe.26.025226] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Accepted: 07/23/2018] [Indexed: 06/09/2023]
Abstract
Liquid crystal tunable filters (LCTF) are extensively used in hyperspectral imaging systems to successively acquire different spectral components of scenes by adjusting the center wavelength of the filter. However, the spectral and spatial resolutions of the imager are limited by the bandwidth of LCTF, and the pitch dimension of the detector, respectively. This paper applies compressive sensing principles to improve both of the spatial and spectral resolutions of the LCTF-based hyperspectral imaging system. An accurate transmission model of the LCTF is used to represent its bandpass filtering effects on the spectra. In addition, a random coded aperture placed behind the LCTF is used to modulate the spectral images in the spatial domain. Then, the three-dimensional encoded spectral images are projected onto a two-dimensional detector. Benefiting from the spectral-dependent transmission property of the LCTF, information of the entire spectrum is collected by a few snapshots using different center wavelengths of the LCTF. Super-resolution hyperspectral images can be reconstructed from a small set of compressive measurements by solving a convex optimization problem. Simulations and experiments show that the proposed method can effectively improve the spectral and spatial resolutions of traditional LCTF-based spectral imager without changing the structures of the LCTF and detector. Finally, a multi-channel spectral coding method is proposed to further increase the compression capacity of the system.
Collapse
|
5
|
Kang J, Li X, Liu Q. Hadamard transform-based calibration method for programmable optical filters based on digital micro-mirror device. OPTICS EXPRESS 2018; 26:19563-19573. [PMID: 30114127 DOI: 10.1364/oe.26.019563] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Digital micromirror device (DMD) based optical filters provide a new avenue for spectral modulation in many research applications. Traditional sequential channel scanning method for the calibration of such filters may suffer from compromised spectral tuning accuracy due to the signal to noise ratio restriction on the minimum pixel number of each channel. In this work, we propose a Hadamard transform based calibration method to address this issue. A DMD-based programmable optical filter is constructed and calibrated using both the sequential scanning method and the proposed method for the subsequent synthesis of three representative filters (i.e., the bandpass filter, Gaussian filter, and principal component based filter). The spectral tuning accuracy is evaluated by calculating the relative root mean square error (RMSE) between the synthesized transmittance spectrum and the target spectrum. The results show that when calibrated with the proposed method, the programmable filter exhibits a consistent decrease in the relative RMSE with an increasing channel number for all filters. The smallest relative RMSE values are therefore achieved when each channel contains only one DMD pixel. In contrast, for the sequential scanning method, the relative RMSE increases dramatically when each channel contains three or fewer DMD pixels. This suggests that our method is superior to the sequential scanning method in spectral tuning accuracy when the signal level is low.
Collapse
|
6
|
Oiknine Y, August I, Blumberg DG, Stern A. Compressive sensing resonator spectroscopy. OPTICS LETTERS 2017; 42:25-28. [PMID: 28059213 DOI: 10.1364/ol.42.000025] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We present a new fast compressive spectroscopic technique based on the resonance spectrometric mechanism. This technique uses an appropriately designed Fabry-Perot resonator and a photo-sensor in order to acquire different multiplexed spectral modulations, from which the original signal is reconstructed using a compressive sensing reconstruction algorithm. We present experimental results that demonstrate the acquisition of hundreds of spectral bands with a compression ratio of about 1:13.
Collapse
|
7
|
Farber V, Oiknine Y, August I, Stern A. Compressive 4D spectro-volumetric imaging. OPTICS LETTERS 2016; 41:5174-5177. [PMID: 27842086 DOI: 10.1364/ol.41.005174] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this Letter, we present a method for hyperspectral imaging of three-dimensional objects. A compressive sensing approach is utilized to remedy the acquisition effort required to capture the large amount of data. The spectral dimension is compressively sensed by means of a liquid crystal-based encoder, and the volumetric data are captured using a synthetic aperture integral imaging setup. We demonstrate reconstruction of spectro-volumetric tesseracts with hundreds of spectral bands at different depths without compromise of spatial resolution.
Collapse
|
8
|
Lim S, Kim M, Hahn J. All-optical depth coloring based on directional gating. OPTICS EXPRESS 2016; 24:21329-21339. [PMID: 27661875 DOI: 10.1364/oe.24.021329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In non-contacting depth extraction there are several issues, such as the accuracy and the measurement speed. In the issue of the measurement speed, the computation cost for image processing is significant. We present an all-optical depth extraction method by coloring objects according to their depth. Our system is operated fully optically and both encoding and decoding processes are optically performed. Therefore, all-optical depth coloring has a distinct advantage to extract the depth information in real time without any computation cost. We invent a directional gating method to extract the points from the object which are positioned at the same distance. Based on this method, the objects look painted by different colors according to the distance when the objects are observed through our system. In this paper, we demonstrate the all-optical depth coloring system and verify the feasibility of our method.
Collapse
|