1
|
Zhao R, Cui Q, Wang Z, Gao L. Coded aperture snapshot hyperspectral light field tomography. OPTICS EXPRESS 2023; 31:37336-37347. [PMID: 38017865 DOI: 10.1364/oe.501844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 09/27/2023] [Indexed: 11/30/2023]
Abstract
Multidimensional imaging has emerged as a powerful technology capable of simultaneously acquiring spatial, spectral, and depth information about a scene. However, existing approaches often rely on mechanical scanning or multi-modal sensing configurations, leading to prolonged acquisition times and increased system complexity. Coded aperture snapshot spectral imaging (CASSI) has introduced compressed sensing to recover three-dimensional (3D) spatial-spectral datacubes from single snapshot two-dimensional (2D) measurements. Despite its advantages, the reconstruction problem remains severely underdetermined due to the high compression ratio, resulting in limited spatial and spectral reconstruction quality. To overcome this challenge, we developed a novel two-stage cascaded compressed sensing scheme called coded aperture snapshot hyperspectral light field tomography (CASH-LIFT). By appropriately distributing the computation load to each stage, this method utilizes the compressibility of natural scenes in multiple domains, reducing the ill-posed nature of datacube recovery and achieving enhanced spatial resolution, suppressed aliasing artifacts, and improved spectral fidelity. Additionally, leveraging the snapshot 3D imaging capability of LIFT, our approach efficiently records a five-dimensional (5D) plenoptic function in a single snapshot.
Collapse
|
2
|
Jia W, van Ruth S, Scollan N, Koidis A. Hyperspectral imaging (HSI) for meat quality evaluation across the supply chain: Current and future trends. Curr Res Food Sci 2022; 5:1017-1027. [PMID: 35755306 PMCID: PMC9218168 DOI: 10.1016/j.crfs.2022.05.016] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 05/25/2022] [Accepted: 05/29/2022] [Indexed: 12/01/2022] Open
Abstract
Meat products are particularly plagued by safety problems because of their complicated structure, various production processes and complex supply chains. Rapid and non-invasive analytical methods to evaluate meat quality have become a priority for the industry over the conventional chemical methods. To achieve rapid analysis of safety and quality parameters of meat products, hyperspectral imaging (HSI) is now widely applied in research studies for detecting the various components of different meat products, but its application in meat production and supply chain integrity as a quality control (QC) solution is still ambiguous. This review presents the fresh look at the current states of HSI research as both the scope and the applicability of the HSI in the meat quality evaluation expanded. The future application scenarios of HSI in the supply chain and the future development of HSI hardware and software are also discussed, by which HSI technology has the potential to enable large scale meat product testing. With a fully adapted for factory setting HSI, the inspection coverage can reliably identify the chemical properties of meat products. With the introduction of Food Industry 4.0, HSI advances can change the meat industry to become from reactive to predictive when facing meat safety issues. HSI has shown promising early signs in the non-destructive analysis of meat quality and safety. Hyperspectral imaging (HSI) is now widely applied in research studies for different meat products with the help of machine learning methods. With a fully adapted factory setting and robust machine learning of HSI, the inspection coverage can reach 100% of the target meat. HSI can change the meat industry to become from reactive to predictive when facing issues, this will be translated into fewer recalls, less meat fraud, and less waste.
Collapse
Affiliation(s)
- Wenyang Jia
- Institute for Global Food Security, School of Biological Sciences, Queen's University, 19 Chlorine Gardens, Belfast, BT9 5DL, Northern Ireland, UK
| | - Saskia van Ruth
- Food Quality and Design Group, Wageningen University and Research, P.O. Box 17, 6700 AA, Wageningen, the Netherlands
| | - Nigel Scollan
- Institute for Global Food Security, School of Biological Sciences, Queen's University, 19 Chlorine Gardens, Belfast, BT9 5DL, Northern Ireland, UK
| | - Anastasios Koidis
- Institute for Global Food Security, School of Biological Sciences, Queen's University, 19 Chlorine Gardens, Belfast, BT9 5DL, Northern Ireland, UK
| |
Collapse
|
3
|
Abstract
We present snapshot hyperspectral light field tomography (Hyper-LIFT), a highly efficient method in recording a 5D (x, y, spatial coordinates; θ, φ, angular coordinates; λ, wavelength) plenoptic function. Using a Dove prism array and a cylindrical lens array, we simultaneously acquire multi-angled 1D en face projections of the object like those in standard sparse-view computed tomography. We further disperse those projections and measure the spectra in parallel using a 2D image sensor. Within a single snapshot, the resultant system can capture a 5D data cube with 270 × 270 × 4 × 4 × 360 voxels. We demonstrated the performance of Hyper-LIFT in imaging spectral volumetric scenes.
Collapse
|
4
|
Liu G, Yang H, Zhao H, Zhang Y, Zhang S, Zhang X, Jin G. Combination of Structured Illumination Microscopy with Hyperspectral Imaging for Cell Analysis. Anal Chem 2021; 93:10056-10064. [PMID: 34251815 DOI: 10.1021/acs.analchem.1c00660] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Existing structured illumination microscopy (SIM) allows super-resolution live-cell imaging in few color channels that provide merely morphological information but cannot acquire the sample spectrum that is strongly relevant to the underlying physicochemical property. We develop hyperspectral SIM which enables high-speed spectral super-resolution imaging in SIM for the first time. Through optically mapping the three-dimensional (x, y, and λ) datacube of the sample to the detector plane, hyperspectral SIM allows snapshot spectral imaging of the SIM raw image, detecting the sample spectrum while retaining the high-speed and super-resolution characteristics of SIM. We demonstrate hyperspectral SIM imaging and reconstruct a datacube containing 31 super-resolution images of different wavelengths from only 9 exposures, achieving a 15 nm spectral resolution. We show time-lapse hyperspectral SIM imaging that achieves an imaging speed of 2.7 s per datacube-31-fold faster than the existing wavelength scanning strategy. To demonstrate the great prospects for further combining hyperspectral SIM with various spectral analysis methods, we also perform spectral unmixing of the hyperspectral SIM result while imaging the spectrally overlapped sample.
Collapse
Affiliation(s)
- Guoxuan Liu
- Department of Precision Instrument, State Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing 100084, China
| | - Huaidong Yang
- Department of Precision Instrument, State Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing 100084, China
| | - Hansen Zhao
- Department of Chemistry, Beijing Key Laboratory for Microanalytical Methods and Instrumentation, Tsinghua University, Beijing 100084, China
| | - Yinxin Zhang
- Key Laboratory of Opto-electronic Information Technology, Ministry of Education, TianJin University, Tianjin 300072, China
| | - Sichun Zhang
- Department of Chemistry, Beijing Key Laboratory for Microanalytical Methods and Instrumentation, Tsinghua University, Beijing 100084, China
| | - Xinrong Zhang
- Department of Chemistry, Beijing Key Laboratory for Microanalytical Methods and Instrumentation, Tsinghua University, Beijing 100084, China
| | - Guofan Jin
- Department of Precision Instrument, State Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing 100084, China
| |
Collapse
|
5
|
Dong X, Tong G, Song X, Xiao X, Yu Y. DMD-based hyperspectral microscopy with flexible multiline parallel scanning. MICROSYSTEMS & NANOENGINEERING 2021; 7:68. [PMID: 34567780 PMCID: PMC8433375 DOI: 10.1038/s41378-021-00299-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Revised: 07/21/2021] [Accepted: 07/23/2021] [Indexed: 05/16/2023]
Abstract
As one of the most common hyperspectral microscopy (HSM) techniques, line-scanning HSM is currently utilized in many fields. However, its scanning efficiency is still considered to be inadequate since many biological and chemical processes occur too rapidly to be captured. Accordingly, in this work, a digital micromirror device (DMD) based on microelectromechanical systems (MEMS) is utilized to demonstrate a flexible multiline scanning HSM system. To the best of our knowledge, this is the first line-scanning HSM system in which the number of scanning lines N can be tuned by simply changing the DMD's parallel scanning units according to diverse applications. This brilliant strategy of effortless adjustability relies only on on-chip scanning methods and totally exploits the benefits of parallelization, aiming to achieve nearly an N-time improvement in the detection efficiency and an N-time decrease in the scanning time and data volume compared with the single-line method under the same operating conditions. To validate this, we selected a few samples of different spectral wavebands to perform reflection imaging, transmission imaging, and fluorescence imaging with varying numbers of scanning lines. The results show the great potential of our DMD-based HSM system for the rapid development of cellular biology, material analysis, and so on. In addition, its on-chip scanning process eliminates the inherent microscopic architecture, making the whole system compact, lightweight, portable, and not subject to site constraints.
Collapse
Affiliation(s)
- Xue Dong
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Geng Tong
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Xuankun Song
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Xingchen Xiao
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| | - Yiting Yu
- Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, 518057 China
- Ningbo Institute of Northwestern Polytechnical University, Ningbo, 315103 China
- Key Laboratory of Micro/Nano Systems for Aerospace (Ministry of Education), Northwestern Polytechnical University, Xi’an, 710072 China
- Shaanxi Province Key Laboratory of Micro and Nano Electro-Mechanical Systems, Northwestern Polytechnical University, Xi’an, 710072 China
| |
Collapse
|
6
|
Kubo T, Temma K, Smith NI, Lu K, Matsuda T, Nagai T, Fujita K. Hyperspectral two-photon excitation microscopy using visible wavelength. OPTICS LETTERS 2021; 46:37-40. [PMID: 33362007 DOI: 10.1364/ol.413526] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Accepted: 11/08/2020] [Indexed: 05/28/2023]
Abstract
We demonstrate hyperspectral imaging by visible-wavelength two-photon excitation microscopy using line illumination and slit-confocal detection. A femtosecond pulsed laser light at 530 nm was used for the simultaneous excitation of fluorescent proteins with different emission wavelengths. The use of line illumination enabled efficient detection of hyperspectral images and achieved simultaneous detection of three fluorescence spectra in the observation of living HeLa cells with an exposure time of 1 ms per line, which is equivalent to about 2 µs per pixel in point scanning, with 160 data points per spectrum. On combining linear spectral unmixing techniques, localization of fluorescent probes in the cells was achieved. A theoretical investigation of the imaging property revealed high-depth discrimination property attained through the combination of nonlinear excitation and slit detection.
Collapse
|
7
|
Cui Q, Park J, Iyer RR, Žurauskas M, Boppart SA, Smith RT, Gao L. Development of a fast calibration method for image mapping spectrometry. APPLIED OPTICS 2020; 59:6062-6069. [PMID: 32672750 PMCID: PMC7418183 DOI: 10.1364/ao.395988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
An image mapping spectrometer (IMS) is a snapshot hyperspectral imager that simultaneously captures both the spatial (x, y) and spectral (λ) information of incoming light. The IMS maps a three-dimensional (3D) datacube (x, y, λ) to a two-dimensional (2D) detector array (x, y) for parallel measurement. To reconstruct the original 3D datacube, one must construct a lookup table that connects voxels in the datacube and pixels in the raw image. Previous calibration methods suffer from either low speed or poor image quality. We herein present a slit-scan calibration method that can significantly reduce the calibration time while maintaining high accuracy. Moreover, we quantitatively analyzed the major artifact in the IMS, the striped image, and developed three numerical methods to correct for it.
Collapse
Affiliation(s)
- Qi Cui
- Department of Bioengineering, University of California Los Angeles, Los Angeles, California 90095, USA
| | - Jongchan Park
- Department of Bioengineering, University of California Los Angeles, Los Angeles, California 90095, USA
| | - Rishyashring R. Iyer
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
| | - Mantas Žurauskas
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
| | - R. Theodore Smith
- Department of Ophthalmology, New York Eye and Ear Infirmary of Mount Sinai, New York, New York 10003, USA
| | - Liang Gao
- Department of Bioengineering, University of California Los Angeles, Los Angeles, California 90095, USA
- Corresponding author:
| |
Collapse
|
8
|
Gasser C, González‐Cabrera M, Ayora‐Cañada MJ, Domínguez‐Vidal A, Lendl B. Comparing mapping and direct hyperspectral imaging in stand-off Raman spectroscopy for remote material identification. JOURNAL OF RAMAN SPECTROSCOPY : JRS 2019; 50:1034-1043. [PMID: 31598032 PMCID: PMC6774338 DOI: 10.1002/jrs.5607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2018] [Revised: 03/07/2019] [Accepted: 03/08/2019] [Indexed: 06/10/2023]
Abstract
Stand-off Raman spectroscopy offers a highly selective technique to probe unknown substances from a safe distance. Often, it is necessary to scan large areas of interest. This can be done by pointwise imaging (PI), that is, spectra are sequentially acquired from an array of points over the region of interest (point-by-point mapping). Alternatively, in this paper a direct hyperspectral Raman imager is presented, where a defocused laser beam illuminates a wide area of the sample and the Raman scattered light is collected from the whole field of view (FOV) at once as a spectral snapshot filtered by a liquid crystal tunable filter to select a specific Raman shift. Both techniques are compared in terms of achievable FOV, spectral resolution, signal-to-noise performance, and time consumption during a measurement at stand-off distance of 15 m. The HSRI showed superior spectral resolution and signal-to-noise ratio, while more than doubling the FOV of the PI at laser power densities reduced by a factor of 277 at the target. Further, the output hyperspectral image data cube can be processed with state of the art chemometric algorithms like vertex component analysis in order to get a simple deterministic false color image showing the chemical composition of the target. This is shown for an artificial polymer sample, measured at a distance of 15 m.
Collapse
Affiliation(s)
- Christoph Gasser
- Institute of Chemical Technologies and AnalyticsTU WienViennaAustria
| | | | | | | | - Bernhard Lendl
- Institute of Chemical Technologies and AnalyticsTU WienViennaAustria
| |
Collapse
|
9
|
Asfour H, Guan S, Muselimyan N, Swift L, Loew M, Sarvazyan N. Optimization of wavelength selection for multispectral image acquisition: a case study of atrial ablation lesions. BIOMEDICAL OPTICS EXPRESS 2018; 9:2189-2204. [PMID: 29760980 PMCID: PMC5946781 DOI: 10.1364/boe.9.002189] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 03/08/2018] [Accepted: 04/09/2018] [Indexed: 05/17/2023]
Abstract
In vivo autofluorescence hyperspectral imaging of moving objects can be challenging due to motion artifacts and to the limited amount of acquired photons. To address both limitations, we selectively reduced the number of spectral bands while maintaining accurate target identification. Several downsampling approaches were applied to data obtained from the atrial tissue of adult pigs with sites of radiofrequency ablation lesions. Standard image qualifiers such as the mean square error, the peak signal-to-noise ratio, the structural similarity index map, and an accuracy index of lesion component images were used to quantify the effects of spectral binning, an increased spectral distance between individual bands, as well as random combinations of spectral bands. Results point to several quantitative strategies for deriving combinations of a small number of spectral bands that can successfully detect target tissue. Insights from our studies can be applied to a wide range of applications.
Collapse
Affiliation(s)
- Huda Asfour
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Shuyue Guan
- Department of Biomedical Engineering, The George Washington University, 800 22nd Street NW, Washington, DC 20052, USA
| | - Narine Muselimyan
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Luther Swift
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Murray Loew
- Department of Biomedical Engineering, The George Washington University, 800 22nd Street NW, Washington, DC 20052, USA
| | - Narine Sarvazyan
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| |
Collapse
|