Predicting Gilthead Sea Bream (Sparus aurata) Freshness by a Novel Combined Technique of 3D Imaging and SW-NIR Spectral Analysis

5D-fusion imaging for surface shape, polarization, and hyperspectral measurement

We present a five-dimensional (5D) imager that is capable of simultaneous detection of the surface shape, spectral characteristics, and polarization states of macroscopic objects, and straightforwardly fuse collected data into a 5D data set. A polarized module that uses a polarized camera obtains polarized images, while a 3D hyperspectral module reconstructs the target as a 3D point cloud using a fringe projection technique. A liquid-crystal tunable filter is placed in front of the camera of this module to acquire spectral data that can be assigned to corresponding point clouds directly. The two modules are coupled by a dual-path configuration that allows the polarization information to be merged into a comprehensive point cloud with spectral information, generating a new 5D model. The 5D imager shows excellent performance, with a spectral resolution of 10 nm, depth accuracy of 30.7 µm, and imaging time of 8 s. Sample experiments on a toy car with micro scratch defects and a yellowing plant are presented to demonstrate the capabilities of the 5D imager and its potential for use in a broad range of applications, such as industrial manufacturing inspection, plant health monitoring, and biological analysis.

4D dual-mode staring hyperspectral-depth imager for simultaneous spectral sensing and surface shape measurement

A 4D dual-mode staring hyperspectral-depth imager (DSHI), which acquire reflectance spectra, fluorescence spectra, and 3D structural information by combining a staring hyperspectral scanner and a binocular line laser stereo vision system, is introduced. A 405 nm laser line generated by a focal laser line generation module is used for both fluorescence excitation and binocular stereo matching of the irradiated line region. Under the configuration, the two kinds of hyperspectral data collected by the hyperspectral scanner can be merged into the corresponding points in the 3D model, forming a dual-mode 4D model. The DSHI shows excellent performance with spectral resolution of 3 nm, depth accuracy of 26.2 µm. Sample experiments on a fluorescent figurine, real and plastic sunflowers and a clam are presented to demonstrate system's with potential within a broad range of applications such as, e.g., digital documentation, plant phenotyping, and biological analysis.

High-precision four-dimensional hyperspectral imager integrating fluorescence spectral detection and 3D surface shape measurement

A four-dimensional hyperspectral imager (FDHI) that combines fluorescence spectral detection and 3D surface morphology measurement is proposed. The FDHI consists of a hyperspectral line-scanner, a line structured light stereo vision system, and a line laser. The line laser is used as both the excitation light for the fluorescence and the scanning light line for the 3D profiling. At each scanning step, the system collects both fluorescent and 3D spatial data of the irradiated line region, which are fused to 4D data points based on a line mapping relationship between the datasets, and by scanning across the measurement object, a complete 4D dataset is obtained. The FDHI shows excellent performance with spatial and spectral resolution of 26.0 µm and 3 nm, respectively. The reported FDHI system and its applications provide a solution for 4D detection and analysis of fluorescent objects in meters measurement range, with advantage of high integration as two imaging modules sharing a same laser source.

Field imaging system for hyperspectral data, 3D structural data and panchromatic image data measurement based on acousto-optic tunable filter

The hyperspectral data and 3D structural data are highly useful in botanical research. But, the two types of information are often acquired separately and hard to be combined. In this work, a novel dual-path configuration based on acousto-optical tunable filter (AOTF) is proposed to acquire an image, structural and hyperspectral information within one acquisition process by a combination of laser triangulation. Under the configuration, the hyperspectral data and the 3D structure can be matched to subpixel level after geometrical calibration. Finally, the obtainment of 3D hyperspectral information in field experiment verifies the feasibility of this imaging system.

A High Throughput Integrated Hyperspectral Imaging and 3D Measurement System

Hyperspectral and three-dimensional measurements can obtain the intrinsic physicochemical properties and external geometrical characteristics of objects, respectively. The combination of these two kinds of data can provide new insights into objects, which has gained attention in the fields of agricultural management, plant phenotyping, cultural heritage conservation, and food production. Currently, a variety of sensors are integrated into a system to collect spectral and morphological information in agriculture. However, previous experiments were usually performed with several commercial devices on a single platform. Inadequate registration and synchronization among instruments often resulted in mismatch between spectral and 3D information of the same target. In addition, using slit-based spectrometers and point-based 3D sensors extends the working hours in farms due to the narrow field of view (FOV). Therefore, we propose a high throughput prototype that combines stereo vision and grating dispersion to simultaneously acquire hyperspectral and 3D information. Furthermore, fiber-reformatting imaging spectrometry (FRIS) is adopted to acquire the hyperspectral images. Test experiments are conducted for the verification of the system accuracy, and vegetation measurements are carried out to demonstrate its feasibility. The proposed system is an improvement in multiple data acquisition and has the potential to improve plant phenotyping.