Application of hyperspectral technology in detection of agricultural products and food: A Review

Critical evaluation of hyperspectral imaging technology for detection and quantification of microplastics in soil

In this study, we critically evaluated the performance of an emerging technology, hyperspectral imaging (HSI), for detecting microplastics (MPs) in soil. We examined the technology's robustness against varying environmental conditions in five groups of experiments. Our findings show that near-infrared (NIR) hyperspectral imaging (HSI) effectively detects microplastics (MPs) in soil, though detection efficacy is influenced by factors such as MP concentration, color, and soil moisture. We found a generally linear relationship between the levels of MPs in various soils and their spectral responses in the NIR HSI imaging spectrum. However, effectiveness is reduced for certain MPs, like polyethylene, in kaolinite clay. Furthermore, we showed that soil moisture considerably influenced the detection of MPs, leading to nonlinearities in quantification and adding complexities to spectral analysis. The varied responses of MPs of different sizes and colors to NIR HSI present further challenges in detection and quantification. The research suggests pre-grouping of MPs based on size before analysis and proposes further investigation into the interaction between soil moisture and MP detectability to enhance HSI's application in MP monitoring and quantification. To our knowledge, this study is the first to comprehensively evaluate this technology for detecting and quantifying microplastics.

Exploring the potential of hyperspectral imaging for microbial assessment of meat: A review

Food safety is always of paramount importance globally due to the devasting social and economic effects of foodborne disease outbreaks. There is a high consumption rate of meat worldwide, making it an essential protein source in the human diet, hence its microbial safety is of great importance. The food industry stakeholders are always in search of methods that ensure safe food whilst maintaining food quality and excellent sensory attributes. Currently, there are several methods used in microbial food analysis, however, these methods are often time-consuming and do not allow real-time analysis. Considering the recent technological breakthroughs in artificial intelligence and machine learning, it raises the question of whether these advancements could be leveraged within the meat industry to improve turnaround time for microbial assessments. Hyperspectral imaging (HSI) is a highly prospective technology worth exploring for microbial analysis. The rapid, non-destructive method has the potential to be integrated into food production systems and allows foodborne pathogen detection in food samples, thus saving time. Although there has been a substantial increase in research on the utilisation of HSI in food applications over the past years, its use in the microbial assessment of meat is not yet optimal. This review aims to provide a basic understanding of the visible-near infrared HSI system, recent applications in the microbial assessment of meat products, challenges, and possible future applications.

Unleashing the Potential of Digitalization in the Agri-Food Chain for Integrated Food Systems

Digitalization transforms many industries, especially manufacturing, with new concepts such as Industry 4.0 and the Industrial Internet of Things. However, information technology also has the potential to integrate and connect the various steps in the supply chain. For the food industry, the situation is ambivalent: It has a high level of automatization, but the potential of digitalization is so far not used today. In this review, we discuss current trends in information technology that have the potential to transform the food industry into an integrated food system. We show how this digital transformation can integrate various activities within the agri-food chain and support the idea of integrated food systems. Based on a future-use case, we derive the potential of digitalization to tackle future challenges in the food industry and present a research agenda.

Rapid determination of starch and alcohol contents in fermented grains by hyperspectral imaging combined with data fusion techniques

Starch and alcohol serve as pivotal indicators in assessing the quality of lees fermentation. In this paper, two hyperspectral imaging (HSI) techniques (visible-near-infrared (Vis-NIR) and NIR) were utilized to acquire separate HSI data, which were then fused and analyzed toforecast the starch and alcohol contents during the fermentation of lees. Five preprocessing methods were first used to preprocess the Vis-NIR, NIR, and the fused Vis-NIR and NIR data, after which partial least squares regression models were established to determine the best preprocessing method. Following, competitive adaptive reweighted sampling, successive projection algorithm, and principal component analysis algorithms were used to extract the characteristic wavelengths to accurately predict the starch and alcohol levels. Finally, support vector machine (SVM)-AdaBoost and XGBoost models were built based on the low-level fusion (LLF) and intermediate-level fusion (ILF) of single Vis-NIR and NIR as well as the fused data. The results showed that the SVM-AdaBoost model built using the LLF data afterpreprocessing by standard normalized variable was most accurate for predicting the starch content, with anR P 2 $\ R_P^2$ of 0.9976 and a root mean square error of prediction (RMSEP) of 0.0992. The XGBoost model built using ILF data was most accurate for predicting the alcohol content, with anR P 2 $R_P^2$ of 0.9969 and an RMSEP of 0.0605. In conclusion, the analysis of fused data from distinct HSI technologies facilitates rapid and precise determination of the starch and alcohol contents in fermented grains.

Intelligent Biosensors Promise Smarter Solutions in Food Safety 4.0

Food safety is closely related to human health. However, the regulation and testing processes for food safety are intricate and resource-intensive. Therefore, it is necessary to address food safety risks using a combination of deep learning, the Internet of Things, smartphones, quick response codes, smart packaging, and other smart technologies. Intelligent designs that combine digital systems and advanced functionalities with biosensors hold great promise for revolutionizing current food safety practices. This review introduces the concept of Food Safety 4.0, and discusses the impact of intelligent biosensors, which offer attractive smarter solutions, including real-time monitoring, predictive analytics, enhanced traceability, and consumer empowerment, helping improve risk management and ensure the highest standards of food safety.

Discrimination of Maturity Stages of Cabernet Sauvignon Wine Grapes Using Visible-Near-Infrared Spectroscopy

Grape quality and ripeness play a crucial role in producing exceptional wines with high-value characteristics, which requires an effective assessment of grape ripeness. The primary purpose of this research is to explore the possible application of visible-near-infrared spectral (Vis-NIR) technology for classifying the maturity stages of wine grapes based on quality indicators. The reflection spectra of Cabernet Sauvignon grapes were recorded using a spectrometer in the spectral range of 400 nm to 1029 nm. After measuring the soluble solids content (SSC), total acids (TA), total phenols (TP), and tannins (TN), the grape samples were categorized into five maturity stages using a spectral clustering method. A traditional supervised classification method, a support vector machine (SVM), and two deep learning techniques, namely stacked autoencoders (SAE) and one-dimensional convolutional neural networks (1D-CNN), were employed to construct a discriminant model and investigate the association linking grape maturity stages and the spectral responses. The spectral data went through three commonly used preprocessing methods, and feature wavelengths were extracted using a competitive adaptive reweighting algorithm (CARS). The spectral data model preprocessed via multiplicative scattering correction (MSC) outperformed the other two preprocessing methods. After preprocessing, a comparison was made between the discriminant models established with full and effective spectral data. It was observed that the SAE model, utilizing the feature spectrum, demonstrated superior overall performance. The classification accuracies of the calibration and prediction sets were 100% and 94%, respectively. This study showcased the dependability of combining Vis-NIR spectroscopy with deep learning methods for rapidly and accurately distinguishing the ripeness stage of grapes. It has significant implications for future applications in wine production and the development of optoelectronic instruments tailored to the specific needs of the winemaking industry.

Rapid and Non-Destructive Estimation of Moisture Content in Caragana Korshinskii Pellet Feed Using Hyperspectral Imaging

Moisture content is an important parameter for estimating the quality of pellet feed, which is vital in nutrition, storage, and taste. The ranges of moisture content serve as an index for factors such as safe storage and nutrition stability. A rapid and non-destructive model for the measurement of moisture content in pellet feed was developed. To achieve this, 144 samples of Caragana korshinskii pellet feed from various regions in Inner Mongolia Autonomous Region underwent separate moisture content control, measurement using standard methods, and captured their images using a hyperspectral imaging (HSI) system in the spectral range of 935.5-2539 nm. The Monte Carlo cross validation (MCCV) was used to eliminate abnormal sample data from the spectral data for better model accuracy, and a global model of moisture content was built by using partial least squares regression (PLSR) with seven preprocessing techniques and two spectral feature extraction techniques. The results showed that the regression model developed by PLSR based on second derivative (SD) and competitive adaptive reweighted sampling (CARS) resulted in better performance for moisture content. The model showed predictive abilities for moisture content with a coefficient of determination of 0.9075 and a root mean square error (RMSE) of 0.4828 for the training set; and a coefficient of determination of 0.907 and a root mean square error (RMSE) of 0.5267 for the test set; and a relative prediction error of 3.3 and the standard error of 0.307.

Catadioptric sensor concept with interlaced beam paths for imaging and pinpoint spectroscopy

This paper presents the concept, optical design, and implementation of a catadioptric sensor for simultaneous imaging of a scene and pinpoint spectroscopy of a selected position, with object distances ranging from tens of centimeters to infinity and from narrow to wide adjustable viewing angles. The use of reflective imaging elements allows the implementation of folded and interlaced beam paths for spectroscopy and image acquisition, which enables a compact setup with a footprint of approximately 90m m×80m m. Although the wavelength range addressed extends far beyond the visible spectrum and reaches into the near infrared (∼400n m to 1000 nm), only three spherical surfaces are needed to project the intermediate image onto the image detector. The anamorphic imaging introduced by the folded beam path with different magnification factors in the horizontal and vertical directions as well as distortion can be compensated by software-based image processing. The area of the scene to be spectrally analyzed is imaged onto the input of an integrated miniature spectrometer. The imaging properties and spectroscopic characteristics are demonstrated in scenarios close to potential applications such as product sorting and fruit quality control.

Quality Assessment and Ripeness Prediction of Table Grapes Using Visible-Near-Infrared Spectroscopy

Ripeness significantly affects the commercial values and sales of fruits. In order to monitor the change of grapes' quality parameters during ripening, a rapid and nondestructive method of visible-near-infrared spectral (Vis-NIR) technology was utilized in this study. Firstly, the physicochemical properties of grapes at four different ripening stages were explored. Data evidenced increasing color in redness/greenness (a*) and Chroma (C*) and soluble solids (SSC) content and decreasing values in color of lightness (L*), yellowness/blueness (b*) and Hue angle (h*), hardness, and total acid (TA) content as ripening advanced. Based on these results, spectral prediction models for SSC and TA in grapes were established. Effective wavelengths were selected by the competitive adaptive weighting algorithm (CARS), and six common preprocessing methods were applied to pretreat the spectra data. Partial least squares regression (PLSR) was applied to establish models on the basis of effective wavelengths and full spectra. The predictive PLSR models built with full spectra data and 1st derivative preprocessing provided the best values of performance parameters for both SSC and TA. For SSC, the model showed the coefficients of determination for calibration (RCal2) and prediction (RPre2) set of 0.97 and 0.93, respectively, the root mean square error for calibration set (RMSEC) and prediction set (RMSEP) of 0.62 and 1.27, respectively; and the RPD equal to 4.09. As for TA, the optimum values of RCal2, RPre2, RMSEC, RMSEP and RPD were 0.97, 0.94, 0.88, 1.96 and 4.55, respectively. The results indicated that Vis-NIR spectroscopy is an effective tool for the rapid and non-destructive detection of SSC and TA in grapes.

Evaluation of Soybean Wildfire Prediction via Hyperspectral Imaging

Plant diseases that affect crop production and productivity harm both crop quality and quantity. To minimize loss due to disease, early detection is a prerequisite. Recently, different technologies have been developed for plant disease detection. Hyperspectral imaging (HSI) is a nondestructive method for the early detection of crop disease and is based on the spatial and spectral information of images. Regarding plant disease detection, HSI can predict disease-induced biochemical and physical changes in plants. Bacterial infections, such as Pseudomonas syringae pv. tabaci, are among the most common plant diseases in areas of soybean cultivation, and have been implicated in considerably reducing soybean yield. Thus, in this study, we used a new method based on HSI analysis for the early detection of this disease. We performed the leaf spectral reflectance of soybean with the effect of infected bacterial wildfire during the early growth stage. This study aimed to classify the accuracy of the early detection of bacterial wildfire in soybean leaves. Two varieties of soybean were used for the experiment, Cheongja 3-ho and Daechan, as control (noninoculated) and treatment (bacterial wildfire), respectively. Bacterial inoculation was performed 18 days after planting, and the imagery data were collected 24 h following bacterial inoculation. The leaf reflectance signature revealed a significant difference between the diseased and healthy leaves in the green and near-infrared regions. The two-way analysis of variance analysis results obtained using the Python package algorithm revealed that the disease incidence of the two soybean varieties, Daechan and Cheongja 3-ho, could be classified on the second and third day following inoculation, with accuracy values of 97.19% and 95.69%, respectively, thus proving his to be a useful technique for the early detection of the disease. Therefore, creating a wide range of research platforms for the early detection of various diseases using a nondestructive method such HSI is feasible.

Deep Learning in Medical Hyperspectral Images: A Review

With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

5D-fusion imaging for surface shape, polarization, and hyperspectral measurement

We present a five-dimensional (5D) imager that is capable of simultaneous detection of the surface shape, spectral characteristics, and polarization states of macroscopic objects, and straightforwardly fuse collected data into a 5D data set. A polarized module that uses a polarized camera obtains polarized images, while a 3D hyperspectral module reconstructs the target as a 3D point cloud using a fringe projection technique. A liquid-crystal tunable filter is placed in front of the camera of this module to acquire spectral data that can be assigned to corresponding point clouds directly. The two modules are coupled by a dual-path configuration that allows the polarization information to be merged into a comprehensive point cloud with spectral information, generating a new 5D model. The 5D imager shows excellent performance, with a spectral resolution of 10 nm, depth accuracy of 30.7 µm, and imaging time of 8 s. Sample experiments on a toy car with micro scratch defects and a yellowing plant are presented to demonstrate the capabilities of the 5D imager and its potential for use in a broad range of applications, such as industrial manufacturing inspection, plant health monitoring, and biological analysis.

Intelligent detection of hard seeds of snap bean based on hyperspectral imaging

As a common problem in snap beans, hard seed has seriously affected the large-scale industrial planting and yield of snap bean. To realize accurate, quick and non-destructive identifying the hard seeds of snap bean is of great significance to avoiding the effects of hard seeds on germination and growth. This research was based on hyperspectral imaging (HSI) to achieve accurate detection of hard seeds of snap bean. This study obtained the characteristic spectra from the hyperspectral image of a single seed, and then combined the synthetic minority over-sampling technique (SMOTE) and Tomek links to balance the numbers of hard and non-hard seed samples. The characteristic wavelengths were extracted from the average spectrum. Then the average spectrum was processed by first derivative (1D). After that, the characteristic wavelengths could be extracted using successive projections algorithm (SPA). Finally, a radial basis function-support vector machine (RBF-SVM) model was established to realize the intelligent detection of hard seeds, and the detection accuracy rate reached 89.32%. The research results showed that HSI technology could achieved accurate, fast and non-destructive testing of the hard seeds of snap bean, which is of great significance to the large-scale and standardized planting of snap bean and increase the yield per unit area.

High-precision four-dimensional hyperspectral imager integrating fluorescence spectral detection and 3D surface shape measurement

A four-dimensional hyperspectral imager (FDHI) that combines fluorescence spectral detection and 3D surface morphology measurement is proposed. The FDHI consists of a hyperspectral line-scanner, a line structured light stereo vision system, and a line laser. The line laser is used as both the excitation light for the fluorescence and the scanning light line for the 3D profiling. At each scanning step, the system collects both fluorescent and 3D spatial data of the irradiated line region, which are fused to 4D data points based on a line mapping relationship between the datasets, and by scanning across the measurement object, a complete 4D dataset is obtained. The FDHI shows excellent performance with spatial and spectral resolution of 26.0 µm and 3 nm, respectively. The reported FDHI system and its applications provide a solution for 4D detection and analysis of fluorescent objects in meters measurement range, with advantage of high integration as two imaging modules sharing a same laser source.

A feasibility study for rapid evaluation of emulsion oxidation using synchronous fluorescence spectroscopy coupled with chemometrics

A rapid method based on three-dimensional synchronous fluorescence spectroscopy was developed for emulsion oxidation evaluation. This method was selected because of its high sensitivity to dissolved organic matter typically occurring in the lipid oxidation. Spectral signal and chemical reference measurements were recorded for each emulsion sample as input and output data for the model construction. Characteristic values were extracted from the spectral data by the application of parallel factor (PARAFAC) analysis. Partial least squares regression (PLSR) was then used to construct a regression model for the rapid determination of emulsion oxidation. The correlation coefficient of the calibration and prediction sets were used as the performance parameters for the PLSR models as follows: R = 0.929, 0.973 for emulsion samples stored at 25℃; R = 0.897, 0.903 for emulsion samples stored at 70℃. The overall results demonstrated that the fluorescence spectroscopy, coupled with PARAFAC and PLSR algorithms, could be successfully used as a rapid method for the emulsion oxidation evaluation.

Polysaccharide determination and habitat classification for fresh Dendrobiums with hyperspectral imagery and modified RBFNN

This research aimed to study the visual and nondestructive detection of mannose (MN) and Dendrobium polysaccharides (DP) in Dendrobiums by using hyperspectral imaging technology. In order to determine the MN and DP concentrations nondestructively, we built radial basis function neural network (RBFNN) models based on NIR spectra (874-1734 nm) with a novel chemometric method to calculate the radial bases. And excellent results with the R _P ² coefficients of 0.906 and 0.913 were obtained by the MN and DP detection models, respectively. In order to simplify the detection models based on full-range spectra, we designed an innovative genetic algorithm-successive projections algorithm (GA-SPA) strategy to extract the feature bands efficiently in two stages. Based on the feature bands selected by GA-SPA, we established the simplified detection models with the same high performance as those based on full-range spectra. By importing the feature bands of every pixel in the hyperspectral image into the simplified detection models, we successfully generated the distribution maps of MN and DP. Moreover, we also built an RBFNN classifier to categorize the habitats of Dendrobium. And the total classification accuracy reached 0.887. This research makes progress in Dendrobium quality evaluation and spectral detection technology.

Nondestructive Testing and Visualization of Catechin Content in Black Tea Fermentation Using Hyperspectral Imaging

Catechin is a major reactive substance involved in black tea fermentation. It has a determinant effect on the final quality and taste of made teas. In this study, we applied hyperspectral technology with the chemometrics method and used different pretreatment and variable filtering algorithms to reduce noise interference. After reduction of the spectral data dimensions by principal component analysis (PCA), an optimal prediction model for catechin content was constructed, followed by visual analysis of catechin content when fermenting leaves for different periods of time. The results showed that zero mean normalization (Z-score), multiplicative scatter correction (MSC), and standard normal variate (SNV) can effectively improve model accuracy; while the shuffled frog leaping algorithm (SFLA), the variable combination population analysis genetic algorithm (VCPA-GA), and variable combination population analysis iteratively retaining informative variables (VCPA-IRIV) can significantly reduce spectral data and enhance the calculation speed of the model. We found that nonlinear models performed better than linear ones. The prediction accuracy for the total amount of catechins and for epicatechin gallate (ECG) of the extreme learning machine (ELM), based on optimal variables, reached 0.989 and 0.994, respectively, and the prediction accuracy for EGC, C, EC, and EGCG of the content support vector regression (SVR) models reached 0.972, 0.993, 0.990, and 0.994, respectively. The optimal model offers accurate prediction, and visual analysis can determine the distribution of the catechin content when fermenting leaves for different fermentation periods. The findings provide significant reference material for intelligent digital assessment of black tea during processing.

Water and nitrogen in-situ imaging detection in live corn leaves using near-infrared camera and interference filter

BACKGROUND

Realizing imaging detection of water and nitrogen content in different regions of plant leaves in-site and real-time can provide an efficient new technology for determining crop drought resistance and nutrient regulation mechanisms, or for use in precision agriculture. Near-infrared imaging is the preferred technology for in-situ real-time detection owing to its non-destructive nature; moreover, it provides rich information. However, the use of hyperspectral imaging technology is limited as it is difficult to use it in field because of its high weight and power.

RESULTS

We developed a smart imaging device using a near-infrared camera and an interference filter; it has a low weight, requires low power, and has a multi-wavelength resolution. The characteristic wavelengths of the filter that realize leaf moisture measurement are 1150 and 1400 nm, respectively, the characteristic wavelength of the filter that realizes nitrogen measurement is 1500 nm, and all filter bandwidths are 25 nm. The prediction result of the average leaf water content model obtained with the device was R² = 0.930, RMSE = 1.030%; the prediction result of the average nitrogen content model was R² = 0.750, RMSE = 0.263 g.

CONCLUSIONS

Using the average water and nitrogen content model, an image of distribution of water and nitrogen in different areas of corn leaf was obtained, and its distribution characteristics were consistent with the actual leaf conditions. The experimental materials used in this research were fresh leaves in the field, and the test was completed indoors. Further verification of applying the device and model to the field is underway.

Confocal hyperspectral microscopic imager for the detection and classification of individual microalgae

We propose a confocal hyperspectral microscopic imager (CHMI) that can measure both transmission and fluorescent spectra of individual microalgae, as well as obtain classical transmission images and corresponding fluorescent hyperspectral images with a high signal-to-noise ratio. Thus, the system can realize precise identification, classification, and location of microalgae in a free or symbiosis state. The CHMI works in a staring state, with two imaging modes, a confocal fluorescence hyperspectral imaging (CFHI) mode and a transmission hyperspectral imaging (THI) mode. The imaging modes share the main light path, and thus obtained fluorescence and transmission hyperspectral images have point-to-point correspondence. In the CFHI mode, a confocal technology to eliminate image blurring caused by interference of axial points is included. The CHMI has excellent performance with spectral and spatial resolutions of 3 nm and 2 µm, respectively (using a 10× microscope objective magnification). To demonstrate the capacity and versatility of the CHMI, we report on demonstration experiments on four species of microalgae in free form as well as three species of jellyfish with symbiotic microalgae. In the microalgae species classification experiments, transmission and fluorescence spectra collected by the CHMI were preprocessed using principal component analysis (PCA), and a support vector machine (SVM) model or deep learning was then used for classification. The accuracy of the SVM model and deep learning method to distinguish one species of individual microalgae from another was found to be 96.25% and 98.34%, respectively. Also, the ability of the CHMI to analyze the concentration, species, and distribution differences of symbiotic microalgae in symbionts is furthermore demonstrated.

4D surface shape measurement system with high spectral resolution and great depth accuracy

A 4D surface shape measurement system that combines spectral detection and 3D surface morphology measurements is proposed, which can realize high spectral resolution and great depth accuracy (HSDA system). A starring hyperspectral imager system based on a grating generates precise spectral data, while a structured light stereovision system reconstructs target morphology as a 3D point cloud. The systems are coupled using a double light path module, which realize point-to-point correspondence of the systems' image planes. The spectral and 3D coordinate data are fused and transformed into a 4D data set. The HSDA system has excellent performance with a spectral resolution of 3 nm and depth accuracy of 27.5 μm. A range of 4D imaging experiments are presented to demonstrate the capabilities and versatility of the HSDA system, which show that it can be used in broad range of application areas, such as fluorescence detection, face anti-spoofing, physical health state assessment and green plant growth condition monitoring.