Near Infrared Hyperspectral Imaging for White Maize Classification According to Grading Regulations

Digital techniques and trends for seed phenotyping using optical sensors

BACKGROUND

The breeding of high-quality, high-yield, and disease-resistant varieties is closely related to food security. The investigation of breeding results relies on the evaluation of seed phenotype, which is a key step in the process of breeding. In the global digitalization trend, digital technology based on optical sensors can perform the digitization of seed phenotype in a non-contact, high throughput way, thus significantly improving breeding efficiency.

AIM OF REVIEW

This paper provides a comprehensive overview of the principles, characteristics, data processing methods, and bottlenecks associated with three digital technique types based on optical sensors: spectroscopy, digital imaging, and three-dimensional (3D) reconstruction techniques. In addition, the applicability and adaptability of digital techniques based on the optical sensors of maize seed phenotype traits, namely external visible phenotype (EVP) and internal invisible phenotype (IIP), are investigated. Furthermore, trends in future equipment, platform, phenotype data, and processing algorithms are discussed. This review offers conceptual and practical support for seed phenotype digitization based on optical sensors, which will provide reference and guidance for future research.

KEY SCIENTIFIC CONCEPTS OF REVIEW

The digital techniques based on optical sensors can perform non-contact and high-throughput seed phenotype evaluation. Due to the distinct characteristics of optical sensors, matching suitable digital techniques according to seed phenotype traits can greatly reduce resource loss, and promote the efficiency of seed evaluation as well as breeding decision-making. Future research in phenotype equipment and platform, phenotype data, and processing algorithms will make digital techniques better meet the demands of seed phenotype evaluation, and promote automatic, integrated, and intelligent evaluation of seed phenotype, further helping to lessen the gap between digital techniques and seed phenotyping.

Computer-Aided Multiclass Classification of Corn from Corn Images Integrating Deep Feature Extraction

Corn has great importance in terms of production in the field of agriculture and animal feed. Obtaining pure corn seeds in corn production is quite significant for seed quality. For this reason, the distinction of corn seeds that have numerous varieties plays an essential role in marketing. This study was conducted with 14,469 images of BT6470, Calipso, Es_Armandi, and Hiva types of corn licensed by BIOTEK. The classification of images was carried out in three stages. At the first stage, deep feature extraction of the four types of corn images was performed with the pretrained CNN model SqueezeNet 1000 deep features were obtained for each image. In the second stage, in order to reduce these features obtained from deep feature extraction with SqueezeNet, separate feature selection processes were performed with the Bat Optimization (BA), Whale Optimization (WOA), and Gray Wolf Optimization (GWO) algorithms among optimization algorithms. Finally, in the last stage, the features obtained from the first and second stages were classified by using the machine learning methods Decision Tree (DT), Naive Bayes (NB), multi-class Support Vector Machine (mSVM), k-Nearest Neighbor (KNN), and Neural Network (NN). In the classification processes of the features obtained in the first stage, the mSVM model has achieved the highest classification success with 89.40%. In the second stage, as a result of the classifications performed through the active features selected by using three types of feature selection algorithms (BA, WOA, GWO), the classification success obtained with the mSVM model was 88.82%, 88.72%, and 88.95%, respectively. The classification accuracies of the tested methods and the classification accuracies obtained in the first stage are close to each other in terms of classification success. However, with the algorithms used in feature selection, successful classification processes have been carried out with fewer features and in a shorter time. The results of the study, in which classification was carried out in the inexpensive, the objective, and the shorter time of processing for the corn types, present a different perspective in terms of classification performance.

Advances in infrared spectroscopy and hyperspectral imaging combined with artificial intelligence for the detection of cereals quality

Cereals provide humans with essential nutrients, and its quality assessment has attracted widespread attention. Infrared (IR) spectroscopy (IRS) and hyperspectral imaging (HSI), as powerful nondestructive testing technologies, are widely used in the quality monitoring of food and agricultural products. Artificial intelligence (AI) plays a crucial role in data mining, especially in recent years, a new generation of AI represented by deep learning (DL) has made breakthroughs in analyzing spectral data of food and agricultural products. The combination of IRS/HSI and AI further promotes the development of quality evaluation of cereals. This paper comprehensively reviews the advances of IRS and HSI combined with AI in the detection of cereals quality. The aim is to present a complete review topic as it touches the background knowledge, instrumentation, spectral data processing (including preprocessing, feature extraction and modeling), spectral interpretation, etc. To suit this goal, principles of IRS and HSI, as well as basic concepts related to AI are first introduced, followed by a critical evaluation of representative reports integrating IRS and HSI with AI. Finally, the advantages, challenges and future trends of IRS and HSI combined with AI are further discussed, so as to provide constructive suggestions and guidance for researchers.

Variety classification of coated maize seeds based on Raman hyperspectral imaging

As an essential factor in quality assessment of maize seeds, variety purity profoundly impacts final yield and farmers' economic benefits. In this study, a novel method based on Raman hyperspectral imaging system was applied to achieve variety classification of coated maize seeds. A total of 760 maize seeds including 4 different varieties were evaluated. Raman spectral data of 400-1800 cm^-1 were extracted and preprocessed. Variable selection methods involved were modified competitive adaptive reweighted sampling (MCARS), successive projections algorithm (SPA), and their combination. In addition, MCARS was proposed for the first time in this paper as a stable search technology. The performance of support vector machine (SVM) models optimized by genetic algorithm (GA) was analyzed and compared with models based on random forest (RF) and back-propagation neural network (BPNN). Same models based on Vis-NIR spectral data were also established for comparison. Results showed that the MCARS-GA-SVM model based on Raman spectral data obtained the best performance with calibration accuracy of 99.29% and prediction accuracy of 100%, which were stable and easily replicated. In addition, the accuracy on the independent validation set was 96.88%, which proved that the model can be applied in practice. A more simplified MCARS-SPA-GA-SVM model, which contained only 3 variables, had more than 95% accuracy on each data set. This procedure can help to develop a real-time detection system to classify coated seed varieties with high accuracy, which is of great significance for assessing variety purity and increasing crop yield.

Near-Infrared Hyperspectral Imaging Pipelines for Pasture Seed Quality Evaluation: An Overview

Near-infrared (800–2500 nm; NIR) spectroscopy coupled to hyperspectral imaging (NIR-HSI) has greatly enhanced its capability and thus widened its application and use across various industries. This non-destructive technique that is sensitive to both physical and chemical attributes of virtually any material can be used for both qualitative and quantitative analyses. This review describes the advancement of NIR to NIR-HSI in agricultural applications with a focus on seed quality features for agronomically important seeds. NIR-HSI seed phenotyping, describing sample sizes used for building high-accuracy calibration and prediction models for full or selected wavelengths of the NIR region, is explored. The molecular interpretation of absorbance bands in the NIR region is difficult; hence, this review offers important NIR absorbance band assignments that have been reported in literature. Opportunities for NIR-HSI seed phenotyping in forage grass seed are described and a step-by-step data-acquisition and analysis pipeline for the determination of seed quality in perennial ryegrass seeds is also presented.

Identification of informative spectral ranges for predicting major chemical constituents in corn using NIR spectroscopy

Many studies have been conducted using NIR spectroscopy to predict corn constituents; however, a systematic investigation of the spectral sub-regions under the scope of overtones and combinations has not been performed. In this study, the corn spectra were divided into second overtones (1100-1388 nm), first overtones (1390-1852 nm), and combinations (1852-2498 nm). Then, using variable importance in projection and genetic algorithm, each region was inspected sequentially to identify the most informative sub-region for each attribute to improve interpretability. The identified spectral subsets were further tuned to select the most influential bands for each attribute. The sub-regions in combinations bands was most informative for predicting water (1908-2108 nm, 2 bands), oil (2176-2304 nm, 6 bands), and protein (2130-2190 nm, 3 bands), whereas the first overtones region was the best for predicting starch (1452-1770 nm, 5 bands). Results provided valuable information for potential hardware and software improvements.

Classification of Different Blueberry Cultivars by Analysis of Physical Factors, Chemical and Nutritional Ingredients, and Antioxidant Capacities

Blueberry fruits of different cultivars are featured with different quality indices. In this work, three types of quality factors, including 6 physical parameters, 12 chemical and nutritional components, and 3 antioxidant indices, were measured to compare and classify blueberry fruits from 12 different cultivars in China. Using the autoscaled data of quality factors, unsupervised principal component analysis was performed for exploratory analysis of intercultivar differences and the influences of quality factors. A supervised classification method, partial least squares discriminant analysis (PLSDA), was combined with the global particle swarm optimization algorithm (PSO) and two multiclass strategies, one-versus-rest (OVR) and one-versus-one (OVO), to select discriminative quality factors and develop classification models of the 12 cultivars. As a result, OVO-PLSDA with 8 quality factors could achieve the classification accuracy of 0.915. This study will provide new insights into the quality variations and key factors among different blueberry cultivars.

Application of near-infrared hyperspectral imaging to identify a variety of silage maize seeds and common maize seeds

Common maize seeds and silage maize seeds are similar in appearance and are difficult to identify with the naked eye. Four varieties of common maize seeds and four varieties of silage maize seeds were identified by near-infrared hyperspectral imaging (NIR-HSI) combined with chemometrics. The pixel-wise principal component analysis was used to distinguish the differences among different varieties of maize seeds. The object-wise spectra of each single seed sample were extracted to build classification models. Support vector machine (SVM) and radial basis function neural network (RBFNN) classification models were established using two different classification strategies. First, the maize seeds were directly classified into eight varieties with the prediction accuracy of the SVM model and RBFNN model over 86%. Second, the seeds of silage maize and common maize were firstly classified with the classification accuracy over 88%, then the seeds were classified into four varieties, respectively. The classification accuracy of silage maize seeds was over 98%, and the classification accuracy of common maize seeds was over 97%. The results showed that the varieties of common maize seeds and silage maize seeds could be classified by NIR-HSI combined with chemometrics, which provided an effective means to ensure the purity of maize seeds, especially to isolate common seeds and silage seeds.

Hyperspectral imaging technology combined with deep forest model to identify frost-damaged rice seeds

In recent years, deep learning models have been widely used in the field of hyperspectral imaging. However, the training of deep learning models requires not only a large number of samples, but also the need to set too many hyper-parameters, which is time consuming and laborious for researchers. This study used hyperspectral imaging technology combined with a deep learning model suitable for small-scale sample data sets, deep forests (DF) model, to classify rice seeds with different degrees of frost damage. During the period, three spectral preprocessing methods (Savitzky-Golay first derivative (SG1), standard normal variate (SNV), and multivariate scatter correction (MSC)) were used to process the original spectral data, and three feature extraction algorithms (principal component analysis (PCA), successive projections algorithm (SPA), and neighborhood component analysis (NCA)) were used to extract the characteristic wavelengths. Moreover, DF model and three traditional machine learning models (decision tree (DT), k-nearest neighbor (KNN), and support vector machine (SVM)) were built based on different numbers of sample sets. After multivariate data analysis, it showed that the pretreatment effect of MSC was the most excellent, and the characteristic wavelength extracted by NCA algorithm was the most useful. In addition, the performance of DF model was better than these three traditional classifier models, and it still performed well in small-scale sample set data. Therefore, DF model was chosen as the best classification model. The results of this study show that the DF model maintains good classification performance in small-scale sample set data, and it has a good application prospect in hyperspectral imaging technology.

Rapid and Noninvasive Typing and Assessment of Nutrient Content of Maize Kernels Using a Handheld Raman Spectrometer

To thrive as a global civilization, food production must meet the demands of our ever-growing population. There are more than a billion people on the planet suffering from malnutrition through poor quality or lack of food. Nutrient content of food can be determined by a variety of methods, which have issues such as slow analysis or sample destruction. Near-infrared (NIR) spectroscopy is a long-standing alternative to these methods. In this work, we demonstrated that Raman spectroscopy (RS), another spectroscopic method, can also be used to assess the nutrient content of maize (Zea mays), one of the most widely cultivated grains in the world. Using a handheld Raman spectrometer, we predicted the content of carbohydrates, fibers, carotenoids, and proteins in six different varieties of maize. This analysis requires only a single maize kernel and is fast (1s), portable, noninvasive, and nondestructive. Moreover, we showed that RS in combination with chemometric methods can be used for highly accurate (approximately 90%) spectroscopic typing of maize, which is important for plant breeders and farmers. Finally, we demonstrate that Raman-based approach is as accurate as NIR analysis. These findings suggest that portable Raman systems can be used on combines and grain elevators for autonomous control of grain quality.