Recent Applications of Multispectral Imaging in Seed Phenotyping and Quality Monitoring-An Overview

Grain Protein Content Phenotyping in Rice via Hyperspectral Imaging Technology and a Genome-Wide Association Study

Efficient and accurate acquisition of the rice grain protein content (GPC) is important for selecting high-quality rice varieties, and remote sensing technology is an attractive potential method for this task. However, the majority of multispectral sensors are poor predictors of GPC due to their broad spectral bands. Hyperspectral technology provides a new analytical technology for bridging the gap between phenomics and genomics. However, the small size of typical datasets is a constraint for model construction for estimating GPC, limiting their accuracy and reducing their ability to generalize to a wide range of varieties. In this study, we used hyperspectral data of rice grains from 515 japonica varieties and deep convolution generative adversarial networks (DCGANs) to generate simulated data to improve the model accuracy. Features sensitive to GPC were extracted after applying a continuous wavelet transform (CWT), and the estimated GPC model was constructed by partial least squares regression (PLSR). Finally, a genome-wide association study (GWAS) was applied to the measured and generated datasets to detect GPC loci. The results demonstrated that the simulated GPC values generated after 8,000 epochs were closest to the measured values. The wavelet feature (WF1743, 2), obtained from the data with the addition of 200 simulated samples, exhibited the highest GPC estimation accuracy (R 2 = 0.58 and RRMSE = 6.70%). The GWAS analysis showed that the estimated values based on the simulated data detected the same loci as the measured values, including the OsmtSSB1L gene related to grain storage protein. This study provides a new technique for the efficient genetic study of phenotypic traits in rice based on hyperspectral technology.

Multispectral imaging for distinguishing hybrid forest seeds of Corymbia spp. and Eucalyptus spp. from their progenitors

In the forest industry, interspecific hybridization, such as Eucalyptus urograndis (Eucalyptus grandis × Eucalyptus urophylla) and Corymbia maculata × Corymbia torelliana, has led to the development of high-performing F1 generations. The successful breeding of these hybrids relies on verifying progenitor origins and confirming post-crossing, but conventional genotype identification methods are resource-intensive and result in seed destruction. As an alternative, multispectral imaging analysis has emerged as an efficient and non-destructive tool for seed phenotyping. This approach has demonstrated success in various crop seeds. However, identifying seed species in the context of forest seeds presents unique challenges due to their natural phenotypic variability and the striking resemblance between different species. This study evaluates the efficacy of spectral imaging analysis in distinguishing hybrid seeds of E. urograndis and C. maculata × C. torelliana from their progenitors. Four experiments were conducted: one for Corymbia spp. seeds, one for each Eucalyptus spp. batch separately, and one for pooled batches. Multispectral images were acquired at 19 wavelengths within the spectral range of 365-970 nm. Classification models based on Linear Discriminant Analysis (LDA), Random Forest (RF), and Support Vector Machine (SVM) was created using reflectance and reflectance features, combined with color, shape, and texture features, as well as nCDA transformed features. The LDA algorithm, combining all features, provided the highest accuracy, reaching 98.15% for Corymbia spp., and 92.75%, 85.38, and 86.00 for Eucalyptus batch one, two, and pooled batches, respectively. The study demonstrated the effectiveness of multispectral imaging in distinguishing hybrid seeds of Eucalyptus and Corymbia species. The seeds' spectral signature played a key role in this differentiation. This technology holds great potential for non-invasively classifying forest seeds in breeding programs.

Quantitative measurement of internal quality of carrots using hyperspectral imaging and multivariate analysis

The study aimed to measure the carotenoid (Car) and pH contents of carrots using hyperspectral imaging. A total of 300 images were collected using a hyperspectral imaging system, covering 472 wavebands from 400 to 1000 nm. Regions of interest (ROIs) were defined to extract average spectra from the hyperspectral images (HIS). We developed two models: least squares support vector machine (LS-SVM) and partial least squares regression (PLSR) to establish a quantitative analysis between the pigment amounts and spectra. The spectra and pigment contents were predicted and correlated using these models. The selection of EWs for modeling was done using the Successive Projections Algorithm (SPA), regression coefficients (RC) from PLSR models, and LS-SVM. The results demonstrated that hyperspectral imaging could effectively evaluate the internal attributes of carrot cortex and xylem. Moreover, these models accurately predicted the Car and pH contents of the carrot parts. This study provides a valuable approach for variable selection and modeling in hyperspectral imaging studies of carrots.

Fusion of Multimodal Imaging and 3D Digitization Using Photogrammetry

Multimodal sensors capture and integrate diverse characteristics of a scene to maximize information gain. In optics, this may involve capturing intensity in specific spectra or polarization states to determine factors such as material properties or an individual's health conditions. Combining multimodal camera data with shape data from 3D sensors is a challenging issue. Multimodal cameras, e.g., hyperspectral cameras, or cameras outside the visible light spectrum, e.g., thermal cameras, lack strongly in terms of resolution and image quality compared with state-of-the-art photo cameras. In this article, a new method is demonstrated to superimpose multimodal image data onto a 3D model created by multi-view photogrammetry. While a high-resolution photo camera captures a set of images from varying view angles to reconstruct a detailed 3D model of the scene, low-resolution multimodal camera(s) simultaneously record the scene. All cameras are pre-calibrated and rigidly mounted on a rig, i.e., their imaging properties and relative positions are known. The method was realized in a laboratory setup consisting of a professional photo camera, a thermal camera, and a 12-channel multispectral camera. In our experiments, an accuracy better than one pixel was achieved for the data fusion using multimodal superimposition. Finally, application examples of multimodal 3D digitization are demonstrated, and further steps to system realization are discussed.

Unravelling marker trait associations linking nutritional value with pigmentation in rice seed

While considerable breeding effort has focused on increasing the yields of staple crops such as rice and the levels of micronutrients such as iron and zinc, breeding to address the problems of the double-burden of malnutrition has received less attention. Pigmented rice has higher nutritional value and greater health benefits compared to white rice. However, the genetic associations underlying pericarp coloration and accumulation of nutritionally valuable compounds is still poorly understood. Here we report the targeted genetic analysis of 364 rice accessions, assessing the genetic relationship between pericarp coloration (measured using multi-spectral imaging) and a range of phenolic compounds with potential nutritional and health-promoting characteristics. A genome-wide association study resulted in the identification of over 280 single nucleotide polymorphisms (SNPs) associated with the traits of interest. Many of the SNPs were associated with more than one trait, colocalization occurring between nutritional traits, and nutritional and color-related traits. Targeted association analysis identified 67 SNPs, located within 52 candidate genes and associated with 24 traits. Six haplotypes identified within the genes Rc/bHLH17 and OsIPT5 indicated that these genes have an important role in the regulation of a wide range of phenolic compounds, and not only those directly conferring pericarp color. These identified genetic linkages between nutritionally valuable phenolic compounds and pericarp color present not only a valuable resource for the enhancement of the nutritional value of rice but an easy method of selection of suitable genotypes.

Vigour testing for the rice seed with computer vision-based techniques

Rice is the staple food for approximately half of the world's population. Seed vigour has a crucial impact on the yield, which can be evaluated by germination rate, vigor index and etc. Existing seed vigour testing methods heavily rely on manual inspections that are destructive, time-consuming, and labor-intensive. To address the drawbacks of existing rice seed vigour testing, we proposed a multispectral image-based non-destructive seed germination testing approach. Specifically, we collected multispectral data in 19 wavebands for six rice varieties. Furthermore, we designed an end-to-end pipeline, denoted as MsiFormer (MisFormer cod3e will be available at https://github.com/LiaoYun0x0/MisFormer) by integrating a Yolo-based object detector (trained Yolo v5) and a vision transformer-based vigour testing model, which effectively improved the automation and efficiency of existing techniques. In order to objectively evaluate the performance of the proposed method in this paper, we conduct a comparison between MisFormer and other 3 deep learning methods. The results showed that, MisFormer performed much better with the accuracy of 94.17%, which was 2.5%-18.34% higher than the other 3 deep learning methods. Besides MsiFormer, possibilities of CIELab mediated image analysis of TTC (tetrazolium chloride) staining in rice seed viability and nCDA (normalized canonical discriminant analysis) in rice seed vigour were also discussed, where CIELab L* of TTC staining were negatively correlated with vigor index and germination rate, with Pearson's correlation coefficient of -0.9874, -0.9802 respectively, and CIELab A* of TTC staining were and positively correlated with vigor index and germination rate, with Pearson's correlation coefficient of 0.9624, 0.9544 respectively, and CIELab A* of nCDA had Pearson's correlation coefficient of -0.8866 and -0.9340 with vigor index and germination rate, respectively. Besides testing methods, vigour results within and among variety(ies) showed that, there were great variations among the 6 rice varieties, and mean coefficient of variation (CV) of vigor index of individual seed within a variety reached 64.87%, revealing the high risk of conventional methods in random sampling. Vigour variations had close relationship with wavelengths of 780 nm-970 nm, indicating their value in future research.

Advancement of non-destructive spectral measurements for the quality of major tropical fruits and vegetables: a review

The quality of tropical fruits and vegetables and the expanding global interest in eating healthy foods have resulted in the continual development of reliable, quick, and cost-effective quality assurance methods. The present review discusses the advancement of non-destructive spectral measurements for evaluating the quality of major tropical fruits and vegetables. Fourier transform infrared (FTIR), Near-infrared (NIR), Raman spectroscopy, and hyperspectral imaging (HSI) were used to monitor the external and internal parameters of papaya, pineapple, avocado, mango, and banana. The ability of HSI to detect both spectral and spatial dimensions proved its efficiency in measuring external qualities such as grading 516 bananas, and defects in 10 mangoes and 10 avocados with 98.45%, 97.95%, and 99.9%, respectively. All of the techniques effectively assessed internal characteristics such as total soluble solids (TSS), soluble solid content (SSC), and moisture content (MC), with the exception of NIR, which was found to have limited penetration depth for fruits and vegetables with thick rinds or skins, including avocado, pineapple, and banana. The appropriate selection of NIR optical geometry and wavelength range can help to improve the prediction accuracy of these crops. The advancement of spectral measurements combined with machine learning and deep learning technologies have increased the efficiency of estimating the six maturity stages of papaya fruit, from the unripe to the overripe stages, with F1 scores of up to 0.90 by feature concatenation of data developed by HSI and visible light. The presented findings in the technological advancements of non-destructive spectral measurements offer promising quality assurance for tropical fruits and vegetables.

RDA-Genebank and Digital Phenotyping for Next-Generation Research on Plant Genetic Resources

The National Agrobiodiversity Center under the Rural Development Administration (RDA) in Jeonju, Republic of Korea stands as the foremost national genebank in the country. Over the years, the National Agrobiodiversity Center has remained committed to enriching its collection with foreign genetic resources, elevating its status to a world-class plant genetic resources (PGR)- holding genebank. Currently, several steps are being undertaken to improve the accessibility of the collection to national as well as international researchers, improve the data available on the resources, and amend the passport information for the accessions. With the implementation of the Nagoya Protocol, the origin of genetic resources is being highlighted as an important input in the passport information. The RDA-Genebank actively responds to the Nagoya Protocol by supplementing passport data for resources lacking information on their origin. In addition, a large number of conserved resources are continuously multiplied, and agronomic traits are investigated concurrently. With the traditional methods of characterization of the germplasm requiring a significant amount of time and effort, we have initiated high-throughput phenotyping using digital techniques to improve our germplasm data. Primarily, we have started adding seed phenotype information followed by measuring root phenotypes which are stored under agronomic traits. This may be the initial step toward using largescale high-throughput techniques for a germplasm. In this study, we aim to provide an introduction to the RDA-Genebank, to adopted international standards, and to the establishment of high-throughput phenotyping techniques for the improvement of passport information.

A Deep Learning Framework for Processing and Classification of Hyperspectral Rice Seed Images Grown under High Day and Night Temperatures

A framework combining two powerful tools of hyperspectral imaging and deep learning for the processing and classification of hyperspectral images (HSI) of rice seeds is presented. A seed-based approach that trains a three-dimensional convolutional neural network (3D-CNN) using the full seed spectral hypercube for classifying the seed images from high day and high night temperatures, both including a control group, is developed. A pixel-based seed classification approach is implemented using a deep neural network (DNN). The seed and pixel-based deep learning architectures are validated and tested using hyperspectral images from five different rice seed treatments with six different high temperature exposure durations during day, night, and both day and night. A stand-alone application with Graphical User Interfaces (GUI) for calibrating, preprocessing, and classification of hyperspectral rice seed images is presented. The software application can be used for training two deep learning architectures for the classification of any type of hyperspectral seed images. The average overall classification accuracy of 91.33% and 89.50% is obtained for seed-based classification using 3D-CNN for five different treatments at each exposure duration and six different high temperature exposure durations for each treatment, respectively. The DNN gives an average accuracy of 94.83% and 91% for five different treatments at each exposure duration and six different high temperature exposure durations for each treatment, respectively. The accuracies obtained are higher than those presented in the literature for hyperspectral rice seed image classification. The HSI analysis presented here is on the Kitaake cultivar, which can be extended to study the temperature tolerance of other rice cultivars.

Automatic Detection of Small Sample Apple Surface Defects Using ASDINet

The appearance quality of apples directly affects their price. To realize apple grading automatically, it is necessary to find an effective method for detecting apple surface defects. Aiming at the problem of a low recognition rate in apple surface defect detection under small sample conditions, we designed an apple surface defect detection network (ASDINet) suitable for small sample learning. The self-developed apple sorting system collected RGB images of 50 apple samples for model verification, including non-defective and defective apples (rot, disease, lacerations, and mechanical damage). First, a segmentation network (AU-Net) with a stronger ability to capture small details was designed, and a Dep-conv module that could expand the feature capacity of the receptive field was inserted in its down-sampling path. Among them, the number of convolutional layers in the single-layer convolutional module was positively correlated with the network depth. Next, to achieve real-time segmentation, we replaced the flooding of feature maps with mask output in the 13th layer of the network. Finally, we designed a global decision module (GDM) with global properties, which inserted the global spatial domain attention mechanism (GSAM) and performed fast prediction on abnormal images through the input of masks. In the comparison experiment with state-of-the-art models, our network achieved an AP of 98.8%, and a 97.75% F1-score, which were higher than those of most of the state-of-the-art networks; the detection speed reached 39ms per frame, achieving accuracy-easy deployment and substantial trade-offs that are in line with actual production needs. In the data sensitivity experiment, the ASDINet achieved results that met the production needs under the training of 42 defective pictures. In addition, we also discussed the effect of the ASDINet in actual production, and the test results showed that our proposed network demonstrated excellent performance consistent with the theory in actual production.

Detection of peanut seed vigor based on hyperspectral imaging and chemometrics

Rapid nondestructive testing of peanut seed vigor is of great significance in current research. Before seeds are sown, effective screening of high-quality seeds for planting is crucial to improve the quality of crop yield, and seed vitality is one of the important indicators to evaluate seed quality, which can represent the potential ability of seeds to germinate quickly and whole and grow into normal seedlings or plants. Meanwhile, the advantage of nondestructive testing technology is that the seeds themselves will not be damaged. In this study, hyperspectral technology and superoxide dismutase activity were used to detect peanut seed vigor. To investigate peanut seed vigor and predict superoxide dismutase activity, spectral characteristics of peanut seeds in the wavelength range of 400-1000 nm were analyzed. The spectral data are processed by a variety of hot spot algorithms. Spectral data were preprocessed with Savitzky-Golay (SG), multivariate scatter correction (MSC), and median filtering (MF), which can effectively to reduce the effects of baseline drift and tilt. CatBoost and Gradient Boosted Decision Tree were used for feature band extraction, the top five weights of the characteristic bands of peanut seed vigor classification are 425.48nm, 930.8nm, 965.32nm, 984.0nm, and 994.7nm. XGBoost, LightGBM, Support Vector Machine and Random Forest were used for modeling of seed vitality classification. XGBoost and partial least squares regression were used to establish superoxide dismutase activity value regression model. The results indicated that MF-CatBoost-LightGBM was the best model for peanut seed vigor classification, and the accuracy result was 90.83%. MSC-CatBoost-PLSR was the optimal regression model of superoxide dismutase activity value. The results show that the R² was 0.9787 and the RMSE value was 0.0566. The results suggested that hyperspectral technology could correlate the external manifestation of effective peanut seed vigor.

Fungal identification in peanuts seeds through multispectral images: Technological advances to enhance sanitary quality

The sanitary quality of seed is essential in agriculture. This is because pathogenic fungi compromise seed physiological quality and prevent the formation of plants in the field, which causes losses to farmers. Multispectral images technologies coupled with machine learning algorithms can optimize the identification of healthy peanut seeds, greatly improving the sanitary quality. The objective was to verify whether multispectral images technologies and artificial intelligence tools are effective for discriminating pathogenic fungi in tropical peanut seeds. For this purpose, dry peanut seeds infected by fungi (A. flavus, A. niger, Penicillium sp., and Rhizopus sp.) were used to acquire images at different wavelengths (365 to 970 nm). Multispectral markers of peanut seed health quality were found. The incubation period of 216 h was the one that most contributed to discriminating healthy seeds from those containing fungi through multispectral images. Texture (Percent Run), color (CIELab L*) and reflectance (490 nm) were highly effective in discriminating the sanitary quality of peanut seeds. Machine learning algorithms (LDA, MLP, RF, and SVM) demonstrated high accuracy in autonomous detection of seed health status (90 to 100%). Thus, multispectral images coupled with machine learning algorithms are effective for screening peanut seeds with superior sanitary quality.

Rice Labeling according to Grain Quality Features Using Laser-Induced Breakdown Spectroscopy

Rice is an important source of nutrition and energy consumed around the world. Thus, quality inspection is crucial for protecting consumers and increasing the rice's value in the productive chain. Currently, methods for rice labeling depending on grain quality features are based on image and/or visual inspection. These methods have shown subjectivity and inefficiency for large-scale analyses. Laser-induced breakdown spectroscopy (LIBS) is an analytical technique showing attractive features due to how quick the analysis can be carried out and its capability of providing spectra that are true fingerprints of the sample's elemental composition. In this work, LIBS performance was evaluated for labeling rice according to grain quality features. The LIBS spectra of samples with their grain quality numerically described as Type 1, 2, and 3 were measured. Several spectral processing methods were evaluated when modeling a k-nearest neighbors (k-NN) classifier. Variable selection was also carried out by principal component analysis (PCA), and then the optimal k-value was selected. The best result was obtained by applying spectrum smoothing followed by normalization by using the first fifteen principal components (PCs) as input variables and k = 9. Under these conditions, the method showed excellent performance, achieving sample classification with 94% overall prediction accuracy. The sensitivities ranged from 90 to 100%, and specificities were in the range of 92-100%. The proposed method has remarkable characteristics, e.g., analytical speed and analysis guided by chemical responses; therefore, the method is not susceptible to subjectivity errors.

Integrating optical imaging techniques for a novel approach to evaluate Siberian wild rye seed maturity

Advances in optical imaging technology using rapid and non-destructive methods have led to improvements in the efficiency of seed quality detection. Accurately timing the harvest is crucial for maximizing the yield of higher-quality Siberian wild rye seeds by minimizing excessive shattering during harvesting. This research applied integrated optical imaging techniques and machine learning algorithms to develop different models for classifying Siberian wild rye seeds based on different maturity stages and grain positions. The multi-source fusion of morphological, multispectral, and autofluorescence data provided more comprehensive information but also increases the performance requirements of the equipment. Therefore, we employed three filtering algorithms, namely minimal joint mutual information maximization (JMIM), information gain, and Gini impurity, and set up two control methods (feature union and no-filtering) to assess the impact of retaining only 20% of the features on the model performance. Both JMIM and information gain revealed autofluorescence and morphological features (CIELab A, CIELab B, hue and saturation), with these two filtering algorithms showing shorter run times. Furthermore, a strong correlation was observed between shoot length and morphological and autofluorescence spectral features. Machine learning models based on linear discriminant analysis (LDA), random forests (RF) and support vector machines (SVM) showed high performance (>0.78 accuracies) in classifying seeds at different maturity stages. Furthermore, it was found that there was considerable variation in the different grain positions at the maturity stage, and the K-means approach was used to improve the model performance by 5.8%-9.24%. In conclusion, our study demonstrated that feature filtering algorithms combined with machine learning algorithms offer high performance and low cost in identifying seed maturity stages and that the application of k-means techniques for inconsistent maturity improves classification accuracy. Therefore, this technique could be employed classification of seed maturity and superior physiological quality for Siberian wild rye seeds.

Identification of Defective Maize Seeds Using Hyperspectral Imaging Combined with Deep Learning

Seed quality affects crop yield and the quality of agricultural products, and traditional identification methods are time-consuming, complex, and irreversibly destructive. This study aims to establish a fast, non-destructive, and effective approach for defect detection in maize seeds based on hyperspectral imaging (HSI) technology combined with deep learning. Raw spectra collected from maize seeds (200 each healthy and worm-eaten) were pre-processed using detrending (DE) and multiple scattering correction (MSC) to highlight the spectral differences between samples. A convolutional neural network architecture (CNN-FES) based on a feature selection mechanism was proposed according to the importance of wavelength in the target classification task. The results show that the subset of 24 feature wavelengths selected by the proposed CNN-FES can capture important feature information in the spectral data more effectively than the conventional successive projections algorithm (SPA) and competitive adaptive reweighted sampling (CARS) algorithms. In addition, a convolutional neural network architecture (CNN-ATM) based on an attentional classification mechanism was designed for one-dimensional spectral data classification and compared with three commonly used machine learning methods, linear discriminant analysis (LDA), random forest (RF), and support vector machine (SVM). The results show that the classification performance of the designed CNN-ATM on the full wavelength does not differ much from the above three methods, and the classification accuracy is above 90% on both the training and test sets. Meanwhile, the accuracy, sensitivity, and specificity of CNN-ATM based on feature wavelength modeling can reach up to 97.50%, 98.28%, and 96.77% at the highest, respectively. The study shows that hyperspectral imaging-based defect detection of maize seed is feasible and effective, and the proposed method has great potential for the processing and analysis of complex hyperspectral data.

A biophotonic platform for quantitative analysis in the spatial, spectral, polarimetric, and goniometric domains

Advanced instrumentation and versatile setups are needed for understanding light interaction with biological targets. Such instruments include (1) microscopes and 3D scanners for detailed spatial analysis, (2) spectral instruments for deducing molecular composition, (3) polarimeters for assessing structural properties, and (4) goniometers probing the scattering phase function of, e.g., tissue slabs. While a large selection of commercial biophotonic instruments and laboratory equipment are available, they are often bulky and expensive. Therefore, they remain inaccessible for secondary education, hobbyists, and research groups in low-income countries. This lack of equipment impedes hands-on proficiency with basic biophotonic principles and the ability to solve local problems with applied physics. We have designed, prototyped, and evaluated the low-cost Biophotonics, Imaging, Optical, Spectral, Polarimetric, Angular, and Compact Equipment (BIOSPACE) for high-quality quantitative analysis. BIOSPACE uses multiplexed light-emitting diodes with emission wavelengths from ultraviolet to near-infrared, captured by a synchronized camera. The angles of the light source, the target, and the polarization filters are automated by low-cost mechanics and a microcomputer. This enables multi-dimensional scatter analysis of centimeter-sized biological targets. We present the construction, calibration, and evaluation of BIOSPACE. The diverse functions of BIOSPACE include small animal spectral imaging, measuring the nanometer thickness of a bark-beetle wing, acquiring the scattering phase function of a blood smear and estimating the anisotropic scattering and the extinction coefficients, and contrasting muscle fibers using polarization. We provide blueprints, component list, and software for replication by enthusiasts and educators to simplify the hands-on investigation of fundamental optical properties in biological samples.

Non-destructive monitoring of amylose content in rice by UAV-based hyperspectral images

Amylose content (AC) is an important indicator for rice quality grading. The rapid development of unmanned aerial vehicle (UAV) technology provides rich spectral and spatial information on observed objects, making non-destructive monitoring of crop quality possible. To test the potential of UAV-based hyperspectral images in AC estimation, in this study, observations on five rice cultivars were carried out in eastern China (Zhejiang province) for four consecutive years (from 2017 to 2020). The correlations between spectral and textural variables of UAV-based hyperspectral images at different growth stages (booting, heading, filling, and ripening) and AC (%) were analyzed, and the linear regression models based on spectral variables alone, textural variables alone, and combined spectral and textural variables were established. The results showed that the sensitive bands (P< 0.001) to AC were mainly centered in the green (536∽568 nm) and red regions (630∽660nm), with spectral and textural variables at the ripening stage giving the highest negative correlation coefficient of -0.868 and -0.824, respectively. Models based on combined spectral and textural variables give better estimation than those based on spectral or textural variables alone, characterized by less variables and higher accuracy. The best models using spectral or textural variables alone both involved three growth stages (heading, filling, and ripening), with root mean square error (RMSE) of 1.01% and 1.04%, respectively, while the models based on combined spectral and textural variables have RMSE of 1.04% 0.844% with only one (ripening stage) or two (ripening and filling stages) growth stages involved. The combination of spectral and textural variables of UAV-based hyperspectral images is expected to simplify data acquisition and enhance estimation accuracy in remote sensing of rice AC.

Rice Chalky Grain 5 regulates natural variation for grain quality under heat stress

Heat stress occurring during rice (Oryza sativa) grain development reduces grain quality, which often manifests as increased grain chalkiness. Although the impact of heat stress on grain yield is well-studied, the genetic basis of rice grain quality under heat stress is less explored as quantifying grain quality is less tractable than grain yield. To address this, we used an image-based colorimetric assay (Red, R; and Green, G) for genome-wide association analysis to identify genetic loci underlying the phenotypic variation in rice grains exposed to heat stress. We found the R to G pixel ratio (RG) derived from mature grain images to be effective in distinguishing chalky grains from translucent grains derived from control (28/24°C) and heat stressed (36/32°C) plants. Our analysis yielded a novel gene, rice Chalky Grain 5 (OsCG5) that regulates natural variation for grain chalkiness under heat stress. OsCG5 encodes a grain-specific, expressed protein of unknown function. Accessions with lower transcript abundance of OsCG5 exhibit higher chalkiness, which correlates with higher RG values under stress. These findings are supported by increased chalkiness of OsCG5 knock-out (KO) mutants relative to wildtype (WT) under heat stress. Grains from plants overexpressing OsCG5 are less chalky than KOs but comparable to WT under heat stress. Compared to WT and OE, KO mutants exhibit greater heat sensitivity for grain size and weight relative to controls. Collectively, these results show that the natural variation at OsCG5 may contribute towards rice grain quality under heat stress.

Single Seed Identification in Three Medicago Species via Multispectral Imaging Combined with Stacking Ensemble Learning

Multispectral imaging (MSI) has become a new fast and non-destructive detection method in seed identification. Previous research has usually focused on single models in MSI data analysis, which always employed all features and increased the risk to efficiency and that of system cost. In this study, we developed a stacking ensemble learning (SEL) model for successfully identifying a single seed of sickle alfalfa (Medicago falcata), hybrid alfalfa (M. varia), and alfalfa (M. sativa). SEL adopted a three-layer structure, i.e., level 0 with principal component analysis (PCA), linear discriminant analysis (LDA), and quadratic discriminant analysis (QDA) as models of dimensionality reduction and feature extraction (DRFE); level 1 with support vector machine (SVM), multiple logistic regression (MLR), generalized linear models with elastic net regularization (GLMNET), and eXtreme Gradient Boosting (XGBoost) as basic learners; and level 3 with XGBoost as meta-learner. We confirmed that the values of overall accuracy, kappa, precision, sensitivity, specificity, and sensitivity in the SEL model were all significantly higher than those in basic models alone, based on both spectral features and a combination of morphological and spectral features. Furthermore, we also developed a feature filtering process and successfully selected 5 optimal features out of 33 ones, which corresponded to the contents of chlorophyll, anthocyanin, fat, and moisture in seeds. Our SEL model in MSI data analysis provided a new way for seed identification, and the feature filter process potentially could be used widely for development of a low-cost and narrow-channel sensor.

An ultra-small nine-color spectrometer with a two-layer biparted ten-dichroic-mirror array and an image sensor

An ultra-small (54 × 58 × 8.5 mm) and large aperture (1 × 7 mm) nine-color spectrometer-using an array of ten dichroic mirrors "biparted" as two layers-was developed and used for snapshot spectral imaging. Incident-light flux with a cross section smaller than the aperture size is split into nine color fluxes with 20-nm-width contiguous wavelength bands and central wavelengths of 530, 550, 570, 590, 610, 630, 650, 670, and 690 nm. Images of the nine color fluxes are simultaneously and efficiently measured by an image sensor. Unlike a conventional dichroic-mirror array, the developed dichroic-mirror array has a unique biparted configuration that not only increases the number of colors that can be measured simultaneously but also improves the image resolution of each color flux. The developed nine-color spectrometer was used for four-capillary-array electrophoresis. Eight dyes concurrently migrating in each capillary were simultaneously quantified by nine-color laser-induced fluorescence detection. Since the nine-color spectrometer is not only ultra-small and inexpensive but also has high light throughput and sufficient spectral resolution for most spectral-imaging applications, it has the potential to be widely used in various fields.

Mathematical modeling to predict rice's phenolic and mineral content through multispectral imaging

Over half the world population relies on rice for energy, but being a carbohydrate-based crop, it offers limited nutritional benefits. To achieve nutritional security targets in Asia, we must understand the genetic variation in multi-nutritional properties with therapeutic properties and deploy this knowledge to future rice breeding. High throughput, VideometerLAB spectral imaging data has been effective in estimating total anthocyanin content, particularly bound anthocyanin content, using the high prediction power of partial least square (PLS) regression models. Multi-pronged nutritional properties of phenolic compounds and minerals, together with videometerLAB features, were utilized to develop models to classify a collection of black rice varieties into three distinct nutritional quality ideotypes. These derived models for black rice diversity panels were created utilizing videometerLAB data (L, A, B parameters), selected phenolic types (total phenolics, total anthocyanins, and bound flavonoids), and minerals (Molybdenum and Phosphorous). Random forest and artificial neural network models depicted the multi-nutritional features of black rice with 85.35 and 99.9% accuracy, respectively. These prediction algorithms would help rice breeders strategically breed nutritionally valuable genotypes based on simple, high-through-put videometerLAB readings and a small number of nutritional assays.

The use of multispectral imaging for the discrimination of Arabica and Robusta coffee beans

Arabica coffee beans are sold at twice the price, or more, compared to Robusta beans and consequently are susceptible to economically motivated adulteration by substitution. There is a need for rapid, non-destructive, and efficient analytical techniques for monitoring the authenticity of Arabica coffee beans in the supply chain. In this study, multispectral imaging (MSI) was applied to discriminate roasted Arabica and Robusta coffee beans and perform quantitative prediction of Arabica coffee bean adulteration with Robusta. The Orthogonal Partial Least Squares Discriminant Analysis (OPLS-DA) model, built using selected spectral and morphological features from individual coffee beans, achieved 100% correct classification of the two coffee species in the test dataset. The OPLS regression model was able to successfully predict the level of adulteration of Arabica with Robusta. MSI analysis has potential as a rapid screening tool for the detection of fraud issues related to the authenticity of Arabica coffee beans.

Rapid and Non-destructive Classification of New and Aged Maize Seeds Using Hyperspectral Image and Chemometric Methods

The aged seeds have a significant influence on seed vigor and corn growth. Therefore, it is vital for the planting industry to identify aged seeds. In this study, hyperspectral reflectance imaging (1,000-2,000 nm) was employed for identifying aged maize seeds using seeds harvested in different years. The average spectra of the embryo side, endosperm side, and both sides were extracted. The support vector machine (SVM) algorithm was used to develop classification models based on full spectra to evaluate the potential of hyperspectral imaging for maize seed detection and using the principal component analysis (PCA) and ANOVA to reduce data dimensionality and extract feature wavelengths. The classification models achieved perfect performance using full spectra with an accuracy of 100% for the prediction set. The performance of models established with the first three principal components was similar to full spectrum models, but that of PCA loading models was worse. Compared to other spectra, the two-band ratio (1,987 nm/1,079 nm) selected by ANOVA from embryo-side spectra achieved a better classification accuracy of 95% for the prediction set. The image texture features, including histogram statistics (HS) and gray-level co-occurrence matrix (GLCM), were extracted from the two-band ratio image to establish fusion models. The results demonstrated that the two-band ratio selected from embryo-side spectra combined with image texture features achieved the classification of maize seeds harvested in different years with an accuracy of 97.5% for the prediction set. The overall results indicated that combining the two wavelengths with image texture features could detect aged maize seeds effectively. The proposed method was conducive to the development of multi-spectral detection equipment.

Advances in infrared spectroscopy and hyperspectral imaging combined with artificial intelligence for the detection of cereals quality

Cereals provide humans with essential nutrients, and its quality assessment has attracted widespread attention. Infrared (IR) spectroscopy (IRS) and hyperspectral imaging (HSI), as powerful nondestructive testing technologies, are widely used in the quality monitoring of food and agricultural products. Artificial intelligence (AI) plays a crucial role in data mining, especially in recent years, a new generation of AI represented by deep learning (DL) has made breakthroughs in analyzing spectral data of food and agricultural products. The combination of IRS/HSI and AI further promotes the development of quality evaluation of cereals. This paper comprehensively reviews the advances of IRS and HSI combined with AI in the detection of cereals quality. The aim is to present a complete review topic as it touches the background knowledge, instrumentation, spectral data processing (including preprocessing, feature extraction and modeling), spectral interpretation, etc. To suit this goal, principles of IRS and HSI, as well as basic concepts related to AI are first introduced, followed by a critical evaluation of representative reports integrating IRS and HSI with AI. Finally, the advantages, challenges and future trends of IRS and HSI combined with AI are further discussed, so as to provide constructive suggestions and guidance for researchers.

Non-Destructive Testing of Alfalfa Seed Vigor Based on Multispectral Imaging Technology

Seed vigor is an important index to evaluate seed quality in plant species. How to evaluate seed vigor quickly and accurately has always been a serious problem in the seed research field. As a new physical testing method, multispectral technology has many advantages such as high sensitivity and accuracy, nondestructive and rapid application having advantageous prospects in seed quality evaluation. In this study, the morphological and spectral information of 19 wavelengths (365, 405, 430, 450, 470, 490, 515, 540, 570, 590, 630, 645, 660, 690, 780, 850, 880, 940, 970 nm) of alfalfa seeds with different level of maturity and different harvest periods (years), representing different vigor levels and age of seed, were collected by using multispectral imaging. Five multivariate analysis methods including principal component analysis (PCA), linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF) and normalized canonical discriminant analysis (nCDA) were used to distinguish and predict their vigor. The results showed that LDA model had the best effect, with an average accuracy of 92.9% for seed samples of different maturity and 97.8% for seed samples of different harvest years, and the average sensitivity, specificity and precision of LDA model could reach more than 90%. The average accuracy of nCDA in identifying dead seeds with no vigor reached 93.3%. In identifying the seeds with high vigor and predicting the germination percentage of alfalfa seeds, it could reach 95.7%. In summary, the use of Multispectral Imaging and multivariate analysis in this experiment can accurately evaluate and predict the seed vigor, seed viability and seed germination percentages of alfalfa, providing important technical methods and ideas for rapid non-destructive testing of seed quality.

Fluorescence spectroscopy and multispectral imaging for fingerprinting of aflatoxin-B1 contaminated (Zea mays L.) seeds: a preliminary study

Cereal seeds safety may be compromised by the presence of toxic contaminants, such as aflatoxins. Besides being carcinogenic, they have other adverse health effects on humans and animals. In this preliminary study, we used two non-invasive optical techniques, optical fiber fluorescence spectroscopy and multispectral imaging (MSI), for discrimination of maize seeds naturally contaminated with aflatoxin B₁ (AFB₁) from the uncontaminated seeds. The AFB₁-contaminated seeds exhibited a red shift of the emission maximum position compared to the control samples. Using linear discrimination analysis to analyse fluorescence data, classification accuracy of 100% was obtained to discriminate uncontaminated and AFB₁-contaminated seeds. The MSI analysis combined with a normalized canonical discriminant analysis, provided spectral and spatial patterns of the analysed seeds. The AFB₁-contaminated seeds showed a 7.9 to 9.6-fold increase in the seed reflectance in the VIS region, and 10.4 and 12.2-fold increase in the NIR spectral region, compared with the uncontaminated seeds. Thus the MSI method classified successfully contaminated from uncontaminated seeds with high accuracy. The results may have an impact on development of spectroscopic non-invasive methods for detection of AFs presence in seeds, providing valuable information for the assessment of seed adulteration in the field of food forensics and food safety.

Near-Infrared Hyperspectral Imaging Pipelines for Pasture Seed Quality Evaluation: An Overview

Near-infrared (800–2500 nm; NIR) spectroscopy coupled to hyperspectral imaging (NIR-HSI) has greatly enhanced its capability and thus widened its application and use across various industries. This non-destructive technique that is sensitive to both physical and chemical attributes of virtually any material can be used for both qualitative and quantitative analyses. This review describes the advancement of NIR to NIR-HSI in agricultural applications with a focus on seed quality features for agronomically important seeds. NIR-HSI seed phenotyping, describing sample sizes used for building high-accuracy calibration and prediction models for full or selected wavelengths of the NIR region, is explored. The molecular interpretation of absorbance bands in the NIR region is difficult; hence, this review offers important NIR absorbance band assignments that have been reported in literature. Opportunities for NIR-HSI seed phenotyping in forage grass seed are described and a step-by-step data-acquisition and analysis pipeline for the determination of seed quality in perennial ryegrass seeds is also presented.

Near-infrared plasmonic sensing and digital metasurface via double Fano resonances

Plasmonic sensing that enables the detection of minute events, when the incident light field interacts with the nanostructure interface, has been widely applied to optical and biological detection. Implementation of the controllable plasmonic double Fano resonances (DFRs) offers a flexible and efficient way for plasmonic sensing. However, plasmonic sensing and digital metasurface induced by tailorable plasmonic DFRs require further study. In this work, we numerically and theoretically investigate the near-infrared plasmonic DFRs for plasmonic sensing and digital metasurface in a hybrid metasurface with concentric ϕ-shaped-hole and circular-ring-aperture unit cells. We show that a plasmonic Fano resonance, resulting from the interaction between a narrow and a wide effective dipolar modes, can be realized in the ϕ-shaped hybrid metasurface. In particular, we demonstrate that the tailoring plasmonic DFRs with distinct mechanisms of actions can be accomplished in three different ϕ-shaped hybrid metasurfaces. Moreover, the resonance mode-broadening and mode-shifting plasmonic sensing can be fulfilled by modulating the polarization orientation and the related geometric parameters of the unit cells in the near-infrared waveband, respectively. In addition, the plasmonic switch with a high ON/OFF ratio can not only be achieved but also be exploited to establish a single-bit digital metasurface, even empower to implement two- and three-bit digital metasurface characterized by the plasmonic DFRs in the telecom L-band. Our results offer a new perspective toward realizing polarization-sensitive optical sensing, passive optical switches, and programmable metasurface devices, which also broaden the landscape of subwavelength nanostructures for biosensors and optical communications.

Deep learning based high-throughput phenotyping of chalkiness in rice exposed to high night temperature

BACKGROUND

Rice is a major staple food crop for more than half the world's population. As the global population is expected to reach 9.7 billion by 2050, increasing the production of high-quality rice is needed to meet the anticipated increased demand. However, global environmental changes, especially increasing temperatures, can affect grain yield and quality. Heat stress is one of the major causes of an increased proportion of chalkiness in rice, which compromises quality and reduces the market value. Researchers have identified 140 quantitative trait loci linked to chalkiness mapped across 12 chromosomes of the rice genome. However, the available genetic information acquired by employing advances in genetics has not been adequately exploited due to a lack of a reliable, rapid and high-throughput phenotyping tool to capture chalkiness. To derive extensive benefit from the genetic progress achieved, tools that facilitate high-throughput phenotyping of rice chalkiness are needed.

RESULTS

We use a fully automated approach based on convolutional neural networks (CNNs) and Gradient-weighted Class Activation Mapping (Grad-CAM) to detect chalkiness in rice grain images. Specifically, we train a CNN model to distinguish between chalky and non-chalky grains and subsequently use Grad-CAM to identify the area of a grain that is indicative of the chalky class. The area identified by the Grad-CAM approach takes the form of a smooth heatmap that can be used to quantify the degree of chalkiness. Experimental results on both polished and unpolished rice grains using standard instance classification and segmentation metrics have shown that Grad-CAM can accurately identify chalky grains and detect the chalkiness area.

CONCLUSIONS

We have successfully demonstrated the application of a Grad-CAM based tool to accurately capture high night temperature induced chalkiness in rice. The models trained will be made publicly available. They are easy-to-use, scalable and can be readily incorporated into ongoing rice breeding programs, without rice researchers requiring computer science or machine learning expertise.

An Approach Using Emerging Optical Technologies and Artificial Intelligence Brings New Markers to Evaluate Peanut Seed Quality

Seeds of high physiological quality are defined by their superior germination capacity and uniform seedling establishment. Here, it was investigated whether multispectral images combined with machine learning models can efficiently categorize the quality of peanut seedlots. The seed quality from seven lots was assessed traditionally (seed weight, water content, germination, and vigor) and by multispectral images (area, length, width, brightness, chlorophyll fluorescence, anthocyanin, and reflectance: 365 to 970 nm). Seedlings from the seeds of each lot were evaluated for their photosynthetic capacity (fluorescence and chlorophyll index, F₀, F_m, and F_v/F_m) and stress indices (anthocyanin and NDVI). Artificial intelligence features (QDA method) applied to the data extracted from the seed images categorized lots with high and low quality. Higher levels of anthocyanin were found in the leaves of seedlings from low quality seeds. Therefore, this information is promising since the initial behavior of the seedlings reflected the quality of the seeds. The existence of new markers that effectively screen peanut seed quality was confirmed. The combination of physical properties (area, length, width, and coat brightness), pigments (chlorophyll fluorescence and anthocyanin), and light reflectance (660, 690, and 780 nm), is highly efficient to identify peanut seedlots with superior quality (98% accuracy).

A Semi-Supervised Reduced-Space Method for Hyperspectral Imaging Segmentation

The development of the hyperspectral remote sensor technology allows the acquisition of images with a very detailed spectral information for each pixel. Because of this, hyperspectral images (HSI) potentially possess larger capabilities in solving many scientific and practical problems in agriculture, biomedical, ecological, geological, hydrological studies. However, their analysis requires developing specialized and fast algorithms for data processing, due the high dimensionality of the data. In this work, we propose a new semi-supervised method for multilabel segmentation of HSI that combines a suitable linear discriminant analysis, a similarity index to compare different spectra, and a random walk based model with a direct label assignment. The user-marked regions are used for the projection of the original high-dimensional feature space to a lower dimensional space, such that the class separation is maximized. This allows to retain in an automatic way the most informative features, lightening the successive computational burden. The part of the random walk is related to a combinatorial Dirichlet problem involving a weighted graph, where the nodes are the projected pixel of the original HSI, and the positive weights depend on the distances between these nodes. We then assign to each pixel of the original image a probability quantifying the likelihood that the pixel (node) belongs to some subregion. The computation of the spectral distance involves both the coordinates in a features space of a pixel and of its neighbors. The final segmentation process is therefore reduced to a suitable optimization problem coupling the probabilities from the random walker computation, and the similarity with respect the initially labeled pixels. We discuss the properties of the new method with experimental results carried on benchmark images.

Lensless Multispectral Camera Based on a Coded Aperture Array

Multispectral imaging can be applied to water quality monitoring, medical diagnosis, and other applications, but the principle of multispectral imaging is different from the principle of hyper-spectral imaging. Multispectral imaging is generally achieved through filters, so multiple photos are required to obtain spectral information. Using multiple detectors to take pictures at the same time increases the complexity and cost of the system. This paper proposes a simple multispectral camera based on lensless imaging, which does not require multiple lenses. The core of the system is the multispectral coding aperture. The coding aperture is divided into different regions and each region transmits the light of one wavelength, such that the spectral information of the target can be coded. By solving the inverse problem of sparse constraints, the multispectral information of the target is inverted. Herein, we analyzed the characteristics of this multispectral camera and developed a principle prototype to obtain experimental results.

Robust seed germination prediction using deep learning and RGB image data

Achieving seed germination quality standards poses a real challenge to seed companies as they are compelled to abide by strict certification rules, while having only partial seed separation solutions at their disposal. This discrepancy results with wasteful disqualification of seed lots holding considerable amounts of good seeds and further translates to financial losses and supply chain insecurity. Here, we present the first-ever generic germination prediction technology that is based on deep learning and RGB image data and facilitates seed classification by seed germinability and usability, two facets of germination fate. We show technology competence to render dozens of disqualified seed lots of seven vegetable crops, representing different genetics and production pipelines, industrially appropriate, and to adequately classify lots by utilizing available crop-level image data, instead of lot-specific data. These achievements constitute a major milestone in the deployment of this technology for industrial seed sorting by germination fate for multiple crops.

A Critical Review of the Current Global Ex Situ Conservation System for Plant Agrobiodiversity. II. Strengths and Weaknesses of the Current System and Recommendations for Its Improvement

In this paper, we review gene bank operations that have an influence on the global conservation system, with the intention to identify critical aspects that should be improved for optimum performance. We describe the role of active and base collections and the importance of linking germplasm conservation and use, also in view of new developments in genomics and phenomics that facilitate more effective and efficient conservation and use of plant agrobiodiversity. Strengths, limitations, and opportunities of the existing global ex situ conservation system are discussed, and measures are proposed to achieve a rational, more effective, and efficient global system for germplasm conservation and sustainable use. The proposed measures include filling genetic and geographic gaps in current ex situ collections; determining unique accessions at the global level for long-term conservation in virtual base collections; intensifying existing international collaborations among gene banks and forging collaborations with the botanic gardens community; increasing investment in conservation research and user-oriented supportive research; improved accession-level description of the genetic diversity of crop collections; improvements of the legal and policy framework; and oversight of the proposed network of global base collections.

Autofluorescence-spectral imaging as an innovative method for rapid, non-destructive and reliable assessing of soybean seed quality

In the agricultural industry, advances in optical imaging technologies based on rapid and non-destructive approaches have contributed to increase food production for the growing population. The present study employed autofluorescence-spectral imaging and machine learning algorithms to develop distinct models for classification of soybean seeds differing in physiological quality after artificial aging. Autofluorescence signals from the 365/400 nm excitation-emission combination (that exhibited a perfect correlation with the total phenols in the embryo) were efficiently able to segregate treatments. Furthermore, it was also possible to demonstrate a strong correlation between autofluorescence-spectral data and several quality indicators, such as early germination and seed tolerance to stressful conditions. The machine learning models developed based on artificial neural network, support vector machine or linear discriminant analysis showed high performance (0.99 accuracy) for classifying seeds with different quality levels. Taken together, our study shows that the physiological potential of soybean seeds is reduced accompanied by changes in the concentration and, probably in the structure of autofluorescent compounds. In addition, altering the autofluorescent properties in seeds impact the photosynthesis apparatus in seedlings. From the practical point of view, autofluorescence-based imaging can be used to check modifications in the optical properties of soybean seed tissues and to consistently discriminate high-and low-vigor seeds.

Non-Destructive Identification of Naturally Aged Alfalfa Seeds via Multispectral Imaging Analysis

Seed aging detection and viable seed prediction are of great significance in alfalfa seed production, but traditional methods are disposable and destructive. Therefore, the establishment of a rapid and non-destructive seed screening method is necessary in seed industry and research. In this study, we used multispectral imaging technology to collect morphological features and spectral traits of aging alfalfa seeds with different storage years. Then, we employed five multivariate analysis methods, i.e., principal component analysis (PCA), linear discrimination analysis (LDA), support vector machines (SVM), random forest (RF) and normalized canonical discriminant analysis (nCDA) to predict aged and viable seeds. The results revealed that the mean light reflectance was significantly different at 450~690 nm between non-aged and aged seeds. LDA model held high accuracy (99.8~100.0%) in distinguishing aged seeds from non-aged seeds, higher than those of SVM (87.4~99.3%) and RF (84.6~99.3%). Furthermore, dead seeds could be distinguished from the aged seeds, with accuracies of 69.7%, 72.0% and 97.6% in RF, SVM and LDA, respectively. The accuracy of nCDA in predicting the germination of aged seeds ranged from 75.0% to 100.0%. In summary, we described a nondestructive, rapid and high-throughput approach to screen aged seeds with various viabilities in alfalfa.

Recent developments and potential of robotics in plant eco-phenotyping

Automated acquisition of plant eco-phenotypic information can serve as a decision-making basis for precision agricultural management and can also provide detailed insights into plant growth status, pest management, water and fertilizer management for plant breeders and plant physiologists. Because the microscopic components and macroscopic morphology of plants will be affected by the ecological environment, research on plant eco-phenotyping is more meaningful than the study of single-plant phenotyping. To achieve high-throughput acquisition of phenotyping information, the combination of high-precision sensors and intelligent robotic platforms have become an emerging research focus. Robotic platforms and automated systems are the important carriers of phenotyping monitoring sensors that enable large-scale screening. Through the diverse design and flexible systems, an efficient operation can be achieved across a range of experimental and field platforms. The combination of robot technology and plant phenotyping monitoring tools provides the data to inform novel artificial intelligence (AI) approaches that will provide steppingstones for new research breakthroughs. Therefore, this article introduces robotics and eco-phenotyping and examines research significant to this novel domain of plant eco-phenotyping. Given the monitoring scenarios of phenotyping information at different scales, the used intelligent robot technology, efficient automation platform, and advanced sensor equipment are summarized in detail. We further discuss the challenges posed to current research as well as the future developmental trends in the application of robot technology and plant eco-phenotyping. These include the use of collected data for AI applications and high-bandwidth data transfer, and large well-structured (meta) data storage approaches in plant sciences and agriculture.

Analysis of color and texture characteristics of cereals on digital images

The color of the grain shell of cereals is an important feature that characterizes the pigments and metabolites contained in it. The grain shell is the main barrier between the grain and the environment, so its characteristics are associated with a number of important biological functions: moisture absorption, grain viability, resistance to pre-harvest germination. The presence of pigments in the shell affects various technological properties of the grain. Color characteristics, as well as the appearance of the grain shell are an important indicator of plant diseases. In addition, the color of the grains serves as a classifying feature of plants. Genetic control of the color formation of both grains and other plant organs is exerted by genes encoding enzymes involved in the biosynthesis of pigments, as well as regulatory genes. For a number of pigments, these genes are well understood, but for some pigments, such as melanin, which causes the black color of grains in barley, the molecular mechanisms of biosynthesis are still poorly understood. When studying the mechanisms of genetic control of grain color, breeders and geneticists are constantly faced with the need to assess the color characteristics of their shell. The technical means of addressing this problem include spectrophotometers, spectrometers, hyperspectral cameras. However, these cameras are expensive, especially with high resolution, both spatial and spectral. An alternative is to use digital cameras that allow you to get high-quality images with high spatial and color resolution. In this regard, recently, in the field of plant phenotyping, methods for evaluating the color and texture characteristics of cereals based on the analysis of two-dimensional images obtained by digital cameras have been intensively developed. This mini-review is devoted to the main tasks related to the analysis of color and texture characteristics of cereals, and to methods of their description based on digital images.

Multispectral and X-ray images for characterization of Jatropha curcas L. seed quality

BACKGROUND

The use of non-destructive methods with less human interference is of great interest in agricultural industry and crop breeding. Modern imaging technologies enable the automatic visualization of multi-parameter for characterization of biological samples, reducing subjectivity and optimizing the analysis process. Furthermore, the combination of two or more imaging techniques has contributed to discovering new physicochemical tools and interpreting datasets in real time.

RESULTS

We present a new method for automatic characterization of seed quality based on the combination of multispectral and X-ray imaging technologies. We proposed an approach using X-ray images to investigate internal tissues because seed surface profile can be negatively affected, but without reaching important internal regions of seeds. An oilseed plant (Jatropha curcas) was used as a model species, which also serves as a multi-purposed crop of economic importance worldwide. Our studies included the application of a normalized canonical discriminant analyses (nCDA) algorithm as a supervised transformation building method to obtain spatial and spectral patterns on different seedlots. We developed classification models using reflectance data and X-ray classes based on linear discriminant analysis (LDA). The classification models, individually or combined, showed high accuracy (> 0.96) using reflectance at 940 nm and X-ray data to predict quality traits such as normal seedlings, abnormal seedlings and dead seeds.

CONCLUSIONS

Multispectral and X-ray imaging have a strong relationship with seed physiological performance. Reflectance at 940 nm and X-ray data can efficiently predict seed quality attributes. These techniques can be alternative methods for rapid, efficient, sustainable and non-destructive characterization of seed quality in the future, overcoming the intrinsic subjectivity of the conventional seed quality analysis.

Heavy metal Hg stress detection in tobacco plant using hyperspectral sensing and data-driven machine learning methods

Accurate detection of heavy metal stress on the growth status of plants is of great concern for agricultural production and management, food security, and ecological environment. A proximal hyperspectral imaging (HSI) system covered the visible/near-infrared (Vis/NIR) region of 400-1000 nm coupled with machine learning methods were employed to discriminate the tobacco plants stressed by different concentration of heavy metal Hg. After acquiring hyperspectral images of tobacco plants stressed by heavy metal Hg with concentration solutions of 0 mg·L-1 (non-stressed groups), 1, 3, and 5 mg·L-1 (3 stressed groups), regions of interest (ROIs) of canopy in tobacco plants were identified for spectra processing. Meanwhile, tobacco plant's appearance and microstructure of mesophyll tissue in tobacco leaves were analyzed. After that, clustering effects of the non-stressed and stressed groups were revealed by score plots and score images calculated by principal component analysis (PCA). Then, loadings of PCA and competitive adaptive reweighted sampling (CARS) algorithm were employed to pick effective wavelengths (EWs) for discriminating non-stressed and stressed samples. Partial least squares discriminant analysis (PLS-DA) and least-squares support vector machine (LS-SVM) were utilized to estimate the stressed tobacco plants status with different concentrations Hg solutions. The performances of those models were evaluated using confusion matrixes (CMes) and receiver operating characteristics (ROC) curves. Results demonstrated that PLS-DA models failed to offer relatively good result, and this algorithm was abandoned to classify the stressed and non-stressed groups of tobacco plants. Compared to LS-SVM model based on full spectra (FS-LS-SVM), the LS-SVM model established EWs selected by CARS (CARS-LS-SVM) carried 13 variables provided an accuracy of 100%, which was promising to achieve the qualitative discrimination of the non-stressed and stressed tobacco plants. Meanwhile, for revealing the discrepancy between 3 stressed groups of tobacco plants, the other FS-LS-SVM, PCA-LS-SVM, and CARS-LS-SVM models were setup and offered relatively low accuracies of 55.56%, 51.11% and 66.67%, respectively. Performance of those 3 LS-SVM discriminative models was also poorly performing to differentiate 3 stressed groups of tobacco plants, which might be caused by low concentration of heavy metal and similar canopy (especially in fresh leaves) of plant. The achievements of the research indicated that HSI coupled with machine learning methods had a powerful potential to discriminate tobacco plant stressed by heavy metal Hg.

Increasing Profitability and Monitoring Environmental Performance: A Case Study in the Agri-Food Industry through an Edge-IoT Platform

Globalization has led to a new paradigm where the traditional industries, such as agriculture, employ vanguard technologies to broaden its possibilities into what is known as smart farming and the agri-food industry 4.0. This industry needs to adapt to the current market through an efficient use of resources while being environmentally friendly. The most commonly used approaches for analyzing efficiency and sustainability on farms are production efficiency based analyses, such as Data Envelopment Analysis and Stochastic Frontier Analysis, since they allow to see how efficient the outputs are generated regardless of the units of measurement of the inputs. This work presents a real scenario for making farms more profitable and sustainable through the analysis of the Data Envelopment Analysis and the application of the Internet of Things and Edge Computing. What makes this model interesting is that it allows monitoring the ambient conditions with real-time data from the different sensors that have been installed on the farm, minimizing costs and gaining robustness in the transmission of the data to the cloud with Edge Computing, and then to have a complete overview in terms of monthly resource efficiency through the Data Envelopment Analysis. The results show that including the costs of edge and non-edge data transfer have an impact on the efficiency. This small-scale study set the basis for a future test with many farms simultaneously.

Cultivar Discrimination of Single Alfalfa (Medicago sativa L.) Seed via Multispectral Imaging Combined with Multivariate Analysis

Rapid and accurate discrimination of alfalfa cultivars is crucial for producers, consumers, and market regulators. However, the conventional routine of alfalfa cultivars discrimination is time-consuming and labor-intensive. In this study, the potential of a new method was evaluated that used multispectral imaging combined with object-wise multivariate image analysis to distinguish alfalfa cultivars with a single seed. Three multivariate analysis methods including principal component analysis (PCA), linear discrimination analysis (LDA), and support vector machines (SVM) were applied to distinguish seeds of 12 alfalfa cultivars based on their morphological and spectral traits. The results showed that the combination of morphological features and spectral data could provide an exceedingly concise process to classify alfalfa seeds of different cultivars with multivariate analysis, while it failed to make the classification with only seed morphological features. Seed classification accuracy of the testing sets was 91.53% for LDA, and 93.47% for SVM. Thus, multispectral imaging combined with multivariate analysis could provide a simple, robust and nondestructive method to distinguish alfalfa seed cultivars.

Machine Learning for Seed Quality Classification: An Advanced Approach Using Merger Data from FT-NIR Spectroscopy and X-ray Imaging

Optical sensors combined with machine learning algorithms have led to significant advances in seed science. These advances have facilitated the development of robust approaches, providing decision-making support in the seed industry related to the marketing of seed lots. In this study, a novel approach for seed quality classification is presented. We developed classifier models using Fourier transform near-infrared (FT-NIR) spectroscopy and X-ray imaging techniques to predict seed germination and vigor. A forage grass (Urochloa brizantha) was used as a model species. FT-NIR spectroscopy data and radiographic images were obtained from individual seeds, and the models were created based on the following algorithms: linear discriminant analysis (LDA), partial least squares discriminant analysis (PLS-DA), random forest (RF), naive Bayes (NB), and support vector machine with radial basis (SVM-r) kernel. In the germination prediction, the models individually reached an accuracy of 82% using FT-NIR data, and 90% using X-ray data. For seed vigor, the models achieved 61% and 68% accuracy using FT-NIR and X-ray data, respectively. Combining the FT-NIR and X-ray data, the performance of the classification model reached an accuracy of 85% to predict germination, and 62% for seed vigor. Overall, the models developed using both NIR spectra and X-ray imaging data in machine learning algorithms are efficient in quickly, non-destructively, and accurately identifying the capacity of seed to germinate. The use of X-ray data and the LDA algorithm showed great potential to be used as a viable alternative to assist in the quality classification of U. brizantha seeds.

Genebank Phenomics: A Strategic Approach to Enhance Value and Utilization of Crop Germplasm

Genetically diverse plant germplasm stored in ex-situ genebanks are excellent resources for breeding new high yielding and sustainable crop varieties to ensure future food security. Novel alleles have been discovered through routine genebank activities such as seed regeneration and characterization, with subsequent utilization providing significant genetic gains and improvements for the selection of favorable traits, including yield, biotic, and abiotic resistance. Although some genebanks have implemented cost-effective genotyping technologies through advances in DNA technology, the adoption of modern phenotyping is lagging. The introduction of advanced phenotyping technologies in recent decades has provided genebank scientists with time and cost-effective screening tools to obtain valuable phenotypic data for more traits on large germplasm collections during routine activities. The utilization of these phenotyping tools, coupled with high-throughput genotyping, will accelerate the use of genetic resources and fast-track the development of more resilient food crops for the future. In this review, we highlight current digital phenotyping methods that can capture traits during annual seed regeneration to enrich genebank phenotypic datasets. Next, we describe strategies for the collection and use of phenotypic data of specific traits for downstream research using high-throughput phenotyping technology. Finally, we examine the challenges and future perspectives of genebank phenomics.