Estimating Leaf Nitrogen Content in Corn Based on Information Fusion of Multiple-Sensor Imagery from UAV

The prediction model of nitrogen nutrition in cotton canopy leaves based on hyperspectral visible-near infrared band feature fusion

Hyperspectral remote sensing technology is becoming increasingly popular in various fields due to its ability to provide detailed information about crop growth and nutritional status. The use of hyperspectral technology to predict SPAD (Soil and Plant Analyzer Development) values during cotton growth and adopt precise fertilization management measures is crucial for achieving high yield and fertilizer efficiency. To detect the nitrogen nutrition in cotton canopy leaves quickly, a non-destructive nitrogen nutrition retrieval model was proposed based on the spectral fusion features of the cotton canopy. The hyperspectral vegetation index and multifractal features were fused to predict the SPAD value and identify the amount of fertilizer applied at different levels. The random decision forest algorithm was used as the model predictor and classifier. A method was introduced which was widely used in the fields of finance and stocks (MF-DFA) into the field of agriculture to extract fractal features of cotton spectral reflectance. Comparing the fusion feature with multi-fractal feature and vegetation index, the results showed that the fusion feature parameters had higher accuracy and better stability than using a single feature or feature combination. The R2 was as high as 0.8363, and the RMSE was 1.8767%. Our intelligent model provides a new idea for detecting nitrogen nutrition in cotton canopy leaves rapidly.

Evaluation of macadamia felted coccid (Hemiptera: Eriococcidae) damage and cultivar susceptibility using imagery from a small unmanned aerial vehicle (sUAV), combined with ground truthing

BACKGROUND

Macadamia felted coccid, Acanthococcus ioronsidei (Williams) (Hemiptera: Eriococcidae), is a significant pest of macadamia nut, Macadamia integrifolia Maiden & Betche (Protaceae), in Hawaii, and heavy infestations can kill branches, resulting in characteristic dead, copper-colored leaves. Small Unmanned Aerial Vehicles (sUAV) or 'drones,' combined with spatial data analysis, can provide growers with accurate and high-resolution detection of plant stress due to pest infestations. We investigated the feasibility of using RGB (red-green-blue) color images from sUAV to detect dieback caused by macadamia felted coccid infestation and compared sUAV estimates with ground-based damage estimates (ground truthing).

RESULTS

Spatial analysis showed clustering of foliar damage that reflected cultivar susceptibility to macadamia felted coccid infestation, with cultivars 344 and 856 being susceptible, and cultivars 800 and 333 being tolerant. sUAV and ground-based estimates of foliar damage were similar for the cultivar 344, but ground-based assessments were higher than sUAV for cultivar 856, possibly due to the differences in canopy architecture and significant early dieback in the lower canopy. At foliar damage levels <10%, sUAV and ground truthing data were significantly positively correlated, suggesting sUAV may be useful in detecting early stages of macadamia felted coccid infestation.

CONCLUSIONS

Cultivars showed varying susceptibility to macadamia felted coccid infestation and the foliage damage appeared in clusters. sUAV was able to detect the foliage damage under high and low infestation scenarios suggesting that it can be effectively used for the early detection of infestations. © 2022 The Authors. Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.

Estimation of the nitrogen content of potato plants based on morphological parameters and visible light vegetation indices

Plant nitrogen content (PNC) is an important indicator to characterize the nitrogen nutrition status of crops, and quickly and efficiently obtaining the PNC information aids in fertilization management and decision-making in modern precision agriculture. This study aimed to explore the potential to improve the accuracy of estimating PNC during critical growth periods of potato by combining the visible light vegetation indices (VIs) and morphological parameters (MPs) obtained from an inexpensive UAV digital camera. First, the visible light VIs and three types of MPs, including the plant height (H), canopy coverage (CC) and canopy volume (CV), were extracted from digital images of the potato tuber formation stage (S1), tuber growth stage (S2), and starch accumulation stage (S3). Then, the correlations of VIs and MPs with the PNC were analyzed for each growth stage, and the performance of VIs and MPs in estimating PNC was explored. Finally, three methods, multiple linear regression (MLR), k-nearest neighbors, and random forest, were used to explore the effect of MPs on the estimation of potato PNC using VIs. The results showed that (i) the values of potato H and CC extracted based on UAV digital images were accurate, and the accuracy of the pre-growth stages was higher than that of the late growth stage. (ii) The estimation of potato PNC by visible light VIs was feasible, but the accuracy required further improvement. (iii) As the growing season progressed, the correlation between MPs and PNC gradually decreased, and it became more difficult to estimate the PNC. (iv) Compared with individual MP, multi-MPs can more accurately reflect the morphological structure of the crop and can further improve the accuracy of estimating PNC. (v) Visible light VIs combined with MPs improved the accuracy of estimating PNC, with the highest accuracy of the models constructed using the MLR method (S1: R ² = 0.79, RMSE=0.27, NRMSE=8.19%; S2:R ² = 0.80, RMSE=0.27, NRMSE=8.11%; S3: R ² = 0.76, RMSE=0.26, NRMSE=8.63%). The results showed that the combination of visible light VIs and morphological information obtained by a UAV digital camera could provide a feasible method for monitoring crop growth and plant nitrogen status.

Application of UAV Multisensor Data and Ensemble Approach for High-Throughput Estimation of Maize Phenotyping Traits

High-throughput estimation of phenotypic traits from UAV (unmanned aerial vehicle) images is helpful to improve the screening efficiency of breeding maize. Accurately estimating phenotyping traits of breeding maize at plot scale helps to promote gene mining for specific traits and provides a guarantee for accelerating the breeding of superior varieties. Constructing an efficient and accurate estimation model is the key to the application of UAV-based multiple sensors data. This study aims to apply the ensemble learning model to improve the feasibility and accuracy of estimating maize phenotypic traits using UAV-based red-green-blue (RGB) and multispectral sensors. The UAV images of four growth stages were obtained, respectively. The reflectance of visible light bands, canopy coverage, plant height (PH), and texture information were extracted from RGB images, and the vegetation indices were calculated from multispectral images. We compared and analyzed the estimation accuracy of single-type feature and multiple features for LAI (leaf area index), fresh weight (FW), and dry weight (DW) of maize. The basic models included ridge regression (RR), support vector machine (SVM), random forest (RF), Gaussian process (GP), and K-neighbor network (K-NN). The ensemble learning models included stacking and Bayesian model averaging (BMA). The results showed that the ensemble learning model improved the accuracy and stability of maize phenotypic traits estimation. Among the features extracted from UAV RGB images, the highest accuracy was obtained by the combination of spectrum, structure, and texture features. The model had the best accuracy constructed using all features of two sensors. The estimation accuracies of ensemble learning models, including stacking and BMA, were higher than those of the basic models. The coefficient of determination (R²) of the optimal validation results were 0.852, 0.888, and 0.929 for LAI, FW, and DW, respectively. Therefore, the combination of UAV-based multisource data and ensemble learning model could accurately estimate phenotyping traits of breeding maize at plot scale.

Estimation of amino acid contents in maize leaves based on hyperspectral imaging

Estimation of the amino acid content in maize leaves is helpful for improving maize yield estimation and nitrogen use efficiency. Hyperspectral imaging can be used to obtain the physiological and biochemical parameters of maize leaves with the advantages of being rapid, non-destructive, and high throughput. This study aims to estimate the multiple amino acid contents in maize leaves using hyperspectral imaging data. Two nitrogen (N) fertilizer experiments were carried out to obtain the hyperspectral images of fresh maize leaves. The partial least squares regression (PLSR) method was used to build the estimation models of various amino acid contents by using the reflectance of all bands, sensitive band range, and sensitive bands. The models were then validated with the independent dataset. The results showed that (1) the spectral reflectance of most amino acids was more sensitive in the range of 400-717.08 nm than other bands. The estimation accuracy was better by using the reflectance of the sensitive band range than that of all bands; (2) the sensitive bands of most amino acids were in the ranges of 505.39-605 nm and 651-714 nm; and (3) among the 24 amino acids, the estimation models of the β-aminobutyric acid, ornithine, citrulline, methionine, and histidine achieved higher accuracy than those of other amino acids, with the R ², relative root mean square error (RE), and relative percent deviation (RPD) of the measured and estimated value of testing samples in the range of 0.84-0.96, 8.79%-19.77%, and 2.58-5.18, respectively. This study can provide a non-destructive and rapid diagnostic method for genetic sensitive analysis and variety improvement of maize.

End-to-End Fusion of Hyperspectral and Chlorophyll Fluorescence Imaging to Identify Rice Stresses

Herbicides and heavy metals are hazardous substances of environmental pollution, resulting in plant stress and harming humans and animals. Identification of stress types can help trace stress sources, manage plant growth, and improve stress-resistant breeding. In this research, hyperspectral imaging (HSI) and chlorophyll fluorescence imaging (Chl-FI) were adopted to identify the rice plants under two types of herbicide stresses (butachlor (DCA) and quinclorac (ELK)) and two types of heavy metal stresses (cadmium (Cd) and copper (Cu)). Visible/near-infrared spectra of leaves (L-VIS/NIR) and stems (S-VIS/NIR) extracted from HSI and chlorophyll fluorescence kinetic curves of leaves (L-Chl-FKC) and stems (S-Chl-FKC) extracted from Chl-FI were fused to establish the models to detect the stress of the hazardous substances. Novel end-to-end deep fusion models were proposed for low-level, middle-level, and high-level information fusion to improve identification accuracy. Results showed that the high-level fusion-based convolutional neural network (CNN) models reached the highest detection accuracy (97.7%), outperforming the models using a single data source (<94.7%). Furthermore, the proposed end-to-end deep fusion models required a much simpler training procedure than the conventional two-stage deep learning fusion. This research provided an efficient alternative for plant stress phenotyping, including identifying plant stresses caused by hazardous substances of environmental pollution.

Nitrogen Balance Index Prediction of Winter Wheat by Canopy Hyperspectral Transformation and Machine Learning

Nitrogen balance index (NBI) is an important indicator for scientific diagnostic and quantitative research on crop growth status. The quick and accurate assessment of NBI is necessary for farmers to make timely N management decisions. The objective of the study was to estimate winter wheat NBI based on canopy hyperspectral features between 400–1350 nm combined with machine learning (ML) methods in the individual and whole growth stages. In this study, 3 years of winter wheat plot experiments were conducted. Ground-level canopy hyperspectral reflectance and corresponding plant NBI values were measured during the jointing, booting, flowering and filling stages. Continuous removal spectra (CRS) and logarithmic transformation spectra (LOGS) were derived from the original canopy spectra. Sensitive bands and vegetation indices (VIs) highly correlated with NBI under different spectral transformations were selected as hyperspectral features to construct the NBI estimation models combined with ML algorithms. The study indicated that the spectral transformation significantly improved the correlation between the sensitive bands, VIs and the NBI. The correlation coefficient of the sensitive band in CRS in the booting stage increased by 27.87%, reaching −0.78. The leaf chlorophyll index (LCI) in LOGS had the highest correlation with NBI in the filling stage, reaching a correlation coefficient of −0.96. The NBI prediction accuracies based on the sensitive band combined with VIs were generally better than those based on the univariate hyperspectral feature, and the prediction accuracy of each growth stage was better than that of the whole growth stage. The random forest regression (RFR) method performed better than the support vector regression (SVR) and partial least squares regression (PLS) methods. The NBI estimation model based on the LOGS-RFR method in the filling stage could explain 95% of the NBI variability with relative prediction deviation (RPD) being 3.69. These results will provide a scientific basis for better nitrogen nutrition monitoring, diagnosis, and later for field management of winter wheat.

A Bibliometric Review of the Use of Unmanned Aerial Vehicles in Precision Agriculture and Precision Viticulture for Sensing Applications

This review focuses on the use of unmanned aerial vehicles (UAVs) in precision agriculture, and specifically, in precision viticulture (PV), and is intended to present a bibliometric analysis of their developments in the field. To this aim, a bibliometric analysis of research papers published in the last 15 years is presented based on the Scopus database. The analysis shows that the researchers from the United States, China, Italy and Spain lead the precision agriculture through UAV applications. In terms of employing UAVs in PV, researchers from Italy are fast extending their work followed by Spain and finally the United States. Additionally, the paper provides a comprehensive study on popular journals for academicians to submit their work, accessible funding organizations, popular nations, institutions, and authors conducting research on utilizing UAVs for precision agriculture. Finally, this study emphasizes the necessity of using UAVs in PV as well as future possibilities.

Application of Multispectral Camera in Monitoring the Quality Parameters of Fresh Tea Leaves

The production of high-quality tea by Camellia sinensis (L.) O. Ktze is the goal pursued by both producers and consumers. Rapid, nondestructive, and low-cost monitoring methods for monitoring tea quality could improve the tea quality and the economic benefits associated with tea. This research explored the possibility of monitoring tea leaf quality from multi-spectral images. Threshold segmentation and manual sampling methods were used to eliminate the image background, after which the spectral features were constructed. Based on this, the texture features of the multi-spectral images of the tea canopy were extracted. Three machine learning methods, partial least squares regression, support vector machine regression, and random forest regression (RFR), were used to construct and train multiple monitoring models. Further, the four key quality parameters of tea polyphenols, total sugars, free amino acids, and caffeine content were estimated using these models. Finally, the effects of automatic and manual image background removal methods, different regression methods, and texture features on the model accuracies were compared. The results showed that the spectral characteristics of the canopy of fresh tea leaves were significantly correlated with the tea quality parameters (r ≥ 0.462). Among the sampling methods, the EXG_Ostu sampling method was best for prediction, whereas, among the models, RFR was the best fitted modeling algorithm for three of four quality parameters. The R2 and root-mean-square error values of the built model were 0.85 and 0.16, respectively. In addition, the texture features extracted from the canopy image improved the prediction accuracy of most models. This research confirms the modeling application of a combination of multi-spectral images and chemometrics, as a low-cost, fast, reliable, and nondestructive quality control method, which can effectively monitor the quality of fresh tea leaves. This provides a scientific reference for the research and development of portable tea quality monitoring equipment that has general applicability in the future.