Enhancing the Nitrogen Signals of Rice Canopies across Critical Growth Stages through the Integration of Textural and Spectral Information from Unmanned Aerial Vehicle (UAV) Multispectral Imagery

A global dataset for assessing nitrogen-related plant traits using drone imagery in major field crop species

Enhancing rapid phenotyping for key plant traits, such as biomass and nitrogen content, is critical for effectively monitoring crop growth and maximizing yield. Studies have explored the relationship between vegetation indices (VIs) and plant traits using drone imagery. However, there is a gap in the literature regarding data availability, accessible datasets. Based on this context, we conducted a systematic review to retrieve relevant data worldwide on the state of the art in drone-based plant trait assessment. The final dataset consists of 41 peer-reviewed papers with 11,189 observations for 11 major crop species distributed across 13 countries. It focuses on the association of plant traits with VIs at different growth/phenological stages. This dataset provides foundational knowledge on the key VIs to focus for phenotyping key plant traits. In addition, future updates to this dataset may include new open datasets. Our goal is to continually update this dataset, encourage collaboration and data inclusion, and thereby facilitate a more rapid advance of phenotyping for critical plant traits to increase yield gains over time.

Combining features selection strategy and features fusion strategy for SPAD estimation of winter wheat based on UAV multispectral imagery

The Soil Plant Analysis Development (SPAD) is a vital index for evaluating crop nutritional status and serves as an essential parameter characterizing the reproductive growth status of winter wheat. Non-destructive and accurate monitorin3g of winter wheat SPAD plays a crucial role in guiding precise management of crop nutrition. In recent years, the spectral saturation problem occurring in the later stage of crop growth has become a major factor restricting the accuracy of SPAD estimation. Therefore, the purpose of this study is to use features selection strategy to optimize sensitive remote sensing information, combined with features fusion strategy to integrate multiple characteristic features, in order to improve the accuracy of estimating wheat SPAD. This study conducted field experiments of winter wheat with different varieties and nitrogen treatments, utilized UAV multispectral sensors to obtain canopy images of winter wheat during the heading, flowering, and late filling stages, extracted spectral features and texture features from multispectral images, and employed features selection strategy (Boruta and Recursive Feature Elimination) to prioritize sensitive remote sensing features. The features fusion strategy and the Support Vector Machine Regression algorithm are applied to construct the SPAD estimation model for winter wheat. The results showed that the spectral features of NIR band combined with other bands can fully capture the spectral differences of winter wheat SPAD during the reproductive growth stage, and texture features of the red and NIR band are more sensitive to SPAD. During the heading, flowering, and late filling stages, the stability and estimation accuracy of the SPAD model constructed using both features selection strategy and features fusion strategy are superior to models using only a single feature strategy or no strategy. The enhancement of model accuracy by this method becomes more significant, with the greatest improvement observed during the late filling stage, with R2 increasing by 0.092-0.202, root mean squared error (RMSE) decreasing by 0.076-4.916, and ratio of performance to deviation (RPD) increasing by 0.237-0.960. In conclusion, this method has excellent application potential in estimating SPAD during the later stages of crop growth, providing theoretical basis and technical support for precision nutrient management of field crops.

Optimizing window size and directional parameters of GLCM texture features for estimating rice AGB based on UAVs multispectral imagery

Aboveground biomass (AGB) is a crucial physiological parameter for monitoring crop growth, assessing nutrient status, and predicting yield. Texture features (TFs) derived from remote sensing images have been proven to be crucial for estimating crops AGB, which can effectively address the issue of low accuracy in AGB estimation solely based on spectral information. TFs exhibit sensitivity to the size of the moving window and directional parameters, resulting in a substantial impact on AGB estimation. However, few studies systematically assessed the effects of moving window and directional parameters for TFs extraction on rice AGB estimation. To this end, this study used Unmanned aerial vehicles (UAVs) to acquire multispectral imagery during crucial growth stages of rice and evaluated the performance of TFs derived with different grey level co-occurrence matrix (GLCM) parameters by random forest (RF) regression model. Meanwhile, we analyzed the importance of TFs under the optimal parameter settings. The results indicated that: (1) the appropriate window size for extracting TFs varies with the growth stages of rice plant, wherein a small-scale window demonstrates advantages during the early growth stages, while the opposite holds during the later growth stages; (2) TFs derived from 45° direction represent the optimal choice for estimating rice AGB. During the four crucial growth stages, this selection improved performance in AGB estimation with R2 = 0.76 to 0.83 and rRMSE = 13.62% to 21.33%. Furthermore, the estimation accuracy for the entire growth season is R2 =0.84 and rRMSE =21.07%. However, there is no consensus regarding the selection of the worst TFs computation direction; (3) Correlation (Cor), Mean, and Homogeneity (Hom) from the first principal component image reflecting internal information of rice plant and Contrast (Con), Dissimilarity (Dis), and Second Moment (SM) from the second principal component image expressing edge texture are more important to estimate rice AGB among the whole growth stages; and (4) Considering the optimal parameters, the accuracy of texture-based AGB estimation slightly outperforms the estimation accuracy based on spectral reflectance alone. In summary, the present study can help researchers confident use of GLCM-based TFs to enhance the estimation accuracy of physiological and biochemical parameters of crops.

Estimating potassium in potato plants based on multispectral images acquired from unmanned aerial vehicles

Plant potassium content (PKC) is a crucial indicator of crop potassium nutrient status and is vital in making informed fertilization decisions in the field. This study aims to enhance the accuracy of PKC estimation during key potato growth stages by using vegetation indices (VIs) and spatial structure features derived from UAV-based multispectral sensors. Specifically, the fraction of vegetation coverage (FVC), gray-level co-occurrence matrix texture, and multispectral VIs were extracted from multispectral images acquired at the potato tuber formation, tuber growth, and starch accumulation stages. Linear regression and stepwise multiple linear regression analyses were conducted to investigate how VIs, both individually and in combination with spatial structure features, affect potato PKC estimation. The findings lead to the following conclusions: (1) Estimating potato PKC using multispectral VIs is feasible but necessitates further enhancements in accuracy. (2) Augmenting VIs with either the FVC or texture features makes potato PKC estimation more accurate than when using single VIs. (3) Finally, integrating VIs with both the FVC and texture features improves the accuracy of potato PKC estimation, resulting in notable R 2 values of 0.63, 0.84, and 0.80 for the three fertility periods, respectively, with corresponding root mean square errors of 0.44%, 0.29%, and 0.25%. Overall, these results highlight the potential of integrating canopy spectral information and spatial-structure information obtained from multispectral sensors mounted on unmanned aerial vehicles for monitoring crop growth and assessing potassium nutrient status. These findings thus have significant implications for agricultural management.

SPSI: A Novel Composite Index for Estimating Panicle Number in Winter Wheat before Heading from UAV Multispectral Imagery

Rapid and accurate estimation of panicle number per unit ground area (PNPA) in winter wheat before heading is crucial to evaluate yield potential and regulate crop growth for increasing the final yield. The accuracies of existing methods were low for estimating PNPA with remotely sensed data acquired before heading since the spectral saturation and background effects were ignored. This study proposed a spectral-textural PNPA sensitive index (SPSI) from unmanned aerial vehicle (UAV) multispectral imagery for reducing the spectral saturation and improving PNPA estimation in winter wheat before heading. The effect of background materials on PNPA estimated by textural indices (TIs) was examined, and the composite index SPSI was constructed by integrating the optimal spectral index (SI) and TI. Subsequently, the performance of SPSI was evaluated in comparison with other indices (SI and TIs). The results demonstrated that green-pixel TIs yielded better performances than all-pixel TIs apart from TI[HOM], TI[ENT], and TI[SEM] among all indices from 8 types of textural features. SPSI, which was calculated by the formula DATT[850,730,675] + NDTICOR[850,730], exhibited the highest overall accuracies for any date in any dataset in comparison with DATT[850,730,675], TINDRE[MEA], and NDTICOR[850,730]. For the unified models assembling 2 experimental datasets, the RV2 values of SPSI increased by 0.11 to 0.23, and both RMSE and RRMSE decreased by 16.43% to 38.79% as compared to the suboptimal index on each date. These findings indicated that the SPSI is valuable in reducing the spectral saturation and has great potential to better estimate PNPA using high-resolution satellite imagery.

Retrieving rice (Oryza sativa L.) net photosynthetic rate from UAV multispectral images based on machine learning methods

Photosynthesis is the key physiological activity in the process of crop growth and plays an irreplaceable role in carbon assimilation and yield formation. This study extracted rice (Oryza sativa L.) canopy reflectance based on the UAV multispectral images and analyzed the correlation between 25 vegetation indices (VIs), three textural indices (TIs), and net photosynthetic rate (Pn) at different growth stages. Linear regression (LR), support vector regression (SVR), gradient boosting decision tree (GBDT), random forest (RF), and multilayer perceptron neural network (MLP) models were employed for Pn estimation, and the modeling accuracy was compared under the input condition of VIs, VIs combined with TIs, and fusion of VIs and TIs with plant height (PH) and SPAD. The results showed that VIs and TIs generally had the relatively best correlation with Pn at the jointing-booting stage and the number of VIs with significant correlation (p< 0.05) was the largest. Therefore, the employed models could achieve the highest overall accuracy [coefficient of determination (R ²) of 0.383-0.938]. However, as the growth stage progressed, the correlation gradually weakened and resulted in accuracy decrease (R ² of 0.258-0.928 and 0.125-0.863 at the heading-flowering and ripening stages, respectively). Among the tested models, GBDT and RF models could attain the best performance based on only VIs input (with R ² ranging from 0.863 to 0.938 and from 0.815 to 0.872, respectively). Furthermore, the fusion input of VIs, TIs with PH, and SPAD could more effectively improve the model accuracy (R ² increased by 0.049-0.249, 0.063-0.470, and 0.113-0.471, respectively, for three growth stages) compared with the input combination of VIs and TIs (R ² increased by 0.015-0.090, 0.001-0.139, and 0.023-0.114). Therefore, the GBDT and RF model with fused input could be highly recommended for rice Pn estimation and the methods could also provide reference for Pn monitoring and further yield prediction at field scale.

Non-destructive monitoring of amylose content in rice by UAV-based hyperspectral images

Amylose content (AC) is an important indicator for rice quality grading. The rapid development of unmanned aerial vehicle (UAV) technology provides rich spectral and spatial information on observed objects, making non-destructive monitoring of crop quality possible. To test the potential of UAV-based hyperspectral images in AC estimation, in this study, observations on five rice cultivars were carried out in eastern China (Zhejiang province) for four consecutive years (from 2017 to 2020). The correlations between spectral and textural variables of UAV-based hyperspectral images at different growth stages (booting, heading, filling, and ripening) and AC (%) were analyzed, and the linear regression models based on spectral variables alone, textural variables alone, and combined spectral and textural variables were established. The results showed that the sensitive bands (P< 0.001) to AC were mainly centered in the green (536∽568 nm) and red regions (630∽660nm), with spectral and textural variables at the ripening stage giving the highest negative correlation coefficient of -0.868 and -0.824, respectively. Models based on combined spectral and textural variables give better estimation than those based on spectral or textural variables alone, characterized by less variables and higher accuracy. The best models using spectral or textural variables alone both involved three growth stages (heading, filling, and ripening), with root mean square error (RMSE) of 1.01% and 1.04%, respectively, while the models based on combined spectral and textural variables have RMSE of 1.04% 0.844% with only one (ripening stage) or two (ripening and filling stages) growth stages involved. The combination of spectral and textural variables of UAV-based hyperspectral images is expected to simplify data acquisition and enhance estimation accuracy in remote sensing of rice AC.

Combining spectral and wavelet texture features for unmanned aerial vehicles remote estimation of rice leaf area index

Estimating the crop leaf area index (LAI) accurately is very critical in agricultural remote sensing, especially in monitoring crop growth and yield prediction. The development of unmanned aerial vehicles (UAVs) has been significant in recent years and has been extensively applied in agricultural remote sensing (RS). The vegetation index (VI), which reflects spectral information, is a commonly used RS method for estimating LAI. Texture features can reflect the differences in the canopy structure of rice at different growth stages. In this research, a method was developed to improve the accuracy of rice LAI estimation during the whole growing season by combining texture information based on wavelet transform and spectral information derived from the VI. During the whole growth period, we obtained UAV images of two study areas using a 12-band Mini-MCA system and performed corresponding ground measurements. Several VI values were calculated, and the texture analysis was carried out. New indices were constructed by mathematically combining the wavelet texture and spectral information. Compared with the corresponding VIs, the new indices reduced the saturation effect and were less sensitive to the emergence of panicles. The determination coefficient (R²) increased for most VIs used in this study throughout the whole growth period. The results indicated that the estimation accuracy of LAI by combining spectral information and texture information was higher than that of VIs. The method proposed in this study used the spectral and wavelet texture features extracted from UAV images to establish a model of the whole growth period of rice, which was easy to operate and had great potential for large-scale auxiliary rice breeding and field management research.

Rice Yield Estimation Based on Continuous Wavelet Transform With Multiple Growth Periods

Yield is an important indicator in evaluating rice planting, and it is the collective result of various factors over multiple growth stages. To achieve a large-scale accurate prediction of rice yield, based on yield estimation models using a single growth stage and conventional spectral transformation methods, this study introduced the continuous wavelet transform algorithm and constructed models under the premise of combined multiple growth stages. In this study, canopy reflectance spectra at four important stages of rice elongation, heading, flowering and milky were selected, and then, a rice yield estimation model was constructed by combining vegetation index, first derivative and wavelet transform based on random forest algorithm or multiple stepwise regression. This study found that the combination of multiple growth stages significantly improved the model accuracy. In addition, after two validations, the optimal model combination for rice yield estimation is first derivative-wavelet transform-vegetation index-random forest model based on four growth stages, with the coefficient of determination (R²) of 0.86, the root mean square error (RMSE) of 35.50 g·m^-2 and the mean absolute percentage error (MAPE) of 4.6% for the training set, R² of 0.85, RMSE of 33.40 g.m^-2 and MAPE 4.30% for the validation set 1, and R² of 0.80, RMSE of 37.40 g·m^-2 and MAPE of 4.60% for the validation set 2. The research results demonstrated that the established model could accurately predict rice yield, providing technical support and a foundation for large-scale statistical estimating of rice yield.

Herbage Mass, N Concentration, and N Uptake of Temperate Grasslands Can Adequately Be Estimated from UAV-Based Image Data Using Machine Learning

Precise and timely information on biomass yield and nitrogen uptake in intensively managed grasslands are essential for sustainable management decisions. Imaging sensors mounted on unmanned aerial vehicles (UAVs) along with photogrammetric structure-from-motion processing can provide timely data on crop traits rapidly and non-destructively with a high spatial resolution. The aim of this multi-temporal field study is to estimate aboveground dry matter yield (DMY), nitrogen concentration (N%) and uptake (Nup) of temperate grasslands from UAV-based image data using machine learning (ML) algorithms. The study is based on a two-year dataset from an experimental grassland trial. The experimental setup regarding climate conditions, N fertilizer treatments and slope yielded substantial variations in the dataset, covering a considerable amount of naturally occurring differences in the biomass and N status of grasslands in temperate regions with similar management strategies. Linear regression models and three ML algorithms, namely, random forest (RF), support vector machine (SVM), and partial least squares (PLS) regression were compared with and without a combination of both structural (sward height; SH) and spectral (vegetation indices and single bands) features. Prediction accuracy was quantified using a 10-fold 5-repeat cross-validation (CV) procedure. The results show a significant improvement of prediction accuracy when all structural and spectral features are combined, regardless of the algorithm. The PLS models were outperformed by their respective RF and SVM counterparts. At best, DMY was predicted with a median RMSECV of 197 kg ha−1, N% with a median RMSECV of 0.32%, and Nup with a median RMSECV of 7 kg ha−1. Furthermore, computationally less expensive models incorporating, e.g., only the single multispectral camera bands and SH metrics, or selected features based on variable importance achieved comparable results to the overall best models.

Cotton Yield Estimation Based on Vegetation Indices and Texture Features Derived From RGB Image

Yield monitoring is an important parameter to evaluate cotton productivity during cotton harvest. Nondestructive and accurate yield monitoring is of great significance to cotton production. Unmanned aerial vehicle (UAV) remote sensing has fast and repetitive acquisition ability. The visible vegetation indices has the advantages of low cost, small amount of calculation and high resolution. The combination of the UAV and visible vegetation indices has been more and more applied to crop yield monitoring. However, there are some shortcomings in estimating cotton yield based on visible vegetation indices only as the similarity between cotton and mulch film makes it difficult to differentiate them and yields may be saturated based on vegetation index estimates near harvest. Texture feature is another important remote sensing information that can provide geometric information of ground objects and enlarge the spatial information identification based on original image brightness. In this study, RGB images of cotton canopy were acquired by UAV carrying RGB sensors before cotton harvest. The visible vegetation indices and texture features were extracted from RGB images for cotton yield monitoring. Feature parameters were selected in different methods after extracting the information. Linear and nonlinear methods were used to build cotton yield monitoring models based on visible vegetation indices, texture features and their combinations. The results show that (1) vegetation indices and texture features extracted from the ultra-high-resolution RGB images obtained by UAVs were significantly correlated with the cotton yield; (2) The best model was that combined with vegetation indices and texture characteristics RF_ELM model, verification set R ² was 0.9109, and RMSE was 0.91277 t.ha^-1. rRMSE was 29.34%. In conclusion, the research results prove that UAV carrying RGB sensor has a certain potential in cotton yield monitoring, which can provide theoretical basis and technical support for field cotton production evaluation.

Integrating the Textural and Spectral Information of UAV Hyperspectral Images for the Improved Estimation of Rice Aboveground Biomass

The accurate and rapid estimation of the aboveground biomass (AGB) of rice is crucial to food security. Unmanned aerial vehicles (UAVs) mounted with hyperspectral sensors can obtain images of high spectral and spatial resolution in a quick and effective manner. Integrating UAV-based spatial and spectral information has substantial potential for improving crop AGB estimation. Hyperspectral remote-sensing data with more continuous reflectance information on ground objects provide more possibilities for band selection. The use of band selection for the spectral vegetation index (VI) has been discussed in many studies, but few studies have paid attention to the band selection of texture features in rice AGB estimation. In this study, UAV-based hyperspectral images of four rice varieties in five nitrogen treatments (N0, N1, N2, N3, and N4) were obtained. First, multiple spectral bands were used to identify the optimal bands of the spectral vegetation indices, as well as the texture features; next, the vegetation index model (VI model), the vegetation index combined with the corresponding-band textures model (VI+CBT model), and the vegetation index combined with the full-band textures model (VI+FBT model) were established to compare their respective rice AGB estimation abilities. The results showed that the optimal bands of the spectral and textural information for AGB monitoring were inconsistent. The red-edge and near-infrared bands demonstrated a strong correlation with the rice AGB in the spectral dimension, while the green and red bands exhibited a high correlation with the rice AGB in the spatial dimension. The ranking of the monitoring accuracies of the three models, from highest to lowest, was: the VI+FBT model, then the VI+CBT model, and then the VI model. Compared with the VI model, the R2 of the VI+FBT model and the VI+CBT model increased by 1.319% and 9.763%, respectively. The RMSE decreased by 2.070% and 16.718%, respectively, while the rRMSE decreased by 2.166% and 16.606%, respectively. The results indicated that the integration of vegetation indices and textures can significantly improve the accuracy of rice AGB estimation. The full-band textures contained richer information that was highly related to rice AGB. The VI model at the tillering stage presented the greatest sensitivity to the integration of textures, and the models in the N3 treatment (1.5 times the normal nitrogen level) gave the best AGB estimation compared with the other nitrogen treatments. This research proposes a reliable modeling framework for monitoring rice AGB and provides scientific support for rice-field management.

Multiple UAV Flights across the Growing Season Can Characterize Fine Scale Phenological Heterogeneity within and among Vegetation Functional Groups

Grasslands and shrublands exhibit pronounced spatial and temporal variability in structure and function with differences in phenology that can be difficult to observe. Unpiloted aerial vehicles (UAVs) can measure vegetation spectral patterns relatively cheaply and repeatably at fine spatial resolution. We tested the ability of UAVs to measure phenological variability within vegetation functional groups and to improve classification accuracy at two sites in Montana, U.S.A. We tested four flight frequencies during the growing season. Classification accuracy based on reference data increased by 5–10% between a single flight and scenarios including all conducted flights. Accuracy increased from 50.6 to 61.4% at the drier site, while at the more mesic/densely vegetated site, we found an increase of 59.0 to 64.4% between a single and multiple flights over the growing season. Peak green-up varied by 2–4 weeks within the scenes, and sparse vegetation classes had only a short detectable window of active phtosynthesis; therefore, a single flight could not capture all vegetation that was active across the growing season. The multi-temporal analyses identified differences in the seasonal timing of green-up and senescence within herbaceous and sagebrush classes. Multiple UAV measurements can identify the fine-scale phenological variability in complex mixed grass/shrub vegetation.

Identification of High Nitrogen Use Efficiency Phenotype in Rice (Oryza sativa L.) Through Entire Growth Duration by Unmanned Aerial Vehicle Multispectral Imagery

Identification of high Nitrogen Use Efficiency (NUE) phenotypes has been a long-standing challenge in breeding rice and sustainable agriculture to reduce the costs of nitrogen (N) fertilizers. There are two main challenges: (1) high NUE genetic sources are biologically scarce and (2) on the technical side, few easy, non-destructive, and reliable methodologies are available to evaluate plant N variations through the entire growth duration (GD). To overcome the challenges, we captured a unique higher NUE phenotype in rice as a dynamic time-series N variation curve through the entire GD analysis by canopy reflectance data collected by Unmanned Aerial Vehicle Remote Sensing Platform (UAV-RSP) for the first time. LY9348 was a high NUE rice variety with high Nitrogen Uptake Efficiency (NUpE) and high Nitrogen Utilization Efficiency (NUtE) shown in nitrogen dosage field analysis. Its canopy nitrogen content (CNC) was analyzed by the high-throughput UAV-RSP to screen two mixed categories (51 versus 42 varieties) selected from representative higher NUE indica rice collections. Five Vegetation Indices (VIs) were compared, and the Normalized Difference Red Edge Index (NDRE) showed the highest correlation with CNC (r = 0.80). Six key developmental stages of rice varieties were compared from transplantation to maturation, and the high NUE phenotype of LY9348 was shown as a dynamic N accumulation curve, where it was moderately high during the vegetative developmental stages but considerably higher in the reproductive developmental stages with a slower reduction rate. CNC curves of different rice varieties were analyzed to construct two non-linear regression models between N% or N% × leaf area index (LAI) with NDRE separately. Both models could determine the specific phenotype with the coefficient of determination (R 2) above 0.61 (Model I) and 0.86 (Model II). Parameters influencing the correlation accuracy between NDRE and N% were found to be better by removing the tillering stage data, separating the short and long GD varieties for the analysis and adding canopy structures, such as LAI, into consideration. The high NUE phenotype of LY9348 could be traced and reidentified across different years, locations, and genetic germplasm groups. Therefore, an effective and reliable high-throughput method was proposed for assisting the selection of the high NUE breeding phenotype.

Leaf area index estimation model for UAV image hyperspectral data based on wavelength variable selection and machine learning methods

BACKGROUND

To accurately estimate winter wheat leaf area index (LAI) using unmanned aerial vehicle (UAV) hyperspectral imagery is crucial for crop growth monitoring, fertilization management, and development of precision agriculture.

METHODS

The UAV hyperspectral imaging data, Analytical Spectral Devices (ASD) data, and LAI were simultaneously obtained at main growth stages (jointing stage, booting stage, and filling stage) of various winter wheat varieties under various nitrogen fertilizer treatments. The characteristic bands related to LAI were extracted from UAV hyperspectral data with different algorithms including first derivative (FD), successive projections algorithm (SPA), competitive adaptive reweighed sampling (CARS), and competitive adaptive reweighed sampling combined with successive projections algorithm (CARS_SPA). Furthermore, three modeling machine learning methods including partial least squares regression (PLSR), support vector machine regression (SVR), and extreme gradient boosting (Xgboost) were used to build LAI estimation models.

RESULTS

The results show that the correlation coefficient between UAV and ASD hyperspectral data is greater than 0.99, indicating the UAV data can be used for estimation of wheat growth information. The LAI bands selected by using different algorithms were slightly different among the 15 models built in this study. The Xgboost model using nine consecutive characteristic bands selected by CARS_SPA algorithm as input was proved to have the best performance. This model yielded identical results of coefficient of determination (0.89) for both calibration set and validation set, indicating a high accuracy of this model.

CONCLUSIONS

The Xgboost modeling method in combine with CARS_SPA algorithm can reduce input variables and improve the efficiency of model operation. The results provide reference and technical support for nondestructive and rapid estimation of winter wheat LAI by using UAV.

Estimating Plant Nitrogen Concentration of Rice through Fusing Vegetation Indices and Color Moments Derived from UAV-RGB Images

Estimating plant nitrogen concentration (PNC) has been conducted using vegetation indices (VIs) from UAV-based imagery, but color features have been rarely considered as additional variables. In this study, the VIs and color moments (color feature) were calculated from UAV-based RGB images, then partial least square regression (PLSR) and random forest regression (RF) models were established to estimate PNC through fusing VIs and color moments. The results demonstrated that the fusion of VIs and color moments as inputs yielded higher accuracies of PNC estimation compared to VIs or color moments as input; the RF models based on the combination of VIs and color moments (R2 ranging from 0.69 to 0.91 and NRMSE ranging from 0.07 to 0.13) showed similar performances to the PLSR models (R2 ranging from 0.68 to 0.87 and NRMSE ranging from 0.10 to 0.29); Among the top five important variables in the RF models, there was at least one variable which belonged to the color moments in different datasets, indicating the significant contribution of color moments in improving PNC estimation accuracy. This revealed the great potential of combination of RGB-VIs and color moments for the estimation of rice PNC.

Estimating the Leaf Nitrogen Content with a New Feature Extracted from the Ultra-High Spectral and Spatial Resolution Images in Wheat

Real-time and accurate monitoring of nitrogen content in crops is crucial for precision agriculture. Proximal sensing is the most common technique for monitoring crop traits, but it is often influenced by soil background and shadow effects. However, few studies have investigated the classification of different components of crop canopy, and the performance of spectral and textural indices from different components on estimating leaf nitrogen content (LNC) of wheat remains unexplored. This study aims to investigate a new feature extracted from near-ground hyperspectral imaging data to estimate precisely the LNC of wheat. In field experiments conducted over two years, we collected hyperspectral images at different rates of nitrogen and planting densities for several varieties of wheat throughout the growing season. We used traditional methods of classification (one unsupervised and one supervised method), spectral analysis (SA), textural analysis (TA), and integrated spectral and textural analysis (S-TA) to classify the images obtained as those of soil, panicles, sunlit leaves (SL), and shadowed leaves (SHL). The results show that the S-TA can provide a reasonable compromise between accuracy and efficiency (overall accuracy = 97.8%, Kappa coefficient = 0.971, and run time = 14 min), so the comparative results from S-TA were used to generate four target objects: the whole image (WI), all leaves (AL), SL, and SHL. Then, those objects were used to determine the relationships between the LNC and three types of indices: spectral indices (SIs), textural indices (TIs), and spectral and textural indices (STIs). All AL-derived indices achieved more stable relationships with the LNC than the WI-, SL-, and SHL-derived indices, and the AL-derived STI was the best index for estimating the LNC in terms of both calibration (Rc2 = 0.78, relative root mean-squared error (RRMSEc) = 13.5%) and validation (Rv2 = 0.83, RRMSEv = 10.9%). It suggests that extracting the spectral and textural features of all leaves from near-ground hyperspectral images can precisely estimate the LNC of wheat throughout the growing season. The workflow is promising for the LNC estimation of other crops and could be helpful for precision agriculture.

Monitoring Wheat Fusarium Head Blight Using Unmanned Aerial Vehicle Hyperspectral Imagery

The monitoring of winter wheat Fusarium head blight via rapid and non-destructive measures is important for agricultural production and disease control. Images of unmanned aerial vehicles (UAVs) are particularly suitable for the monitoring of wheat diseases because they feature high spatial resolution and flexible acquisition time. This study evaluated the potential to monitor Fusarium head blight via UAV hyperspectral imagery. The field site investigated by this study is located in Lujiang County, Anhui Province, China. The hyperspectral UAV images were acquired on 3 and 8 May 2019, when wheat was at the grain filling stage. Several features, including original spectral bands, vegetation indexes, and texture features, were extracted from these hyperspectral images. Based on these extracted features, univariate Fusarium monitoring models were developed, and backward feature selection was applied to filter these features. The backpropagation (BP) neural network was improved by integrating a simulated annealing algorithm in the experiment. A multivariate Fusarium head blight monitoring model was developed using the improved BP neural network. The results showed that bands in the red region provide important information for discriminating between wheat canopies that are either slightly or severely Fusarium-head-blight-infected. The modified chlorophyll absorption reflectance index performed best among all features, with an area under the curve and standard deviation of 1.0 and 0.0, respectively. Five commonly used methods were compared with this improved BP neural network. The results showed that the developed Fusarium head blight monitoring model achieved the highest overall accuracy of 98%. In addition, the difference between the producer accuracy and user accuracy of the improved BP neural network was smallest among all models, indicating that this model achieved better stability. These results demonstrate that hyperspectral images of UAVs can be used to monitor Fusarium head blight in winter wheat.

Transforming Unmanned Aerial Vehicle (UAV) and Multispectral Sensor into a Practical Decision Support System for Precision Nitrogen Management in Corn

Determining the optimal nitrogen (N) rate in corn remains a critical issue, mainly due to unaccounted spatial (e.g., soil properties) and temporal (e.g., weather) variability. Unmanned aerial vehicles (UAVs) equipped with multispectral sensors may provide opportunities to improve N management by the timely informing of spatially variable, in-season N applications. Here, we developed a practical decision support system (DSS) to translate spatial field characteristics and normalized difference red edge (NDRE) values into an in-season N application recommendation. On-farm strip-trials were established at three sites over two years to compare farmer’s traditional N management to a split-application N management guided by our UAV sensor-based DSS. The proposed systems increased nitrogen use efficiency 18.3 ± 6.1 kg grain kg N−1 by reducing N rates by 31 ± 6.3 kg N ha−1 with no yield differences compared to the farmers’ traditional management. We identify five avenues for further improvement of the proposed DSS: definition of the initial base N rate, estimation of inputs for sensor algorithms, management zone delineation, high-resolution image normalization approach, and the threshold for triggering N application. Two virtual reference (VR) methods were compared with the high N (HN) reference strip method for normalizing high-resolution sensor data. The VR methods resulted in significantly lower sufficiency index values than those generated by the HN reference, resulting in N fertilization recommendations that were 31.4 ± 10.3 kg ha−1 higher than the HN reference N fertilization recommendation. The use of small HN reference blocks in contrasting management zones may be more appropriate to translate field-scale, high-resolution imagery into in-season N recommendations. In view of a growing interest in using UAVs in commercial fields and the need to improve crop NUE, further work is needed to refine approaches for translating imagery into in-season N recommendations.

Prediction of Biomass and N Fixation of Legume-Grass Mixtures Using Sensor Fusion

European farmers and especially organic farmers rely on legume-grass mixtures in their crop rotation as an organic nitrogen (N) source, as legumes can fix atmospheric N, which is the most important element for plant growth. Furthermore, legume-grass serves as valuable fodder for livestock and biogas plants. Therefore, information about aboveground biomass and N fixation (NFix) is crucial for efficient farm management decisions on the field level. Remote sensing, as a non-destructive and fast technique, provides different methods to quantify plant trait parameters. In our study, high-density point clouds, derived from terrestrial laser scanning (TLS), in combination with unmanned aerial vehicle-based multispectral (MS) data, were collected to receive information about three plant trait parameters (fresh and dry matter, nitrogen fixation) in two legume-grass mixtures. Several crop surface height metrics based on TLS and vegetation indices based on the four MS bands (green, red, red edge, and near-infrared) were calculated. Furthermore, eight texture features based on mean crop surface height and the four MS bands were generated to measure horizontal spatial heterogeneity. The aim of this multi-temporal study over two vegetation periods was to create estimation models based on biomass and N fixation for two legume-grass mixtures by sensor fusion, a combination of both sensors. To represent conditions in practical farming, e.g., the varying proportion of legumes, the experiment included pure stands of legume and grass of the mixtures. Sensor fusion of TLS and MS data was found to provide better estimates of biomass and N _Fix than separate data analysis. The study shows the important role of texture based on MS and point cloud data, which contributed greatly to the estimation model generation. The applied approach offers an interesting method for improvements in precision agriculture.