Estimating Plant Nitrogen Concentration of Rice through Fusing Vegetation Indices and Color Moments Derived from UAV-RGB Images

RGB Imaging as a Tool for Remote Sensing of Characteristics of Terrestrial Plants: A Review

Approaches for remote sensing can be used to estimate the influence of changes in environmental conditions on terrestrial plants, providing timely protection of their growth, development, and productivity. Different optical methods, including the informative multispectral and hyperspectral imaging of reflected light, can be used for plant remote sensing; however, multispectral and hyperspectral cameras are technically complex and have a high cost. RGB imaging based on the analysis of color images of plants is definitely simpler and more accessible, but using this tool for remote sensing plant characteristics under changeable environmental conditions requires the development of methods to increase its informativity. Our review focused on using RGB imaging for remote sensing the characteristics of terrestrial plants. In this review, we considered different color models, methods of exclusion of background in color images of plant canopies, and various color indices and their relations to characteristics of plants, using regression models, texture analysis, and machine learning for the estimation of these characteristics based on color images, and some approaches to provide transformation of simple color images to hyperspectral and multispectral images. As a whole, our review shows that RGB imaging can be an effective tool for estimating plant characteristics; however, further development of methods to analyze color images of plants is necessary.

The Uncertainty Assessment by the Monte Carlo Analysis of NDVI Measurements Based on Multispectral UAV Imagery

This paper proposes a workflow to assess the uncertainty of the Normalized Difference Vegetation Index (NDVI), a critical index used in precision agriculture to determine plant health. From a metrological perspective, it is crucial to evaluate the quality of vegetation indices, which are usually obtained by processing multispectral images for measuring vegetation, soil, and environmental parameters. For this reason, it is important to assess how the NVDI measurement is affected by the camera characteristics, light environmental conditions, as well as atmospheric and seasonal/weather conditions. The proposed study investigates the impact of atmospheric conditions on solar irradiation and vegetation reflection captured by a multispectral UAV camera in the red and near-infrared bands and the variation of the nominal wavelengths of the camera in these bands. Specifically, the study examines the influence of atmospheric conditions in three scenarios: dry-clear, humid-hazy, and a combination of both. Furthermore, this investigation takes into account solar irradiance variability and the signal-to-noise ratio (SNR) of the camera. Through Monte Carlo simulations, a sensitivity analysis is carried out against each of the above-mentioned uncertainty sources and their combination. The obtained results demonstrate that the main contributors to the NVDI uncertainty are the atmospheric conditions, the nominal wavelength tolerance of the camera, and the variability of the NDVI values within the considered leaf conditions (dry and fresh).

Real-time and accurate estimation of surgical hemoglobin loss using deep learning-based medical sponges image analysis

Real-time and accurate estimation of surgical hemoglobin (Hb) loss is essential for fluid resuscitation management and evaluation of surgical techniques. In this study, we aimed to explore a novel surgical Hb loss estimation method using deep learning-based medical sponges image analysis. Whole blood samples of pre-measured Hb concentration were collected, and normal saline was added to simulate varying levels of Hb concentration. These blood samples were distributed across blank medical sponges to generate blood-soaked sponges. Eight hundred fifty-one blood-soaked sponges representing a wide range of blood dilutions were randomly divided 7:3 into a training group (n = 595) and a testing group (n = 256). A deep learning model based on the YOLOv5 network was used as the target region extraction and detection, and the three models (Feature extraction technology, ResNet-50, and SE-ResNet50) were trained to predict surgical Hb loss. Mean absolute error (MAE), mean absolute percentage error (MAPE), coefficient (R2) value, and the Bland-Altman analysis were calculated to evaluate the predictive performance in the testing group. The deep learning model based on SE-ResNet50 could predict surgical Hb loss with the best performance (R2 = 0.99, MAE = 11.09 mg, MAPE = 8.6%) compared with other predictive models, and Bland-Altman analysis also showed a bias of 1.343 mg with narrow limits of agreement (- 29.81 to 32.5 mg) between predictive and actual Hb loss. The interactive interface was also designed to display the real-time prediction of surgical Hb loss more intuitively. Thus, it is feasible for real-time estimation of surgical Hb loss using deep learning-based medical sponges image analysis, which was helpful for clinical decisions and technical evaluation.

Detection of wheat Fusarium head blight using UAV-based spectral and image feature fusion

Infection caused by Fusarium head blight (FHB) has severely damaged the quality and yield of wheat in China and threatened the health of humans and livestock. Inaccurate disease detection increases the use cost of pesticide and pollutes farmland, highlighting the need for FHB detection in wheat fields. The combination of spectral and spatial information provided by image analysis facilitates the detection of infection-related damage in crops. In this study, an effective detection method for wheat FHB based on unmanned aerial vehicle (UAV) hyperspectral images was explored by fusing spectral features and image features. Spectral features mainly refer to band features, and image features mainly include texture and color features. Our aim was to explain all aspects of wheat infection through multi-class feature fusion and to find the best FHB detection method for field wheat combining current advanced algorithms. We first evaluated the quality of the two acquired UAV images and eliminated the excessively noisy bands in the images. Then, the spectral features, texture features, and color features in the images were extracted. The random forest (RF) algorithm was used to optimize features, and the importance value of the features determined whether the features were retained. Feature combinations included spectral features, spectral and texture features fusion, and the fusion of spectral, texture, and color features to combine support vector machine, RF, and back propagation neural network in constructing wheat FHB detection models. The results showed that the model based on the fusion of spectral, texture, and color features using the RF algorithm achieved the best performance, with a prediction accuracy of 85%. The method proposed in this study may provide an effective way of FHB detection in field wheat.

Monitoring Key Wheat Growth Variables by Integrating Phenology and UAV Multispectral Imagery Data into Random Forest Model

Rapidly developing remote sensing techniques are shedding new light on large-scale crop growth status monitoring, especially in recent applications of unmanned aerial vehicles (UAVs). Many inversion models have been built to estimate crop growth variables. However, the present methods focused on building models for each single crop stage, and the features generally used in the models are vegetation indices (VI) or joint VI with data derived from UAV-based sensors (e.g., texture, RGB color information, or canopy height). It is obvious these models are either limited to a single stage or have an unstable performance across stages. To address these issues, this study selected four key wheat growth parameters for inversion: above-ground biomass (AGB), plant nitrogen accumulation (PNA) and concentration (PNC), and the nitrogen nutrition index (NNI). Crop data and multispectral data were acquired in five wheat growth stages. Then, the band reflectance and VI were obtained from multispectral data, along with the five stages that were recorded as phenology indicators (PIs) according to the stage of Zadok’s scale. These three types of data formed six combinations (C1–C6): C1 used all of the band reflectances, C2 used all VIs, C3 used bands and VIs, C4 used bands and PIs, C5 used VIs and PIs, and C6 used bands, Vis, and PIs. Some of the combinations were integrated with PIs to verify if PIs can improve the model accuracy. Random forest (RF) was used to build models with combinations of different parameters and evaluate the feature importance. The results showed that all models of different combinations have good performance in the modeling of crop parameters, such as R2 from 0.6 to 0.79 and NRMSE from 10.51 to 15.83%. Then, the model was optimized to understand the importance of PIs. The results showed that the combinations that integrated PIs showed better estimations and the potential of using PIs to minimize features while still achieving good predictions. Finally, the varied model results were evaluated to analyze their performances in different stages or fertilizer treatments. The results showed the models have good performances at different stages or treatments (R2 > 0.6). This paper provides a reference for monitoring and estimating wheat growth parameters based on UAV multispectral imagery and phenology information.

Estimation Model of Potassium Content in Cotton Leaves Based on Wavelet Decomposition Spectra and Image Combination Features

Potassium (K) is one of the most important elements influencing cotton metabolism, quality, and yield. Due to the characteristics of strong fluidity and fast redistribution of the K in plants, it leads to rapid transformation of the K lack or abundance in plant leaves; therefore, rapid and accurate estimation of potassium content in leaves (LKC, %) is a necessary prerequisite to solve the regulation of plant potassium. In this study, we concentrated on the LKC of cotton in different growth stages, an estimation model based on the combined characteristics of wavelet decomposition spectra and image was proposed, and discussed the potential of different combined features in accurate estimation of the LKC. We collected hyperspectral imaging data of 60 main-stem leaves at the budding, flowering, and boll setting stages of cotton, respectively. The original spectrum (R) is decomposed by continuous wavelet transform (CWT). The competitive adaptive reweighted sampling (CARS) and random frog (RF) algorithms combined with partial least squares regression (PLSR) model were used to determine the optimal decomposition scale and characteristic wavelengths at three growth stages. Based on the best "CWT spectra" model, the grayscale image databases were constructed, and the image features were extracted by using color moment and gray level co-occurrence matrix (GLCM). The results showed that the best decomposition scales of the three growth stages were CWT-1, 3, and 9. The best growth stage for estimating LKC in cotton was the boll setting stage, with the feature combination of "CWT-9 spectra + texture," and its determination coefficients (R ²val) and root mean squared error (RMSEval) values were 0.90 and 0.20. Compared with the single R model (R ²val = 0.66, RMSEval = 0.34), the R ²val increased by 0.24. Different from our hypothesis, the combined feature based on "CWT spectra + color + texture" cannot significantly improve the estimation accuracy of the model, it means that the performance of the estimation model established with more feature information is not correspondingly better. Moreover, the texture features contributed more to the improvement of model performance than color features did. These results provide a reference for rapid and non-destructive monitoring of the LKC in cotton.

Rapid Diagnosis of Nitrogen Nutrition Status in Summer Maize over Its Life Cycle by a Multi-Index Synergy Model Using Ground Hyperspectral and UAV Multispectral Sensor Data

Global climate change and the spread of COVID-19 have caused widespread concerns about food security. The development of smart agriculture could contribute to food security; moreover, the targeted and accurate management of crop nitrogen is a topic of concern in the field of smart agriculture. Unmanned aerial vehicle (UAV) spectroscopy has demonstrated versatility in the rapid and non-destructive estimation of nitrogen in summer maize. Previous studies focused on the entire growth season or early stages of summer maize; however, systematic studies on the diagnosis of nitrogen that consider the entire life cycle are few. This study aimed to: (1) construct a practical diagnostic model of the nitrogen life cycle of summer maize based on ground hyperspectral data and UAV multispectral sensor data and (2) evaluate this model and express a change in the trend of nitrogen nutrient status at a spatiotemporal scale. Here, a comprehensive data set consisting of a time series of crop biomass, nitrogen concentration, hyperspectral reflectance, and UAV multispectral reflectance from field experiments conducted during the growing seasons of 2017–2019 with summer maize cultivars grown under five different nitrogen fertilization levels in Beijing, China, were considered. The results demonstrated that the entire life cycle of summer maize was divided into four stages, viz., V6 (mean leaf area index (LAI) = 0.67), V10 (mean LAI = 1.94), V12 (mean LAI = 3.61), and VT-R6 (mean LAI = 3.94), respectively; moreover, the multi-index synergy model demonstrated high accuracy and good stability. The best spectral indexes of these four stages were GBNDVI, TCARI, NRI, and MSAVI2, respectively. The thresholds of the spectral index of nitrogen sufficiency in the V6, V10, V12, VT, R1, R2, and R3–R6 stages were 0.83–0.44, −0.22 to −5.23, 0.42–0.35, 0.69–0.87, 0.60–0.75, 0.49–0.61, and 0.42–0.53, respectively. The simulated nitrogen concentration at the various growth stages of summer maize was consistent with the actual spatial distribution.