Classification of Rice Yield Using UAV-Based Hyperspectral Imagery and Lodging Feature

Fine classification of rice fields in high-resolution remote sensing images

Fine-grained management of rice fields can enhance the yield and quality of rice crops. Challenges in achieving fine classification include interference from similar vegetation, the irregularity of natural field shapes, and complex scale variations. This paper introduces Rice Attention Cascade Network (RACNet), for the fine classification of rice fields in high-resolution satellite remote sensing imagery. The network employs the Hybrid Task Cascade network as the base framework and uses spectral and indices mixed multimodal data as input to reinforce the feature differentiation of similar vegetation. Initially, a Channel Attention Deformable-ResNet (CAD-ResNet) was designed to enhance the feature representation of rice on different channels. Deformable convolution improves the ability of CAD-ResNet to capture irregular field shapes. Then, to address the issue of complex scale changes, the multi-scale features extracted by the CAD-ResNet are progressively fused using an Asymptotic Feature Pyramid, reducing the loss of scale information between non-adjacent layers. Experiments on the Meishan rice dataset show that the proposed method is capable of accurate instance segmentation for fragmented or irregularly shaped rice fields. The evaluation metric AP50 of RACNet reaches 50.8%.

DC2Net: An Asian Soybean Rust Detection Model Based on Hyperspectral Imaging and Deep Learning

Asian soybean rust (ASR) is one of the major diseases that causes serious yield loss worldwide, even up to 80%. Early and accurate detection of ASR is critical to reduce economic losses. Hyperspectral imaging, combined with deep learning, has already been proved as a powerful tool to detect crop diseases. However, current deep learning models are limited to extract both spatial and spectral features in hyperspectral images due to the use of fixed geometric structure of the convolutional kernels, leading to the fact that the detection accuracy of current models remains further improvement. In this study, we proposed a deformable convolution and dilated convolution neural network (DC2Net) for the ASR detection. The deformable convolution module was used to extract the spatial features, while the dilated convolution module was applied to extract features from the spectral dimension. We also adopted the Shapley value and the channel attention methods to evaluate the importance of each wavelength during decision-making, thereby identifying the most contributing ones. The proposed DC2Net can realize early asymptomatic detection of ASR even when visual symptoms have not appeared. The results of the experiment showed that the detection performance of DC2Net dominated state-of-the-art methods, reaching an overall accuracy at 96.73%. Meanwhile, the experimental result suggested that the Shapley Additive exPlanations method was able to extract feature wavelengths correctly, thereby helping DC2Net achieve reasonable performance with less input data. The research result of this study could provide early warning of ASR outbreak in advance, even at the asymptomatic period.

Are unmanned aerial vehicle-based hyperspectral imaging and machine learning advancing crop science?

The past few years have seen increased interest in unmanned aerial vehicle (UAV)-based hyperspectral imaging (HSI) and machine learning (ML) in agricultural research, concomitant with an increase in published research on these topics. We provide an updated review, written for agriculturalists, highlighting the benefits in the retrieval of biophysical parameters of crops via UAVs relative to less sophisticated options. We reviewed >70 recent papers and found few consistent results between similar studies. Owing to their high complexity and cost, especially when applied to crops of low value, the benefits of most of the research reviewed are difficult to explain. Future effort will be necessary to distill research findings into lower-cost options for end-users.

Field phenotyping for African crops: overview and perspectives

Improvements in crop productivity are required to meet the dietary demands of the rapidly-increasing African population. The development of key staple crop cultivars that are high-yielding and resilient to biotic and abiotic stresses is essential. To contribute to this objective, high-throughput plant phenotyping approaches are important enablers for the African plant science community to measure complex quantitative phenotypes and to establish the genetic basis of agriculturally relevant traits. These advances will facilitate the screening of germplasm for optimum performance and adaptation to low-input agriculture and resource-constrained environments. Increasing the capacity to investigate plant function and structure through non-invasive technologies is an effective strategy to aid plant breeding and additionally may contribute to precision agriculture. However, despite the significant global advances in basic knowledge and sensor technology for plant phenotyping, Africa still lags behind in the development and implementation of these systems due to several practical, financial, geographical and political barriers. Currently, field phenotyping is mostly carried out by manual methods that are prone to error, costly, labor-intensive and may come with adverse economic implications. Therefore, improvements in advanced field phenotyping capabilities and appropriate implementation are key factors for success in modern breeding and agricultural monitoring. In this review, we provide an overview of the current state of field phenotyping and the challenges limiting its implementation in some African countries. We suggest that the lack of appropriate field phenotyping infrastructures is impeding the development of improved crop cultivars and will have a detrimental impact on the agricultural sector and on food security. We highlight the prospects for integrating emerging and advanced low-cost phenotyping technologies into breeding protocols and characterizing crop responses to environmental challenges in field experimentation. Finally, we explore strategies for overcoming the barriers and maximizing the full potential of emerging field phenotyping technologies in African agriculture. This review paper will open new windows and provide new perspectives for breeders and the entire plant science community in Africa.

Multispectral Drone Imagery and SRGAN for Rapid Phenotypic Mapping of Individual Chinese Cabbage Plants

The phenotypic parameters of crop plants can be evaluated accurately and quickly using an unmanned aerial vehicle (UAV) equipped with imaging equipment. In this study, hundreds of images of Chinese cabbage (Brassica rapa L. ssp. pekinensis) germplasm resources were collected with a low-cost UAV system and used to estimate cabbage width, length, and relative chlorophyll content (soil plant analysis development [SPAD] value). The super-resolution generative adversarial network (SRGAN) was used to improve the resolution of the original image, and the semantic segmentation network Unity Networking (UNet) was used to process images for the segmentation of each individual Chinese cabbage. Finally, the actual length and width were calculated on the basis of the pixel value of the individual cabbage and the ground sampling distance. The SPAD value of Chinese cabbage was also analyzed on the basis of an RGB image of a single cabbage after background removal. After comparison of various models, the model in which visible images were enhanced with SRGAN showed the best performance. With the validation set and the UNet model, the segmentation accuracy was 94.43%. For Chinese cabbage dimensions, the model was better at estimating length than width. The R² of the visible-band model with images enhanced using SRGAN was greater than 0.84. For SPAD prediction, the R² of the model with images enhanced with SRGAN was greater than 0.78. The root mean square errors of the 3 semantic segmentation network models were all less than 2.18. The results showed that the width, length, and SPAD value of Chinese cabbage predicted using UAV imaging were comparable to those obtained from manual measurements in the field. Overall, this research demonstrates not only that UAVs are useful for acquiring quantitative phenotypic data on Chinese cabbage but also that a regression model can provide reliable SPAD predictions. This approach offers a reliable and convenient phenotyping tool for the investigation of Chinese cabbage breeding traits.

Estimation of amino acid contents in maize leaves based on hyperspectral imaging

Estimation of the amino acid content in maize leaves is helpful for improving maize yield estimation and nitrogen use efficiency. Hyperspectral imaging can be used to obtain the physiological and biochemical parameters of maize leaves with the advantages of being rapid, non-destructive, and high throughput. This study aims to estimate the multiple amino acid contents in maize leaves using hyperspectral imaging data. Two nitrogen (N) fertilizer experiments were carried out to obtain the hyperspectral images of fresh maize leaves. The partial least squares regression (PLSR) method was used to build the estimation models of various amino acid contents by using the reflectance of all bands, sensitive band range, and sensitive bands. The models were then validated with the independent dataset. The results showed that (1) the spectral reflectance of most amino acids was more sensitive in the range of 400-717.08 nm than other bands. The estimation accuracy was better by using the reflectance of the sensitive band range than that of all bands; (2) the sensitive bands of most amino acids were in the ranges of 505.39-605 nm and 651-714 nm; and (3) among the 24 amino acids, the estimation models of the β-aminobutyric acid, ornithine, citrulline, methionine, and histidine achieved higher accuracy than those of other amino acids, with the R ², relative root mean square error (RE), and relative percent deviation (RPD) of the measured and estimated value of testing samples in the range of 0.84-0.96, 8.79%-19.77%, and 2.58-5.18, respectively. This study can provide a non-destructive and rapid diagnostic method for genetic sensitive analysis and variety improvement of maize.

Evaluation of important phenotypic parameters of tea plantations using multi-source remote sensing data

Tea height, leaf area index, canopy water content, leaf chlorophyll, and nitrogen concentrations are important phenotypic parameters to reflect the status of tea growth and guide the management of tea plantation. UAV multi-source remote sensing is an emerging technology, which can obtain more abundant multi-source information and enhance dynamic monitoring ability of crops. To monitor the phenotypic parameters of tea canopy more efficiently, we first deploy UAVs equipped with multispectral, thermal infrared, RGB, LiDAR, and tilt photography sensors to acquire phenotypic remote sensing data of tea canopy, and then, we utilize four machine learning algorithms to model the single-source and multi-source data, respectively. The results show that, on the one hand, using multi-source data sets to evaluate H, LAI, W, and LCC can greatly improve the accuracy and robustness of the model. LiDAR + TC data sets are suggested for assessing H, and the SVM model delivers the best estimation (Rp² = 0.82 and RMSEP = 0.078). LiDAR + TC + MS data sets are suggested for LAI assessment, and the SVM model delivers the best estimation (Rp² = 0.90 and RMSEP = 0.40). RGB + TM data sets are recommended for evaluating W, and the SVM model delivers the best estimation (Rp² = 0.62 and RMSEP = 1.80). The MS +RGB data set is suggested for studying LCC, and the RF model offers the best estimation (Rp² = 0.87 and RMSEP = 1.80). On the other hand, using single-source data sets to evaluate LNC can greatly improve the accuracy and robustness of the model. MS data set is suggested for assessing LNC, and the RF model delivers the best estimation (Rp² = 0.65 and RMSEP = 0.85). The work revealed an effective technique for obtaining high-throughput tea crown phenotypic information and the best model for the joint analysis of diverse phenotypes, and it has significant importance as a guiding principle for the future use of artificial intelligence in the management of tea plantations.

High-throughput field crop phenotyping: current status and challenges

In contrast to the rapid advances made in plant genotyping, plant phenotyping is considered a bottleneck in plant science. This has promoted high-throughput plant phenotyping (HTP) studies, resulting in an exponential increase in phenotyping-related publications. The development of HTP was originally intended for use as indoor HTP technologies for model plant species under controlled environments. However, this subsequently shifted to HTP for use in crops in fields. Although HTP in fields is much more difficult to conduct due to unstable environmental conditions compared to HTP in controlled environments, recent advances in HTP technology have allowed these difficulties to be overcome, allowing for rapid, efficient, non-destructive, non-invasive, quantitative, repeatable, and objective phenotyping. Recent HTP developments have been accelerated by the advances in data analysis, sensors, and robot technologies, including machine learning, image analysis, three dimensional (3D) reconstruction, image sensors, laser sensors, environmental sensors, and drones, along with high-speed computational resources. This article provides an overview of recent HTP technologies, focusing mainly on canopy-based phenotypes of major crops, such as canopy height, canopy coverage, canopy biomass, and canopy stressed appearance, in addition to crop organ detection and counting in the fields. Current topics in field HTP are also presented, followed by a discussion on the low rates of adoption of HTP in practical breeding programs.