Automatic Identification and Monitoring of Plant Diseases Using Unmanned Aerial Vehicles: A Review

Monitoring the leaf damage by the rice leafroller with deep learning and ultra-light UAV

BACKGROUND

Rice leafroller is a serious threat to the production of rice. Monitoring the damage caused by rice leafroller is essential for effective pest management. Owing to limitations in collecting decent quality images and high-performing identification methods to recognize the damage, studies recommending fast and accurate identification of rice leafroller damage are rare. In this study, we employed an ultra-lightweight unmanned aerial vehicle (UAV) to eliminate the influence of the downwash flow field and obtain very high-resolution images of the damaged areas of the rice leafroller. We used deep learning technology and the segmentation model, Attention U-Net, to recognize the damaged area by the rice leafroller. Further, a method is presented to count the damaged patches from the segmented area.

RESULTS

The result shows that Attention U-Net achieves high performance, with an F1 score of 0.908. Further analysis indicates that the deep learning model performs better than the traditional image classification method, Random Forest (RF). The traditional method of RF causes a lot of false alarms around the edge of leaves, and is sensitive to the changes in brightness. Validation based on the ground survey indicates that the UAV and deep learning-based method achieve a reasonable accuracy in identifying damage patches, with a coefficient of determination of 0.879. The spatial distribution of the damage is uneven, and the UAV-based image collecting method provides a dense and accurate method to recognize the damaged area.

CONCLUSION

Overall, this study presents a vision to monitor the damage caused by the rice leafroller with ultra-light UAV efficiently. It would also contribute to effectively controlling and managing the hazardous rice leafroller. © 2024 Society of Chemical Industry.

Australian Cool-Season Pulse Seed-Borne Virus Research: 1. Alfalfa and Cucumber Mosaic Viruses and Less Important Viruses

Here, we review the research undertaken since the 1950s in Australia's grain cropping regions on seed-borne virus diseases of cool-season pulses caused by alfalfa mosaic virus (AMV) and cucumber mosaic virus (CMV). We present brief background information about the continent's pulse industry, virus epidemiology, management principles and future threats to virus disease management. We then take a historical approach towards all past investigations with these two seed-borne pulse viruses in the principal cool-season pulse crops grown: chickpea, faba bean, field pea, lentil, narrow-leafed lupin and white lupin. With each pathosystem, the main focus is on its biology, epidemiology and management, placing particular emphasis on describing field and glasshouse experimentation that enabled the development of effective phytosanitary, cultural and host resistance control strategies. Past Australian cool-season pulse investigations with AMV and CMV in the less commonly grown species (vetches, narbon bean, fenugreek, yellow and pearl lupin, grass pea and other Lathyrus species) and those with the five less important seed-borne pulse viruses also present (broad bean stain virus, broad bean true mosaic virus, broad bean wilt virus, cowpea mild mottle virus and peanut mottle virus) are also summarized. The need for future research is emphasized, and recommendations are made regarding what is required.

Vegetation Indices for Early Grey Mould Detection in Lettuce Grown under Different Lighting Conditions

Early detection of pathogenic fungi in controlled environment areas can prevent major food production losses. Grey mould caused by Botrytis cinerea is often detected as an infection on lettuce. This paper explores the use of vegetation indices for early detection and monitoring of grey mould on lettuce under different lighting conditions in controlled environment chambers. The aim was focused on the potential of using vegetation indices for the early detection of grey mould and on evaluating their changes during disease development in lettuce grown under different lighting conditions. The experiment took place in controlled environment chambers, where day/night temperatures were 21 ± 2/17 ± 2 °C, a 16 h photoperiod was established, and relative humidity was 70 ± 10% under different lighting conditions: high-pressure sodium (HPS) and light-emitting diode (LED) lamps. Lettuces were inoculated by 7-day-old fungus Botrytis cinerea isolate at the BBCH 21. As a control, non-inoculated lettuces were grown under HPS and LEDs (non-inoculated). Then, the following were evaluated: Anthocyanin Reflectance Index 2 (ARI2); Carotenoid Reflectance Index 2 (CRI2); Structure Intensive Pigment Index (SIPI); Flavanol Reflectance Index (FRI); Greenness (G); Greenness 2 (G2); Redness (R); Blue (B); Blue Green Index 2 (BGI2); Browning Index 2 (BRI2); Lichtenthaler Index 1 (LIC1); Pigment Specific Simple Ratio (PSSRa and PSSRb); Gitelson and Merzlyak (GM1 and GM2); Zarco Tejada-Miller Index (ZMI); Normalized Difference Vegetation Index (NDVI); Simple Ratio (SR); Red-Eye Vegetation Stress Index (RVSI); Photochemical Reflectance Index (PRI); Photochemical Reflectance Index 515 (PRI515); Water Band Index (WBI); specific disease index for individual study (fD); Healthy Index (HI); Plant Senescence Reflectance (PSRI); Vogelmann Red Edge Index (VREI1); Red Edge Normalized Difference Vegetation Index (RENDVI); and Modified Red Edge Simple Ratio (MRESRI). Our results showed that the PSRI and fD vegetation indices significantly detected grey mould on lettuce grown under both lighting systems (HPS and LEDs) the day after inoculation. The results conclusively affirmed that NDVI, PSRI, HI, fD, WBI, RVSI, PRI, PRI515, CRI2, SIPI, chlorophyll index PSSRb, and coloration index B were identified as the best indicators for Botrytis cinerea infection on green-leaf lettuce (Lactuca sativa L. cv Little Gem) at the early stage of inoculated lettuce's antioxidative response against grey mould with a significant increase in chlorophyll indices.

Can Metabolomic Approaches Become a Tool for Improving Early Plant Disease Detection and Diagnosis with Modern Remote Sensing Methods? A Review

The various areas of ultra-sensitive remote sensing research equipment development have provided new ways for assessing crop states. However, even the most promising areas of research, such as hyperspectral remote sensing or Raman spectrometry, have not yet led to stable results. In this review, the main methods for early plant disease detection are discussed. The best proven existing techniques for data acquisition are described. It is discussed how they can be applied to new areas of knowledge. The role of metabolomic approaches in the application of modern methods for early plant disease detection and diagnosis is reviewed. A further direction for experimental methodological development is indicated. The ways to increase the efficiency of modern early plant disease detection remote sensing methods through metabolomic data usage are shown. This article provides an overview of modern sensors and technologies for assessing the biochemical state of crops as well as the ways to apply them in synergy with existing data acquisition and analysis technologies for early plant disease detection.

Artificial Intelligence: A Promising Tool in Exploring the Phytomicrobiome in Managing Disease and Promoting Plant Health

There is increasing interest in harnessing the microbiome to improve cropping systems. With the availability of high-throughput and low-cost sequencing technologies, gathering microbiome data is becoming more routine. However, the analysis of microbiome data is challenged by the size and complexity of the data, and the incomplete nature of many microbiome databases. Further, to bring microbiome data value, it often needs to be analyzed in conjunction with other complex data that impact on crop health and disease management, such as plant genotype and environmental factors. Artificial intelligence (AI), boosted through deep learning (DL), has achieved significant breakthroughs and is a powerful tool for managing large complex datasets such as the interplay between the microbiome, crop plants, and their environment. In this review, we aim to provide readers with a brief introduction to AI techniques, and we introduce how AI has been applied to areas of microbiome sequencing taxonomy, the functional annotation for microbiome sequences, associating the microbiome community with host traits, designing synthetic communities, genomic selection, field phenotyping, and disease forecasting. At the end of this review, we proposed further efforts that are required to fully exploit the power of AI in studying phytomicrobiomes.

UAV Multisensory Data Fusion and Multi-Task Deep Learning for High-Throughput Maize Phenotyping

Recent advances in unmanned aerial vehicles (UAV), mini and mobile sensors, and GeoAI (a blend of geospatial and artificial intelligence (AI) research) are the main highlights among agricultural innovations to improve crop productivity and thus secure vulnerable food systems. This study investigated the versatility of UAV-borne multisensory data fusion within a framework of multi-task deep learning for high-throughput phenotyping in maize. UAVs equipped with a set of miniaturized sensors including hyperspectral, thermal, and LiDAR were collected in an experimental corn field in Urbana, IL, USA during the growing season. A full suite of eight phenotypes was in situ measured at the end of the season for ground truth data, specifically, dry stalk biomass, cob biomass, dry grain yield, harvest index, grain nitrogen utilization efficiency (Grain NutE), grain nitrogen content, total plant nitrogen content, and grain density. After being funneled through a series of radiometric calibrations and geo-corrections, the aerial data were analytically processed in three primary approaches. First, an extended version normalized difference spectral index (NDSI) served as a simple arithmetic combination of different data modalities to explore the correlation degree with maize phenotypes. The extended NDSI analysis revealed the NIR spectra (750-1000 nm) alone in a strong relation with all of eight maize traits. Second, a fusion of vegetation indices, structural indices, and thermal index selectively handcrafted from each data modality was fed to classical machine learning regressors, Support Vector Machine (SVM) and Random Forest (RF). The prediction performance varied from phenotype to phenotype, ranging from R² = 0.34 for grain density up to R² = 0.85 for both grain nitrogen content and total plant nitrogen content. Further, a fusion of hyperspectral and LiDAR data completely exceeded limitations of single data modality, especially addressing the vegetation saturation effect occurring in optical remote sensing. Third, a multi-task deep convolutional neural network (CNN) was customized to take a raw imagery data fusion of hyperspectral, thermal, and LiDAR for multi-predictions of maize traits at a time. The multi-task deep learning performed predictions comparably, if not better in some traits, with the mono-task deep learning and machine learning regressors. Data augmentation used for the deep learning models boosted the prediction accuracy, which helps to alleviate the intrinsic limitation of a small sample size and unbalanced sample classes in remote sensing research. Theoretical and practical implications to plant breeders and crop growers were also made explicit during discussions in the studies.

Paper-Based Multiplex Sensors for the Optical Detection of Plant Stress

The rising population and the ongoing climate crisis call for improved means to monitor and optimise agriculture. A promising approach to tackle current challenges in food production is the early diagnosis of plant diseases through non-invasive methods, such as the detection of volatiles. However, current devices for detection of multiple volatiles are based on electronic noses, which are expensive, require complex circuit assembly, may involve metal oxides with heating elements, and cannot easily be adapted for some applications that require miniaturisation or limit front-end use of electronic components. To address these challenges, a low-cost optoelectronic nose using chemo-responsive colorimetric dyes drop-casted onto filter paper has been developed in the current work. The final sensors could be used for the quantitative detection of up to six plant volatiles through changes in colour intensities with a sub-ppm level limit of detection, one of the lowest limits of detection reported so far using colorimetric gas sensors. Sensor colouration could be analysed using a low-cost spectrometer and the results could be processed using a microcontroller. The measured volatiles could be used for the early detection of plant abiotic stress as early as two days after exposure to two different stresses: high salinity and starvation. This approach allowed a lowering of costs to GBP 1 per diagnostic sensing paper. Furthermore, the small size of the paper sensors allows for their use in confined settings, such as Petri dishes. This detection of abiotic stress could be easily achieved by exposing the devices to living plants for 1 h. This technology has the potential to be used for monitoring of plant development in field applications, early recognition of stress, implementation of preventative measures, and mitigation of harvest losses.

Identification of plant leaf diseases by deep learning based on channel attention and channel pruning

Plant diseases cause significant economic losses and food security in agriculture each year, with the critical path to reducing losses being accurate identification and timely diagnosis of plant diseases. Currently, deep neural networks have been extensively applied in plant disease identification, but such approaches still suffer from low identification accuracy and numerous parameters. Hence, this paper proposes a model combining channel attention and channel pruning called CACPNET, suitable for disease identification of common species. The channel attention mechanism adopts a local cross-channel strategy without dimensionality reduction, which is inserted into a ResNet-18-based model that combines global average pooling with global max pooling to effectively improve the features' extracting ability of plant leaf diseases. Based on the model's optimum feature extraction condition, unimportant channels are removed to reduce the model's parameters and complexity via the L1-norm channel weight and local compression ratio. The accuracy of CACPNET on the public dataset PlantVillage reaches 99.7% and achieves 97.7% on the local peanut leaf disease dataset. Compared with the base ResNet-18 model, the floating point operations (FLOPs) decreased by 30.35%, the parameters by 57.97%, the model size by 57.85%, and the GPU RAM requirements by 8.3%. Additionally, CACPNET outperforms current models considering inference time and throughput, reaching 22.8 ms/frame and 75.5 frames/s, respectively. The results outline that CACPNET is appealing for deployment on edge devices to improve the efficiency of precision agriculture in plant disease detection.

Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review

Remote detection and monitoring of the vegetation responses to stress became relevant for sustainable agriculture. Ongoing developments in optical remote sensing technologies have provided tools to increase our understanding of stress-related physiological processes. Therefore, this study aimed to provide an overview of the main spectral technologies and retrieval approaches for detecting crop stress in agriculture. Firstly, we present integrated views on: i) biotic and abiotic stress factors, the phases of stress, and respective plant responses, and ii) the affected traits, appropriate spectral domains and corresponding methods for measuring traits remotely. Secondly, representative results of a systematic literature analysis are highlighted, identifying the current status and possible future trends in stress detection and monitoring. Distinct plant responses occurring under shortterm, medium-term or severe chronic stress exposure can be captured with remote sensing due to specific light interaction processes, such as absorption and scattering manifested in the reflected radiance, i.e. visible (VIS), near infrared (NIR), shortwave infrared, and emitted radiance, i.e. solar-induced fluorescence and thermal infrared (TIR). From the analysis of 96 research papers, the following trends can be observed: increasing usage of satellite and unmanned aerial vehicle data in parallel with a shift in methods from simpler parametric approaches towards more advanced physically-based and hybrid models. Most study designs were largely driven by sensor availability and practical economic reasons, leading to the common usage of VIS-NIR-TIR sensor combinations. The majority of reviewed studies compared stress proxies calculated from single-source sensor domains rather than using data in a synergistic way. We identified new ways forward as guidance for improved synergistic usage of spectral domains for stress detection: (1) combined acquisition of data from multiple sensors for analysing multiple stress responses simultaneously (holistic view); (2) simultaneous retrieval of plant traits combining multi-domain radiative transfer models and machine learning methods; (3) assimilation of estimated plant traits from distinct spectral domains into integrated crop growth models. As a future outlook, we recommend combining multiple remote sensing data streams into crop model assimilation schemes to build up Digital Twins of agroecosystems, which may provide the most efficient way to detect the diversity of environmental and biotic stresses and thus enable respective management decisions.

A survey on deep learning-based identification of plant and crop diseases from UAV-based aerial images

The agricultural crop productivity can be affected and reduced due to many factors such as weeds, pests, and diseases. Traditional methods that are based on terrestrial engines, devices, and farmers' naked eyes are facing many limitations in terms of accuracy and the required time to cover large fields. Currently, precision agriculture that is based on the use of deep learning algorithms and Unmanned Aerial Vehicles (UAVs) provides an effective solution to achieve agriculture applications, including plant disease identification and treatment. In the last few years, plant disease monitoring using UAV platforms is one of the most important agriculture applications that have gained increasing interest by researchers. Accurate detection and treatment of plant diseases at early stages is crucial to improving agricultural production. To this end, in this review, we analyze the recent advances in the use of computer vision techniques that are based on deep learning algorithms and UAV technologies to identify and treat crop diseases.

Evaluating the Forest Ecosystem through a Semi-Autonomous Quadruped Robot and a Hexacopter UAV

Accurate and timely monitoring is imperative to the resilience of forests for economic growth and climate regulation. In the UK, forest management depends on citizen science to perform tedious and time-consuming data collection tasks. In this study, an unmanned aerial vehicle (UAV) equipped with a light sensor and positioning capabilities is deployed to perform aerial surveying and to observe a series of forest health indicators (FHIs) which are inaccessible from the ground. However, many FHIs such as burrows and deadwood can only be observed from under the tree canopy. Hence, we take the initiative of employing a quadruped robot with an integrated camera as well as an external sensing platform (ESP) equipped with light and infrared cameras, computing, communication and power modules to observe these FHIs from the ground. The forest-monitoring time can be extended by reducing computation and conserving energy. Therefore, we analysed different versions of the YOLO object-detection algorithm in terms of accuracy, deployment and usability by the EXP to accomplish an extensive low-latency detection. In addition, we constructed a series of new datasets to train the YOLOv5x and YOLOv5s for recognising FHIs. Our results reveal that YOLOv5s is lightweight and easy to train for FHI detection while performing close to real-time, cost-effective and autonomous forest monitoring.

Application of Improved Satin Bowerbird Optimizer in Image Segmentation

Aiming at the problems of low optimization accuracy and slow convergence speed of Satin Bowerbird Optimizer (SBO), an improved Satin Bowerbird Optimizer (ISBO) based on chaotic initialization and Cauchy mutation strategy is proposed. In order to improve the value of the proposed algorithm in engineering and practical applications, we apply it to the segmentation of medical and plant images. To improve the optimization accuracy, convergence speed and pertinence of the initial population, the population is initialized by introducing the Logistic chaotic map. To avoid the algorithm falling into local optimum (prematurity), the search performance of the algorithm is improved through Cauchy mutation strategy. Based on extensive visual and quantitative data analysis, this paper conducts a comparative analysis of the ISBO with the SBO, the fuzzy Gray Wolf Optimizer (FGWO), and the Fuzzy Coyote Optimization Algorithm (FCOA). The results show that the ISBO achieves better segmentation effects in both medical and plant disease images.

Ecological Dynamics and Microbial Treatments against Oomycete Plant Pathogens

In this review, we explore how ecological concepts may help assist with applying microbial biocontrol agents to oomycete pathogens. Oomycetes cause a variety of agricultural diseases, including potato late blight, apple replant diseases, and downy mildew of grapevine, which also can lead to significant economic damage in their respective crops. The use of microbial biocontrol agents is increasingly gaining interest due to pressure from governments and society to reduce chemical plant protection products. The success of a biocontrol agent is dependent on many ecological processes, including the establishment on the host, persistence in the environment, and expression of traits that may be dependent on the microbiome. This review examines recent literature and trends in research that incorporate ecological aspects, especially microbiome, host, and environmental interactions, into biological control development and applications. We explore ecological factors that may influence microbial biocontrol agents’ efficacy and discuss key research avenues forward.