A Machine Learning Approach to Detecting Pine Wilt Disease Using Airborne Spectral Imagery

Mechanistic links between physiology and spectral reflectance enable previsual detection of oak wilt and drought stress

Tree mortality due to global change-including range expansion of invasive pests and pathogens-is a paramount threat to forest ecosystems. Oak forests are among the most prevalent and valuable ecosystems both ecologically and economically in the United States. There is increasing interest in monitoring oak decline and death due to both drought and the oak wilt pathogen (Bretziella fagacearum). We combined anatomical and ecophysiological measurements with spectroscopy at leaf, canopy, and airborne levels to enable differentiation of oak wilt and drought, and detection prior to visible symptom appearance. We performed an outdoor potted experiment with Quercus rubra saplings subjected to drought stress and/or artificially inoculated with the pathogen. Models developed from spectral reflectance accurately predicted ecophysiological indicators of oak wilt and drought decline in both potted and field experiments with naturally grown saplings. Both oak wilt and drought resulted in blocked water transport through xylem conduits. However, oak wilt impaired conduits in localized regions of the xylem due to formation of tyloses instead of emboli. The localized tylose formation resulted in more variable canopy photosynthesis and water content in diseased trees than drought-stressed ones. Reflectance signatures of plant photosynthesis, water content, and cellular damage detected oak wilt and drought 12 d before visual symptoms appeared. Our results show that leaf spectral reflectance models predict ecophysiological processes relevant to detection and differentiation of disease and drought. Coupling spectral models that detect physiological change with spatial information enhances capacity to differentiate plant stress types such as oak wilt and drought.

Exploring the Close-Range Detection of UAV-Based Images on Pine Wilt Disease by an Improved Deep Learning Method

Pine wilt disease (PWD) is a significantly destructive forest disease. To control the spread of PWD, an urgent need exists for a real-time and efficient method to detect infected trees. However, existing object detection models have often faced challenges in balancing lightweight design and accuracy, particularly in complex mixed forests. To address this, an improvement was made to the YOLOv5s (You Only Look Once version 5s) algorithm, resulting in a real-time and efficient model named PWD-YOLO. First, a lightweight backbone was constructed, composed of multiple connected RepVGG Blocks, significantly enhancing the model's inference speed. Second, a C2fCA module was designed to incorporate rich gradient information flow and concentrate on key features, thereby preserving more detailed characteristics of PWD-infected trees. In addition, the GSConv network was utilized instead of conventional convolutions to reduce network complexity. Last, the Bidirectional Feature Pyramid Network strategy was used to enhance the propagation and sharing of multiscale features. The results demonstrate that on a self-built dataset, PWD-YOLO surpasses existing object detection models with respective measurements of model size (2.7 MB), computational complexity (3.5 GFLOPs), parameter volume (1.09 MB), and speed (98.0 frames/s). The Precision, Recall, and F1-score on the test set are 92.5%, 95.3%, and 93.9%, respectively, which confirms the effectiveness of the proposed method. It provides reliable technical support for daily monitoring and clearing of infected trees by forestry management departments.

Early Monitoring of Forest Wood-Boring Pests with Remote Sensing

Wood-boring pests (WBPs) pose an enormous threat to global forest ecosystems because their early stage infestations show no visible symptoms and can result in rapid and widespread infestations at later stages, leading to large-scale tree death. Therefore, early-stage WBP detection is crucial for prompt management response. Early detection of WBPs requires advanced and effective methods like remote sensing. This review summarizes the applications of various remote sensing sensors, platforms, and detection methods for monitoring WBP infestations. The current capabilities, gaps in capabilities, and future potential for the accurate and rapid detection of WBPs are highlighted.

Early detection of pine wilt disease tree candidates using time-series of spectral signatures

Pine wilt disease (PWD), caused by pine wood nematode (PWN), poses a tremendous threat to global pine forests because it can result in rapid and widespread infestations within months, leading to large-scale tree mortality. Therefore, the implementation of preventive measures relies on early detection of PWD. Unmanned aerial vehicle (UAV)-based hyperspectral images (HSI) can detect tree-level changes and are thus an effective tool for forest change detection. However, previous studies mainly used single-date UAV-based HSI data, which could not monitor the temporal changes of disease distribution and determine the optimal detection period. To achieve these purposes, multi-temporal data is required. In this study, Pinus koraiensis stands were surveyed in the field from May to October during an outbreak of PWD. Concurrently, multi-temporal UAV-based red, green, and blue bands (RGB) and HSI data were also obtained. During the survey, 59 trees were confirmed to be infested with PWD, and 59 non-infested trees were used as control. Spectral features of each tree crown, such as spectral reflectance, first and second-order spectral derivatives, and vegetation indices (VIs), were analyzed to identify those useful for early monitoring of PWD. The Random Forest (RF) classification algorithm was used to examine the separability between the two groups of trees (control and infested trees). The results showed that: (1) the responses of the tree crown spectral features to PWD infestation could be detected before symptoms were noticeable in RGB data and field surveys; (2) the spectral derivatives were the most discriminable variables, followed by spectral reflectance and VIs; (3) based on the HSI data from July to October, the two groups of trees were successfully separated using the RF classifier, with an overall classification accuracy of 0.75-0.95. Our results illustrate the potential of UAV-based HSI for PWD early monitoring.

UAV-Based Forest Health Monitoring: A Systematic Review

In recent years, technological advances have led to the increasing use of unmanned aerial vehicles (UAVs) for forestry applications. One emerging field for drone application is forest health monitoring (FHM). Common approaches for FHM involve small-scale resource-extensive fieldwork combined with traditional remote sensing platforms. However, the highly dynamic nature of forests requires timely and repetitive data acquisition, often at very high spatial resolution, where conventional remote sensing techniques reach the limits of feasibility. UAVs have shown that they can meet the demands of flexible operation and high spatial resolution. This is also reflected in a rapidly growing number of publications using drones to study forest health. Only a few reviews exist which do not cover the whole research history of UAV-based FHM. Since a comprehensive review is becoming critical to identify research gaps, trends, and drawbacks, we offer a systematic analysis of 99 papers covering the last ten years of research related to UAV-based monitoring of forests threatened by biotic and abiotic stressors. Advances in drone technology are being rapidly adopted and put into practice, further improving the economical use of UAVs. Despite the many advantages of UAVs, such as their flexibility, relatively low costs, and the possibility to fly below cloud cover, we also identified some shortcomings: (1) multitemporal and long-term monitoring of forests is clearly underrepresented; (2) the rare use of hyperspectral and LiDAR sensors must drastically increase; (3) complementary data from other RS sources are not sufficiently being exploited; (4) a lack of standardized workflows poses a problem to ensure data uniformity; (5) complex machine learning algorithms and workflows obscure interpretability and hinders widespread adoption; (6) the data pipeline from acquisition to final analysis often relies on commercial software at the expense of open-source tools.

A GA and SVM Classification Model for Pine Wilt Disease Detection Using UAV-Based Hyperspectral Imagery

Pine wilt disease (PWD), caused by the pine wood nematode (Bursaphelenchus xylophilus), is a global destructive threat to forests and has led to serious economic losses all over the world. Therefore, it is necessary to establish a feasible and effective method to accurately monitor and estimate PWD infection. In this study, we used hyperspectral imagery (HI) collected by an unmanned airship with a hyperspectral imaging spectrometer to detect PWD in healthy, early, middle and serious infection stages. To avoid massive calculations on the full spectral dimensions of the HI, 16 spectral features were extracted from the HI, and a genetic algorithm (GA) was implemented to identify the optimal ones with the least fitness. Simultaneously, a support vector machine (SVM) classifier was established to predict the PWD infection stage for an individual pine tree. The following results were obtained: (1) the spectral characteristics for pine trees in different PWD infection stages were distinctive in the green region (510–580 nm), red edge (680–760 nm) and near-infrared (780–1000 nm) spectra; (2) the six optimal spectral features (Dgreen, SDgreen, Dred, DRE, DNIR, SDNIR) selected with the GA effectively distinguished the PWD infection stages of pine trees with a lower calculation cost; (3) compared with the traditional classifiers, such as k-nearest neighbor (KNN), random forest (RF) and single SVM, the proposed GA and SVM classifier achieved the highest overall accuracy (95.24%) and Kappa coefficient (0.9234). The approach could also be employed for monitoring and detecting other forest pests.

Detection of Standing Dead Trees after Pine Wilt Disease Outbreak with Airborne Remote Sensing Imagery by Multi-Scale Spatial Attention Deep Learning and Gaussian Kernel Approach

The continuous and extensive pinewood nematode disease has seriously threatened the sustainable development of forestry in China. At present, many studies have used high-resolution remote sensing images combined with a deep semantic segmentation algorithm to identify standing dead trees in the red attack period. However, due to the complex background, closely distributed detection scenes, and unbalanced training samples, it is difficult to detect standing dead trees (SDTs) in a variety of complex scenes by using conventional segmentation models. In order to further solve the above problems and improve the recognition accuracy, we proposed a new detection method called multi-scale spatial supervision convolutional network (MSSCN) to identify SDTs in a wide range of complex scenes based on airborne remote sensing imagery. In the method, a Gaussian kernel approach was used to generate a confidence map from SDTs marked as points for training samples, and a multi-scale spatial attention block was added into fully convolutional neural networks to reduce the loss of spatial information. Further, an augmentation strategy called copy–pasting was used to overcome the lack of efficient samples in this research area. Validation at four different forest areas belonging to two forest types and two diseased outbreak intensities showed that (1) the copy–pasting method helps to augment training samples and can improve the detecting accuracy with a suitable oversampling rate, and the best oversampling rate should be carefully determined by the input training samples and image data. (2) Based on the two-dimensional spatial Gaussian kernel distribution function and the multi-scale spatial attention structure, the MSSCN model can effectively find the dead tree extent in a confidence map, and by following this with maximum location searching we can easily locate the individual dead trees. The averaged precision, recall, and F1-score across different forest types and disease-outbreak-intensity areas can achieve 0.94, 0.84, and 0.89, respectively, which is the best performance among FCN8s and U-Net. (3) In terms of forest type and outbreak intensity, the MSSCN performs best in pure pine forest type and low-outbreak-intensity areas. Compared with FCN8s and U-Net, the MSSCN can achieve the best recall accuracy in all forest types and outbreak-intensity areas. Meanwhile, the precision metric is also maintained at a high level, which means that the proposed method provides a trade-off between the precision and recall in detection accuracy.

Recent Advances in Forest Insect Pests and Diseases Monitoring Using UAV-Based Data: A Systematic Review

Unmanned aerial vehicles (UAVs) are platforms that have been increasingly used over the last decade to collect data for forest insect pest and disease (FIPD) monitoring. These machines provide flexibility, cost efficiency, and a high temporal and spatial resolution of remotely sensed data. The purpose of this review is to summarize recent contributions and to identify knowledge gaps in UAV remote sensing for FIPD monitoring. A systematic review was performed using the preferred reporting items for systematic reviews and meta-analysis (PRISMA) protocol. We reviewed the full text of 49 studies published between 2015 and 2021. The parameters examined were the taxonomic characteristics, the type of UAV and sensor, data collection and pre-processing, processing and analytical methods, and software used. We found that the number of papers on this topic has increased in recent years, with most being studies located in China and Europe. The main FIPDs studied were pine wilt disease (PWD) and bark beetles (BB) using UAV multirotor architectures. Among the sensor types, multispectral and red–green–blue (RGB) bands were preferred for the monitoring tasks. Regarding the analytical methods, random forest (RF) and deep learning (DL) classifiers were the most frequently applied in UAV imagery processing. This paper discusses the advantages and limitations associated with the use of UAVs and the processing methods for FIPDs, and research gaps and challenges are presented.

Detection of Tree Decline (Pinus pinaster Aiton) in European Forests Using Sentinel-2 Data

Moderate-resolution satellite imagery is essential to detect conifer tree decline on a regional scale and address the threat caused by pinewood nematode (PWN), (Bursaphelenchus xylophilus. This is a quarantine organism responsible for pine wilt disease (PWD), which has caused substantial ecological and economic losses in the maritime pine (Pinus pinaster) forests of Portugal. This study describes the first instance of a pre-operational algorithm applied to Sentinel-2 imagery to detect PWD-compatible decline in maritime pine. The Random Forest model relied on a pre-wilting and an in-season image, calibrated with data from a 24-month long field campaign enhanced with Worldview-3 data and the analysis of biological samples (hyperspectral reflectance, pigment quantification in needles, and PWN identification). Independent validation results attested to the good performance of the model with an overall accuracy of 95%, particularly when decline affects more than 30% of the 100 m2 pixel of Sentinel-2. Spectral angle mapper applied to hyperspectral measurements suggested that PWN infection cannot be separated from other drivers of decline in the visible-near infrared domain. Our algorithm can be employed to detect regional decline trends and inform subsequent aerial and field surveys, to further investigate decline hotspots.

Monitoring the Severity of Pantana phyllostachysae Chao Infestation in Moso Bamboo Forests Based on UAV Multi-Spectral Remote Sensing Feature Selection

In recent years, the rapid development of unmanned aerial vehicle (UAV) remote sensing technology has provided a new means to efficiently monitor forest resources and effectively prevent and control pests and diseases. This study aims to develop a detection model to study the damage caused to Moso bamboo forests by Pantana phyllostachysae Chao (PPC), a major leaf-eating pest, at 5 cm resolution. Damage sensitive features were extracted from multispectral images acquired by UAVs and used to train detection models based on support vector machines (SVM), random forests (RF), and extreme gradient boosting tree (XGBoost) machine learning algorithms. The overall detection accuracy (OA) and Kappa coefficient of SVM, RF, and XGBoost were 81.95%, 0.733, 85.71%, 0.805, and 86.47%, 0.811, respectively. Meanwhile, the detection accuracies of SVM, RF, and XGBoost were 78.26%, 76.19%, and 80.95% for healthy, 75.00%, 83.87%, and 79.17% for mild damage, 83.33%, 86.49%, and 85.00% for moderate damage, and 82.5%, 90.91%, and 93.75% for severe damage Moso bamboo, respectively. Overall, XGBoost exhibited the best detection performance, followed by RF and SVM. Thus, the study findings provide a technical reference for the regional monitoring and control of PPC in Moso bamboo.

A Deep Learning-Based Generalized System for Detecting Pine Wilt Disease Using RGB-Based UAV Images

Pine wilt is a devastating disease that typically kills affected pine trees within a few months. In this paper, we confront the problem of detecting pine wilt disease. In the image samples that have been used for pine wilt disease detection, there is high ambiguity due to poor image resolution and the presence of “disease-like” objects. We therefore created a new dataset using large-sized orthophotographs collected from 32 cities, 167 regions, and 6121 pine wilt disease hotspots in South Korea. In our system, pine wilt disease was detected in two stages: n the first stage, the disease and hard negative samples were collected using a convolutional neural network. Because the diseased areas varied in size and color, and as the disease manifests differently from the early stage to the late stage, hard negative samples were further categorized into six different classes to simplify the complexity of the dataset. Then, in the second stage, we used an object detection model to localize the disease and “disease-like” hard negative samples. We used several image augmentation methods to boost system performance and avoid overfitting. The test process was divided into two phases: a patch-based test and a real-world test. During the patch-based test, we used the test-time augmentation method to obtain the average prediction of our system across multiple augmented samples of data, and the prediction results showed a mean average precision of 89.44% in five-fold cross validation, thus representing an increase of around 5% over the alternative system. In the real-world test, we collected 10 orthophotographs in various resolutions and areas, and our system successfully detected 711 out of 730 potential disease spots.

Three-Dimensional Convolutional Neural Network Model for Early Detection of Pine Wilt Disease Using UAV-Based Hyperspectral Images

As one of the most devastating disasters to pine forests, pine wilt disease (PWD) has caused tremendous ecological and economic losses in China. An effective way to prevent large-scale PWD outbreaks is to detect and remove the damaged pine trees at the early stage of PWD infection. However, early infected pine trees do not show obvious changes in morphology or color in the visible wavelength range, making early detection of PWD tricky. Unmanned aerial vehicle (UAV)-based hyperspectral imagery (HI) has great potential for early detection of PWD. However, the commonly used methods, such as the two-dimensional convolutional neural network (2D-CNN), fail to simultaneously extract and fully utilize the spatial and spectral information, whereas the three-dimensional convolutional neural network (3D-CNN) is able to collect this information from raw hyperspectral data. In this paper, we applied the residual block to 3D-CNN and constructed a 3D-Res CNN model, the performance of which was then compared with that of 3D-CNN, 2D-CNN, and 2D-Res CNN in identifying PWD-infected pine trees from the hyperspectral images. The 3D-Res CNN model outperformed the other models, achieving an overall accuracy (OA) of 88.11% and an accuracy of 72.86% for detecting early infected pine trees (EIPs). Using only 20% of the training samples, the OA and EIP accuracy of 3D-Res CNN can still achieve 81.06% and 51.97%, which is superior to the state-of-the-art method in the early detection of PWD based on hyperspectral images. Collectively, 3D-Res CNN was more accurate and effective in early detection of PWD. In conclusion, 3D-Res CNN is proposed for early detection of PWD in this paper, making the prediction and control of PWD more accurate and effective. This model can also be applied to detect pine trees damaged by other diseases or insect pests in the forest.

Diagnosis of pine wilt disease using remote wireless sensing

Pine wilt disease caused by Bursaphelenchus xylophilus is a major tree disease that threatens pine forests worldwide. To diagnose this disease, we developed battery-powered remote sensing devices capable of long-range (LoRa) communication and installed them in pine trees (Pinus densiflora) in Gyeongju and Ulsan, South Korea. Upon analyzing the collected tree sensing signals, which represented stem resistance, we found that the mean absolute deviation (MAD) of the sensing signals was useful for distinguishing between uninfected and infected trees. The MAD of infected trees was greater than that of uninfected trees from August of the year, and in the two-dimensional plane, consisting of the MAD value in July and that in October, the infected and uninfected trees were separated by the first-order boundary line generated using linear discriminant analysis. It was also observed that wood moisture content and precipitation affected MAD. This is the first study to diagnose pine wilt disease using remote sensors attached to trees.

Evaluation of Deep Learning Segmentation Models for Detection of Pine Wilt Disease in Unmanned Aerial Vehicle Images

Pine wilt disease (PWD) is a serious threat to pine forests. Combining unmanned aerial vehicle (UAV) images and deep learning (DL) techniques to identify infected pines is the most efficient method to determine the potential spread of PWD over a large area. In particular, image segmentation using DL obtains the detailed shape and size of infected pines to assess the disease’s degree of damage. However, the performance of such segmentation models has not been thoroughly studied. We used a fixed-wing UAV to collect images from a pine forest in Laoshan, Qingdao, China, and conducted a ground survey to collect samples of infected pines and construct prior knowledge to interpret the images. Then, training and test sets were annotated on selected images, and we obtained 2352 samples of infected pines annotated over different backgrounds. Finally, high-performance DL models (e.g., fully convolutional networks for semantic segmentation, DeepLabv3+, and PSPNet) were trained and evaluated. The results demonstrated that focal loss provided a higher accuracy and a finer boundary than Dice loss, with the average intersection over union (IoU) for all models increasing from 0.656 to 0.701. From the evaluated models, DeepLLabv3+ achieved the highest IoU and an F1 score of 0.720 and 0.832, respectively. Also, an atrous spatial pyramid pooling module encoded multiscale context information, and the encoder–decoder architecture recovered location/spatial information, being the best architecture for segmenting trees infected by the PWD. Furthermore, segmentation accuracy did not improve as the depth of the backbone network increased, and neither ResNet34 nor ResNet50 was the appropriate backbone for most segmentation models.

Research on Polarized Multi-Spectral System and Fusion Algorithm for Remote Sensing of Vegetation Status at Night

The monitoring of vegetation via remote sensing has been widely applied in various fields, such as crop diseases and pests, forest coverage and vegetation growth status, but such monitoring activities were mainly carried out in the daytime, resulting in limitations in sensing the status of vegetation at night. In this article, with the aim of monitoring the health status of outdoor plants at night by remote sensing, a polarized multispectral low-illumination-level imaging system (PMSIS) was established, and a fusion algorithm was proposed to detect vegetation by sensing the spectrum and polarization characteristics of the diffuse and specular reflection of vegetation. The normalized vegetation index (NDVI), degree of linear polarization (DoLP) and angle of polarization (AOP) are all calculated in the fusion algorithm to better detect the health status of plants in the night environment. Based on NDVI, DoLP and AOP fusion images (NDAI), a new index of night plant state detection (NPSDI) was proposed. A correlation analysis was made for the chlorophyll content (SPAD), nitrogen content (NC), NDVI and NPSDI to understand their capabilities to detect plants under stress. The scatter plot of NPSDI shows a good distinction between vegetation with different health levels, which can be seen from the high specificity and sensitivity values. It can be seen that NPSDI has a good correlation with NDVI (coefficient of determination R2 = 0.968), PSAD (R2 = 0.882) and NC (R2 = 0.916), which highlights the potential of NPSDI in the identification of plant health status. The results clearly show that the proposed fusion algorithm can enhance the contrast effect and the generated fusion image will carry richer vegetation information, thereby monitoring the health status of plants at night more effectively. This algorithm has a great potential in using remote sensing platform to monitor the health of vegetation and crops.

Identifying Pine Wood Nematode Disease Using UAV Images and Deep Learning Algorithms

Pine nematode is a highly contagious disease that causes great damage to the world’s pine forest resources. Timely and accurate identification of pine nematode disease can help to control it. At present, there are few research on pine nematode disease identification, and it is difficult to accurately identify and locate nematode disease in a single pine by existing methods. This paper proposes a new network, SCANet (spatial-context-attention network), to identify pine nematode disease based on unmanned aerial vehicle (UAV) multi-spectral remote sensing images. In this method, a spatial information retention module is designed to reduce the loss of spatial information; it preserves the shallow features of pine nematode disease and expands the receptive field to enhance the extraction of deep features through a context information module. SCANet reached an overall accuracy of 79% and a precision and recall of around 0.86, and 0.91, respectively. In addition, 55 disease points among 59 known disease points were identified, which is better than other methods (DeepLab V3+, DenseNet, and HRNet). This paper presents a fast, precise, and practical method for identifying nematode disease and provides reliable technical support for the surveillance and control of pine wood nematode disease.

Detection of Longhorned Borer Attack and Assessment in Eucalyptus Plantations Using UAV Imagery

Eucalyptus Longhorned Borers (ELB) are some of the most destructive pests in regions with Mediterranean climate. Low rainfall and extended dry summers cause stress in eucalyptus trees and facilitate ELB infestation. Due to the difficulty of monitoring the stands by traditional methods, remote sensing arises as an invaluable tool. The main goal of this study was to demonstrate the accuracy of unmanned aerial vehicle (UAV) multispectral imagery for detection and quantification of ELB damages in eucalyptus stands. To detect spatial damage, Otsu thresholding analysis was conducted with five imagery-derived vegetation indices (VIs) and classification accuracy was assessed. Treetops were calculated using the local maxima filter of a sliding window algorithm. Subsequently, large-scale mean-shift segmentation was performed to extract the crowns, and these were classified with random forest (RF). Forest density maps were produced with data obtained from RF classification. The normalized difference vegetation index (NDVI) presented the highest overall accuracy at 98.2% and 0.96 Kappa value. Random forest classification resulted in 98.5% accuracy and 0.94 Kappa value. The Otsu thresholding and random forest classification can be used by forest managers to assess the infestation. The aggregation of data offered by forest density maps can be a simple tool for supporting pest management.