1
|
Liu B, Wei S, Zhang F, Guo N, Fan H, Yao W. Tomato leaf disease recognition based on multi-task distillation learning. FRONTIERS IN PLANT SCIENCE 2024; 14:1330527. [PMID: 38352252 PMCID: PMC10862124 DOI: 10.3389/fpls.2023.1330527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 12/28/2023] [Indexed: 02/16/2024]
Abstract
Introduction Tomato leaf diseases can cause major yield and quality losses. Computer vision techniques for automated disease recognition show promise but face challenges like symptom variations, limited labeled data, and model complexity. Methods Prior works explored hand-crafted and deep learning features for tomato disease classification and multi-task severity prediction, but did not sufficiently exploit the shared and unique knowledge between these tasks. We present a novel multi-task distillation learning (MTDL) framework for comprehensive diagnosis of tomato leaf diseases. It employs knowledge disentanglement, mutual learning, and knowledge integration through a multi-stage strategy to leverage the complementary nature of classification and severity prediction. Results Experiments show our framework improves performance while reducing model complexity. The MTDL-optimized EfficientNet outperforms single-task ResNet101 in classification accuracy by 0.68% and severity estimation by 1.52%, using only 9.46% of its parameters. Discussion The findings demonstrate the practical potential of our framework for intelligent agriculture applications.
Collapse
Affiliation(s)
- Bo Liu
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Shusen Wei
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Fan Zhang
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Nawei Guo
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Hongyu Fan
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Wei Yao
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| |
Collapse
|
2
|
Liu B, Fan H, Zhang Y, Cai J, Cheng H. Deep learning architectures for diagnosing the severity of apple frog-eye leaf spot disease in complex backgrounds. FRONTIERS IN PLANT SCIENCE 2024; 14:1289497. [PMID: 38259944 PMCID: PMC10800469 DOI: 10.3389/fpls.2023.1289497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 12/04/2023] [Indexed: 01/24/2024]
Abstract
Introduction In precision agriculture, accurately diagnosing apple frog-eye leaf spot disease is critical for effective disease management. Traditional methods, predominantly relying on labor-intensive and subjective visual evaluations, are often inefficient and unreliable. Methods To tackle these challenges in complex orchard environments, we develop a specialized deep learning architecture. This architecture consists of a two-stage multi-network model. The first stage features an enhanced Pyramid Scene Parsing Network (L-DPNet) with deformable convolutions for improved apple leaf segmentation. The second stage utilizes an improved U-Net (D-UNet), optimized with bilinear upsampling and batch normalization, for precise disease spot segmentation. Results Our model sets new benchmarks in performance, achieving a mean Intersection over Union (mIoU) of 91.27% for segmentation of both apple leaves and disease spots, and a mean Pixel Accuracy (mPA) of 94.32%. It also excels in classifying disease severity across five levels, achieving an overall precision of 94.81%. Discussion This approach represents a significant advancement in automated disease quantification, enhancing disease management in precision agriculture through data-driven decision-making.
Collapse
Affiliation(s)
- Bo Liu
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Hongyu Fan
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Yuting Zhang
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Jinjin Cai
- College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| | - Hong Cheng
- College of Information Science and Technology, Hebei Agricultural University, Baoding, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| |
Collapse
|
3
|
Sun Y, Wu F, Guo H, Li R, Yao J, Shen J. TeaDiseaseNet: multi-scale self-attentive tea disease detection. FRONTIERS IN PLANT SCIENCE 2023; 14:1257212. [PMID: 37900761 PMCID: PMC10600390 DOI: 10.3389/fpls.2023.1257212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 09/19/2023] [Indexed: 10/31/2023]
Abstract
Accurate detection of tea diseases is essential for optimizing tea yield and quality, improving production, and minimizing economic losses. In this paper, we introduce TeaDiseaseNet, a novel disease detection method designed to address the challenges in tea disease detection, such as variability in disease scales and dense, obscuring disease patterns. TeaDiseaseNet utilizes a multi-scale self-attention mechanism to enhance disease detection performance. Specifically, it incorporates a CNN-based module for extracting features at multiple scales, effectively capturing localized information such as texture and edges. This approach enables a comprehensive representation of tea images. Additionally, a self-attention module captures global dependencies among pixels, facilitating effective interaction between global information and local features. Furthermore, we integrate a channel attention mechanism, which selectively weighs and combines the multi-scale features, eliminating redundant information and enabling precise localization and recognition of tea disease information across diverse scales and complex backgrounds. Extensive comparative experiments and ablation studies validate the effectiveness of the proposed method, demonstrating superior detection results in scenarios characterized by complex backgrounds and varying disease scales. The presented method provides valuable insights for intelligent tea disease diagnosis, with significant potential for improving tea disease management and production.
Collapse
Affiliation(s)
- Yange Sun
- School of Computer and Information Technology, Xinyang Normal University, Xinyang, China
- Research Center of Precision Sensing and Control, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Fei Wu
- School of Computer and Information Technology, Xinyang Normal University, Xinyang, China
| | - Huaping Guo
- School of Computer and Information Technology, Xinyang Normal University, Xinyang, China
- Research Center of Precision Sensing and Control, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Ran Li
- School of Computer and Information Technology, Xinyang Normal University, Xinyang, China
| | - Jianfeng Yao
- School of Computer and Information Technology, Xinyang Normal University, Xinyang, China
- Henan Key Laboratory of Tea Plant Biology, Xinyang Normal University, Xinyang, China
| | - Jianbo Shen
- Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing, China
| |
Collapse
|
4
|
Zhang X, Li D, Liu X, Sun T, Lin X, Ren Z. Research of segmentation recognition of small disease spots on apple leaves based on hybrid loss function and CBAM. FRONTIERS IN PLANT SCIENCE 2023; 14:1175027. [PMID: 37346136 PMCID: PMC10279884 DOI: 10.3389/fpls.2023.1175027] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 05/03/2023] [Indexed: 06/23/2023]
Abstract
Identification technology of apple diseases is of great significance in improving production efficiency and quality. This paper has used apple Alternaria blotch and brown spot disease leaves as the research object and proposes a disease spot segmentation and disease identification method based on DFL-UNet+CBAM to address the problems of low recognition accuracy and poor performance of small spot segmentation in apple leaf disease recognition. The goal of this paper is to accurately prevent and control apple diseases, avoid fruit quality degradation and yield reduction, and reduce the resulting economic losses. DFL-UNet+CBAM model has employed a hybrid loss function of Dice Loss and Focal Loss as the loss function and added CBAM attention mechanism to both effective feature layers extracted by the backbone network and the results of the first upsampling, enhancing the model to rescale the inter-feature weighting relationships, enhance the channel features of leaf disease spots and suppressing the channel features of healthy parts of the leaf, and improving the network's ability to extract disease features while also increasing model robustness. In general, after training, the average loss rate of the improved model decreases from 0.063 to 0.008 under the premise of ensuring the accuracy of image segmentation. The smaller the loss value is, the better the model is. In the lesion segmentation and disease identification test, MIoU was 91.07%, MPA was 95.58%, F1 Score was 95.16%, MIoU index increased by 1.96%, predicted disease area and actual disease area overlap increased, MPA increased by 1.06%, predicted category correctness increased, F1 Score increased by 1.14%, the number of correctly identified lesion pixels increased, and the segmentation result was more accurate. Specifically, compared to the original U-Net model, the segmentation of Alternaria blotch disease, the MIoU value increased by 4.41%, the MPA value increased by 4.13%, the Precision increased by 1.49%, the Recall increased by 4.13%, and the F1 Score increased by 2.81%; in the segmentation of brown spots, MIoU values increased by 1.18%, MPA values by 0.6%, Precision by 0.78%, Recall by 0.6%, and F1 Score by 0.69%. The spot diameter of the Alternaria blotch disease is 0.2-0.3cm in the early stage, 0.5-0.6cm in the middle and late stages, and the spot diameter of the brown spot disease is 0.3-3cm. Obviously, brown spot spots are larger than Alternaria blotch spots. The segmentation performance of smaller disease spots has increased more noticeably, according to the quantitative analysis results, proving that the model's capacity to segment smaller disease spots has greatly improved. The findings demonstrate that for the detection of apple leaf diseases, the method suggested in this research has a greater recognition accuracy and better segmentation performance. The model in this paper can obtain more sophisticated semantic information in comparison to the traditional U-Net, further enhance the recognition accuracy and segmentation performance of apple leaf spots, and address the issues of low accuracy and low efficiency of conventional disease recognition methods as well as the challenging convergence of conventional deep convolutional networks.
Collapse
|
5
|
Recent advances in plant disease severity assessment using convolutional neural networks. Sci Rep 2023; 13:2336. [PMID: 36759626 PMCID: PMC9911734 DOI: 10.1038/s41598-023-29230-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 01/31/2023] [Indexed: 02/11/2023] Open
Abstract
In modern agricultural production, the severity of diseases is an important factor that directly affects the yield and quality of plants. In order to effectively monitor and control the entire production process of plants, not only the type of disease, but also the severity of the disease must be clarified. In recent years, deep learning for plant disease species identification has been widely used. In particular, the application of convolutional neural network (CNN) to plant disease images has made breakthrough progress. However, there are relatively few studies on disease severity assessment. The group first traced the prevailing views of existing disease researchers to provide criteria for grading the severity of plant diseases. Then, depending on the network architecture, this study outlined 16 studies on CNN-based plant disease severity assessment in terms of classical CNN frameworks, improved CNN architectures and CNN-based segmentation networks, and provided a detailed comparative analysis of the advantages and disadvantages of each. Common methods for acquiring datasets and performance evaluation metrics for CNN models were investigated. Finally, this study discussed the major challenges faced by CNN-based plant disease severity assessment methods in practical applications, and provided feasible research ideas and possible solutions to address these challenges.
Collapse
|
6
|
Haque MA, Marwaha S, Arora A, Deb CK, Misra T, Nigam S, Hooda KS. A lightweight convolutional neural network for recognition of severity stages of maydis leaf blight disease of maize. FRONTIERS IN PLANT SCIENCE 2022; 13:1077568. [PMID: 36643296 PMCID: PMC9833299 DOI: 10.3389/fpls.2022.1077568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 12/01/2022] [Indexed: 06/17/2023]
Abstract
Maydis leaf blight (MLB) of maize (Zea Mays L.), a serious fungal disease, is capable of causing up to 70% damage to the crop under severe conditions. Severity of diseases is considered as one of the important factors for proper crop management and overall crop yield. Therefore, it is quite essential to identify the disease at the earliest possible stage to overcome the yield loss. In this study, we created an image database of maize crop, MDSD (Maydis leaf blight Disease Severity Dataset), containing 1,760 digital images of MLB disease, collected from different agricultural fields and categorized into four groups viz. healthy, low, medium and high severity stages. Next, we proposed a lightweight convolutional neural network (CNN) to identify the severity stages of MLB disease. The proposed network is a simple CNN framework augmented with two modified Inception modules, making it a lightweight and efficient multi-scale feature extractor. The proposed network reported approx. 99.13% classification accuracy with the f1-score of 98.97% on the test images of MDSD. Furthermore, the class-wise accuracy levels were 100% for healthy samples, 98% for low severity samples and 99% for the medium and high severity samples. In addition to that, our network significantly outperforms the popular pretrained models, viz. VGG16, VGG19, InceptionV3, ResNet50, Xception, MobileNetV2, DenseNet121 and NASNetMobile for the MDSD image database. The experimental findings revealed that our proposed lightweight network is excellent in identifying the images of severity stages of MLB disease despite complicated background conditions.
Collapse
Affiliation(s)
- Md. Ashraful Haque
- Division of Computer Applications, Indian Council of Agriculture Research (ICAR)-Indian Agricultural Statistics Research Institute, New Delhi, India
| | - Sudeep Marwaha
- Division of Computer Applications, Indian Council of Agriculture Research (ICAR)-Indian Agricultural Statistics Research Institute, New Delhi, India
| | - Alka Arora
- Division of Computer Applications, Indian Council of Agriculture Research (ICAR)-Indian Agricultural Statistics Research Institute, New Delhi, India
| | - Chandan Kumar Deb
- Division of Computer Applications, Indian Council of Agriculture Research (ICAR)-Indian Agricultural Statistics Research Institute, New Delhi, India
| | - Tanuj Misra
- Department of Computer Science, Rani Lakshmi Bai Central Agricultural University, Jhansi, India
| | - Sapna Nigam
- Division of Computer Applications, Indian Council of Agriculture Research (ICAR)-Indian Agricultural Statistics Research Institute, New Delhi, India
| | - Karambir Singh Hooda
- Division of Germplasm Evaluation, Indian Council of Agriculture Research (ICAR)-National Bureau of Plant Genetic Resources, New Delhi, India
| |
Collapse
|
7
|
Cruz M, Mafra S, Teixeira E, Figueiredo F. Smart Strawberry Farming Using Edge Computing and IoT. SENSORS (BASEL, SWITZERLAND) 2022; 22:5866. [PMID: 35957425 PMCID: PMC9371401 DOI: 10.3390/s22155866] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 07/27/2022] [Accepted: 07/29/2022] [Indexed: 05/02/2023]
Abstract
Strawberries are sensitive fruits that are afflicted by various pests and diseases. Therefore, there is an intense use of agrochemicals and pesticides during production. Due to their sensitivity, temperatures or humidity at extreme levels can cause various damages to the plantation and to the quality of the fruit. To mitigate the problem, this study developed an edge technology capable of handling the collection, analysis, prediction, and detection of heterogeneous data in strawberry farming. The proposed IoT platform integrates various monitoring services into one common platform for digital farming. The system connects and manages Internet of Things (IoT) devices to analyze environmental and crop information. In addition, a computer vision model using Yolo v5 architecture searches for seven of the most common strawberry diseases in real time. This model supports efficient disease detection with 92% accuracy. Moreover, the system supports LoRa communication for transmitting data between the nodes at long distances. In addition, the IoT platform integrates machine learning capabilities for capturing outliers in collected data, ensuring reliable information for the user. All these technologies are unified to mitigate the disease problem and the environmental damage on the plantation. The proposed system is verified through implementation and tested on a strawberry farm, where the capabilities were analyzed and assessed.
Collapse
Affiliation(s)
| | - Samuel Mafra
- Instituto Nacional de Telecomunições (INATEL) Santa Rita Sapucai, Santa Rita do Sapucai 37540-000, MG, Brazil
| | | | | |
Collapse
|