1
|
Karim MJ, Goni MOF, Nahiduzzaman M, Ahsan M, Haider J, Kowalski M. Enhancing agriculture through real-time grape leaf disease classification via an edge device with a lightweight CNN architecture and Grad-CAM. Sci Rep 2024; 14:16022. [PMID: 38992069 PMCID: PMC11239930 DOI: 10.1038/s41598-024-66989-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 07/08/2024] [Indexed: 07/13/2024] Open
Abstract
Crop diseases can significantly affect various aspects of crop cultivation, including crop yield, quality, production costs, and crop loss. The utilization of modern technologies such as image analysis via machine learning techniques enables early and precise detection of crop diseases, hence empowering farmers to effectively manage and avoid the occurrence of crop diseases. The proposed methodology involves the use of modified MobileNetV3Large model deployed on edge device for real-time monitoring of grape leaf disease while reducing computational memory demands and ensuring satisfactory classification performance. To enhance applicability of MobileNetV3Large, custom layers consisting of two dense layers were added, each followed by a dropout layer, helped mitigate overfitting and ensured that the model remains efficient. Comparisons among other models showed that the proposed model outperformed those with an average train and test accuracy of 99.66% and 99.42%, with a precision, recall, and F1 score of approximately 99.42%. The model was deployed on an edge device (Nvidia Jetson Nano) using a custom developed GUI app and predicted from both saved and real-time data with high confidence values. Grad-CAM visualization was used to identify and represent image areas that affect the convolutional neural network (CNN) classification decision-making process with high accuracy. This research contributes to the development of plant disease classification technologies for edge devices, which have the potential to enhance the ability of autonomous farming for farmers, agronomists, and researchers to monitor and mitigate plant diseases efficiently and effectively, with a positive impact on global food security.
Collapse
Affiliation(s)
- Md Jawadul Karim
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, 6204, Bangladesh
| | - Md Omaer Faruq Goni
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, 6204, Bangladesh
| | - Md Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, 6204, Bangladesh
| | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, Heslington, York, YO10 5GH, UK
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester Street, Manchester, M1 5GD, UK
| | - Marcin Kowalski
- Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego 2, 00-908, Warsaw, Poland.
| |
Collapse
|
2
|
Gülmez B. Advancements in rice disease detection through convolutional neural networks: A comprehensive review. Heliyon 2024; 10:e33328. [PMID: 39021980 PMCID: PMC11253532 DOI: 10.1016/j.heliyon.2024.e33328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Revised: 06/19/2024] [Accepted: 06/19/2024] [Indexed: 07/20/2024] Open
Abstract
This review paper addresses the critical need for advanced rice disease detection methods by integrating artificial intelligence, specifically convolutional neural networks (CNNs). Rice, being a staple food for a large part of the global population, is susceptible to various diseases that threaten food security and agricultural sustainability. This research is significant as it leverages technological advancements to tackle these challenges effectively. Drawing upon diverse datasets collected across regions including India, Bangladesh, Türkiye, China, and Pakistan, this paper offers a comprehensive analysis of global research efforts in rice disease detection using CNNs. While some rice diseases are universally prevalent, many vary significantly by growing region due to differences in climate, soil conditions, and agricultural practices. The primary objective is to explore the application of AI, particularly CNNs, for precise and early identification of rice diseases. The literature review includes a detailed examination of data sources, datasets, and preprocessing strategies, shedding light on the geographic distribution of data collection and the profiles of contributing researchers. Additionally, the review synthesizes information on various algorithms and models employed in rice disease detection, highlighting their effectiveness in addressing diverse data complexities. The paper thoroughly evaluates hyperparameter optimization techniques and their impact on model performance, emphasizing the importance of fine-tuning for optimal results. Performance metrics such as accuracy, precision, recall, and F1 score are rigorously analyzed to assess model effectiveness. Furthermore, the discussion section critically examines challenges associated with current methodologies, identifies opportunities for improvement, and outlines future research directions at the intersection of machine learning and rice disease detection. This comprehensive review, analyzing a total of 121 papers, underscores the significance of ongoing interdisciplinary research to meet evolving agricultural technology needs and enhance global food security.
Collapse
Affiliation(s)
- Burak Gülmez
- Leiden Institute of Advanced Computer Science, Leiden University, Leiden, the Netherlands
- Mine Apt, Altay Mah. Sehit A. Taner Ekici Sk. No: 6, 06820, Etimesgut, Ankara, Türkiye
| |
Collapse
|
3
|
Yuan P, Xia Y, Tian Y, Xu H. TRiP: a transfer learning based rice disease phenotype recognition platform using SENet and microservices. FRONTIERS IN PLANT SCIENCE 2024; 14:1255015. [PMID: 38328620 PMCID: PMC10847581 DOI: 10.3389/fpls.2023.1255015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Accepted: 12/26/2023] [Indexed: 02/09/2024]
Abstract
Classification of rice disease is one significant research topics in rice phenotyping. Recognition of rice diseases such as Bacterialblight, Blast, Brownspot, Leaf smut, and Tungro are a critical research field in rice phenotyping. However, accurately identifying these diseases is a challenging issue due to their high phenotypic similarity. To address this challenge, we propose a rice disease phenotype identification framework which utilizing the transfer learning and SENet with attention mechanism on the cloud platform. The pre-trained parameters are transferred to the SENet network for parameters optimization. To capture distinctive features of rice diseases, the attention mechanism is applied for feature extracting. Experiment test and comparative analysis are conducted on the real rice disease datasets. The experimental results show that the accuracy of our method reaches 0.9573. Furthermore, we implemented a rice disease phenotype recognition platform based microservices architecture and deployed it on the cloud, which can provide rice disease phenotype recognition task as a service for easy usage.
Collapse
Affiliation(s)
- Peisen Yuan
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| | - Ye Xia
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| | - Yongchao Tian
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
- College of Agriculture, Nanjing Agricultural University, Nanjing, China
| | - Huanliang Xu
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, China
| |
Collapse
|
4
|
Xu L, Cao B, Ning S, Zhang W, Zhao F. Peanut leaf disease identification with deep learning algorithms. MOLECULAR BREEDING : NEW STRATEGIES IN PLANT IMPROVEMENT 2023; 43:25. [PMID: 37313521 PMCID: PMC10248705 DOI: 10.1007/s11032-023-01370-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/11/2023] [Indexed: 06/15/2023]
Abstract
Peanut is an essential food and oilseed crop. One of the most critical factors contributing to the low yield and destruction of peanut plant growth is leaf disease attack, which will directly reduce the yield and quality of peanut plants. The existing works have shortcomings such as strong subjectivity and insufficient generalization ability. So, we proposed a new deep learning model for peanut leaf disease identification. The proposed model is a combination of an improved X-ception, a parts-activated feature fusion module, and two attention-augmented branches. We obtained an accuracy of 99.69%, which was 9.67%-23.34% higher than those of Inception-V4, ResNet 34, and MobileNet-V3. Besides, supplementary experiments were performed to confirm the generality of the proposed model. The proposed model was applied to cucumber, apple, rice, corn, and wheat leaf disease identification, and yielded an average accuracy of 99.61%. The experimental results demonstrate that the proposed model can identify different crop leaf diseases, proving its feasibility and generalization. The proposed model has a positive significance for exploring other crop diseases' detection. Supplementary Information The online version contains supplementary material available at 10.1007/s11032-023-01370-8.
Collapse
Affiliation(s)
- Laixiang Xu
- School of Information and Communication Engineering, Hainan University, 570228 Haikou, China
- Haikou, China
| | - Bingxu Cao
- Information Engineering Department, Luohe Vocational Technology College, Luohe, 462000 China
- Luohe, China
| | - Shiyuan Ning
- Department of Software Information, China Electronics Technology Group Corporation 36th Research Institute, Jiaxing, 314033 China
| | - Wenbo Zhang
- School of Information and Communication Engineering, Hainan University, 570228 Haikou, China
| | - Fengjie Zhao
- Henan Sui Xian People’s Hospital, The First Affiliated Hospital of Zhengzhou University, Shangqiu First People’s Hospital, Shangqiu, 476000 China
| |
Collapse
|
5
|
Shi T, Liu Y, Zheng X, Hu K, Huang H, Liu H, Huang H. Recent advances in plant disease severity assessment using convolutional neural networks. Sci Rep 2023; 13:2336. [PMID: 36759626 PMCID: PMC9911734 DOI: 10.1038/s41598-023-29230-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 01/31/2023] [Indexed: 02/11/2023] Open
Abstract
In modern agricultural production, the severity of diseases is an important factor that directly affects the yield and quality of plants. In order to effectively monitor and control the entire production process of plants, not only the type of disease, but also the severity of the disease must be clarified. In recent years, deep learning for plant disease species identification has been widely used. In particular, the application of convolutional neural network (CNN) to plant disease images has made breakthrough progress. However, there are relatively few studies on disease severity assessment. The group first traced the prevailing views of existing disease researchers to provide criteria for grading the severity of plant diseases. Then, depending on the network architecture, this study outlined 16 studies on CNN-based plant disease severity assessment in terms of classical CNN frameworks, improved CNN architectures and CNN-based segmentation networks, and provided a detailed comparative analysis of the advantages and disadvantages of each. Common methods for acquiring datasets and performance evaluation metrics for CNN models were investigated. Finally, this study discussed the major challenges faced by CNN-based plant disease severity assessment methods in practical applications, and provided feasible research ideas and possible solutions to address these challenges.
Collapse
Affiliation(s)
- Tingting Shi
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Yongmin Liu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China.
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China.
| | - Xinying Zheng
- Business School of Hunan Normal University, Changsha, 410081, China
| | - Kui Hu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hao Huang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hanlin Liu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hongxu Huang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| |
Collapse
|
6
|
Alshammari H, Gasmi K, Ben Ltaifa I, Krichen M, Ben Ammar L, Mahmood MA. Olive Disease Classification Based on Vision Transformer and CNN Models. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3998193. [PMID: 35958771 PMCID: PMC9357740 DOI: 10.1155/2022/3998193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 06/23/2022] [Indexed: 12/01/2022]
Abstract
It has been noted that disease detection approaches based on deep learning are becoming increasingly important in artificial intelligence-based research in the field of agriculture. Studies conducted in this area are not at the level that is desirable due to the diversity of plant species and the regional characteristics of many of these species. Although numerous researchers have studied diseases on plant leaves, it is undeniable that timely diagnosis of diseases on olive leaves remains a difficult task. It is estimated that people have been cultivating olive trees for 6000 years, making it one of the most useful and profitable fruit trees in history. Symptoms that appear on infected leaves can vary from one plant to another or even between individual leaves on the same plant. Because olive groves are susceptible to a variety of pathogens, including bacterial blight, olive knot, Aculus olearius, and olive peacock spot, it has been difficult to develop an effective olive disease detection algorithm. For this reason, we developed a unique deep ensemble learning strategy that combines the convolutional neural network model with vision transformer model. The goal of this method is to detect and classify diseases that can affect olive leaves. In addition, binary and multiclassification systems based on deep convolutional models were used to categorize olive leaf disease. The results are encouraging and show how effectively CNN and vision transformer models can be used together. Our model outperformed the other models with an accuracy of about 96% for multiclass classification and 97% for binary classification, as shown by the experimental results reported in this study.
Collapse
Affiliation(s)
- Hamoud Alshammari
- Department of Information Systems College of Computer and Information Sciences, Jouf University, Jouf, Saudi Arabia
| | - Karim Gasmi
- Department of Computer Science, College of Arts and Sciences at Tabarjal, Jouf University, Jouf, Saudi Arabia
- ReDCAD Laboratory, University of Sfax, Sfax, Tunisia
| | | | - Moez Krichen
- ReDCAD Laboratory, University of Sfax, Sfax, Tunisia
- Faculty of CSIT, Al-Baha University, Al Bahah, Saudi Arabia
| | - Lassaad Ben Ammar
- College of Sciences and Humanities, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Mahmood A. Mahmood
- Department of Information Systems College of Computer and Information Sciences, Jouf University, Jouf, Saudi Arabia
- Department of Information Systems and Technology, FGSSR, Cairo University, Egypt
| |
Collapse
|
7
|
Albattah W, Javed A, Nawaz M, Masood M, Albahli S. Artificial Intelligence-Based Drone System for Multiclass Plant Disease Detection Using an Improved Efficient Convolutional Neural Network. FRONTIERS IN PLANT SCIENCE 2022; 13:808380. [PMID: 35755664 PMCID: PMC9218756 DOI: 10.3389/fpls.2022.808380] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 04/08/2022] [Indexed: 05/31/2023]
Abstract
The role of agricultural development is very important in the economy of a country. However, the occurrence of several plant diseases is a major hindrance to the growth rate and quality of crops. The exact determination and categorization of crop leaf diseases is a complex and time-required activity due to the occurrence of low contrast information in the input samples. Moreover, the alterations in the size, location, structure of crop diseased portion, and existence of noise and blurriness effect in the input images further complicate the classification task. To solve the problems of existing techniques, a robust drone-based deep learning approach is proposed. More specifically, we have introduced an improved EfficientNetV2-B4 with additional added dense layers at the end of the architecture. The customized EfficientNetV2-B4 calculates the deep key points and classifies them in their related classes by utilizing an end-to-end training architecture. For performance evaluation, a standard dataset, namely, the PlantVillage Kaggle along with the samples captured using a drone is used which is complicated in the aspect of varying image samples with diverse image capturing conditions. We attained the average precision, recall, and accuracy values of 99.63, 99.93, and 99.99%, respectively. The obtained results confirm the robustness of our approach in comparison to other recent techniques and also show less time complexity.
Collapse
Affiliation(s)
- Waleed Albattah
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| | - Ali Javed
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Momina Masood
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Saleh Albahli
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| |
Collapse
|
8
|
Qian X, Zhang C, Chen L, Li K. Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention. FRONTIERS IN PLANT SCIENCE 2022; 13:864486. [PMID: 35574079 PMCID: PMC9096888 DOI: 10.3389/fpls.2022.864486] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 03/28/2022] [Indexed: 06/15/2023]
Abstract
Maize leaf diseases significantly reduce maize yield; therefore, monitoring and identifying the diseases during the growing season are crucial. Some of the current studies are based on images with simple backgrounds, and the realistic field settings are full of background noise, making this task challenging. We collected low-cost red, green, and blue (RGB) images from our experimental fields and public dataset, and they contain a total of four categories, namely, southern corn leaf blight (SCLB), gray leaf spot (GLS), southern corn rust (SR), and healthy (H). This article proposes a model different from convolutional neural networks (CNNs) based on transformer and self-attention. It represents visual information of local regions of images by tokens, calculates the correlation (called attention) of information between local regions with an attention mechanism, and finally integrates global information to make the classification. The results show that our model achieves the best performance compared to five mainstream CNNs at a meager computational cost, and the attention mechanism plays an extremely important role. The disease lesions information was effectively emphasized, and the background noise was suppressed. The proposed model is more suitable for fine-grained maize leaf disease identification in a complex background, and we demonstrated this idea from three perspectives, namely, theoretical, experimental, and visualization.
Collapse
Affiliation(s)
- Xiufeng Qian
- School of Information and Computer, Anhui Agricultural University, Hefei, China
- Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information, Anhui Agricultural University, Hefei, China
- Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei, China
| | - Chengqi Zhang
- School of Plant Protection, Anhui Agricultural University, Hefei, China
| | - Li Chen
- School of Plant Protection, Anhui Agricultural University, Hefei, China
| | - Ke Li
- School of Information and Computer, Anhui Agricultural University, Hefei, China
- Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information, Anhui Agricultural University, Hefei, China
- Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei, China
| |
Collapse
|