1
|
Chang Y, Zhou D, Tang Y, Ou S, Wang S. An improved deep learning network for image detection and its application in Dendrobii caulis decoction piece. Sci Rep 2024; 14:13505. [PMID: 38866849 PMCID: PMC11169365 DOI: 10.1038/s41598-024-63398-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 05/28/2024] [Indexed: 06/14/2024] Open
Abstract
In recent years, with the increasing demand for high-quality Dendrobii caulis decoction piece, the identification of D. caulis decoction piece species has become an urgent issue. However, the current methods are primarily designed for professional quality control and supervision. Therefore, ordinary consumers should not rely on these methods to assess the quality of products when making purchases. This research proposes a deep learning network called improved YOLOv5 for detecting different types of D. caulis decoction piece from images. In the main architecture of improved YOLOv5, we have designed the C2S module to replace the C3 module in YOLOv5, thereby enhancing the network's feature extraction capability for dense and small targets. Additionally, we have introduced the Reparameterized Generalized Feature Pyramid Network (RepGFPN) module and Optimal Transport Assignment (OTA) operator to more effectively integrate the high-dimensional and low-dimensional features of the network. Furthermore, a new large-scale dataset of Dendrobium images has been established. Compared to other models with similar computational complexity, improved YOLOv5 achieves the highest detection accuracy, with an average mAP@.05 of 96.5%. It is computationally equivalent to YOLOv5 but surpasses YOLOv5 by 2 percentage points in terms of accuracy.
Collapse
Affiliation(s)
- Yonghu Chang
- School of Medical Information Engineering, Zunyi Medical University, Zunyi, 563000, China
| | - Dejin Zhou
- School of Pharmacy, Zunyi Medical University, Zunyi, 563000, China
| | - Yongchuan Tang
- School of Microelectronics, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Shuiping Ou
- Department of Pharmacy, Affiliated Hospital of Zunyi Medical University, Zunyi, 563000, China
| | - Sen Wang
- School of Pharmacy, Zunyi Medical University, Zunyi, 563000, China.
| |
Collapse
|
2
|
Chilakalapudi M, Jayachandran S. Optimized deep learning network for plant leaf disease segmentation and multi-classification using leaf images. NETWORK (BRISTOL, ENGLAND) 2024:1-34. [PMID: 38661039 DOI: 10.1080/0954898x.2024.2337801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 03/27/2024] [Indexed: 04/26/2024]
Abstract
Automatic detection of plant diseases is very imperative for monitoring the plants because they are one of the major concerns in the agricultural sector. Continuous monitoring can combat diseases of plants, which contribute to production loss. In the global production of agricultural goods, the disease of plants plays a significant role and harms yield, resulting in losses for the economy, society, and environment. It seems like a difficult and time-consuming task to manually identify diseased symptoms on leaves. The majority of disease symptoms are reflected in plant leaves, but experts in laboratories spend a lot of money and time diagnosing them. The majority of the features, which affect crop superiority and amount are plant or crop diseases. Therefore, classification, segmentation, and recognition of contaminated symptoms at the starting phase of infection is indispensable. Precision agriculture employs a deep learning model to jointly address these issues. In this research, an efficient disease of plant leaf segmentation and plant leaf disease recognition model is introduced using an optimized deep learning technique. As a result, maximum testing accuracy of 94.69%, sensitivity of 95.58%, and specificity of 92.90% were attained by the optimized deep learning method.
Collapse
Affiliation(s)
- Malathi Chilakalapudi
- School of Computer Science and Engineering (SCOPE), VIT-AP University, Andhra Pradesh, India
| | - Sheela Jayachandran
- School of Computer Science and Engineering (SCOPE), VIT-AP University, Andhra Pradesh, India
| |
Collapse
|
3
|
Kalpana P, Anandan R, Hussien AG, Migdady H, Abualigah L. Plant disease recognition using residual convolutional enlightened Swin transformer networks. Sci Rep 2024; 14:8660. [PMID: 38622177 PMCID: PMC11018742 DOI: 10.1038/s41598-024-56393-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 03/06/2024] [Indexed: 04/17/2024] Open
Abstract
Agriculture plays a pivotal role in the economic development of a nation, but, growth of agriculture is affected badly by the many factors one such is plant diseases. Early stage prediction of these disease is crucial role for global health and even for game changers the farmer's life. Recently, adoption of modern technologies, such as the Internet of Things (IoT) and deep learning concepts has given the brighter light of inventing the intelligent machines to predict the plant diseases before it is deep-rooted in the farmlands. But, precise prediction of plant diseases is a complex job due to the presence of noise, changes in the intensities, similar resemblance between healthy and diseased plants and finally dimension of plant leaves. To tackle this problem, high-accurate and intelligently tuned deep learning algorithms are mandatorily needed. In this research article, novel ensemble of Swin transformers and residual convolutional networks are proposed. Swin transformers (ST) are hierarchical structures with linearly scalable computing complexity that offer performance and flexibility at various scales. In order to extract the best deep key-point features, the Swin transformers and residual networks has been combined, followed by Feed forward networks for better prediction. Extended experimentation is conducted using Plant Village Kaggle datasets, and performance metrics, including accuracy, precision, recall, specificity, and F1-rating, are evaluated and analysed. Existing structure along with FCN-8s, CED-Net, SegNet, DeepLabv3, Dense nets, and Central nets are used to demonstrate the superiority of the suggested version. The experimental results show that in terms of accuracy, precision, recall, and F1-rating, the introduced version shown better performances than the other state-of-art hybrid learning models.
Collapse
Affiliation(s)
- Ponugoti Kalpana
- Department of Computer Science Engineering, Vels Institute of Science Technology and Advanced Studies, Chennai, Tamil Nadu, 600117, India.
| | - R Anandan
- Department of Computer Science Engineering, Vels Institute of Science Technology and Advanced Studies, Chennai, Tamil Nadu, 600117, India
| | - Abdelazim G Hussien
- Department of Computer and Information Science, Linköping University, Linköping, Sweden.
- Faculty of Science, Fayoum University, Fayoum, Egypt.
| | - Hazem Migdady
- CSMIS Department, Oman College of Management and Technology, 320, Barka, Oman
| | - Laith Abualigah
- Artificial Intelligence and Sensing Technologies (AIST) Research Center, University of Tabuk, 71491, Tabuk, Saudi Arabia
- Computer Science Department, Al Al-Bayt University, Mafraq, 25113, Jordan
- Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman, 19328, Jordan
- MEU Research Unit, Middle East University, Amman, 11831, Jordan
- Department of Electrical and Computer Engineering, Lebanese American University, Byblos, 13-5053, Lebanon
- School of Computer Sciences, Universiti Sains Malaysia, 11800, George Town, Penang, Malaysia
- School of Engineering and Technology, Sunway University Malaysia, 27500, Petaling Jaya, Malaysia
- Applied Science Research Center, Applied Science Private University, Amman, 11931, Jordan
- College of Engineering, Yuan Ze University, Taoyuan, Taiwan
| |
Collapse
|
4
|
Ma N, Su Y, Yang L, Li Z, Yan H. Wheat Seed Detection and Counting Method Based on Improved YOLOv8 Model. SENSORS (BASEL, SWITZERLAND) 2024; 24:1654. [PMID: 38475189 DOI: 10.3390/s24051654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 02/29/2024] [Accepted: 03/01/2024] [Indexed: 03/14/2024]
Abstract
Wheat seed detection has important applications in calculating thousand-grain weight and crop breeding. In order to solve the problems of seed accumulation, adhesion, and occlusion that can lead to low counting accuracy, while ensuring fast detection speed with high accuracy, a wheat seed counting method is proposed to provide technical support for the development of the embedded platform of the seed counter. This study proposes a lightweight real-time wheat seed detection model, YOLOv8-HD, based on YOLOv8. Firstly, we introduce the concept of shared convolutional layers to improve the YOLOv8 detection head, reducing the number of parameters and achieving a lightweight design to improve runtime speed. Secondly, we incorporate the Vision Transformer with a Deformable Attention mechanism into the C2f module of the backbone network to enhance the network's feature extraction capability and improve detection accuracy. The results show that in the stacked scenes with impurities (severe seed adhesion), the YOLOv8-HD model achieves an average detection accuracy (mAP) of 77.6%, which is 9.1% higher than YOLOv8. In all scenes, the YOLOv8-HD model achieves an average detection accuracy (mAP) of 99.3%, which is 16.8% higher than YOLOv8. The memory size of the YOLOv8-HD model is 6.35 MB, approximately 4/5 of YOLOv8. The GFLOPs of YOLOv8-HD decrease by 16%. The inference time of YOLOv8-HD is 2.86 ms (on GPU), which is lower than YOLOv8. Finally, we conducted numerous experiments and the results showed that YOLOv8-HD outperforms other mainstream networks in terms of mAP, speed, and model size. Therefore, our YOLOv8-HD can efficiently detect wheat seeds in various scenarios, providing technical support for the development of seed counting instruments.
Collapse
Affiliation(s)
- Na Ma
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu District, Jinzhong 030801, China
| | - Yaxin Su
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu District, Jinzhong 030801, China
| | - Lexin Yang
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu District, Jinzhong 030801, China
| | - Zhongtao Li
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu District, Jinzhong 030801, China
| | - Hongwen Yan
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu District, Jinzhong 030801, China
| |
Collapse
|
5
|
Bedi P, Gole P, Marwaha S. PDSE-Lite: lightweight framework for plant disease severity estimation based on Convolutional Autoencoder and Few-Shot Learning. FRONTIERS IN PLANT SCIENCE 2024; 14:1319894. [PMID: 38259916 PMCID: PMC10800669 DOI: 10.3389/fpls.2023.1319894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 12/12/2023] [Indexed: 01/24/2024]
Abstract
Plant disease diagnosis with estimation of disease severity at early stages still remains a significant research challenge in agriculture. It is helpful in diagnosing plant diseases at the earliest so that timely action can be taken for curing the disease. Existing studies often rely on labor-intensive manually annotated large datasets for disease severity estimation. In order to conquer this problem, a lightweight framework named "PDSE-Lite" based on Convolutional Autoencoder (CAE) and Few-Shot Learning (FSL) is proposed in this manuscript for plant disease severity estimation with few training instances. The PDSE-Lite framework is designed and developed in two stages. In first stage, a lightweight CAE model is built and trained to reconstruct leaf images from original leaf images with minimal reconstruction loss. In subsequent stage, pretrained layers of the CAE model built in the first stage are utilized to develop the image classification and segmentation models, which are then trained using FSL. By leveraging FSL, the proposed framework requires only a few annotated instances for training, which significantly reduces the human efforts required for data annotation. Disease severity is then calculated by determining the percentage of diseased leaf pixels obtained through segmentation out of the total leaf pixels. The PDSE-Lite framework's performance is evaluated on Apple-Tree-Leaf-Disease-Segmentation (ATLDS) dataset. However, the proposed framework can identify any plant disease and quantify the severity of identified diseases. Experimental results reveal that the PDSE-Lite framework can accurately detect healthy and four types of apple tree diseases as well as precisely segment the diseased area from leaf images by using only two training samples from each class of the ATLDS dataset. Furthermore, the PDSE-Lite framework's performance is compared with existing state-of-the-art techniques, and it is found that this framework outperformed these approaches. The proposed framework's applicability is further verified by statistical hypothesis testing using Student t-test. The results obtained from this test confirm that the proposed framework can precisely estimate the plant disease severity with a confidence interval of 99%. Hence, by reducing the reliance on large-scale manual data annotation, the proposed framework offers a promising solution for early-stage plant disease diagnosis and severity estimation.
Collapse
Affiliation(s)
- Punam Bedi
- Department of Computer Science, University of Delhi, New Delhi, India
| | - Pushkar Gole
- Department of Computer Science, University of Delhi, New Delhi, India
| | - Sudeep Marwaha
- ICAR-Indian Agricultural Statistics Research Institute, New Delhi, India
| |
Collapse
|
6
|
Nyasulu C, Diattara A, Traore A, Ba C, Diedhiou PM, Sy Y, Raki H, Peluffo-Ordóñez DH. A comparative study of Machine Learning-based classification of Tomato fungal diseases: Application of GLCM texture features. Heliyon 2023; 9:e21697. [PMID: 38027996 PMCID: PMC10656238 DOI: 10.1016/j.heliyon.2023.e21697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 10/11/2023] [Accepted: 10/26/2023] [Indexed: 12/01/2023] Open
Abstract
Globally, agriculture remains an important source of food and economic development. Due to various plant diseases, farmers continue to suffer huge yield losses in both quality and quantity. In this study, we explored the potential of using Artificial Neural Networks, K-Nearest Neighbors, Random Forest, and Support Vector Machine to classify tomato fungal leaf diseases: Alternaria, Curvularia, Helminthosporium, and Lasiodiplodi based on Gray Level Co-occurrence Matrix texture features. Small differences between symptoms of these diseases make it difficult to use the naked eye to obtain better results in detecting and distinguishing these diseases. The Artificial Neural Network outperformed other classifiers with an overall accuracy of 94% and average scores of 93.6% for Precision, 93.8% for Recall, and 93.8% for F1-score. Generally, the models confused samples originally belonging to Helminthosporium with Curvularia. The extracted texture features show great potential to classify the different tomato leaf fungal diseases. The results of this study show that texture characteristics of the Gray Level Co-occurrence Matrix play a critical role in the establishment of tomato leaf disease classification systems and can facilitate the implementation of preventive measures by farmers, resulting in enhanced yield quality and quantity.
Collapse
Affiliation(s)
- Chimango Nyasulu
- LANI (Laboratoire d'Analyse Numérique et Informatique), University of Gaston Berger, BP:234, Saint-Louis, 32000, Saint-Louis, Senegal
- College of Computing, Mohammed VI Polytechnic University, Lot 660, Hay Moulay Rachid, Ben Guerir, 43150, Ben Guerir, Morocco
| | - Awa Diattara
- LANI (Laboratoire d'Analyse Numérique et Informatique), University of Gaston Berger, BP:234, Saint-Louis, 32000, Saint-Louis, Senegal
| | | | - Cheikh Ba
- LANI (Laboratoire d'Analyse Numérique et Informatique), University of Gaston Berger, BP:234, Saint-Louis, 32000, Saint-Louis, Senegal
| | - Papa Madiallacké Diedhiou
- UFR des Sciences Agronomiques d'Aquaculture et des Technologies Alimentaires, University of Gaston Berger, BP:234, Saint-Louis, 32000, Saint-Louis, Senegal
| | - Yakhya Sy
- UFR des Sciences Agronomiques d'Aquaculture et des Technologies Alimentaires, University of Gaston Berger, BP:234, Saint-Louis, 32000, Saint-Louis, Senegal
| | - Hind Raki
- College of Computing, Mohammed VI Polytechnic University, Lot 660, Hay Moulay Rachid, Ben Guerir, 43150, Ben Guerir, Morocco
- Faculty of Engineering, Corporación Universitaria Autónoma de Nariño, Pasto, 520001, Nariño, Colombia
| | - Diego Hernán Peluffo-Ordóñez
- College of Computing, Mohammed VI Polytechnic University, Lot 660, Hay Moulay Rachid, Ben Guerir, 43150, Ben Guerir, Morocco
- Faculty of Engineering, Corporación Universitaria Autónoma de Nariño, Pasto, 520001, Nariño, Colombia
- SDAS Research Group, Lot 660, Hay Moulay Rachid, Ben Guerir, 43150, Ben Guerir, Morocco
| |
Collapse
|
7
|
Kanna GP, Kumar SJKJ, Kumar Y, Changela A, Woźniak M, Shafi J, Ijaz MF. Advanced deep learning techniques for early disease prediction in cauliflower plants. Sci Rep 2023; 13:18475. [PMID: 37891188 PMCID: PMC10611743 DOI: 10.1038/s41598-023-45403-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 10/19/2023] [Indexed: 10/29/2023] Open
Abstract
Agriculture plays a pivotal role in the economies of developing countries by providing livelihoods, sustenance, and employment opportunities in rural areas. However, crop diseases pose a significant threat to both farmers' incomes and food security. Furthermore, these diseases also show adverse effects on human health by causing various illnesses. Till date, only a limited number of studies have been conducted to identify and classify diseased cauliflower plants but they also face certain challenges such as insufficient disease surveillance mechanisms, the lack of comprehensive datasets that are properly labelled as well as are of high quality, and the considerable computational resources that are necessary for conducting thorough analysis. In view of the aforementioned challenges, the primary objective of this manuscript is to tackle these significant concerns and enhance understanding regarding the significance of cauliflower disease identification and detection in rural agriculture through the use of advanced deep transfer learning techniques. The work is conducted on the four classes of cauliflower diseases i.e. Bacterial spot rot, Black rot, Downy Mildew, and No disease which are taken from VegNet dataset. Ten deep transfer learning models such as EfficientNetB0, Xception, EfficientNetB1, MobileNetV2, EfficientNetB2, DenseNet201, EfficientNetB3, InceptionResNetV2, EfficientNetB4, and ResNet152V2, are trained and examined on the basis of root mean square error, recall, precision, F1-score, accuracy, and loss. Remarkably, EfficientNetB1 achieved the highest validation accuracy (99.90%), lowest loss (0.16), and root mean square error (0.40) during experimentation. It has been observed that our research highlights the critical role of advanced CNN models in automating cauliflower disease detection and classification and such models can lead to robust applications for cauliflower disease management in agriculture, ultimately benefiting both farmers and consumers.
Collapse
Affiliation(s)
- G Prabu Kanna
- School of Computer Science and Engineering, VIT Bhopal University, Bhopal-Indore Highway, Kothrikalan, Sehore Madhya Pradesh - 466114, India
| | - S J K Jagadeesh Kumar
- Department of Computer Science and Engineering, Kathir College of Engineering, Neelambur, India
| | - Yogesh Kumar
- Department of CSE, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India.
| | - Ankur Changela
- Department of ICT, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India
| | - Marcin Woźniak
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100, Gliwice, Poland
| | - Jana Shafi
- Department of Computer Science, College of Arts and Science, Prince Sattam bin Abdul Aziz University, 11991, Wadi Ad-Dawasir, Saudi Arabia
| | - Muhammad Fazal Ijaz
- School of IT and Engineering, Melbourne Institute of Technology, Melbourne, 3000, Australia.
| |
Collapse
|
8
|
Nahiduzzaman M, Chowdhury MEH, Salam A, Nahid E, Ahmed F, Al-Emadi N, Ayari MA, Khandakar A, Haider J. Explainable deep learning model for automatic mulberry leaf disease classification. FRONTIERS IN PLANT SCIENCE 2023; 14:1175515. [PMID: 37794930 PMCID: PMC10546311 DOI: 10.3389/fpls.2023.1175515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 08/28/2023] [Indexed: 10/06/2023]
Abstract
Mulberry leaves feed Bombyx mori silkworms to generate silk thread. Diseases that affect mulberry leaves have reduced crop and silk yields in sericulture, which produces 90% of the world's raw silk. Manual leaf disease identification is tedious and error-prone. Computer vision can categorize leaf diseases early and overcome the challenges of manual identification. No mulberry leaf deep learning (DL) models have been reported. Therefore, in this study, two types of leaf diseases: leaf rust and leaf spot, with disease-free leaves, were collected from two regions of Bangladesh. Sericulture experts annotated the leaf images. The images were pre-processed, and 6,000 synthetic images were generated using typical image augmentation methods from the original 764 training images. Additional 218 and 109 images were employed for testing and validation respectively. In addition, a unique lightweight parallel depth-wise separable CNN model, PDS-CNN was developed by applying depth-wise separable convolutional layers to reduce parameters, layers, and size while boosting classification performance. Finally, the explainable capability of PDS-CNN is obtained through the use of SHapley Additive exPlanations (SHAP) evaluated by a sericulture specialist. The proposed PDS-CNN outperforms well-known deep transfer learning models, achieving an optimistic accuracy of 95.05 ± 2.86% for three-class classifications and 96.06 ± 3.01% for binary classifications with only 0.53 million parameters, 8 layers, and a size of 6.3 megabytes. Furthermore, when compared with other well-known transfer models, the proposed model identified mulberry leaf diseases with higher accuracy, fewer factors, fewer layers, and lower overall size. The visually expressive SHAP explanation images validate the models' findings aligning with the predictions made the sericulture specialist. Based on these findings, it is possible to conclude that the explainable AI (XAI)-based PDS-CNN can provide sericulture specialists with an effective tool for accurately categorizing mulberry leaves.
Collapse
Affiliation(s)
- Md. Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh
- Department of Electrical Engineering, Qatar University, Doha, Qatar
| | | | - Abdus Salam
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh
| | - Emama Nahid
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh
| | - Faruque Ahmed
- Bangladesh Sericulture Research and Training Institute, Rajshahi, Bangladesh
| | - Nasser Al-Emadi
- Department of Electrical Engineering, Qatar University, Doha, Qatar
| | - Mohamed Arselene Ayari
- Department of Civil and Environmental Engineering, Qatar University, Doha, Qatar
- Technology Innovation and Engineering Education Unit, Qatar University, Doha, Qatar
| | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha, Qatar
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Manchester, United Kingdom
| |
Collapse
|
9
|
Badiger M, Mathew JA. Tomato plant leaf disease segmentation and multiclass disease detection using hybrid optimization enabled deep learning. J Biotechnol 2023; 374:101-113. [PMID: 37543108 DOI: 10.1016/j.jbiotec.2023.07.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 07/28/2023] [Accepted: 07/31/2023] [Indexed: 08/07/2023]
Abstract
Production of crops is increasing day by day in agriculture sectors. The insecurity of food is a main reason of plant disease and is a main global issue that humans face these days. With the design of contemporary environmental agriculture, more focus is devised for yielding the crop and elevating its quality. The occurrence of crops has elevated in years and the kind of disease has become more and more complex. The disease in plants and the pernicious insects are the major risks in agriculture field. Thus, earlier discovery and treatment of this disease are imperative. The major design of Deep Learning (DL) model helped in detecting the plant disease and grants a dynamic tool with accurate results. This paper presents DL-assisted technique for detecting and classifying the tomato disease and used deep batch-normalized eLu Alex Net (DbneAlexnet) for classifying the tomato plant leaves. Initially, tomato plant leaf images are taken as an input from specific dataset represented and it is subjected to preprocessing phase to eliminate unwanted distortions using anisotropic filtering. Then, the segmentation is carried out using U-net, which is trained by Gradient-Golden search optimization (Gradient-GSO) Algorithm and it is incorporation of both Golden search optimization (GSO) and Gradient concept. Thereafter the segmented image is given to image augmentation process, where position augmentation and color augmentation are considered. Finally, the multiclass plant leaf disease is classified using DbneAlexnet and is trained using proposed Gradient Jaya- Golden search optimization (GJ-GSO). Here, the GJ-GSO is devised with the integration of Gradient concept, Jaya algorithm, and GSO algorithm. The proposed GJ-GSO-based DbneAlexnet outperformed highest accuracy of 92.4%, True positive rate (TPR) of 91.9%, True negative rate (TNR) of 92.2% and smallest False Positive Rate (FPR) of 0.078. Hence, the technique with unified segmentation and classification is effectual for identifying the plant disease and the empirical research verifies the benefits of the developed model.
Collapse
Affiliation(s)
- Manjunatha Badiger
- Department of Electronics & Communication Engineering, Sahyadri College of Engineering & Management, Mangaluru, Karnataka 575007, India.
| | - Jose Alex Mathew
- Department of Artificial Intelligence and Data Science, Srinivas Institute of Technology, Mangaluru, Karnataka 574143, India
| |
Collapse
|
10
|
Podder KK, Ezeddin M, Chowdhury MEH, Sumon MSI, Tahir AM, Ayari MA, Dutta P, Khandakar A, Mahbub ZB, Kadir MA. Signer-Independent Arabic Sign Language Recognition System Using Deep Learning Model. SENSORS (BASEL, SWITZERLAND) 2023; 23:7156. [PMID: 37631693 PMCID: PMC10459624 DOI: 10.3390/s23167156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 07/27/2023] [Accepted: 08/03/2023] [Indexed: 08/27/2023]
Abstract
Every one of us has a unique manner of communicating to explore the world, and such communication helps to interpret life. Sign language is the popular language of communication for hearing and speech-disabled people. When a sign language user interacts with a non-sign language user, it becomes difficult for a signer to express themselves to another person. A sign language recognition system can help a signer to interpret the sign of a non-sign language user. This study presents a sign language recognition system that is capable of recognizing Arabic Sign Language from recorded RGB videos. To achieve this, two datasets were considered, such as (1) the raw dataset and (2) the face-hand region-based segmented dataset produced from the raw dataset. Moreover, operational layer-based multi-layer perceptron "SelfMLP" is proposed in this study to build CNN-LSTM-SelfMLP models for Arabic Sign Language recognition. MobileNetV2 and ResNet18-based CNN backbones and three SelfMLPs were used to construct six different models of CNN-LSTM-SelfMLP architecture for performance comparison of Arabic Sign Language recognition. This study examined the signer-independent mode to deal with real-time application circumstances. As a result, MobileNetV2-LSTM-SelfMLP on the segmented dataset achieved the best accuracy of 87.69% with 88.57% precision, 87.69% recall, 87.72% F1 score, and 99.75% specificity. Overall, face-hand region-based segmentation and SelfMLP-infused MobileNetV2-LSTM-SelfMLP surpassed the previous findings on Arabic Sign Language recognition by 10.970% accuracy.
Collapse
Affiliation(s)
- Kanchon Kanti Podder
- Department of Biomedical Physics & Technology, University of Dhaka, Dhaka 1000, Bangladesh
| | - Maymouna Ezeddin
- Department of Computer Science, Hamad Bin Khalifa University, Doha 34110, Qatar
| | | | - Md. Shaheenur Islam Sumon
- Department of Biomedical Engineering, Military Institute of Science and Technology (MIST), Dhaka 1216, Bangladesh
| | - Anas M. Tahir
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | | | - Proma Dutta
- Department of Electrical& Electronic Engineering, Chittagong University of Engineering & Technology, Chittagong 4349, Bangladesh
| | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | - Zaid Bin Mahbub
- Department of Mathematics and Physics, North South University, Dhaka 1229, Bangladesh
| | - Muhammad Abdul Kadir
- Department of Biomedical Physics & Technology, University of Dhaka, Dhaka 1000, Bangladesh
| |
Collapse
|
11
|
Deng Y, Xi H, Zhou G, Chen A, Wang Y, Li L, Hu Y. An Effective Image-Based Tomato Leaf Disease Segmentation Method Using MC-UNet. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0049. [PMID: 37228512 PMCID: PMC10204749 DOI: 10.34133/plantphenomics.0049] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 04/21/2023] [Indexed: 05/27/2023]
Abstract
Tomato disease control is an urgent requirement in the field of intellectual agriculture, and one of the keys to it is quantitative identification and precise segmentation of tomato leaf diseases. Some diseased areas on tomato leaves are tiny and may go unnoticed during segmentation. Blurred edge also makes the segmentation accuracy poor. Based on UNet, we propose an effective image-based tomato leaf disease segmentation method called Cross-layer Attention Fusion Mechanism combined with Multi-scale Convolution Module (MC-UNet). First, a Multi-scale Convolution Module is proposed. This module obtains multiscale information about tomato disease by employing 3 convolution kernels of different sizes, and it highlights the edge feature information of tomato disease using the Squeeze-and-Excitation Module. Second, a Cross-layer Attention Fusion Mechanism is proposed. This mechanism highlights tomato leaf disease locations via gating structure and fusion operation. Then, we employ SoftPool rather than MaxPool to retain valid information on tomato leaves. Finally, we use the SeLU function appropriately to avoid network neuron dropout. We compared MC-UNet to the existing segmentation network on our self-built tomato leaf disease segmentation dataset and MC-UNet achieved 91.32% accuracy and 6.67M parameters. Our method achieves good results for tomato leaf disease segmentation, which demonstrates the effectiveness of the proposed methods.
Collapse
Affiliation(s)
- Yubao Deng
- College of Computer & Information Engineering,
Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
| | - Haoran Xi
- College of Mechanical & Electrical Engineering,
Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
| | - Guoxiong Zhou
- College of Computer & Information Engineering,
Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
| | - Aibin Chen
- College of Computer & Information Engineering,
Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
| | - Yanfeng Wang
- National University of Defense Technology, 410015, Changsha, Hunan, China
| | - Liujun Li
- Department of Soil and Water Systems,
University of Idaho, Moscow, ID, 83844, USA
| | - Yahui Hu
- Plant Protection Research Institute, Academy of Agricultural Sciences, 410125, Changsha, Hunan, China
| |
Collapse
|
12
|
Mittal U, Wadhawan A, Singla J, Jhanjhi NZ, Ghoniem RM, Ray SK, Abdelmaboud A. Plant Disease Detection and Classification: A Systematic Literature Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:4769. [PMID: 37430683 DOI: 10.3390/s23104769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Revised: 05/06/2023] [Accepted: 05/10/2023] [Indexed: 07/12/2023]
Abstract
A significant majority of the population in India makes their living through agriculture. Different illnesses that develop due to changing weather patterns and are caused by pathogenic organisms impact the yields of diverse plant species. The present article analyzed some of the existing techniques in terms of data sources, pre-processing techniques, feature extraction techniques, data augmentation techniques, models utilized for detecting and classifying diseases that affect the plant, how the quality of images was enhanced, how overfitting of the model was reduced, and accuracy. The research papers for this study were selected using various keywords from peer-reviewed publications from various databases published between 2010 and 2022. A total of 182 papers were identified and reviewed for their direct relevance to plant disease detection and classification, of which 75 papers were selected for this review after exclusion based on the title, abstract, conclusion, and full text. Researchers will find this work to be a useful resource in recognizing the potential of various existing techniques through data-driven approaches while identifying plant diseases by enhancing system performance and accuracy.
Collapse
Affiliation(s)
- Usha Mittal
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara 144411, Punjab, India
| | - Ankita Wadhawan
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara 144411, Punjab, India
| | - Jimmy Singla
- School of Engineering and Technology, CT University, Ludhiana 142024, Punjab, India
| | - N Z Jhanjhi
- School of Computer Science, SCS, Taylor's University, Subang Jaya 47500, Malaysia
| | - Rania M Ghoniem
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Riyadh, Saudi Arabia
| | - Sayan Kumar Ray
- School of Computer Science, SCS, Taylor's University, Subang Jaya 47500, Malaysia
| | - Abdelzahir Abdelmaboud
- Department of Information Systems, King Khalid University, Abha 61913, Muhayel Aseer, Saudi Arabia
| |
Collapse
|
13
|
Shahoveisi F, Taheri Gorji H, Shahabi S, Hosseinirad S, Markell S, Vasefi F. Application of image processing and transfer learning for the detection of rust disease. Sci Rep 2023; 13:5133. [PMID: 36991013 PMCID: PMC10060580 DOI: 10.1038/s41598-023-31942-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 03/20/2023] [Indexed: 03/31/2023] Open
Abstract
Plant diseases introduce significant yield and quality losses to the food production industry, worldwide. Early identification of an epidemic could lead to more effective management of the disease and potentially reduce yield loss and limit excessive input costs. Image processing and deep learning techniques have shown promising results in distinguishing healthy and infected plants at early stages. In this paper, the potential of four convolutional neural network models, including Xception, Residual Networks (ResNet)50, EfficientNetB4, and MobileNet, in the detection of rust disease on three commercially important field crops was evaluated. A dataset of 857 positive and 907 negative samples captured in the field and greenhouse environments were used. Training and testing of the algorithms were conducted using 70% and 30% of the data, respectively where the performance of different optimizers and learning rates were tested. Results indicated that EfficientNetB4 model was the most accurate model (average accuracy = 94.29%) in the disease detection followed by ResNet50 (average accuracy = 93.52%). Adaptive moment estimation (Adam) optimizer and learning rate of 0.001 outperformed all other corresponding hyperparameters. The findings from this study provide insights into the development of tools and gadgets useful in the automated detection of rust disease required for precision spraying.
Collapse
Affiliation(s)
- Fereshteh Shahoveisi
- Department of Plant Pathology, North Dakota State University, Fargo, ND, USA.
- Department of Plant Sciences and Landscape Architecture, University of Maryland, College Park, MD, USA.
| | - Hamed Taheri Gorji
- Biomedical Engineering Program, College of Engineering and Mine, University of North Dakota, Grand Forks, ND, USA
- SafetySpect Inc., 10100 Santa Monica Blvd., Suite 300, Los Angeles, CA, USA
| | - Seyedmojtaba Shahabi
- School of Electrical Engineering and Computer Science, College of Engineering and Mine, University of North Dakota, Grand Forks, ND, USA
| | - Seyedali Hosseinirad
- Department of Plant Sciences and Landscape Architecture, University of Maryland, College Park, MD, USA
- Department of Plant Sciences, North Dakota State University, Fargo, ND, USA
| | - Samuel Markell
- Department of Plant Pathology, North Dakota State University, Fargo, ND, USA
| | - Fartash Vasefi
- SafetySpect Inc., 10100 Santa Monica Blvd., Suite 300, Los Angeles, CA, USA
| |
Collapse
|
14
|
Deshpande R, Patidar H. Tomato plant leaf disease detection using generative adversarial network and deep convolutional neural network. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2022.2161696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Affiliation(s)
- Rashmi Deshpande
- Department of Electronics & Communication Engineering, Oriental University, Indore, Madhya Pradesh, India
| | - Hemant Patidar
- Department of Electronics & Communication Engineering, Oriental University, Indore, Madhya Pradesh, India
| |
Collapse
|
15
|
Nawaz M, Nazir T, Javed A, Masood M, Rashid J, Kim J, Hussain A. A robust deep learning approach for tomato plant leaf disease localization and classification. Sci Rep 2022; 12:18568. [PMID: 36329073 PMCID: PMC9633769 DOI: 10.1038/s41598-022-21498-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 09/28/2022] [Indexed: 11/06/2022] Open
Abstract
Tomato plants' disease detection and classification at the earliest stage can save the farmers from expensive crop sprays and can assist in increasing the food quantity. Although, extensive work has been presented by the researcher for the tomato plant disease classification, however, the timely localization and identification of various tomato leaf diseases is a complex job as a consequence of the huge similarity among the healthy and affected portion of plant leaves. Furthermore, the low contrast information between the background and foreground of the suspected sample has further complicated the plant leaf disease detection process. To deal with the aforementioned challenges, we have presented a robust deep learning (DL)-based approach namely ResNet-34-based Faster-RCNN for tomato plant leaf disease classification. The proposed method includes three basic steps. Firstly, we generate the annotations of the suspected images to specify the region of interest (RoI). In the next step, we have introduced ResNet-34 along with Convolutional Block Attention Module (CBAM) as a feature extractor module of Faster-RCNN to extract the deep key points. Finally, the calculated features are utilized for the Faster-RCNN model training to locate and categorize the numerous tomato plant leaf anomalies. We tested the presented work on an accessible standard database, the PlantVillage Kaggle dataset. More specifically, we have obtained the mAP and accuracy values of 0.981, and 99.97% respectively along with the test time of 0.23 s. Both qualitative and quantitative results confirm that the presented solution is robust to the detection of plant leaf disease and can replace the manual systems. Moreover, the proposed method shows a low-cost solution to tomato leaf disease classification which is robust to several image transformations like the variations in the size, color, and orientation of the leaf diseased portion. Furthermore, the framework can locate the affected plant leaves under the occurrence of blurring, noise, chrominance, and brightness variations. We have confirmed through the reported results that our approach is robust to several tomato leaf diseases classification under the varying image capturing conditions. In the future, we plan to extend our approach to apply it to other parts of plants as well.
Collapse
Affiliation(s)
- Marriam Nawaz
- grid.442854.bDepartment of Computer Science, University of Engineering and Technology Taxila, Taxila, 47050 Pakistan ,grid.442854.bDepartment of Software Engineering, University of Engineering and Technology Taxila, Taxila, 47050 Pakistan
| | - Tahira Nazir
- grid.414839.30000 0001 1703 6673Faculty of Computing, Riphah International University, Islamabad, Pakistan
| | - Ali Javed
- grid.442854.bDepartment of Software Engineering, University of Engineering and Technology Taxila, Taxila, 47050 Pakistan
| | - Momina Masood
- grid.442854.bDepartment of Computer Science, University of Engineering and Technology Taxila, Taxila, 47050 Pakistan
| | - Junaid Rashid
- grid.411118.c0000 0004 0647 1065Department of Computer Science and Engineering, Kongju National University, Cheonan, 31080 South Korea
| | - Jungeun Kim
- grid.411118.c0000 0004 0647 1065Department of Computer Science and Engineering, Kongju National University, Cheonan, 31080 South Korea ,grid.411118.c0000 0004 0647 1065Department of Software, Kongju National University, Cheonan, 31080 South Korea
| | - Amir Hussain
- grid.20409.3f000000012348339XCentre of AI and Data Science, Edinburgh Napier University, Edinburgh, EH11 4DY UK
| |
Collapse
|
16
|
Shoaib M, Hussain T, Shah B, Ullah I, Shah SM, Ali F, Park SH. Deep learning-based segmentation and classification of leaf images for detection of tomato plant disease. FRONTIERS IN PLANT SCIENCE 2022; 13:1031748. [PMID: 36275583 PMCID: PMC9585275 DOI: 10.3389/fpls.2022.1031748] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 09/15/2022] [Indexed: 05/27/2023]
Abstract
Plants contribute significantly to the global food supply. Various Plant diseases can result in production losses, which can be avoided by maintaining vigilance. However, manually monitoring plant diseases by agriculture experts and botanists is time-consuming, challenging and error-prone. To reduce the risk of disease severity, machine vision technology (i.e., artificial intelligence) can play a significant role. In the alternative method, the severity of the disease can be diminished through computer technologies and the cooperation of humans. These methods can also eliminate the disadvantages of manual observation. In this work, we proposed a solution to detect tomato plant disease using a deep leaning-based system utilizing the plant leaves image data. We utilized an architecture for deep learning based on a recently developed convolutional neural network that is trained over 18,161 segmented and non-segmented tomato leaf images-using a supervised learning approach to detect and recognize various tomato diseases using the Inception Net model in the research work. For the detection and segmentation of disease-affected regions, two state-of-the-art semantic segmentation models, i.e., U-Net and Modified U-Net, are utilized in this work. The plant leaf pixels are binary and classified by the model as Region of Interest (ROI) and background. There is also an examination of the presentation of binary arrangement (healthy and diseased leaves), six-level classification (healthy and other ailing leaf groups), and ten-level classification (healthy and other types of ailing leaves) models. The Modified U-net segmentation model outperforms the simple U-net segmentation model by 98.66 percent, 98.5 IoU score, and 98.73 percent on the dice. InceptionNet1 achieves 99.95% accuracy for binary classification problems and 99.12% for classifying six segmented class images; InceptionNet outperformed the Modified U-net model to achieve higher accuracy. The experimental results of our proposed method for classifying plant diseases demonstrate that it outperforms the methods currently available in the literature.
Collapse
Affiliation(s)
- Muhammad Shoaib
- Department of Computer Science, CECOS University of Information Technology (IT) and Emerging Sciences, Peshawar, Pakistan
| | - Tariq Hussain
- High Performance Computing and Networking Institute, National Research Council (ICAR-CNR), Naples, Italy
| | - Babar Shah
- College of Technological Innovation, Zayed University, Dubai, United Arab Emirates
| | - Ihsan Ullah
- Department of Robotics and Mechatronics Engineering, Daegu Gyeonbuk Institute of Science and Engineering (DGIST), Daegu, South Korea
| | - Sayyed Mudassar Shah
- Institute of Computer Science & Information Technology, The University of Agriculture Peshawar, Peshawar, Pakistan
| | - Farman Ali
- Department of Software, Sejong University, Seoul, South Korea
| | - Sang Hyun Park
- Department of Robotics and Mechatronics Engineering, Daegu Gyeonbuk Institute of Science and Engineering (DGIST), Daegu, South Korea
| |
Collapse
|
17
|
Albahli S, Nawaz M. DCNet: DenseNet-77-based CornerNet model for the tomato plant leaf disease detection and classification. FRONTIERS IN PLANT SCIENCE 2022; 13:957961. [PMID: 36160977 PMCID: PMC9499263 DOI: 10.3389/fpls.2022.957961] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 08/12/2022] [Indexed: 06/16/2023]
Abstract
Early recognition of tomato plant leaf diseases is mandatory to improve the food yield and save agriculturalists from costly spray procedures. The correct and timely identification of several tomato plant leaf diseases is a complicated task as the healthy and affected areas of plant leaves are highly similar. Moreover, the incidence of light variation, color, and brightness changes, and the occurrence of blurring and noise on the images further increase the complexity of the detection process. In this article, we have presented a robust approach for tackling the existing issues of tomato plant leaf disease detection and classification by using deep learning. We have proposed a novel approach, namely the DenseNet-77-based CornerNet model, for the localization and classification of the tomato plant leaf abnormalities. Specifically, we have used the DenseNet-77 as the backbone network of the CornerNet. This assists in the computing of the more nominative set of image features from the suspected samples that are later categorized into 10 classes by the one-stage detector of the CornerNet model. We have evaluated the proposed solution on a standard dataset, named PlantVillage, which is challenging in nature as it contains samples with immense brightness alterations, color variations, and leaf images with different dimensions and shapes. We have attained an average accuracy of 99.98% over the employed dataset. We have conducted several experiments to assure the effectiveness of our approach for the timely recognition of the tomato plant leaf diseases that can assist the agriculturalist to replace the manual systems.
Collapse
Affiliation(s)
- Saleh Albahli
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| | - Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology–Taxila, Taxila, Pakistan
- Department of Software Engineering, University of Engineering and Technology–Taxila, Taxila, Pakistan
| |
Collapse
|
18
|
Smart Agriculture Applications Using Deep Learning Technologies: A Survey. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12125919] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Agriculture is considered an important field with a significant economic impact in several countries. Due to the substantial population growth, meeting people’s dietary needs has become a relevant concern. The transition to smart agriculture has become inevitable to achieve these food security goals. In recent years, deep learning techniques, such as convolutional neural networks (CNN) and recurrent neural networks (RNN), have been intensely researched and applied in various fields, including agriculture. This study analyzed the recent research articles on deep learning techniques in agriculture over the previous five years and discussed the most important contributions and the challenges that have been solved. Furthermore, we investigated the agriculture parameters being monitored by the internet of things and used them to feed the deep learning algorithm for analysis. Additionally, we compared different studies regarding focused agriculture area, problems solved, the dataset used, the deep learning model used, the framework used, data preprocessing and augmentation method, and results with accuracy. We concluded in this survey that although CNN provides better results, it lacks in early detection of plant diseases. To cope with this issue, we proposed an intelligent agriculture system based on a hybrid model of CNN and SVM, capable of detecting and classifying plant leaves disease early.
Collapse
|
19
|
Albattah W, Javed A, Nawaz M, Masood M, Albahli S. Artificial Intelligence-Based Drone System for Multiclass Plant Disease Detection Using an Improved Efficient Convolutional Neural Network. FRONTIERS IN PLANT SCIENCE 2022; 13:808380. [PMID: 35755664 PMCID: PMC9218756 DOI: 10.3389/fpls.2022.808380] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 04/08/2022] [Indexed: 05/31/2023]
Abstract
The role of agricultural development is very important in the economy of a country. However, the occurrence of several plant diseases is a major hindrance to the growth rate and quality of crops. The exact determination and categorization of crop leaf diseases is a complex and time-required activity due to the occurrence of low contrast information in the input samples. Moreover, the alterations in the size, location, structure of crop diseased portion, and existence of noise and blurriness effect in the input images further complicate the classification task. To solve the problems of existing techniques, a robust drone-based deep learning approach is proposed. More specifically, we have introduced an improved EfficientNetV2-B4 with additional added dense layers at the end of the architecture. The customized EfficientNetV2-B4 calculates the deep key points and classifies them in their related classes by utilizing an end-to-end training architecture. For performance evaluation, a standard dataset, namely, the PlantVillage Kaggle along with the samples captured using a drone is used which is complicated in the aspect of varying image samples with diverse image capturing conditions. We attained the average precision, recall, and accuracy values of 99.63, 99.93, and 99.99%, respectively. The obtained results confirm the robustness of our approach in comparison to other recent techniques and also show less time complexity.
Collapse
Affiliation(s)
- Waleed Albattah
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| | - Ali Javed
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Momina Masood
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Saleh Albahli
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| |
Collapse
|
20
|
Tan S, Liu J, Lu H, Lan M, Yu J, Liao G, Wang Y, Li Z, Qi L, Ma X. Machine Learning Approaches for Rice Seedling Growth Stages Detection. FRONTIERS IN PLANT SCIENCE 2022; 13:914771. [PMID: 35755682 PMCID: PMC9225317 DOI: 10.3389/fpls.2022.914771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 05/04/2022] [Indexed: 06/15/2023]
Abstract
Recognizing rice seedling growth stages to timely do field operations, such as temperature control, fertilizer, irrigation, cultivation, and disease control, is of great significance of crop management, provision of standard and well-nourished seedlings for mechanical transplanting, and increase of yield. Conventionally, rice seedling growth stage is performed manually by means of visual inspection, which is not only labor-intensive and time-consuming, but also subjective and inefficient on a large-scale field. The application of machine learning algorithms on UAV images offers a high-throughput and non-invasive alternative to manual observations and its applications in agriculture and high-throughput phenotyping are increasing. This paper presented automatic approaches to detect rice seedling of three critical stages, BBCH11, BBCH12, and BBCH13. Both traditional machine learning algorithms and deep learning algorithms were investigated the discriminative ability of the three growth stages. UAV images were captured vertically downward at 3-m height from the field. A dataset consisted of images of three growth stages of rice seedlings for three cultivars, five nursing seedling densities, and different sowing dates. In the traditional machine learning algorithm, histograms of oriented gradients (HOGs) were selected as texture features and combined with the support vector machine (SVM) classifier to recognize and classify three growth stages. The best HOG-SVM model obtained the performance with 84.9, 85.9, 84.9, and 85.4% in accuracy, average precision, average recall, and F1 score, respectively. In the deep learning algorithm, the Efficientnet family and other state-of-art CNN models (VGG16, Resnet50, and Densenet121) were adopted and investigated the performance of three growth stage classifications. EfficientnetB4 achieved the best performance among other CNN models, with 99.47, 99.53, 99.39, and 99.46% in accuracy, average precision, average recall, and F1 score, respectively. Thus, the proposed method could be effective and efficient tool to detect rice seedling growth stages.
Collapse
Affiliation(s)
- Suiyan Tan
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Jingbin Liu
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Henghui Lu
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Maoyang Lan
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Jie Yu
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Guanzhong Liao
- College of Electronic Engineering, South China Agricultural University, Guangzhou, China
| | - Yuwei Wang
- College of Engineering, South China Agricultural University, Guangzhou, China
| | - Zehua Li
- College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
| | - Long Qi
- College of Engineering, South China Agricultural University, Guangzhou, China
| | - Xu Ma
- College of Engineering, South China Agricultural University, Guangzhou, China
| |
Collapse
|
21
|
Pushpa B, Shobha Rani N. A simple and efficient technique for leaf extraction in complex backgrounds of low resolution mobile photographed images. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-212451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Low resolution mobile photographed images pose a complex set of research challenges as compared to non-mobile captured images, which really is a significant issue these days. For non-mobile captured and high-resolution photos, current plant recognition systems are the best solution providers. This study proposes the identification and extraction of leaf regions from complex backgrounds to meet the automatic recognition needs of a variety of mobile phone users. Additionally multiple factors complicate the leaf region extraction from complex backgrounds such as varying background patterns, clutters, varying leaf shape/size and varying illumination due to volatile weather conditions. In this paper, a simple and efficient method for leaf extraction from complex background of mobile photographed low resolution images is proposed based on color channel thresholding and morphological operations. A self-built database of 5000 mobile photographed images in realistic environments is adapted for experimentations. Experiments were conducted on various resolution categories, and it was discovered that the proposed model has an average dice similarity measure of 99.5 percent for successful extraction of the leaf region in 13MP mobile photographed images. Furthermore, our comparative investigation reveals that the suggested model outperforms both traditional and state-of-the-art techniques.
Collapse
Affiliation(s)
- B.R. Pushpa
- Department of Computer Science, Amrita School of Arts and Sciences, Mysuru Campus, Amrita Vishwa Vidyapeetham, India
| | - N. Shobha Rani
- Department of Computer Science, Amrita School of Arts and Sciences, Mysuru Campus, Amrita Vishwa Vidyapeetham, India
| |
Collapse
|
22
|
Li D, Ahmed F, Wu N, Sethi AI. YOLO-JD: A Deep Learning Network for Jute Diseases and Pests Detection from Images. PLANTS (BASEL, SWITZERLAND) 2022; 11:plants11070937. [PMID: 35406915 PMCID: PMC9003326 DOI: 10.3390/plants11070937] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 03/25/2022] [Accepted: 03/27/2022] [Indexed: 06/12/2023]
Abstract
Recently, disease prevention in jute plants has become an urgent topic as a result of the growing demand for finer quality fiber. This research presents a deep learning network called YOLO-JD for detecting jute diseases from images. In the main architecture of YOLO-JD, we integrated three new modules such as Sand Clock Feature Extraction Module (SCFEM), Deep Sand Clock Feature Extraction Module (DSCFEM), and Spatial Pyramid Pooling Module (SPPM) to extract image features effectively. We also built a new large-scale image dataset for jute diseases and pests with ten classes. Compared with other state-of-the-art experiments, YOLO-JD has achieved the best detection accuracy, with an average mAP of 96.63%.
Collapse
Affiliation(s)
- Dawei Li
- College of Information Sciences and Technology, Donghua University, Shanghai 201620, China; (D.L.); (F.A.)
- State Key Laboratory for Modification of Chemical Fibers and Polymer Materials, Donghua University, Shanghai 201620, China
- Engineering Research Center of Digitized Textile and Fashion Technology, Ministry of Education, Donghua University, Shanghai 201620, China
| | - Foysal Ahmed
- College of Information Sciences and Technology, Donghua University, Shanghai 201620, China; (D.L.); (F.A.)
| | - Nailong Wu
- College of Information Sciences and Technology, Donghua University, Shanghai 201620, China; (D.L.); (F.A.)
- Engineering Research Center of Digitized Textile and Fashion Technology, Ministry of Education, Donghua University, Shanghai 201620, China
| | - Arlin I. Sethi
- Department of Chemistry, Faculty of Science, National University of Bangladesh, Gazipur, Dhaka 1704, Bangladesh;
| |
Collapse
|
23
|
Robust and General Model to Forecast the Heat Transfer Coefficient for Flow Condensation in Multi Port Mini/Micro-Channels. Processes (Basel) 2022. [DOI: 10.3390/pr10020243] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
A general correlation for predicting the two-phase heat transfer coefficient (HTC) during condensation inside multi-port mini/micro-channels was presented. The model was obtained by correlating the two-phase multiplier, φtp with affecting parameters using the genetic programming (GP) method. An extensive database containing 3503 experimental data samples was gathered from 21 different sources, including a broad range of operating parameters. The newly obtained correlation fits the broad range of measured data analyzed with an average absolute relative deviation (AARD) of 16.87% and estimates 84.73% of analyzed data points with a relative error of less than 30%. Evaluation of previous correlations was also conducted using the same database. They showed the AARD values ranging from 36.94% to 191.19%. However, the GP model provides more accurate results, AARD lower than 17%, by considering the surface tension effects. Finally, the effect of various operating parameters on the HTC was studied using the proposed correlation.
Collapse
|
24
|
Tripathi A, Chourasia U, Dixit P, Chang V. Plant Disease Detection Using Sequential Convolutional Neural Network. INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES 2022. [DOI: 10.4018/ijdst.303672] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The main warning in the area of food preservation and care is on topmost are crop diseases. It has been recognized speedily, but it is not as easy as in any area of the world because no required framework exists. Both the healthy and diseased plant leaves were gathered and collected under the condition and circumstances. For this purpose, a public set of information was used. It was 20,639 images of plants that were infected and healthy. In order to recognize three different crops and 12 diseases, a sequential convolutional neural network from Keras was trained and applied. The perfection and exactness was 98.18 % onset of information of the above trained mentioned model using CNN . It has also indicated the probability and possibility of this strategy and procedure. The over-fitting occurs and neutralizes by putting the dropout value to 0.25.
Collapse
Affiliation(s)
- Anshul Tripathi
- University Institute of Technology, Rajiv Gandhi Proudyogiki Vishwavidyalaya, India
| | - Uday Chourasia
- University Institute of Technology, Rajiv Gandhi Proudyogiki Vishwavidyalaya, India
| | - Priyanka Dixit
- University Institute of Technology, Rajiv Gandhi Proudyogiki Vishwavidyalaya, India
| | | |
Collapse
|
25
|
Trivedi NK, Gautam V, Anand A, Aljahdali HM, Villar SG, Anand D, Goyal N, Kadry S. Early Detection and Classification of Tomato Leaf Disease Using High-Performance Deep Neural Network. SENSORS 2021; 21:s21237987. [PMID: 34883991 PMCID: PMC8659659 DOI: 10.3390/s21237987] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2021] [Revised: 11/15/2021] [Accepted: 11/16/2021] [Indexed: 12/02/2022]
Abstract
Tomato is one of the most essential and consumable crops in the world. Tomatoes differ in quantity depending on how they are fertilized. Leaf disease is the primary factor impacting the amount and quality of crop yield. As a result, it is critical to diagnose and classify these disorders appropriately. Different kinds of diseases influence the production of tomatoes. Earlier identification of these diseases would reduce the disease’s effect on tomato plants and enhance good crop yield. Different innovative ways of identifying and classifying certain diseases have been used extensively. The motive of work is to support farmers in identifying early-stage diseases accurately and informing them about these diseases. The Convolutional Neural Network (CNN) is used to effectively define and classify tomato diseases. Google Colab is used to conduct the complete experiment with a dataset containing 3000 images of tomato leaves affected by nine different diseases and a healthy leaf. The complete process is described: Firstly, the input images are preprocessed, and the targeted area of images are segmented from the original images. Secondly, the images are further processed with varying hyper-parameters of the CNN model. Finally, CNN extracts other characteristics from pictures like colors, texture, and edges, etc. The findings demonstrate that the proposed model predictions are 98.49% accurate.
Collapse
Affiliation(s)
- Naresh K. Trivedi
- Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, India; (N.K.T.); (A.A.)
| | - Vinay Gautam
- School of Computing, DIT University, Dehradun 248009, India;
| | - Abhineet Anand
- Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, India; (N.K.T.); (A.A.)
| | - Hani Moaiteq Aljahdali
- Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 37848, Saudi Arabia;
| | - Santos Gracia Villar
- Higher Polytechnic School/Industrial Organization Engineering, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain;
- Department of Project Management, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
| | - Divya Anand
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara 144411, India;
| | - Nitin Goyal
- Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, India; (N.K.T.); (A.A.)
- Correspondence: (N.G.)
| | - Seifedine Kadry
- Faculty of Applied Computing and Technology, Noroff University College, 4608 Kristiansand, Norway;
| |
Collapse
|
26
|
Smart Indoor Farms: Leveraging Technological Advancements to Power a Sustainable Agricultural Revolution. AGRIENGINEERING 2021. [DOI: 10.3390/agriengineering3040047] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Conventional farming necessitates a large number of resources and infrastructure such as land, irrigation, manpower to manage farms, etc. Modern initiatives are required to automate conventional farms. Smart indoor farms offer the potential to remedy the shortfalls of conventional farms by providing a controlled, intelligent, and smart environment. This paper presents a three-dimensional perspective consisting of soilless farming, energy harvesting, and smart technologies, which could be considered as the three important characteristics of smart indoor farms. A six-layer smart indoor farms architecture has also been proposed, which explains how data are collected using various sensors and devices and then transmitted onto the cloud infrastructure for further analysis and control through various layers. Artificial lighting, smart nutrition management, and artificial climate control, to name a few, are some of the important requirements for smart indoor farms while considering control and service management factors. The major bottleneck in installing such systems is both the economical and the technical constraints. However, with the evolution of technology (and when they become widely available in the near future), a more favourable farming scenario may emerge. Furthermore, smart indoor farms could be viewed as a potential answer for meeting the demands of a sustainable agricultural revolution as we move closer to Agriculture 4.0. Finally, in order to adapt smart indoor farms and their study scope, our work has presented various research areas to potential researchers.
Collapse
|