1
|
Prince RH, Mamun AA, Peyal HI, Miraz S, Nahiduzzaman M, Khandakar A, Ayari MA. CSXAI: a lightweight 2D CNN-SVM model for detection and classification of various crop diseases with explainable AI visualization. FRONTIERS IN PLANT SCIENCE 2024; 15:1412988. [PMID: 39036360 PMCID: PMC11257924 DOI: 10.3389/fpls.2024.1412988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Accepted: 06/07/2024] [Indexed: 07/23/2024]
Abstract
Plant diseases significantly impact crop productivity and quality, posing a serious threat to global agriculture. The process of identifying and categorizing these diseases is often time-consuming and prone to errors. This research addresses this issue by employing a convolutional neural network and support vector machine (CNN-SVM) hybrid model to classify diseases in four economically important crops: strawberries, peaches, cherries, and soybeans. The objective is to categorize 10 classes of diseases, with six diseased classes and four healthy classes, for these crops using the deep learning-based CNN-SVM model. Several pre-trained models, including VGG16, VGG19, DenseNet, Inception, MobileNetV2, MobileNet, Xception, and ShuffleNet, were also trained, achieving accuracy ranges from 53.82% to 98.8%. The proposed model, however, achieved an average accuracy of 99.09%. While the proposed model's accuracy is comparable to that of the VGG16 pre-trained model, its significantly lower number of trainable parameters makes it more efficient and distinctive. This research demonstrates the potential of the CNN-SVM model in enhancing the accuracy and efficiency of plant disease classification. The CNN-SVM model was selected over VGG16 and other models due to its superior performance metrics. The proposed model achieved a 99% F1-score, a 99.98% Area Under the Curve (AUC), and a 99% precision value, demonstrating its efficacy. Additionally, class activation maps were generated using the Gradient Weighted Class Activation Mapping (Grad-CAM) technique to provide a visual explanation of the detected diseases. A heatmap was created to highlight the regions requiring classification, further validating the model's accuracy and interpretability.
Collapse
Affiliation(s)
- Reazul Hasan Prince
- Department of Electrical and Computer Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
| | - Abdul Al Mamun
- Department of Computer Science and Engineering, Tejgaon College, Dhaka, Bangladesh
| | - Hasibul Islam Peyal
- Department of Electrical and Computer Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
- Department of Computer Science and Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
| | - Shafiun Miraz
- Department of Computer Science and Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
| | - Md. Nahiduzzaman
- Department of Electrical and Computer Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
| | - Amith Khandakar
- Department of Electrical Engineering, College of Engineering, Qatar University, Doha, Qatar
| | - Mohamed Arselene Ayari
- Department of Civil and Architectural Engineering, Qatar University, Doha, Qatar
- Technology Innovation and Engineering Education Unit, Qatar University, Doha, Qatar
| |
Collapse
|
2
|
Aghamohammadesmaeilketabforoosh K, Nikan S, Antonini G, Pearce JM. Optimizing Strawberry Disease and Quality Detection with Vision Transformers and Attention-Based Convolutional Neural Networks. Foods 2024; 13:1869. [PMID: 38928810 PMCID: PMC11202458 DOI: 10.3390/foods13121869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2024] [Revised: 06/10/2024] [Accepted: 06/12/2024] [Indexed: 06/28/2024] Open
Abstract
Machine learning and computer vision have proven to be valuable tools for farmers to streamline their resource utilization to lead to more sustainable and efficient agricultural production. These techniques have been applied to strawberry cultivation in the past with limited success. To build on this past work, in this study, two separate sets of strawberry images, along with their associated diseases, were collected and subjected to resizing and augmentation. Subsequently, a combined dataset consisting of nine classes was utilized to fine-tune three distinct pretrained models: vision transformer (ViT), MobileNetV2, and ResNet18. To address the imbalanced class distribution in the dataset, each class was assigned weights to ensure nearly equal impact during the training process. To enhance the outcomes, new images were generated by removing backgrounds, reducing noise, and flipping them. The performances of ViT, MobileNetV2, and ResNet18 were compared after being selected. Customization specific to the task was applied to all three algorithms, and their performances were assessed. Throughout this experiment, none of the layers were frozen, ensuring all layers remained active during training. Attention heads were incorporated into the first five and last five layers of MobileNetV2 and ResNet18, while the architecture of ViT was modified. The results indicated accuracy factors of 98.4%, 98.1%, and 97.9% for ViT, MobileNetV2, and ResNet18, respectively. Despite the data being imbalanced, the precision, which indicates the proportion of correctly identified positive instances among all predicted positive instances, approached nearly 99% with the ViT. MobileNetV2 and ResNet18 demonstrated similar results. Overall, the analysis revealed that the vision transformer model exhibited superior performance in strawberry ripeness and disease classification. The inclusion of attention heads in the early layers of ResNet18 and MobileNet18, along with the inherent attention mechanism in ViT, improved the accuracy of image identification. These findings offer the potential for farmers to enhance strawberry cultivation through passive camera monitoring alone, promoting the health and well-being of the population.
Collapse
Affiliation(s)
| | - Soodeh Nikan
- Department of Electrical & Computer Engineering, Western University, London, ON N6A 3K7, Canada
| | - Giorgio Antonini
- Department of Electrical & Computer Engineering, Western University, London, ON N6A 3K7, Canada
| | - Joshua M. Pearce
- Department of Electrical & Computer Engineering, Western University, London, ON N6A 3K7, Canada
- Ivey Business School, Western University, London, ON N6A 3K7, Canada
| |
Collapse
|
3
|
Elsherbiny O, Elaraby A, Alahmadi M, Hamdan M, Gao J. Rapid Grapevine Health Diagnosis Based on Digital Imaging and Deep Learning. PLANTS (BASEL, SWITZERLAND) 2024; 13:135. [PMID: 38202443 PMCID: PMC10780826 DOI: 10.3390/plants13010135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 12/30/2023] [Accepted: 12/30/2023] [Indexed: 01/12/2024]
Abstract
Deep learning plays a vital role in precise grapevine disease detection, yet practical applications for farmer assistance are scarce despite promising results. The objective of this research is to develop an intelligent approach, supported by user-friendly, open-source software named AI GrapeCare (Version 1, created by Osama Elsherbiny). This approach utilizes RGB imagery and hybrid deep networks for the detection and prevention of grapevine diseases. Exploring the optimal deep learning architecture involved combining convolutional neural networks (CNNs), long short-term memory (LSTM), deep neural networks (DNNs), and transfer learning networks (including VGG16, VGG19, ResNet50, and ResNet101V2). A gray level co-occurrence matrix (GLCM) was employed to measure the textural characteristics. The plant disease detection platform (PDD) created a dataset of real-life grape leaf images from vineyards to improve plant disease identification. A data augmentation technique was applied to address the issue of limited images. Subsequently, the augmented dataset was used to train the models and enhance their capability to accurately identify and classify plant diseases in real-world scenarios. The analyzed outcomes indicated that the combined CNNRGB-LSTMGLCM deep network, based on the VGG16 pretrained network and data augmentation, outperformed the separate deep network and nonaugmented version features. Its validation accuracy, classification precision, recall, and F-measure are all 96.6%, with a 93.4% intersection over union and a loss of 0.123. Furthermore, the software developed through the proposed approach holds great promise as a rapid tool for diagnosing grapevine diseases in less than one minute. The framework of the study shows potential for future expansion to include various types of trees. This capability can assist farmers in early detection of tree diseases, enabling them to implement preventive measures.
Collapse
Affiliation(s)
- Osama Elsherbiny
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China;
- Agricultural Engineering Department, Faculty of Agriculture, Mansoura University, Mansoura 35516, Egypt
| | - Ahmed Elaraby
- Department of Cybersecurity, College of Engineering and Information Technology, Buraydah Private Colleges, Buraydah 51418, Saudi Arabia;
- Department of Computer Science, Faculty of Computers and Information, South Valley University, Qena 83523, Egypt
| | - Mohammad Alahmadi
- Department of Software Engineering, College of Computer Science and Engineering, University of Jeddah, Jeddah 23890, Saudi Arabia;
| | - Mosab Hamdan
- Interdisciplinary Research Center for Intelligent Secure Systems, King Fahd University of Petroleum and Minerals, Dhahran 31261, Saudi Arabia;
| | - Jianmin Gao
- School of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China;
| |
Collapse
|
4
|
Srikamwang C, onsa NE, Sunanta P, Sangta J, Chanway CP, Thanakkasaranee S, Sommano SR. Role of Microbial Volatile Organic Compounds in Promoting Plant Growth and Disease Resistance in Horticultural Production. PLANT SIGNALING & BEHAVIOR 2023; 18:2227440. [PMID: 37366146 PMCID: PMC10730190 DOI: 10.1080/15592324.2023.2227440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 06/12/2023] [Accepted: 06/15/2023] [Indexed: 06/28/2023]
Abstract
Microbial volatile organic compounds (MVOCs) are a diverse group of volatile organic compounds that microorganisms may produce and release into the environment. These compounds have both positive and negative effects on plants, as they have been shown to be effective at mitigating stresses and functioning as immune stimulants. Furthermore, MVOCs modulate plant growth and systemic plant resistance, while also serving as attractants or repellents for insects and other stressors that pose threats to plants. Considering the economic value of strawberries as one of the most popular and consumed fruits worldwide, harnessing the benefits of MVOCs becomes particularly significant. MVOCs offer cost-effective and efficient solutions for disease control and pest management in horticultural production, as they can be utilized at low concentrations. This paper provides a comprehensive review of the current knowledge on microorganisms that contribute to the production of beneficial volatile organic compounds for enhancing disease resistance in fruit products, with a specific emphasis on broad horticultural production. The review also identifies research gaps and highlights the functions of MVOCs in horticulture, along with the different types of MVOCs that impact plant disease resistance in strawberry production. By offering a novel perspective on the application and utilization of volatile organic compounds in sustainable horticulture, this review presents an innovative approach to maximizing the efficiency of horticultural production through the use of natural products.
Collapse
Affiliation(s)
- Chonlada Srikamwang
- Plant Bioactive Compound Laboratory, Faculty of Agriculture, Chiang Mai University, Chiang Mai, Thailand
- Interdisciplinary Program in Biotechnology, Graduate School, Chiang Mai University, Chiang Mai, Thailand
| | - Nuttacha Eva onsa
- Plant Bioactive Compound Laboratory, Faculty of Agriculture, Chiang Mai University, Chiang Mai, Thailand
- Department of Plant and Soil Science, Chiang Mai University, Chiang Mai, Thailand
| | - Piyachat Sunanta
- Department of Plant and Soil Science, Chiang Mai University, Chiang Mai, Thailand
- Postharvest Technology Research Center, Faculty of Agriculture, Chiang Mai University, Chiang Mai, Thailand
| | - Jiraporn Sangta
- Plant Bioactive Compound Laboratory, Faculty of Agriculture, Chiang Mai University, Chiang Mai, Thailand
- Interdisciplinary Program in Biotechnology, Graduate School, Chiang Mai University, Chiang Mai, Thailand
| | - Christopher P. Chanway
- Department of Forest and Conservation Sciences, Faculty of Forestry, University of British Columbia, Vancouver, Canada
| | - Sarinthip Thanakkasaranee
- Division of Packaging Technology, School of Agro-Industry, Faculty of Agro Industry, Chiang Mai University, Chiang Mai, Thailand
- Center of Excellence in Materials Science and Technology, Chiang Mai University, Chiang Mai, Thailand
- Center of Excellence in Agro Bio-Circular-Green Industry (Agro BCG), Chiang Mai University, Chiang Mai, Thailand
| | - Sarana Rose Sommano
- Plant Bioactive Compound Laboratory, Faculty of Agriculture, Chiang Mai University, Chiang Mai, Thailand
- Department of Plant and Soil Science, Chiang Mai University, Chiang Mai, Thailand
- Center of Excellence in Agro Bio-Circular-Green Industry (Agro BCG), Chiang Mai University, Chiang Mai, Thailand
| |
Collapse
|
5
|
Haw YH, Lai KW, Chuah JH, Bejo SK, Husin NA, Hum YC, Yee PL, Tee CATH, Ye X, Wu X. Classification of basal stem rot using deep learning: a review of digital data collection and palm disease classification methods. PeerJ Comput Sci 2023; 9:e1325. [PMID: 37346512 PMCID: PMC10280561 DOI: 10.7717/peerj-cs.1325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 03/13/2023] [Indexed: 06/23/2023]
Abstract
Oil palm is a key agricultural resource in Malaysia. However, palm disease, most prominently basal stem rot caused at least RM 255 million of annual economic loss. Basal stem rot is caused by a fungus known as Ganoderma boninense. An infected tree shows few symptoms during early stage of infection, while potentially suffers an 80% lifetime yield loss and the tree may be dead within 2 years. Early detection of basal stem rot is crucial since disease control efforts can be done. Laboratory BSR detection methods are effective, but the methods have accuracy, biosafety, and cost concerns. This review article consists of scientific articles related to the oil palm tree disease, basal stem rot, Ganoderma Boninense, remote sensors and deep learning that are listed in the Web of Science since year 2012. About 110 scientific articles were found that is related to the index terms mentioned and 60 research articles were found to be related to the objective of this research thus included in this review article. From the review, it was found that the potential use of deep learning methods were rarely explored. Some research showed unsatisfactory results due to limitations on dataset. However, based on studies related to other plant diseases, deep learning in combination with data augmentation techniques showed great potentials, showing remarkable detection accuracy. Therefore, the feasibility of analyzing oil palm remote sensor data using deep learning models together with data augmentation techniques should be studied. On a commercial scale, deep learning used together with remote sensors and unmanned aerial vehicle technologies showed great potential in the detection of basal stem rot disease.
Collapse
Affiliation(s)
- Yu Hong Haw
- Department of Biomedical Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Joon Huang Chuah
- Department of Electrical Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Siti Khairunniza Bejo
- Department of Biological and Agricultural Engineering, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
| | - Nur Azuan Husin
- Department of Biological and Agricultural Engineering, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
| | - Yan Chai Hum
- Department of Mechatronics and Biomedical Engineering, Universiti Tunku Abdul Rahman, Bandar Sungai Long, Cheras, Kajang, Selangor, Malaysia
| | - Por Lip Yee
- Department of Computer System and Technology, Universiti Malaya, Kuala Lumpur, Malaysia
| | | | - Xin Ye
- YLZ Eaccessy Information Technology Co., Ltd, Xiamen, China
| | - Xiang Wu
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
| |
Collapse
|
6
|
Phan QH, Nguyen VT, Lien CH, Duong TP, Hou MTK, Le NB. Classification of Tomato Fruit Using Yolov5 and Convolutional Neural Network Models. PLANTS (BASEL, SWITZERLAND) 2023; 12:plants12040790. [PMID: 36840138 PMCID: PMC9959894 DOI: 10.3390/plants12040790] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 01/31/2023] [Accepted: 02/02/2023] [Indexed: 06/12/2023]
Abstract
Four deep learning frameworks consisting of Yolov5m and Yolov5m combined with ResNet50, ResNet-101, and EfficientNet-B0, respectively, are proposed for classifying tomato fruit on the vine into three categories: ripe, immature, and damaged. For a training dataset consisting of 4500 images and a training process with 200 epochs, a batch size of 128, and an image size of 224 × 224 pixels, the prediction accuracy for ripe and immature tomatoes is found to be 100% when combining Yolo5m with ResNet-101. Meanwhile, the prediction accuracy for damaged tomatoes is 94% when using Yolo5m with the Efficient-B0 model. The ResNet-50, EfficientNet-B0, Yolov5m, and ResNet-101 networks have testing accuracies of 98%, 98%, 97%, and 97%, respectively. Thus, all four frameworks have the potential for tomato fruit classification in automated tomato fruit harvesting applications in agriculture.
Collapse
Affiliation(s)
- Quoc-Hung Phan
- Department of Mechanical Engineering, National United University, Miaoli 360302, Taiwan
| | - Van-Tung Nguyen
- Department of Mechanical Engineering, National United University, Miaoli 360302, Taiwan
| | - Chi-Hsiang Lien
- Department of Mechanical Engineering, National United University, Miaoli 360302, Taiwan
| | - The-Phong Duong
- Department of Mechanical Engineering, HCMC University of Technology and Education, Ho Chi Minh City 700000, Vietnam
| | - Max Ti-Kuang Hou
- Department of Mechanical Engineering, National United University, Miaoli 360302, Taiwan
| | - Ngoc-Bich Le
- School of Biomedical Engineering, International University, Ho Chi Minh City 700000, Vietnam
- Vietnam National University HCMC, Ho Chi Minh City 700000, Vietnam
| |
Collapse
|
7
|
Lee S, Arora AS, Yun CM. Detecting strawberry diseases and pest infections in the very early stage with an ensemble deep-learning model. FRONTIERS IN PLANT SCIENCE 2022; 13:991134. [PMID: 36311098 PMCID: PMC9597313 DOI: 10.3389/fpls.2022.991134] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Accepted: 09/23/2022] [Indexed: 05/28/2023]
Abstract
Detecting early signs of plant diseases and pests is important to preclude their progress and minimize the damages caused by them. Many methods are developed to catch signs of diseases and pests from plant images with deep learning techniques, however, detecting early signs is still challenging because of the lack of datasets to train subtle changes in plants. To solve these challenges, we built an automatic data acquisition system for the accumulation of a large dataset of plant images and trained an ensemble model to detect targeted plant diseases and pests. After obtaining 13,393 plant image data, our ensemble model shows a decent detection performance with an average of AUPRC 0.81. Also, this data acquisition and the detection process can be applied to other plant anomalies with the collection of additional data.
Collapse
Affiliation(s)
- Sangyeon Lee
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | | | | |
Collapse
|
8
|
Pan J, Xia L, Wu Q, Guo Y, Chen Y, Tian X. Automatic strawberry leaf scorch severity estimation via faster R-CNN and few-shot learning. ECOL INFORM 2022. [DOI: 10.1016/j.ecoinf.2022.101706] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
9
|
Zheng H, Wang G, Li X. Identifying strawberry appearance quality by vision transformers and support vector machine. J FOOD PROCESS ENG 2022. [DOI: 10.1111/jfpe.14132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Hao Zheng
- School of Optoelectronic Engineering Xi'an Technological University Xi'an China
| | - Guohui Wang
- School of Optoelectronic Engineering Xi'an Technological University Xi'an China
| | - Xuchen Li
- School of Optoelectronic Engineering Xi'an Technological University Xi'an China
| |
Collapse
|
10
|
Arenas-Calle LN, Heinemann AB, Soler da Silva MA, dos Santos AB, Ramirez-Villegas J, Whitfield S, Challinor AJ. Rice Management Decisions Using Process-Based Models With Climate-Smart Indicators. FRONTIERS IN SUSTAINABLE FOOD SYSTEMS 2022. [DOI: 10.3389/fsufs.2022.873957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Irrigation strategies are keys to fostering sustainable and climate-resilient rice production by increasing efficiency, building resilience and reducing Greenhouse Gas (GHG) emissions. These strategies are aligned with the Climate-Smart Agriculture (CSA) principles, which aim to maximize productivity whilst adapting to and mitigating climate change. Achieve such mitigation, adaptation, and productivity goals- to the extent possible- is described as climate smartness. Measuring climate smartness is challenging, with recent progress focusing on the use of agronomic indicators in a limited range of contexts. One way to broaden the ability to measure climate-smartness is to use modeling tools, expanding the scope of climate smartness assessments. Accordingly, and as a proof-of-concept, this study uses modeling tools with CSA indicators (i.e., Greenhouse Intensity and Water Productivity) to quantify the climate-smartness of irrigation management in rice and to assess sensitivity to climate. We focus on a field experiment that assessed four irrigation strategies in tropical conditions, Continuous Flooding (CF), Intermittent Irrigation (II), Intermittent Irrigation until Flowering (IIF), and Continuous soil saturation (CSS). The DNDC model was used to simulate rice yields, GHG emissions and water inputs. We used model outputs to calculate a previously developed Climate-Smartness Index (CSI) based on water productivity and greenhouse gas intensity, which score on a scale between−1 (lack of climate-smartness) to 1 (high climate smartness) the climate-smartness of irrigation strategies. The CSS exhibited the highest simulation-based CSI, and CF showed the lowest. A sensitivity analysis served to explore the impacts of climate on CSI. While higher temperatures reduced CSI, rainfall mostly showed no signal. The climate smartness decreasing in warmer temperatures was associated with increased GHG emissions and, to some extent, a reduction in Water Productivity (WP). Overall, CSI varied with the climate-management interaction, demonstrating that climate variability can influence the performance of CSA practices. We conclude that combining models with climate-smart indicators can broaden the CSA-based evidence and provide reproducible research findings. The methodological approach used in this study can be useful to fill gaps in observational evidence of climate-smartness and project the impact of future climates in regions where calibrated crop models perform well.
Collapse
|
11
|
Liao T, Yang R, Zhao P, Zhou W, He M, Li L. MDAM-DRNet: Dual Channel Residual Network With Multi-Directional Attention Mechanism in Strawberry Leaf Diseases Detection. FRONTIERS IN PLANT SCIENCE 2022; 13:869524. [PMID: 35874000 PMCID: PMC9305473 DOI: 10.3389/fpls.2022.869524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 06/10/2022] [Indexed: 06/15/2023]
Abstract
The growth of strawberry plants is affected by a variety of strawberry leaf diseases. Yet, due to the complexity of these diseases' spots in terms of color and texture, their manual identification requires much time and energy. Developing a more efficient identification method could be imperative for improving the yield and quality of strawberry crops. To that end, here we proposed a detection framework for strawberry leaf diseases based on a dual-channel residual network with a multi-directional attention mechanism (MDAM-DRNet). (1) In order to fully extract the color features from images of diseased strawberry leaves, this paper constructed a color feature path at the front end of the network. The color feature information in the image was then extracted mainly through a color correlogram. (2) Likewise, to fully extract the texture features from images, a texture feature path at the front end of the network was built; it mainly extracts texture feature information by using an area compensation rotation invariant local binary pattern (ACRI-LBP). (3) To enhance the model's ability to extract detailed features, for the main frame, this paper proposed a multidirectional attention mechanism (MDAM). This MDAM can allocate weights in the horizontal, vertical, and diagonal directions, thereby reducing the loss of feature information. Finally, in order to solve the problems of gradient disappearance in the network, the ELU activation function was used in the main frame. Experiments were then carried out using a database we compiled. According to the results, the highest recognition accuracy by the network used in this paper for six types of strawberry leaf diseases and normal leaves is 95.79%, with an F1 score of 95.77%. This proves the introduced method is effective at detecting strawberry leaf diseases.
Collapse
Affiliation(s)
- Tingjing Liao
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Ruoli Yang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Peirui Zhao
- College of Food Science and Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Wenhua Zhou
- College of Food Science and Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Mingfang He
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Liujun Li
- Department of Civil, Missouri University of Science and Technology, University of Missouri-Rolla, Rolla, MO, United States
| |
Collapse
|
12
|
You J, Jiang K, Lee J. Deep Metric Learning-Based Strawberry Disease Detection With Unknowns. FRONTIERS IN PLANT SCIENCE 2022; 13:891785. [PMID: 35860535 PMCID: PMC9289608 DOI: 10.3389/fpls.2022.891785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 06/06/2022] [Indexed: 06/15/2023]
Abstract
There has been substantial research that has achieved significant advancements in plant disease detection based on deep object detection models. However, with unknown diseases, it is difficult to find a practical solution for plant disease detection. This study proposes a simple but effective strawberry disease detection scheme with unknown diseases that can provide applicable performance in the real field. In the proposed scheme, the known strawberry diseases are detected with deep metric learning (DML)-based classifiers along with the unknown diseases that have certain symptoms. The pipeline of our proposed scheme consists of two stages: the first is object detection with known disease classes, while the second is a DML-based post-filtering stage. The second stage has two different types of classifiers: one is softmax classifiers that are only for known diseases and the K-nearest neighbor (K-NN) classifier for both known and unknown diseases. In the training of the first stage and the DML-based softmax classifier, we only use the known samples of the strawberry disease. Then, we include the known (a priori) and the known unknown training samples to construct the K-NN classifier. The final decisions regarding known diseases are made from the combined results of the two classifiers, while unknowns are detected from the K-NN classifier. The experimental results show that the DML-based post-filter is effective at improving the performance of known disease detection in terms of mAP. Furthermore, the separate DML-based K-NN classifier provides high recall and precision for known and unknown diseases and achieve 97.8% accuracy, meaning it could be exploited as a Region of Interest (ROI) classifier. For the real field data, the proposed scheme achieves a high mAP of 93.7% to detect known classes of strawberry disease, and it also achieves reasonable results for unknowns. This implies that the proposed scheme can be applied to identify disease-like symptoms caused by real known and unknown diseases or disorders for any kind of plant.
Collapse
Affiliation(s)
- Jie You
- Artificial Intelligence Lab, Department of Computer Science and Engineering, Jeonbuk National University, Jeonju, South Korea
| | - Kan Jiang
- Artificial Intelligence Lab, Department of Computer Science and Engineering, Jeonbuk National University, Jeonju, South Korea
| | - Joonwhoan Lee
- Artificial Intelligence Lab, Department of Computer Science and Engineering, Jeonbuk National University, Jeonju, South Korea
| |
Collapse
|
13
|
Valoppi F, Agustin M, Abik F, Morais de Carvalho D, Sithole J, Bhattarai M, Varis JJ, Arzami ANAB, Pulkkinen E, Mikkonen KS. Insight on Current Advances in Food Science and Technology for Feeding the World Population. FRONTIERS IN SUSTAINABLE FOOD SYSTEMS 2021. [DOI: 10.3389/fsufs.2021.626227] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
While the world population is steadily increasing, the capacity of Earth to renew its resources is continuously declining. Consequently, the bioresources required for food production are diminishing and new approaches are needed to feed the current and future global population. In the last decades, scientists have developed novel strategies to reduce food loss and waste, improve food production, and find new ingredients, design and build new food structures, and introduce digitalization in the food system. In this work, we provide a general overview on circular economy, alternative technologies for food production such as cellular agriculture, and new sources of ingredients like microalgae, insects, and wood-derived fibers. We present a summary of the whole process of food design using creative problem-solving that fosters food innovation, and digitalization in the food sector such as artificial intelligence, augmented and virtual reality, and blockchain technology. Finally, we briefly discuss the effect of COVID-19 on the food system. This review has been written for a broad audience, covering a wide spectrum and giving insights on the most recent advances in the food science and technology area, presenting examples from both academic and industrial sides, in terms of concepts, technologies, and tools which will possibly help the world to achieve food security in the next 30 years.
Collapse
|
14
|
Fuentes A, Yoon S, Kim T, Park DS. Open Set Self and Across Domain Adaptation for Tomato Disease Recognition With Deep Learning Techniques. FRONTIERS IN PLANT SCIENCE 2021; 12:758027. [PMID: 34956261 PMCID: PMC8702618 DOI: 10.3389/fpls.2021.758027] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 11/16/2021] [Indexed: 05/05/2023]
Abstract
Recent advances in automatic recognition systems based on deep learning technology have shown the potential to provide environmental-friendly plant disease monitoring. These systems are able to reliably distinguish plant anomalies under varying environmental conditions as the basis for plant intervention using methods such as classification or detection. However, they often show a performance decay when applied under new field conditions and unseen data. Therefore, in this article, we propose an approach based on the concept of open-set domain adaptation to the task of plant disease recognition to allow existing systems to operate in new environments with unseen conditions and farms. Our system specifically copes diagnosis as an open set learning problem, and mainly operates in the target domain by exploiting a precise estimation of unknown data while maintaining the performance of the known classes. The main framework consists of two modules based on deep learning that perform bounding box detection and open set self and across domain adaptation. The detector is built based on our previous filter bank architecture for plant diseases recognition and enforces domain adaptation from the source to the target domain, by constraining data to be classified as one of the target classes or labeled as unknown otherwise. We perform an extensive evaluation on our tomato plant diseases dataset with three different domain farms, which indicates that our approach can efficiently cope with changes of new field environments during field-testing and observe consistent gains from explicit modeling of unseen data.
Collapse
Affiliation(s)
- Alvaro Fuentes
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, South Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, South Korea
| | - Sook Yoon
- Department of Computer Engineering, Mokpo National University, Muan, South Korea
- *Correspondence: Sook Yoon,
| | - Taehyun Kim
- National Institute of Agricultural Sciences, Wanju, South Korea
| | - Dong Sun Park
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, South Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, South Korea
- Dong Sun Park,
| |
Collapse
|
15
|
Lyzhin A, Luk’yanchuk I. Analysis of strawberry promising varieties and selected forms by resistance to red stele root rot using molecular markers. BIO WEB OF CONFERENCES 2021. [DOI: 10.1051/bioconf/20213902002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
The analysis of the allelic state of the Rpf1 red stele root rot gene in 14 promising foreign strawberry varieties and 6 selected forms of the I.V. Michurin FSC breeding was completed. The Rpf1 gene in a heterozygous state was identified in strawberry forms 61-15 (Bylinnaya × Olimpiyskaya nadezhda), 69-29 (Feyerverk × Bylinnaya), and 72-71 (Privlekatelnaya × Bylinnaya), which makes it possible to recommend them for involvement in breeding work to create resistant to P. fragariae var. fragariae strawberry varieties. Strawberry varieties Lebedushka, Elianny, Florence, Malwina, Monterey, Polka, Verona, Vima Tarda Asia, Chamora Turusi, Clery, Flamenco, Salsa and Symphony, and selected forms 56-5 (Gigantella Maxim × Privlekatelnaya), 69-42 (Feyerverk × Bylinnaya) and 35-16 (922-67 × Maryshka) have a recessive homozygous genotype.
Collapse
|