1
|
Qin WB, Abbas A, Abbas S, Alam A, Chen DH, Hafeez F, Ali J, Romano D, Chen RZ. Automated lepidopteran pest developmental stages classification via transfer learning framework. ENVIRONMENTAL ENTOMOLOGY 2024:nvae085. [PMID: 39397261 DOI: 10.1093/ee/nvae085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 07/04/2024] [Accepted: 09/11/2024] [Indexed: 10/15/2024]
Abstract
The maize crop is highly susceptible to damage caused by its primary pests, which poses considerable challenges in manually identifying and controlling them at various larval developmental stages. To mitigate this issue, we propose an automated classification system aimed at identifying the different larval developmental stages of 23 instars of 4 major lepidopteran pests: the Asian corn borer, Ostrinia furnacalis (Guenée; Lepidoptera: Crambidae), the fall armyworm, Spodoptera frugiperda (J.E. Smith; Lepidoptera: Noctuidae), the oriental armyworm, Mythimna separata (Walker; Lepidoptera: Noctuidae), and the tobacco cutworm, Spodoptera litura (Fabricius; Lepidoptera: Noctuidae). Employing 5 distinct Convolutional Neural Network architectures-Convnext, Densenet121, Efficientnetv2, Mobilenet, and Resnet-we aimed to automate the process of identifying these larval developmental stages. Each model underwent fine-tuning using 2 different optimizers: stochastic gradient descent with momentum and adaptive moment estimation (Adam). Among the array of models tested, Densenet121, coupled with the Adam optimizer, exhibited the highest classification accuracy, achieving an impressive 96.65%. The configuration performed well in identifying the larval development stages of all 4 pests, with precision, recall, and F1 score evaluation indicators reaching 98.71%, 98.66%, and 98.66%, respectively. Notably, the model was ultimately tested in a natural field environment, demonstrating that Adam_Densenet121 model achieved an accuracy of 90% in identifying the 23 instars of the 4 pests. The application of transfer learning methodology showcased its effectiveness in automating the identification of larval developmental stages, underscoring promising implications for precision-integrated pest management strategies in agriculture.
Collapse
Affiliation(s)
- Wei-Bo Qin
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - Arzlan Abbas
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - Sohail Abbas
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - Aleena Alam
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - De-Hui Chen
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - Faisal Hafeez
- Entomological Research Institute, Ayub Agricultural Research Institute, Faisalabad 37000, Province Punjab, Pakistan
| | - Jamin Ali
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| | - Donato Romano
- The BioRobotics Institute, Sant' Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025 Pontedera, Italy
| | - Ri-Zhao Chen
- College of Plant Protection, Jilin Agricultural University, 2888 Xincheng Road, Changchun 130118, Jilin Province, China
| |
Collapse
|
2
|
Xu X, Shi J, Chen Y, He Q, Liu L, Sun T, Ding R, Lu Y, Xue C, Qiao H. Research on machine vision and deep learning based recognition of cotton seedling aphid infestation level. FRONTIERS IN PLANT SCIENCE 2023; 14:1200901. [PMID: 37645464 PMCID: PMC10461631 DOI: 10.3389/fpls.2023.1200901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Accepted: 07/10/2023] [Indexed: 08/31/2023]
Abstract
Aphis gossypii Glover is a major insect pest in cotton production, which can cause yield reduction in severe cases. In this paper, we proposed the A. gossypii infestation monitoring method, which identifies the infestation level of A. gossypii at the cotton seedling stage, and can improve the efficiency of early warning and forecasting of A. gossypii, and achieve precise prevention and cure according to the predicted infestation level. We used smartphones to collect A. gossypii infestation images and compiled an infestation image data set. And then constructed, trained, and tested three different A. gossypii infestation recognition models based on Faster Region-based Convolutional Neural Network (R-CNN), You Only Look Once (YOLO)v5 and single-shot detector (SSD) models. The results showed that the YOLOv5 model had the highest mean average precision (mAP) value (95.7%) and frames per second (FPS) value (61.73) for the same conditions. In studying the influence of different image resolutions on the performance of the YOLOv5 model, we found that YOLOv5s performed better than YOLOv5x in terms of overall performance, with the best performance at an image resolution of 640×640 (mAP of 96.8%, FPS of 71.43). And the comparison with the latest YOLOv8s showed that the YOLOv5s performed better than the YOLOv8s. Finally, the trained model was deployed to the Android mobile, and the results showed that mobile-side detection was the best when the image resolution was 256×256, with an accuracy of 81.0% and FPS of 6.98. The real-time recognition system established in this study can provide technical support for infestation forecasting and precise prevention of A. gossypii.
Collapse
Affiliation(s)
- Xin Xu
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Jing Shi
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Yongqin Chen
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Qiang He
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Liangliang Liu
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Tong Sun
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Ruifeng Ding
- Institute of Plant Protection, Xinjiang Academy of Agricultural Sciences, Urumqi, China
| | - Yanhui Lu
- Institute of Plant Protection, Chinese Academy of Agricultural Sciences, Beijing, China
| | - Chaoqun Xue
- Zhengzhou Tobacco Research Institute of China National Tobacco Corporation (CNTC), Zhengzhou, China
| | - Hongbo Qiao
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| |
Collapse
|
3
|
Dai M, Sun W, Wang L, Dorjoy MMH, Zhang S, Miao H, Han L, Zhang X, Wang M. Pepper leaf disease recognition based on enhanced lightweight convolutional neural networks. FRONTIERS IN PLANT SCIENCE 2023; 14:1230886. [PMID: 37621882 PMCID: PMC10445539 DOI: 10.3389/fpls.2023.1230886] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 07/25/2023] [Indexed: 08/26/2023]
Abstract
Pepper leaf disease identification based on convolutional neural networks (CNNs) is one of the interesting research areas. However, most existing CNN-based pepper leaf disease detection models are suboptimal in terms of accuracy and computing performance. In particular, it is challenging to apply CNNs on embedded portable devices due to a large amount of computation and memory consumption for leaf disease recognition in large fields. Therefore, this paper introduces an enhanced lightweight model based on GoogLeNet architecture. The initial step involves compressing the Inception structure to reduce model parameters, leading to a remarkable enhancement in recognition speed. Furthermore, the network incorporates the spatial pyramid pooling structure to seamlessly integrate local and global features. Subsequently, the proposed improved model has been trained on the real dataset of 9183 images, containing 6 types of pepper diseases. The cross-validation results show that the model accuracy is 97.87%, which is 6% higher than that of GoogLeNet based on Inception-V1 and Inception-V3. The memory requirement of the model is only 10.3 MB, which is reduced by 52.31%-86.69%, comparing to GoogLeNet. We have also compared the model with the existing CNN-based models including AlexNet, ResNet-50 and MobileNet-V2. The result shows that the average inference time of the proposed model decreases by 61.49%, 41.78% and 23.81%, respectively. The results show that the proposed enhanced model can significantly improve performance in terms of accuracy and computing efficiency, which has potential to improve productivity in the pepper farming industry.
Collapse
Affiliation(s)
- Min Dai
- College of Mechanical Engineering, Yangzhou University, Yangzhou, China
| | - Wenjing Sun
- College of Mechanical Engineering, Yangzhou University, Yangzhou, China
| | - Lixing Wang
- College of Mechanical Engineering, Yangzhou University, Yangzhou, China
| | | | - Shanwen Zhang
- College of Mechanical Engineering, Yangzhou University, Yangzhou, China
| | - Hong Miao
- College of Mechanical Engineering, Yangzhou University, Yangzhou, China
- Nanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing, China
| | - Liangxiu Han
- Faculty of Science and Engineering, Manchester Metropolitan University Manchester, Manchester, United Kingdom
| | - Xin Zhang
- Faculty of Science and Engineering, Manchester Metropolitan University Manchester, Manchester, United Kingdom
| | - Mingyou Wang
- Nanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing, China
| |
Collapse
|
4
|
Zhang S, Zhang C, Park DS, Yoon S. Editorial: Machine learning and artificial intelligence for smart agriculture, volume II. FRONTIERS IN PLANT SCIENCE 2023; 14:1166209. [PMID: 37152126 PMCID: PMC10157275 DOI: 10.3389/fpls.2023.1166209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 03/08/2023] [Indexed: 05/09/2023]
Affiliation(s)
- Shanwen Zhang
- Information Engineering College, Xijing University, Xi’an, China
| | - Chuanlei Zhang
- College of Artificial Intelligence, Tianjin University of Science and Technology, Tianjin, China
- *Correspondence: Chuanlei Zhang,
| | - Dong Sun Park
- Department of Electronics Engineering, Jeonbuk National University, Jeonju, Republic of Korea
| | - Sook Yoon
- Department of Computer Engineering, Mokpo National University, Muan, Republic of Korea
| |
Collapse
|
5
|
Niu Q, Liu J, Jin Y, Chen X, Zhu W, Yuan Q. Tobacco shred varieties classification using Multi-Scale-X-ResNet network and machine vision. FRONTIERS IN PLANT SCIENCE 2022; 13:962664. [PMID: 36061766 PMCID: PMC9433752 DOI: 10.3389/fpls.2022.962664] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 07/25/2022] [Indexed: 05/21/2023]
Abstract
The primary task in calculating the tobacco shred blending ratio is identifying the four tobacco shred types: expanded tobacco silk, cut stem, tobacco silk, and reconstituted tobacco shred. The classification precision directly affects the subsequent determination of tobacco shred components. However, the tobacco shred types, especially expanded tobacco silk and tobacco silk, have no apparent differences in macro-scale characteristics. The tobacco shreds have small size and irregular shape characteristics, creating significant challenges in their recognition and classification based on machine vision. This study provides a complete set of solutions aimed at this problem for screening tobacco shred samples, taking images, image preprocessing, establishing datasets, and identifying types. A block threshold binarization method is used for image preprocessing. Parameter setting and method performance are researched to obtain the maximum number of complete samples with acceptable execution time. ResNet50 is used as the primary classification and recognition network structure. By increasing the multi-scale structure and optimizing the number of blocks and loss function, a new tobacco shred image classification method is proposed based on the MS-X-ResNet (Multi-Scale-X-ResNet) network. Specifically, the MS-ResNet network is obtained by fusing the multi-scale Stage 3 low-dimensional and Stage 4 high-dimensional features to reduce the overfitting risk. The number of blocks in Stages 1-4 are adjusted from the original 3:4:6:3 to 3:4:N:3 (A-ResNet) and 3:3:N:3 (B-ResNet) to obtain the X-ResNet network, which improves the model's classification performance with lower complexity. The focal loss function is selected to reduce the impact of identification difficulty for different sample types on the network and improve its performance. The experimental results show that the final classification accuracy of the network on a tobacco shred dataset is 96.56%. The image recognition of a single tobacco shred requires 103 ms, achieving high classification accuracy and efficiency. The image preprocessing and deep learning algorithms for tobacco shred classification and identification proposed in this study provide a new implementation approach for the actual production and quality detection of tobacco and a new way for online real-time type identification of other agricultural products.
Collapse
Affiliation(s)
- Qunfeng Niu
- School of Electrical Engineering, Henan University of Technology, Zhengzhou, China
| | - Jiangpeng Liu
- School of Electrical Engineering, Henan University of Technology, Zhengzhou, China
| | - Yi Jin
- Anyang Cigarette Factory, China Tobacco Henan Industrial Co., Ltd., Anyang, China
| | - Xia Chen
- Anyang Cigarette Factory, China Tobacco Henan Industrial Co., Ltd., Anyang, China
| | - Wenkui Zhu
- Zhengzhou Tobacco Research Institute of China National Tobacco Corporation (CNTC), Zhengzhou, China
| | - Qiang Yuan
- School of Electrical Engineering, Henan University of Technology, Zhengzhou, China
| |
Collapse
|
6
|
Dai G, Fan J. An Industrial-Grade Solution for Crop Disease Image Detection Tasks. FRONTIERS IN PLANT SCIENCE 2022; 13:921057. [PMID: 35832228 PMCID: PMC9272756 DOI: 10.3389/fpls.2022.921057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 05/24/2022] [Indexed: 05/03/2023]
Abstract
Crop leaf diseases can reflect the current health status of the crop, and the rapid and automatic detection of field diseases has become one of the difficulties in the process of industrialization of agriculture. In the widespread application of various machine learning techniques, recognition time consumption and accuracy remain the main challenges in moving agriculture toward industrialization. This article proposes a novel network architecture called YOLO V5-CAcT to identify crop diseases. The fast and efficient lightweight YOLO V5 is chosen as the base network. Repeated Augmentation, FocalLoss, and SmoothBCE strategies improve the model robustness and combat the positive and negative sample ratio imbalance problem. Early Stopping is used to improve the convergence of the model. We use two technical routes of model pruning, knowledge distillation and memory activation parameter compression ActNN for model training and identification under different hardware conditions. Finally, we use simplified operators with INT8 quantization for further optimization and deployment in the deep learning inference platform NCNN to form an industrial-grade solution. In addition, some samples from the Plant Village and AI Challenger datasets were applied to build our dataset. The average recognition accuracy of 94.24% was achieved in images of 59 crop disease categories for 10 crop species, with an average inference time of 1.563 ms per sample and model size of only 2 MB, reducing the model size by 88% and the inference time by 72% compared with the original model, with significant performance advantages. Therefore, this study can provide a solid theoretical basis for solving the common problems in current agricultural disease image detection. At the same time, the advantages in terms of accuracy and computational cost can meet the needs of agricultural industrialization.
Collapse
Affiliation(s)
- Guowei Dai
- National Agriculture Science Data Center, Agricultural Information Institute, Chinese Academy of Agricultural Sciences, Beijing, China
- *Correspondence: Guowei Dai
| | - Jingchao Fan
- National Agriculture Science Data Center, Agricultural Information Institute, Chinese Academy of Agricultural Sciences, Beijing, China
- National Nanfan Research Institute (Sanya), Chinese Academy of Agricultural Sciences, Sanya, China
- Jingchao Fan
| |
Collapse
|