1
|
Khanal R, Choi Y, Lee J. Transforming Poultry Farming: A Pyramid Vision Transformer Approach for Accurate Chicken Counting in Smart Farm Environments. SENSORS (BASEL, SWITZERLAND) 2024; 24:2977. [PMID: 38793832 PMCID: PMC11124838 DOI: 10.3390/s24102977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 04/13/2024] [Accepted: 05/06/2024] [Indexed: 05/26/2024]
Abstract
Smart farm environments, equipped with cutting-edge technology, require proficient techniques for managing poultry. This research investigates automated chicken counting, an essential part of optimizing livestock conditions. By integrating artificial intelligence and computer vision, it introduces a transformer-based chicken-counting model to overcome challenges to precise counting, such as lighting changes, occlusions, cluttered backgrounds, continual chicken growth, and camera distortions. The model includes a pyramid vision transformer backbone and a multi-scale regression head to predict precise density maps of the crowded chicken enclosure. The customized loss function incorporates curriculum loss, allowing the model to learn progressively, and adapts to diverse challenges posed by varying densities, scales, and appearances. The proposed annotated dataset includes data on various lighting conditions, chicken sizes, densities, and placements. Augmentation strategies enhanced the dataset with brightness, contrast, shadow, blur, occlusion, cropping, and scaling variations. Evaluating the model on the proposed dataset indicated its robustness, with a validation mean absolute error of 27.8, a root mean squared error of 40.9, and a test average accuracy of 96.9%. A comparison with the few-shot object counting model SAFECount demonstrated the model's superior accuracy and resilience. The transformer-based approach was 7.7% more accurate than SAFECount. It demonstrated robustness in response to different challenges that may affect counting and offered a comprehensive and effective solution for automated chicken counting in smart farm environments.
Collapse
Affiliation(s)
- Ridip Khanal
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea
- Department of Computer Science and Applications, Tribhuvan University, Mechi Multiple Campus, Bhadrapur 57200, Nepal
| | - Yoochan Choi
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea
| | - Joonwhoan Lee
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea
| |
Collapse
|
2
|
David E, Ogidi F, Smith D, Chapman S, de Solan B, Guo W, Baret F, Stavness I. Global Wheat Head Detection Challenges: Winning Models and Application for Head Counting. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0059. [PMID: 38239739 PMCID: PMC10795497 DOI: 10.34133/plantphenomics.0059] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 06/01/2023] [Indexed: 01/22/2024]
Abstract
Data competitions have become a popular approach to crowdsource new data analysis methods for general and specialized data science problems. Data competitions have a rich history in plant phenotyping, and new outdoor field datasets have the potential to embrace solutions across research and commercial applications. We developed the Global Wheat Challenge as a generalization competition in 2020 and 2021 to find more robust solutions for wheat head detection using field images from different regions. We analyze the winning challenge solutions in terms of their robustness when applied to new datasets. We found that the design of the competition had an influence on the selection of winning solutions and provide recommendations for future competitions to encourage the selection of more robust solutions.
Collapse
Affiliation(s)
- Etienne David
- UMR 1114 EMMAH, INRAE, Avignon, France
- Arvalis – Institut du Végétal, Paris, France
| | - Franklin Ogidi
- Department of Computer Science,
University of Saskatchewan, Saskatoon, Canada
| | - Daniel Smith
- School of Food and Agricultural Sciences,
University of Queensland, Brisbane, Australia
| | - Scott Chapman
- School of Food and Agricultural Sciences,
University of Queensland, Brisbane, Australia
| | | | - Wei Guo
- Graduate School of Agricultural and Life Sciences,
The University of Tokyo, Tokyo, Japan
| | | | - Ian Stavness
- Department of Computer Science,
University of Saskatchewan, Saskatoon, Canada
| |
Collapse
|
3
|
Li Y, Ma R, Zhang R, Cheng Y, Dong C. A Tea Buds Counting Method Based on YOLOv5 and Kalman Filter Tracking Algorithm. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0030. [PMID: 37011273 PMCID: PMC10062705 DOI: 10.34133/plantphenomics.0030] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 02/16/2023] [Indexed: 06/19/2023]
Abstract
The tea yield estimation provides information support for the harvest time and amount and serves as a decision-making basis for farmer management and picking. However, the manual counting of tea buds is troublesome and inefficient. To improve the efficiency of tea yield estimation, this study presents a deep-learning-based approach for efficiently estimating tea yield by counting tea buds in the field using an enhanced YOLOv5 model with the Squeeze and Excitation Network. This method combines the Hungarian matching and Kalman filtering algorithms to achieve accurate and reliable tea bud counting. The effectiveness of the proposed model was demonstrated by its mean average precision of 91.88% on the test dataset, indicating that it is highly accurate at detecting tea buds. The model application to the tea bud counting trials reveals that the counting results from test videos are highly correlated with the manual counting results (R 2 = 0.98), indicating that the counting method has high accuracy and effectiveness. In conclusion, the proposed method can realize tea bud detection and counting in natural light and provides data and technical support for rapid tea bud acquisition.
Collapse
Affiliation(s)
- Yang Li
- Key Laboratory of Tea Quality and Safety Control, Ministry of Agriculture and Rural Affairs, Tea Research Institute,
Chinese Academy of Agricultural Sciences, Hangzhou, China
| | - Rong Ma
- College of Optical, Mechanical and Electrical Engineering,
Zhejiang A&F University, Hangzhou, China
| | - Rentian Zhang
- Key Laboratory of Tea Quality and Safety Control, Ministry of Agriculture and Rural Affairs, Tea Research Institute,
Chinese Academy of Agricultural Sciences, Hangzhou, China
- College of Mechanical and Electrical Engineering,
Shihezi University, Shihezi, China
| | - Yifan Cheng
- Key Laboratory of Tea Quality and Safety Control, Ministry of Agriculture and Rural Affairs, Tea Research Institute,
Chinese Academy of Agricultural Sciences, Hangzhou, China
- College of Optical, Mechanical and Electrical Engineering,
Zhejiang A&F University, Hangzhou, China
| | - Chunwang Dong
- Key Laboratory of Tea Quality and Safety Control, Ministry of Agriculture and Rural Affairs, Tea Research Institute,
Chinese Academy of Agricultural Sciences, Hangzhou, China
- Tea Research Institute of Shandong Academy of Agricultural Sciences, Jinan 250100, China
| |
Collapse
|
4
|
David E, Serouart M, Smith D, Madec S, Velumani K, Liu S, Wang X, Pinto F, Shafiee S, Tahir ISA, Tsujimoto H, Nasuda S, Zheng B, Kirchgessner N, Aasen H, Hund A, Sadhegi-Tehran P, Nagasawa K, Ishikawa G, Dandrifosse S, Carlier A, Dumont B, Mercatoris B, Evers B, Kuroki K, Wang H, Ishii M, Badhon MA, Pozniak C, LeBauer DS, Lillemo M, Poland J, Chapman S, de Solan B, Baret F, Stavness I, Guo W. Global Wheat Head Detection 2021: An Improved Dataset for Benchmarking Wheat Head Detection Methods. PLANT PHENOMICS (WASHINGTON, D.C.) 2021; 2021:9846158. [PMID: 34778804 PMCID: PMC8548052 DOI: 10.34133/2021/9846158] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 08/11/2021] [Indexed: 05/03/2023]
Abstract
The Global Wheat Head Detection (GWHD) dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions. With an associated competition hosted in Kaggle, GWHD_2020 has successfully attracted attention from both the computer vision and agricultural science communities. From this first experience, a few avenues for improvements have been identified regarding data size, head diversity, and label reliability. To address these issues, the 2020 dataset has been reexamined, relabeled, and complemented by adding 1722 images from 5 additional countries, allowing for 81,553 additional wheat heads. We now release in 2021 a new version of the Global Wheat Head Detection dataset, which is bigger, more diverse, and less noisy than the GWHD_2020 version.
Collapse
Affiliation(s)
- Etienne David
- Arvalis, Institut du Végétal, 3 Rue Joseph et Marie Hackin, 75116 Paris, France
- UMR1114 EMMAH, INRAE, Centre PACA, Bâtiment Climat, Domaine Saint-Paul, 228 Route de l'Aérodrome, CS 40509, 84914 Avignon Cedex, France
| | - Mario Serouart
- Arvalis, Institut du Végétal, 3 Rue Joseph et Marie Hackin, 75116 Paris, France
- UMR1114 EMMAH, INRAE, Centre PACA, Bâtiment Climat, Domaine Saint-Paul, 228 Route de l'Aérodrome, CS 40509, 84914 Avignon Cedex, France
| | - Daniel Smith
- School of Food and Agricultural Sciences, The University of Queensland, Gatton, 4343 QLD, Australia
| | - Simon Madec
- Arvalis, Institut du Végétal, 3 Rue Joseph et Marie Hackin, 75116 Paris, France
- School of Food and Agricultural Sciences, The University of Queensland, Gatton, 4343 QLD, Australia
| | - Kaaviya Velumani
- UMR1114 EMMAH, INRAE, Centre PACA, Bâtiment Climat, Domaine Saint-Paul, 228 Route de l'Aérodrome, CS 40509, 84914 Avignon Cedex, France
- Hiphen SAS, 120 Rue Jean Dausset, Agroparc, Bâtiment Technicité, 84140 Avignon, France
| | - Shouyang Liu
- Plant Phenomics Research Center, Nanjing Agricultural University, Nanjing, China
| | - Xu Wang
- Wheat Genetics Resource Center, Dep. of Plant Pathology, Kansas State Univ., 4024 Throckmorton Plant Sciences Center, Manhattan, Kansas, USA
| | - Francisco Pinto
- Global Wheat Program, International Maize and Wheat Improvement Centre (CIMMYT), Mexico, D.F., Mexico
| | - Shahameh Shafiee
- Faculty of Biosciences, Norwegian University of Life Sciences, P.O. Box 5003, NO-1432 Ås, Norway
| | - Izzat S. A. Tahir
- Agricultural Research Corporation, Wheat Research Program, P.O. Box 126, Wad Medani, Sudan
| | - Hisashi Tsujimoto
- Arid Land Research Center, Tottori University, Tottori 680-0001, Japan
| | - Shuhei Nasuda
- Laboratories of Plant Genetics and Plant Breeding, Graduate School of Agriculture, Kyoto University, Japan
| | - Bangyou Zheng
- CSIRO Agriculture and Food, Queensland Biosciences Precinct, 306 Carmody Road, St Lucia, 4067 QLD, Australia
| | - Norbert Kirchgessner
- Institute of Agricultural Sciences, ETH Zurich, Universitätstrasse 2, 8092 Zurich, Switzerland
| | - Helge Aasen
- Institute of Agricultural Sciences, ETH Zurich, Universitätstrasse 2, 8092 Zurich, Switzerland
| | - Andreas Hund
- Institute of Agricultural Sciences, ETH Zurich, Universitätstrasse 2, 8092 Zurich, Switzerland
| | | | - Koichi Nagasawa
- Institute of Crop Science, National Agriculture and Food Research Organization, Japan
| | - Goro Ishikawa
- Hokkaido Agricultural Research Center, National Agriculture and Food Research Organization, Japan
| | - Sébastien Dandrifosse
- Biosystems Dynamics and Exchanges, TERRA Teaching and Research Center, Gembloux Agro-Bio Tech, University of Liège, 5030 Gembloux, Belgium
| | - Alexis Carlier
- Biosystems Dynamics and Exchanges, TERRA Teaching and Research Center, Gembloux Agro-Bio Tech, University of Liège, 5030 Gembloux, Belgium
| | - Benjamin Dumont
- Plant Sciences, TERRA Teaching and Research Center, Gembloux Agro-Bio Tech, University of Liège, 5030 Gembloux, Belgium
| | - Benoit Mercatoris
- Biosystems Dynamics and Exchanges, TERRA Teaching and Research Center, Gembloux Agro-Bio Tech, University of Liège, 5030 Gembloux, Belgium
| | - Byron Evers
- Wheat Genetics Resource Center, Dep. of Plant Pathology, Kansas State Univ., 4024 Throckmorton Plant Sciences Center, Manhattan, Kansas, USA
| | - Ken Kuroki
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Midori-cho, Nishitokyo City, Tokyo, Japan
| | - Haozhou Wang
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Midori-cho, Nishitokyo City, Tokyo, Japan
| | - Masanori Ishii
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Midori-cho, Nishitokyo City, Tokyo, Japan
| | | | - Curtis Pozniak
- Department of Plant Sciences, University of Saskatchewan, Canada
| | - David Shaner LeBauer
- College of Agriculture and Life Sciences, University of Arizona, Tucson, Arizona, USA
| | - Morten Lillemo
- Faculty of Biosciences, Norwegian University of Life Sciences, P.O. Box 5003, NO-1432 Ås, Norway
| | - Jesse Poland
- Wheat Genetics Resource Center, Dep. of Plant Pathology, Kansas State Univ., 4024 Throckmorton Plant Sciences Center, Manhattan, Kansas, USA
| | - Scott Chapman
- School of Food and Agricultural Sciences, The University of Queensland, Gatton, 4343 QLD, Australia
- CSIRO Agriculture and Food, Queensland Biosciences Precinct, 306 Carmody Road, St Lucia, 4067 QLD, Australia
| | - Benoit de Solan
- Arvalis, Institut du Végétal, 3 Rue Joseph et Marie Hackin, 75116 Paris, France
| | - Frédéric Baret
- UMR1114 EMMAH, INRAE, Centre PACA, Bâtiment Climat, Domaine Saint-Paul, 228 Route de l'Aérodrome, CS 40509, 84914 Avignon Cedex, France
| | - Ian Stavness
- Department of Computer Science, University of Saskatchewan, Canada
| | - Wei Guo
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Midori-cho, Nishitokyo City, Tokyo, Japan
| |
Collapse
|