1
|
Tran M, Truong S, Fernandes AFA, Kidd MT, Le N. CarcassFormer: an end-to-end transformer-based framework for simultaneous localization, segmentation and classification of poultry carcass defect. Poult Sci 2024; 103:103765. [PMID: 38925080 PMCID: PMC11255899 DOI: 10.1016/j.psj.2024.103765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 04/02/2024] [Accepted: 04/09/2024] [Indexed: 06/28/2024] Open
Abstract
In the food industry, assessing the quality of poultry carcasses during processing is a crucial step. This study proposes an effective approach for automating the assessment of carcass quality without requiring skilled labor or inspector involvement. The proposed system is based on machine learning (ML) and computer vision (CV) techniques, enabling automated defect detection and carcass quality assessment. To this end, an end-to-end framework called CarcassFormer is introduced. It is built upon a Transformer-based architecture designed to effectively extract visual representations while simultaneously detecting, segmenting, and classifying poultry carcass defects. Our proposed framework is capable of analyzing imperfections resulting from production and transport welfare issues, as well as processing plant stunner, scalder, picker, and other equipment malfunctions. To benchmark the framework, a dataset of 7,321 images was initially acquired, which contained both single and multiple carcasses per image. In this study, the performance of the CarcassFormer system is compared with other state-of-the-art (SOTA) approaches for both classification, detection, and segmentation tasks. Through extensive quantitative experiments, our framework consistently outperforms existing methods, demonstrating re- markable improvements across various evaluation metrics such as AP, AP@50, and AP@75. Furthermore, the qualitative results highlight the strengths of CarcassFormer in capturing fine details, including feathers, and accurately localizing and segmenting carcasses with high precision. To facilitate further research and collaboration, the source code and trained models will be made publicly available upon acceptance.
Collapse
Affiliation(s)
- Minh Tran
- Department of Computer Science and Computer Engineering, 1 University of Arkansas, Fayetteville, AR 72701, USA
| | - Sang Truong
- Department of Computer Science and Computer Engineering, 1 University of Arkansas, Fayetteville, AR 72701, USA
| | | | - Michael T Kidd
- Department of Poultry Science, Fayetteville, AR 72701, USA
| | - Ngan Le
- Department of Computer Science and Computer Engineering, 1 University of Arkansas, Fayetteville, AR 72701, USA.
| |
Collapse
|
2
|
da Rocha Balthazar G, Silveira RMF, da Silva IJO. How Do Escape Distance Behavior of Broiler Chickens Change in Response to a Mobile Robot Moving at Two Different Speeds? Animals (Basel) 2024; 14:1014. [PMID: 38612253 PMCID: PMC11011048 DOI: 10.3390/ani14071014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Revised: 02/12/2024] [Accepted: 02/22/2024] [Indexed: 04/14/2024] Open
Abstract
In poultry farming, robots are considered by birds as intruder elements to their environment, because animals escape due to their movement. Their escape is measured using the escape distance (ED) technique. This study analyzes the behavior of animals in relation to their ED through the use of a robot with two speeds: 12 rpm and 26 rpm. The objective is to understand whether the speeds cause variations in ED and their implications for animal stress. A broiler breeding cycle was analyzed (six weeks) through the introduction of the robot weekly. ED analyses were carried out on static images generated from footage of the robot running. The results indicate higher escape distance rates (p < 0.05) peaking midway through the production cycle, notably in the third week. Conversely, the final weeks saw the lowest ED, with the most significant reduction occurring in the last week. This pattern indicates a gradual escalation of ED up to the fourth week, followed by a subsequent decline. Despite RPM12 having shown low ED results, it did not show enough ED to move the animals away from their path of travel, causing bumps and collisions. RPM26 showed higher ED in all breeding phases, but showed ED with no bumps and collisions.
Collapse
Affiliation(s)
- Glauber da Rocha Balthazar
- Ambience Research Center, Department of Biosystems Engineering, Luiz de Queiroz College of Agriculture, University of São Paulo (ESALQ/USP), Piracicaba 13418-900, Brazil; (R.M.F.S.); (I.J.O.d.S.)
- Analysis and Development Department, Federal Institute of Education, Science and Technology of São Paulo (IFSP), R. Heitor Lacerda Guedes, 1000-Cidade Satélite Íris, Campinas 13059-581, Brazil
| | - Robson Mateus Freitas Silveira
- Ambience Research Center, Department of Biosystems Engineering, Luiz de Queiroz College of Agriculture, University of São Paulo (ESALQ/USP), Piracicaba 13418-900, Brazil; (R.M.F.S.); (I.J.O.d.S.)
| | - Iran José Oliveira da Silva
- Ambience Research Center, Department of Biosystems Engineering, Luiz de Queiroz College of Agriculture, University of São Paulo (ESALQ/USP), Piracicaba 13418-900, Brazil; (R.M.F.S.); (I.J.O.d.S.)
| |
Collapse
|
3
|
Nakrosis A, Paulauskaite-Taraseviciene A, Raudonis V, Narusis I, Gruzauskas V, Gruzauskas R, Lagzdinyte-Budnike I. Towards Early Poultry Health Prediction through Non-Invasive and Computer Vision-Based Dropping Classification. Animals (Basel) 2023; 13:3041. [PMID: 37835647 PMCID: PMC10571708 DOI: 10.3390/ani13193041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 09/17/2023] [Accepted: 09/25/2023] [Indexed: 10/15/2023] Open
Abstract
The use of artificial intelligence techniques with advanced computer vision techniques offers great potential for non-invasive health assessments in the poultry industry. Evaluating the condition of poultry by monitoring their droppings can be highly valuable as significant changes in consistency and color can be indicators of serious and infectious diseases. While most studies have prioritized the classification of droppings into two categories (normal and abnormal), with some relevant studies dealing with up to five categories, this investigation goes a step further by employing image processing algorithms to categorize droppings into six classes, based on visual information indicating some level of abnormality. To ensure a diverse dataset, data were collected in three different poultry farms in Lithuania by capturing droppings on different types of litter. With the implementation of deep learning, the object detection rate reached 92.41% accuracy. A range of machine learning algorithms, including different deep learning architectures, has been explored and, based on the obtained results, we have proposed a comprehensive solution by combining different models for segmentation and classification purposes. The results revealed that the segmentation task achieved the highest accuracy of 0.88 in terms of the Dice coefficient employing the K-means algorithm. Meanwhile, YOLOv5 demonstrated the highest classification accuracy, achieving an ACC of 91.78%.
Collapse
Affiliation(s)
- Arnas Nakrosis
- Faculty of Informatics, Kaunas University of Technology, Studentu 50, 51368 Kaunas, Lithuania; (A.N.); (I.N.); (I.L.-B.)
| | - Agne Paulauskaite-Taraseviciene
- Faculty of Informatics, Kaunas University of Technology, Studentu 50, 51368 Kaunas, Lithuania; (A.N.); (I.N.); (I.L.-B.)
- Artificial Intelligence Centre, Kaunas University of Technology, K. Barsausko 59, 51423 Kaunas, Lithuania; (V.R.); (V.G.); (R.G.)
| | - Vidas Raudonis
- Artificial Intelligence Centre, Kaunas University of Technology, K. Barsausko 59, 51423 Kaunas, Lithuania; (V.R.); (V.G.); (R.G.)
- Faculty of Electrical and Electronics, Kaunas University of Technology, Studentu 48, 51367 Kaunas, Lithuania
| | - Ignas Narusis
- Faculty of Informatics, Kaunas University of Technology, Studentu 50, 51368 Kaunas, Lithuania; (A.N.); (I.N.); (I.L.-B.)
| | - Valentas Gruzauskas
- Artificial Intelligence Centre, Kaunas University of Technology, K. Barsausko 59, 51423 Kaunas, Lithuania; (V.R.); (V.G.); (R.G.)
- Institute of Computer Science, Vilnius University, 08303 Vilnius, Lithuania
| | - Romas Gruzauskas
- Artificial Intelligence Centre, Kaunas University of Technology, K. Barsausko 59, 51423 Kaunas, Lithuania; (V.R.); (V.G.); (R.G.)
| | - Ingrida Lagzdinyte-Budnike
- Faculty of Informatics, Kaunas University of Technology, Studentu 50, 51368 Kaunas, Lithuania; (A.N.); (I.N.); (I.L.-B.)
| |
Collapse
|
4
|
Wu Z, Zhang T, Fang C, Yang J, Ma C, Zheng H, Zhao H. Super-resolution fusion optimization for poultry detection: a multi-object chicken detection method. J Anim Sci 2023; 101:skad249. [PMID: 37490419 PMCID: PMC10494879 DOI: 10.1093/jas/skad249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 07/24/2023] [Indexed: 07/27/2023] Open
Abstract
Accurate poultry detection is crucial for studying poultry behavior using computer vision and video surveillance. However, in free-range farming environments, detecting chickens can often be challenging due to their small size and mutual occlusion. The current detection algorithms exhibit a low level of accuracy, with a high probability of false and missed detections. To address this, we proposed a multi-object chicken detection method named Super-resolution Chicken Detection, which utilizes super-resolution fusion optimization. The algorithm employs the residual-residual dense block to extract image features and used a generative adversarial network to compensate for the loss of details during deep convolution, producing high-resolution images for detection. The proposed algorithm was validated with the B1 data set and the MC1 multi-object data set, demonstrating that the reconstructed images possessed richer pixel features compared to original images, specifically it improved detection accuracy and reduced the number of missed detections. The structural similarity of the reconstructed images was 99.9%, and the peak signal-to-noise ratio was above 30. The algorithm improved the Average Precision50:95 of all You Only Look Once Version X (YOLOX) models, with the largest improvement for the B1 data set with YOLOX-Large (+6.3%) and for the MC1 data set with YOLOX-Small (+4.1%). This was the first time a super-resolution reconstruction technique was applied to multi-object poultry detection. Our method will provide a fresh approach for future poultry researchers to improve the accuracy of object detection using computer vision and video surveillance.
Collapse
Affiliation(s)
- Zhenlong Wu
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| | - Tiemin Zhang
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
- State Key Laboratory of Swine and Poultry Breeding Industry, Guangzhou 510642, PR China
- National Engineering Research Center for Breeding Swine Industry, Guangzhou 510642, PR China
| | - Cheng Fang
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| | - Jikang Yang
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| | - Chuang Ma
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| | - Haikun Zheng
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| | - Hongzhi Zhao
- College of Engineering, South China Agricultural University, Guangzhou 510642, PR China
| |
Collapse
|
5
|
Salmonella spp. in Chicken: Prevalence, Antimicrobial Resistance, and Detection Methods. MICROBIOLOGY RESEARCH 2022. [DOI: 10.3390/microbiolres13040050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Multidrug-resistant Salmonella spp. is one of the leading causes of worldwide foodborne disease outbreaks. Animal-derived foods, particularly chicken and poultry products, are the most likely source of Salmonella transmission to humans. The increasing demand for chicken meat has raised a global food safety issue. This review aims to determine the prevalence and antimicrobial resistance of Salmonella spp. in chickens from various countries in Asia. The methods for detecting Salmonella will also be discussed in this review. The prevalence of Salmonella spp. in chicken and poultry products is lower in developed countries than in developing countries. In addition, the incidence of Salmonella spp. in chicken and poultry products from fresh markets is higher than those from supermarkets. Furthermore, this review also reported the presence of multidrug-resistant Salmonella strains in various Asian countries. Rapid Salmonella detection based on immunological assays, molecular-based assays, and biosensors can provide more accurate results with high sensitivity and specificity. These methods also require a shorter time than the cultural-based Salmonella detection method. The use of suitable detection methods to determine the presence of Salmonella spp. in chicken and poultry products is important to ensure food safety.
Collapse
|
6
|
Affiliation(s)
- Robert J Delmore
- Department of Animal Sciences, Colorado State University, Fort Collins, CO 80523, USA
| |
Collapse
|