1
|
Go J, Moon N. Cleaned Meta Pseudo Labels-Based Pet Behavior Recognition Using Time-Series Sensor Data. SENSORS (BASEL, SWITZERLAND) 2024; 24:3391. [PMID: 38894180 PMCID: PMC11175053 DOI: 10.3390/s24113391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 05/15/2024] [Accepted: 05/23/2024] [Indexed: 06/21/2024]
Abstract
With the increasing number of households owning pets, the importance of sensor data for recognizing pet behavior has grown significantly. However, challenges arise due to the costs and reliability issues associated with data collection. This paper proposes a method for classifying pet behavior using cleaned meta pseudo labels to overcome these issues. The data for this study were collected using wearable devices equipped with accelerometers, gyroscopes, and magnetometers, and pet behaviors were classified into five categories. Utilizing this data, we analyzed the impact of the quantity of labeled data on accuracy and further enhanced the learning process by integrating an additional Distance Loss. This method effectively improves the learning process by removing noise from unlabeled data. Experimental results demonstrated that while the conventional supervised learning method achieved an accuracy of 82.9%, the existing meta pseudo labels method showed an accuracy of 86.2%, and the cleaned meta pseudo labels method proposed in this study surpassed these with an accuracy of 88.3%. These results hold significant implications for the development of pet monitoring systems, and the approach of this paper provides an effective solution for recognizing and classifying pet behavior in environments with insufficient labels.
Collapse
Affiliation(s)
| | - Nammee Moon
- Department of Computer Science and Engineering, Hoseo University, Asan-si 31499, Republic of Korea;
| |
Collapse
|
2
|
Berg P, Mappes T, Kujala MV. Olfaction in the canine cognitive and emotional processes: From behavioral and neural viewpoints to measurement possibilities. Neurosci Biobehav Rev 2024; 157:105527. [PMID: 38160722 DOI: 10.1016/j.neubiorev.2023.105527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 12/22/2023] [Accepted: 12/27/2023] [Indexed: 01/03/2024]
Abstract
Domestic dogs (Canis familiaris) have excellent olfactory processing capabilities that are utilized widely in human society e.g., working with customs, police, and army; their scent detection is also used in guarding, hunting, mold-sniffing, searching for missing people or animals, and facilitating the life of the disabled. Sniffing and searching for odors is a natural, species-typical behavior and essential for the dog's welfare. While taking advantage of this canine ability widely, we understand its foundations and implications quite poorly. We can improve animal welfare by better understanding their olfactory world. In this review, we outline the olfactory processing of dogs in the nervous system, summarize the current knowledge of scent detection and differentiation; the effect of odors on the dogs' cognitive and emotional processes and the dog-human bond; and consider the methodological advancements that could be developed further to aid in our understanding of the canine world of odors.
Collapse
Affiliation(s)
- Päivi Berg
- Department of Biological and Environmental Science, Faculty of Mathematics and Science, University of Jyväskylä, PO BOX 35, FI-40014, Finland; Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO BOX 35, FI-40014, Finland,.
| | - Tapio Mappes
- Department of Biological and Environmental Science, Faculty of Mathematics and Science, University of Jyväskylä, PO BOX 35, FI-40014, Finland
| | - Miiamaaria V Kujala
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, PO BOX 35, FI-40014, Finland,; Faculty of Veterinary Medicine, University of Helsinki, PO BOX 57, FI-00014, Finland; Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 11000, FI-00076 Aalto, Finland
| |
Collapse
|
3
|
Aguilar-Lazcano CA, Espinosa-Curiel IE, Ríos-Martínez JA, Madera-Ramírez FA, Pérez-Espinosa H. Machine Learning-Based Sensor Data Fusion for Animal Monitoring: Scoping Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:5732. [PMID: 37420896 DOI: 10.3390/s23125732] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Revised: 06/01/2023] [Accepted: 06/05/2023] [Indexed: 07/09/2023]
Abstract
The development of technology, such as the Internet of Things and artificial intelligence, has significantly advanced many fields of study. Animal research is no exception, as these technologies have enabled data collection through various sensing devices. Advanced computer systems equipped with artificial intelligence capabilities can process these data, allowing researchers to identify significant behaviors related to the detection of illnesses, discerning the emotional state of the animals, and even recognizing individual animal identities. This review includes articles in the English language published between 2011 and 2022. A total of 263 articles were retrieved, and after applying inclusion criteria, only 23 were deemed eligible for analysis. Sensor fusion algorithms were categorized into three levels: Raw or low (26%), Feature or medium (39%), and Decision or high (34%). Most articles focused on posture and activity detection, and the target species were primarily cows (32%) and horses (12%) in the three levels of fusion. The accelerometer was present at all levels. The findings indicate that the study of sensor fusion applied to animals is still in its early stages and has yet to be fully explored. There is an opportunity to research the use of sensor fusion for combining movement data with biometric sensors to develop animal welfare applications. Overall, the integration of sensor fusion and machine learning algorithms can provide a more in-depth understanding of animal behavior and contribute to better animal welfare, production efficiency, and conservation efforts.
Collapse
|
4
|
Velichko A, Korzun D, Meigal A. Artificial Neural Networks for IoT-Enabled Smart Applications: Recent Trends. SENSORS (BASEL, SWITZERLAND) 2023; 23:4853. [PMID: 37430767 DOI: 10.3390/s23104853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 05/15/2023] [Indexed: 07/12/2023]
Abstract
In the age of neural networks and the Internet of Things (IoT), the search for new neural network architectures capable of operating on devices with limited computing power and small memory size is becoming an urgent agenda [...].
Collapse
Affiliation(s)
- Andrei Velichko
- Institute of Physics and Technology, Petrozavodsk State University, 33 Lenin Ave., 185910 Petrozavodsk, Russia
| | - Dmitry Korzun
- Department of Computer Science, Institute of Mathematics and Information Technology, Petrozavodsk State University, 33 Lenin Ave., 185910 Petrozavodsk, Russia
| | - Alexander Meigal
- Medical Institute, Petrozavodsk State University, 33 Lenin Ave., 185910 Petrozavodsk, Russia
| |
Collapse
|
5
|
The Cloud-to-Edge-to-IoT Continuum as an Enabler for Search and Rescue Operations. FUTURE INTERNET 2023. [DOI: 10.3390/fi15020055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023] Open
Abstract
When a natural or human disaster occurs, time is critical and often of vital importance. Data from the incident area containing the information to guide search and rescue (SAR) operations and improve intervention effectiveness should be collected as quickly as possible and with the highest accuracy possible. Nowadays, rescuers are assisted by different robots able to fly, climb or crawl, and with different sensors and wireless communication means. However, the heterogeneity of devices and data together with the strong low-delay requirements cause these technologies not yet to be used at their highest potential. Cloud and Edge technologies have shown the capability to offer support to the Internet of Things (IoT), complementing it with additional resources and functionalities. Nonetheless, building a continuum from the IoT to the edge and to the cloud is still an open challenge. SAR operations would benefit strongly from such a continuum. Distributed applications and advanced resource orchestration solutions over the continuum in combination with proper software stacks reaching out to the edge of the network may enhance the response time and effective intervention for SAR operation. The challenges for SAR operations, the technologies, and solutions for the cloud-to-edge-to-IoT continuum will be discussed in this paper.
Collapse
|
6
|
Muminov A, Mukhiddinov M, Cho J. Enhanced Classification of Dog Activities with Quaternion-Based Fusion Approach on High-Dimensional Raw Data from Wearable Sensors. SENSORS (BASEL, SWITZERLAND) 2022; 22:9471. [PMID: 36502172 PMCID: PMC9739384 DOI: 10.3390/s22239471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 11/28/2022] [Accepted: 12/02/2022] [Indexed: 06/17/2023]
Abstract
The employment of machine learning algorithms to the data provided by wearable movement sensors is one of the most common methods to detect pets' behaviors and monitor their well-being. However, defining features that lead to highly accurate behavior classification is quite challenging. To address this problem, in this study we aim to classify six main dog activities (standing, walking, running, sitting, lying down, and resting) using high-dimensional sensor raw data. Data were received from the accelerometer and gyroscope sensors that are designed to be attached to the dog's smart costume. Once data are received, the module computes a quaternion value for each data point that provides handful features for classification. Next, to perform the classification, we used several supervised machine learning algorithms, such as the Gaussian naïve Bayes (GNB), Decision Tree (DT), K-nearest neighbor (KNN), and support vector machine (SVM). In order to evaluate the performance, we finally compared the proposed approach's F-score accuracies with the accuracy of classic approach performance, where sensors' data are collected without computing the quaternion value and directly utilized by the model. Overall, 18 dogs equipped with harnesses participated in the experiment. The results of the experiment show a significantly enhanced classification with the proposed approach. Among all the classifiers, the GNB classification model achieved the highest accuracy for dog behavior. The behaviors are classified with F-score accuracies of 0.94, 0.86, 0.94, 0.89, 0.95, and 1, respectively. Moreover, it has been observed that the GNB classifier achieved 93% accuracy on average with the dataset consisting of quaternion values. In contrast, it was only 88% when the model used the dataset from sensors' data.
Collapse
|
7
|
Foster M, Wu T, Roberts DL, Bozkurt A. Preliminary Evaluation of a System with On-Body and Aerial Sensors for Monitoring Working Dogs. SENSORS (BASEL, SWITZERLAND) 2022; 22:7631. [PMID: 36236730 PMCID: PMC9572382 DOI: 10.3390/s22197631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 10/01/2022] [Accepted: 10/03/2022] [Indexed: 06/16/2023]
Abstract
This paper presents a system for behavioral, environmental, and physiological monitoring of working dogs using on-body and aerial sensors. The proof of concept study presented here includes two trained dogs performing nine scent detection tasks in an uncontrolled environment encompassing approximately two acres. The dogs were outfitted with a custom designed wearable harness to monitor their heart rate, activity levels and skin temperature. We utilized a commercially available micro-air vehicle to perform aerial sensing by tracking the terrain and movement of the dog in the outdoor space. The dogs were free to explore the space working at maximal speeds to complete a scent-based search-and-retrieval task. Throughout the experiment, the harness data was transferred to a base station via Wi-Fi in real-time. In this work, we also focused on testing the performance of a custom 3D electrode with application specific ergonomic improvements and adaptive filter processing techniques to recover as much electrocardiography data as possible during high intensity motion activity. We were able to recover and use 84% of the collected data where we observed a trend of heart rate generally increasing immediately after successful target localization. For tracking the dogs in the aerial video footage, we applied a state-of-the-art deep learning algorithm designed for online object tracking. Both qualitative and quantitative tracking results are very promising. This study presents an initial effort towards deployment of on-body and aerial sensors to monitor the working dogs and their environments during scent detection and search and rescue tasks in order to ensure their welfare, enable novel dog-machine interfaces, and allow for higher success rate of remote and automated task performance.
Collapse
Affiliation(s)
- Marc Foster
- Department of Electrical and Computer Engineering, NC State University, Raleigh, NC 27695, USA
| | - Tianfu Wu
- Department of Computer Science, NC State University, Raleigh, NC 27695, USA
| | - David L. Roberts
- Department of Computer Science, NC State University, Raleigh, NC 27695, USA
| | - Alper Bozkurt
- Department of Electrical and Computer Engineering, NC State University, Raleigh, NC 27695, USA
| |
Collapse
|
8
|
Basran PS, Appleby RB. The unmet potential of artificial intelligence in veterinary medicine. Am J Vet Res 2022; 83:385-392. [PMID: 35353711 DOI: 10.2460/ajvr.22.03.0038] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Veterinary medicine is a broad and growing discipline that includes topics such as companion animal health, population medicine and zoonotic diseases, and agriculture. In this article, we provide insight on how artificial intelligence works and how it is currently applied in veterinary medicine. We also discuss its potential in veterinary medicine. Given the rapid pace of research and commercial product developments in this area, the next several years will pose challenges to understanding, interpreting, and adopting this powerful and evolving technology. Artificial intelligence has the potential to enable veterinarians to perform tasks more efficiently while providing new insights for the management and treatment of disorders. It is our hope that this will translate to better quality of life for animals and those who care for them.
Collapse
Affiliation(s)
- Parminder S Basran
- Department of Clinical Sciences, College of Veterinary Medicine, Cornell University, Ithaca, NY
| | - Ryan B Appleby
- Department of Clinical Studies, Ontario Veterinary College, University of Guelph, Guelph, ON, Canada
| |
Collapse
|
9
|
Introducing the Architecture of FASTER: A Digital Ecosystem for First Responder Teams. INFORMATION 2022. [DOI: 10.3390/info13030115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Emergency first responders play an important role during search and rescue missions, by helping people and saving lives. Thus, it is important to provide them with technology that will maximize their performance and their safety on the field of action. IFAFRI, the “International Forum to Advanced First Responder Innovation” has pointed out several capability gaps that are found in the existing solutions. Based on them, there is a need for the development of novel, modern digital solutions that will better assist responders by helping them on the field and, at the same time, better protect them. The work presented here introduces the logical architecture implemented in the Horizon 2020 project called FASTER (First responders Advanced technologies for Safe and efficienT Emergency Response), which is an innovating digital ecosystem for emergency first response teams. It is a system that meets the requirements of the consortium members but also fills all the gaps that IFARFI has pointed out and consists of mechanisms and tools for data communication, data analysis, monitoring, privacy protection and smart detection mechanisms.
Collapse
|