Improving Animal Monitoring Using Small Unmanned Aircraft Systems (sUAS) and Deep Learning Networks

Aerial Wildlife Image Repository for animal monitoring with drones in the age of artificial intelligence

Drones (unoccupied aircraft systems) have become effective tools for wildlife monitoring and conservation. Automated animal detection and classification using artificial intelligence (AI) can substantially reduce logistical and financial costs and improve drone surveys. However, the lack of annotated animal imagery for training AI is a critical bottleneck in achieving accurate performance of AI algorithms compared to other fields. To bridge this gap for drone imagery and help advance and standardize automated animal classification, we have created the Aerial Wildlife Image Repository (AWIR), which is a dynamic, interactive database with annotated images captured from drone platforms using visible and thermal cameras. The AWIR provides the first open-access repository for users to upload, annotate, and curate images of animals acquired from drones. The AWIR also provides annotated imagery and benchmark datasets that users can download to train AI algorithms to automatically detect and classify animals, and compare algorithm performance. The AWIR contains 6587 animal objects in 1325 visible and thermal drone images of predominantly large birds and mammals of 13 species in open areas of North America. As contributors increase the taxonomic and geographic diversity of available images, the AWIR will open future avenues for AI research to improve animal surveys using drones for conservation applications. Database URL: https://projectportal.gri.msstate.edu/awir/.

An efficient visual servo tracker for herd monitoring by UAV

It is a challenging and meaningful task to carry out UAV-based livestock monitoring in high-altitude (more than 4500 m on average) and cold regions (annual average - 4 °C) on the Qinghai Tibet Plateau. The purpose of artificial intelligence (AI) is to execute automated tasks and to solve practical problems in actual applications by combining the software technology with the hardware carrier to create integrated advanced devices. Only in this way, the maximum value of AI could be realized. In this paper, a real-time tracking system with dynamic target tracking ability is proposed. It is developed based on the tracking-by-detection architecture using YOLOv7 and Deep SORT algorithms for target detection and tracking, respectively. In response to the problems encountered in the tracking process of complex and dense scenes, our work (1) Uses optical flow to compensate the Kalman filter, to solve the problem of mismatch between the target bounding box predicted by the Kalman filter (KF) and the input when the target detection in the current frame is complex, thereby improving the prediction accuracy; (2) Using a low confidence trajectory filtering method to reduce false positive trajectories generated by Deep SORT, thereby mitigating the impact of unreliable detection on target tracking. (3) A visual servo controller has been designed for the Unmanned Aerial Vehicle (UAV) to reduce the impact of rapid movement on tracking and ensure that the target is always within the field of view of the UAV camera, thereby achieving automatic tracking tasks. Finally, the system was tested using Tibetan yaks on the Qinghai Tibet Plateau as tracking targets, and the results showed that the system has real-time multi tracking ability and ideal visual servo effect in complex and dense scenes.

Fusion of visible and thermal images improves automated detection and classification of animals for drone surveys

Visible and thermal images acquired from drones (unoccupied aircraft systems) have substantially improved animal monitoring. Combining complementary information from both image types provides a powerful approach for automating detection and classification of multiple animal species to augment drone surveys. We compared eight image fusion methods using thermal and visible drone images combined with two supervised deep learning models, to evaluate the detection and classification of white-tailed deer (Odocoileus virginianus), domestic cow (Bos taurus), and domestic horse (Equus caballus). We classified visible and thermal images separately and compared them with the results of image fusion. Fused images provided minimal improvement for cows and horses compared to visible images alone, likely because the size, shape, and color of these species made them conspicuous against the background. For white-tailed deer, which were typically cryptic against their backgrounds and often in shadows in visible images, the added information from thermal images improved detection and classification in fusion methods from 15 to 85%. Our results suggest that image fusion is ideal for surveying animals inconspicuous from their backgrounds, and our approach uses few image pairs to train compared to typical machine-learning methods. We discuss computational and field considerations to improve drone surveys using our fusion approach.

Cow Behavioural Activities in Extensive Farms: Challenges of Adopting Automatic Monitoring Systems

Animal welfare is becoming an increasingly important requirement in the livestock sector to improve, and therefore raise, the quality and healthiness of food production. By monitoring the behaviour of the animals, such as feeding, rumination, walking, and lying, it is possible to understand their physical and psychological status. Precision Livestock Farming (PLF) tools offer a good solution to assist the farmer in managing the herd, overcoming the limits of human control, and to react early in the case of animal health issues. The purpose of this review is to highlight a key concern that occurs in the design and validation of IoT-based systems created for monitoring grazing cows in extensive agricultural systems, since they have many more, and more complicated, problems than indoor farms. In this context, the most common concerns are related to the battery life of the devices, the sampling frequency to be used for data collection, the need for adequate service connection coverage and transmission range, the computational site, and the performance of the algorithm embedded in IoT-systems in terms of computational cost.

Towards the fully automated monitoring of ecological communities

High-resolution monitoring is fundamental to understand ecosystems dynamics in an era of global change and biodiversity declines. While real-time and automated monitoring of abiotic components has been possible for some time, monitoring biotic components-for example, individual behaviours and traits, and species abundance and distribution-is far more challenging. Recent technological advancements offer potential solutions to achieve this through: (i) increasingly affordable high-throughput recording hardware, which can collect rich multidimensional data, and (ii) increasingly accessible artificial intelligence approaches, which can extract ecological knowledge from large datasets. However, automating the monitoring of facets of ecological communities via such technologies has primarily been achieved at low spatiotemporal resolutions within limited steps of the monitoring workflow. Here, we review existing technologies for data recording and processing that enable automated monitoring of ecological communities. We then present novel frameworks that combine such technologies, forming fully automated pipelines to detect, track, classify and count multiple species, and record behavioural and morphological traits, at resolutions which have previously been impossible to achieve. Based on these rapidly developing technologies, we illustrate a solution to one of the greatest challenges in ecology: the ability to rapidly generate high-resolution, multidimensional and standardised data across complex ecologies.

Prediction and monitoring of LULC shift using cellular automata-artificial neural network in Jumar watershed of Ranchi District, Jharkhand

Jumar watershed of Ranchi district is agrarian in nature. The unplanned and exponentially growing urban sprawl has become one of the probable threats in achieving sustainable development goals (SDG-15). The purpose of this research study is to monitor the urban sprawl in Jumar watershed within three decades i.e. from the year 1990 to 2021. Land use land cover (LULC) change has been monitored using satellite data from LANDSAT (4, 5 and 8). Various indices are calculated like normalised difference vegetation index (NDVI), normalised difference built-up index (NDBI), normalised difference water index (NDWI) and built-up index (BUI) to monitor LULC change in the area. For prediction of urban sprawl, cellular automata and artificial neural network (CA-ANN) with GIS application technique is used. The model is validated by using Kappa coefficient. The prediction results showed increase in built-up area by 8.23 sq. km in the next decade. The built-up and barren land together increase up to 42.85 sq. km by 2030 and 34.61 sq. km in 2021. The NDVI for 3-decade period showed significant decrease in the healthy vegetation and increase in sparse vegetation. The NDBI showed a slight increase in urban area but massive increase in uncultivated and barren land. NDWI showed a decrease in area of the surface water. The LULC studies showed a major shift from healthy vegetation to agriculture and then to barren land. To assess the impact of urbanisation on water quality, water samples are taken seasonally from J1to J11 sampling locations and are analysed as per APHA procedure. The sites are classified as urban, semi urban and rural area as per their location. The water quality index (WQI) varied between 42.14 to 61.42 during pre-monsoon, 62.20 to 68.7995 during monsoon and 43.48 to 60.12 during post-monsoon. The quality of water is found poor in all seasons at all sampling sites. The water is found highly turbid and alkaline throughout the year. Overall, it can be concluded that the water needs to be pre-treated for drinking purposes throughout the year.