FIN-PRINT a fully-automated multi-stage deep-learning-based framework for the individual recognition of killer whales

Deep learning-based image classification of turtles imported into Korea

Although turtles play a key role in maintaining healthy and balanced environments, these are endangered due to global trade to meet the high demand for food, medicine, and pets in Asia. In addition, imported non-native turtles have been controlled as alien invasive species in various countries, including Korea. Therefore, a rapid and accurate classification of imported turtles is needed to conserve and detect those in native ecosystems. In this study, eight Single Shot MultiBox Detector (SSD) models using different backbone networks were used to classify 36 imported turtles in Korea. The images of these species were collected from Google and were identified using morphological features. Then, these were divided into 70% for training, 15% for validation, and 15% for test sets. In addition, data augmentation was applied to the training set to prevent overfitting. Among the eight models, the Resnet18 model showed the highest mean Average Precision (mAP) at 88.1% and the fastest inference time at 0.024 s. The average correct classification rate of 36 turtles in this model was 82.8%. The results of this study could help in management of the turtle trade, specifically in improving detection of alien invasive species in the wild.

ORCA-SPY enables killer whale sound source simulation, detection, classification and localization using an integrated deep learning-based segmentation

Acoustic identification of vocalizing individuals opens up new and deeper insights into animal communications, such as individual-/group-specific dialects, turn-taking events, and dialogs. However, establishing an association between an individual animal and its emitted signal is usually non-trivial, especially for animals underwater. Consequently, a collection of marine species-, array-, and position-specific ground truth localization data is extremely challenging, which strongly limits possibilities to evaluate localization methods beforehand or at all. This study presents ORCA-SPY, a fully-automated sound source simulation, classification and localization framework for passive killer whale (Orcinus orca) acoustic monitoring that is embedded into PAMGuard, a widely used bioacoustic software toolkit. ORCA-SPY enables array- and position-specific multichannel audio stream generation to simulate real-world ground truth killer whale localization data and provides a hybrid sound source identification approach integrating ANIMAL-SPOT, a state-of-the-art deep learning-based orca detection network, followed by downstream Time-Difference-Of-Arrival localization. ORCA-SPY was evaluated on simulated multichannel underwater audio streams including various killer whale vocalization events within a large-scale experimental setup benefiting from previous real-world fieldwork experience. Across all 58,320 embedded vocalizing killer whale events, subject to various hydrophone array geometries, call types, distances, and noise conditions responsible for a signal-to-noise ratio varying from [Formula: see text] dB to 3 dB, a detection rate of 94.0 % was achieved with an average localization error of 7.01[Formula: see text]. ORCA-SPY was field-tested on Lake Stechlin in Brandenburg Germany under laboratory conditions with a focus on localization. During the field test, 3889 localization events were observed with an average error of 29.19[Formula: see text] and a median error of 17.54[Formula: see text]. ORCA-SPY was deployed successfully during the DeepAL fieldwork 2022 expedition (DLFW22) in Northern British Columbia, with a mean average error of 20.01[Formula: see text] and a median error of 11.01[Formula: see text] across 503 localization events. ORCA-SPY is an open-source and publicly available software framework, which can be adapted to various recording conditions as well as animal species.