Automated image analysis for the detection of benthic crustaceans and bacterial mat coverage using the VENUS undersea cabled network

Automatic Monitoring of Relevant Behaviors for Crustacean Production in Aquaculture: A Review

Simple Summary

Automatic behavior monitoring, also called automated analytics or automated reporting, is the ability of an analytics platform to auto-detect relevant insights—anomalies, trends, patterns—and deliver them to users in real time, without users having to manually explore their data to find the answers they need. An analytics platform with automated behavior monitoring uses algorithms to auto-analyze datasets to search for notable changes in data. It then generates alerts at fixed intervals or triggers (thresholds), and delivers the findings to each user, ready-made. In-aquaculture scoring of behavioral indicators of aquatic animal welfare is challenging, but the increasing availability of low-cost technology now makes the automated monitoring of behavior feasible.

Abstract

Crustacean farming is a fast-growing sector and has contributed to improving incomes. Many studies have focused on how to improve crustacean production. Information about crustacean behavior is important in this respect. Manual methods of detecting crustacean behavior are usually infectible, time-consuming, and imprecise. Therefore, automatic growth situation monitoring according to changes in behavior has gained more attention, including acoustic technology, machine vision, and sensors. This article reviews the development of these automatic behavior monitoring methods over the past three decades and summarizes their domains of application, as well as their advantages and disadvantages. Furthermore, the challenges of individual sensitivity and aquaculture environment for future research on the behavior of crustaceans are also highlighted. Studies show that feeding behavior, movement rhythms, and reproduction behavior are the three most important behaviors of crustaceans, and the applications of information technology such as advanced machine vision technology have great significance to accelerate the development of new means and techniques for more effective automatic monitoring. However, the accuracy and intelligence still need to be improved to meet intensive aquaculture requirements. Our purpose is to provide researchers and practitioners with a better understanding of the state of the art of automatic monitoring of crustacean behaviors, pursuant of supporting the implementation of smart crustacean farming applications.

The Hierarchic Treatment of Marine Ecological Information from Spatial Networks of Benthic Platforms

Measuring biodiversity simultaneously in different locations, at different temporal scales, and over wide spatial scales is of strategic importance for the improvement of our understanding of the functioning of marine ecosystems and for the conservation of their biodiversity. Monitoring networks of cabled observatories, along with other docked autonomous systems (e.g., Remotely Operated Vehicles [ROVs], Autonomous Underwater Vehicles [AUVs], and crawlers), are being conceived and established at a spatial scale capable of tracking energy fluxes across benthic and pelagic compartments, as well as across geographic ecotones. At the same time, optoacoustic imaging is sustaining an unprecedented expansion in marine ecological monitoring, enabling the acquisition of new biological and environmental data at an appropriate spatiotemporal scale. At this stage, one of the main problems for an effective application of these technologies is the processing, storage, and treatment of the acquired complex ecological information. Here, we provide a conceptual overview on the technological developments in the multiparametric generation, storage, and automated hierarchic treatment of biological and environmental information required to capture the spatiotemporal complexity of a marine ecosystem. In doing so, we present a pipeline of ecological data acquisition and processing in different steps and prone to automation. We also give an example of population biomass, community richness and biodiversity data computation (as indicators for ecosystem functionality) with an Internet Operated Vehicle (a mobile crawler). Finally, we discuss the software requirements for that automated data processing at the level of cyber-infrastructures with sensor calibration and control, data banking, and ingestion into large data portals.

A Flexible Autonomous Robotic Observatory Infrastructure for Bentho-Pelagic Monitoring

This paper presents the technological developments and the policy contexts for the project “Autonomous Robotic Sea-Floor Infrastructure for Bentho-Pelagic Monitoring” (ARIM). The development is based on the national experience with robotic component technologies that are combined and merged into a new product for autonomous and integrated ecological deep-sea monitoring. Traditional monitoring is often vessel-based and thus resource demanding. It is economically unviable to fulfill the current policy for ecosystem monitoring with traditional approaches. Thus, this project developed platforms for bentho-pelagic monitoring using an arrangement of crawler and stationary platforms at the Lofoten-Vesterålen (LoVe) observatory network (Norway). Visual and acoustic imaging along with standard oceanographic sensors have been combined to support advanced and continuous spatial-temporal monitoring near cold water coral mounds. Just as important is the automatic processing techniques under development that have been implemented to allow species (or categories of species) quantification (i.e., tracking and classification). At the same time, real-time outboard processed three-dimensional (3D) laser scanning has been implemented to increase mission autonomy capability, delivering quantifiable information on habitat features (i.e., for seascape approaches). The first version of platform autonomy has already been tested under controlled conditions with a tethered crawler exploring the vicinity of a cabled stationary instrumented garage. Our vision is that elimination of the tether in combination with inductive battery recharge trough fuel cell technology will facilitate self-sustained long-term autonomous operations over large areas, serving not only the needs of science, but also sub-sea industries like subsea oil and gas, and mining.

New High-Tech Flexible Networks for the Monitoring of Deep-Sea Ecosystems

Increasing interest in the acquisition of biotic and abiotic resources from within the deep sea (e.g., fisheries, oil-gas extraction, and mining) urgently imposes the development of novel monitoring technologies, beyond the traditional vessel-assisted, time-consuming, high-cost sampling surveys. The implementation of permanent networks of seabed and water-column-cabled (fixed) and docked mobile platforms is presently enforced, to cooperatively measure biological features and environmental (physicochemical) parameters. Video and acoustic (i.e., optoacoustic) imaging are becoming central approaches for studying benthic fauna (e.g., quantifying species presence, behavior, and trophic interactions) in a remote, continuous, and prolonged fashion. Imaging is also being complemented by in situ environmental-DNA sequencing technologies, allowing the traceability of a wide range of organisms (including prokaryotes) beyond the reach of optoacoustic tools. Here, we describe the different fixed and mobile platforms of those benthic and pelagic monitoring networks, proposing at the same time an innovative roadmap for the automated computing of hierarchical ecological information on deep-sea ecosystems (i.e., from single species' abundance and life traits to community composition, and overall biodiversity).

The value of remote sensing techniques in supporting effective extrapolation across multiple marine spatial scales

The reporting of ecological phenomena and environmental status routinely required point observations, collected with traditional sampling approaches to be extrapolated to larger reporting scales. This process encompasses difficulties that can quickly entrain significant errors. Remote sensing techniques offer insights and exceptional spatial coverage for observing the marine environment. This review provides guidance on (i) the structures and discontinuities inherent within the extrapolative process, (ii) how to extrapolate effectively across multiple spatial scales, and (iii) remote sensing techniques and data sets that can facilitate this process. This evaluation illustrates that remote sensing techniques are a critical component in extrapolation and likely to underpin the production of high-quality assessments of ecological phenomena and the regional reporting of environmental status. Ultimately, is it hoped that this guidance will aid the production of robust and consistent extrapolations that also make full use of the techniques and data sets that expedite this process.

Application of morphological segmentation to leaking defect detection in sewer pipelines

As one of major underground pipelines, sewerage is an important infrastructure in any modern city. The most common problem occurring in sewerage is leaking, whose position and failure level is typically identified through closed circuit television (CCTV) inspection in order to facilitate rehabilitation process. This paper proposes a novel method of computer vision, morphological segmentation based on edge detection (MSED), to assist inspectors in detecting pipeline defects in CCTV inspection images. In addition to MSED, other mathematical morphology-based image segmentation methods, including opening top-hat operation (OTHO) and closing bottom-hat operation (CBHO), were also applied to the defect detection in vitrified clay sewer pipelines. The CCTV inspection images of the sewer system in the 9th district, Taichung City, Taiwan were selected as the experimental materials. The segmentation results demonstrate that MSED and OTHO are useful for the detection of cracks and open joints, respectively, which are the typical leakage defects found in sewer pipelines.

A new colorimetrically-calibrated automated video-imaging protocol for day-night fish counting at the OBSEA coastal cabled observatory

Field measurements of the swimming activity rhythms of fishes are scant due to the difficulty of counting individuals at a high frequency over a long period of time. Cabled observatory video monitoring allows such a sampling at a high frequency over unlimited periods of time. Unfortunately, automation for the extraction of biological information (i.e., animals' visual counts per unit of time) is still a major bottleneck. In this study, we describe a new automated video-imaging protocol for the 24-h continuous counting of fishes in colorimetrically calibrated time-lapse photographic outputs, taken by a shallow water (20 m depth) cabled video-platform, the OBSEA. The spectral reflectance value for each patch was measured between 400 to 700 nm and then converted into standard RGB, used as a reference for all subsequent calibrations. All the images were acquired within a standardized Region Of Interest (ROI), represented by a 2 × 2 m methacrylate panel, endowed with a 9-colour calibration chart, and calibrated using the recently implemented "3D Thin-Plate Spline" warping approach in order to numerically define color by its coordinates in n-dimensional space. That operation was repeated on a subset of images, 500 images as a training set, manually selected since acquired under optimum visibility conditions. All images plus those for the training set were ordered together through Principal Component Analysis allowing the selection of 614 images (67.6%) out of 908 as a total corresponding to 18 days (at 30 min frequency). The Roberts operator (used in image processing and computer vision for edge detection) was used to highlights regions of high spatial colour gradient corresponding to fishes' bodies. Time series in manual and visual counts were compared together for efficiency evaluation. Periodogram and waveform analysis outputs provided very similar results, although quantified parameters in relation to the strength of respective rhythms were different. Results indicate that automation efficiency is limited by optimum visibility conditions. Data sets from manual counting present the larger day-night fluctuations in comparison to those derived from automation. This comparison indicates that the automation protocol subestimate fish numbers but it is anyway suitable for the study of community activity rhythms.