An Under-Ice Hyperspectral and RGB Imaging System to Capture Fine-Scale Biophysical Properties of Sea Ice

Quantifying pigment content in crustose coralline algae using hyperspectral imaging: A case study with Tethysphytum antarcticum (Ross Sea, Antarctica)

Crustose coralline algae (CCA) are a highly diverse group of habitat-forming, calcifying red macroalgae (Rhodophyta) with unique adaptations to diverse irradiance regimes. A distinctive CCA phenotype adaptation, which allows them to maximize photosynthetic performance in low light, is their content of a specific group of light-harvesting pigments called phycobilins. In this study, we assessed the potential of noninvasive hyperspectral imaging (HSI) in the visible spectrum (400-800 nm) to describe the phenotypic variability in phycobilin content of an Antarctic coralline, Tethysphytum antarcticum (Hapalidiales), from two distinct locations. We validated our measurements with pigment extractions and spectrophotometry analysis, in addition to DNA barcoding using the psbA marker. Targeted spectral indices were developed and correlated with phycobilin content using linear mixed models (R2 = 0.64-0.7). Once applied to the HSI, the models revealed the distinct phycoerythrin spatial distribution in the two site-specific CCA phenotypes, with thin and thick crusts, respectively. This study advances the capabilities of hyperspectral imaging as a tool to quantitatively study CCA pigmentation in relation to their phenotypic plasticity, which can be applied in laboratory studies and potentially in situ surveys using underwater hyperspectral imaging systems.

Pixelwise immersion factor calibration for underwater hyperspectral imaging instruments

In situ spectral reflectance initially captured at high spatial resolution with underwater hyperspectral imaging (UHI) is effective for classification and quantification in oceanic biogeochemical studies; however, the measured spectral radiance is rarely used as an absolute quantity due to challenges in calibration of UHI instruments. In this paper, a commercial UHI instrument was calibrated for radiometric flat field response and pixelwise immersion effect to support in situ measurement of absolute spectral radiance. The radiometric and immersion factor calibrations of the UHI instrument were evaluated quantitatively through comparative experiments with a spectroradiometer and a spectrometer. Results show that the immersion factor of the center pixel of the tested UHI instrument was 1.763 in pure water at 600 nm, and the averaged difference in immersion factor between the center and edge pixel of the UHI instrument in the visible light band was only 1∼3% across its half angle field of view of 35° in air. The new calibration coefficients were further used to calculate the spectral radiance of transmitted sunlight through ice algae clusters in sea ice measured by the UHI instrument during an Arctic under-ice bio-optical survey.

A Tunable Hyperspectral Imager for Detection and Quantification of Marine Biofouling on Coated Surfaces

Fouling control coatings (FCCs) are used to prevent the accumulation of marine biofouling on, e.g., ship hulls, which causes increased fuel consumption and the global spread of non-indigenous species. The standards for performance evaluations of FCCs rely on visual inspections, which induce a degree of subjectivity. The use of RGB images for objective evaluations has already received interest from several authors, but the limited acquired information restricts detailed analyses class-wise. This study demonstrates that hyperspectral imaging (HSI) expands the specificity of biofouling assessments of FCCs by capturing distinguishing spectral features. We developed a staring-type hyperspectral imager using a liquid crystal tunable filter as the wavelength selective element. A novel light-emitting diode illumination system with high and uniform irradiance was designed to compensate for the low-filter transmittance. A spectral library was created from reflectance-calibrated optical signatures of representative biofouling species and coated panels. We trained a neural network on the annotated library to assign a class to each pixel. The model was evaluated on an artificially generated target, and global accuracy of 95% was estimated. The classifier was tested on coated panels (exposed at the CoaST Maritime Test Centre) with visible intergrown biofouling. The segmentation results were used to determine the coverage percentage per class. Although a detailed taxonomic description might be complex due to spectral similarities among groups, these results demonstrate the feasibility of HSI for repeatable and quantifiable biofouling detection on coated surfaces.

Underwater Hyperspectral Imaging (UHI): A Review of Systems and Applications for Proximal Seafloor Ecosystem Studies

Marine ecosystem monitoring requires observations of its attributes at different spatial and temporal scales that traditional sampling methods (e.g., RGB imaging, sediment cores) struggle to efficiently provide. Proximal optical sensing methods can fill this observational gap by providing observations of, and tracking changes in, the functional features of marine ecosystems non-invasively. Underwater hyperspectral imaging (UHI) employed in proximity to the seafloor has shown a further potential to monitor pigmentation in benthic and sympagic phototrophic organisms at small spatial scales (mm–cm) and for the identification of minerals and taxa through their finely resolved spectral signatures. Despite the increasing number of studies applying UHI, a review of its applications, capabilities, and challenges for seafloor ecosystem research is overdue. In this review, we first detail how the limited band availability inherent to standard underwater cameras has led to a data analysis “bottleneck” in seafloor ecosystem research, in part due to the widespread implementation of underwater imaging platforms (e.g., remotely operated vehicles, time-lapse stations, towed cameras) that can acquire large image datasets. We discuss how hyperspectral technology brings unique opportunities to address the known limitations of RGB cameras for surveying marine environments. The review concludes by comparing how different studies harness the capacities of hyperspectral imaging, the types of methods required to validate observations, and the current challenges for accurate and replicable UHI research.

Life beneath the ice: jellyfish and ctenophores from the Ross Sea, Antarctica, with an image-based training set for machine learning

BACKGROUND

Southern Ocean ecosystems are currently experiencing increased environmental changes and anthropogenic pressures, urging scientists to report on their biodiversity and biogeography. Two major taxonomically diverse and trophically important gelatinous zooplankton groups that have, however, stayed largely understudied until now are the cnidarian jellyfish and ctenophores. This data scarcity is predominantly due to many of these fragile, soft-bodied organisms being easily fragmented and/or destroyed with traditional net sampling methods. Progress in alternative survey methods including, for instance, optics-based methods is slowly starting to overcome these obstacles. As video annotation by human observers is both time-consuming and financially costly, machine-learning techniques should be developed for the analysis of in situ /in aqua image-based datasets. This requires taxonomically accurate training sets for correct species identification and the present paper is the first to provide such data.

NEW INFORMATION

In this study, we twice conducted three week-long in situ optics-based surveys of jellyfish and ctenophores found under the ice in the McMurdo Sound, Antarctica. Our study constitutes the first optics-based survey of gelatinous zooplankton in the Ross Sea and the first study to use in situ / in aqua observations to describe taxonomic and some trophic and behavioural characteristics of gelatinous zooplankton from the Southern Ocean. Despite the small geographic and temporal scales of our study, we provided new undescribed morphological traits for all observed gelatinous zooplankton species (eight cnidarian and four ctenophore species). Three ctenophores and one leptomedusa likely represent undescribed species. Furthermore, along with the photography and videography, we prepared a Common Objects in Context (COCO) dataset, so that this study is the first to provide a taxonomist-ratified image training set for future machine-learning algorithm development concerning Southern Ocean gelatinous zooplankton species.

Rapid Quantification of Microalgae Growth with Hyperspectral Camera and Vegetation Indices

Spectral cameras are traditionally used in remote sensing of microalgae, but increasingly also in laboratory-scale applications, to study and monitor algae biomass in cultures. Practical and cost-efficient protocols for collecting and analyzing hyperspectral data are currently needed. The purpose of this study was to test a commercial, easy-to-use hyperspectral camera to monitor the growth of different algae strains in liquid samples. Indices calculated from wavebands from transmission imaging were compared against algae abundance and wet biomass obtained from an electronic cell counter, chlorophyll a concentration, and chlorophyll fluorescence. A ratio of selected wavebands containing near-infrared and red turned out to be a powerful index because it was simple to calculate and interpret, yet it yielded strong correlations to abundances strain-specifically (0.85 < r < 0.96, p < 0.001). When all the indices formulated as A/B, A/(A + B) or (A − B)/(A + B), where A and B were wavebands of the spectral camera, were scrutinized, good correlations were found amongst them for biomass of each strain (0.66 < r < 0.98, p < 0.001). Comparison of near-infrared/red index to chlorophyll a concentration demonstrated that small-celled strains had higher chlorophyll absorbance compared to strains with larger cells. The comparison of spectral imaging to chlorophyll fluorescence was done for one strain of green algae and yielded strong correlations (near-infrared/red, r = 0.97, p < 0.001). Consequently, we described a simple imaging setup and information extraction based on vegetation indices that could be used to monitor algae cultures.

Mapping the in situ microspatial distribution of ice algal biomass through hyperspectral imaging of sea-ice cores

Ice-associated microalgae make a significant seasonal contribution to primary production and biogeochemical cycling in polar regions. However, the distribution of algal cells is driven by strong physicochemical gradients which lead to a degree of microspatial variability in the microbial biomass that is significant, but difficult to quantify. We address this methodological gap by employing a field-deployable hyperspectral scanning and photogrammetric approach to study sea-ice cores. The optical set-up facilitated unsupervised mapping of the vertical and horizontal distribution of phototrophic biomass in sea-ice cores at mm-scale resolution (using chlorophyll a [Chl a] as proxy), and enabled the development of novel spectral indices to be tested against extracted Chl a (R² ≤ 0.84). The modelled bio-optical relationships were applied to hyperspectral imagery captured both in situ (using an under-ice sliding platform) and ex situ (on the extracted cores) to quantitatively map Chl a in mg m⁻² at high-resolution (≤ 2.4 mm). The optical quantification of Chl a on a per-pixel basis represents a step-change in characterising microspatial variation in the distribution of ice-associated algae. This study highlights the need to increase the resolution at which we monitor under-ice biophysical systems, and the emerging capability of hyperspectral imaging technologies to deliver on this research goal.

Underwater Hyperspectral Imaging Technology and Its Applications for Detecting and Mapping the Seafloor: A Review

Common methods of ocean remote sensing and seafloor surveying are mainly carried out by airborne and spaceborne hyperspectral imagers. However, the water column hinders the propagation of sunlight to deeper areas, thus limiting the scope of observation. As an emerging technology, underwater hyperspectral imaging (UHI) is an extension of hyperspectral imaging technology in air conditions, and is undergoing rapid development for applications in shallow and deep-sea environments. It is a close-range, high-resolution approach for detecting and mapping the seafloor. In this paper, we focus on the concepts of UHI technology, covering imaging systems and the correction methods of eliminating the water column’s influence. The current applications of UHI, such as deep-sea mineral exploration, benthic habitat mapping, and underwater archaeology, are highlighted to show the potential of this technology. This review can provide an introduction and overview for those working in the field and offer a reference for those searching for literature on UHI technology.