Robustness of analyses of imaging data

Calibration to maximize temporal radiometric repeatability of airborne hyperspectral imaging data

Many studies provide insight into calibration of airborne remote sensing data but very few specifically address the issue of temporal radiometric repeatability. In this study, we acquired airborne hyperspectral optical sensing data from experimental objects (white Teflon and colored panels) during 52 flight missions on three separate days. Data sets were subjected to four radiometric calibration methods: no radiometric calibration (radiance data), empirical line method calibration based on white calibration boards (ELM calibration), and two atmospheric radiative transfer model calibrations: 1) radiometric calibration with irradiance data acquired with a drone-mounted down-welling sensor (ARTM), and 2) modeled sun parameters and weather variables in combination with irradiance data from drone-mounted down-welling sensor (ARTM+). Spectral bands from 900-970 nm were found to be associated with disproportionally lower temporal radiometric repeatability than spectral bands from 416-900 nm. ELM calibration was found to be highly sensitive to time of flight missions (which is directly linked to sun parameters and weather conditions). Both ARTM calibrations outperformed ELM calibration, especially ARTM2+. Importantly, ARTM+ calibration markedly attenuated loss of radiometric repeatability in spectral bands beyond 900 nm and therefore improved possible contributions of these spectral bands to classification functions. We conclude that a minimum of 5% radiometric error (radiometric repeatability<95%), and probably considerably more error, should be expected when airborne remote sensing data are acquired at multiple time points across days. Consequently, objects being classified should be in classes that are at least 5% different in terms of average optical traits for classification functions to perform with high degree of accuracy and consistency. This study provides strong support for the claim that airborne remote sensing studies should include repeated data acquisitions from same objects at multiple time points. Such temporal replication is essential for classification functions to capture variation and stochastic noise caused by imaging equipment, and abiotic and environmental variables.

Experimental data manipulations to assess performance of hyperspectral classification models of crop seeds and other objects

BACKGROUND

Optical sensing solutions are being developed and adopted to classify a wide range of biological objects, including crop seeds. Performance assessment of optical classification models remains both a priority and a challenge.

METHODS

As training data, we acquired hyperspectral imaging data from 3646 individual tomato seeds (germination yes/no) from two tomato varieties. We performed three experimental data manipulations: (1) Object assignment error: effect of individual object in the training data being assigned to the wrong class. (2) Spectral repeatability: effect of introducing known ranges (0-10%) of stochastic noise to individual reflectance values. (3) Size of training data set: effect of reducing numbers of observations in training data. Effects of each of these experimental data manipulations were characterized and quantified based on classifications with two functions [linear discriminant analysis (LDA) and support vector machine (SVM)].

RESULTS

For both classification functions, accuracy decreased linearly in response to introduction of object assignment error and to experimental reduction of spectral repeatability. We also demonstrated that experimental reduction of training data by 20% had negligible effect on classification accuracy. LDA and SVM classification algorithms were applied to independent validation seed samples. LDA-based classifications predicted seed germination with RMSE = 10.56 (variety 1) and 26.15 (variety 2), and SVM-based classifications predicted seed germination with RMSE = 10.44 (variety 1) and 12.58 (variety 2).

CONCLUSION

We believe this study represents the first, in which optical seed classification included both a thorough performance evaluation of two separate classification functions based on experimental data manipulations, and application of classification models to validation seed samples not included in training data. Proposed experimental data manipulations are discussed in broader contexts and general relevance, and they are suggested as methods for in-depth performance assessments of optical classification models.

Proximal Remote Sensing to Non-destructively Detect and Diagnose Physiological Responses by Host Insect Larvae to Parasitism

As part of identifying and characterizing physiological responses and adaptations by insects, it is paramount to develop non-destructive techniques to monitor individual insects over time. Such techniques can be used to optimize the timing of when in-depth (i.e., destructive sampling of insect tissue) physiological or molecular analyses should be deployed. In this article, we present evidence that hyperspectral proximal remote sensing can be used effectively in studies of host responses to parasitism. We present time series body reflectance data acquired from individual soybean loopers (Chrysodeixis includens) without parasitism (control) or parasitized by one of two species of parasitic wasps with markedly different life histories: Microplitis demolitor, a solitary larval koinobiont endoparasitoid and Copidosoma floridanum, a polyembryonic (gregarious) egg-larval koinobiont endoparasitoid. Despite considerable temporal variation in reflectance data 1-9 days post-parasitism, the two parasitoids caused uniquely different host body reflectance responses. Based on reflectance data acquired 3-5 days post-parasitism, all three treatments (control larvae, and those parasitized by either M. demolitor or C. floridanum) could be classified with >85 accuracy. We suggest that hyperspectral proximal imaging technologies represent an important frontier in insect physiology, as they are non-invasive and can be used to account for important time scale factors, such as: minutes of exposure or acclimation to abiotic factors, circadian rhythms, and seasonal effects. Although this study is based on data from a host-parasitoid system, results may be of broad relevance to insect physiologists. Described approaches provide a non-invasive and rapid method that can provide insights into when to destructively sample tissue for more detailed mechanistic studies of physiological responses to stressors and environmental conditions.

Penetration and scattering-Two optical phenomena to consider when applying proximal remote sensing technologies to object classifications

Proximal remote sensing is being used across a very wide range of research fields and by scientists, who are often without deep theoretical knowledge optical physics; the author of this article falls squarely in that category! This article highlights two optical phenomena, which may greatly influence the quality and robustness of proximal remote sensing: penetration and scattering. Penetration implies that acquired reflectance signals are associated with both physical and chemical properties of target objects from both the surface and internal tissues/structures. Scattering implies that reflectance signals acquired from one point or object are influenced by scattered radiometric energy from neighboring points or objects. Based on a series of laboratory experiments, penetration and scattering were discussed in the context of "robustness" (repeatability) of hyperspectral reflectance data. High robustness implies that it is possible to control imaging conditions and therefore: 1) obtain very similar radiometric signals from inert objects (objects that do not change) over time, and 2) be able to consistently distinguish objects that are otherwise highly similar in appearance (size, shape, and color) and in terms of biochemical composition. It was demonstrated that robustness of hyperspectral reflectance data (40 spectral bands from 385 to 1024 nm) were significantly influenced by penetration and scattering of radiometric energy. In addition, it was demonstrated that the influence of penetration and scattering varied across the examined spectrum. Characterization of how optical phenomena may affect the robustness of reflectance data is important when using proximal remote sensing technologies as tools used to classify engineering and biological objects.

Using proximal remote sensing in non-invasive phenotyping of invertebrates

Proximal imaging remote sensing technologies are used to phenotype and to characterize organisms based on specific external body reflectance features. These imaging technologies are gaining interest and becoming more widely used and applied in ecological, systematic, evolutionary, and physiological studies of plants and also of animals. However, important factors may impact the quality and consistency of body reflectance features and therefore the ability to use these technologies as part of non-invasive phenotyping and characterization of organisms. We acquired hyperspectral body reflectance profiles from three insect species, and we examined how preparation procedures and preservation time affected the ability to detect reflectance responses to gender, origin, and age. Different portions of the radiometric spectrum varied markedly in their sensitivity to preparation procedures and preservation time. Based on studies of three insect species, we successfully identified specific radiometric regions, in which phenotypic traits become significantly more pronounced based on either: 1) gentle cleaning of museum specimens with distilled water, or 2) killing and preserving insect specimens in 70% ethanol. Standardization of killing and preservation procedures will greatly increase the ability to use proximal imaging remote sensing technologies as part of phenotyping and also when used in ecological and evolutionary studies of invertebrates.

The potential and prospects of proximal remote sensing of arthropod pests

Bench-top or proximal remote sensing applications are widely used as part of quality control and machine vision systems in commercial operations. In addition, these technologies are becoming increasingly important in insect systematics and studies of insect physiology and pest management. This paper provides a review and discussion of how proximal remote sensing may contribute valuable quantitative information regarding identification of species, assessment of insect responses to insecticides, insect host responses to parasitoids and performance of biological control agents. The future role of proximal remote sensing is discussed as an exciting path for novel paths of multidisciplinary research among entomologists and scientists from a wide range of other disciplines, including image processing engineers, medical engineers, research pharmacists and computer scientists. © 2015 Society of Chemical Industry.

Remote Sensing and Reflectance Profiling in Entomology

Remote sensing describes the characterization of the status of objects and/or the classification of their identity based on a combination of spectral features extracted from reflectance or transmission profiles of radiometric energy. Remote sensing can be benchtop based, and therefore acquired at a high spatial resolution, or airborne at lower spatial resolution to cover large areas. Despite important challenges, airborne remote sensing technologies will undoubtedly be of major importance in optimized management of agricultural systems in the twenty-first century. Benchtop remote sensing applications are becoming important in insect systematics and in phenomics studies of insect behavior and physiology. This review highlights how remote sensing influences entomological research by enabling scientists to nondestructively monitor how individual insects respond to treatments and ambient conditions. Furthermore, novel remote sensing technologies are creating intriguing interdisciplinary bridges between entomology and disciplines such as informatics and electrical engineering.