Blood Stain Classification with Hyperspectral Imaging and Deep Neural Networks

Discrimination of human and animal bloodstains using hyperspectral imaging

Blood is the most encountered type of biological evidence in violent crimes and contains pertinent information to a forensic investigation. The false presumption that blood encountered at a crime scene is human may not be realised until after costly and sample-consuming tests are performed. To address the question of blood origin, the novel application of visible-near infrared hyperspectral imaging (HSI) is used for the detection and discrimination of human and animal bloodstains. The HSI system used is a portable, non-contact, non-destructive method for the determination of blood origin. A support vector machine (SVM) binary classifier was trained for the discrimination of bloodstains of human (n = 20) and five animal species: pig (n = 20), mouse (n = 16), rat (n = 5), rabbit (n = 5), and cow (n = 20). On an independent test set, the SVM model achieved accuracy, precision, sensitivity, and specificity values of 96, 97, 95, and 96%, respectively. Segmented images of bloodstains aged over a period of two months were produced, allowing for the clear visualisation of the discrimination of human and animal bloodstains. The inclusion of such a system in a forensic investigation workflow not only removes ambiguity surrounding blood origin, but can potentially be used in tandem with HSI bloodstain age determination methods for rapid on-scene forensic analysis.

Neural network based hyperspectral imaging for substrate independent bloodstain age estimation

Being able to determine the age of a bloodstain can be a key element in a crime scene investigation. Many techniques exploit reflectance spectroscopy because it is very versatile and can be used in the field with ease. However, there are no methods for estimating bloodstain age with adequate uncertainty, and the problem of substrate influence is not yet fully resolved. We develop a hyperspectral imaging based technique for the substrate-independent age estimation of a bloodstain. Once the hyperspectral image is acquired, a neural network model recognizes the pixels belonging to the bloodstain. The reflectance spectra belonging to the bloodstain are then processed by an artificial intelligence model that removes the effect of the substrate on the bloodstain and then estimates its age. The method is trained on bloodstains deposited on 9 different substrates over a time period of 0-385 h obtaining an absolute mean error of 6.9 h over the period considered. Within two days of age, the method achieves a mean absolute error of 1.1 h. The method is finally tested on a new material (i.e., red cardboard) never used to test or validate the neural network models. Also in this case the bloodstain age is identified with the same accuracy.

Combined metabolomics and tandem machine-learning models for wound age estimation: a novel analytical strategy

Wound age estimation is one of the most challenging and indispensable issues for forensic pathologists. Although many methods based on physical findings and biochemical tests can be used to estimate wound age, an objective and reliable method for inferring the time interval after injury remains difficult. In the present study, endogenous metabolites of contused skeletal muscle were investigated to estimate the time interval after injury. Animal model of skeletal muscle injury was established using Sprague-Dawley rat, and the contused muscles were sampled at 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, and 48 h postcontusion (n = 9). Then, the samples were analysed using ultraperformance liquid chromatography coupled with high-resolution mass spectrometry. A total of 43 differential metabolites in contused muscle were determined by metabolomics method. They were applied to construct a two-level tandem prediction model for wound age estimation based on multilayer perceptron algorithm. As a result, all muscle samples were eventually divided into the following subgroups: 4, 8, 12, 16-20, 24-32, 36-40, and 44-48 h. The tandem model exhibited a robust performance and achieved a prediction accuracy of 92.6%, which was much higher than that of the single model. In summary, the multilayer perceptron-multilayer perceptron tandem machine-learning model based on metabolomics data can be used as a novel strategy for wound age estimation in future forensic casework.

Key Points

The changes of metabolite profile were correlated with the time interval after injury in contused skeletal muscle.A panel of 43 endogenous metabolites screened by ultraperformance liquid chromatography coupled with high-resolution mass spectrometry could distinguish the wound ages.The multilayer perceptron (MLP) algorithm exhibited a robust performance in wound age estimation using metabolites.The combination of matabolomics and MLP-MLP tandem model could improve the accuracy of inferring the time interval after injury.

Deep Learning in Medical Hyperspectral Images: A Review

With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.

Forensic applications of hyperspectral imaging technique: a narrative review

Hyperspectral imaging (HSI) collects and processes information from the entire electromagnetic spectrum to obtain the spectrum of each pixel in the image of a scene, with the aim of finding objects and identifying materials. It is a non-contact, non-destructive technology that can be used without modifying or altering the analysed target. Forensic analysis and crime scene investigations are two of the most investigated fields of application, being able to detect and analyse many types of evidence.In this paper we analysed the most commonly reported forensic science applications.The literature indicates that the fields in which HSI appears most promising are the analysis of blood traces, document forgery, gunshot residues and the identification of fingerprints.

Correction of Substrate Spectral Distortion in Hyper-Spectral Imaging by Neural Network for Blood Stain Characterization

In the recent past, hyper-spectral imaging has found widespread application in forensic science, performing both geometric characterization of biological traces and trace classification by exploiting their spectral emission. Methods proposed in the literature for blood stain analysis have been shown to be effectively limited to collaborative surfaces. This proves to be restrictive in real-case scenarios. The problem of the substrate material and color is then still an open issue for blood stain analysis. This paper presents a novel method for blood spectra correction when contaminated by the influence of the substrate, exploiting a neural network-based approach. Blood stains hyper-spectral images deposited on 12 different substrates for 12 days at regular intervals were acquired via a hyper-spectral camera. The data collected were used to train and test the developed neural network model. Starting from the spectra of a blood stain deposited in a generic substrate, the algorithm at first recognizes whether it is blood or not, then allows to obtain the spectra that the same blood stain, at the same time, would have on a reference white substrate with a mean absolute percentage error of 1.11%. Uncertainty analysis has also been performed by comparing the ground truth reflectance spectra with the predicted ones by the neural model.

Recent Advances in Multi- and Hyperspectral Image Analysis

Current advancements in sensor technology bring new possibilities in multi- and hyperspectral imaging. Real-life use cases which can benefit from such imagery span across various domains, including precision agriculture, chemistry, biology, medicine, land cover applications, management of natural resources, detecting natural disasters, and more. To extract value from such highly dimensional data capturing up to hundreds of spectral bands in the electromagnetic spectrum, researchers have been developing a range of image processing and machine learning analysis pipelines to process these kind of data as efficiently as possible. To this end, multi- or hyperspectral analysis has bloomed and has become an exciting research area which can enable the faster adoption of this technology in practice, also when such algorithms are deployed in hardware-constrained and extreme execution environments; e.g., on-board imaging satellites.

Hyperspectral Imaging for Bloodstain Identification

Blood is key evidence to reconstruct crime scenes in forensic sciences. Blood identification can help to confirm a suspect, and for that reason, several chemical methods are used to reconstruct the crime scene however, these methods can affect subsequent DNA analysis. Therefore, this study presents a non-destructive method for bloodstain identification using Hyperspectral Imaging (HSI, 397-1000 nm range). The proposed method is based on the visualization of heme-components bands in the 500-700 nm spectral range. For experimental and validation purposes, a total of 225 blood (different donors) and non-blood (protein-based ketchup, rust acrylic paint, red acrylic paint, brown acrylic paint, red nail polish, rust nail polish, fake blood, and red ink) samples (HSI cubes, each cube is of size 1000 × 512 × 224, in which 1000 × 512 are the spatial dimensions and 224 spectral bands) were deposited on three substrates (white cotton fabric, white tile, and PVC wall sheet). The samples are imaged for up to three days to include aging. Savitzky Golay filtering has been used to highlight the subtle bands of all samples, particularly the aged ones. Based on the derivative spectrum, important spectral bands were selected to train five different classifiers (SVM, ANN, KNN, Random Forest, and Decision Tree). The comparative analysis reveals that the proposed method outperformed several state-of-the-art methods.

Adaptive Detection of Direct-Sequence Spread-Spectrum Signals Based on Knowledge-Enhanced Compressive Measurements and Artificial Neural Networks

The direct-sequence spread-spectrum (DSSS) technique has been widely used in wireless secure communications. In this technique, the baseband signal is spread over a wider bandwidth using pseudo-random sequences to avoid interference or interception. In this paper, the authors propose methods to adaptively detect the DSSS signals based on knowledge-enhanced compressive measurements and artificial neural networks. Compared with the conventional non-compressive detection system, the compressive detection framework can achieve a reasonable balance between detection performance and sampling hardware cost. In contrast to the existing compressive sampling techniques, the proposed methods are shown to enable adaptive measurement kernel design with high efficiency. Through the theoretical analysis and the simulation results, the proposed adaptive compressive detection methods are also demonstrated to provide significantly enhanced detection performance efficiently, compared to their counterpart with the conventional random measurement kernels.

Deep Learning for Biospectroscopy and Biospectral Imaging: State-of-the-Art and Perspectives

With the advances in instrumentation and sampling techniques, there is an explosive growth of data from molecular and cellular samples. The call to extract more information from the large data sets has greatly challenged the conventional chemometrics method. Deep learning, which utilizes very large data sets for finding hidden features therein and for making accurate predictions for a wide range of applications, has been applied in an unbelievable pace in biospectroscopy and biospectral imaging in the recent 3 years. In this Feature, we first introduce the background and basic knowledge of deep learning. We then focus on the emerging applications of deep learning in the data preprocessing, feature detection, and modeling of the biological samples for spectral analysis and spectroscopic imaging. Finally, we highlight the challenges and limitations in deep learning and the outlook for future directions.

A dataset for evaluating blood detection in hyperspectral images

The sensitivity of imaging spectroscopy to haemoglobin derivatives makes it a promising tool for detecting blood. However, due to complexity and high dimensionality of hyperspectral images, the development of hyperspectral blood detection algorithms is challenging. To facilitate their development, we present a new hyperspectral blood detection dataset. This dataset, published under an open access license, consists of multiple detection scenarios with varying levels of complexity. It allows to test the performance of Machine Learning methods in relation to different acquisition environments, types of background, age of blood and presence of other blood-like substances. We have explored the dataset with blood detection experiments, for which we have used a hyperspectral target detection algorithm based on the well-known Matched Filter detector. Our results and their discussion highlight the challenges of blood detection in hyperspectral data and form a reference for further works.