Real-Time Classification of Multivariate Olfaction Data Using Spiking Neural Networks

Narrative review on artificially intelligent olfaction in halitosis

Halitosis, commonly known as oral malodor, is a multifactorial health concern that significantly impacts the psychological and social well-being of individuals. It is the third most frequent reason for individuals to seek dental treatment, after dental caries and periodontal diseases. For an in-depth exploration of the topic of halitosis, an extensive literature review was conducted. The review focused on articles published in peer-reviewed journals and only those written in the English language were considered. The search for relevant literature began by employing subject headings such as 'halitosis, oral malodor, volatile sulfur compounds, artificial intelligence, and olfaction' in databases such as PubMed/Medline, Scopus, Google Scholar, Web of Science, and EMBASE. Additionally, a thorough hand search of references was conducted to ensure the comprehensiveness of the review. After amalgamating the search outcomes, a comprehensive analysis revealed the existence of precisely 134 full-text articles that bore relevance to the study. Abstracts and editorial letters were excluded from this study, and almost 50% of the full-text articles were deemed immaterial to dental practice. Out of the remaining articles, precisely 54 full-text articles were employed in this review. As primary healthcare providers, dentists are responsible for diagnosing and treating oral issues that may contribute to the development of halitosis. To effectively manage this condition, dentists must educate their patients about the underlying causes of halitosis, as well as proper oral hygiene practices such as tongue cleaning, flossing, and selecting appropriate mouthwash and toothpaste. This narrative review summarises all possible AI olfaction in halitosis.

Application of Neuromorphic Olfactory Approach for High-Accuracy Classification of Malts

Current developments in artificial olfactory systems, also known as electronic nose (e-nose) systems, have benefited from advanced machine learning techniques that have significantly improved the conditioning and processing of multivariate feature-rich sensor data. These advancements are complemented by the application of bioinspired algorithms and architectures based on findings from neurophysiological studies focusing on the biological olfactory pathway. The application of spiking neural networks (SNNs), and concepts from neuromorphic engineering in general, are one of the key factors that has led to the design and development of efficient bioinspired e-nose systems. However, only a limited number of studies have focused on deploying these models on a natively event-driven hardware platform that exploits the benefits of neuromorphic implementation, such as ultra-low-power consumption and real-time processing, for simplified integration in a portable e-nose system. In this paper, we extend our previously reported neuromorphic encoding and classification approach to a real-world dataset that consists of sensor responses from a commercial e-nose system when exposed to eight different types of malts. We show that the proposed SNN-based classifier was able to deliver 97% accurate classification results at a maximum latency of 0.4 ms per inference with a power consumption of less than 1 mW when deployed on neuromorphic hardware. One of the key advantages of the proposed neuromorphic architecture is that the entire functionality, including pre-processing, event encoding, and classification, can be mapped on the neuromorphic system-on-a-chip (NSoC) to develop power-efficient and highly-accurate real-time e-nose systems.

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms

In recent times, the usage of modern neuromorphic hardware for brain-inspired SNNs has grown exponentially. In the context of sparse input data, they are undertaking low power consumption for event-based neuromorphic hardware, specifically in the deeper layers. However, using deep ANNs for training spiking models is still considered as a tedious task. Until recently, various ANN to SNN conversion methods in the literature have been proposed to train deep SNN models. Nevertheless, these methods require hundreds to thousands of time-steps for training and still cannot attain good SNN performance. This work proposes a customized model (VGG, ResNet) architecture to train deep convolutional spiking neural networks. In this current study, the training is carried out using deep convolutional spiking neural networks with surrogate gradient descent backpropagation in a customized layer architecture similar to deep artificial neural networks. Moreover, this work also proposes fewer time-steps for training SNNs with surrogate gradient descent. During the training with surrogate gradient descent backpropagation, overfitting problems have been encountered. To overcome these problems, this work refines the SNN based dropout technique with surrogate gradient descent. The proposed customized SNN models achieve good classification results on both private and public datasets. In this work, several experiments have been carried out on an embedded platform (NVIDIA JETSON TX2 board), where the deployment of customized SNN models has been extensively conducted. Performance validations have been carried out in terms of processing time and inference accuracy between PC and embedded platforms, showing that the proposed customized models and training techniques are feasible for achieving a better performance on various datasets such as CIFAR-10, MNIST, SVHN, and private KITTI and Korean License plate dataset.

Optical Axons for Electro-Optical Neural Networks

Recently, neuromorphic sensors, which convert analogue signals to spiking frequencies, have ‎been reported for neurorobotics. In bio-inspired systems these sensors are connected to the main neural unit to perform ‎post-processing of the sensor data. The performance of spiking neural networks has been ‎improved using optical synapses, which offer parallel communications between the distanced ‎neural areas but are sensitive to the intensity variations of the optical signal. For systems with ‎several neuromorphic sensors, which are connected optically to the main unit, the use of ‎optical synapses is not an advantage. To address this, in this paper we propose and ‎experimentally verify optical axons with synapses activated optically using digital signals. The ‎synaptic weights are encoded by the energy of the stimuli, which are then optically transmitted ‎independently. We show that the optical intensity fluctuations and link's misalignment result ‎in delay in activation of the synapses. For the proposed optical axon, we have demonstrated line of ‎sight transmission over a maximum link length of 190 cm with a delay of 8 μs. Furthermore, we ‎show the axon delay as a function of the illuminance using a fitted model for which the root mean square error (RMS) ‎similarity is 0.95.

Application of a Brain-Inspired Spiking Neural Network Architecture to Odor Data Classification

Existing methods in neuromorphic olfaction mainly focus on implementing the data transformation based on the neurobiological architecture of the olfactory pathway. While the transformation is pivotal for the sparse spike-based representation of odor data, classification techniques based on the bio-computations of the higher brain areas, which process the spiking data for identification of odor, remain largely unexplored. This paper argues that brain-inspired spiking neural networks constitute a promising approach for the next generation of machine intelligence for odor data processing. Inspired by principles of brain information processing, here we propose the first spiking neural network method and associated deep machine learning system for classification of odor data. The paper demonstrates that the proposed approach has several advantages when compared to the current state-of-the-art methods. Based on results obtained using a benchmark dataset, the model achieved a high classification accuracy for a large number of odors and has the capacity for incremental learning on new data. The paper explores different spike encoding algorithms and finds that the most suitable for the task is the step-wise encoding function. Further directions in the brain-inspired study of odor machine classification include investigation of more biologically plausible algorithms for mapping, learning, and interpretation of odor data along with the realization of these algorithms on some highly parallel and low power consuming neuromorphic hardware devices for real-world applications.

Visual Analysis of Odor Interaction Based on Support Vector Regression Method

The complex odor interaction between odorants makes it difficult to predict the odor intensity of their mixtures. The analysis method is currently one of the factors limiting our understanding of the odor interaction laws. We used a support vector regression algorithm to establish odor intensity prediction models for binary esters, aldehydes, and aromatic hydrocarbon mixtures, respectively. The prediction accuracy to both training samples and test samples demonstrated the high prediction capacity of the support vector regression model. Then the optimized model was used to generate extra odor data by predicting the odor intensity of more simulated samples with various mixing ratios and concentration levels. Based on these olfactory measured and model predicted data, the odor interaction was analyzed in the form of contour maps. This intuitive method showed more details about the odor interaction pattern in the binary mixture. We found that that the antagonism effect was commonly observed in these binary mixtures and the interaction degree was more intense when the components’ mixing ratio was close. Meanwhile, the odor intensity level of the odor mixture barely influenced the interaction degree. The machine learning algorithms were considered promising tools in odor researches.

A Hardware-Deployable Neuromorphic Solution for Encoding and Classification of Electronic Nose Data

In several application domains, electronic nose systems employing conventional data processing approaches incur substantial power and computational costs and limitations, such as significant latency and poor accuracy for classification. Recent developments in spike-based bio-inspired approaches have delivered solutions for the highly accurate classification of multivariate sensor data with minimized computational and power requirements. Although these methods have addressed issues related to efficient data processing and classification accuracy, other areas, such as reducing the processing latency to support real-time application and deploying spike-based solutions on supported hardware, have yet to be studied in detail. Through this investigation, we proposed a spiking neural network (SNN)-based classifier, implemented in a chip-emulation-based development environment, that can be seamlessly deployed on a neuromorphic system-on-a-chip (NSoC). Under three different scenarios of increasing complexity, the SNN was determined to be able to classify real-valued sensor data with greater than 90% accuracy and with a maximum latency of 3 s on the software-based platform. Highlights of this work included the design and implementation of a novel encoder for artificial olfactory systems, implementation of unsupervised spike-timing-dependent plasticity (STDP) for learning, and a foundational study on early classification capability using the SNN-based classifier.