On-line multi-gas component measurement in the mud logging process based on Raman spectroscopy combined with a CNN-LSTM-AM hybrid model

A new method for the rapid identification of external water types in rainwater pipeline networks using UV-Vis absorption spectroscopy

Ultraviolet-visible (UV-Vis) absorption spectroscopy, due to its high sensitivity and capability for real-time online monitoring, is one of the most promising tools for the rapid identification of external water in rainwater pipe networks. However, difficulties in obtaining actual samples lead to insufficient real samples, and the complex composition of wastewater can affect the accurate traceability analysis of external water in rainwater pipe networks. In this study, a new method for identifying external water in rainwater pipe networks with a small number of samples is proposed. In this method, the Generative Adversarial Network (GAN) algorithm was initially used to generate spectral data from the absorption spectra of water samples; subsequently, the multiplicative scatter correction (MSC) algorithm was applied to process the UV-Vis absorption spectra of different types of water samples; following this, the Variational Mode Decomposition (VMD) algorithm was employed to decompose and recombine the spectra after MSC; and finally, the long short-term memory (LSTM) algorithm was used to establish the identification model between the recombined spectra and the water source types, and to determine the optimal number of decomposed spectra K. The research results show that when the number of decomposed spectra K is 5, the identification accuracy for different sources of domestic sewage, surface water, and industrial wastewater is the highest, with an overall accuracy of 98.81%. Additionally, the performance of this method was validated by mixed water samples (combinations of rainwater and domestic sewage, rainwater and surface water, and rainwater and industrial wastewater). The results indicate that the accuracy of the proposed method in identifying the source of external water in rainwater reaches 98.99%, with detection time within 10 s. Therefore, the proposed method can become a potential approach for rapid identification and traceability analysis of external water in rainwater pipe networks.

Multi-gas pollutant detection based on sparrow search algorithm optimized ALSTM-FCN

It is critical to identify and detect hazardous, flammable, explosive, and poisonous gases in the realms of industrial production and medical diagnostics. To detect and categorize a range of common hazardous gasses, we propose an attention-based Long Short term memory Full Convolutional network (ALSTM-FCN) in this paper. We adjust the network parameters of ALSTM-FCN using the Sparrow search algorithm (SSA) based on this, by comparison, SSA outperforms Particle Swarm Optimization (PSO) Algorithm, Genetic Algorithm (GA), Gray Wolf Optimization (GWO) Algorithm, Cuckoo Search (CS) Algorithm and other traditional optimization algorithms. We evaluate the model using University of California-Irvine (UCI) datasets and compare it with LSTM and FCN. The findings indicate that the ALSTM-FCN hybrid model has a better reliability test accuracy of 99.461% than both LSTM (89.471%) and FCN (96.083%). Furthermore, AdaBoost, logistic regression (LR), extra tree (ET), decision tree (DT), random forest (RF), K-nearest neighbor (KNN) and other models were trained. The suggested approach outperforms the conventional machine learning model in terms of gas categorization accuracy, according to experimental data. The findings indicate a potential for a broad range of polluting gas detection using the suggested ALSTM-FCN model, which is based on SSA optimization.

High-Sensitivity and In Situ Multi-Component Detection of Gases Based on Multiple-Reflection-Cavity-Enhanced Raman Spectroscopy

Raman spectroscopy with the advantages of the in situ and simultaneous detection of multi-components has been widely used in the identification and quantitative detection of gas. As a type of scattering spectroscopy, the detection sensitivity of Raman spectroscopy is relatively lower, mainly due to the low signal collection efficiency. This paper presents the design and assembly of a multi-channel cavity-enhanced Raman spectroscopy system, optimizing the structure of the sample pool to reduce the loss of the laser and increase the excitation intensity of the Raman signals. Moreover, three channels are used to collect Raman signals to increase the signal collection efficiency for improving the detection sensitivity. The results showed that the limits of detection for the CH4, H2, CO2, O2, and N2 gases were calculated to be 3.1, 34.9, 17.9, 27, and 35.2 ppm, respectively. The established calibration curves showed that the correlation coefficients were all greater than 0.999, indicating an excellent linear correlation and high level of reliability. Meanwhile, under long-time integration detection, the Raman signals of CH4, H2, and CO2 could be clearly distinguished at the concentrations of 10, 10, and 50 ppm, respectively. The results indicated that the designed Raman system possesses broad application prospects in complex field environments.

13CH4/12CH4 sensing using Raman spectroscopy

The paper presents a technique for measuring the concentration of 13CH4 in natural methane using Raman spectroscopy. The peak positions and the relative scattering cross-sections of the Q-branches for the most intense vibrational bands of 13CH4 are determined. Features of the 13CH4/12CH4 ratio measurement methods using Q-branches of the ν1 and ν3 bands were considered. It was shown that the 13CH4/12CH4 ratio can be determined by simulation of the ν3 bands of these molecules without the use of experimental spectra. In our experiments the measurement error of δ13C value was 10 ‰ using the 100-s exposure spectrum at a gas pressure close to 1 atm recorded on the developed Raman spectrometer. In addition, the Raman spectra of alkanes (up to n-hexane) in the range of 2850-3050 cm-1 at a resolution of 0.4 cm-1 are presented, and their integrated intensities in the ranges of the characteristic bands of 13CH4 and 12CH4 are provided. The data obtained make it possible to expand the capabilities of Raman gas analyzers in the mud gas logging industry.

Spectral encoder to extract the efficient features of Raman spectra for reliable and precise quantitative analysis

Raman spectroscopy has become a powerful analytical tool highly demanded in many applications such as microorganism sample analysis, food quality control, environmental science, and pharmaceutical analysis, owing to its non-invasiveness, simplicity, rapidity and ease of use. Among them, quantitative research using Raman spectroscopy is a crucial application field of spectral analysis. However, the entire process of quantitative modeling largely relies on the extraction of effective spectral features, particularly for measurements on complex samples or in environments with poor spectral signal quality. In this paper, we propose a method of utilizing a spectral encoder to extract effective spectral features, which can significantly enhance the reliability and precision of quantitative analysis. We built a latent encoded feature regression model; in the process of utilizing the autoencoder for reconstructing the spectrometer output, the latent feature obtained from the intermediate bottleneck layer is extracted. Then, these latent features are fed into a deep regression model for component concentration prediction. Through detailed ablation and comparative experiments, our proposed model demonstrates superior performance to common methods on single-component and multi-component mixture datasets, remarkably improving regression precision while without needing user-selected parameters and eliminating the interference of irrelevant and redundant information. Furthermore, in-depth analysis reveals that latent encoded feature possesses strong nonlinear feature representation capabilities, low computational costs, wide adaptability, and robustness against noise interference. This highlights its effectiveness in spectral regression tasks and indicates its potential in other application fields. Sufficient experimental results show that our proposed method provides a novel and effective feature extraction approach for spectral analysis, which is simple, suitable for various methods, and can meet the measurement needs of different real-world scenarios.

Qualitative and quantitative studies of phthalates in extra virgin olive oil (EVOO) by surface-enhanced Raman spectroscopy (SERS) combined with long short term memory (LSTM) neural network

Phthalates are commonly used plasticizers in the plastics industry, and have received extensive attention due to their reproductive toxicity. Since phthalates are lipophilic solutions, phthalates can easily migrate from packaging to edible oils. This study synthesized stable and sensitive Gold Nanostars as SERS substrates to conduct qualitative and quantitative analysis of two common phthalates, dibutyl phthalate and di(2-ethylhexyl) phthalate. Two ethanol standard solutions and actual oil solutions of phthalates at different concentrations (10, 5, 1, 0.5, 0.1, 0.02 mg/kg) were prepared. After dimension reduction, LSTM achieved the accuracy of 98% for pure EVOO and EVOO adulterated with different types of phthalates. In terms of quantification, LSTM demonstrates great predictive performance with Rp2 greater than 0.97 and the ratio of performance to deviation greater than 5. These results have certain guiding significance for the analysis of plasticizers in edible oil.

Classification and rapid non-destructive quality evaluation of different processed products of Cyperus rotundus based on near-infrared spectroscopy combined with deep learning

The quality of traditional Chinese medicine is very important for human health, but the traditional quality control method is very tedious, which leads to the substandard quality of many traditional Chinese medicine. In order to solve the problem of time-consuming and laborious traditional quality control methods, this study takes traditional Chinese medicine Cyperus rotundus as an example, a comprehensive strategy of near-infrared (NIR) spectroscopy combined with One-dimensional convolutional neural network (1D-CNN) and chaotic map dung beetle optimization (CDBO) algorithm combined with BP neural network (BPNN) is proposed. This strategy has the advantages of fast and non-destructive. It can not only qualitatively distinguish Cyperus rotundus and various processed products, but also quantitatively predict two bioactive components. In classification, 1D-CNN successfully distinguished four kinds of processed products of Cyperus rotundus with 100 % accuracy. Quantitatively, a CDBO algorithm is proposed to optimize the performance of the BPNN quantitative model of two terpenoids, and compared with the BP, whale optimization algorithm (WOA)-BP, sparrow optimization algorithm (SSA)-BP, grey wolf optimization (GWO)-BP and particle swarm optimization (PSO)-BP models. The results show that the CDBO-BPNN model has the smallest error and has a significant advantage in predicting the content of active components in different processed products. To sum up, it is feasible to use near infrared spectroscopy to quickly evaluate the effect of processing methods on the quality of Cyperus rotundus, which provides a meaningful reference for the quality control of traditional Chinese medicine with many other processing methods.

Rapid quantitative analysis of Rongalite adulteration in rice flour using autoencoder and residual-based model associated with portable Raman spectroscopy

Rice flour is a raw material for various foods and is used as a substitute for wheat flour. However, some merchants adulterate rice flour with the illegal additive Rongalite to extend the shelf life and earn illegal profits. Rongalite is highly carcinogenic, and ingestion of more than 10 g can even cause death. high-performance liquid chromatography (HPLC) and mass spectrometry (MS) are currently the main methods for detecting food adulteration, however, the existing methods have many limitations, complex operation, expensive instrumentation, etc. Raman spectroscopy has the advantages of convenience and non-destructive samples, but Raman spectroscopy can be affected by interference such as fluorescence background that affects detection, in addition to the problem of difficult quantitative analysis due to nonlinear bias. In this article, we used the preprocessing method of Savitzky-Golay smoothing filtering and VTPspline to improve the quality of the spectra and proposed the SARNet, which combines autoencoder and residual network to achieve the quantitative analysis of Rongalite content in rice flour. The new model combines a linear model with a nonlinear model, which can solve the nonlinear problem effectively. Experiments showed that the new SARNet model achieved state-of-the-art results, achieving the best R2 of 0.9703 and RMSEP of 0.0075. The lowest Rongalite concentration detected by the portable Raman spectrometer was 0.49%. In summary, the proposed method using portable Raman spectroscopy combined with machine learning has low detection bias and high accuracy, which can realize quantitative analyses of adulterated Rongalite in rice flour quickly. The method provides an accurate and nondestructive analytical tool in the field of food detection.

Deep metric learning framework combined with Gramian angular difference field image generation for Raman spectra classification based on a handheld Raman spectrometer

Rapid identification of unknown material samples using portable or handheld Raman spectroscopy detection equipment is becoming a common analytical tool. However, the design and implementation of a set of Raman spectroscopy-based devices for substance identification must include spectral sampling of standard reference substance samples, resolution matching between different devices, and the training process of the corresponding classification models. The process of selecting a suitable classification model is frequently time-consuming, and when the number of classes of substances to be recognised increases dramatically, recognition accuracy decreases dramatically. In this paper, we propose a fast classification method for Raman spectra based on deep metric learning networks combined with the Gramian angular difference field (GADF) image generation approach. First, we uniformly convert Raman spectra acquired at different resolutions into GADF images of the same resolution, addressing spectral dimension disparities induced by resolution differences in different Raman spectroscopy detection devices. Second, a network capable of implementing nonlinear distance measurements between GADF images of different classes of substances is designed based on a deep metric learning approach. The Raman spectra of 450 different mineral classes obtained from the RRUFF database were converted into GADF images and used to train this deep metric learning network. Finally, the trained network can be installed on an embedded computing platform and used in conjunction with portable or handheld Raman spectroscopic detection sensors to perform material identification tasks at various scales. A series of experiments demonstrate that our trained deep metric learning network outperforms existing mainstream machine learning models on classification tasks of different sizes. For the two tasks of Raman spectral classification of natural minerals of 260 classes and Raman spectral classification of pathogenic bacteria of 8 classes with significant noise, our suggested model achieved 98.05% and 90.13% classification accuracy, respectively. Finally, we also deployed the model in a handheld Raman spectrometer and conducted identification experiments on 350 samples of chemical substances attributed to 32 classes, achieving a classification accuracy of 99.14%. These results demonstrate that our method can greatly improve the efficiency of developing Raman spectroscopy-based substance detection devices and can be widely used in tasks of unknown substance identification.

Online detection of concentrate grade in the antimony flotation process based on in situ Raman spectroscopy combined with a CNN-GRU hybrid model

Froth flotation is the most critical process for separating stibnite from raw ore. Concentrate grade is a vital production indicator in the antimony flotation process. It is a direct reflection of the product quality of the flotation process and an essential basis for the dynamic adjustment of its operating parameters. Existing methods of measuring concentrate grades suffer from expensive measurement equipment, difficult maintenance of complex sampling systems, and extended testing times. This paper presents a nondestructive and fast methodology to quantify the concentrate grade in the antimony flotation process based on in situ Raman spectroscopy. A particular Raman spectroscopic measuring system is designed for on-line measurement of the Raman spectra of the mixed minerals from the froth layer during the antimony flotation process. To obtain representative Raman spectra that better characterize the concentrate grades, a traditional Raman spectroscopic system has been redesigned to account for the different interferences during actual flotation field acquisition. A one-dimensional convolutional neural network (1D-CNN) is combined with a gated recurrent unit (GRU) and applied to construct a model for online prediction of concentrate grades based on continuously collected Raman spectra of mixed minerals in the froth layer. With an average prediction error of 4.37% and a maximum prediction deviation of 10.56%, the quantitative analysis of concentrate grade by the model demonstrates that our method is distinguished by high accuracy, low deviation, and in situ analysis, and it essentially satisfies the requirements for online quantitative determination of concentrate grade in the antimony flotation site.