Comparison of Soil Total Nitrogen Content Prediction Models Based on Vis-NIR Spectroscopy

Research on the Effects of Drying Temperature for the Detection of Soil Nitrogen by Near-Infrared Spectroscopy

Nitrogen nitrates play a significant role in the soil's nutrient cycle, and near-infrared spectroscopy can efficiently and accurately detect the content of nitrate-nitrogen in the soil. Accordingly, it can provide a scientific basis for soil improvement and agricultural productivity by deeply examining the cycle and transformation pattern of nutrients in the soil. To investigate the impact of drying temperature on NIR soil nitrogen detection, soil samples with different N concentrations were dried at temperatures of 50 °C, 65 °C, 80 °C, and 95 °C, respectively. Additionally, soil samples naturally air-dried at room temperature (25 °C) were used as a control group. Different drying times were modified based on the drying temperature to completely eliminate the impact of moisture. Following data collection with an NIR spectrometer, the best preprocessing method was chosen to handle the raw data. Based on the feature bands chosen by the RFFS, CARS, and SPA methods, two linear models, PLSR and SVM, and a nonlinear ANN model were then established for analysis and comparison. It was found that the drying temperature had a great effect on the detection of soil nitrogen by near-infrared spectroscopy. In the meantime, the SPA-ANN model simultaneously yielded the best and most stable accuracy, with Rc2 = 0.998, Rp2 = 0.989, RMSEC = 0.178 g/kg, and RMSEP = 0.257 g/kg. The results showed that NIR spectroscopy had the least effect and the highest accuracy in detecting nitrogen at 80 °C soil drying temperature. This work provides a theoretical foundation for agricultural production in the future.

Vis-NIR Spectroscopy Combined with GAN Data Augmentation for Predicting Soil Nutrients in Degraded Alpine Meadows on the Qinghai-Tibet Plateau

Soil nutrients play vital roles in vegetation growth and are a key indicator of land degradation. Accurate, rapid, and non-destructive measurement of the soil nutrient content is important for ecological conservation, degradation monitoring, and precision farming. Currently, visible and near-infrared (Vis-NIR) spectroscopy allows for rapid and non-destructive monitoring of soil nutrients. However, the performance of Vis-NIR inversion models is extremely dependent on the number of samples. Limited samples may lead to low prediction accuracy of the models. Therefore, modeling and prediction based on a small sample size remain a challenge. This study proposes a method for the simultaneous augmentation of soil spectral and nutrient data (total nitrogen (TN), soil organic matter (SOM), total potassium oxide (TK₂O), and total phosphorus pentoxide (TP₂O₅)) using a generative adversarial network (GAN). The sample augmentation range and the level of accuracy improvement were also analyzed. First, 42 soil samples were collected from the pika disturbance area on the QTP. The collected soils were measured in the laboratory for Vis-NIR and TN, SOM, TK₂O, and TP₂O₅ data. A GAN was then used to augment the soil spectral and nutrient data simultaneously. Finally, the effect of adding different numbers of generative samples to the training set on the predictive performance of a convolutional neural network (CNN) was analyzed and compared with another data augmentation method (extended multiplicative signal augmentation, EMSA). The results showed that a GAN can generate data very similar to real data and with better diversity. A total of 15, 30, 60, 120, and 240 generative samples (GAN and EMSA) were randomly selected from 300 generative samples to be included in the real data to train the CNN model. The model performance first improved and then deteriorated, and the GAN was more effective than EMSA. Further shortening the interval for adding GAN data revealed that the optimal ranges were 30-40, 50-60, 30-35, and 25-35 for TK₂O, TN, TP₂O₅, and SOM, respectively, and the validation set accuracy was maximized in these ranges. Therefore, the above method can compensate to some extent for insufficient samples in the hyperspectral prediction of soil nutrients, and can quickly and accurately estimate the content of soil TK₂O, TN, TP₂O₅, and SOM.

Detection of Plastic Granules and Their Mixtures

Chemically pure plastic granulate is used as the starting material in the production of plastic parts. Extrusion machines rely on purity, otherwise resources are lost, and waste is produced. To avoid losses, the machines need to analyze the raw material. Spectroscopy in the visible and near-infrared range and machine learning can be used as analyzers. We present an approach using two spectrometers with a spectral range of 400-1700 nm and a fusion model comprising classification, regression, and validation to detect 25 materials and proportions of their binary mixtures. one dimensional convolutional neural network is used for classification and partial least squares regression for the estimation of proportions. The classification is validated by reconstructing the sample spectrum using the component spectra in linear least squares fitting. To save time and effort, the fusion model is trained on semi-empirical spectral data. The component spectra are acquired empirically and the binary mixture spectra are computed as linear combinations. The fusion model achieves very a high accuracy on visible and near-infrared spectral data. Even in a smaller spectral range from 400-1100 nm, the accuracy is high. The visible and near-infrared spectroscopy and the presented fusion model can be used as a concept for building an analyzer. Inexpensive silicon sensor-based spectrometers can be used.

A Review of Machine Learning for Near-Infrared Spectroscopy

The analysis of infrared spectroscopy of substances is a non-invasive measurement technique that can be used in analytics. Although the main objective of this study is to provide a review of machine learning (ML) algorithms that have been reported for analyzing near-infrared (NIR) spectroscopy from traditional machine learning methods to deep network architectures, we also provide different NIR measurement modes, instruments, signal preprocessing methods, etc. Firstly, four different measurement modes available in NIR are reviewed, different types of NIR instruments are compared, and a summary of NIR data analysis methods is provided. Secondly, the public NIR spectroscopy datasets are briefly discussed, with links provided. Thirdly, the widely used data preprocessing and feature selection algorithms that have been reported for NIR spectroscopy are presented. Then, the majority of the traditional machine learning methods and deep network architectures that are commonly employed are covered. Finally, we conclude that developing the integration of a variety of machine learning algorithms in an efficient and lightweight manner is a significant future research direction.

Machine Learning Strategy for Soil Nutrients Prediction Using Spectroscopic Method

The research presented in this paper is based on the hypothesis that the machine learning approach improves the accuracy of soil properties prediction. The correlations obtained in this research are important for understanding the overall strategy for soil properties prediction using optical spectroscopy sensors. Several research results have been stated and investigated. A comparison is made between six commonly used techniques: Random Forest, Decision Tree, Naïve Bayes, Support Vector Machine, Least-Square Support Vector Machine and Artificial Neural Network, showing that the best prediction accuracy cannot always be achieved by the most common and complicated method. The influence of the chosen category for nutrient characterization was investigated, indicating better prediction when a multi-component strategy was used. In contrast, the prediction of single-component soil properties was less accurate. In addition, the influence of category levels was not as significant as expected when choosing between 3-level, 5-level or 13-level nutrient characterization for some nutrients, which can be used for a more precise nutrient characterization strategy. A comparative analysis was performed between soil from a local farm with similar texture and soils collected from different locations in Slovenia, which gave a better prediction for a local farm. Finally, the influence of principal component analysis was validated using 5, 10, 20 and 50 first principal components, indicating the better performance of machine learning when using the 50 principal components.