Progress and Applications of Multivariate Calibration Model Transfer Methods

Deployment strategy of multiple miniaturized near-infrared spectrometers based on spectral transfer for characterizing soil organic matter and nitrogen

Developing timely, convenient, and low-cost methods for high-frequency characterization of soil nutrients is necessary for implementing precise soil nutrient management. With the current availability of numerous calibration models of laboratory benchtop near-infrared (NIR) spectrometers for rapid soil nutrient characterization and the appearance of low-cost, convenient miniaturized NIR spectrometers, this study proposes an efficient deployment strategy to address model failure due to inter-device variation based on spectral transfer. The strategy involves using Direct Standardization (DS) to migrate the spectra from multiple miniaturized NIR spectrometers with a laboratory benchtop NIR spectrometer and then directly applying the existing calibration models of the laboratory benchtop instrument to the transferred spectra for soil nutrient analysis. The results indicated that the DS method successfully transferred the spectra of miniaturized devices to be consistent with the spectra of the laboratory benchtop instrument. The soil organic matter (SOM) predictions using the transferred spectra and the calibration models of the laboratory benchtop instrument were even more accurate than those using the respective models developed for each miniaturized devices, with root mean square error (RMSE) of 0.177 %, 0.177 %, and 0.150 %, respectively, while the performances of total nitrogen (TN) predictions were comparable to those using the respective models, with RMSE of 0.013 %, 0.012 %, and 0.010 %, respectively. Bland-Altman plots demonstrated good consistency between the strategy proposed in this study and the strategy of developing respective models for each miniaturized device, with no difference in predictions for the independent validation set compared to the laboratory benchtop instrument. This study proved the feasibility of deployment strategy of multiple miniaturized NIR spectrometers based on spectral transfer, offering a new solution for high-frequency on-site soil nutrient characterization.

Quantitative analysis of the illegal addition of Atenolol in Panax notoginseng based on NIR-MIR spectral data fusion and calibration transfer

To address the issue of the common illegal addition of Atenolol in Panax notoginseng, we propose an approach that realizes multivariate calibration transfer between different particle sizes based on near-infrared (NIR) and mid-infrared (MIR) spectral data fusion. To achieve high prediction accuracy, we construct three data fusion schemes (full-spectrum fusion, feature-level fusion, and decision-level fusion) that combine NIR and MIR spectral data. Among three data fusion schemes, the feature-level fusion based on the UVE-SPA-PLS model for 120-mesh spectral data achieves optimal prediction accuracy. Here, a Piecewise Direct Standardization (PDS) algorithm has been applied to calibration transfer from 100-mesh and 80-mesh to 120-mesh to reduce the influence of particle size and improve the robustness of the model. The correlation coefficient (R2) of 100-mesh, and 80-mesh prediction sets can reach 0.9861 and 0.9823, respectively. The corresponding root mean square error (RMSE) are 0.1545 and 0.2045, respectively. This research provides a method for illegal additions in precious herbs and reduces the effect of particle size on spectral modeling, enabling high-precision quantitative detection. In addition, it has important application prospects in reducing experimental losses of precious medicinal materials and ensuring the safe use of Chinese and Western medicines, which provides an alternative method for non-destructive testing.

Rapid Detection of Total Viable Count in Intact Beef Dishes Based on NIR Hyperspectral Hybrid Model

The total viable count (TVC) of bacteria is an important index to evaluate the freshness and safety of dishes. To improve the accuracy and robustness of spectroscopic detection of total viable bacteria count in a complex system, a new method based on a near-infrared (NIR) hyperspectral hybrid model and Support Vector Machine (SVM) algorithms was developed to directly determine the total viable count in intact beef dish samples in this study. Diffuse reflectance data of intact and crushed samples were tested by NIR hyperspectral and processed using Multiplicative Scattering Correction (MSC) and Competitive Adaptive Reweighted Sampling (CARS). Kennard-Stone (KS) and Samples Set Partitioning Based on Joint X-Y Distance (SPXY) algorithms were used to select the optimal number of standard samples transferred by the model combined with root mean square error. The crushed samples were transferred into the complete samples prediction model through the Direct Standardization (DS) algorithm. The spectral hybrid model of crushed samples and full samples was established. The results showed that the Determination Coefficient of Calibration (RP2) value of the total samples prediction set increased from 0.5088 to 0.8068, and the value of the Root Mean Square Error of Prediction (RMSEP) decreased from 0.2454 to 0.1691 log10 CFU/g. After establishing the hybrid model, the RMSEP value decreased by 9.23% more than before, and the values of Relative Percent Deviation (RPD) and Reaction Error Relation (RER) increased by 12.12% and 10.09, respectively. The results of this study showed that TVC instewed beef samples can be non-destructively determined based on the DS model transfer method combined with the hybrid model strategy. This study provided a reference for solving the problem of poor accuracy and reliability of prediction models in heterogeneous samples.

Calibration model transfer in mid-infrared process analysis with in situ attenuated total reflectance immersion probes

Process applications of mid-infrared (MIR) spectrometry may involve replacement of the spectrometer and/or measurement probe, which generally requires a calibration transfer method to maintain the accuracy of analysis. In this study, direct standardisation (DS), piecewise direct standardisation (PDS) and spectral space transformation (SST) were compared for analysis of ternary mixtures of acetone, ethanol and ethyl acetate. Three calibration transfer examples were considered: changing the spectrometer, multiplexing two probes to a spectrometer, and changing the diameter of the attenuated total reflectance (ATR) probe (as might be required when scaling up from lab to process analysis). In each case, DS, PDS and SST improved the accuracy of prediction for the test samples, analysed on a secondary spectrometer-probe combination, using a calibration model developed on the primary system. When the probe diameter was changed, a scaling step was incorporated into SST to compensate for the change in absorbance caused by the difference in ATR crystal size. SST had some advantages over DS and PDS: DS was sensitive to the choice of standardisation samples, and PDS required optimisation of the window size parameter (which also required an extra standardisation sample). SST only required a single parameter to be chosen: the number of principal components, which can be set equal to the number of standardisation samples when a low number of standards (n < 7) are used, which is preferred to minimise the time required to transfer the calibration model.

Application of NIR Spectral Standardization Based on Principal Component Score Evaluation in Wheat Flour Crude Protein Model Sharing

In order to explore spectral standardization methods for spectra collected by different NIR spectrometers, to reduce spectral differences, and to realize model sharing among different instruments, the crude protein content of 154 wheat flour samples was measured using one grating and three Fabry-Perot tunable filter NIR spectrometers in wavelength. At the same wavelength range and wavelength interval, three algorithms, namely, direct standardization (DS), piecewise direct standardization (PDS), and simple linear regression direct standardization (SLRDS), were used to standardize spectra collected by different instruments from the same samples. Spectral standardization error rate (SSER), principal component score error rate (PCSER), and other indicators were employed to analyze the spectral differences between the master and the target spectra, and the effect of model sharing was evaluated using parameters including prediction correlation coefficient (Rp), root mean square error of prediction (RMSEP), and relative prediction deviation (RPD). The results show the following: (1) The difference between spectra can be quantitatively evaluated through analyzing SSER and PCSER. (2) After standardization by the three algorithms, the spectral difference between the three target and the master spectrometers is significantly reduced and the prediction effect of the master model is greatly improved. (3) Among the three algorithms, DS algorithm had the smallest error rate in standardizing spectra from three target spectrometers. After standardization by the DS algorithm, the master model had the best effect. Its prediction accuracy was greatly improved compared with that before standardization. (4) The standard model established based on the S450 spectrometer can be applied to the same spectrometer as the N500 spectrometer with the same resolution and different wavelength ranges, so as to achieve model sharing. Therefore, DS, PDS, and SLRDS algorithms can effectively reduce the spectral differences between different instruments and realize the sharing of NIR calibration models for wheat flour crude protein measurement.

Algorithm of Stability-Analysis-Based Feature Selection for NIR Calibration Transfer

For conventional near-infrared spectroscopy (NIR) technology, even within the same sample, the NIR spectral signal can vary significantly with variation of spectrometers and the spectral collection environment. In order to improve the applicability and application of NIR prediction models, effective calibration transfer is essential. In this study, a stability-analysis-based feature selection algorithm (SAFS) for NIR calibration transfer is proposed, which is used to extract effective spectral band information with high stability between the master and slave instruments during the calibration transfer process. The stability of the spectrum bands shared between the master and slave instruments is used as the evaluation index, and the genetic algorithm was used to select suitable thresholds to filter out the spectral feature information suitable for calibration transfer. The proposed SAFS algorithm was applied to two near-infrared datasets of corn oil content and larch wood density. Simultaneously, its calibration transfer performances were compared with two classical feature selection methods. The effects of different preprocessing algorithms and calibration transfer algorithms were also assessed. The model with the feature variables selected by the SAFS obtained the best prediction. The SAFS algorithm can simplify the spectral data to be transferred and improve the transfer efficiency, and the universality of the SAFS allows it to be used to optimize calibration transfer in various situations. By combining different preprocessing and classic feature selection methods with this, the sensitivity of the correlation between spectral data and component information are improved significantly, as well as the effect of calibration transfer, which will be deeply developed.

Calibration transfer between modelled and commercial pharmaceutical tablet for API quantification using backscattering NIR, Raman and transmission Raman spectroscopy (TRS)

Backscattering NIR, Raman (BSR) and transmission Raman spectroscopy (TRS) coupled with chemometrics have shown to be rapid and non-invasive tools for the quantification of active pharmaceutical ingredient (API) content in tablets. However, the developed models are generally specifically related to the measurement conditions and sample characteristics. In this study, a number of calibration transfer methods, including DS, PDS, DWPDS, GLSW and SST, were evaluated for the spectra correction between modelled tablets produced in the laboratory and commercial samples. Results showed that the NIR and BSR spectra of commercial tablet corrected by DWPDS and PDS, respectively, enabled accurate API predictions with the high ratio of prediction error to deviation (RPD_P) values of 2.33 and 3.03. The most successfully approach was achieved with DS corrected TRS data and SiPLS modelling (161 variables) and yielded RMSE_P of 0.72 %, R²_P of 0.946 and RPD_P of 4.35. The proposed calibration transfer strategy offers the opportunities to analyse samples produced in different conditions; in the future, its implication will find extensively process control and quality assurance applications and benefit all possible users in the entire pharmaceutical industry.

A correlation-analysis-based wavelength selection method for calibration transfer

Considering that the spectral signals vary among different instruments, calibration transfer is required for further popularization and application of the near-infrared spectroscopy (NIRS). To achieve good calibration transfer results, spectral variables with stable and consistent signals between instruments and containing the target component information should be selected. In this study, a correlation-analysis-based wavelength selection method (CAWS) is proposed for calibration transfer. This method relies on the selection of wavelengths at which the spectral responses of master and slave instruments are well correlated (high absolute values of Pearson's correlation coefficient (|R_i|)). The proposed CAWS method was applied to two available datasets, corn and rice bran, and its calibration transfer performances were compared with other wavelength selection methods. The effects of pretreatment methods and calibration transfer algorithms were also assessed. The CAWS optimized models obtained lower root mean square errors of prediction (RMSEP_trans) after calibration transfer, suggesting that the proposed method is capable of effectively improving the efficiency of calibration transfer. Combinations of this method with other wavelength selection methods and calibration transfer algorithms may further enhance the efficiency of calibration transfer, and thus should be thoroughly investigated.