Chemometric approaches for calibrating high-throughput spectral imaging setups to support digital plant phenotyping by calibrating and transferring spectral models from a point spectrometer

Calibration transfer via filter learning

BACKGROUND

Calibration transfer is an essential activity in analytical chemistry in order to avoid a complete recalibration. Currently, the most popular calibration transfer methods, such as piecewise direct standardization and dynamic orthogonal projection, require a certain amount of standard or reference samples to guarantee their effectiveness. To achieve higher efficiency, it is desirable to perform the transfer with as few reference samples as possible.

RESULTS

To this end, we propose a new calibration transfer method by using a calibration database from a master instrument (source domain) and only one spectrum with known properties from a slave instrument (target domain). We first generate a counterpart of this spectrum in the source domain by a multivariate Gaussian kernel. Then, we train a filter to make the response function of the slave instrument equivalent to that of the master instrument. To avoid the need for labels from the target domain, we also propose an unsupervised way to implement our method. Compared with several state-of-the-art methods, the results on one simulated dataset and two real-world datasets demonstrate the effectiveness of our method.

SIGNIFICANCE

Traditionally, the demand for certain amounts of reference samples during calibration transfer is cumbersome. Our approach, which requires only one reference sample, makes the transfer process simple and fast. In addition, we provide an alternative for performing unsupervised calibration transfer. As such, the proposed method is a promising tool for calibration transfer.

PFCE2: A versatile parameter-free calibration enhancement framework for near-infrared spectroscopy

Near-infrared (NIR) spectroscopy is a widely used technique for chemical analysis, but it has faced challenges of calibration transfer, maintenance, and enhancement among different instruments and conditions. The parameter-free calibration enhancement (PFCE) framework was developed to address these challenges with non-supervised (NS), semi-supervised (SS), and full-supervised (FS) methods. This study presented PFCE2, an updated version of the PFCE framework that incorporates two new constraints and a new method to improve the robustness and efficiency of calibration enhancement. First, normalized L2 and L1 constraints were introduced to replace the correlation coefficient (Corr) constraint used in the original PFCE. These constraints preserve the parameter-free feature of PFCE and impose smoothness or sparsity on the model coefficients. Second, multitask PFCE (MT-PFCE) was proposed within the framework to address the calibration enhancement among multiple instruments, enabling the framework to be versatile for all possible calibration transfer situations. Demonstrations conducted on three NIR datasets of tablets, plant leaves, and corn showed that the PFCE methods with the new L2 and L1 constraints can result in more accurate and robust predictions than the Corr constraint, especially when the standard sample size is small. Moreover, MT-PFCE could refine all models in the involved scenarios at once, leading to significant enhancement in model performance, compared to the original PFCE method with the same data requirements. Finally, the applicable situations of the PFCE framework and other analogous calibration transfer methods were summarized, facilitating users to choose suitable methods for their application. The source codes written in both MATLAB and Python are available at https://github.com/JinZhangLab/PFCE and https://pypi.org/project/pynir/, respectively.

Feasibility of an NIR spectral calibration transfer algorithm based on optimized feature variables to predict tobacco samples in different states

The prediction accuracy of calibration models for near-infrared (NIR) spectroscopy typically relies on the morphology and homogeneity of the samples. To achieve non-homogeneous tobacco samples for non-destructive and rapid analysis, a method that can predict tobacco filament samples using reliable models based on the corresponding tobacco powder is proposed here. First, as it is necessary to establish a simple and robust calibrated model with excellent performance, based on full-wavelength PLSR (Full-PLSR), the key feature variables were screened by three methods, namely competitive adaptive reweighted sampling (CARS), variable combination population analysis-iteratively retaining informative variables (VCPA-IRIV), and variable combination population analysis-genetic algorithm (VCPA-GA). The partial least squares regression (PLSR) models for predicting the total sugar content in tobacco were established based on three optimal wavelength sets and named CARS-PLSR, VCPA-IRIV-PLSR and VCPA-GA-PLSR, respectively. Subsequently, they were combined with different calibration transfer algorithms, including calibration transfer based on canonical correlation analysis (CTCCA), slope/bias correction (S/B) and non-supervised parameter-free framework for calibration enhancement (NS-PFCE), to evaluate the best prediction model for the tobacco filament samples. Compared with the previous two transfer algorithms, NS-PFCE performed the best under various wavelength conditions. The prediction results indicated that the most successful approach for predicting the tobacco filament samples was achieved by VCPA-IRIV-PLSR when coupled with the NS-PFCE method, which obtained the highest determination coefficient (R_p² = 0.9340) and the lowest root mean square error of the prediction set (RMSEP = 0.8425). VCPA-IRIV simplifies the calibration model and improves the efficiency of model transfer (31 variables). Furthermore, it pledges the prediction accuracy of the tobacco filament samples when combined with NS-PFCE. In summary, calibration transfer based on optimized feature variables can eliminate prediction errors caused by sample morphological differences and proves to be a more beneficial method for online application in the tobacco industry.

Optical imaging spectroscopy coupled with machine learning for detecting heavy metal of plants: A review

Heavy metal elements, which inhibit plant development by destroying cell structure and wilting leaves, are easily absorbed by plants and eventually threaten human health via the food chain. Recently, with the increasing precision and refinement of optical instruments, optical imaging spectroscopy has gradually been applied to the detection and reaction of heavy metals in plants due to its in-situ, real-time, and simple operation compared with traditional chemical analysis methods. Moreover, the emergence of machine learning helps improve detection accuracy, making optical imaging spectroscopy comparable to conventional chemical analysis methods in some situations. This review (a): summarizes the progress of advanced optical imaging spectroscopy techniques coupled with artificial neural network algorithms for plant heavy metal detection over ten years from 2012-2022; (b) briefly describes and compares the principles and characteristics of spectroscopy and traditional chemical techniques applied to plants heavy metal detection, and the advantages of artificial neural network techniques including machine learning and deep learning techniques in combination with spectroscopy; (c) proposes the solutions such as coupling with other analytical and detection methods, portability, to address the challenges of unsatisfactory sensitivity of optical imaging spectroscopy and expensive instruments.