Variable Screening for Near Infrared (NIR) Spectroscopy Data Based on Ridge Partial Least Squares Regression

Quality Assessment and Ripeness Prediction of Table Grapes Using Visible-Near-Infrared Spectroscopy

Ripeness significantly affects the commercial values and sales of fruits. In order to monitor the change of grapes' quality parameters during ripening, a rapid and nondestructive method of visible-near-infrared spectral (Vis-NIR) technology was utilized in this study. Firstly, the physicochemical properties of grapes at four different ripening stages were explored. Data evidenced increasing color in redness/greenness (a*) and Chroma (C*) and soluble solids (SSC) content and decreasing values in color of lightness (L*), yellowness/blueness (b*) and Hue angle (h*), hardness, and total acid (TA) content as ripening advanced. Based on these results, spectral prediction models for SSC and TA in grapes were established. Effective wavelengths were selected by the competitive adaptive weighting algorithm (CARS), and six common preprocessing methods were applied to pretreat the spectra data. Partial least squares regression (PLSR) was applied to establish models on the basis of effective wavelengths and full spectra. The predictive PLSR models built with full spectra data and 1st derivative preprocessing provided the best values of performance parameters for both SSC and TA. For SSC, the model showed the coefficients of determination for calibration (RCal2) and prediction (RPre2) set of 0.97 and 0.93, respectively, the root mean square error for calibration set (RMSEC) and prediction set (RMSEP) of 0.62 and 1.27, respectively; and the RPD equal to 4.09. As for TA, the optimum values of RCal2, RPre2, RMSEC, RMSEP and RPD were 0.97, 0.94, 0.88, 1.96 and 4.55, respectively. The results indicated that Vis-NIR spectroscopy is an effective tool for the rapid and non-destructive detection of SSC and TA in grapes.

Practical Online Characterization of the Properties of Hydrocracking Bottom Oil via Near-Infrared Spectroscopy

Providing real-time information on the chemical properties of hydrocracking bottom oil (HBO) as the feedstock for ethylene cracker while minimizing processing time, is important to improve the real-time optimization of ethylene production. In this study, a novel approach for estimating the properties of HBO samples was developed on the basis of near-infrared (NIR) spectra. The main noise and extreme samples in the spectral data were removed by combining discrete wavelet transform with principal component analysis and Hotelling’s T2 test. Kernel partial least squares (KPLS) regression was utilized to account for the nonlinearities between NIR data and the chemical properties of HBO. Compared with the principal component regression, partial least squares regression, and artificial neural network, the KPLS model had a better performance of obtaining acceptable values of root mean square error of prediction (RMSEP) and mean absolute relative error (MARE). All RMSEP and MARE values of density, Bureau of Mines correlation index, paraffins, isoparaffins, and naphthenes were less than 1.0 and 3.0, respectively. The accuracy of the industrial NIR online measurement system during consecutive running periods in predicting the chemical properties of HBO was satisfactory. The yield of high value-added products increased by 0.26 percentage points and coil outlet temperature decreased by 0.25 °C, which promoted economic benefits of the ethylene cracking process and boosted industrial reform from automation to digitization and intelligence.

Headspace Solid-Phase Microextraction Followed by Gas Chromatography-Mass Spectrometry as a Powerful Analytical Tool for the Discrimination of Truffle Species According to Their Volatiles

This study provides the first assessment of the volatile metabolome map of Tuber Aestivum and Tuber Borchii originating from Greece using headspace solid-phase micro-extraction (HS-SPME) coupled to gas chromatography-mass spectrometry (GC-MS). For the extraction of the volatile fraction, the SPME protocol was optimized after examining the effects of sample mass, extraction temperature, and extraction time using the one-variable at-a-time approach (OVAT). The optimum parameters involved the extraction of 100 mg of homogenized truffle for 45 min at 50°C. Overall, 19 truffle samples were analyzed, and the acquired data were normalized and further processed with chemometrics. Agglomerative hierarchical clustering (HCA) was used to identify the groups of the two species. Partial least squares-discriminant analysis (PLS-DA) was employed to develop a chemometric model that could discriminate the truffles according to the species and reveal characteristic volatile markers for Tuber Aestivum and Tuber Borchii grown in Greece.

A Combined Feature Screening Approach of Random Forest and Filter-based Methods for Ultra-high Dimensional Data

Background:

Various feature (variable) screening approaches have been proposed in the past decade to mitigate the impact of ultra-high dimensionality in classification and regression problems, including filter based methods such as sure indepen¬dence screening, and wrapper based methods such random forest. However, the former type of methods rely heavily on strong modelling assumptions while the latter ones requires an adequate sample size to make the data speak for themselves. These require¬ments can seldom be met in biochemical studies in cases where we have only access to ultra-high dimensional data with a complex structure and a small number of observations.

Objective:

In this research, we want to investigate the possibility of combing both filter based screening methods and random forest based screening methods in the regression context.

Method:

We have combined four state-of-art filter approaches, namely, sure independence screening (SIS) , robust rank corre¬lation based screening (RRCS), high dimensional ordinary least squares projection (HOLP) and a model free sure independence screening procedure based on the distance correlation (DCSIS) from the statistical community with a random forest based Boruta screening method from the machine learning community for regression problems.

Result:

Among all combined methods, RF-DCSIS performs better than the other methods in terms of screening accuracy and prediction capability on the simulated scenarios and real benchmark datasets.

Conclusion:

By empirical study from both extensive simulation and real data, we have shown that both filter based screening and random forest based screening have their pros and cons while a combination of both may lead to a better feature screening result and prediction capability

Keywords:

feature screening, filter-based method, ultra-high dimensional data, variable selection, random forest,RF-DCSIS