Sparse principal component regression for generalized linear models

Estimation of the rice aboveground biomass based on the first derivative spectrum and Boruta algorithm

Aboveground biomass (AGB) is regarded as a critical variable in monitoring crop growth and yield. The use of hyperspectral remote sensing has emerged as a viable method for the rapid and precise monitoring of AGB. Due to the extensive dimensionality and volume of hyperspectral data, it is crucial to effectively reduce data dimensionality and select sensitive spectral features to enhance the accuracy of rice AGB estimation models. At present, derivative transform and feature selection algorithms have become important means to solve this problem. However, few studies have systematically evaluated the impact of derivative spectrum combined with feature selection algorithm on rice AGB estimation. To this end, at the Xiaogang Village (Chuzhou City, China) Experimental Base in 2020, this study used an ASD FieldSpec handheld 2 ground spectrometer (Analytical Spectroscopy Devices, Boulder, Colorado, USA) to obtain canopy spectral data at the critical growth stage (tillering, jointing, booting, heading, and maturity stages) of rice, and evaluated the performance of the recursive feature elimination (RFE) and Boruta feature selection algorithm through partial least squares regression (PLSR), principal component regression (PCR), support vector machine (SVM) and ridge regression (RR). Moreover, we analyzed the importance of the optimal derivative spectrum. The findings indicate that (1) as the growth stage progresses, the correlation between rice canopy spectrum and AGB shows a trend from high to low, among which the first derivative spectrum (FD) has the strongest correlation with AGB. (2) The number of feature bands selected by the Boruta algorithm is 19~35, which has a good dimensionality reduction effect. (3) The combination of FD-Boruta-PCR (FB-PCR) demonstrated the best performance in estimating rice AGB, with an increase in R² of approximately 10% ~ 20% and a decrease in RMSE of approximately 0.08% ~ 14%. (4) The best estimation stage is the booting stage, with R2 values between 0.60 and 0.74 and RMSE values between 1288.23 and 1554.82 kg/hm2. This study confirms the accuracy of hyperspectral remote sensing in estimating vegetation biomass and further explores the theoretical foundation and future direction for monitoring rice growth dynamics.

Logistic regression with sparse common and distinctive covariates

Having large sets of predictor variables from multiple sources concerning the same individuals is becoming increasingly common in behavioral research. On top of the variable selection problem, predicting a categorical outcome using such data gives rise to an additional challenge of identifying the processes at play underneath the predictors. These processes are of particular interest in the setting of multi-source data because they can either be associated individually with a single data source or jointly with multiple sources. Although many methods have addressed the classification problem in high dimensionality, the additional challenge of distinguishing such underlying predictor processes from multi-source data has not received sufficient attention. To this end, we propose the method of Sparse Common and Distinctive Covariates Logistic Regression (SCD-Cov-logR). The method is a multi-source extension of principal covariates regression that combines with generalized linear modeling framework to allow classification of a categorical outcome. In a simulation study, SCD-Cov-logR resulted in outperformance compared to related methods commonly used in behavioral sciences. We also demonstrate the practical usage of the method under an empirical dataset.

Estimation and visualization of heterogeneous treatment effects for multiple outcomes

We consider two-arm comparison in clinical trials. The objective is to identify a population with characteristics that make the treatment effective. Such a population is called a subgroup. This identification can be made by estimating the treatment effect and identifying the interactions between treatments and covariates. For a single outcome, there are several ways available to identify the subgroups. There are also multiple outcomes, but they are difficult to interpret and cannot be applied to outcomes other than continuous values. In this paper, we thus propose a new method that allows for a straightforward interpretation of subgroups and deals with both continuous and binary outcomes. The proposed method introduces latent variables and adds Lasso sparsity constraints to the estimated loadings to facilitate the interpretation of the relationship between outcomes and covariates. The interpretation of the subgroups is made by visualizing treatment effects and latent variables. Since we are performing sparse estimation, we can interpret the covariates related to the treatment effects and subgroups. Finally, simulation and real data examples demonstrate the effectiveness of the proposed method.

Estimation of metal elements content in soil using x-ray fluorescence based on multilayer perceptron

X-ray fluorescence (XRF) is widely used to rapidly detect heavy metals in soil. Spectra processing has been an important research topic to improve accuracy. In this study, 80 soil samples were analyzed by XRF under indoor conditions, where different preprocessing and quantitative analysis methods were compared in terms of prediction accuracy. Denoising algorithms were used to preprocess the soil spectra before establishing prediction models for As, Pb, Cu, Cr, and Cd in soil. The influence of denoising methods on the prediction effects of different models was compared and discussed. The results on five heavy metal spectra show that the proper spectral preprocessing method can effectively improve the prediction performance of the model. The multilayer perceptron model provides promising analysis and modeling for the five metal elements. The determination coefficients (R²) of the models were 0.857, 0.976, 0.977, 0.995, and 0.886, respectively. The proposed method provides the potential to support accurate quantitation by XRF analysis.

Sparse principal component regression via singular value decomposition approach

Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage builds a regression model whose explanatory variables are the principal components obtained in the first stage. Since PCA is performed using only explanatory variables, the principal components have no information about the response variable. To address this problem, we present a one-stage procedure for PCR based on a singular value decomposition approach. Our approach is based upon two loss functions, which are a regression loss and a PCA loss from the singular value decomposition, with sparse regularization. The proposed method enables us to obtain principal component loadings that include information about both explanatory variables and a response variable. An estimation algorithm is developed by using the alternating direction method of multipliers. We conduct numerical studies to show the effectiveness of the proposed method.

Machine Learning Identifies Robust Matrisome Markers and Regulatory Mechanisms in Cancer

The expression and regulation of matrisome genes-the ensemble of extracellular matrix, ECM, ECM-associated proteins and regulators as well as cytokines, chemokines and growth factors-is of paramount importance for many biological processes and signals within the tumor microenvironment. The availability of large and diverse multi-omics data enables mapping and understanding of the regulatory circuitry governing the tumor matrisome to an unprecedented level, though such a volume of information requires robust approaches to data analysis and integration. In this study, we show that combining Pan-Cancer expression data from The Cancer Genome Atlas (TCGA) with genomics, epigenomics and microenvironmental features from TCGA and other sources enables the identification of "landmark" matrisome genes and machine learning-based reconstruction of their regulatory networks in 74 clinical and molecular subtypes of human cancers and approx. 6700 patients. These results, enriched for prognostic genes and cross-validated markers at the protein level, unravel the role of genetic and epigenetic programs in governing the tumor matrisome and allow the prioritization of tumor-specific matrisome genes (and their regulators) for the development of novel therapeutic approaches.

Application of statistical techniques to proportional loss data: Evaluating the predictive accuracy of physical vulnerability to hazardous hydro-meteorological events

Knowledge about the cause of differential structural damages following the occurrence of hazardous hydro-meteorological events can inform more effective risk management and spatial planning solutions. While studies have been previously conducted to describe relationships between physical vulnerability and features about building properties, the immediate environment and event intensity proxies, several key challenges remain. In particular, observations, especially those associated with high magnitude events, and studies designed to evaluate a comprehensive range of predictive features are both limited. To build upon previous developments, we described a workflow to support the continued development and assessment of empirical, multivariate physical vulnerability functions based on predictive accuracy. Within this workflow, we evaluated several statistical approaches, namely generalized linear models and their more complex alternatives. A series of models were built 1) to explicitly consider the effects of dimension reduction, 2) to evaluate the inclusion of interaction effects between and among predictors, 3) to evaluate an ensemble prediction method for applications where data observations are sparse, 4) to describe how model results can inform about the relative importance of predictors to explain variance in expected damages and 5) to assess the predictive accuracy of the models based on prescribed metrics. The utility of the workflow was demonstrated on data with characteristics of what is commonly acquired in ex-post field assessments. The workflow and recommendations from this study aim to provide guidance to researchers and practitioners in the natural hazards community.