A new kind of stochastic restricted biased estimator for logistic regression model

In the logistic regression model, the variance of the maximum likelihood estimator is inflated and unstable when the multicollinearity exists in the data. There are several methods available in literature to overcome this problem. We propose a new stochastic restricted biased estimator. We study the statistical properties of the proposed estimator and compare its performance with some existing estimators in the sense of scalar mean squared criterion. An example and a simulation study are provided to illustrate the performance of the proposed estimator.

A new estimator for the multicollinear Poisson regression model: simulation and application

The maximum likelihood estimator (MLE) suffers from the instability problem in the presence of multicollinearity for a Poisson regression model (PRM). In this study, we propose a new estimator with some biasing parameters to estimate the regression coefficients for the PRM when there is multicollinearity problem. Some simulation experiments are conducted to compare the estimators' performance by using the mean squared error (MSE) criterion. For illustration purposes, aircraft damage data has been analyzed. The simulation results and the real-life application evidenced that the proposed estimator performs better than the rest of the estimators.

Biased Adjusted Poisson Ridge Estimators-Method and Application

Månsson and Shukur (Econ Model 28:1475-1481, 2011) proposed a Poisson ridge regression estimator (PRRE) to reduce the negative effects of multicollinearity. However, a weakness of the PRRE is its relatively large bias. Therefore, as a remedy, Türkan and Özel (J Appl Stat 43:1892-1905, 2016) examined the performance of almost unbiased ridge estimators for the Poisson regression model. These estimators will not only reduce the consequences of multicollinearity but also decrease the bias of PRRE and thus perform more efficiently. The aim of this paper is twofold. Firstly, to derive the mean square error properties of the Modified Almost Unbiased PRRE (MAUPRRE) and Almost Unbiased PRRE (AUPRRE) and then propose new ridge estimators for MAUPRRE and AUPRRE. Secondly, to compare the performance of the MAUPRRE with the AUPRRE, PRRE and maximum likelihood estimator. Using both simulation study and real-world dataset from the Swedish football league, it is evidenced that one of the proposed, MAUPRRE (k ^ q 4 ) performed better than the rest in the presence of high to strong (0.80-0.99) multicollinearity situation.

A New Liu Type of Estimator for the Restricted SUR Estimator

A new Liu type of estimator for the seemingly unrelated regression (SUR) models is proposed that may be used when estimating the parameters vector in the presence of multicollinearity if the it is suspected to belong to a linear subspace. The dispersion matrices and the mean squared error (MSE) are derived. The new estimator may have a lower MSE than the traditional estimators. It was shown using simulation techniques the new shrinkage estimator outperforms the commonly used estimators in the presence of multicollinearity.

A new Poisson Liu Regression Estimator: method and application

This paper considers the estimation of parameters for the Poisson regression model in the presence of high, but imperfect multicollinearity. To mitigate this problem, we suggest using the Poisson Liu Regression Estimator (PLRE) and propose some new approaches to estimate this shrinkage parameter. The small sample statistical properties of these estimators are systematically scrutinized using Monte Carlo simulations. To evaluate the performance of these estimators, we assess the Mean Square Errors (MSE) and the Mean Absolute Percentage Errors (MAPE). The simulation results clearly illustrate the benefit of the methods of estimating these types of shrinkage parameters in finite samples. Finally, we illustrate the empirical relevance of our newly proposed methods using an empirically relevant application. Thus, in summary, via simulations of empirically relevant parameter values, and by a standard empirical application, it is clearly demonstrated that our technique exhibits more precise estimators, compared to traditional techniques – at least when multicollinearity exist among the regressors.