Quantile regression for nonignorable missing data with its application of analyzing electronic medical records

Over the past decade, there has been growing enthusiasm for using electronic medical records (EMRs) for biomedical research. Quantile regression estimates distributional associations, providing unique insights into the intricacies and heterogeneity of the EMR data. However, the widespread nonignorable missing observations in EMR often obscure the true associations and challenge its potential for robust biomedical discoveries. We propose a novel method to estimate the covariate effects in the presence of nonignorable missing responses under quantile regression. This method imposes no parametric specifications on response distributions, which subtly uses implicit distributions induced by the corresponding quantile regression models. We show that the proposed estimator is consistent and asymptotically normal. We also provide an efficient algorithm to obtain the proposed estimate and a randomly weighted bootstrap approach for statistical inferences. Numerical studies, including an empirical analysis of real-world EMR data, are used to assess the proposed method's finite-sample performance compared to existing literature.

Estimation of patient flow in hospitals using up-to-date data. Application to bed demand prediction during pandemic waves

Hospital bed demand forecast is a first-order concern for public health action to avoid healthcare systems to be overwhelmed. Predictions are usually performed by estimating patients flow, that is, lengths of stay and branching probabilities. In most approaches in the literature, estimations rely on not updated published information or historical data. This may lead to unreliable estimates and biased forecasts during new or non-stationary situations. In this paper, we introduce a flexible adaptive procedure using only near-real-time information. Such method requires handling censored information from patients still in hospital. This approach allows the efficient estimation of the distributions of lengths of stay and probabilities used to represent the patient pathways. This is very relevant at the first stages of a pandemic, when there is much uncertainty and too few patients have completely observed pathways. Furthermore, the performance of the proposed method is assessed in an extensive simulation study in which the patient flow in a hospital during a pandemic wave is modelled. We further discuss the advantages and limitations of the method, as well as potential extensions.

Statistical Inference for Partially Linear Varying Coefficient Quantile Models with Missing Responses

The construction of confidence intervals is investigated for the partially linear varying coefficient quantile model with missing random responses. Combined with quantile regression, an imputation-based empirical likelihood method is proposed to construct confidence intervals for parametric and varying coefficient components. Then, it is proved that the proposed empirical log-likelihood ratios are asymptotically Chi-square in theory. Finally, the symmetry confidence intervals of the parametric components and the point-by-point confidence intervals of the varying coefficient components are constructed in the simulation studies to demonstrate further that the proposed method yields smaller confidence intervals and higher coverage probabilities.

Nonparametric kernel estimation of the probability of cure in a mixture cure model when the cure status is partially observed

Cure models are a class of time-to-event models where a proportion of individuals will never experience the event of interest. The lifetimes of these so-called cured individuals are always censored. It is usually assumed that one never knows which censored observation is cured and which is uncured, so the cure status is unknown for censored times. In this paper, we develop a method to estimate the probability of cure in the mixture cure model when some censored individuals are known to be cured. A cure probability estimator that incorporates the cure status information is introduced. This estimator is shown to be strongly consistent and asymptotically normally distributed. Two alternative estimators are also presented. The first one considers a competing risks approach with two types of competing events, the event of interest and the cure. The second alternative estimator is based on the fact that the probability of cure can be written as the conditional mean of the cure status. Hence, nonparametric regression methods can be applied to estimate this conditional mean. However, the cure status remains unknown for some censored individuals. Consequently, the application of regression methods in this context requires handling missing data in the response variable (cure status). Simulations are performed to evaluate the finite sample performance of the estimators, and we apply them to the analysis of two datasets related to survival of breast cancer patients and length of hospital stay of COVID-19 patients requiring intensive care.

SuperMICE: An Ensemble Machine Learning Approach to Multiple Imputation by Chained Equations

Researchers often face the problem of how to address missing data. Multiple imputation is a popular approach, with multiple imputation by chained equations (MICE) being among the most common and flexible methods for execution. MICE iteratively fits a predictive model for each variable with missing values, conditional on other variables in the data. In theory, any imputation model can be used to predict the missing values. However, if the predictive models are incorrectly specified, they may produce biased estimates of the imputed data, yielding inconsistent parameter estimates and invalid inference. Given the set of modeling choices that must be made in conducting multiple imputation, in this paper we propose a data-adaptive approach to model selection. Specifically, we adapt MICE to incorporate an ensemble algorithm, Super Learner, to predict the conditional mean for each missing value, and we also incorporate a local kernel-based estimate of variance. We present a set of simulations indicating that this approach produces final parameter estimates with lower bias and better coverage than other commonly used imputation methods. These results suggest that using a flexible machine learning imputation approach can be useful in settings where data are missing at random, especially when the relationships among the variables are complex.

Joint sufficient dimension reduction for estimating continuous treatment effect functions

The estimation of continuous treatment effect functions using observational data often requires parametric specification of the effect curves, the conditional distributions of outcomes and treatment assignments given multi-dimensional covariates. While nonparametric extensions are possible, they typically suffer from the curse of dimensionality. Dimension reduction is often inevitable and we propose a sufficient dimension reduction framework to balance parsimony and flexibility. The joint central subspace can be estimated at a n ^1/2-rate without fixing its dimension in advance, and the treatment effect function is estimated by averaging local estimates of a reduced dimension. Asymptotic properties are studied. Unlike binary treatments, continuous treatments require multiple smoothing parameters of different asymptotic orders to borrow different facets of information, and their joint estimation is proposed by a non-standard version of the infinitesimal jackknife.

Doubly robust multiple imputation using kernel-based techniques

We consider the problem of estimating the marginal mean of an incompletely observed variable and develop a multiple imputation approach. Using fully observed predictors, we first establish two working models: one predicts the missing outcome variable, and the other predicts the probability of missingness. The predictive scores from the two models are used to measure the similarity between the incomplete and observed cases. Based on the predictive scores, we construct a set of kernel weights for the observed cases, with higher weights indicating more similarity. Missing data are imputed by sampling from the observed cases with probability proportional to their kernel weights. The proposed approach can produce reasonable estimates for the marginal mean and has a double robustness property, provided that one of the two working models is correctly specified. It also shows some robustness against misspecification of both models. We demonstrate these patterns in a simulation study. In a real-data example, we analyze the total helicopter response time from injury in the Arizona emergency medical service data.

Semiparametric dimension reduction estimation for mean response with missing data

Model misspecification can be a concern for high-dimensional data. Nonparametric regression obviates model specification but is impeded by the curse of dimensionality. This paper focuses on the estimation of the marginal mean response when there is missingness in the response and multiple covariates are available. We propose estimating the mean response through nonparametric functional estimation, where the dimension is reduced by a parametric working index. The proposed semiparametric estimator is robust to model misspecification: it is consistent for any working index if the missing mechanism of the response is known or correctly specified up to unknown parameters; even with misspecification in the missing mechanism, it is consistent so long as the working index can recover E(Y  |   X), the conditional mean response given the covariates. In addition, when the missing mechanism is correctly specified, the semiparametric estimator attains the optimal efficiency if E(Y  |   X) is recoverable through the working index. Robustness and efficiency of the proposed estimator is further investigated by simulations. We apply the proposed method to a clinical trial for HIV.