Incorporating Bayesian methods into the propensity score matching framework: A no-treatment effect safety analysis

Assessing the Negative Binomial-Lindley model for crash hotspot identification: Insights from Monte Carlo simulation analysis

Identifying hazardous crash sites (or hotspots) is a crucial step in highway safety management. The Negative Binomial (NB) model is the most common model used in safety analyses and evaluations - including hotspot identification. The NB model, however, is not without limitations. In fact, this model does not perform well when data are highly dispersed, include excess zero observations, or have a long tail. Recently, the Negative Binomial-Lindley (NB-L) model has been proposed as an alternative to the NB. The NB-L model overcomes several limitations related to the NB, such as addressing the issue of excess zero observations in highly dispersed data. However, it is not clear how the NB-L model performs regarding the hotspot identification. In this paper, an innovative Monte Carlo simulation protocol was designed to generate a wide range of simulated data characterized by different means, dispersions, and percentage of zeros. Next, the NB-L model was written as a Full-Bayes hierarchical model and compared with the Full-Bayes NB model for hotspot identification using extensive simulation scenarios. Most previous studies focused on statistical fit, and showed that the NB-L model fits the data better than the NB. In this research, however, we investigated the performance of the NB-L model in identifying the hazardous sites. We showed that there is a trade-off between the NB-L and NB when it comes to hotspot identification. Multiple performance metrics were used for the assessment. Among those, the results show that the NB-L model provides a better specificity in identifying hotspots, while the NB model provides a better sensitivity, especially for highly dispersed data. In other words, while the NB model performs better in identifying hazardous sites, the NB-L model performs better, when budget is limited, by not selecting non-hazardous sites as hazardous.

Crash modification factors of rumble strips on horizontal curves of two-lane rural roads: A propensity scores potential outcomes approach

Horizontal curves are known to be more crash-prone than tangent sections particularly with respect to roadway departure crashes. Rumble strips are an effective countermeasure to mitigate various types of roadway departure crashes. While existing studies on the safety effectiveness of rumble strips have primarily used before-after study designs or cross-sectional methods for crash modification factor (CMF) estimation, these methods often suffer from imbalanced datasets and larger standard errors, especially when the sample size is small. To address this, this study applies the propensity score potential outcome (PSPO) framework to estimate CMFs for centerline rumble strips, shoulder rumble strips, and their combined application on horizontal curves. In addition to contributing to the development of CMFs by crash severity, this study also examines the effects of rumble strips on collision types, highlighting their impact on vehicle maneuvering and collision characteristics. The analysis is conducted on horizontal curves on two-lane rural roads in Pennsylvania, utilizing crash data from 2017 to 2021. The PSPO method effectively reduces bias between sites with and without rumble strips, and the resulting statistical models align with engineering judgment. The findings indicate that centerline rumble strips reduce opposite direction sideswipe and head-on crashes but increase run off the road and hit fixed object crashes. Shoulder rumble strips, either alone or in combination with centerline rumble strips, decrease crash frequencies for most types except opposite direction sideswipe and head-on crashes. However, shoulder rumble strips alone are more effective at reducing crash frequencies on horizontal curves than when combined with centerline rumble strips.

Road safety evaluation with multiple treatments: A comparison of methods based on simulations

This paper focuses on ex-post road safety evaluation with multiple treatments. The potential outcome framework for causal inference is introduced to formalize the causal estimands of interest. Various estimation methods are compared via performing simulation experiments based on semi-synthetic data constructed from a London 20 mph zones dataset. The methods under evaluation include regressions, propensity score (PS) based methods, and a machine learning-based method termed generalized random forests (GRF). Both PS-based methods and GRF show higher flexibility with respect to functional specifications of outcome models. Moreover, GRF shows great superiority in the cases where road safety treatments are assigned following specific criteria and/or where there are heterogeneous treatment effects. Considering the ex-post evaluation of combined effects of multiple treatments has significant practical value, the potential outcome framework and the estimation methods presented in this paper are highly recommended for road safety studies.

Counterfactual safety benefits quantification method for en-route driving behavior interventions

Driving behavior intervention is a dominant traffic safety countermeasure being implemented that has substantially reduced crash occurrence. However, during implementation, the intervention strategy faces the curse of dimensionality as there are multiple candidate intervention locations with various intervention measures and options. Quantifying the interventions' safety benefits and further implementing the most effective ones could avoid too frequent interventions which may lead to counterproductive safety impacts. Traditional intervention effects quantification approaches rely on observational data, thus failing to control confounding variables and leading to biased results. In this study, a counterfactual safety benefits quantification method for en-route driving behavior interventions was proposed. Empirical data from online ride-hailing services were employed to quantify the safety benefits of en-route safety broadcasting to speed maintenance behavior. Specifically, to effectively control the impacts of confounding variables on the quantification results of interventions, the "if without intervention" case of the intervention case is inferred based on the structural causality model according to the Theory of Planned Behavior (TPB). Then, a safety benefits quantification method based on Extreme Value Theory (EVT) was developed to connect changes of speed maintenance behavior with crash occurrence probabilities. Furthermore, a closed-loop evaluation and optimization framework for the various behavior interventions was established and applied to a subset of Didi's online ride-hailing service drivers (more than 1.35 million). Analyses results indicated safety broadcasting could effectively reduce driving speed by approximately 6.30 km/h and contribute to an approximate 40% reduction in speeding-related crashes. Besides, empirical application results showed that the whole framework contributed to a remarkable reduction in the fatality rate per 100 million km, from an average of 0.368 to 0.225. Finally, directions for future research in terms of data, counterfactual inference methodology, and research subjects have been discussed.

Examining the performance of engineering treatment evaluation methodologies using the hypothetical treatment and actual treatment settings

The selection of treatment evaluation methodology is paramount in determining reliable crash modification factors (CMFs) for engineering treatments. A lack of ground truth makes it cumbersome to examine the performance of treatment evaluation methodologies. In addition, a sound methodological framework is critical for evaluating the performances of treatment evaluation methodologies. In addressing these challenges, this study proposed a framework for assessing treatment evaluation methodologies by hypothetical treatments with known ground truth and actual real-world treatments. In particular, this study examined three before-after treatment evaluation approaches: 1) Empirical Bayes, 2) Simulation-based Empirical Bayes, and 3) Full Bayes methods. In addition, this study examined the Cross-Sectional treatment evaluation methodology. The methodological framework utilized five datasets of hypothetical treatment with known ground truth based on the hotspot identification method and a real-world dataset of wide centerline treatment on two-lane, two-way rural highways in Queensland, Australia. Results showed that all the methods could identify the ground truth of hypothetical treatments, but the Full Bayes approach better predicts the known ground truth compared to Empirical Bayes, Simulation-based Empirical Bayes, and Cross-Sectional methods. The Full Bayes approach was also found to provide the most precise estimate for real-world wide centerline treatment along rural highways compared to other methods. Moreover, the current study highlighted that the Cross-Sectional method offers a viable estimate of treatment effectiveness in case the before-period data is limited.

Influence of segmentation approaches on the before-after evaluation of engineering treatments: A hypothetical treatment approach

The segmentation of highways is a fundamental step in estimating crash frequency models and conducting a before-after evaluation of engineering treatments, but the effects of segmentation approaches on the engineering treatment evaluations are not known very well. This study examined the effects of segmentation approaches on the before-after evaluation of engineering treatments. In particular, this study evaluated four segmentation approaches by applying the Empirical Bayes technique to a dataset for which the ground truth was known. Four segmentation approaches included Highway Safety Manual (HSM), Fixed (kilometre post), Fisher's, and K-means segmentation. This study utilized a 440 km stretch of rural two-lane two-way highway in Queensland, Australia, to prepare a dataset with known ground truth. The treatment under evaluation was a hypothetical treatment, which should yield a crash modification factor (CMF) of 1. For assigning hypothetical treatment, a total of fifteen datasets were prepared, including ten datasets based on the random assignment and five datasets based on the hotspot identification method. Following the before-after evaluation using the Empirical Bayes technique, the results showed that HSM and Fixed segmentation approaches predict the ground truth in both dataset types. From random assignment datasets, the estimated CMFs using HSM, Fixed, Fisher's, and K-means segmentation approaches deviated from the true CMF (i.e., 1) by 2.32 %, 5.30 %, 6.08 %, and 8.62 %, respectively. In the case of hotspots, the corresponding deviations of CMFs were 8.57 %, 9.37 %, 28.84 %, and 35.43 %, respectively. Overall, HSM segmentation best identified the actual treatment effect, followed by the Fixed segmentation. If the variables to define homogeneity for HSM segmentation are limited, then Fixed segmentation can yield reliable crash modification factors from the before-after treatment evaluations than the crash-based segmentation approaches.

Optimized Weighted Nearest Neighbours Matching Algorithm for Control Group Selection

An essential criterion for the proper implementation of case-control studies is selecting appropriate case and control groups. In this article, a new simulated annealing-based control group selection method is proposed, which solves the problem of selecting individuals in the control group as a distance optimization task. The proposed algorithm pairs the individuals in the n-dimensional feature space by minimizing the weighted distances between them. The weights of the dimensions are based on the odds ratios calculated from the logistic regression model fitted on the variables describing the probability of membership of the treated group. For finding the optimal pairing of the individuals, simulated annealing is utilized. The effectiveness of the newly proposed Weighted Nearest Neighbours Control Group Selection with Simulated Annealing (WNNSA) algorithm is presented by two Monte Carlo studies. Results show that the WNNSA method can outperform the widely applied greedy propensity score matching method in feature spaces where only a few covariates characterize individuals and the covariates can only take a few values.

Evaluation of the Implementation Effect of the Ecological Compensation Policy in the Poyang Lake River Basin Based on Difference-in-Difference Method

Watershed environments play an important supporting role in sustainable high-quality economic development in China, but they have been deteriorating. In order to solve environmental problems in the Poyang Lake River Basin brought about by economic development, the Jiangxi Provincial Government promulgated relevant river basin protection policies in 2015. However, after several years of this policy, the specific effects of its implementation are a matter of general concern to the government and academic circles. After years of policy implementation, the implementation effect of the watershed ecological compensation policy needs to be evaluated. Based on 4248 observations from the Jiangxi and Hunan Provinces, we adopt the difference-in-difference method to analyze the impact of the ecological compensation policy on the Poyang Lake River Basin. The empirical results show that the ecological compensation policy has a significant effect on water-quality improvement. Water quality in the upstream area is better than that in the downstream area; areas with small administrative areas have a smaller population, which in turn leads to better water quality in the river basin; and the higher the per capita GDP, the worse the water quality. Our results highlight the need for the following policy improvements: ecological priority, customizing measures to local conditions, tracing the main body, and strengthening supervision.

Propensity score methods for road safety evaluation: Practical suggestions from a simulation study

The propensity score (PS) based method has been increasingly used in road safety evaluation studies. However, several major considerations regarding its implementation arise when using the PS method. First, as is well known, the PS method is 'data hungry' in terms of the number of treated and control units, however, it is sometimes difficult and time-consuming to construct a large sample in road safety studies. It would be helpful to better understand how to choose a proper sample size, as well as the ratio of the number of treated units to the control ones. Second, the criteria used for covariates selection of the PS model were not fully consistent across the existing road safety evaluation studies. Due to the complicated mechanisms behind the implementation of road safety measures and policies, including all relevant covariates that affect both the selection into treatment (i.e., implementation of road safety measures) and the outcomes (i.e., road accidents) is impossible. In this paper, we conduct a simulation study to investigate such issues and provide some practical suggestions for using PS methods in road safety evaluations. The estimator considered in this study is the inverse probability weighting estimator based on the PS. Our results suggest that the bias and variance of the estimated treatment effect will remain stable when the sample size reaches a certain level. A proper sample size is the one that ensures relevant covariates achieve acceptable balance. Regarding the issue of covariates selection, including the covariates that significantly affect the road accidents is recommended, regardless of whether they affect the implementation of road safety measures. This study also proposes practical procedures for using the weighting approach to evaluate the effects of road safety treatments.

Investigating the Links Between Vaccination Against COVID-19 and Public Attitudes Toward Protective Countermeasures: Implications for Public Health

The COVID-19 pandemic caused by the novel coronavirus, SARS-CoV-2, is spreading globally at an unprecedented rate. To protect the world against this devastating catastrophe, vaccines for SARS-CoV-2 have been produced following consistent clinical trials. However, the durability of a protective immune response due to vaccination has not been confirmed. Moreover, COVID-19 vaccination against SARS-CoV-2 is not 100% guaranteed, as new variants arise due to mutations. Consequently, health officials are pleading with the public to take extra precautions against the virus and continue wearing masks, wash hands, and observe physical distancing even after vaccination. The current research collected data from 4,540 participants (1,825 vaccinated and 2,715 not vaccinated) in China to analyze this phenomenon empirically. The propensity score matching (PSM) model is employed to analyze the impact of vaccination against COVID-19 on participants' attitudes toward protective countermeasures. The findings showed that gender, age, education level, occupation risk, individual health risk perception, public health risk perception, social responsibility, peer effect, and government supervision are the main drivers for participants to be vaccinated with COVID-19's vaccines. The results further show that vaccination lessened participants' frequency of hand washing by 1.75 times and their compliance frequency intensity of observing physical distancing by 1.24 times. However, the rate of mask-wearing did not reduce significantly, implying that China's main countermeasure of effective mask-wearing effectively controls COVID-19. Moreover, the findings indicate that a reduction in the frequency of hand washing and observing physical distance could cause a resurgence of COVID-19. In conclusion, factors leading to the eradication of SARS-CoV-2 from the world are complex to be achieved, so the exploration of COVID-19 vaccination and people's attitude toward protective countermeasures may provide insights for policymakers to encourage vaccinated people to follow protective health measures and help in completely defeating the COVID-19 from the globe.