A causal analysis of time-varying speed camera safety effects based on the propensity score method

Road safety evaluation with multiple treatments: A comparison of methods based on simulations

This paper focuses on ex-post road safety evaluation with multiple treatments. The potential outcome framework for causal inference is introduced to formalize the causal estimands of interest. Various estimation methods are compared via performing simulation experiments based on semi-synthetic data constructed from a London 20 mph zones dataset. The methods under evaluation include regressions, propensity score (PS) based methods, and a machine learning-based method termed generalized random forests (GRF). Both PS-based methods and GRF show higher flexibility with respect to functional specifications of outcome models. Moreover, GRF shows great superiority in the cases where road safety treatments are assigned following specific criteria and/or where there are heterogeneous treatment effects. Considering the ex-post evaluation of combined effects of multiple treatments has significant practical value, the potential outcome framework and the estimation methods presented in this paper are highly recommended for road safety studies.

Evaluations of Speed Camera Interventions Can Deliver a Wide Range of Outcomes: Causes and Policy Implications

Speeding (travelling at speeds above the speed limit) is proven to be a major contributor to serious crashes, and speed management interventions including speed cameras are shown to reduce speeds, crashes, and trauma. However, the present review identifies that the range of outcomes reported in evaluations of speed cameras is large, complicating the understanding of effects, and inviting scepticism about the value of speed cameras despite the large numbers of reported successes, as well as systematic reviews and meta-analyses that demonstrate their life- and injury-saving value. Therefore, this review is focused on the factors that contribute to the large range of findings, including reasons for genuine differences in the outcomes delivered by different camera programs and variations in evaluation methodology that influence the extent to which real benefits are detected. Finally, recommendations are offered to maximise the safety benefits of speed-camera programs (including ensuring the full chain of requirements for general deterrence is met; strong communications about new programs and expansions at least several weeks in advance of implementation; and unpredictability of enforcement versus signposted cameras) and to improve evaluation methods (especially around determining the road lengths/locations assumed to be treated by the cameras and use of control locations).

Estimating heterogeneous treatment effects in road safety analysis using generalized random forests

Numerous evaluation studies have been conducted on a variety of road safety measures. However, the issue of treatment heterogeneity, defined as the variation in treatment effects, has rarely been investigated before. This paper contributes to the literature by introducing generalized random forests (GRF) for estimation of heterogeneous treatment effects (HTEs) in road safety analysis. GRF has high functional flexibility and is able to search for complex treatment heterogeneity. We first perform a series of simulation experiments to compare GRF with three causal methods that have been used in road safety studies, i.e., outcome regression method, propensity score method, and doubly robust estimation method. The simulation results suggest that GRF is superior to these three methods in terms of model specification, especially with the existence of nonlinearity and nonadditivity. On the other hand, a large dataset is required for accurate GRF estimation. Then we conduct a case study on the UK's speed camera program. Our results indicate significant reductions in the number of road accidents at speed camera sites. And the heterogeneity in treatment effects is found to be statistically significant. We further consider the associations between the baseline accident records, traffic volume, local socio-economic characteristics, and the safety effects of speed cameras. In general, the effect of speed cameras is larger at the sites with more baseline accident records, higher traffic volume, and in more densely-populated and deprived areas. Several policy suggestions are provided based on these findings. The evaluation of HTEs likely offers more comprehensive information to local authorities and policy makers, and improves the performance of speed camera programs. Moreover, GRF can be a promising approach for revealing treatment effect heterogeneity in road safety analysis.

Propensity score methods for road safety evaluation: Practical suggestions from a simulation study

The propensity score (PS) based method has been increasingly used in road safety evaluation studies. However, several major considerations regarding its implementation arise when using the PS method. First, as is well known, the PS method is 'data hungry' in terms of the number of treated and control units, however, it is sometimes difficult and time-consuming to construct a large sample in road safety studies. It would be helpful to better understand how to choose a proper sample size, as well as the ratio of the number of treated units to the control ones. Second, the criteria used for covariates selection of the PS model were not fully consistent across the existing road safety evaluation studies. Due to the complicated mechanisms behind the implementation of road safety measures and policies, including all relevant covariates that affect both the selection into treatment (i.e., implementation of road safety measures) and the outcomes (i.e., road accidents) is impossible. In this paper, we conduct a simulation study to investigate such issues and provide some practical suggestions for using PS methods in road safety evaluations. The estimator considered in this study is the inverse probability weighting estimator based on the PS. Our results suggest that the bias and variance of the estimated treatment effect will remain stable when the sample size reaches a certain level. A proper sample size is the one that ensures relevant covariates achieve acceptable balance. Regarding the issue of covariates selection, including the covariates that significantly affect the road accidents is recommended, regardless of whether they affect the implementation of road safety measures. This study also proposes practical procedures for using the weighting approach to evaluate the effects of road safety treatments.