Autonomous driving in urban environments: approaches, lessons and challenges

Human-machine coordination in mixed traffic as a problem of Meaningful Human Control

The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how "designing for meaningful human control" constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation.

Logic programming for deliberative robotic task planning

Over the last decade, the use of robots in production and daily life has increased. With increasingly complex tasks and interaction in different environments including humans, robots are required a higher level of autonomy for efficient deliberation. Task planning is a key element of deliberation. It combines elementary operations into a structured plan to satisfy a prescribed goal, given specifications on the robot and the environment. In this manuscript, we present a survey on recent advances in the application of logic programming to the problem of task planning. Logic programming offers several advantages compared to other approaches, including greater expressivity and interpretability which may aid in the development of safe and reliable robots. We analyze different planners and their suitability for specific robotic applications, based on expressivity in domain representation, computational efficiency and software implementation. In this way, we support the robotic designer in choosing the best tool for his application.

Human injury-based safety decision of automated vehicles

Automated vehicles (AVs) are anticipated to improve road traffic safety. However, prevailing decision-making algorithms have largely neglected the potential to mitigate injuries when confronting inevitable obstacles. To explore whether, how, and to what extent AVs can enhance human protection, we propose an injury risk mitigation-based decision-making algorithm. The algorithm is guided by a real-time, data-driven human injury prediction model and is assessed using detailed first-hand information collected from real-world crashes. The results demonstrate that integrating injury prediction into decision-making is promising for reducing traffic casualties. Because safety decisions involve harm distribution for different participants, we further analyze the potential ethical issues quantitatively, providing a technically critical step closer to settling such dilemmas. This work demonstrates the feasibility of applying mining tools to identify the underlying mechanisms embedded in crash data accumulated over time and opens the way for future AVs to facilitate optimal road traffic safety.

•

We propose an injury risk mitigation-based decision-making algorithm for AVs

•

A real-time, data-driven human injury prediction model was established

•

We applied mining tools to identify mechanisms embedded in accumulated crash data

•

We analyzed traffic ethical issues quantitatively, closer to feasible solutions

Reactive task and motion planning for robust whole-body dynamic locomotion in constrained environments

Contact-based decision and planning methods are becoming increasingly important to endow higher levels of autonomy for legged robots. Formal synthesis methods derived from symbolic systems have great potential for reasoning about high-level locomotion decisions and achieving complex maneuvering behaviors with correctness guarantees. This study takes a first step toward formally devising an architecture composed of task planning and control of whole-body dynamic locomotion behaviors in constrained and dynamically changing environments. At the high level, we formulate a two-player temporal logic game between the multi-limb locomotion planner and its dynamic environment to synthesize a winning strategy that delivers symbolic locomotion actions. These locomotion actions satisfy the desired high-level task specifications expressed in a fragment of temporal logic. Those actions are sent to a robust finite transition system that synthesizes a locomotion controller that fulfills state reachability constraints. This controller is further executed via a low-level motion planner that generates feasible locomotion trajectories. We construct a set of dynamic locomotion models for legged robots to serve as a template library for handling diverse environmental events. We devise a replanning strategy that takes into consideration sudden environmental changes or large state disturbances to increase the robustness of the resulting locomotion behaviors. We formally prove the correctness of the layered locomotion framework guaranteeing a robust implementation by the motion planning layer. Simulations of reactive locomotion behaviors in diverse environments indicate that our framework has the potential to serve as a theoretical foundation for intelligent locomotion behaviors.

Knowledge-Based Approach for the Perception Enhancement of a Vehicle

An autonomous vehicle relies on sensors in order to perceive its surroundings. However, there are multiple causes that would hinder a sensor’s proper functioning, such as bad weather or lighting conditions. Studies have shown that rainfall and fog lead to a reduced visibility, which is one of the main causes of accidents. This work proposes the use of a drone in order to enhance the vehicle’s perception, making use of both embedded sensors and its advantageous 3D positioning. The environment perception and vehicle/Unmanned Aerial Vehicle (UAV) interactions are managed by a knowledge base in the form of an ontology, and logical rules are used in order to detect and infer the environmental context and UAV management. The model was tested and validated in a simulation made on Unity.

Collaborative Autonomous Driving-A Survey of Solution Approaches and Future Challenges

Sooner than expected, roads will be populated with a plethora of connected and autonomous vehicles serving diverse mobility needs. Rather than being stand-alone, vehicles will be required to cooperate and coordinate with each other, referred to as cooperative driving executing the mobility tasks properly. Cooperative driving leverages Vehicle to Vehicle (V2V) and Vehicle to Infrastructure (V2I) communication technologies aiming to carry out cooperative functionalities: (i) cooperative sensing and (ii) cooperative maneuvering. To better equip the readers with background knowledge on the topic, we firstly provide the detailed taxonomy section describing the underlying concepts and various aspects of cooperation in cooperative driving. In this survey, we review the current solution approaches in cooperation for autonomous vehicles, based on various cooperative driving applications, i.e., smart car parking, lane change and merge, intersection management, and platooning. The role and functionality of such cooperation become more crucial in platooning use-cases, which is why we also focus on providing more details of platooning use-cases and focus on one of the challenges, electing a leader in high-level platooning. Following, we highlight a crucial range of research gaps and open challenges that need to be addressed before cooperative autonomous vehicles hit the roads. We believe that this survey will assist the researchers in better understanding vehicular cooperation, its various scenarios, solution approaches, and challenges.

Smartphone-enabled road condition monitoring: from accelerations to road roughness and excess energy dissipation

We develop a framework to address the shortcomings of current smartphone-based approaches for road roughness sensing and monitoring through combining vehicle dynamics, random vibration theory and a two-layer inverse analysis. The proposed approach uses in-cabin recordings of the vehicle’s vertical acceleration measured by a smartphone positioned inside the car for the estimation of road roughness. The mechanistic road roughness–vehicle interaction model at the core of the proposed framework links the frequency spectrum of the vehicle’s vertical acceleration to the road roughness power spectral density and lends itself to the quantitative characterization of roughness-induced energy dissipation. We demonstrate that the measure of roughness provided by the stochastic model of car dynamics interacting with a rough road is fully compatible, in a statistical sense, with the spatial but deterministic definition of road roughness, and validate the identification strategy that originates from it against laser measurements of road roughness. The critical crowdsourcing features of the proposed framework, such as the marginal impact of phone position and transferability, are examined and its utility to meld with big data analytics to identify the class of vehicles travelling on a roadway network is demonstrated.

A Review of the Transformation of Road Transport Systems: Are We Ready for the Next Step in Artificially Intelligent Sustainable Transport?

Mobility is experiencing a revolution, as advanced communications, computers with big data capacities, efficient networks of sensors, and signals, are developing value-added applications such as intelligent spaces and autonomous vehicles. Another new technology that is both promising and might even be pervasive for faster, safer and more environmentally-friendly public transport (PT) is the development of autonomous vehicles (AVs). This study aims to understand the state of the current research on the artificially intelligent transportation system (ITS) and AVs through a critical evaluation of peer-reviewed literature. This study’s findings revealed that the majority of existing research (around 82% of studies) focused on AVs. Results show that AVs can potentially reduce more than 80% of pollutant emissions per mile if powered by alternate energy resources (e.g., natural gas, biofuel, electricity, hydrogen cells, etc.). Not only can private vehicle ownership be cut down by bringing in ridesharing but the average vehicle miles travelled (VMT) should also be reduced through improved PT. The main benefits of AV adoption were reported in the literature to be travel time, traffic congestion, cost and environmental factors. Findings revealed barriers such as technological uncertainties, lack of regulation, unawareness among stakeholders and privacy and security concerns, along with the fact that lack of simulation and empirical modelling data from pilot studies limit the application. AV–PT was also found to be the most sustainable strategy in dense urban areas to shift the heavy trip load from private vehicles.

A new integrated collision risk assessment methodology for autonomous vehicles

Real-time risk assessment of autonomous driving at tactical and operational levels is extremely challenging since both contextual and circumferential factors should concurrently be considered. Recent methods have started to simultaneously treat the context of the traffic environment along with vehicle dynamics. In particular, interaction-aware motion models that take inter-vehicle dependencies into account by utilizing the Bayesian interference are employed to mutually control multiple factors. However, communications between vehicles are often assumed and the developed models are required many parameters to be tuned. Consequently, they are computationally very demanding. Even in the cases where these desiderata are fulfilled, current approaches cannot cope with a large volume of sequential data from organically changing traffic scenarios, especially in highly complex operational environments such as dense urban areas with heterogeneous road users. To overcome these limitations, this paper develops a new risk assessment methodology that integrates a network-level collision estimate with a vehicle-based risk estimate in real-time under the joint framework of interaction-aware motion models and Dynamic Bayesian Networks (DBN). Following the formulation and explanation of the required functions, machine learning classifiers were utilized for the real-time network-level collision prediction and the results were then incorporated into the integrated DBN model for predicting collision probabilities in real-time. Results indicated an enhancement of the interaction-aware model by up to 10%, when traffic conditions are deemed as collision-prone. Hence, it was concluded that a well-calibrated collision prediction classifier provides a crucial hint for better risk perception by autonomous vehicles.

Robotic Online Path Planning on Point Cloud

This paper deals with the path-planning problem for mobile wheeled- or tracked-robot which drive in 2.5-D environments, where the traversable surface is usually considered as a 2-D-manifold embedded in a 3-D ambient space. Specially, we aim at solving the 2.5-D navigation problem using raw point cloud as input. The proposed method is independent of traditional surface parametrization or reconstruction methods, such as a meshing process, which generally has high-computational complexity. Instead, we utilize the output of 3-D tensor voting framework on the raw point clouds. The computation of tensor voting is accelerated by optimized implementation on graphics computation unit. Based on the tensor voting results, a novel local Riemannian metric is defined using the saliency components, which helps the modeling of the latent traversable surface. Using the proposed metric, we prove that the geodesic in the 3-D tensor space leads to rational path-planning results by experiments. Compared to traditional methods, the results reveal the advantages of the proposed method in terms of smoothing the robot maneuver while considering the minimum travel distance.

Extrinsic calibration of 2D laser rangefinders from perpendicular plane observations

Many applications in the fields of mobile robotics and autonomous vehicles employ two or more 2D laser rangefinders (LRFs) for different purposes: navigation, obstacle detection, 3D mapping or simultaneous localization and mapping. The extrinsic calibration between such sensors (i.e. finding their relative poses) is required to exploit effectively all of the sensor measurements and to perform data fusion. In the literature, most works employing several LRFs obtain their extrinsic calibration from manual measurements or from ad-hoc solutions. In this paper we present a new method to obtain such calibration easily and robustly by scanning perpendicular planes (typically corners encountered in structured scenes), from which geometric constraints are inferred. This technique can be applied to a rig with any number of LRFs in almost any geometric configuration (a minimum of two LRFs whose scanning planes are not parallel is required). Experimental results are presented with synthetic and real data to validate our proposal. A C++ implementation of this method and a dataset are also provided.

CarSpeak

This paper introduces CarSpeak, a communication system for autonomous driving. CarSpeak enables a car to query and access sensory information captured by other cars in a manner similar to how it accesses information from its local sensors. CarSpeak adopts a content-centric approach where information objects -- i.e., regions along the road -- are first class citizens. It names and accesses road regions using a multi-resolution system, which allows it to scale the amount of transmitted data with the available bandwidth. CarSpeak also changes the MAC protocol so that, instead of having nodes contend for the medium, contention is between road regions, and the medium share assigned to any region depends on the number of cars interested in that region.

CarSpeak is implemented in a state-of-the-art autonomous driving system and tested on indoor and outdoor hardware testbeds including an autonomous golf car and 10 iRobot Create robots. In comparison with a baseline that directly uses 802.11, CarSpeak reduces the time for navigating around obstacles by 2.4x, and reduces the probability of a collision due to limited visibility by 14x.

Traffic jams: dynamics and control

This introductory paper reviews the current state-of-the-art scientific methods used for modelling, analysing and controlling the dynamics of vehicular traffic. Possible mechanisms underlying traffic jam formation and propagation are presented from a dynamical viewpoint. Stable and unstable motions are described that may give the skeleton of traffic dynamics, and the effects of driver behaviour are emphasized in determining the emergent state in a vehicular system. At appropriate points, references are provided to the papers published in the corresponding Theme Issue.