1
|
Skrickij V, Kojis P, Šabanovič E, Shyrokau B, Ivanov V. Review of Integrated Chassis Control Techniques for Automated Ground Vehicles. Sensors (Basel) 2024; 24:600. [PMID: 38257691 PMCID: PMC10819876 DOI: 10.3390/s24020600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 01/14/2024] [Accepted: 01/15/2024] [Indexed: 01/24/2024]
Abstract
Integrated chassis control systems represent a significant advancement in the dynamics of ground vehicles, aimed at enhancing overall performance, comfort, handling, and stability. As vehicles transition from internal combustion to electric platforms, integrated chassis control systems have evolved to meet the demands of electrification and automation. This paper analyses the overall control structure of automated vehicles with integrated chassis control systems. Integration of longitudinal, lateral, and vertical systems presents complexities due to the overlapping control regions of various subsystems. The presented methodology includes a comprehensive examination of state-of-the-art technologies, focusing on algorithms to manage control actions and prevent interference between subsystems. The results underscore the importance of control allocation to exploit the additional degrees of freedom offered by over-actuated systems. This paper systematically overviews the various control methods applied in integrated chassis control and path tracking. This includes a detailed examination of perception and decision-making, parameter estimation techniques, reference generation strategies, and the hierarchy of controllers, encompassing high-level, middle-level, and low-level control components. By offering this systematic overview, this paper aims to facilitate a deeper understanding of the diverse control methods employed in automated driving with integrated chassis control, providing insights into their applications, strengths, and limitations.
Collapse
Affiliation(s)
- Viktor Skrickij
- Transport and Logistics Competence Centre, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania
| | - Paulius Kojis
- Department of Mobile Machinery and Railway Transport, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10105 Vilnius, Lithuania
| | - Eldar Šabanovič
- Transport and Logistics Competence Centre, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania
| | - Barys Shyrokau
- Department of Cognitive Robotics, Delft University of Technology, 2628 CD Delft, The Netherlands
| | - Valentin Ivanov
- Smart Vehicle Systems—Working Group, Technische Universität Ilmenau, Ehrenbergstr, 15, 98693 Ilmenau, Germany
| |
Collapse
|
2
|
Itu R, Danescu R. Fully Convolutional Neural Network for Vehicle Speed and Emergency-Brake Prediction. Sensors (Basel) 2023; 24:212. [PMID: 38203074 PMCID: PMC10781285 DOI: 10.3390/s24010212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 12/20/2023] [Accepted: 12/28/2023] [Indexed: 01/12/2024]
Abstract
Ego-vehicle state prediction represents a complex and challenging problem for self-driving and autonomous vehicles. Sensorial information and on-board cameras are used in perception-based solutions in order to understand the state of the vehicle and the surrounding traffic conditions. Monocular camera-based methods are becoming increasingly popular for driver assistance, with precise predictions of vehicle speed and emergency braking being important for road safety enhancement, especially in the prevention of speed-related accidents. In this research paper, we introduce the implementation of a convolutional neural network (CNN) model tailored for the prediction of vehicle velocity, braking events, and emergency braking, employing sequential image sequences and velocity data as inputs. The CNN model is trained on a dataset featuring sequences of 20 consecutive images and corresponding velocity values, all obtained from a moving vehicle navigating through road-traffic scenarios. The model's primary objective is to predict the current vehicle speed, braking actions, and the occurrence of an emergency-brake situation using the information encoded in the preceding 20 frames. We subject our proposed model to an evaluation on a dataset using regression and classification metrics, and comparative analysis with existing published work based on recurrent neural networks (RNNs). Through our efforts to improve the prediction accuracy for velocity, braking behavior, and emergency-brake events, we make a substantial contribution to improving road safety and offer valuable insights for the development of perception-based techniques in the field of autonomous vehicles.
Collapse
Affiliation(s)
- Razvan Itu
- Computer Science Department, Technical University of Cluj-Napoca, St. Memorandumului 28, 400114 Cluj-Napoca, Romania;
| | | |
Collapse
|
3
|
Tan C, Cai Y, Wang H, Sun X, Chen L. Vehicle State Estimation Combining Physics-Informed Neural Network and Unscented Kalman Filtering on Manifolds. Sensors (Basel) 2023; 23:6665. [PMID: 37571450 PMCID: PMC10422649 DOI: 10.3390/s23156665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 07/12/2023] [Accepted: 07/21/2023] [Indexed: 08/13/2023]
Abstract
This paper proposes a novel vehicle state estimation (VSE) method that combines a physics-informed neural network (PINN) and an unscented Kalman filter on manifolds (UKF-M). This VSE aimed to achieve inertial measurement unit (IMU) calibration and provide comprehensive information on the vehicle's dynamic state. The proposed method leverages a PINN to eliminate IMU drift by constraining the loss function with ordinary differential equations (ODEs). Then, the UKF-M is used to estimate the 3D attitude, velocity, and position of the vehicle more accurately using a six-degrees-of-freedom vehicle model. Experimental results demonstrate that the proposed PINN method can learn from multiple sensors and reduce the impact of sensor biases by constraining the ODEs without affecting the sensor characteristics. Compared to the UKF-M algorithm alone, our VSE can better estimate vehicle states. The proposed method has the potential to automatically reduce the impact of sensor drift during vehicle operation, making it more suitable for real-world applications.
Collapse
Affiliation(s)
- Chenkai Tan
- Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China; (C.T.)
| | - Yingfeng Cai
- Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China; (C.T.)
| | - Hai Wang
- School of Automotive and Traffic Engineering, Jiangsu University, Zhenjiang 212013, China
| | - Xiaoqiang Sun
- Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China; (C.T.)
| | - Long Chen
- Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China; (C.T.)
| |
Collapse
|
4
|
Qi D, Feng J, Li Y, Wang L, Song B. A Robust Hierarchical Estimation Scheme for Vehicle State Based on Maximum Correntropy Square-Root Cubature Kalman Filter. Entropy (Basel) 2023; 25:453. [PMID: 36981341 PMCID: PMC10048041 DOI: 10.3390/e25030453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Revised: 03/02/2023] [Accepted: 03/03/2023] [Indexed: 06/18/2023]
Abstract
Accurate acquisition of vehicle dynamics state information is essential for vehicle active safety control systems. However, these states cannot be easily measured, and the measurement is expensive. Conventional Kalman filters perform well for vehicle state estimation in Gaussian environments but exhibit low accuracy and robustness under practical non-Gaussian noise. Vehicle model parameter ingestion, inaccurate tire force calculation, and non-Gaussian noise from on-board sensors cause great challenges to the estimation of vehicle driving states. Therefore, this paper presents a robust hierarchical estimation scheme for vehicle driving state based on the maximum correntropy square-root cubature Kalman filter (MCSCKF) using easily measurable on-board sensor information. First, the vehicle mass is dynamically updated based on the recursive least squares (FRLS) method with a forgetting factor. Then, an adaptive sliding mode observer (ASMO) is designed to estimate the longitudinal and lateral tire forces. Ultimately, the vehicle states are estimated based on the MCSCKF under non-Gaussian noise. Two typical operating situations are carried out to verify the validity of the proposed estimation scheme. The results prove that the proposed estimation scheme can estimate the vehicle's driving state accurately compared to other common methods. And the MCSCKF algorithm has better accuracy and robustness than the traditional Kalman filters for vehicle state estimation in non-Gaussian situations.
Collapse
Affiliation(s)
- Dengliang Qi
- College of Mechanical and Electrical Engineering, Shihezi University, Shihezi 832003, China
| | - Jingan Feng
- College of Mechanical and Electrical Engineering, Shihezi University, Shihezi 832003, China
| | - Yongbin Li
- College of Mechanical and Electrical Engineering, Shihezi University, Shihezi 832003, China
| | - Lei Wang
- College of Mechanical and Electrical Engineering, Shihezi University, Shihezi 832003, China
| | - Bao Song
- School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
5
|
Šabanovič E, Kojis P, Šukevičius Š, Shyrokau B, Ivanov V, Dhaens M, Skrickij V. Feasibility of a Neural Network-Based Virtual Sensor for Vehicle Unsprung Mass Relative Velocity Estimation. Sensors (Basel) 2021; 21:s21217139. [PMID: 34770447 PMCID: PMC8587321 DOI: 10.3390/s21217139] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 10/16/2021] [Accepted: 10/25/2021] [Indexed: 11/16/2022]
Abstract
With the automotive industry moving towards automated driving, sensing is increasingly important in enabling technology. The virtual sensors allow data fusion from various vehicle sensors and provide a prediction for measurement that is hard or too expensive to measure in another way or in the case of demand on continuous detection. In this paper, virtual sensing is discussed for the case of vehicle suspension control, where information about the relative velocity of the unsprung mass for each vehicle corner is required. The corresponding goal can be identified as a regression task with multi-input sequence input. The hypothesis is that the state-of-art method of Bidirectional Long–Short Term Memory (BiLSTM) can solve it. In this paper, a virtual sensor has been proposed and developed by training a neural network model. The simulations have been performed using an experimentally validated full vehicle model in IPG Carmaker. Simulations provided the reference data which were used for Neural Network (NN) training. The extensive dataset covering 26 scenarios has been used to obtain training, validation and testing data. The Bayesian Search was used to select the best neural network structure using root mean square error as a metric. The best network is made of 167 BiLSTM, 256 fully connected hidden units and 4 output units. Error histograms and spectral analysis of the predicted signal compared to the reference signal are presented. The results demonstrate the good applicability of neural network-based virtual sensors to estimate vehicle unsprung mass relative velocity.
Collapse
Affiliation(s)
- Eldar Šabanovič
- Transport and Logistics Competence Centre, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania; (P.K.); (V.S.)
- Correspondence:
| | - Paulius Kojis
- Transport and Logistics Competence Centre, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania; (P.K.); (V.S.)
| | - Šarūnas Šukevičius
- Department of Mobile Machinery and Railway Transport, Transport Engineering Faculty, Vilnius Gediminas Technical University, 08101 Vilnius, Lithuania;
| | - Barys Shyrokau
- Department of Cognitive Robotics, Delft University of Technology, 2628 CD Delft, The Netherlands;
| | - Valentin Ivanov
- Automotive Engineering Group, Technische Universität Ilmenau, 98693 Ilmenau, Germany;
| | - Miguel Dhaens
- Tenneco Automotive Europe, 3800 Sint-Truiden, Belgium;
| | - Viktor Skrickij
- Transport and Logistics Competence Centre, Transport Engineering Faculty, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania; (P.K.); (V.S.)
| |
Collapse
|
6
|
Ruggaber J, Brembeck J. A Novel Kalman Filter Design and Analysis Method Considering Observability and Dominance Properties of Measurands Applied to Vehicle State Estimation. Sensors (Basel) 2021; 21:4750. [PMID: 34300490 DOI: 10.3390/s21144750] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 06/25/2021] [Accepted: 07/06/2021] [Indexed: 11/28/2022]
Abstract
In Kalman filter design, the filter algorithm and prediction model design are the most discussed topics in research. Another fundamental but less investigated issue is the careful selection of measurands and their contribution to the estimation problem. This is often done purely on the basis of empirical values or by experiments. This paper presents a novel holistic method to design and assess Kalman filters in an automated way and to perform their analysis based on quantifiable parameters. The optimal filter parameters are computed with the help of a nonlinear optimization algorithm. To determine and analyze an optimal filter design, two novel quantitative nonlinear observability measures are presented along with a method to quantify the dominance contribution of a measurand to an estimate. As a result, different filter configurations can be specifically investigated and compared with respect to the selection of measurands and their influence on the estimation. An unscented Kalman filter algorithm is used to demonstrate the method’s capabilities to design and analyze the estimation problem parameters. For this purpose, an example of a vehicle state estimation with a focus on the tire-road friction coefficient is used, which represents a challenging problem for classical analysis and filter parameterization.
Collapse
|
7
|
Kim B, Baek Y. Sensor-Based Extraction Approaches of In-Vehicle Information for Driver Behavior Analysis. Sensors (Basel) 2020; 20:s20185197. [PMID: 32933088 PMCID: PMC7571261 DOI: 10.3390/s20185197] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 09/07/2020] [Accepted: 09/10/2020] [Indexed: 11/16/2022]
Abstract
Advances in vehicle technology have resulted in the development of vehicles equipped with sensors to acquire standardized information such as engine speed and vehicle speed from the in-vehicle controller area network (CAN) system. However, there are challenges in acquiring proprietary information from CAN frames, such as the brake pedal and steering wheel operation, which are essential for driver behavior analysis. Such information extraction requires electronic control unit identifier analysis and accompanying data interpretation. In this paper, we present a system for the automatic extraction of proprietary in-vehicle information using sensor data correlated with the desired information. First, the proposed system estimates the vehicle's driving status through threshold-, random forest-, and long short-term memory-based techniques using inertial measurement unit and global positioning system values. Then, the system segments in-vehicle CAN frames using the estimation and evaluates each segment with our scoring method to select suitable candidates by examining the similarity between each candidate and its estimation through the suggested distance matching technique. We conduct comprehensive experiments of the proposed system using real vehicles in an urban environment. Performance evaluation shows that the estimation accuracy of the driving condition is 84.20%, and the extraction accuracy of the in-vehicle information is 82.31%, which implies that the presented approaches are quite feasible for automatic extraction of proprietary in-vehicle information.
Collapse
|
8
|
Jin X, Yin G, Chen N. Advanced Estimation Techniques for Vehicle System Dynamic State: A Survey. Sensors (Basel) 2019; 19:s19194289. [PMID: 31623345 PMCID: PMC6806602 DOI: 10.3390/s19194289] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2019] [Revised: 09/28/2019] [Accepted: 09/30/2019] [Indexed: 11/16/2022]
Abstract
In order to improve handling stability performance and active safety of a ground vehicle, a large number of advanced vehicle dynamics control systems-such as the direct yaw control system and active front steering system, and in particular the advanced driver assistance systems-towards connected and automated driving vehicles have recently been developed and applied. However, the practical effects and potential performance of vehicle active safety dynamics control systems heavily depend on real-time knowledge of fundamental vehicle state information, which is difficult to measure directly in a standard car because of both technical and economic reasons. This paper presents a comprehensive technical survey of the development and recent research advances in vehicle system dynamic state estimation. Different aspects of estimation strategies and methodologies in recent literature are classified into two main categories-the model-based estimation approach and the data-driven-based estimation approach. Each category is further divided into several sub-categories from the perspectives of estimation-oriented vehicle models, estimations, sensor configurations, and involved estimation techniques. The principal features of the most popular methodologies are summarized, and the pros and cons of these methodologies are also highlighted and discussed. Finally, future research directions in this field are provided.
Collapse
Affiliation(s)
- Xianjian Jin
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China.
- State Key Laboratory of Automotive Simulation and Control, Jilin University, Changchun 130025, China.
| | - Guodong Yin
- State Key Laboratory of Automotive Simulation and Control, Jilin University, Changchun 130025, China
- School of Mechanical Engineering, Southeast University, Nanjing 211189, China
| | - Nan Chen
- School of Mechanical Engineering, Southeast University, Nanjing 211189, China
| |
Collapse
|
9
|
Brembeck J. Nonlinear Constrained Moving Horizon Estimation Applied to Vehicle Position Estimation. Sensors (Basel) 2019; 19:s19102276. [PMID: 31100983 PMCID: PMC6567158 DOI: 10.3390/s19102276] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Revised: 04/30/2019] [Accepted: 05/11/2019] [Indexed: 11/16/2022]
Abstract
The design of high–performance state estimators for future autonomous vehicles constitutes a challenging task, because of the rising complexity and demand for operational safety. In this application, a vehicle state observer with a focus on the estimation of the quantities position, yaw angle, velocity, and yaw rate, which are necessary for a path following control for an autonomous vehicle, is discussed. The synthesis of the vehicle’s observer model is a trade-off between modelling complexity and performance. To cope with the vehicle still stand situations, the framework provides an automatic event handling functionality. Moreover, by means of an efficient root search algorithm, map-based information on the current road boundaries can be determined. An extended moving horizon state estimation algorithm enables the incorporation of delayed low bandwidth Global Navigation Satellite System (GNSS) measurements—including out of sequence measurements—as well as the possibility to limit the vehicle position change through the knowledge of the road boundaries. Finally, different moving horizon observer configurations are assessed in a comprehensive case study, which are compared to a conventional extended Kalman filter. These rely on real-world experiment data from vehicle testdrive experiments, which show very promising results for the proposed approach.
Collapse
Affiliation(s)
- Jonathan Brembeck
- Institute of System Dynamics and Control, Robotics and Mechatronics Center, German Aerospace Center (DLR), 82234 Weßling, Germany.
| |
Collapse
|
10
|
Tuononen AJ. Vehicle lateral state estimation based on measured tyre forces. Sensors (Basel) 2009; 9:8761-75. [PMID: 22291535 PMCID: PMC3260612 DOI: 10.3390/s91108761] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2009] [Revised: 10/14/2009] [Accepted: 10/21/2009] [Indexed: 11/18/2022]
Abstract
Future active safety systems need more accurate information about the state of vehicles. This article proposes a method to evaluate the lateral state of a vehicle based on measured tyre forces. The tyre forces of two tyres are estimated from optically measured tyre carcass deflections and transmitted wirelessly to the vehicle body. The two remaining tyres are so-called virtual tyre sensors, the forces of which are calculated from the real tyre sensor estimates. The Kalman filter estimator for lateral vehicle state based on measured tyre forces is presented, together with a simple method to define adaptive measurement error covariance depending on the driving condition of the vehicle. The estimated yaw rate and lateral velocity are compared with the validation sensor measurements.
Collapse
Affiliation(s)
- Ari J Tuononen
- Laboratory of Automotive Engineering, Helsinki University of Technology, P.O. Box 4300, 02015 TKK, Finland; E-Mail: ; Tel.: +358-50 5604702
| |
Collapse
|