Prior Familiarization With Takeover Requests Affects Drivers' Takeover Performance and Automation Trust

Exploring driving anger-caused impairment of takeover performance among professional taxi drivers during partially automated driving

Partially automated systems are expected to reduce road crashes related to human error, even amongst professional drivers. Consequently, the applications of these systems into the taxi industry would potentially improve transportation safety. However, taxi drivers are prone to experiencing driving anger, which may subsequently affect their takeover performance. In this research, we explored how driving anger emotion affects taxi drivers' driving performance in various takeover scenarios, namely Mandatory Automation-Initiated transition (MAIT), Mandatory Driver-Initiated transition (MDIT), and Optional Driver-Initiated transition (ODIT). Forty-seven taxi drivers participated in this 2·3 mixed design simulator experiment (between-subjects: anger vs. calmness; within-subjects: MAIT vs. MDIT vs. ODIT). Compared to calmness, driving anger emotion led to a narrower field of attention (e.g., smaller standard deviations of horizontal fixation points position) and worse hazard perception (e.g., longer saccade latency, smaller amplitude of skin conductance responses), which resulted in longer takeover time and inferior vehicle control stability (e.g., higher standard deviations of lateral position) in MAIT and MDIT scenarios. Angry taxi drivers were more likely to deactivate vehicle automation and take over the vehicle in a more aggressive manner (e.g., higher maximal resulting acceleration, refusing to yield to other road users) in ODIT scenarios. The findings will contribute to addressing the safety concerns related to driving anger among professional taxi drivers and promote the widespread acceptance and integration of partially automated systems within the taxi industry.

Once a driver, always a driver - Manual driving style persists in automated driving takeover

As automated vehicles require human drivers to resume control in critical situations, predicting driver takeover behaviour could be beneficial for safe transitions of control. While previous research has explored predicting takeover behaviour in relation to driver state and traits, little work has examined the predictive value of manual driving style. We hypothesised that drivers' behaviour during manual driving is predictive of their takeover behaviour when resuming control from an automated vehicle. We assessed 38 drivers with varying experience in a high-fidelity driving simulator. After completing manual driving sessions to assess their driving style, participants performed an automated driving task, typically on a subsequent date. Measures of driving style from manual driving sessions, including headway and lane change speed, were found to be predictive of takeover behaviour. The level of driving experience was associated with the behavioural measures, but correlations between measures of manual driving style and takeover behaviour remained after controlling for driver experience. Our findings demonstrate that how drivers reclaim control from their automated vehicle is not an isolated phenomenon but is associated with manual driving behaviour and driving experience. Strategies to improve takeover safety and comfort could be based on driving style measures, for example by the automated vehicle adapting its behaviour to match a driver's driving style.

Fostering Drivers' Trust in Automated Driving Styles: The Role of Driver Perception of Automated Driving Maneuvers

OBJECTIVE

This study investigated the impact of driving styles of drivers and automated vehicles (AVs) on drivers' perception of automated driving maneuvers and quantified the relationships among drivers' perception of AV maneuvers, driver trust, and acceptance of AVs.

BACKGROUND

Previous studies on automated driving styles focused on the impact of AV's global driving style on driver's attitude and driving performance. However, research on drivers' perception of automated driving maneuvers at the specific driving style level is still lacking.

METHOD

Sixteen aggressive drivers and sixteen defensive drivers were recruited to experience twelve driving scenarios in either an aggressive AV or a defensive AV on the driving simulator. Their perception of AV maneuvers, trust, and acceptance was measured via questionnaires, and driving performance was collected via the driving simulator.

RESULTS

Results revealed that drivers' trust and acceptance of AVs would decrease significantly if they perceived AVs to have a higher speed, larger deceleration, smaller deceleration, or shorter stopping distance than expected. Moreover, defensive drivers perceived significantly greater inappropriateness of these maneuvers from aggressive AVs than defensive AVs, whereas aggressive drivers didn't differ significantly in their perceived inappropriateness of these maneuvers with different driving styles.

CONCLUSION

The driving styles of automated vehicles and drivers influenced drivers' perception of automated driving maneuvers, which influence their trust and acceptance of AVs.

APPLICATION

This study suggested that the design of AVs should consider drivers' perceptions of automated driving maneuvers to avoid undermining drivers' trust and acceptance of AVs.

How Can the Trust-Change Direction be Measured and Identified During Takeover Transitions in Conditionally Automated Driving? Using Physiological Responses and Takeover-Related Factors

OBJECTIVE

This paper proposes an objective method to measure and identify trust-change directions during takeover transitions (TTs) in conditionally automated vehicles (AVs).

BACKGROUND

Takeover requests (TORs) will be recurring events in conditionally automated driving that could undermine trust, and then lead to inappropriate reliance on conditionally AVs, such as misuse and disuse.

METHOD

34 drivers engaged in the non-driving-related task were involved in a sequence of takeover events in a driving simulator. The relationships and effects between drivers' physiological responses, takeover-related factors, and trust-change directions during TTs were explored by the combination of an unsupervised learning algorithm and statistical analyses. Furthermore, different typical machine learning methods were applied to establish recognition models of trust-change directions during TTs based on takeover-related factors and physiological parameters.

RESULT

Combining the change values in the subjective trust rating and monitoring behavior before and after takeover can reliably measure trust-change directions during TTs. The statistical analysis results showed that physiological parameters (i.e., skin conductance and heart rate) during TTs are negatively linked with the trust-change directions. And drivers were more likely to increase trust during TTs when they were in longer TOR lead time, with more takeover frequencies, and dealing with the stationary vehicle scenario. More importantly, the F1-score of the random forest (RF) model is nearly 77.3%.

CONCLUSION

The features investigated and the RF model developed can identify trust-change directions during TTs accurately.

APPLICATION

Those findings can provide additional support for developing trust monitoring systems to mitigate both drivers' overtrust and undertrust in conditionally AVs.

Getting back in the loop: Does autonomous driving duration affect driver's takeover performance?

The level 3 autonomous driving function allows the driver to perform non-driving-related tasks such as watching movies or reading while the system manages the driving task. However, when a difficult situation arises, the driver is requested to return to the loop of control. This switching from driver to passenger then back to driver may modify the driving paradigm, potentially causing an out-of-the-loop state. We tested the hypothesis of a linear (progressive) impact of various autonomous driving durations: the longer the level 3 autonomous function is used, the poorer the driver's takeover performance. Fifty-two participants were divided into 4 groups, each group being assigned a specific period of autonomous driving (5, 15, 45, or 60 min), followed by a takeover request with a time budget of 8.3 s. Takeover performance was assessed over two successive drives via reaction times and manual driving metrics (trajectories). The initial hypothesis (linearity) was not confirmed: there was a nonlinear relationship between autonomous driving duration and takeover performance, with one duration (15 min) appearing safer overall and mixed performance within groups. Repetition induced a major change in performance during the second drive, indicating rapid adaptation to the situation. The non-driving-related task appears critical in several respects (dynamics, content, driver interest) to proper use of level 3 automation. All this supports previous research prompting reservations about the prospect of car driving becoming like train travel.

Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review

OBJECTIVE

In this review, we investigate the relationship between agent transparency, Situation Awareness, mental workload, and operator performance for safety critical domains.

BACKGROUND

The advancement of highly sophisticated automation across safety critical domains poses a challenge for effective human oversight. Automation transparency is a design principle that could support humans by making the automation's inner workings observable (i.e., "seeing-into"). However, experimental support for this has not been systematically documented to date.

METHOD

Based on the PRISMA method, a broad and systematic search of the literature was performed focusing on identifying empirical research investigating the effect of transparency on central Human Factors variables.

RESULTS

Our final sample consisted of 17 experimental studies that investigated transparency in a controlled setting. The studies typically employed three human-automation interaction types: responding to agent-generated proposals, supervisory control of agents, and monitoring only. There is an overall trend in the data pointing towards a beneficial effect of transparency. However, the data reveals variations in Situation Awareness, mental workload, and operator performance for specific tasks, agent-types, and level of integration of transparency information in primary task displays.

CONCLUSION

Our data suggests a promising effect of automation transparency on Situation Awareness and operator performance, without the cost of added mental workload, for instances where humans respond to agent-generated proposals and where humans have a supervisory role.

APPLICATION

Strategies to improve human performance when interacting with intelligent agents should focus on allowing humans to see into its information processing stages, considering the integration of information in existing Human Machine Interface solutions.

Calibration of Trust in Automated Driving: A Matter of Initial Level of Trust and Automated Driving Style?

OBJECTIVE

Automated driving is becoming a reality, and such technology raises new concerns about human-machine interaction on road. This paper aims to investigate factors influencing trust calibration and evolution over time.

BACKGROUND

Numerous studies showed trust was a determinant in automation use and misuse, particularly in the automated driving context.

METHOD

Sixty-one drivers participated in an experiment aiming to better understand the influence of initial level of trust (Trustful vs. Distrustful) on drivers' behaviors and trust calibration during two sessions of simulated automated driving. The automated driving style was manipulated as positive (smooth) or negative (abrupt) to investigate human-machine early interactions. Trust was assessed over time through questionnaires. Drivers' visual behaviors and take-over performances during an unplanned take-over request were also investigated.

RESULTS

Results showed an increase of trust over time, for both Trustful and Distrustful drivers regardless the automated driving style. Trust was also found to fluctuate over time depending on the specific events handled by the automated vehicle. Take-over performances were not influenced by the initial level of trust nor automated driving style.

CONCLUSION

Trust in automated driving increases rapidly when drivers' experience such a system. Initial level of trust seems to be crucial in further trust calibration and modulate the effect of automation performance. Long-term trust evolutions suggest that experience modify drivers' mental model about automated driving systems.

APPLICATION

In the automated driving context, trust calibration is a decisive question to guide such systems' proper utilization, and road safety.

Evaluation of Imminent Take-Over Requests With Real Automation on a Test Track

OBJECTIVE

Investigating take-over, driving, non-driving related task (NDRT) performance, and trust of conditionally automated vehicles (AVs) in critical transitions on a test track.

BACKGROUND

Most experimental results addressing driver take-over were obtained in simulators. The presented experiment aimed at validating relevant findings while uncovering potential effects of motion cues and real risk.

METHOD

Twenty-two participants responded to four critical transitions on a test track. Non-driving related task modality (reading on a handheld device vs. auditory) and take-over timing (cognitive load) were varied on two levels. We evaluated take-over and NDRT performance as well as gaze behavior. Further, trust and workload were assessed with scales and interviews.

RESULTS

Reaction times were significantly faster than in simulator studies. Further, reaction times were only barely affected by varying visual, physical, or cognitive load. Post-take-over control was significantly degraded with the handheld device. Experiencing the system reduced participants' distrust, and distrusting participants monitored the system longer and more frequently. NDRTs on a handheld device resulted in more safety-critical situations.

CONCLUSION

The results confirm that take-over performance is mainly influenced by visual-cognitive load, while physical load did not significantly affect responses. Future take-over request (TOR) studies may investigate situation awareness and post-take-over control rather than reaction times only. Trust and distrust can be considered as different dimensions in AV research.

APPLICATION

Conditionally AVs should offer dedicated interfaces for NDRTs to provide an alternative to using nomadic devices. These interfaces should be designed in a way to maintain drivers' situation awareness.

PRÉCIS

This paper presents a test track experiment addressing conditionally automated driving systems. Twenty-two participants responded to critical TORs, where we varied NDRT modality and take-over timing. In addition, we assessed trust and workload with standardized scales and interviews.

Understanding trust calibration in automated driving: the effect of time, personality, and system warning design

Under the human-automation codriving future, dynamic trust should be considered. This paper explored how trust changes over time and how multiple factors (time, trust propensity, neuroticism, and takeover warning design) calibrate trust together. We launched two driving simulator experiments to measure drivers' trust before, during, and after the experiment under takeover scenarios. The results showed that trust in automation increased during short-term interactions and dropped after four months, which is still higher than pre-experiment trust. Initial trust and trust propensity had a stable impact on trust. Drivers trusted the system more with the two-stage (MR + TOR) warning design than the one-stage (TOR). Neuroticism had a significant effect on the countdown compared with the content warning.Practitioner summary: The results provide new data and knowledge for trust calibration in the takeover scenario. The findings can help design a more reasonable automated driving system in long-term human-automation interactions.

Where drivers are looking at during takeover: Implications for safe takeovers during conditionally automated driving

OBJECTIVE

Safety has become one of the primary concerns of level 3 automated driving, especially during the takeover process. Since most studies have focused on impacts of various factors on takeover performance of drivers, there seems to be a gap between the causes of crashes and the desired means to mitigate their occurrence and consequences. Hence, the main objective of this study is to extract from crash data during takeovers drivers' patterns of gaze behaviors and maneuvers and then utilize them to extract some guidance on human-machine-interface design to enhance safety and acceptability of automated driving.

METHODS

A study involving 27 subjects was conducted on a high-fidelity driving simulator with a Steward motion platform of six degrees of freedom. Each subject participated in 6 takeover scenarios with a lead time of 5 s and different duration of monitoring (DoM), with their maneuvers recorded by the system and eye gazes recorded by the Smart Eye Pro and Smart Recorder. Crash data collected during the takeover process were then utilized for the analysis.

RESULTS

From 132 valid takeovers collected from 23 out of the 27 participants, 15 crashes were recorded. Based on which, five typical patterns of unsafe behaviors were recognized that may have caused the crashes, denoted as Type I to Type V, respectively. Besides, it appears that even if drivers were given more time to observe the surroundings, i.e., longer DoM, the number of crashes has not decreased as anticipated. Therefore, what is more important seems to be drivers' gaze behaviors and maneuvers shortly after TOR.

CONCLUSIONS

For takeovers to be safe, good cooperations between drivers' gaze behaviors and maneuvers are essential. Overall, it seems that in emergent situations that require takeovers, some drivers have difficulty in allocating attentions reasonably, which appears to have less to do with the time left for drivers to observe the surroundings. While designing HMIs, we may as well consider providing enough information to guide drivers according to drivers' states and maneuvers at the time to improve safety of takeovers in emergent situations, and more importantly, to provide the information timely and effectively.

Training for the safe activation of Automated Vehicles matters: Revealing the benefits of online training to creating glaringly better mental models and behaviour

Automated Vehicle (AV) systems are expected to reduce the frequency and severity of on-road collisions. Unless drivers have an appropriate mental model for the capabilities and limitations of the automation, they may not activate the automation safely or appropriately on the road, potentially leading to a collision. As such, a training package (L4DTP) was developed to improve drivers' decisions and behaviour when activating an AV system and this was evaluated in a between-subjects simulator experiment. Drivers received no training (NT, control group), read an owner's manual (OM, experimental group 1: current training provision) or underwent the L4DTP (experimental group 2: new training programme). All drivers then experienced five scenarios in a driving simulator where they encountered road conditions which were safe and unsafe for activation. Their activation decisions, behaviour, trust in automation, workload and mental models were measured. This experiment found that drivers who read the OM or underwent the L4DTP made better activation decisions and showed better activation behaviour compared to drivers who received NT. Additionally, drivers who underwent the L4DTP found it easier, less demanding and felt under less time pressure when making their decisions, had to expend less effort to reach the same activation performance and had more appropriate and comprehensive mental models for when the automation can be activated compared to drivers who read the OM. This L4DTP can make roads safer by reducing collisions linked to poor activation decisions and behaviour. Therefore, there is the potential for a real benefit for society if this training programme is adopted into mandatory AV driver training.

Impact of non-driving related tasks while operating automated driving systems (ADS): A systematic review

Automated Driving Systems (ADS) (SAE, 2021), promise improved safety and comfort for drivers. Current technological advances have resulted in increased automation capabilities. However, with the increase in automation capabilities, there is a shift in how drivers interact with their vehicles. Drivers can now temporarily hand over the control of the driving task to ADS under certain conditions. However, with ADS in temporary control of the vehicle, drivers may choose to engage in non-driving related tasks (NDRT). The current capabilities of ADS do not allow drivers to hand over control of the driving task indefinitely. Drivers must remain aware and be ready to take back control if necessary. There is a need to better understand drivers' performance and behaviors when driving with ADS, especially when engaged in NDRTs. This literature review, therefore, aims to understand the state of knowledge on automated vehicle systems and driver distraction. This review was conducted as per PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Studies found a significant increase in takeover times while engaging in NDRTs and driving with automation active. Studies also discuss a change in driver's visual attention, with more focus given to NDRTs as compared to the front roadway. The concerning effects of increasing reaction times and decreases in visual attention can be mitigated by using interventions and studies have had success in redirecting drivers attention and reorient them to the task of driving. The review, therefore, includes a discussion of ADS and NDRT engagement and its impact on driving behaviors such as take-over times, visual attention, trust, and workload. Implications on driver safety and performance are discussed in light of this synthesis.

A new approach for Training Needs Analysis: A case study using an Automated Vehicle

Considerable resources are invested each year into training to ensure trainees have the required competencies to safely and effectively perform their tasks/jobs. As such, it is important to develop effective training programmes which target those required competencies. One method that can be used at the start of the training lifecycle to establish the tasks and competencies that are required for a task/job and is considered an important activity to perform when developing a training programme is a Training Needs Analysis (TNA). This article presents a new TNA approach and uses an Automated Vehicle (AV) case study to demonstrate this new approach for a specific AV scenario within the current UK road system. A Hierarchical Task Analysis (HTA) was performed in order to identify the overall goal and tasks that drivers need to perform to operate the AV system safely on the road. This HTA identified 7 main tasks which were decomposed into 26 sub-tasks and 2428 operations. Then, six AV driver training themes from the literature were combined with the Knowledge, Skills and Attitudes (KSA) taxonomy to identify the KSAs that drivers need to perform the tasks, sub-tasks and operations that were identified in the HTA (training needs). This resulted in the identification of over 100 different training needs. This new approach helped to identify more tasks, operations and training needs than previous TNAs which applied the KSA taxonomy alone. As such, a more comprehensive TNA for drivers of the AV system was produced. This can be more easily translated into the development and evaluation of future training programmes for drivers of AV systems.

Effects of brand and brand trust on initial trust in fully automated driving system

Before Automated Driving Systems (ADS) with full driving automation (SAE Level 5) are placed into practical use, the issue of calibrating drivers' initial trust in Level 5 ADS to an appropriate degree to avoid inappropriate disuse or improper use should be resolved. This study aimed to identify the factors that affected drivers' initial trust in Level 5 ADS. We conducted two online surveys. Of these, one explored the effects of automobile brands and drivers' trust in automobile brands on drivers' initial trust in Level 5 ADS using a Structural Equation Model (SEM). The other identified drivers' cognitive structures regarding automobile brands using the Free Word Association Test (FWAT) and summarized the characteristics that resulted in higher initial trust among drivers in Level 5 ADS. The results showed that drivers' trust in automobile brands positively impacted their initial trust in Level 5 ADS, which showed invariance across gender and age. In addition, the degree of drivers' initial trust in Level 5 ADS was significantly different across different automobile brands. Furthermore, for automobile brands with higher trust in automobile brands and Level 5 ADS, drivers' cognitive structures were richer and varied, which included particular characteristics. These findings suggest the necessity of considering the influence of automobile brands on calibrating drivers' initial trust in driving automation.

The trustworthy and acceptable HRI checklist (TA-HRI): questions and design recommendations to support a trust-worthy and acceptable design of human-robot interaction

This contribution to the journal Gruppe. Interaktion. Organisation. (GIO) presents a checklist of questions and design recommendations for designing acceptable and trustworthy human-robot interaction (HRI). In order to extend the application scope of robots towards more complex contexts in the public domain and in private households, robots have to fulfill requirements regarding social interaction between humans and robots in addition to safety and efficiency. In particular, this results in recommendations for the design of the appearance, behavior, and interaction strategies of robots that can contribute to acceptance and appropriate trust. The presented checklist was derived from existing guidelines of associated fields of application, the current state of research on HRI, and the results of the BMBF-funded project RobotKoop. The trustworthy and acceptable HRI checklist (TA-HRI) contains 60 design topics with questions and design recommendations for the development and design of acceptable and trustworthy robots. The TA-HRI Checklist provides a basis for discussion of the design of service robots for use in public and private environments and will be continuously refined based on feedback from the community.

Objective assessment of trait attentional control predicts driver response to emergency failures of vehicular automation

With the advent of autonomous driving, the issue of human intervention during safety-critical events is an urgent topic of research. Supervisory monitoring, taking over vehicle control during automation failures and then bringing the vehicle to safety under time pressure are cognitively demanding tasks that pose varying difficulties across the driving population. This underpins a need to investigate individual differences (i.e., how people differ in their dispositional traits) in driver responses to automation system limits, so that autonomous vehicle design can be tailored to meet the safety-critical needs of higher-risk drivers. However, few studies thus far have examined individual differences, with self-report measures showing limited ability to predict driver takeover performance. To address this gap, the present study explored the utility of an established brain activity-based objective index of trait attentional control (frontal theta/beta ratio; TBR) in predicting driver interactions with conditional automation. Frontal TBR predicted drivers' average takeover reaction time, as well as the likelihood of accident after takeover. Moving towards practical applications, this study also demonstrated the utility of streamlined estimates of frontal TBR measured from the forehead electrodes and from a single crown electrode, with the latter showing better fidelity and predictive value. Overall, TBR is behaviourally relevant, measurable with minimal sensors and easily computable, rendering it a promising candidate for practical and objective assessment of drivers' neurocognitive traits that contribute to their AV driving readiness.

Takeover requests for automated driving: The effects of signal direction, lead time, and modality on takeover performance

Vehicle-to-driver takeover will still be needed in semi-autonomous vehicles. Due to the complexity of the takeover process, it is important to develop interfaces to support good takeover performance. Multimodal displays have been proposed as a candidate for the design of takeover requests (TORs), but many questions remain unanswered regarding the effectiveness of this approach. This study investigated the effects of takeover signal direction (ipsilateral vs. contralateral), lead time (4 vs. 7 s), and modality (uni-, bi-, and trimodal combinations of visual, auditory, and tactile signals) on automated vehicle takeover performance. Twenty-four participants rode in a simulated SAE Level 3 vehicle and performed a series of takeover tasks when presented with a TOR. Overall, single and multimodal signals with a tactile component were correlated with the faster takeover and information processing times, and were perceived as most useful. Ipsilateral signals showed a marginally significant benefit to takeover times compared to contralateral signals. Finally, a shorter lead time was associated with faster takeover times, but also poorer takeover quality. Findings from this study can inform the design of in-vehicle information and warning systems for next-generation transportation.

Keeping the driver in the loop through semi-automated or manual lane changes in conditionally automated driving

In the current study we investigated if drivers of conditionally automated vehicles can be kept in the loop through lane change maneuvers. More specifically, we examined whether involving drivers in lane-changes during a conditionally automated ride can influence critical take-over behavior and keep drivers' gaze on the road. In a repeated measures driving simulator study (n = 85), drivers drove the same route three times, each trial containing four lane changes that were all either (1) automated, (2) semi-automated or (3) manual. Each ride ended with a critical take-over situation that could be solved by braking and/or steering. Critical take-over reactions were analyzed with a linear mixed model and parametric accelerated failure time survival analysis. As expected, semi-automated and manual lane changes throughout the ride led to 13.5% and 17.0% faster maximum deceleration compared to automated lane changes. Additionally, semi-automated and manual lane changes improved the quality of the take-over by significantly decreasing standard deviation of the steering wheel angle. Unexpectedly, drivers in the semi-automated condition were slowest to start the braking maneuver. This may have been caused by the drivers' confusion as to how the semi-automated system would react. Additionally, the percentage gaze off-the-road was significantly decreased by the semi-automated (6.0%) and manual (6.6%) lane changes. Taken together, the results suggest that semi-automated and manual transitions may be an alarm-free instrument which developers could use to help maintain drivers' perception-action loop and improve automated driving safety.

Effects of gender, age, experience, and practice on driver reaction and acceptance of traffic jam chauffeur systems

This study conducted a driving simulation experiment to compare four automated driving systems (ADS) designs during lane change demanding traffic situations on highways while accounting for the drivers’ gender, age, experience, and practice. A lane-change maneuver was required when the automated vehicle approaches traffic congestion on the left-hand lane. ADS-1 can only reduce the speed to synchronize with the congestion. ADS-2 reduces the speed and issues an optional request to intervene, advising the driver to change lanes manually. ADS-3 offers to overtake the congestion autonomously if the driver approves it. ADS-4 overtakes the congestion autonomously without the driver’s approval. Results of drivers’ reaction, acceptance, and trust indicated that differences between ADS designs increase when considering the combined effect of drivers’ demographic factors more than the individual effect of each factor. However, the more ADS seems to have driver-like capacities, the more impact of demographic factors is expected. While preliminary, these findings may help us understand how ADS users’ behavior can differ based on the interaction between human demographic factors and system design.

Assessing subjective criticality of take-over situations: Validation of two rating scales

Assessing subjective criticality of take-over situations is crucial for understanding of take-over behavior and comparing studies. However, no validated rating scales exist that assess subjective criticality of take-over situations. In a driving simulator study, two rating scales, the Scale of Criticality Assessment of driving situations from Neukum et al. (2008) and the Criticality Rating Scale, were tested on their validity to assess the subjective criticality of take-over situations. Besides, the subjective and behavioral changes over the repeated experience of take-over situations were investigated. Twenty-five participants experienced a set of five take-over situations with varying time-to-collisions (TTC) at the moment of the take-over request, twice. After each of the first five take-over situations, participants rated the criticality on one scale, after each of the second five situations on the other scale. Correlation coefficients between TTCs and criticality ratings for each scale were calculated. Also, the changes of subjective and behavioral measures over the trials were investigated. Correlation coefficients indicated a strong correlation between criticality ratings and TTCs. Hence, both scales are equally valid for the assessment of the criticality of take-over situations. The repeated experience of the take-over situations did not affect effort ratings, take-over times, or steering wheel positions. But brake input decreased with increasing practice, indicating a safer take-over behavior. Hence, results of studies with repeated experience of take-over situations are relatively valid as only brake behavior changed with increasing practice.

Revisiting human-machine trust: a replication study of Muir and Moray (1996) using a simulated pasteurizer plant task

This study aimed to replicate Muir and Moray that demonstrated operators' trust in automated machines developing from faith, then dependability, and lastly predictability. Following the procedure of Muir and Moray, we asked undergraduate participants to complete a training program in a simulated pasteuriser plant and an experimental program including various errors in the pasteuriser. Results showed that the best predictor of overall trust was not faith but dependability, and that dependability consistently governed trust throughout the interaction with the pasteuriser. Thus, the obtained data patterns were inconsistent with those reported in Muir and Moray. We observed that operators in the current study used automatic control more frequently than manual control to successfully produce performance scores contrary to the operators in Muir and Moray. The results imply that dependability is a critical predictor of human-machine trust, which automation designer may focus on. More extensive future research using more modern automated technologies is necessary for understanding what factors control human-autonomy trust in modern ages. Practitioner Summary: The results suggest that dependability is a key factor that shapes human-machine trust across the time course of the trust development. This replication study suggests a new perspective for designing effective human-machine systems for untrained users who do not go through extensive training programs on automated systems.

What drives people to use automated vehicles? A meta-analytic review

Lack of consumer acceptance is a prominent barrier to the large-scale adoption of automated vehicles (AVs). This study investigated the underlying mechanisms for AV acceptance and how the mechanisms differed across subgroups by reviewing and synthesizing existing literature. We proposed AV acceptance models by extending the basic Technology Acceptance Model (TAM) with trust and perceived risk factors. Data from 36 studies were extracted to fit the models using meta-analytic structural equation modeling technique. The results suggested that trust contributed most in determining AV acceptance, followed by perceived usefulness and perceived risk, and perceived ease of use makes the least contribution. The subgroup analyses showed that the model parameters differed across the levels of three variables, i.e., sample origin (Europe/Asia/America), automation level (full/partial), and age (young/middle-aged). Specifically, trust was unanimously identified as the most important determinant of AV acceptance across all subgroups. Perceived risk only remained significant in America, fully AVs, and middle-aged subgroups. Perceived ease of use was insignificant in the above-mentioned three subgroups while remained significant in the rest subgroups. Building trust could be the most useful and universal way to improve AV acceptance, and policy makers should consider the characteristics of consumers when making AV promotion strategies.

Modeling takeover behavior in level 3 automated driving via a structural equation model: Considering the mediating role of trust

The takeover process in level 3 automated driving determines the controllability of the functions of automated vehicles and thereby traffic safety. In this study, we attempted to explain drivers' takeover performance variation in a level 3 automated vehicle in consideration of the effects of trust, system characteristics, environmental characteristics, and driver characteristics with a structural equation model. The model was built by incorporating drivers' takeover time and quality as endogenous variables. A theoretical framework of the model was hypothesized on the basis of the ACT-R cognitive architecture and relevant research results. The validity of the model was confirmed using data collected from 136 driving simulator samples under the condition of voluntary non-driving-related tasks. Results revealed that takeover time budget was the most critical factor in promoting the safety and stability of takeover process, which, together with traffic density, drivers' age and manual driving experience, determined drivers' takeover quality directly. In addition, the pre-existing experience with an automated system or a similar technology and self-confidence of the driver, as well as takeover time budget, strongly influenced the takeover time directly. Apart from the direct effects mentioned above, trust, as an intermediary variable, explained a major portion of the variance in takeover time. Theoretically, these findings suggest that takeover behavior could be comprehensively evaluated from the two dimensions of takeover time and quality through the combination of trust, driver characteristics, environmental characteristics, and vehicle characteristics. The influence mechanism of the above factors is complex and multidimensional. In addition to the form of direct influence, trust, as an intermediary variable, could reflect the internal mechanism of the takeover behavior variation. Practically, the findings emphasize the crucial role of trust in the change in takeover behavior through the dimensions of subjective trust level and monitoring strategy, which may provide new insights into the function design of takeover process.

Supporting User Onboarding in Automated Vehicles through Multimodal Augmented Reality Tutorials

Misconceptions of vehicle automation functionalities lead to either non-use or dangerous misuse of assistant systems, harming the users’ experience by reducing potential comfort or compromise safety. Thus, users must understand how and when to use an assistant system. In a preliminary online survey, we examined the use, trust, and the perceived understanding of modern vehicle assistant systems. Despite remaining incomprehensibility (36–64%), experienced misunderstandings (up to 9%), and the need for training (around 30%), users reported high trust in the systems. In the following study with first-time users, we examine the effect of different User Onboarding approaches for an automated parking assistant system in a Tesla and compare the traditional text-based manual with a multimodal augmented reality (AR) smartphone application in means of user acceptance, UX, trust, understanding, and task performance. While the User Onboarding experience for both approaches shows high pragmatic quality, the hedonic quality was perceived significantly higher in AR. For the automated parking process, reported hedonic and pragmatic user experience, trust, automation understanding, and acceptance do not differ, yet the observed task performance was higher in the AR condition. Overall, AR might help motivate proper User Onboarding and better communicate how to operate the system for inexperienced users.

Optimal Time Intervals in Two-Stage Takeover Warning Systems With Insight Into the Drivers' Neuroticism Personality

Conditional automated driving [level 3, Society of Automotive Engineers (SAE)] requires drivers to take over the vehicle when an automated system's failure occurs or is about to leave its operational design domain. Two-stage warning systems, which warn drivers in two steps, can be a promising method to guide drivers in preparing for the takeover. However, the proper time intervals of two-stage warning systems that allow drivers with different personalities to prepare for the takeover remain unclear. This study explored the optimal time intervals of two-stage warning systems with insights into the drivers' neuroticism personality. A total of 32 drivers were distributed into two groups according to their self-ratings in neuroticism (high vs. low). Each driver experienced takeover under the two-stage warning systems with four time intervals (i.e., 3, 5, 7, and 9 s). The takeover performance (i.e., hands-on-steering-wheel time, takeover time, and maximum resulting acceleration) and subjective opinions (i.e., appropriateness and usefulness) for time intervals and situation awareness (SA) were recorded. The results showed that drivers in the 5-s time interval had the best takeover preparation (fast hands-on steering wheel responses and sufficient SA). Furthermore, both the 5- and 7-s time intervals resulted in more rapid takeover reactions and were rated more appropriate and useful than the 3- and 9-s time intervals. In terms of personality, drivers with high neuroticism tended to take over immediately after receiving takeover messages, at the cost of SA deficiency. In contrast, drivers with low neuroticism responded safely by judging whether they gained enough SA. We concluded that the 5-s time interval was optimal for drivers in two-stage takeover warning systems. When considering personality, drivers with low neuroticism had no strict requirements for time intervals. However, the extended time intervals were favorable for drivers with high neuroticism in developing SA. The present findings have reference implications for designers and engineers to set the time intervals of two-stage warning systems according to the neuroticism personality of drivers.

Virtual reality tour for first-time users of highly automated cars: Comparing the effects of virtual environments with different levels of interaction fidelity

Research in aviation and driving has highlighted the importance of training as an effective approach to reduce the costs associated with the supervisory role of the human in automated systems. However, only a few studies have investigated the effect of training on highly automated driving. Moreover, available interactive trainings are mostly based on automated driving simulators and the application of immersive technology such as Virtual Reality (VR) as a low-cost training solution has not been widely adopted. In this study, we developed three types of familiarization tours (low-fidelity VR, high-fidelity VR, and video) to train first-time users of highly automated cars. Then, the effectiveness of these tours was investigated on automation trust and driving performance in several critical and non-critical transition tasks in four groups: control, video, low-fidelity VR, and high-fidelity VR. The results revealed the positive impact of the tours on trust and transition performance at the first time of measurement. Takeover quality only improved when practices were presented in high-fidelity VR. After three times of exposure to transition requests, trust and transition performance of all groups converged to those of the high-fidelity VR group, demonstrating that: a) experiencing takeover transition during the training may reduce costs associated with first critical takeover request in highly automated driving, b) the VR tour with high level of interaction fidelity was superior to other training methods, and c) untrained and less-trained drivers learned about automation after a few trials. Knowledge resulting from this research could help develop cost-effective solutions for automated driving training in dealerships and car rental centers.

Where We Come from and Where We Are Going: A Systematic Review of Human Factors Research in Driving Automation

During the last decade, research has brought forth a large amount of studies that investigated driving automation from a human factor perspective. Due to the multitude of possibilities for the study design with regard to the investigated constructs, data collection methods, and evaluated parameters, at present, the pool of findings is heterogeneous and nontransparent. This literature review applied a structured approach, where five reviewers investigated n = 161 scientific papers of relevant journals and conferences focusing on driving automation between 2010 and 2018. The aim was to present an overview of the status quo of existing methodological approaches and investigated constructs to help scientists in conducting research with established methods and advanced study setups. Results show that most studies focused on safety aspects, followed by trust and acceptance, which were mainly collected through self-report measures. Driving/Take-Over performance also marked a significant portion of the published papers; however, a wide range of different parameters were investigated by researchers. Based on our insights, we propose a set of recommendations for future studies. Amongst others, this includes validation of existing results on real roads, studying long-term effects on trust and acceptance (and of course other constructs), or triangulation of self-reported and behavioral data. We furthermore emphasize the need to establish a standardized set of parameters for recurring use cases to increase comparability. To assure a holistic contemplation of automated driving, we moreover encourage researchers to investigate other constructs that go beyond safety.

Automated Driving: A Literature Review of the Take over Request in Conditional Automation

In conditional automation (level 3), human drivers can hand over the Driving Dynamic Task (DDT) to the Automated Driving System (ADS) and only be ready to resume control in emergency situations, allowing them to be engaged in non-driving related tasks (NDRT) whilst the vehicle operates within its Operational Design Domain (ODD). Outside the ODD, a safe transition process from the ADS engaged mode to manual driving should be initiated by the system through the issue of an appropriate Take Over Request (TOR). In this case, the driver’s state plays a fundamental role, as a low attention level might increase driver reaction time to take over control of the vehicle. This paper summarizes and analyzes previously published works in the field of conditional automation and the TOR process. It introduces the topic in the appropriate context describing as well a variety of concerns that are associated with the TOR. It also provides theoretical foundations on implemented designs, and report on concrete examples that are targeted towards designers and the general public. Moreover, it compiles guidelines and standards related to automation in driving and highlights the research gaps that need to be addressed in future research, discussing also approaches and limitations and providing conclusions.

Predicting takeover response to silent automated vehicle failures

Current and foreseeable automated vehicles are not able to respond appropriately in all circumstances and require human monitoring. An experimental examination of steering automation failure shows that response latency, variability and corrective manoeuvring systematically depend on failure severity and the cognitive load of the driver. The results are formalised into a probabilistic predictive model of response latencies that accounts for failure severity, cognitive load and variability within and between drivers. The model predicts high rates of unsafe outcomes in plausible automation failure scenarios. These findings underline that understanding variability in failure responses is crucial for understanding outcomes in automation failures.

The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency

OBJECTIVE

This paper presents a theoretical model and two simulator studies on the psychological processes during early trust calibration in automated vehicles.

BACKGROUND

The positive outcomes of automation can only reach their full potential if a calibrated level of trust is achieved. In this process, information on system capabilities and limitations plays a crucial role.

METHOD

In two simulator experiments, trust was repeatedly measured during an automated drive. In Study 1, all participants in a two-group experiment experienced a system-initiated take-over, and the occurrence of a system malfunction was manipulated. In Study 2 in a 2 × 2 between-subject design, system transparency was manipulated as an additional factor.

RESULTS

Trust was found to increase during the first interactions progressively. In Study 1, take-overs led to a temporary decrease in trust, as did malfunctions in both studies. Interestingly, trust was reestablished in the course of interaction for take-overs and malfunctions. In Study 2, the high transparency condition did not show a temporary decline in trust after a malfunction.

CONCLUSION

Trust is calibrated along provided information prior to and during the initial drive with an automated vehicle. The experience of take-overs and malfunctions leads to a temporary decline in trust that was recovered in the course of error-free interaction. The temporary decrease can be prevented by providing transparent information prior to system interaction.

APPLICATION

Transparency, also about potential limitations of the system, plays an important role in this process and should be considered in the design of tutorials and human-machine interaction (HMI) concepts of automated vehicles.

Understanding take-over performance of high crash risk drivers during conditionally automated driving

Understanding driver behavior of conditionally automated driving is necessary to ensure a safe transition from automated to manual driving. This study aimed to examine the difference in take-over performance between high crash risk (HCR) and lower crash risk (LCR) drivers in emergency take-over situations during conditionally automated driving. In the current simulator study, a 3 × 3 (within-subjects) factorial design was used, including the task factors (no task, reading the news, and watching a video) and time budget factors (time budget = 3 s, 4 s, and 5 s). Forty-eight participants completed a test drive on an approximately 10 km long two-way six-lane urban road. The participants firstly were in manual control and then switched to the automated driving mode at a speed of 50 km/h. The automated driving system was able to detect a broken car in the ego-lane and requested the driver to take over the control of the vehicle. There are at least one or two other vehicles or motorcycles on each side of the ego-vehicle, resulting in fewer escape paths. For the two non-handheld non-driving-related tasks (NDRTs), the participants were asked to be fully engaged in a task without any need to monitor the road environments. Each participant completed nine emergency take-over situations. The participants were classified into two groups that were labeled LCR (N ≤ 2) and HCR drivers (N ≥ 3) according to the number of accidents per driver. The results show that LCR drivers had shorter brake reaction time compared to HCR drivers. For all drivers, the engagement in a task led to longer response times, and the time budget affected the longitudinal vehicle control. In addition, the task affected the response times for LCR and HCR drivers, but only the time budget affected the longitudinal vehicle control for LCR drivers. For all drivers, LCR and HCR drivers, the time budget and task affected the safety of take-over. Especially, the two non-handheld everyday tasks seem to have a similar effect on the drivers' workload. Therefore, the HCR drivers had a lower hazard perception compared to the LCR drivers, and the factor regarding the individual difference of driving ability in take-over situations should be considered to design safe take-over concepts for automated vehicles.

Safety Compensation for Improving Driver Takeover Performance in Conditionally Automated Driving

The topic of transition from automated driving to manual maneuver in conditionally automated driving (SAE level-3) has acquired increasing interest. In such conditionally automated driving, drivers are expected to take over the vehicle control if the situation goes beyond the system’s functional limit of operation. However, it is challenging for drivers to resume control timely and perform well after being engaged in non-driving related tasks. Facing this challenge, this paper investigated a safety compensation in which the system conducts automatic deceleration to prolong the time budget for drivers to response. The purpose of the paper is to evaluate the effect of safety compensation on takeover performance in different takeover scenarios such as fog, route choosing, and lane closing. In the experiment, 16 participants were recruited. Results showed no significant effect of safety compensation on the takeover time, but a significant effect on the longitudinal driving performance (viz. driver brake input and the time to event). Moreover, it indicated a significant effect of safety compensation on the lateral acceleration in the lane closing scenario. This finding is useful for the automotive manufacturers to supply users a safer transition scheme from automated driving to manual maneuver.

Evaluating advanced driver-assistance system trainings using driver performance, attention allocation, and neural efficiency measures

There are about 44 million licensed older drivers in the U.S. Older adults have higher crash rates and fatalities as compared to middle-aged and young drivers, which might be associated with degradations in sensory, cognitive, and physical capabilities. Advanced driver-assistance systems (ADAS) have the potential to substantially improve safety by removing some of driver vehicle control responsibilities. However, a critical aspect of providing ADAS is educating drivers on their operational characteristics and continued use. Twenty older adults participated in a driving simulation study assessing the effectiveness of video-based and demonstration-based training protocols in learning ADAS considering gender differences. The findings revealed video-based training to be more effective than demonstration-based training in improving driver performance and reducing off-road visual attention allocation and mental workload. In addition, female drivers required lower investment of mental effort (higher neural efficiency) to maintain the performance relative to males and they were less distracted by ADAS. However, male drivers were faster in activating ADAS as compared to females since they were monitoring the status of ADAS features more frequently while driving. The findings of this study provided an empirical support for using video-based approach for learning ADAS in older adults to improve driver safety and supported previous findings on older adults' learning that as age increases there is a tendency to prefer more passive and observational learning methods.

Pedestrian Trust in Automated Vehicles: Role of Traffic Signal and AV Driving Behavior

Pedestrians' acceptance of automated vehicles (AVs) depends on their trust in the AVs. We developed a model of pedestrians' trust in AVs based on AV driving behavior and traffic signal presence. To empirically verify this model, we conducted a human–subject study with 30 participants in a virtual reality environment. The study manipulated two factors: AV driving behavior (defensive, normal, and aggressive) and the crosswalk type (signalized and unsignalized crossing). Results indicate that pedestrians' trust in AVs was influenced by AV driving behavior as well as the presence of a signal light. In addition, the impact of the AV's driving behavior on trust in the AV depended on the presence of a signal light. There were also strong correlations between trust in AVs and certain observable trusting behaviors such as pedestrian gaze at certain areas/objects, pedestrian distance to collision, and pedestrian jaywalking time. We also present implications for design and future research.

Getting Back Into the Loop: The Perceptual-Motor Determinants of Successful Transitions out of Automated Driving

OBJECTIVE

To present a structured, narrative review highlighting research into human perceptual-motor coordination that can be applied to automated vehicle (AV)-human transitions.

BACKGROUND

Manual control of vehicles is made possible by the coordination of perceptual-motor behaviors (gaze and steering actions), where active feedback loops enable drivers to respond rapidly to ever-changing environments. AVs will change the nature of driving to periods of monitoring followed by the human driver taking over manual control. The impact of this change is currently poorly understood.

METHOD

We outline an explanatory framework for understanding control transitions based on models of human steering control. This framework can be summarized as a perceptual-motor loop that requires (a) calibration and (b) gaze and steering coordination. A review of the current experimental literature on transitions is presented in the light of this framework.

RESULTS

The success of transitions are often measured using reaction times, however, the perceptual-motor mechanisms underpinning steering quality remain relatively unexplored.

CONCLUSION

Modeling the coordination of gaze and steering and the calibration of perceptual-motor control will be crucial to ensure safe and successful transitions out of automated driving.

APPLICATION

This conclusion poses a challenge for future research on AV-human transitions. Future studies need to provide an understanding of human behavior that will be sufficient to capture the essential characteristics of drivers reengaging control of their vehicle. The proposed framework can provide a guide for investigating specific components of human control of steering and potential routes to improving manual control recovery.

Effects of Task-Induced Fatigue in Prolonged Conditional Automated Driving

OBJECTIVE

The aim of this study was to investigate the effects of task-induced fatigue in prolonged conditional automated driving on takeover performance.

BACKGROUND

In conditional automated driving, the driver can engage in non-driving related tasks (NDRTs) and does not have to monitor the system and the driving environment. In the event that the system hits its limits, the human driver must regain control of the car. To ensure safety, adequate driver fallback performance is necessary. Effects of the drivers' state and the engagement in NDRTs need to be investigated.

METHOD

Seventy-three participants experienced prolonged conditional automated rides and simultaneously had to engage in either an activating quiz or a fatiguing monitoring task (between subjects). After 50 minutes, a takeover situation occurred, and participants had to regain control of the car.

RESULTS

Prolonged conditional automated driving and simultaneously engaging in NDRTs affected the driver's state and the takeover performance of the participants. Takeover performance was impaired when participants had to deal with monotonous NDRTs.

CONCLUSION

An engagement in monotonous monitoring tasks in conditional automated driving affects the driver's state and takeover performance when it comes to takeover situations. Especially in prolonged automated driving, an adequate driver state seems to be necessary for safety reasons.

APPLICATION

The results of this study demonstrate that engagement in monotonous NDRTs while driving conditionally automated may negatively affect takeover performance. A monitoring of the driver state and adapted assistance in a takeover situation seems to be a good opportunity to ensure safety.

Toward Computational Simulations of Behavior During Automated Driving Takeovers: A Review of the Empirical and Modeling Literatures

OBJECTIVE

This article provides a review of empirical studies of automated vehicle takeovers and driver modeling to identify influential factors and their impacts on takeover performance and suggest driver models that can capture them.

BACKGROUND

Significant safety issues remain in automated-to-manual transitions of vehicle control. Developing models and computer simulations of automated vehicle control transitions may help designers mitigate these issues, but only if accurate models are used. Selecting accurate models requires estimating the impact of factors that influence takeovers.

METHOD

Articles describing automated vehicle takeovers or driver modeling research were identified through a systematic approach. Inclusion criteria were used to identify relevant studies and models of braking, steering, and the complete takeover process for further review.

RESULTS

The reviewed studies on automated vehicle takeovers identified several factors that significantly influence takeover time and post-takeover control. Drivers were found to respond similarly between manual emergencies and automated takeovers, albeit with a delay. The findings suggest that existing braking and steering models for manual driving may be applicable to modeling automated vehicle takeovers.

CONCLUSION

Time budget, repeated exposure to takeovers, silent failures, and handheld secondary tasks significantly influence takeover time. These factors in addition to takeover request modality, driving environment, non-handheld secondary tasks, level of automation, trust, fatigue, and alcohol significantly impact post-takeover control. Models that capture these effects through evidence accumulation were identified as promising directions for future work.

APPLICATION

Stakeholders interested in driver behavior during automated vehicle takeovers may use this article to identify starting points for their work.

Tell Them How They Did: Feedback on Operator Performance Helps Calibrate Perceived Ease of Use in Automated Driving

The development of automated driving will profit from an agreed-upon methodology to evaluate human–machine interfaces. The present study examines the role of feedback on interaction performance provided directly to participants when interacting with driving automation (i.e., perceived ease of use). In addition, the development of ratings itself over time and use case specificity were examined. In a driving simulator study, N = 55 participants completed several transitions between Society of Automotive Engineers (SAE) level 0, level 2, and level 3 automated driving. One half of the participants received feedback on their interaction performance immediately after each use case, while the other half did not. As expected, the results revealed that participants judged the interactions to become easier over time. However, a use case specificity was present, as transitions to L0 did not show effects over time. The role of feedback also depended on the respective use case. We observed more conservative evaluations when feedback was provided than when it was not. The present study supports the application of perceived ease of use as a diagnostic measure in interaction with automated driving. Evaluations of interfaces can benefit from supporting feedback to obtain more conservative results.

User Education in Automated Driving: Owner’s Manual and Interactive Tutorial Support Mental Model Formation and Human-Automation Interaction

Automated driving systems (ADS) and a combination of these with advanced driver assistance systems (ADAS) will soon be available to a large consumer population. Apart from testing automated driving features and human–machine interfaces (HMI), the development and evaluation of training for interacting with driving automation has been largely neglected. The present work outlines the conceptual development of two possible approaches of user education which are the owner’s manual and an interactive tutorial. These approaches are investigated by comparing them to a baseline consisting of generic information about the system function. Using a between-subjects design, N = 24 participants complete one training prior to interacting with the ADS HMI in a driving simulator. Results show that both the owner’s manual and an interactive tutorial led to an increased understanding of driving automation systems as well as an increased interaction performance. This work contributes to method development for the evaluation of ADS by proposing two alternative approaches of user education and their implications for both application in realistic settings and HMI testing.

Risk of automated driving: Implications on safety acceptability and productivity

Autonomous Vehicles have captured the imagination of our society and have promised a future of safe and efficient mobility. However, there is a need to understand behaviour and its consequences in the use of autonomous vehicles. Using paradigms of behavioural and experimental economics, we show that risk attitudes play a role in acceptability of autonomous vehicles, productivity in autonomous vehicles and safety under risk of failures of autonomous systems. We found that risk attitudes and age have a significant impact on these. We believe these findings will help provide guidance to insurance agencies, licensing, vehicle design, and policies around automated vehicles.

Test procedure for evaluating the human-machine interface of vehicles with automated driving systems

Objective: The human-machine interface (HMI) is a crucial part of every automated driving system (ADS). In the near future, it is likely that-depending on the operational design domain (ODD)-different levels of automation will be available within the same vehicle. The capabilities of a given automation level as well as the operator's responsibilities must be communicated in an appropriate way. To date, however, there are no agreed-upon evaluation methods that can be used by human factors practitioners as well as researchers to test this. Methods: We developed an iterative test procedure that can be applied during the product development cycle of ADS. The test procedure is specifically designed to evaluate whether minimum requirements as proposed in NHTSA's automated vehicle policy are met. Results: The proposed evaluation protocol includes (a) a method to identify relevant use cases for testing on the basis of all theoretically possible steady states and mode transitions of a given ADS; (b) an expert-based heuristic assessment to evaluate whether the HMI complies with applicable norms, standards, and best practices; and (c) an empirical evaluation of ADS HMIs using a standardized design for user studies and performance metrics. Conclusions: Each can be used as a stand-alone method or in combination to generate objective, reliable, and valid evaluations of HMIs, focusing on whether they meet minimum requirements. However, we also emphasize that other evaluation aspects such as controllability, misuse, and acceptance are not within the scope of the evaluation protocol.

From partial and high automation to manual driving: Relationship between non-driving related tasks, drowsiness and take-over performance

BACKGROUND

Until the level of full vehicle automation is reached, users of vehicle automation systems will be required to take over manual control of the vehicle occasionally and stay fallback-ready to some extent during the drive. Both, drowsiness caused by inactivity and the engagement in distracting non-driving related tasks (NDRTs) such as entertainment or office work have been suggested to impair the driver's ability to safely handle these transitions of control. Thus, it is an open question whether engagement in NDRTs will impair or improve take-over performance.

METHOD

In a motion-based driving simulator, 64 participants completed an automated drive that lasted either one or two hours using either a partially or highly automated driving system. In the partially automated driving condition, a warning was issued after several seconds when drivers took both hands off the steering wheel, while the highly automated driving system allowed hands-off driving permanently. Drivers were allowed to bring along their smartphones and to use them during the drive. They engaged in a wide variety of NDRTs such as reading or using social media. At the end of the session, drivers had to react to a sudden lead vehicle braking event. In the partial automation condition, there was no take-over request (TOR) to notify the drivers of the braking vehicle, while in the highly automated condition, the situation happened right after the drivers had deactivated the automation in response to a TOR. The lead time of the TOR was set at 8 s. Driver's level of drowsiness, workload (visual, mental and motoric) from carrying out the NDRT and motivational appeal of the NDRT right before the control transition were video-coded and used to predict the outcome of the braking event (i.e., reaction and system deactivation times, minimal Time-to-collision (TTC) and self-reported criticality) with a multiple regression approach.

RESULTS

In the partial automation condition, reaction times to the braking vehicle and situation criticality as measured by the minimum TTC could be well predicted. Main predictors for increased reaction time were drowsiness and motivational appeal of the NDRT. However, visual and mental demand associated with NDRTs did decrease reaction time, suggesting that the NDRT helped the drivers to maintain alertness during the partially automated drive. Accordingly, drowsiness and motivational appeal of the NDRT increased situation criticality, while cognitive load due to the NDRT decreased it. In the highly automated condition, however, it was not possible to predict system deactivation time (in reaction to the TOR), brake reaction time to the braking vehicle and situation criticality by observed drowsiness and NDRT engagement.

DISCUSSION

The results suggest a relationship between the driver's drowsiness and NDRT engagement in partial automation but not in highly automated driving. Several explanations for this finding are discussed. It could be possible that the lead time of 8 s might have given the drivers enough time to complete the driver state transition process from executing NDRTs to manual driving, putting them in a position to be able to cope with the driving event, while this was not possible in the partial automation condition. Methodological issues that might have led to a non-detection of an effect of drowsiness or NDRT engagement in the highly automated driving condition, such as the sample size and sensitivity of the observer ratings, are also discussed.

Using Smartbands, Pupillometry and Body Motion to Detect Discomfort in Automated Driving

As technological advances lead to rapid progress in driving automation, human-machine interaction (HMI) issues such as comfort in automated driving gain increasing attention. The research project KomfoPilot at Chemnitz University of Technology aims to assess discomfort in automated driving using physiological parameters from commercially available smartbands, pupillometry and body motion. Detected discomfort should subsequently be used to adapt driving parameters as well as information presentation and prevent potentially safety-critical take-over situations. In an empirical driving simulator study, 40 participants from 25 years to 84 years old experienced two highly automated drives with three potentially critical and discomfort-inducing approaching situations in each trip. The ego car drove in a highly automated mode at 100 km/h and approached a truck driving ahead with a constant speed of 80 km/h. Automated braking started very late at a distance of 9 m, reaching a minimum of 4.2 m. Perceived discomfort was assessed continuously using a handset control. Physiological parameters were measured by the smartband Microsoft Band 2 and included heart rate (HR), heart rate variability (HRV) and skin conductance level (SCL). Eye tracking glasses recorded pupil diameter and eye blink frequency; body motion was captured by a motion tracking system and a seat pressure mat. Trends of all parameters were analyzed 10 s before, during and 10 s after reported discomfort to check for overall parameter relevance, direction and strength of effects; timings of increase/decrease; variability as well as filtering, standardization and artifact removal strategies to increase the signal-to-noise ratio. Results showed a reduced eye blink rate during discomfort as well as pupil dilation, also after correcting for ambient light influence. Contrary to expectations, HR decreased significantly during discomfort periods, whereas HRV diminished as expected. No effects could be observed for SCL. Body motion showed the expected pushback movement during the close approach situation. Overall, besides SCL, all other parameters showed changes associated with discomfort indicated by the handset control. The results serve as a basis for designing and configuring a real-time discomfort detection algorithm that will be implemented in the driving simulator and validated in subsequent studies.

Psychosocial factors associated with intended use of automated vehicles: A simulated driving study

This study applied the Theory of Planned Behavior (TPB) and the Technology Acceptance Model (TAM) to assess drivers' intended use of automated vehicles (AVs) after undertaking a simulated driving task. In addition, this study explored the potential for trust to account for additional variance to the psychosocial factors in TPB and TAM. Seventy-four participants (51% female) aged between 25 and 64 years (M = 42.8, SD = 12.9) undertook a 20 min simulated experimental drive in which participants experienced periods of automated driving and manual control. A survey task followed. A hierarchical regression analysis revealed that TPB constructs; attitude toward the behavior, subjective norms, and perceived behavioral control, were significant predictors of intentions to use AV. In addition, there was partial support for the test of TAM, with ease of use (but not usefulness) predicting intended use of AV (SAE Level 3). Trust contributed variance to both models beyond TPB or TAM constructs. The findings provide an important insight into factors that might reflect intended use of vehicles that are primarily automated (longitudinal, lateral, and manoeuvre controls) but require and allow drivers to have periods of manual control.

Take-over again: Investigating multimodal and directional TORs to get the driver back into the loop

When a highly automated car reaches its operational limits, it needs to provide a take-over request (TOR) in order for the driver to resume control. The aim of this simulator-based study was to investigate the effects of TOR modality and left/right directionality on drivers' steering behaviour when facing a head-on collision without having received specific instructions regarding the directional nature of the TORs. Twenty-four participants drove three sessions in a highly automated car, each session with a different TOR modality (auditory, vibrotactile, and auditory-vibrotactile). Six TORs were provided per session, warning the participants about a stationary vehicle that had to be avoided by changing lane left or right. Two TORs were issued from the left, two from the right, and two from both the left and the right (i.e., nondirectional). The auditory stimuli were presented via speakers in the simulator (left, right, or both), and the vibrotactile stimuli via a tactile seat (with tactors activated at the left side, right side, or both). The results showed that the multimodal TORs yielded statistically significantly faster steer-touch times than the unimodal vibrotactile TOR, while no statistically significant differences were observed for brake times and lane change times. The unimodal auditory TOR yielded relatively low self-reported usefulness and satisfaction ratings. Almost all drivers overtook the stationary vehicle on the left regardless of the directionality of the TOR, and a post-experiment questionnaire revealed that most participants had not realized that some of the TORs were directional. We conclude that between the three TOR modalities tested, the multimodal approach is preferred. Moreover, our results show that directional auditory and vibrotactile stimuli do not evoke a directional response in uninstructed drivers. More salient and semantically congruent cues, as well as explicit instructions, may be needed to guide a driver into a specific direction during a take-over scenario.