Evaluation of different speech and touch interfaces to in-vehicle music retrieval systems

Assessing driver distraction from in-vehicle information system: an on-road study exploring the effects of input modalities and secondary task types

In-vehicle information system (IVIS) use is prevalent among young adults. However, their interaction with IVIS needs to be better understood. Therefore, an on-road study aims to explore the effects of input modalities and secondary task types on young drivers' secondary task performance, driving performance, and visual glance behavior. A 2 × 4 within-subject design was undertaken. The independent variables are input modalities (auditory-speech and visual-manual) and secondary task types (calls, music, navigation, and radio). The dependent variables include secondary task performance (task completion time, number of errors, and SUS), driving performance (average speed, number of lane departure warnings, and NASA-TLX), and visual glance behavior (average glance duration, number of glances, total glance duration, and number of glances over 1.6 s). The statistical analysis result showed that the main effect of input modalities is significant, with more distraction during visual-manual than auditory-speech. The main impact of secondary task types was also substantial across most metrics, aside from average speed and average glance duration. Navigation and music were the most distracting, followed by calls, and radio came in last. The distracting effect of input modalities is relatively stable and generally not moderated by the secondary task types, except radio tasks. The findings practically benefit the driver-friendly human-machine interface design, preventing IVIS-related distraction.

Input modality matters: A comparison of touch, speech, and gesture based in-vehicle interaction

Innovative input devices are being available for in-vehicle information systems (IVISs). While they have the potential to provide enjoyable driving by enabling drivers to perform non-driving related tasks (NDRTs) in more natural ways, the associated distracting effects should be paid with more attention. The purpose of this exploratory study was to compare the effects of three novel input modalities, i.e., touchscreen-based interaction (TBI), speech-based interaction (SBI), and gesture-based interaction (GBI), on driving performance and driver visual behaviors. Moreover, we examined if the influence of different modalities would be moderated by the difficulty level of NDRTs. A total of 36 participants were invited to a simulated driving experiment where they were randomly assigned to one of the four groups (TBI, GBI, SBI or baseline) and completed three driving trials. The results showed that TBI led to the worse driving performance, as indicated by the significantly prolonged reaction time, reduced minimum time-to-collision, and increased variations in both longitudinal and lateral vehicle control. The deteriorated driving performance could be attributed, at least partially, to the intense visual demand induced by looking towards the touchscreen, as indicated by more and longer off-the-road glances. The adverse impacts of GBI were relatively smaller, but it still posed great crash risk by leading to a shorter minimum time-to-collision and less stable vehicle control compared to the baseline. SBI, although not completely equivalent to the baseline group, showed the minimum influence on driving and visual performance. Only very few interaction effects were found, suggesting that the effects of modality were quite robust across different NDRTs. It was concluded that SBI and GBI provided safer alternatives to in-vehicle interaction than TBI.

Factors affecting drivers' off-road glance behavior while interacting with in-vehicle voice interfaces

In-vehicle voice-based interfaces have been massively embedded in modern vehicles as a countermeasure to visual-manual distractions. However, limited data are available regarding the actual visual demands imposed on the driver when interacting with such an interface. How those factors that are associated with the drivers themselves affect their visual behavior when interacting with an in-vehicle voice-based interface remains understudied. This study focused on investigating factors affecting drivers' off-road visual behavior while interacting with a voice-based interface. A secondary data analysis leveraging structural equation modeling was performed based on data collected from a large-scale field experiment wherein participants drove a vehicle on the highway and performed a series of tasks using an in-vehicle voice interface. The results indicate that while voice-based interfaces are designed to help reduce drivers' visual demands, drivers can still direct their eyes off the road for a prolonged period of time during the interaction and exhibit potentially risky visual behavior. In addition, individual-level factors can exert influence on drivers' off-road visual behavior in such a way that older drivers and drivers with higher trust in technologies are associated with more long eyes-off-road glances when interacting with a voice-based interface. To promote the general public's adoption of in-vehicle voice interfaces and support safe interactions, we recommend relevant research and system design consider drivers' trust in, perceptions, and previous usage of similar technologies, as well as their individual characteristics such as age.

What is the difference between perceived and actual risk of distracted driving? A field study on a real highway

Distracted driving is a leading cause of traffic accidents. It is influenced by driver attitude toward secondary tasks; however, field-based studies on the effects of low-perceived-risk tasks on lateral driving have rarely been reported. A total of 17 experienced non-professional drivers were recruited to participate in two secondary tasks: a cognitive experiment (conversation) and a visual distraction experiment (observation of following vehicles), each representing low-perceived-risk secondary tasks. One-way analysis of variance (ANOVA) was conducted to evaluate the effects of low-perceived-risk tasks on lateral driving performance. ANOVA results indicated that compared with baseline (no task) lateral performance, lane-keeping ability was enhanced during cognitive distractions. In the visual distraction experiment, more than 50% of the distractions required 1–2 s. Lane deviation and its growth rate increased with the duration of distraction. Compared with cognitive distraction, lane deviation increased significantly with visual distraction, and lane-keeping performance was seriously impaired. For low-perceived-risk tasks, visual distractions impaired driving safety more seriously, compared with cognitive distractions, suggesting that drivers misjudge the risks associated with visual tasks. These results can contribute to the design of advanced driving-assistance systems and improve professional driver programs, potentially reducing the frequency of traffic accidents caused by distracted driving.

Eye tracking use in researching driver distraction: A scientometric and qualitative literature review approach

Many factors affect road safety, but research constantly shows that drivers are the major cause of critical situations that could potentially lead to a traffic accident in road traffic. Visual information is a crucial part of input information into the driving process; therefore, distractions of overt visual attention can potentially have a large impact on driving safety. Modern eye tracking technology enables researchers to gain precise insight into the direction and movement of a driver’s gaze during various distractions. As this is an evolving and currently very relevant field of road safety research, the present paper sets out to analyse the current state of the research field and the most relevant publications that use eye tracking for research of distractions to a driver’s visual attention. With the use of scientometrics and a qualitative review of the 139 identified publications that fit the inclusion criteria, the results revealed a currently expanding research field. The narrow research field is interdisciplinary in its core, as evidenced by the dispersion of publication sources and research variables. The main research gaps identified were performing research in real conditions, including a wider array of distractions, a larger number of participants, and increasing interdisciplinarity of the field with more author cooperation outside of their primary co-authorship networks.

Effectiveness of auditory and tactile crossmodal cues in a dual-task visual and auditory scenario

In this study, we examined how spatially informative auditory and tactile cues affected participants' performance on a visual search task while they simultaneously performed a secondary auditory task. Visual search task performance was assessed via reaction time and accuracy. Tactile and auditory cues provided the approximate location of the visual target within the search display. The inclusion of tactile and auditory cues improved performance in comparison to the no-cue baseline conditions. In comparison to the no-cue conditions, both tactile and auditory cues resulted in faster response times in the visual search only (single task) and visual-auditory (dual-task) conditions. However, the effectiveness of auditory and tactile cueing for visual task accuracy was shown to be dependent on task-type condition. Crossmodal cueing remains a viable strategy for improving task performance without increasing attentional load within a singular sensory modality. Practitioner Summary: Crossmodal cueing with dual-task performance has not been widely explored, yet has practical applications. We examined the effects of auditory and tactile crossmodal cues on visual search performance, with and without a secondary auditory task. Tactile cues aided visual search accuracy when also engaged in a secondary auditory task, whereas auditory cues did not.

Multi-modal assessment of on-road demand of voice and manual phone calling and voice navigation entry across two embedded vehicle systems

One purpose of integrating voice interfaces into embedded vehicle systems is to reduce drivers' visual and manual distractions with 'infotainment' technologies. However, there is scant research on actual benefits in production vehicles or how different interface designs affect attentional demands. Driving performance, visual engagement, and indices of workload (heart rate, skin conductance, subjective ratings) were assessed in 80 drivers randomly assigned to drive a 2013 Chevrolet Equinox or Volvo XC60. The Chevrolet MyLink system allowed completing tasks with one voice command, while the Volvo Sensus required multiple commands to navigate the menu structure. When calling a phone contact, both voice systems reduced visual demand relative to the visual-manual interfaces, with reductions for drivers in the Equinox being greater. The Equinox 'one-shot' voice command showed advantages during contact calling but had significantly higher error rates than Sensus during destination address entry. For both secondary tasks, neither voice interface entirely eliminated visual demand. Practitioner Summary: The findings reinforce the observation that most, if not all, automotive auditory-vocal interfaces are multi-modal interfaces in which the full range of potential demands (auditory, vocal, visual, manipulative, cognitive, tactile, etc.) need to be considered in developing optimal implementations and evaluating drivers' interaction with the systems. Social Media: In-vehicle voice-interfaces can reduce visual demand but do not eliminate it and all types of demand need to be taken into account in a comprehensive evaluation.

Development and Evaluation of Automotive Speech Interfaces: Useful Information from the Human Factors and the Related Literature

Drivers often use infotainment systems in motor vehicles, such as systems for navigation, music, and phones. However, operating visual-manual interfaces for these systems can distract drivers. Speech interfaces may be less distracting. To help designing easy-to-use speech interfaces, this paper identifies key speech interfaces (e.g., CHAT, Linguatronic, SYNC, Siri, and Google Voice), their features, and what was learned from evaluating them and other systems. Also included is information on key technical standards (e.g., ISO 9921, ITU P.800) and relevant design guidelines. This paper also describes relevant design and evaluation methods (e.g., Wizard of Oz) and how to make driving studies replicable (e.g., by referencing SAE J2944). Throughout the paper, there is discussion of linguistic terms (e.g., turn-taking) and principles (e.g., Grice’s Conversational Maxims) that provide a basis for describing user-device interactions and errors in evaluations.

Scrolling and driving: how an MP3 player and its aftermarket controller affect driving performance and visual behavior

OBJECTIVE

The aim of this study was to assess how scrolling through playlists on an MP3 player or its aftermarket controller affects driving performance and to examine how drivers adapt device use to driving demands.

BACKGROUND

Drivers use increasingly complex infotainment devices that can undermine driving performance. The goal activation hypothesis suggests that drivers might fail to compensate for these demands, particularly with long tasks and large search set sizes.

METHOD

A total of 50 participants searched for songs in playlists of varying lengths using either an MP3 player or an aftermarket controller while negotiating road segments with traffic and construction in a medium-fidelity driving simulator.

RESULTS

Searching through long playlists (580 songs) resulted in poor driving performance and required more long glances (longer than 2 s) to the device compared with other playlist lengths. The aftermarket controller also led to more long glances compared with the MP3 player. Drivers did not adequately adapt their behavior to roadway demand, as evident in their degraded driving performance. No significant performance differences were found between short playlists, the radio-tuning task, and the no-task condition.

CONCLUSION

Selecting songs from long playlists undermined driving performance, and drivers did not sufficiently adapt their use of the device to the roadway demands, consistent with the goal activation hypothesis. The aftermarket controller degraded rather than enhanced performance.

APPLICATION

Infotainment systems should support drivers in managing distraction. Aftermarket controllers can have the unintended effect of making devices carried into the car less compatible with driving.These results can motivate development of new interfaces as alternatives to scrolling lists.

Effects on driving performance of interacting with an in-vehicle music player: a comparison of three interface layout concepts for information presentation

Interface design is an important factor in assessing the potential effects on safety of interacting with an in-vehicle information system while driving. In the current study, the layout of information on a visual display was manipulated to explore its effect on driving performance in the context of music selection. The comparative effects of an auditory-verbal (cognitive) task were also explored. The driving performance of 30 participants was assessed under both baseline and dual task conditions using the Lane Change Test. Concurrent completion of the music selection task with driving resulted in significant impairment to lateral driving performance (mean lane deviation and percentage of correct lane changes) relative to the baseline, and significantly greater mean lane deviation relative to the combined driving and the cognitive task condition. The magnitude of these effects on driving performance was independent of layout concept, although significant differences in subjective workload estimates and performance on the music selection task across layout concepts highlights that potential uncertainty regarding design use as conveyed through layout concept could be disadvantageous. The implications of these results for interface design and safety are discussed.

Are Driving Simulators Effective Tools for Evaluating Novice Drivers' Hazard Anticipation, Speed Management, and Attention Maintenance Skills

Novice drivers (teen drivers with their solo license for six months or less) are at a greatly inflated risk of crashing. Post hoc analyses of police accident reports indicate that novice drivers fail to anticipate hazards, manage their speed, and maintain attention. These skills are much too broadly defined to be of much help in training. Recently, however, driving simulators have been used to identify those skills which differentiate the novice drivers from older, more experienced drivers in the areas of hazard anticipation and speed management. Below, we report an experiment on a driving simulator which compares novice and experienced drivers' performance in the third area believed to contribute especially heavily to crashes among novice drivers: attention to the forward roadway. The results indicate that novice drivers are much more willing to glance for long periods of time inside the vehicle than are experienced drivers. Interestingly, the results also indicate that both novice and experienced drivers spend equal amounts of time glancing at tasks external to the vehicle and in the periphery. Moreover, just as a program has been designed to train the scanning skills that clearly differentiate novice from experienced drivers, one might hope that a training program could be designed to improve the attention maintenance skills of novice drivers. We report on the initial piloting of just such a training program. Finally, we address a question that has long been debated in the literature: Do the results from driving simulators generalize to the real world? We argue that in the case of hazard anticipation, speed management, and attention maintenance the answer is yes.