Verbal interface design: Do verbal directional cues automatically orient visual spatial attention?

Enhancing performance with multisensory cues in a realistic target discrimination task

Making decisions is an important aspect of people’s lives. Decisions can be highly critical in nature, with mistakes possibly resulting in extremely adverse consequences. Yet, such decisions have often to be made within a very short period of time and with limited information. This can result in decreased accuracy and efficiency. In this paper, we explore the possibility of increasing speed and accuracy of users engaged in the discrimination of realistic targets presented for a very short time, in the presence of unimodal or bimodal cues. More specifically, we present results from an experiment where users were asked to discriminate between targets rapidly appearing in an indoor environment. Unimodal (auditory) or bimodal (audio-visual) cues could shortly precede the target stimulus, warning the users about its location. Our findings show that, when used to facilitate perceptual decision under time pressure, and in condition of limited information in real-world scenarios, spoken cues can be effective in boosting performance (accuracy, reaction times or both), and even more so when presented in bimodal form. However, we also found that cue timing plays a critical role and, if the cue-stimulus interval is too short, cues may offer no advantage. In a post-hoc analysis of our data, we also show that congruency between the response location and both the target location and the cues, can interfere with the speed and accuracy in the task. These effects should be taken in consideration, particularly when investigating performance in realistic tasks.

Competitive Poaching in Search Advertising: Two Randomized Field Experiments

Keyword searches with brand names enable firms to generate traffic from search advertising by bidding not only on their own keywords but also on competitors’ keywords. The strategy of bidding on competitors’ keywords, known as competitive poaching, presents unique opportunities for practitioners. This study examines factors that influence the effectiveness of competitive poaching. We collected data from two randomized field experiments, one with a business school in the Northeastern United States and the other one with a leading automobile dealership company, where these firms bid on keywords of competing brands and randomly display different types of ad copies in the sponsored search listings. We find that, when poaching on keywords of high-quality brands, ad copies that feature vertical differentiation through quality signals are more effective than the control ad copies that do not convey any differentiation or prescriptive messages. We also find that when poaching from low-quality brands, ad copies featuring horizontal differentiation through nonquality attributes perform better than the control ad copies. Finally, the presence of the poached brand’s own ad has a positive association with the ad effectiveness of the poaching brand when that poached brand is high quality and a negative association when the poached brand is low quality.

Motor (but not auditory) attention affects syntactic choice

Understanding the determinants of syntactic choice in sentence production is a salient topic in psycholinguistics. Existing evidence suggests that syntactic choice results from an interplay between linguistic and non-linguistic factors, and a speaker’s attention to the elements of a described event represents one such factor. Whereas multimodal accounts of attention suggest a role for different modalities in this process, existing studies examining attention effects in syntactic choice are primarily based on visual cueing paradigms. Hence, it remains unclear whether attentional effects on syntactic choice are limited to the visual modality or are indeed more general. This issue is addressed by the current study. Native English participants viewed and described line drawings of simple transitive events while their attention was directed to the location of the agent or the patient of the depicted event by means of either an auditory (monaural beep) or a motor (unilateral key press) lateral cue. Our results show an effect of cue location, with participants producing more passive-voice descriptions in the patient-cued conditions. Crucially, this cue location effect emerged in the motor-cue but not (or substantially less so) in the auditory-cue condition, as confirmed by a reliable interaction between cue location (agent vs. patient) and cue type (auditory vs. motor). Our data suggest that attentional effects on the speaker’s syntactic choices are modality-specific and limited to the visual and motor, but not the auditory, domain.

Depth: the Forgotten Dimension in Multisensory Research

The last quarter of a century has seen a dramatic rise of interest in the spatial constraints on multisensory integration. However, until recently, the majority of this research has investigated integration in the space directly in front of the observer. The space around us, however, extends in three spatial dimensions in the front and to the rear beyond such a limited area. The question to be addressed in this review concerns whether multisensory integration operates according to the same rules throughout the whole of three-dimensional space. The results reviewed here not only show that the space around us seems to be divided into distinct functional regions, but they also suggest that multisensory interactions are modulated by the region of space in which stimuli happen to be presented. We highlight a number of key limitations with previous research in this area, including: (1) The focus on only a very narrow region of two-dimensional space in front of the observer; (2) the use of static stimuli in most research; (3) the study of observers who themselves have been mostly static; and (4) the study of isolated observers. All of these factors may change the way in which the senses interact at any given distance, as can the emotional state/personality of the observer. In summarizing these salient issues, we hope to encourage researchers to consider these factors in their own research in order to gain a better understanding of the spatial constraints on multisensory integration as they affect us in our everyday life.

Space-Time Compatibility Effects in the Auditory Modality

Previous research suggests that past and future temporal concepts are spatially represented from left to right along a mental line. And these concepts can both prime motor responses to left or right space and direct visual spatial attention. The present study aimed at investigating the nature of this space-time conceptual metaphor in different auditory tasks. In the first experiment, subjects categorized time-related words (past or future) that were presented binaurally. In the second experiment, subjects detected left-ear or right-ear targets following time-related words. The similar space-time compatibility effects were found in these two experiments. Our results demonstrate that the activation of temporal concepts can both prime motor responses to left or right space and influence the orientation of auditory spatial attention, suggesting that the modality of the stimulus input is unimportant for the left-right mapping of time. These results are explained by the “intermediate coding” account.

Giving subjects the eye and showing them the finger: socio-biological cues and saccade generation in the anti-saccade task

Pointing with the eyes or the finger occurs frequently in social interaction to indicate direction of attention and one's intentions. Research with a voluntary saccade task (where saccade direction is instructed by the colour of a fixation point) suggested that gaze cues automatically activate the oculomotor system, but non-biological cues, like arrows, do not. However, other work has failed to support the claim that gaze cues are special. In the current research we introduced biological and non-biological cues into the anti-saccade task, using a range of stimulus onset asynchronies (SOAs). The anti-saccade task recruits both top-down and bottom-up attentional mechanisms, as occurs in naturalistic saccadic behaviour. In experiment 1 gaze, but not arrows, facilitated saccadic reaction times (SRTs) in the opposite direction to the cues over all SOAs, whereas in experiment 2 directional word cues had no effect on saccades. In experiment 3 finger pointing cues caused reduced SRTs in the opposite direction to the cues at short SOAs. These findings suggest that biological cues automatically recruit the oculomotor system whereas non-biological cues do not. Furthermore, the anti-saccade task set appears to facilitate saccadic responses in the opposite direction to the cues.

Effect of directional speech warnings on road hazard detection

BACKGROUND

In the last 2 decades, cognitive science and the transportation psychology field have dedicated a lot of effort to designing advanced driver support systems. Verbal warning systems are increasingly being implemented in modern automobiles in an effort to increase road safety.

OBJECTIVE

The study presented here investigated the impact of directional speech alert messages on the participants' speed to judge whether or not naturalistic road scenes depicted a situation of impending danger.

METHOD

Thirty-eight volunteers performed a computer-based key-press reaction time task.

RESULTS

Findings indicated that semantic content of verbal warning signals can be used for increasing driving safety and improving hazard detection. Furthermore, the classical result regarding signal accuracy is confirmed: directional informative speech messages lead to faster hazard detection compared to drivers who received a high rate of false alarms.

CONCLUSION

Notwithstanding some study limitations (lack of driver experience and low ecological validity), this evidence could provide important information for the specification of future Human-Machine-interaction (HMI) design guidelines.

Action-related objects influence the distribution of visuospatial attention

Previous studies have shown that attention is drawn to the location of manipulable objects and is distributed across pairs of objects that are positioned for action. Here, we investigate whether central, action-related objects can cue attention to peripheral targets. Experiment 1 compared the effect of uninformative arrow and object cues on a letter discrimination task. Arrow cues led to spatial-cueing benefits across a range of stimulus onset asynchronies (SOAs: 0 ms, 120 ms, 400 ms), but object-cueing benefits were slow to build and were only significant at the 400-ms SOA. Similar results were found in Experiment 2, in which the targets were objects that could be either congruent or incongruent with the cue (e.g., screwdriver and screw versus screwdriver and glass). Cueing benefits were not influenced by the congruence between the cue and target, suggesting that the cueing effects reflected the action implied by the central object, not the interaction between the objects. For Experiment 3 participants decided whether the cue and target objects were related. Here, the interaction between congruent (but not incongruent) targets led to significant cueing/positioning benefits at all three SOAs. Reduced cueing benefits were obtained in all three experiments when the object cue did not portray a legitimate action (e.g., a bottle pointing towards an upper location, since a bottle cannot pour upwards), suggesting that it is the perceived action that is critical, rather than the structural properties of individual objects. The data suggest that affordance for action modulates the allocation of visual attention.

Using peripersonal warning signals to orient a driver's gaze

OBJECTIVE

We report a series of three experiments designed to assess the relative speed with which people can initiate speeded head-orienting responses following the presentation of spatial warning signals.

BACKGROUND

Recent cognitive neuroscience findings have shown that the human brain tends to treat stimuli occurring in peripersonal space as being somehow more behaviorally relevant and attention demanding than stimuli occurring in extrapersonal space. These brain mechanisms may be exploited in the design of warning signals.

METHOD

Experiment 1 assessed the effectiveness of various different unisensory warning signals in eliciting a head-turning response to look at the potential source of danger requiring participants' immediate attention; Experiment 2 assessed the latency of a driver's responses to events occurring in the cued direction; Experiment 3 assessed the relative effectiveness of various warning signals in reorienting a person's gaze back to a central driving task while he or she was distracted by a secondary task.

RESULTS

The results show that participants initiated head-turning movements and made speeded discrimination or braking responses significantly more rapidly following the presentation of a close rear auditory warning signal than following the presentation of either a far frontal auditory warning signal, a vibrotactile warning signal presented to their waist, or a peripheral visual warning signal.

CONCLUSION

These results support the claim that the introduction of peripersonal warning signals results in a significant performance advantage relative to traditionally designed warnings.

APPLICATION

Warning systems that have been designed around the constraints of the human brain offer great potential in the future design ofmultisensory interfaces.