Multisensory attention and tactile information-processing

Cross-modal metacognition: Visual and tactile confidence share a common scale

Humans can judge the quality of their perceptual decisions-an ability known as perceptual confidence. Previous work suggested that confidence can be evaluated on an abstract scale that can be sensory modality-independent or even domain-general. However, evidence is still scarce on whether confidence judgments can be directly made across visual and tactile decisions. Here, we investigated in a sample of 56 adults whether visual and tactile confidence share a common scale by measuring visual contrast and vibrotactile discrimination thresholds in a confidence-forced choice paradigm. Confidence judgments were made about the correctness of the perceptual decision between two trials involving either the same or different modalities. To estimate confidence efficiency, we compared discrimination thresholds obtained from all trials to those from trials judged to be relatively more confident. We found evidence for metaperception because higher confidence was associated with better perceptual performance in both modalities. Importantly, participants were able to judge their confidence across modalities without any costs in metaperceptual sensitivity and only minor changes in response times compared to unimodal confidence judgments. In addition, we were able to predict cross-modal confidence well from unimodal judgments. In conclusion, our findings show that perceptual confidence is computed on an abstract scale and that it can assess the quality of our decisions across sensory modalities.

May I Smell Your Attention: Exploration of Smell and Sound for Visuospatial Attention in Virtual Reality

When interacting with technology, attention is mainly driven by audiovisual and increasingly haptic stimulation. Olfactory stimuli are widely neglected, although the sense of smell influences many of our daily life choices, affects our behavior, and can catch and direct our attention. In this study, we investigated the effect of smell and sound on visuospatial attention in a virtual environment. We implemented the Bells Test, an established neuropsychological test to assess attentional and visuospatial disorders, in virtual reality (VR). We conducted an experiment with 24 participants comparing the performance of users under three experimental conditions (smell, sound, and smell and sound). The results show that multisensory stimuli play a key role in driving the attention of the participants and highlight asymmetries in directing spatial attention. We discuss the relevance of the results within and beyond human-computer interaction (HCI), particularly with regard to the opportunity of using VR for rehabilitation and assessment procedures for patients with spatial attention deficits.

Haptic-payment: Exploring vibration feedback as a means of reducing overspending in mobile payment

The proliferation of mobile payment applications in recent years has decoupled the physical act of paying from the consumption experience. Prior research suggests that this decreases the psychological sense of loss or 'pain' that consumers feel when making a purchase with more direct payment types (such as cash) and leads them to spend more money. To help address this issue, the present research explores, designs, and tests haptic vibration feedback configurations aimed at restoring the 'pain' of paying with cashless payment options (i.e., online and mobile payment). Counter-intuitively, the present research finds that lower- (vs. higher-) intensity vibration feedback reduces participants' reported willingness-to-spend when compared to a control group that does not receive any vibration feedback. This work is one of the first to explore the role of haptic vibration feedback in nudging consumers to reduce their spending when using cashless payment methods.

Attention in naïve psychology

In everyday life, mentalizing is nested in a rich context of cognitive faculties and background information that potentially contribute to its success. Yet, we know little about these modulating effects. Here we propose that humans develop a naïve psychological model of attention (featured as a goal-dependent, intentional relation to the environment) and use this to fine-tune their mentalizing attempts, presuming that the way people represent their environment is influenced by the cognitive priorities (attention) their current intentions create. The attention model provides an opportunity to tailor mental state inferences to the temporary features of the agent whose mind is in the focus of mentalizing. The ability to trace attention is an exceptionally powerful aid for mindreading. Knowledge about the partner's attention provides background information, however being grounded in his current intentions, attention has direct relevance to the ongoing interaction. Furthermore, due to its causal connection to intentions, the output of the attention model remains valid for a prolonged but predictable amount of time: till the evoking intention is in place. The naïve attention model theory is offered as a novel theory on social attention that both incorporates existing evidence and identifies new directions in research.

Smell and 3D Haptic Representation: A Common Pathway to Understand Brain Dynamics in a Cross-Modal Task. A Pilot OERP and fNIRS Study

Cross-modal perception allows olfactory information to integrate with other sensory modalities. Olfactory representations are processed by multisensory cortical pathways, where the aspects related to the haptic sensations are integrated. This complex reality allows the development of an integrated perception, where olfactory aspects compete with haptic and/or trigeminal activations. It is assumed that this integration involves both perceptive electrophysiological and metabolic/hemodynamic aspects, but there are no studies evaluating these activations in parallel. The aim of this study was to investigate brain dynamics during a cross-modal olfactory and haptic attention task, preceded by an exploratory session. The assessment of cross-modal dynamics was conducted through simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) recording, evaluating both electrophysiological and hemodynamic activities. The study consisted of two experimental sessions and was conducted with a sample of ten healthy subjects (mean age 25 ± 5.2 years). In Session 1, the subjects were trained to manipulate 3D haptic models (HC) and to smell different scents (SC). In Session 2, the subjects were tested during an attentive olfactory task, in order to investigate the olfactory event-related potentials (OERP) N1 and late positive component (LPC), and EEG rhythms associated with fNIRS components (oxy-Hb and deoxy-Hb). The main results of this study highlighted, in Task 1, a higher fNIRS oxy-Hb response during SC and a positive correlation with the delta rhythm in the central and parietal EEG region of interest. In Session 2, the N1 OERP highlighted a greater amplitude in SC. A negative correlation was found in HC for the deoxy-Hb parietal with frontal and central N1, and for the oxy-Hb frontal with N1 in the frontal, central and parietal regions of interests (ROIs). A negative correlation was found in parietal LPC amplitude with central deoxy-Hb. The data suggest that cross-modal valence modifies the attentional olfactory response and that the dorsal cortical/metabolic pathways are involved in these responses. This can be considered as an important starting point for understanding integrated cognition, as the subject could perceive in an ecological context.

Assessing the Automaticity of the Exogenous Orienting of Tactile Attention

We examined whether or not abrupt tactile onsets are capable of exogenously capturing tactile spatial attention when visual spatial attention is focused elsewhere. In experiment 1, we compared performance under dual-task conditions (where participants performed a tactile exogenous cuing task and a rapid serial visual presentation—RSVP—task at the same time) with their performance under single-task conditions (where the participants had to perform only the cuing task, although the RSVP stream was still presented in the background) and to a no-stream condition (where only the cuing task was presented). Tactile cuing was completely suppressed in both the dual-task and single-task conditions, showing that exogenous tactile spatial orienting is modulated by visual-spatial attention, which hence appears to be far from truly automatic. In experiment 2, we demonstrated that the abolishment of exogenous tactile orienting was not caused by the transient presentation of abrupt onset stimuli (letters). These results therefore show that exogenous spatial attentional orienting toward abrupt peripheral tactile stimuli is possible as long as perceptual resources are not depleted by a perceptually demanding (RSVP) task.

Numerosity Judgments for Tactile Stimuli Distributed over the Body Surface

A large body of research now supports the claim that two different and dissociable processes are involved in making numerosity judgments regarding visual stimuli: subitising (fast and nearly errorless) for up to 4 stimuli, and counting (slow and error-prone) when more than 4 stimuli are presented. We studied tactile numerosity judgments for combinations of 1–7 vibrotactile stimuli presented simultaneously over the body surface. In experiment 1, the stimuli were presented once, while in experiment 2 conditions of single presentation and repeated presentation of the stimulus were compared. Neither experiment provided any evidence for a discontinuity in the slope of either the RT or error data suggesting that subitisation does not occur for tactile stimuli. By systematically varying the intensity of the vibrotactile stimuli in experiment 3, we were able to demonstrate that participants were not simply using the ‘global intensity’ of the whole tactile display to make their tactile numerosity judgments, but were, instead, using information concerning the number of tactors activated. The results of the three experiments reported here are discussed in relation to current theories of counting and subitising, and potential implications for the design of tactile user interfaces are highlighted.

Tactile Stimuli Increase Effects of Modality Compatibility in Task Switching

Modality compatibility refers to the similarity of stimulus modality and modality of response-related sensory consequences. Previous dual-task studies found increased switch costs for modality incompatible tasks (auditory-manual/visual-vocal) compared to modality compatible tasks (auditory-vocal/visual-manual). The present task-switching study further examined modality compatibility and investigated vibrotactile stimulation as a novel alternative to visual stimulation. Interestingly, a stronger modality compatibility effect on switch costs was revealed for the group with tactile-auditory stimulation compared to the visual-auditory stimulation group. We suggest that the modality compatibility effect is based on crosstalk of central processing codes due to ideomotor "backward" linkages between the anticipated response effects and the stimuli indicating this response. This crosstalk is increased in the tactile-auditory stimulus group compared to the visual-auditory stimulus group due to a higher degree of ideomotor-compatibility in the tactile-manual tasks. Since crosstalk arises between tasks, performance is only affected in task switching and not in single tasks.

Designing Haptic Assistive Technology for Individuals Who Are Blind or Visually Impaired

This paper considers issues relevant for the design and use of haptic technology for assistive devices for individuals who are blind or visually impaired in some of the major areas of importance: Braille reading, tactile graphics, orientation and mobility. We show that there is a wealth of behavioral research that is highly applicable to assistive technology design. In a few cases, conclusions from behavioral experiments have been directly applied to design with positive results. Differences in brain organization and performance capabilities between individuals who are "early blind" and "late blind" from using the same tactile/haptic accommodations, such as the use of Braille, suggest the importance of training and assessing these groups individually. Practical restrictions on device design, such as performance limitations of the technology and cost, raise questions as to which aspects of these restrictions are truly important to overcome to achieve high performance. In general, this raises the question of what it means to provide functional equivalence as opposed to sensory equivalence.

How our body influences our perception of the world

Incorporating the fact that the senses are embodied is necessary for an organism to interpret sensory information. Before a unified perception of the world can be formed, sensory signals must be processed with reference to body representation. The various attributes of the body such as shape, proportion, posture, and movement can be both derived from the various sensory systems and can affect perception of the world (including the body itself). In this review we examine the relationships between sensory and motor information, body representations, and perceptions of the world and the body. We provide several examples of how the body affects perception (including but not limited to body perception). First we show that body orientation effects visual distance perception and object orientation. Also, visual-auditory crossmodal-correspondences depend on the orientation of the body: audio "high" frequencies correspond to a visual "up" defined by both gravity and body coordinates. Next, we show that perceived locations of touch is affected by the orientation of the head and eyes on the body, suggesting a visual component to coding body locations. Additionally, the reference-frame used for coding touch locations seems to depend on whether gaze is static or moved relative to the body during the tactile task. The perceived attributes of the body such as body size, affect tactile perception even at the level of detection thresholds and two-point discrimination. Next, long-range tactile masking provides clues to the posture of the body in a canonical body schema. Finally, ownership of seen body parts depends on the orientation and perspective of the body part in view. Together, all of these findings demonstrate how sensory and motor information, body representations, and perceptions (of the body and the world) are interdependent.

Approach of visual stimuli modulates spatial expectations for subsequent somatosensory stimuli

To examine how the approach of visual stimuli toward the body influences expectations regarding subsequent somatosensory stimuli, we recorded event-related brain potentials (ERPs; nose reference) during a simple reaction time to somatosensory stimuli task. Twelve participants were asked to place their arms on a desk, and three LEDs were placed between their arms at equal intervals. Electrical stimuli were presented to the left (or right) wrist at a high probability (80%) or to the opposite wrist at a low probability (20%). Each trial was composed of three visual stimuli followed by one electrical stimulus. In Experiment 1, the right, center, and left (or left, center, and right) LEDs were turned on sequentially toward the wrist to which the high probability somatosensory stimuli was presented (congruent condition), or the center LED were presented three times (neutral condition). Experiment 2 was composed of the congruent condition and the inverse of the congruent condition (incongruent condition). In both experiments, the reaction times to low probability stimuli were longer than those to high probability stimuli. Moreover, the low probability stimuli elicited a larger P3 amplitude than the high probability stimuli. In addition, the P3 amplitude was higher under the visual approach condition (i.e., the congruent condition in each experiment) than under the control condition (i.e., the neutral and incongruent conditions). Furthermore, no effect on the CNV amplitude before the somatosensory stimuli was found. These results suggest that visual stimuli directed toward the body induce an automatic spatial expectation for subsequent somatosensory stimuli.

Visual attention in a visual-haptic, cross-modal matching task in children and adults

Visual fixation patterns were analyzed to gain insight into developmental changes in attention allocation in a cross-modal task. Two patterns that have been associated with increased task difficulty, gaze aversion and fixation duration, were recorded using an eye-tracker. In this exploratory study, 37 elementary age children (M age 7-10 yr.) and 23 undergraduates engaged in visual-only and haptic-visual shape-matching tasks. Theoretical assumptions underlying this study are that children have greater limitations on attention capacity compared to adults, and that a task presented in the cross-modal condition would pose special demands on this capacity. A 2×2 (uni- or cross-modal×age group) repeated-measures analysis of variance (ANOVA) was used to analyze both gaze aversion and average fixation duration. Children averted gaze significantly more during the cross-modal condition, supporting the idea that children use gaze aversion as an attention-shifting mechanism. Mean fixation duration increased for both groups in the cross-modal condition. Due to the small number and limited age range of the children as well as the limited number of task items, interpretations are made with caution.

Rubber hand illusion reduces discomfort caused by cold stimulus

There is a growing interest in body-ownership disruptions and their consequences for subjective experiences such as tactile sensations or pain. Here, we investigated the effect of the rubber hand illusion (RHI) on the perceived discomfort caused by cold stimulus applied to the real hand. The results showed reduced discomfort to cold reflected in behavioural and subjective measures. The stronger the illusion, the later the cold temperature became unpleasant and the less intense the experience was rated. We discuss the link between thermoception and body ownership as well as possible theoretical and methodological implications for studies on pain experience under RHI.

Global and local processing near the left and right hands

Visual targets can be processed more quickly and reliably when a hand is placed near the target. Both unimodal and bimodal representations of hands are largely lateralized to the contralateral hemisphere, and since each hemisphere demonstrates specialized cognitive processing, it is possible that targets appearing near the left hand may be processed differently than targets appearing near the right hand. The purpose of this study was to determine whether visual processing near the left and right hands interacts with hemispheric specialization. We presented hierarchical-letter stimuli (e.g., small characters used as local elements to compose large characters at the global level) near the left or right hands separately and instructed participants to discriminate the presence of target letters (X and O) from non-target letters (T and U) at either the global or local levels as quickly as possible. Targets appeared at either the global or local level of the display, at both levels, or were absent from the display; participants made foot-press responses. When discriminating target presence at the global level, participants responded more quickly to stimuli presented near the left hand than near either the right hand or in the no-hand condition. Hand presence did not influence target discrimination at the local level. Our interpretation is that left-hand presence may help participants discriminate global information, a right hemisphere (RH) process, and that the left hand may influence visual processing in a way that is distinct from the right hand.

Impaired disengagement from threatening cues of impending pain in a crossmodal cueing paradigm

This paper reports an experimental investigation of attentional engagement to and disengagement from cues of impending pain. Pain-free volunteers performed a cueing task in which they were instructed to detect somatosensory and tone targets. Target stimuli were preceded by visual cues informing participants of the modality of the impending stimuli. Participants were randomly assigned to a pain group (n = 54) or to a control group (n = 53). Somatosensory targets consisted of painful electrocutaneous stimuli in the pain group and non-painful vibrotactile targets in the control group. Analyses revealed a similar amount of attentional engagement to both cues signalling somatosensory targets, irrespective of their threat value. However, participants had significantly more difficulty in disengaging attention from a threatening cue of impending pain compared to a cue signalling the non-painful vibrotactile target. Our findings provide further evidence that pain cues demand attention, particularly resulting in impaired disengagement.

Visual and haptic influence on perception of stimulus size

In six experiments, subjects judged the sizes of squares that were presented visually and/or haptically, in unimodal or bimodal conditions. We were interested in which mode most affected size judgments in the bimodal condition when the squares presented to each mode actually differed in size. Three factors varied: whether haptic exploration was passive or active, whether the choice set from which the subjects selected their responses was visual or haptic, and whether cutaneous information was provided in addition to kinesthetic information. To match the task for each mode, visual presentations consisted of a cursor that moved along a square pathway to correspond to the haptic experience of successive segments revealed during exploration. We found that the visual influence on size judgments was greater than the influence of haptics when the haptic experience involved only kinesthesis, passive movement, and a visual choice set. However, when cutaneous input was added to kinesthetic information, size judgments were most influenced by the haptic mode. The results support hypotheses of sensory integration, rather than capture of one sense by the other.

Human olfaction: a constant state of change-blindness

Paradoxically, although humans have a superb sense of smell, they don’t trust their nose. Furthermore, although human odorant detection thresholds are very low, only unusually high odorant concentrations spontaneously shift our attention to olfaction. Here we suggest that this lack of olfactory awareness reflects the nature of olfactory attention that is shaped by the spatial and temporal envelopes of olfaction. Regarding the spatial envelope, selective attention is allocated in space. Humans direct an attentional spotlight within spatial coordinates in both vision and audition. Human olfactory spatial abilities are minimal. Thus, with no olfactory space, there is no arena for olfactory selective attention. Regarding the temporal envelope, whereas vision and audition consist of nearly continuous input, olfactory input is discreet, made of sniffs widely separated in time. If similar temporal breaks are artificially introduced to vision and audition, they induce “change blindness”, a loss of attentional capture that results in a lack of awareness to change. Whereas “change blindness” is an aberration of vision and audition, the long inter-sniff-interval renders “change anosmia” the norm in human olfaction. Therefore, attentional capture in olfaction is minimal, as is human olfactory awareness. All this, however, does not diminish the role of olfaction through sub-attentive mechanisms allowing subliminal smells a profound influence on human behavior and perception.

The Involvement of Occipital Cortex in the Early Blind in Auditory and Tactile Duration Discrimination Tasks

Early blind participants outperform controls on several spatially oriented perceptual tasks such as sound localization and tactile orientation discrimination. Previous studies have suggested that the recruitment of occipital cortex in the blind is responsible for this improvement. For example, electroencephalographic studies showed an enlarged posterior negativity for the blind in these tasks compared to controls. In our study, the question was raised whether the early blind are also better at tasks in which the duration of auditory and tactile stimuli must be discriminated. The answer was affirmative. Our electroencephalographic data revealed an enlarged posterior negativity for the blind relative to controls. Source analyses showed comparable solutions in the case of auditory and tactile targets for the blind. These findings support the interpretation of these negativities in terms of a supramodal rather than a modality-specific process, although confirmation with more spatially sensitive methods seems necessary. We additionally examined whether the early blind are less affected by irrelevant tactile or auditory exogenous cues preceding auditory or tactile targets than controls. No differences in alerting and orienting effects of these cues were found between the blind and the controls. Together, our results support the view that major differences between early blind participants and sighted controls on auditory and tactile duration discrimination tasks relate to a late and likely supramodal process that takes place in occipital areas.

Crossmodal influences in somatosensory cortex: Interaction of vision and touch

Previous research has shown that information from one sensory modality has the potential to influence activity in a different modality, and these crossmodal interactions can occur early in the cortical sensory processing stream within sensory-specific cortex. In addition, it has been shown that when sensory information is relevant to the performance of a task, there is an upregulation of sensory cortex. This study sought to investigate the effects of simultaneous bimodal (visual and vibrotactile) stimulation on the modulation of primary somatosensory cortex (SI), in the context of a delayed sensory-to-motor task when both stimuli are task-relevant. It was hypothesized that the requirement to combine visual and vibrotactile stimuli would be associated with an increase in SI activity compared to vibrotactile stimuli alone. Functional magnetic resonance imaging (fMRI) was performed on healthy subjects using a 3T scanner. During the scanning session, subjects performed a sensory-guided motor task while receiving visual, vibrotactile, or both types of stimuli. An event-related design was used to examine cortical activity related to the stimulus onset and the motor response. A region of interest (ROI) analysis was performed on right SI and revealed an increase in percent blood oxygenation level dependent signal change in the bimodal (visual + tactile) task compared to the unimodal tasks. Results of the whole-brain analysis revealed a common fronto-parietal network that was active across both the bimodal and unimodal task conditions, suggesting that these regions are sensitive to the attentional and motor-planning aspects of the task rather than the unimodal or bimodal nature of the stimuli.

Perception in action: the impact of sensory information on sensorimotor synchronization in musicians and non-musicians

The present study aimed at investigating to what extent sensorimotor synchronization is related to (i) musical specialization, (ii) perceptual discrimination, and (iii) the movement's trajectory. To this end, musicians with different musical expertise (drummers, professional pianists, amateur pianists, singers, and non-musicians) performed an auditory and visual synchronization and a cross-modal temporal discrimination task. During auditory synchronization drummers performed less variably than amateur pianists, singers and non-musicians. In the cross-modal discrimination task drummers showed superior discrimination abilities which were correlated with synchronization variability as well as with the trajectory. These data suggest that (i) the type of specialized musical instrument affects synchronization abilities and (ii) synchronization accuracy is related to perceptual discrimination abilities as well as to (iii) the movement's trajectory. Since particularly synchronization variability was affected by musical expertise, the present data imply that the type of instrument improves accuracy of timekeeping mechanisms.

Short article: The role of working memory in tactile selective attention

Load theory suggests that working memory controls the extent to which irrelevant distractors are processed (e.g., Lavie, Hirst, De Fockert, & Viding, 2004). However, so far this proposal has only been tested in vision. Here, we examine the extent to which tactile selective attention also depends on working memory. In Experiment 1, participants focused their attention on continuous target vibrations while attempting to ignore pulsed distractor vibrations. In Experiment 2, targets were always presented to a particular hand, with distractors being presented to the other hand. In both experiments, a high (vs. low) load in a concurrent working memory task led to greater interference by the tactile distractors. These results establish the role of working memory in the control of tactile selective attention, demonstrating for the first time that the principles of load theory also apply to the tactile modality.

Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment

This study examined the concurrent performance of military gunnery, robotics control and communication tasks in a simulated environment. More specifically, the study investigated how aided target recognition (AiTR) capabilities (delivered either through tactile or tactile + visual cueing) for the gunnery task might benefit overall performance. Results showed that AiTR benefited not only the gunnery task, but also the concurrent robotics and communication tasks. The participants' spatial ability was found to be a good indicator of their gunnery and robotics task performance. However, when AiTR was available to assist their gunnery task, those participants of lower spatial ability were able to perform their robotics tasks as well as those of higher spatial ability. Finally, participants' workload assessment was significantly higher when they teleoperated (i.e. remotely operated) a robot and when their gunnery task was unassisted. These results will further understanding of multitasking performance in military tasking environments. These results will also facilitate the implementation of robots in military settings and will provide useful data to military system designs.

Neurobehavioral testing in human risk assessment

Neurobehavioral tests are being increasingly used in human risk assessment and there is a strong need for guidance. The field of neurobehavioral toxicology has evolved from research which initially focused on using traditional neuropsychological tests to identify "abnormal cases" to include methods used to detect sub-clinical deficits, to further incorporate the use of neurosensory assessment, and to expand testing from occupational populations to vulnerable populations including older adults and children. Even as exposures in the workplace are reduced, they have been increasing in the environment and research on exposure has now expanded to cross the entire lifetime. These neurobehavioral methods are applied in research and the findings used for regulatory purposes to develop preventative action for exposed populations. This paper reflects a summary of the talks presented at the Neurobehavioral Testing in Human Risk Assessment symposium presented at the 11th meeting of the International Neurotoxicology Association.

Why Does Joint Attention Look Atypical in Autism?

This essay answers the question of why autistic children are less likely to initiate joint attention (e.g., use their index finger to point to indicate interest in something) and why they are less likely to respond to bids for their joint attention (e.g., turn their heads to look at something to which another person points). It reviews empirical evidence that autistic toddlers, children, adolescents, and adults can attend covertly, even to social stimuli, such as the direction in which another person's eyes are gazing. It also reviews empirical evidence that autistics of various ages understand the intentionality of other persons' actions. The essay suggests that autistics' atypical resistance to distraction, atypical skill at parallel perception, and atypical execution of volitional actions underlie their atypical manifestations of joint attention.

Feeding kinematics, suction and hydraulic jetting capabilities in bearded seals (Erignathus barbatus)

Feeding kinematics, suction and hydraulic jetting capabilities of bearded seals (Erignathus barbatus) were characterized during controlled feeding trials. Feeding trials were conducted both on land and in water, and allowed a choice between suction and biting, but food was also presented that could be ingested by suction alone. Four feeding phases, preparatory, jaw opening, hyoid depression and jaw closing were observed; the mean feeding cycle duration was 0.54±0.22 s, regardless of feeding mode(P>0.05). Subjects feeding on land used biting and suction 89.3%and 10.7% of the time, respectively. Subjects feeding in water used suction and hydraulic jetting 96.3% and 3.7% of the time, respectively. No biting behavior was observed underwater. Suction feeding was characterized by a small gape (2.7±0.85 cm), small gape angle (24.4±8.13°), pursing of the rostral lips to form a circular aperture, and pursing of the lateral lips to occlude lateral gape. Biting was characterized by large gape(7.3±2.2 cm), large gape angle (41.7±15.2°), and lip curling to expose the teeth. An excavation behavior in which suction and hydraulic jetting were alternated was used to extract food from recessed wells. The maximum subambient and suprambient pressures recorded were 91.2 and 53.4 kPa,respectively. The inclusion of suction data for phocids broadens the principle that suction feeding kinematics is conserved among aquatic vertebrates. Furthermore, bearded seals support predictions that mouth size, fluid flow speed, and elusiveness of prey consumed are among a suite of traits that determine the specific nature of suction feeding among species.

Pain Draws Visual Attention to Its Location: Experimental Evidence for a Threat-Related Bias

It has been often demonstrated that pain interferes with the processing of other information. However, the initiation of protective behavior in response to pain also requires enhanced processing of potentially relevant information, such as stimuli sharing the same spatial coordinates. In this study we test whether pain draws visual attention to its location. We report 2 experiments in which healthy individuals detected visual stimuli at 2 possible locations. Each stimulus was preceded by painful stimulation at the corresponding (congruent trial) or noncorresponding (incongruent trial) location. Based on the probability ratio of congruent to incongruent trials, pain was either spatially informative (experiment 1) or uninformative (experiment 2) for visual target detection. The detection of visual stimuli was faster at the pain location than at the other location in both experiments suggesting efficient spatially guided orienting and responding to potential sources of somatic threat. However, when pain was spatially uninformative, visual attention was only drawn to the pain location when pain was perceived as threatening. This indicates that threatening pain prioritizes the processing of visual information at its location, even if the pain is irrelevant for the upcoming visual event.

PERSPECTIVE

In this study a threat-related processing bias of visual information on a painful body location was demonstrated. This finding advances our knowledge on how pain modulates attention. More particularly, it seems that interruption by pain is not absolute and that pain prioritizes the processing of other perceptual information that it spatially related to the pain.

The context of a noxious stimulus affects the pain it evokes

The influence of contextual factors on the pain evoked by a noxious stimulus is not well defined. In this study, a -20 degrees C rod was placed on one hand for 500 ms while we manipulated the evaluative context (or 'meaning') of, warning about, and visual attention to, the stimulus. For meaning, a red (hot, more tissue damaging) or blue (cold, less tissue damaging) visual cue was used. For warning, the stimulus occurred after the cue or they occurred together. For visual attention, subjects looked towards the stimulus or away from it. Repeated measures ANCOVA was significant (alpha=0.0125). Stimuli associated with a red cue were rated as hot, with the blue cue as cold (difference on an 11 point scale approximately 5.5). The red cue also meant the pain was rated as more unpleasant (difference approximately 3.5) and more intense (difference approximately 3). For stimuli associated with the red cue only, the pain was more unpleasant when the stimulus occurred after the cue than when it didn't (difference approximately 1.1). Pain was rated as more intense, and the stimulus as hotter, when subjects looked at the red-cued stimulus than when they didn't (difference approximately 0.9 for pain intensity and approximately 2 for temperature). We conclude that meaning affects the experience a noxious stimulus evokes, and that warning and visual attention moderate the effects of meaning when the meaning is associated with tissue-damage. Different dimensions of the stimulus' context can have differential effects on sensory-discriminative and affective-emotional components of pain.

Event-related potentials during auditory oddball, and combined auditory oddball-visual paradigms

The purpose of the current study was to investigate the properties of a new modification of the classical auditory oddball paradigm (auditory oddball paradigm combined with passive visual stimulation, AERPs + VEPs) and compare the scalp topography obtained with the new paradigm and the classical auditory oddball paradigm (AERPs) in healthy humans. The responses to bimodal stimulation, and to the classical oddball paradigm were similar to those reported in other studies in terms of location, amplitudes, and latencies of P1, N1, P2, N2, and P300. The new modification of the oddball paradigm produced P300 at fronto-central locations in contrast to centro-parietal locations during the classical oddball paradigm. The amplitudes and latencies of P300 were also significantly larger during the new than the classical paradigm. Furthermore, the amplitudes of N1 and P2, but not N2 were significantly higher and differed in location during the new paradigm in response to both target and standard stimuli. The latencies of all three waves were significantly longer and the latency of P2 differed in location between the new and the classical paradigms in response to only the standard stimuli. The results of this study suggest that the new modification of the classical oddball paradigm produces different neural responses to the classical oddball paradigm. Therefore, this modification can be used to investigate dysfunctions in sensory and cognitive processing in clinical samples.

Event-related potentials to visual, auditory, and bimodal (combined auditory-visual) stimuli

The purpose of this study was to investigate the response properties of event related potentials to unimodal and bimodal stimulations. The amplitudes of N1 and P2 were larger during bimodal evoked potentials (BEPs) than auditory evoked potentials (AEPs) in the anterior sites and the amplitudes of P1 were larger during BEPs than VEPs especially at the parieto-occipital locations. Responses to bimodal stimulation had longer latencies than responses to unimodal stimulation. The N1 and P2 components were larger in amplitude and longer in latency during the bimodal paradigm and predominantly occurred at the anterior sites. Therefore, the current bimodal paradigm can be used to investigate the involvement and location of specific neural generators that contribute to higher processing of sensory information. Moreover, this paradigm may be a useful tool to investigate the level of sensory dysfunctions in clinical samples.

Dysynchiria is not a common feature of neuropathic pain

Patients with chronic neuropathic pain (non-CRPS) and brush-evoked allodynia watched a reflected image of their corresponding but opposite skin region being brushed in a mirror. Unlike complex regional pain syndrome Type 1, this process did not evoke any sensation at the affected area ('dysynchiria'). We conclude that central nociceptive sensitisation alone is not sufficient to cause dysynchiria in neuropathic pain. The results imply a difference in cortical pain processing between complex regional pain syndrome and other chronic neuropathic pain.

Somatoform dissociation and somatosensory amplification are differentially associated with attention to the tactile modality following exposure to body-related stimuli

OBJECTIVE

Body-focused attention is regarded as an important maintaining factor for somatoform illness, although there is limited empirical evidence pertaining to this hypothesis. This study was conducted to assess whether individual differences in somatoform dissociation and somatosensory amplification were associated with biased attention towards the tactile modality, particularly following exposure to threatening body-related stimuli.

METHODS

Forty-eight nonclinical participants completed the Somatoform Dissociation Questionnaire (SDQ-20; a proxy measure of somatoform symptomatology), the Somatosensory Amplification Scale (SSAS), and a modality bias task. The task consisted of a series of body-relevant or body-irrelevant (scene) picture stimuli, half of which were threatening and half were neutral, followed by target stimuli in either the visual or the tactile modality. Participants judged the location of each target stimulus, and performance data were used to calculate the degree to which participants were biased towards the tactile modality following each of the picture types.

RESULTS

Participants in the high SDQ-20 group (defined by median split) showed a significant increase in tactile bias when responding to targets occurring 250 ms after the presentation of threatening body-relevant stimuli only. This effect was not observed for the low SDQ-20 group. Scores on the SSAS correlated negatively with tactile bias for both threatening and neutral body-relevant stimuli at 250 ms.

CONCLUSIONS

Individuals with a tendency to experience somatoform symptoms focus more on stimuli in the tactile modality immediately following exposure to threatening body-relevant information. In contrast, self-reported somatosensory amplification appears to be associated with attention away from the tactile modality rather than with increased tactile focus.

Alerts for in-vehicle information systems: annoyance, urgency, and appropriateness

OBJECTIVE

This study assesses the influence of the auditory characteristics of alerts on perceived urgency and annoyance and whether these perceptions depend on the context in which the alert is received.

BACKGROUND

Alert parameters systematically affect perceived urgency, and mapping the urgency of a situation to the perceived urgency of an alert is a useful design consideration. Annoyance associated with environmental noise has been thoroughly studied, but little research has addressed whether alert parameters differentially affect annoyance and urgency.

METHOD

Three 2(3) x 3 mixed within/between factorial experiments, with a total of 72 participants, investigated nine alert parameters in three driving contexts. These parameters were formant (similar to harmonic series), pulse duration, interpulse interval, alert onset and offset, burst duty cycle, alert duty cycle, interburst period, and sound type. Imagined collision warning, navigation alert, and E-mail notification scenarios defined the driving context.

RESULTS

All parameters influenced both perceived urgency and annoyance (p < .05), with pulse duration, interpulse interval, alert duty cycle, and sound type influencing urgency substantially more than annoyance. There was strong relationship between perceived urgency and rated appropriateness for high-urgency driving scenarios and a strong relationship between annoyance and rated appropriateness for low-urgency driving scenarios.

CONCLUSION

Sound parameters differentially affect annoyance and urgency. Also, urgency and annoyance differentially affect perceived appropriateness of warnings.

APPLICATION

Annoyance may merit as much attention as urgency in the design of auditory warnings, particularly in systems that alert drivers to relatively low-urgency situations.

Prediction of the main cortical areas and connections involved in the tactile function of the visual cortex by network analysis

We explored the cortical pathways from the primary somatosensory cortex to the primary visual cortex (V1) by analysing connectional data in the macaque monkey using graph-theoretical tools. Cluster analysis revealed the close relationship of the dorsal visual stream and the sensorimotor cortex. It was shown that prefrontal area 46 and parietal areas VIP and 7a occupy a central position between the different clusters in the visuo-tactile network. Among these structures all the shortest paths from primary somatosensory cortex (3a, 1 and 2) to V1 pass through VIP and then reach V1 via MT, V3 and PO. Comparison of the input and output fields suggested a larger specificity for the 3a/1-VIP-MT/V3-V1 pathways among the alternative routes. A reinforcement learning algorithm was used to evaluate the importance of the aforementioned pathways. The results suggest a higher role for V3 in relaying more direct sensorimotor information to V1. Analysing cliques, which identify areas with the strongest coupling in the network, supported the role of VIP, MT and V3 in visuo-tactile integration. These findings indicate that areas 3a, 1, VIP, MT and V3 play a major role in shaping the tactile information reaching V1 in both sighted and blind subjects. Our observations greatly support the findings of the experimental studies and provide a deeper insight into the network architecture underlying visuo-tactile integration in the primate cerebral cortex.

Vision and touch in ageing: Crossmodal selective attention and visuotactile spatial interactions

We investigated whether ageing affects crossmodal selective attention (the ability to focus on a relevant sensory modality and ignore an irrelevant modality) and the spatial constraints on such selective processing. Three groups of 24 participants were tested: Young (19-25 years), Young-Old (65-72 years) and Old-Old (76-92 years). The participants had to judge the elevation of vibrotactile targets (upper/index finger and lower/thumb), presented randomly to either hand while ignoring concurrent visual distractors. In a second task, the role of the target and distractor modalities was reversed. Crossmodal selective attention was assessed by comparing performance in the presence versus absence of distractors. Spatial constraints on selective attention were also investigated by comparing the effect of distractors presented on the same versus opposite side as the target. When attending to touch, the addition of visual distractors had a significantly larger effect on error rates in both of the older groups as compared to the Young group. This indicates that ageing has a detrimental effect on crossmodal selective attention. In all three age groups, performance was impaired when the target and distractor were presented at incongruent as compared to congruent elevations in both tasks. This congruency effect was modulated by the relative spatial location of the target and distractor in certain conditions for the Young and the Young-Old group. That is, participants in the two younger age groups found it harder to attend selectively to targets in one modality, when distractor stimuli came from the same side rather than from the opposite side. However, no significant spatial modulation was found in the Old-Old group. This suggests that ageing may also compromise spatial aspects of crossmodal selective attention.

Crossmodal interactions: lessons from synesthesia

Synesthesia is a condition in which stimulation in one modality also gives rise to a perceptual experience in a second modality. In two recent studies we found that the condition is more common than previously reported; up to 5% of the population may experience at least one type of synesthesia. Although the condition has been traditionally viewed as an anomaly (e.g., breakdown in modularity), it seems that at least some of the mechanisms underlying synesthesia do reflect universal crossmodal mechanisms. We review here a number of examples of crossmodal correspondences found in both synesthetes and nonsynesthetes including pitch-lightness and vision-touch interaction, as well as cross-domain spatial-numeric interactions. Additionally, we discuss the common role of spatial attention in binding shape and color surface features (whether ordinary or synesthetic color). Consistently with behavioral and neuroimaging data showing that chromatic-graphemic (colored-letter) synesthesia is a genuine perceptual phenomenon implicating extrastriate cortex, we also present electrophysiological data showing modulation of visual evoked potentials by synesthetic color congruency.

The brain's fingers and hands

The brain keeps track of the changing positions of body parts in space using a spatial body schema. When subjects localise a tactile stimulus on the skin, they might either use a somatotopic body map, or use a body schema to identify the location of the stimulation in external space. Healthy subjects were touched on the fingertips, with the hands in one of two postures: either the right hand was vertically above the left, or the fingers of both hands were interwoven. Subjects made speeded verbal responses to identify either the finger or the hand that was touched. Interweaving the fingers significantly impaired hand identification across several experiments, but had no effect on finger identification. Our results suggest that identification of fingers occurs in a somatotopic representation or finger schema. Identification of hands uses a general body schema, and is influenced by external spatial location. This dissociation implies that touches on the finger can only be identified with a particular hand after a process of assigning fingers to hands. This assignment is based on external spatial location. Our results suggest a role of the body schema in the identification of structural body parts from touch.

Viewing touch improves tactile sensory threshold

Previous research on multisensory integration has demonstrated that viewing the stimulated body part enhances discrimination ability. Participants in this experiment watched a video showing a hand being touched by a stick and a second video showing the stick touching the space beneath the hand. Sensory thresholds of the index fingers were tested with von Frey filaments. We found significant enhancements of the sensory threshold after showing the video with the touched hand but not after showing the video with no touch of the hand. This enhancement was specific for the index finger shown in the video. The results link the visuotactile enhancement of this study to the observation of touch rather than to the simple depiction of the body part.

Multisensory contributions to the 3-D representation of visuotactile peripersonal space in humans: evidence from the crossmodal congruency task

In order to determine precisely the location of a tactile stimulus presented to the hand it is necessary to know not only which part of the body has been stimulated, but also where that part of the body lies in space. This involves the multisensory integration of visual, tactile, proprioceptive, and even auditory cues regarding limb position. In recent years, researchers have become increasingly interested in the question of how these various sensory cues are weighted and integrated in order to enable people to localize tactile stimuli, as well as to give rise to the 'felt' position of our limbs, and ultimately the multisensory representation of 3-D peripersonal space. We highlight recent research on this topic using the crossmodal congruency task, in which participants make speeded elevation discrimination responses to vibrotactile targets presented to the thumb or index finger, while simultaneously trying to ignore irrelevant visual distractors presented from either the same (i.e., congruent) or a different (i.e., incongruent) elevation. Crossmodal congruency effects (calculated as performance on incongruent-congruent trials) are greatest when visual and vibrotactile stimuli are presented from the same azimuthal location, thus providing an index of common position across different sensory modalities. The crossmodal congruency task has been used to investigate a number of questions related to the representation of space in both normal participants and brain-damaged patients. In this review, we detail the major findings from this research, and highlight areas of convergence with other cognitive neuroscience disciplines.

Bare hands and attention: evidence for a tactile representation of the human body

If brain lesions impair the allocation of attention to a representation of the body surface and the hand may serve as an attentional focus or "wand", one might expect that somatosensory deficits caused by cerebral lesions would be ameliorated by contact with the ipsilesional hand. To test this prediction, tactile detection tasks were administered to two subjects with right hemisphere lesions. Subject CB's left tactile extinction was investigated in conditions in which the degree of contact between the right and left hands and the spatial relationship between his hands was systematically varied. His left tactile extinction was significantly reduced by touch of the right hand. Similarly, extinction at the left knee was ameliorated by touch of the knee by the right hand; touch of the right foot had no effect. Subject NC's ability to detect a tactile stimulus delivered to the left side was systematically assessed in conditions in which the hands touched and the spatial relationship between the hands was varied. His ability to detect a touch on the left hand improved in conditions in which the left hand was touched by the right hand. This effect was not observed if direct contact between the two hands was prevented by inserting a thin cloth between the hands. For both subjects, placing the right hand in close proximity to the left hand or altering the spatial location of the hands relative to the body did not influence performance. These data demonstrate that the hand may serve as a conduit for attention and provide strong evidence for a distinct representation of the body surface that is at least in part independent of spatial representations.

Percept-related activity in the human somatosensory system: functional magnetic resonance imaging studies

In this paper, we review blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) studies addressing the neural correlates of touch, thermosensation, pain and the mechanisms of their cognitive modulation in healthy human subjects. There is evidence that fMRI signal changes can be elicited in the parietal cortex by stimulation of single mechanoceptive afferent fibers at suprathreshold intensities for conscious perception. Positive linear relationships between the amplitude or the spatial extents of BOLD fMRI signal changes, stimulus intensity and the perceived touch or pain intensity have been described in different brain areas. Some recent fMRI studies addressed the role of cortical areas in somatosensory perception by comparing the time course of cortical activity evoked by different kinds of stimuli with the temporal features of touch, heat or pain perception. Moreover, parametric single-trial functional MRI designs have been adopted in order to disentangle subprocesses within the nociceptive system. Available evidence suggest that studies that combine fMRI with psychophysical methods may provide a valuable approach for understanding complex perceptual mechanisms and top-down modulation of the somatosensory system by cognitive factors specifically related to selective attention and to anticipation. The brain networks underlying somatosensory perception are complex and highly distributed. A deeper understanding of perceptual-related brain mechanisms therefore requires new approaches suited to investigate the spatial and temporal dynamics of activation in different brain regions and their functional interaction.

Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time

Manual reaction times to visual, auditory, and tactile stimuli presented simultaneously, or with a delay, were measured to test for multisensory interaction effects in a simple detection task with redundant signals. Responses to trimodal stimulus combinations were faster than those to bimodal combinations, which in turn were faster than reactions to unimodal stimuli. Response enhancement increased with decreasing auditory and tactile stimulus intensity and was a U-shaped function of stimulus onset asynchrony. Distribution inequality tests indicated that the multisensory interaction effects were larger than predicted by separate activation models, including the difference between bimodal and trimodal response facilitation. The results are discussed with respect to previous findings in a focused attention task and are compared with multisensory integration rules observed in bimodal and trimodal superior colliculus neurons in the cat and monkey.

Altered auditory-tactile interactions in congenitally blind humans: an event-related potential study

It has been shown that stimuli of a task-irrelevant modality receive enhanced processing when they are presented at an attended location in space (crossmodal attention). The present study investigated the effects of visual deprivation on the interaction of the intact sensory systems. Random streams of tactile and auditory stimuli were presented at the left or right index finger of congenitally blind participants. They had to attend to one modality (auditory or tactile) of one side (left or right) and had to respond to deviant stimuli of the attended modality and side. While in a group of sighted participants, early event-related potentials (ERPs) were negatively displaced to stimuli presented at the attended position, compared to the unattended, for both the task-relevant and the task-irrelevant modality, starting as early as 80 ms after stimulus onset (unimodal and crossmodal spatial attention effects, respectively), corresponding crossmodal effects could not be detected in the blind. In the sighted, spatial attention effects after 200 ms were only significant for the task-relevant modality, whereas a crossmodal effect for this late time window was observed in the blind. This positive rather than negative effect possibly indicates an active suppression of task-irrelevant stimuli at an attended location in space. The present data suggest that developmental visual input is essential for the use of space to integrate input of the non-visual modalities, possibly because of its high spatial resolution. Alternatively, enhanced perceptual skills of the blind within the intact modalities may result in reduced multisensory interactions ("inverse effectiveness of multisensory integration").

Crossmodal integration--insights from the chemical senses

Our understanding of the neural correlates of crossmodal binding in the human brain derives almost exclusively from studies of audition, vision and somatosensation. A new study by Gottfried and Dolan extends our understanding of multisensory integration by showing that facilitation of odor detection by visual cues depends on object congruency, as well as on enhanced activity in the superior temporal sulcus and a region of the orbitofrontal cortex that is adjacent to olfactory association cortex.