Tactile-visual cross-modal shape matching: a functional MRI study

Informational Masking in Aging and Brain-lesioned Individuals

Auditory stream segregation and informational masking were investigated in brain-lesioned individuals, age-matched controls with no neurological disease, and young college-age students. A psychophysical paradigm known as rhythmic masking release (RMR) was used to examine the ability of participants to identify a change in the rhythmic sequence of 20-ms Gaussian noise bursts presented through headphones and filtered through generalized head-related transfer functions to produce the percept of an externalized auditory image (i.e., a 3D virtual reality sound). The target rhythm was temporally interleaved with a masker sequence comprising similar noise bursts in a manner that resulted in a uniform sequence with no information remaining about the target rhythm when the target and masker were presented from the same location (an impossible task). Spatially separating the target and masker sequences allowed participants to determine if there was a change in the target rhythm midway during its presentation. RMR thresholds were defined as the minimum spatial separation between target and masker sequences that resulted in 70.7% correct-performance level in a single-interval 2-alternative forced-choice adaptive tracking procedure. The main findings were (1) significantly higher RMR thresholds for individuals with brain lesions (especially those with damage to parietal areas) and (2) a left-right spatial asymmetry in performance for lesion (but not control) participants. These findings contribute to a better understanding of spatiotemporal relations in informational masking and the neural bases of auditory scene analysis.

Vision- and touch-dependent brain correlates of body-related mental processing

In humans, the nature of sensory input influences body-related mental processing. For instance, behavioral differences (e.g., response time) can be found between mental spatial transformations (e.g., mental rotation) of viewed and touched body parts. It can thus be hypothesized that distinct brain activation patterns are associated with such sensory-dependent body-related mental processing. However, direct evidence that the neural correlates of body-related mental processing can be modulated by the nature of the sensory stimuli is still missing. We thus analyzed event-related functional magnetic resonance imaging (fMRI) data from thirty-one healthy participants performing mental rotation of visually- (images) and haptically-presented (plastic) hands. We also dissociated the neural activity related to rotation or task-related performance using models that either regressed out or included the variance associated with response time. Haptically-mediated mental rotation recruited mostly the sensorimotor brain network. Visually-mediated mental rotation led to parieto-occipital activations. In addition, faster mental rotation was associated with sensorimotor activity, while slower mental rotation was associated with parieto-occipital activations. The fMRI results indicated that changing the type of sensory inputs modulates the neural correlates of body-related mental processing. These findings suggest that distinct sensorimotor brain dynamics can be exploited to execute similar tasks depending on the available sensory input. The present study can contribute to a better evaluation of body-related mental processing in experimental and clinical settings.

The Tactile-Visual Conflict Processing and Its Modulation by Tactile-Induced Emotional States: An Event-Related Potential Study

This experiment used event-related potentials (ERPs) to study the tactile-visual information conflict processing in a tactile-visual pairing task and its modulation by tactile-induced emotional states. Eighteen participants were asked to indicate whether the tactile sensation on their body matched or did not match the expected tactile sensation associated with the object depicted in an image. The type of tactile-visual stimuli (matched vs. mismatched) and the valence of tactile-induced emotional states (positive vs. negative) were manipulated following a 2 × 2 factorial design. Electrophysiological analyses revealed a mismatched minus matched negative difference component between 420 and 620 ms after stimulus onset in the negative tactile-induced emotional state condition. This ND420-620 component was considered as a sign of the cross-modal conflict processing during the processing of incongruent tactile-visual information. In contrast, no significant mismatched minus matched negative difference component was found in the positive tactile-induced emotional state condition. Together, these results support the hypothesis that a positive emotional state induced by a positive tactile stimulation improves tactile-visual conflict processing abilities.

Active touch facilitates object size perception in children but not adults: A multisensory event related potential study

In order to increase perceptual precision the adult brain dynamically combines redundant information from different senses depending on their reliability. During object size estimation, for example, visual, auditory and haptic information can be integrated to increase the precision of the final size estimate. Young children, however, do not integrate sensory information optimally and instead rely on active touch. Whether this early haptic dominance is reflected in age-related differences in neural mechanisms and whether it is driven by changes in bottom-up perceptual or top-down attentional processes has not yet been investigated. Here, we recorded event-related-potentials from a group of adults and children aged 5-7 years during an object size perception task using auditory, visual and haptic information. Multisensory information was presented either congruently (conveying the same information) or incongruently (conflicting information). No behavioral responses were required from participants. When haptic size information was available via actively tapping the objects, response amplitudes in the mid-parietal area were significantly reduced by information congruency in children but not in adults between 190 ms-250 ms and 310 ms-370 ms. These findings indicate that during object size perception only children's brain activity is modulated by active touch supporting a neural maturational shift from sensory dominance in early childhood to optimal multisensory benefit in adulthood.

Neural Correlates of Feedback Processing in Visuo-Tactile Crossmodal Paired-Associate Learning

Previous studies have examined the neural correlates for crossmodal paired-associate (PA) memory and the temporal dynamics of its formation. However, the neural dynamics for feedback processing of crossmodal PA learning remain unclear. To examine this process, we recorded event-related scalp electrical potentials for PA learning of unimodal visual-visual pairs and crossmodal visual-tactile pairs when participants performed unimodal and crossmodal tasks. We examined event-related potentials (ERPs) after the onset of feedback in the tasks for three effects: feedback type (positive feedback vs. negative feedback), learning (as the learning progressed) and the task modality (crossmodal vs. unimodal). The results were as follows: (1) feedback type: the amplitude of P300 decreased with incorrect trials and the P400/N400 complex was only present in incorrect trials; (2) learning: progressive positive voltage shifts in frontal recording sites and negative voltage shifts in central and posterior recording sites were identified as learning proceeded; and (3) task modality: compared with the unimodal PA learning task, positive voltage shifts in frontal sites and negative voltage shifts in posterior sites were found in the crossmodal PA learning task. To sum up, these results shed light on cortical excitability related to feedback processing of crossmodal PA learning.

Tactile-to-Visual Cross-Modal Transfer of Texture Categorisation Following Training: An fMRI Study

We investigated the neural underpinnings of texture categorisation using exemplars that were previously learned either within modalities (visual training and visual test) or across modalities (tactile training and visual test). Previous models of learning suggest a decrease in activation in brain regions that are typically involved in cognitive control during task acquisition, but a concomitant increase in activation in brain regions associated with the representation of the acquired information. In our study, participants were required to learn to categorise fabrics of different textures as either natural or synthetic. Training occurred over several sessions, with each fabric presented either visually or through touch to a participant. Pre- and post-training tests, in which participants categorised visual images only of the fabrics, were conducted during a functional magnetic resonance imaging (fMRI) scan. Consistent with previous research on cognitive processes involved in task acquisition, we found that categorisation training was associated with a decrease in activation in brain regions associated with cognitive systems involved in learning, including the superior parietal cortex, dorsal anterior cingulate cortex (dACC), and the right dorsolateral prefrontal cortex (DLFC). Moreover, these decreases were independent of training modality. In contrast, we found greater activation to visual textures in a region within the left medial occipital cortex (MOC) following training. There was no overall evidence of an effect of training modality in the main analyses, with texture-specific regional changes associated with both within- (visual) and cross- (touch) modal training. However, further analyses suggested that, unlike categorisation performance following within-modal training, crossmodal training was associated with bilateral activation of the MOC. Our results support previous evidence for a multisensory representation of texture within early visual regions of the cortex and provide insight into how multisensory categories are formed in the brain.

Dorsolateral prefrontal cortex bridges bilateral primary somatosensory cortices during cross-modal working memory

Neural activity in the dorsolateral prefrontal cortex (DLPFC) has been suggested to integrate information from distinct sensory areas. However, how the DLPFC interacts with the bilateral primary somatosensory cortices (SIs) in tactile-visual cross-modal working memory has not yet been established. In the present study, we applied single-pulse transcranial magnetic stimulation (sp-TMS) over the contralateral DLPFC and bilateral SIs of human participants at various time points, while they performed a tactile-visual delayed matching-to-sample task with a 2-second delay. sp-TMS over the contralateral DLPFC or the contralateral SI at either an sensory encoding stage [i.e. 100 ms after the onset of a vibrotactile sample stimulus (200-ms duration)] or an early maintenance stage (i.e. 300 ms after the onset), significantly impaired the accuracy of task performance; sp-TMS over the contralateral DLPFC or the ipsilateral SI at a late maintenance stage (1600 ms and 1900 ms) also significantly disrupted the performance. Furthermore, at 300 ms after the onset of the vibrotactile sample stimulus, there was a significant correlation between the deteriorating effects of sp-TMS over the contralateral SI and the contralateral DLPFC. These results imply that the DLPFC and the bilateral SIs play causal roles at distinctive stages during cross-modal working memory, while the contralateral DLPFC communicates with the contralateral SI in the early delay, and cooperates with the ipsilateral SI in the late delay.

Age Effects on Visuo-Haptic Length Discrimination: Evidence for Optimal Integration of Senses in Senior Adults

Demographic changes in most developed societies have fostered research on functional aging. While cognitive changes have been characterized elaborately, understanding of perceptual aging lacks behind. We investigated age effects on the mechanisms of how multiple sources of sensory information are merged into a common percept. We studied visuo-haptic integration in a length discrimination task. A total of 24 young (20-25 years) and 27 senior (69-77 years) adults compared standard stimuli to appropriate sets of comparison stimuli. Standard stimuli were explored under visual, haptic, or visuo-haptic conditions. The task procedure allowed introducing an intersensory conflict by anamorphic lenses. Comparison stimuli were exclusively explored haptically. We derived psychometric functions for each condition, determining points of subjective equality and discrimination thresholds. We notably evaluated visuo-haptic perception by different models of multisensory processing, i.e., the Maximum-Likelihood-Estimate model of optimal cue integration, a suboptimal integration model, and a cue switching model. Our results support robust visuo-haptic integration across the adult lifespan. We found suboptimal weighted averaging of sensory sources in young adults, however, senior adults exploited differential sensory reliabilities more efficiently to optimize thresholds. Indeed, evaluation of the MLE model indicates that young adults underweighted visual cues by more than 30%; in contrast, visual weights of senior adults deviated only by about 3% from predictions. We suggest that close to optimal multisensory integration might contribute to successful compensation for age-related sensory losses and provides a critical resource. Differentiation between multisensory integration during healthy aging and age-related pathological challenges on the sensory systems awaits further exploration.

Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans

Studies have indicated that a cortical sensory system is capable of processing information from different sensory modalities. However, it still remains unclear when and how a cortical system integrates and retains information across sensory modalities during learning. Here we investigated the neural dynamics underlying crossmodal associations and memory by recording event-related potentials (ERPs) when human participants performed visuo-tactile (crossmodal) and visuo-visual (unimodal) paired-associate (PA) learning tasks. In a trial of the tasks, the participants were required to explore and learn the relationship (paired or non-paired) between two successive stimuli. EEG recordings revealed dynamic ERP changes during participants' learning of paired-associations. Specifically, (1) the frontal N400 component showed learning-related changes in both unimodal and crossmodal tasks but did not show any significant difference between these two tasks, while the central P400 displayed both learning changes and task differences; (2) a late posterior negative slow wave (LPN) showed the learning effect only in the crossmodal task; (3) alpha-band oscillations appeared to be involved in crossmodal working memory. Additional behavioral experiments suggested that these ERP components were not relevant to the participants' familiarity with stimuli per se. Further, by shortening the delay length (from 1300ms to 400ms or 200 ms) between the first and second stimulus in the crossmodal task, declines in participants' task performance were observed accordingly. Taken together, these results provide insights into the cortical plasticity (induced by PA learning) of neural networks involved in crossmodal associations in working memory.

Improving ACL Reconstruction Outcomes

Anterior cruciate ligament (ACL) reconstruction is a common and predominantly successful surgical intervention. But are there specific preoperative patient characteristics or intraoperative surgeon decisions that lead to better or worse outcomes? And can understanding brain function changes of patients after ACL reconstruction reveal insights into the ways that postsurgical rehabilitation can be improved to further enhance outcomes? These intriguing and clinically applicable questions are addressed in this webinar titled "Improving ACL Reconstruction Outcomes," hosted jointly by JOSPT and JBJS. The webinar is based on 2 published research articles-one from JBJS and the other from JOSPT. Participants in this continuing education activity are asked to read both articles carefully before watching the webinar. JBJS co-author Kurt Spindler, MD, discusses findings from a longitudinal analysis that identified certain baseline patient characteristics and intraoperative choices that predicted higher and lower SF-36 Physical Component scores after ACL reconstruction. JOSPT co-author Dustin Grooms, PhD, ATC, shares recently published results of a controlled laboratory study that employed functional MRI to investigate brain-activation differences between patients who did and did not undergo ACL reconstruction. Moderated by Kevin Wilk, PT, DPT, FAPTA, a leading authority on rehabilitation of sports injuries, the webinar includes additional insights from expert commentators Eric McCarty, MD, and Karin Grävare Silbernagel, PT, PhD, ATC.

Neuroplasticity Associated With Anterior Cruciate Ligament Reconstruction

Study Design Controlled laboratory study. Background Anterior cruciate ligament (ACL) injury may result in neuroplastic changes due to lost mechanoreceptors of the ACL and compensations in neuromuscular control. These alterations are not completely understood. Assessing brain function after ACL injury and anterior cruciate ligament reconstruction (ACLR) with functional magnetic resonance imaging provides a means to address this gap in knowledge. Objective To compare differences in brain activation during knee flexion/extension in persons who have undergone ACLR and in matched controls. Methods Fifteen participants who had undergone left ACLR (38.13 ± 27.16 months postsurgery) and 15 healthy controls matched on age, sex, height, mass, extremity dominance, education level, sport participation, and physical activity level participated. Functional magnetic resonance imaging data were obtained during a unilateral knee motor task consisting of repeated cycles of knee flexion and extension. Results Participants who had undergone ACLR had increased activation in the contralateral motor cortex, lingual gyrus, and ipsilateral secondary somatosensory area and diminished activation in the ipsilateral motor cortex and cerebellum when compared to healthy matched controls. Conclusion Brain activation for knee flexion/extension motion may be altered following ACLR. The ACLR brain activation profile may indicate a shift toward a visual-motor strategy as opposed to a sensory-motor strategy to engage in knee movement. Level of Evidence Cohort, level 3. J Orthop Sports Phys Ther 2017;47(3):180-189. Epub 5 Nov 2016. doi:10.2519/jospt.2017.7003.

Human Brain Activity Related to the Tactile Perception of Stickiness

While the perception of stickiness serves as one of the fundamental dimensions for tactile sensation, little has been elucidated about the stickiness sensation and its neural correlates. The present study investigated how the human brain responds to perceived tactile sticky stimuli using functional magnetic resonance imaging (fMRI). To evoke tactile perception of stickiness with multiple intensities, we generated silicone stimuli with varying catalyst ratios. Also, an acrylic sham stimulus was prepared to present a condition with no sticky sensation. From the two psychophysics experiments-the methods of constant stimuli and the magnitude estimation-we could classify the silicone stimuli into two groups according to whether a sticky perception was evoked: the Supra-threshold group that evoked sticky perception and the Infra-threshold group that did not. In the Supra-threshold vs. Sham contrast analysis of the fMRI data using the general linear model (GLM), the contralateral primary somatosensory area (S1) and ipsilateral dorsolateral prefrontal cortex (DLPFC) showed significant activations in subjects, whereas no significant result was found in the Infra-threshold vs. Sham contrast. This result indicates that the perception of stickiness not only activates the somatosensory cortex, but also possibly induces higher cognitive processes. Also, the Supra- vs. Infra-threshold contrast analysis revealed significant activations in several subcortical regions, including the pallidum, putamen, caudate and thalamus, as well as in another region spanning the insula and temporal cortices. These brain regions, previously known to be related to tactile discrimination, may subserve the discrimination of different intensities of tactile stickiness. The present study unveils the human neural correlates of the tactile perception of stickiness and may contribute to broadening the understanding of neural mechanisms associated with tactile perception.

How the Blind “See” Braille: Lessons From Functional Magnetic Resonance Imaging

What does the visual cortex of the blind do during Braille reading? This process involves converting simple tactile information into meaningful patterns that have lexical and semantic properties. The perceptual processing of Braille might be mediated by the somatosensory system, whereas visual letter identity is accomplished within the visual system in sighted people. Recent advances in functional neuroimaging techniques, such as functional magnetic resonance imaging, have enabled exploration of the neural substrates of Braille reading. The primary visual cortex of early-onset blind subjects is functionally relevant to Braille reading, suggesting that the brain shows remarkable plasticity that potentially permits the additional processing of tactile information in the visual cortical areas.

Preserved Haptic Shape Processing after Bilateral LOC Lesions

The visual and haptic perceptual systems are understood to share a common neural representation of object shape. A region thought to be critical for recognizing visual and haptic shape information is the lateral occipital complex (LOC). We investigated whether LOC is essential for haptic shape recognition in humans by studying behavioral responses and brain activation for haptically explored objects in a patient (M.C.) with bilateral lesions of the occipitotemporal cortex, including LOC. Despite severe deficits in recognizing objects using vision, M.C. was able to accurately recognize objects via touch. M.C.'s psychophysical response profile to haptically explored shapes was also indistinguishable from controls. Using fMRI, M.C. showed no object-selective visual or haptic responses in LOC, but her pattern of haptic activation in other brain regions was remarkably similar to healthy controls. Although LOC is routinely active during visual and haptic shape recognition tasks, it is not essential for haptic recognition of object shape.

SIGNIFICANCE STATEMENT

The lateral occipital complex (LOC) is a brain region regarded to be critical for recognizing object shape, both in vision and in touch. However, causal evidence linking LOC with haptic shape processing is lacking. We studied recognition performance, psychophysical sensitivity, and brain response to touched objects, in a patient (M.C.) with extensive lesions involving LOC bilaterally. Despite being severely impaired in visual shape recognition, M.C. was able to identify objects via touch and she showed normal sensitivity to a haptic shape illusion. M.C.'s brain response to touched objects in areas of undamaged cortex was also very similar to that observed in neurologically healthy controls. These results demonstrate that LOC is not necessary for recognizing objects via touch.

Crossmodal enhancement in the LOC for visuohaptic object recognition over development

Research has provided strong evidence of multisensory convergence of visual and haptic information within the visual cortex. These studies implement crossmodal matching paradigms to examine how systems use information from different sensory modalities for object recognition. Developmentally, behavioral evidence of visuohaptic crossmodal processing has suggested that communication within sensory systems develops earlier than across systems; nonetheless, it is unknown how the neural mechanisms driving these behavioral effects develop. To address this gap in knowledge, BOLD functional Magnetic Resonance Imaging (fMRI) was measured during delayed match-to-sample tasks that examined intramodal (visual-to-visual, haptic-to-haptic) and crossmodal (visual-to-haptic, haptic-to-visual) novel object recognition in children aged 7-8.5 years and adults. Tasks were further divided into sample encoding and test matching phases to dissociate the relative contributions of each. Results of crossmodal and intramodal object recognition revealed the network of known visuohaptic multisensory substrates, including the lateral occipital complex (LOC) and the intraparietal sulcus (IPS). Critically, both adults and children showed crossmodal enhancement within the LOC, suggesting a sensitivity to changes in sensory modality during recognition. These groups showed similar regions of activation, although children generally exhibited more widespread activity during sample encoding and weaker BOLD signal change during test matching than adults. Results further provided evidence of a bilateral region in the occipitotemporal cortex that was haptic-preferring in both age groups. This region abutted the bimodal LOtv, and was consistent with a medial to lateral organization that transitioned from a visual to haptic bias within the LOC. These findings converge with existing evidence of visuohaptic processing in the LOC in adults, and extend our knowledge of crossmodal processing in adults and children.

Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics

Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes--color, shape, visual motion, sound, and manipulation--for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes.

Visuo-haptic multisensory object recognition, categorization, and representation

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.

Short-term plasticity of visuo-haptic object recognition

Functional magnetic resonance imaging (fMRI) studies have provided ample evidence for the involvement of the lateral occipital cortex (LO), fusiform gyrus (FG), and intraparietal sulcus (IPS) in visuo-haptic object integration. Here we applied 30 min of sham (non-effective) or real offline 1 Hz repetitive transcranial magnetic stimulation (rTMS) to perturb neural processing in left LO immediately before subjects performed a visuo-haptic delayed-match-to-sample task during fMRI. In this task, subjects had to match sample (S1) and target (S2) objects presented sequentially within or across vision and/or haptics in both directions (visual-haptic or haptic-visual) and decide whether or not S1 and S2 were the same objects. Real rTMS transiently decreased activity at the site of stimulation and remote regions such as the right LO and bilateral FG during haptic S1 processing. Without affecting behavior, the same stimulation gave rise to relative increases in activation during S2 processing in the right LO, left FG, bilateral IPS, and other regions previously associated with object recognition. Critically, the modality of S2 determined which regions were recruited after rTMS. Relative to sham rTMS, real rTMS induced increased activations during crossmodal congruent matching in the left FG for haptic S2 and the temporal pole for visual S2. In addition, we found stronger activations for incongruent than congruent matching in the right anterior parahippocampus and middle frontal gyrus for crossmodal matching of haptic S2 and in the left FG and bilateral IPS for unimodal matching of visual S2, only after real but not sham rTMS. The results imply that a focal perturbation of the left LO triggers modality-specific interactions between the stimulated left LO and other key regions of object processing possibly to maintain unimpaired object recognition. This suggests that visual and haptic processing engage partially distinct brain networks during visuo-haptic object matching.

Multisensory convergence of visual and haptic object preference across development

Visuohaptic inputs offer redundant and complementary information regarding an object׳s geometrical structure. The integration of these inputs facilitates object recognition in adults. While the ability to recognize objects in the environment both visually and haptically develops early on, the development of the neural mechanisms for integrating visual and haptic object shape information remains unknown. In the present study, we used functional Magnetic Resonance Imaging (fMRI) in three groups of participants, 4 to 5.5 year olds, 7 to 8.5 year olds, and adults. Participants were tested in a block design involving visual exploration of two-dimensional images of common objects and real textures, and haptic exploration of their three-dimensional counterparts. As in previous studies, object preference was defined as a greater BOLD response for objects than textures. The analyses specifically target two sites of known visuohaptic convergence in adults: the lateral occipital tactile-visual region (LOtv) and intraparietal sulcus (IPS). Results indicated that the LOtv is involved in visuohaptic object recognition early on. More importantly, object preference in the LOtv became increasingly visually dominant with development. Despite previous reports that the lateral occipital complex (LOC) is adult-like by 8 years, these findings indicate that at least part of the LOC is not. Whole-brain maps showed overlap between adults and both groups of children in the LOC. However, the overlap did not build incrementally from the younger to the older group, suggesting that visuohaptic object preference does not develop in an additive manner. Taken together, the results show that the development of neural substrates for visuohaptic recognition is protracted compared to substrates that are primarily visual or haptic.

The taste-visual cross-modal Stroop effect: An event-related brain potential study

Event-related potentials (ERPs) were recorded to explore, for the first time, the electrophysiological correlates of the taste-visual cross-modal Stroop effect. Eighteen healthy participants were presented with a taste stimulus and a food image, and asked to categorize the image as "sweet" or "sour" by pressing the relevant button as quickly as possible. Accurate categorization of the image was faster when it was presented with a congruent taste stimulus (e.g., sour taste/image of lemon) than with an incongruent one (e.g., sour taste/image of ice cream). ERP analyses revealed a negative difference component (ND430-620) between 430 and 620ms in the taste-visual cross-modal Stroop interference. Dipole source analysis of the difference wave (incongruent minus congruent) indicated that two generators localized in the prefrontal cortex and the parahippocampal gyrus contributed to this taste-visual cross-modal Stroop effect. This result suggests that the prefrontal cortex is associated with the process of conflict control in the taste-visual cross-modal Stroop effect. Also, we speculate that the parahippocampal gyrus is associated with the process of discordant information in the taste-visual cross-modal Stroop effect.

Natural stimuli from three coherent modalities enhance behavioral responses and electrophysiological cortical activity in humans

Cues that involve a number of sensory modalities are processed in the brain in an interactive multimodal manner rather than independently for each modality. We studied multimodal integration in a natural, yet fully controlled scene, implemented as an interactive game in an auditory-haptic-visual virtual environment. In this imitation of a natural scene, the targets of perception were ecologically valid uni-, bi- and tri-modal manifestations of a simple event-a ball hitting a wall. Subjects were engaged in the game while their behavioral and early cortical electrophysiological responses were measured. Behavioral results confirmed that tri-modal cues were detected faster and more accurately than bi-modal cues, which, likewise, showed advantages over unimodal responses. Event-Related Potentials (ERPs) were recorded, and the first 200 ms following stimulus onset was analyzed to reveal the latencies of cortical multimodal interactions as estimated by sLORETA. These electrophysiological findings indicated bi-modal as well as tri-modal interactions beginning very early (~30 ms), uniquely for each multimodal combination. The results suggest that early cortical multimodal integration accelerates cortical activity and, in turn, enhances performance measures. This acceleration registers on the scalp as sub-additive cortical activation.

Does somatosensory discrimination activate different brain areas in children with unilateral cerebral palsy compared to typically developing children? An fMRI study

Aside from motor impairment, many children with unilateral cerebral palsy (CP) experience altered tactile, proprioceptive, and kinesthetic awareness. Sensory deficits are addressed in rehabilitation programs, which include somatosensory discrimination exercises. In contrast to adult stroke patients, data on brain activation, occurring during somatosensory discrimination exercises, are lacking in CP children. Therefore, this study investigated brain activation with functional magnetic resonance imaging (fMRI) during passively guided somatosensory discrimination exercises in 18 typically developing children (TD) (age, M=14 ± 1.92 years; 11 girls) and 16 CP children (age, M=15 ± 2.54 years; 8 girls). The demographic variables between both groups were not statistically different. An fMRI compatible robot guided the right index finger and performed pairs of unfamiliar geometric shapes in the air, which were judged on their equality. The control condition comprised discrimination of music fragments. Both groups exhibited significant activation (FDR, p<.05) in frontoparietal, temporal, cerebellar areas, and insula, similar to studies in adults. The frontal areas encompassed ventral premotor areas, left postcentral gyrus, and precentral gyrus; additional supplementary motor area (SMA proper) activation in TD; as well as dorsal premotor, and parietal operculum recruitment in CP. On uncorrected level, p<.001, TD children revealed more left frontal lobe, and right cerebellum activation, compared to CP children. Conversely, CP children activated the left dorsal cingulate gyrus to a greater extent than TD children. These data provide incentives to investigate the effect of somatosensory discrimination during rehabilitation in CP, on clinical outcome and brain plasticity.

Brain integration as a driver for quality management success

Purpose

In this paper, research leading to quality management success is examined, elaborated, and highlighted in a new profound way by focusing on the most fundamental aspect of the human dimension, the brain. The purpose is to examine the relationship between brain functioning and quality management success. In this examination, the role of core values, profound organizational learning and values of quality management are explained.

Design/methodology/approach

The paper builds on a conceptual review of research in the areas of quality management success, values of quality management, core values and neurophysiology with focus on brain integration.

Findings

The relation of core values with brain functioning is described based on previous research. A framework with logical steps from brain integration, via core values, quality management values and quality management practices to quality management success is developed.

Research limitations/implications

The paper adds to the understanding of the role brain integration has for success in quality management efforts. A limitation is that it only builds on previous research.

Practical implications

The findings provide a deeper understanding of quality management success and should thus be valuable for quality managers and leaders striving for excellence for their organisations.

Originality/value

The importance and crucial role of brain integration for quality management success has not been elaborated in the literature of quality management before.

Superior haptic-to-visual shape matching in autism spectrum disorders

A weak central coherence theory in autism spectrum disorder (ASD) proposes that a cognitive bias toward local processing in ASD derives from a weakness in integrating local elements into a coherent whole. Using this theory, we hypothesized that shape perception through active touch, which requires sequential integration of sensorimotor traces of exploratory finger movements into a shape representation, would be impaired in ASD. Contrary to our expectation, adults with ASD showed superior performance in a haptic-to-visual delayed shape-matching task compared to adults without ASD. Accuracy in discriminating haptic lengths or haptic orientations, which lies within the somatosensory modality, did not differ between adults with ASD and adults without ASD. Moreover, this superior ability in inter-modal haptic-to-visual shape matching was not explained by the score in a unimodal visuospatial rotation task. These results suggest that individuals with ASD are not impaired in integrating sensorimotor traces into a global visual shape and that their multimodal shape representations and haptic-to-visual information transfer are more accurate than those of individuals without ASD.

Prominent activation of the intraparietal and somatosensory areas during angle discrimination by intra-active touch

Intra-active touch (IAT) is a process that involves a body part doing the touching (active touch [AT]) and another body part being touched (passive touch [PT]) simultaneously. The brain representation related to IAT is still unclear. A total of 23 subjects carried out angle discrimination under PT, AT and IAT conditions with functional magnetic resonance imaging. All of the tasks were strictly dependent on cutaneous feedback from the finger(s). As the subjects were able to perceive the angle stimuli from the right (touching) and left (touched) sides during the IAT condition, we expected there would be greater brain activation with the IAT condition than for the AT or PT condition. Therefore, we hypothesized that the region within and/or around the intraparietal sulcus (IPS) and the part of the primary somatosensory cortex (SI) that is associated with high-level tactile spatial processing would be more active during the IAT task than during the AT and PT tasks. Compared with the areas activated by the motor somatosensory control task, the most prominent activation areas evoked by the three-angle discrimination tasks were in the SI and secondary somatosensory cortex areas in the bilateral parietal operculum, IPS, lateral occipital complex, insula and cerebellum. Finally, we directly compared IAT with AT and PT, and the results suggest that the contralateral part of IPS and part of the SI are more active under IAT conditions than under either AT or PT conditions. These results suggest that both hemispheres contribute to angle discrimination during IAT.

The event-related potential elicited by taste-visual cross-modal interference

Sixteen healthy subjects took part in this event-related potentials (ERPs) study aimed at investigating the neural response of the taste-visual cross-modal pairing. An interference effect was observed at the behavioral level: the mismatched condition was performed more slowly than the matched condition. ERP analyses revealed a more negative component between 400 and 600 ms in the mismatched condition than in the matched condition. Dipole source analysis of the difference wave (mismatched minus matched) indicated that two generators localized in prefrontal cortex (PFC) and posterior cingulate cortex (PCC) contributed to this cross-modal interference effect. These results provided the electrophysiological evidence of interference during the extraction of taste information from memory and conflict control during the incongruent taste-visual information processing.

Dual pathways for haptic and visual perception of spatial and texture information

Segregation of information flow along a dorsally directed pathway for processing object location and a ventrally directed pathway for processing object identity is well established in the visual and auditory systems, but is less clear in the somatosensory system. We hypothesized that segregation of location vs. identity information in touch would be evident if texture is the relevant property for stimulus identity, given the salience of texture for touch. Here, we used functional magnetic resonance imaging (fMRI) to investigate whether the pathways for haptic and visual processing of location and texture are segregated, and the extent of bisensory convergence. Haptic texture-selectivity was found in the parietal operculum and posterior visual cortex bilaterally, and in parts of left inferior frontal cortex. There was bisensory texture-selectivity at some of these sites in posterior visual and left inferior frontal cortex. Connectivity analyses demonstrated, in each modality, flow of information from unisensory non-selective areas to modality-specific texture-selective areas and further to bisensory texture-selective areas. Location-selectivity was mostly bisensory, occurring in dorsal areas, including the frontal eye fields and multiple regions around the intraparietal sulcus bilaterally. Many of these regions received input from unisensory areas in both modalities. Together with earlier studies, the activation and connectivity analyses of the present study establish that somatosensory processing flows into segregated pathways for location and object identity information. The location-selective somatosensory pathway converges with its visual counterpart in dorsal frontoparietal cortex, while the texture-selective somatosensory pathway runs through the parietal operculum before converging with its visual counterpart in visual and frontal cortex. Both segregation of sensory processing according to object property and multisensory convergence appear to be universal organizing principles.

TMS of posterior parietal cortex disrupts visual tactile multisensory integration

Functional neuroimaging studies have implicated a number of brain regions, especially the posterior parietal cortex (PPC), as being potentially important for visual-tactile multisensory integration. However, neuroimaging studies are correlational and do not prove the necessity of a region for the behavioral improvements that are the hallmark of multisensory integration. To remedy this knowledge gap, we interrupted activity in the PPC, near the junction of the anterior intraparietal sulcus and the postcentral sulcus, using MRI-guided transcranial magnetic stimulation (TMS) while subjects localized touches delivered to different fingers. As the touches were delivered, subjects viewed a congruent touch video, an incongruent touch video, or no video. Without TMS, a strong effect of multisensory integration was observed, with significantly better behavioral performance for discrimination of congruent multisensory touch than for unisensory touch alone. Incongruent multisensory touch produced a smaller improvement in behavioral performance. TMS of the PPC eliminated the behavioral advantage of both congruent and incongruent multisensory stimuli, reducing performance to unisensory levels. These results demonstrate a causal role for the PPC in visual-tactile multisensory integration. Taken together with converging evidence from other studies, these results support a model in which the PPC contains a map of space around the hand that receives input from both the visual and somatosensory modalities. Activity in this map is likely to be the neural substrate for visual-tactile multisensory integration.

Passive tactile recognition of geometrical shape in humans: An fMRI study

Tactile shape discrimination involves frontal other than somatosensory cortex (Palva et al., 2005 [48]), but it is unclear if this frontal activity is related to exploratory concomitants. In this study, we investigated topographical details of prefrontal, premotor, and parietal areas during passive tactile recognition of 2D geometrical shapes in conditions avoiding exploratory movements. Functional magnetic resonance imaging (fMRI) was performed while the same wooden 2D geometrical shapes were blindly pressed on subjects' passive right palm in three conditions. In the RAW condition, shapes were pressed while subjects were asked to attend to the stimuli but were not trained to recognize them. After a brief training, in the SHAPE condition subjects were asked to covertly recognize shapes. In the RECOGNITION condition, they were asked to overtly recognize shapes, using response buttons with their opposite hand. Results showed that somatosensory cortex including contralateral SII, contralateral SI, and left insula was active in all conditions, confirming its importance in processing tactile shapes. In the RAW vs. SHAPE contrast, bilateral posterior parietal, insular, premotor, prefrontal, and (left) Broca's areas were more active in the latter. In the RECOGNITION, activation of (left) Broca's area correlated with correct responses. These results suggest that, even without exploratory movements, passive recognition of tactile geometrical shapes involves prefrontal and premotor as well as somatosensory regions. In this framework, Broca's area might be involved in a successful selection and/or execution of the correct responses.

Neural substrates of reliability-weighted visual-tactile multisensory integration

As sensory systems deteriorate in aging or disease, the brain must relearn the appropriate weights to assign each modality during multisensory integration. Using blood-oxygen level dependent functional magnetic resonance imaging of human subjects, we tested a model for the neural mechanisms of sensory weighting, termed “weighted connections.” This model holds that the connection weights between early and late areas vary depending on the reliability of the modality, independent of the level of early sensory cortex activity. When subjects detected viewed and felt touches to the hand, a network of brain areas was active, including visual areas in lateral occipital cortex, somatosensory areas in inferior parietal lobe, and multisensory areas in the intraparietal sulcus (IPS). In agreement with the weighted connection model, the connection weight measured with structural equation modeling between somatosensory cortex and IPS increased for somatosensory-reliable stimuli, and the connection weight between visual cortex and IPS increased for visual-reliable stimuli. This double dissociation of connection strengths was similar to the pattern of behavioral responses during incongruent multisensory stimulation, suggesting that weighted connections may be a neural mechanism for behavioral reliability weighting.

Neural and temporal dynamics underlying visual selection for action

The present study investigated the selection for action hypothesis, according to which a subject's action intention to perform a movement influences the way in which visual information is being processed. Subjects were instructed in separate blocks either to grasp or to point to a three-dimensional target-object and event-related potentials were recorded relative to stimulus onset. It was found that grasping compared with pointing resulted in a stronger N1 component and a subsequent selection negativity, which were localized to the lateral occipital complex. These effects suggest that the intention to grasp influences the processing of action-relevant features in ventral stream areas already at an early stage (e.g., enhanced processing of object orientation for grasping). These findings provide new insight in the neural and temporal dynamics underlying perception-action coupling and provide neural evidence for a selection for action principle in early human visual processing.

Object familiarity modulates the relationship between visual object imagery and haptic shape perception

Although visual cortical engagement in haptic shape perception is well established, its relationship with visual imagery remains controversial. We addressed this using functional magnetic resonance imaging during separate visual object imagery and haptic shape perception tasks. Two experiments were conducted. In the first experiment, the haptic shape task employed unfamiliar, meaningless objects, whereas familiar objects were used in the second experiment. The activations evoked by visual object imagery overlapped more extensively, and their magnitudes were more correlated, with those evoked during haptic shape perception of familiar, compared to unfamiliar, objects. In the companion paper (Deshpande et al., this issue), we used task-specific functional and effective connectivity analyses to provide convergent evidence: these analyses showed that the neural networks underlying visual imagery were similar to those underlying haptic shape perception of familiar, but not unfamiliar, objects. We conclude that visual object imagery is more closely linked to haptic shape perception when objects are familiar, compared to when they are unfamiliar.

What is the link between language and spatial images? Behavioral and neural findings in blind and sighted individuals

In order to find objects or places in the world, multiple sources of information, such as visual input, auditory input and asking for directions, can help you. These different sources of information can be converged into a spatial image, which represents configurational characteristics of the world. This paper discusses the findings on the nature of spatial images and the role of spatial language in generating these spatial images in both blind and sighted individuals. Congenitally blind individuals have never experienced visual input, yet they are able to perform several tasks traditionally associated with spatial imagery, such as mental scanning, mental pathway completions and mental clock time comparison, though perhaps not always in a similar manner as sighted. Therefore, they offer invaluable insights into the exact nature of spatial images. We will argue that spatial imagery exceeds the input from different input modalities to form an abstract mental representation while maintaining connections with the input modalities. This suggests that the nature of spatial images is supramodal, which can explain functional equivalent results from verbal and perceptual inputs for spatial situations and subtle to moderate behavioral differences between the blind and sighted.

Multisensory visual-tactile object related network in humans: insights gained using a novel crossmodal adaptation approach

Neuroimaging techniques have provided ample evidence for multisensory integration in humans. However, it is not clear whether this integration occurs at the neuronal level or whether it reflects areal convergence without such integration. To examine this issue as regards visuo-tactile object integration we used the repetition suppression effect, also known as the fMRI-based adaptation paradigm (fMR-A). Under some assumptions, fMR-A can tag specific neuronal populations within an area and investigate their characteristics. This technique has been used extensively in unisensory studies. Here we applied it for the first time to study multisensory integration and identified a network of occipital (LOtv and calcarine sulcus), parietal (aIPS), and prefrontal (precentral sulcus and the insula) areas all showing a clear crossmodal repetition suppression effect. These results provide a crucial first insight into the neuronal basis of visuo-haptic integration of objects in humans and highlight the power of using fMR-A to study multisensory integration using non-invasinve neuroimaging techniques.

A putative model of multisensory object representation

This review surveys the recent literature on visuo-haptic convergence in the perception of object form, with particular reference to the lateral occipital complex (LOC) and the intraparietal sulcus (IPS) and discusses how visual imagery or multisensory representations might underlie this convergence. Drawing on a recent distinction between object- and spatially-based visual imagery, we propose a putative model in which LOtv, a subregion of LOC, contains a modality-independent representation of geometric shape that can be accessed either bottom-up from direct sensory inputs or top-down from frontoparietal regions. We suggest that such access is modulated by object familiarity: spatial imagery may be more important for unfamiliar objects and involve IPS foci in facilitating somatosensory inputs to the LOC; by contrast, object imagery may be more critical for familiar objects, being reflected in prefrontal drive to the LOC.

Integrating visual and tactile information in the perirhinal cortex

By virtue of its widespread afferent projections, perirhinal cortex is thought to bind polymodal information into abstract object-level representations. Consistent with this proposal, deficits in cross-modal integration have been reported after perirhinal lesions in nonhuman primates. It is therefore surprising that imaging studies of humans have not observed perirhinal activation during visual–tactile object matching. Critically, however, these studies did not differentiate between congruent and incongruent trials. This is important because successful integration can only occur when polymodal information indicates a single object (congruent) rather than different objects (incongruent). We scanned neurologically intact individuals using functional magnetic resonance imaging (fMRI) while they matched shapes. We found higher perirhinal activation bilaterally for cross-modal (visual–tactile) than unimodal (visual–visual or tactile–tactile) matching, but only when visual and tactile attributes were congruent. Our results demonstrate that the human perirhinal cortex is involved in cross-modal, visual–tactile, integration and, thus, indicate a functional homology between human and monkey perirhinal cortices.