The influence of misnaming on object recognition: a case of multimodal agnosia

Haptic experience of bodies alters body perception

Research on media's effects on body perception has mainly focused on the role of vision of extreme body types. However, haptics is a major part of the way children experience bodies. Playing with unrealistically thin dolls has been linked to the emergence of body image concerns, but the perceptual mechanisms remain unknown. We explore the effects of haptic experience of extreme body types on body perception, using adaptation aftereffects. Blindfolded participants judged whether the doll-like stimuli explored haptically were thinner or fatter than the average body before and after adaptation to an underweight or overweight doll. In a second experiment, participants underwent a traditional visual adaptation paradigm to extreme bodies, using stimuli matched to those in Experiment 1. For both modalities, after adaptation to an underweight body test bodies were judged as fatter. Adaptation to an overweight body produced opposite results. For the first time, we show adiposity aftereffects in haptic modality, analogous to those established in vision, using matched stimuli across visual and haptic paradigms.

Distinct but related abilities for visual and haptic object recognition

People vary in their ability to recognize objects visually. Individual differences for matching and recognizing objects visually is supported by a domain-general ability capturing common variance across different tasks (e.g., Richler et al., Psychological Review, 126, 226-251, 2019). Behavioral (e.g., Cooke et al., Neuropsychologia, 45, 484-495, 2007) and neural evidence (e.g., Amedi, Cerebral Cortex, 12, 1202-1212, 2002) suggest overlapping mechanisms in the processing of visual and haptic information in the service of object recognition, but it is unclear whether such group-average results generalize to individual differences. Psychometrically validated measures are required, which have been lacking in the haptic modality. We investigate whether object recognition ability is specific to vision or extends to haptics using psychometric measures we have developed. We use multiple visual and haptic tests with different objects and different formats to measure domain-general visual and haptic abilities and to test for relations across them. We measured object recognition abilities using two visual tests and four haptic tests (two each for two kinds of haptic exploration) in 97 participants. Partial correlation and confirmatory factor analyses converge to support the existence of a domain-general haptic object recognition ability that is moderately correlated with domain-general visual object recognition ability. Visual and haptic abilities share about 25% of their variance, supporting the existence of a multisensory domain-general ability while leaving a substantial amount of residual variance for modality-specific abilities. These results extend our understanding of the structure of object recognition abilities; while there are mechanisms that may generalize across categories, tasks, and modalities, there are still other mechanisms that are distinct between modalities.

Tactually-related cognitive impairments: sharing of neural substrates across associative tactile agnosia, agraphesthesia, and kinesthetic reading difficulty

INTRODUCTION

A precise understanding of the neural substrates underlying tactually-related cognitive impairments such as bilateral tactile agnosia, bilateral agraphesthesia, kinesthetic alexia and kinesthetic reading difficulty is currently incomplete. In particular, recent data have implicated a role for the lateral occipital tactile visual region, or LOtv, in tactile object naming (Amedi et al. Cerebral Cortex 2002). Thus, this study set out to examine the degree to which the LOtv may be involved in tactually-related cognitive impairments by examining two unique cases.

METHODS

To assess whether LOtv or the visual word form area (VWFA) is involved in tactually-related cognitive impairments, the average activation point of LOtv and that of VWFA were placed on the single-photon emission computed tomography (SPECT) cerebral blood flow images of two patients: one with bilateral associative tactile agnosia, bilateral agraphesthesia, and ineffective kinesthetic reading, and the other with kinesthetic reading difficulty.

RESULTS

The average LOtv coordinate was involved in the area of hypoperfusion in both patients, whereas that of VWFA was not included in any of the hypoperfused areas.

CONCLUSIONS

The results support the view that interruption of LOtv or disconnection to LOtv and to VWFA may cause these tactually-related cognitive impairments. Further, bilateral associative tactile agnosia and bilateral agraphesthesia are attributable toward the damage of the occipital lobe, whereas unilateral or predominantly one-sided associative tactile agnosia and agraphesthesia are attributable toward the damage of the parietal lobe.

Asymmetric Bálint's syndrome with multimodal agnosia, bilateral agraphesthesia, and ineffective kinesthetic reading due to subcortical hemorrhage in the left parieto-occipito-temporal area

We report a patient with asymmetric Bálint's syndrome (predominantly right-sided oculomotor apraxia and simultanagnosia and optic ataxia for the right hemispace), and multimodal agnosia (apperceptive visual agnosia and bilateral associative tactile agnosia) with accompanying right hemianopia, bilateral agraphesthesia, hemispatial neglect, global alexia with unavailable kinesthetic reading, and lexical agraphia for kanji (Japanese morphograms), after hemorrhage in the left parieto-occipito-temporal area. The coexistence of tactile agnosia, bilateral agraphesthesia, and ineffective kinesthetic reading suggests that tactile-kinesthetic information can be interrupted because of damage to the fiber connection from the parietal lobe to the occipito-temporal area, leading to these tactually related cognitive impairments.

Preserved Haptic Shape Processing after Bilateral LOC Lesions

The visual and haptic perceptual systems are understood to share a common neural representation of object shape. A region thought to be critical for recognizing visual and haptic shape information is the lateral occipital complex (LOC). We investigated whether LOC is essential for haptic shape recognition in humans by studying behavioral responses and brain activation for haptically explored objects in a patient (M.C.) with bilateral lesions of the occipitotemporal cortex, including LOC. Despite severe deficits in recognizing objects using vision, M.C. was able to accurately recognize objects via touch. M.C.'s psychophysical response profile to haptically explored shapes was also indistinguishable from controls. Using fMRI, M.C. showed no object-selective visual or haptic responses in LOC, but her pattern of haptic activation in other brain regions was remarkably similar to healthy controls. Although LOC is routinely active during visual and haptic shape recognition tasks, it is not essential for haptic recognition of object shape.

SIGNIFICANCE STATEMENT

The lateral occipital complex (LOC) is a brain region regarded to be critical for recognizing object shape, both in vision and in touch. However, causal evidence linking LOC with haptic shape processing is lacking. We studied recognition performance, psychophysical sensitivity, and brain response to touched objects, in a patient (M.C.) with extensive lesions involving LOC bilaterally. Despite being severely impaired in visual shape recognition, M.C. was able to identify objects via touch and she showed normal sensitivity to a haptic shape illusion. M.C.'s brain response to touched objects in areas of undamaged cortex was also very similar to that observed in neurologically healthy controls. These results demonstrate that LOC is not necessary for recognizing objects via touch.

Language as grist to the mill of cognition

There is a growing consensus that natural language plays a significant role in our cognitive lives. However, this role of language is not adequately characterised. In this paper, I investigate the relationship between natural language and thinking and argue that thinking operates largely according to associationistic rules. Furthermore, I show that language is neither restricted to interfacing between a 'Language of Thought' and the conscious level, nor is it constitutively involved in thinking. Unlike available alternatives, the suggested view predicts and accommodates a large battery of empirical evidence. Furthermore, it avoids problems that associationistic views traditionally faced, e.g. problems of propositional thinking and compositionality of thought.

Functional Specialization and Convergence in the Occipito-temporal Cortex Supporting Haptic and Visual Identification of Human Faces and Body Parts: An fMRI Study

Humans can recognize common objects by touch extremely well whenever vision is unavailable. Despite its importance to a thorough understanding of human object recognition, the neuroscientific study of this topic has been relatively neglected. To date, the few published studies have addressed the haptic recognition of nonbiological objects. We now focus on haptic recognition of the human body, a particularly salient object category for touch. Neuroimaging studies demonstrate that regions of the occipito-temporal cortex are specialized for visual perception of faces (fusiform face area, FFA) and other body parts (extrastriate body area, EBA). Are the same category-sensitive regions activated when these components of the body are recognized haptically? Here, we use fMRI to compare brain organization for haptic and visual recognition of human body parts. Sixteen subjects identified exemplars of faces, hands, feet, and nonbiological control objects using vision and haptics separately. We identified two discrete regions within the fusiform gyrus (FFA and the haptic face region) that were each sensitive to both haptically and visually presented faces; however, these two regions differed significantly in their response patterns. Similarly, two regions within the lateral occipito-temporal area (EBA and the haptic body region) were each sensitive to body parts in both modalities, although the response patterns differed. Thus, although the fusiform gyrus and the lateral occipito-temporal cortex appear to exhibit modality-independent, category-sensitive activity, our results also indicate a degree of functional specialization related to sensory modality within these structures.

Functional imaging of human crossmodal identification and object recognition

The perception of objects is a cognitive function of prime importance. In everyday life, object perception benefits from the coordinated interplay of vision, audition, and touch. The different sensory modalities provide both complementary and redundant information about objects, which may improve recognition speed and accuracy in many circumstances. We review crossmodal studies of object recognition in humans that mainly employed functional magnetic resonance imaging (fMRI). These studies show that visual, tactile, and auditory information about objects can activate cortical association areas that were once believed to be modality-specific. Processing converges either in multisensory zones or via direct crossmodal interaction of modality-specific cortices without relay through multisensory regions. We integrate these findings with existing theories about semantic processing and propose a general mechanism for crossmodal object recognition: The recruitment and location of multisensory convergence zones varies depending on the information content and the dominant modality.