Tactile Object Familiarity in the Blind Brain Reveals the Supramodal Perceptual-Mnemonic Nature of the Perirhinal Cortex

Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Evidence for Independent Processing of Shape by Vision and Touch

Although visual object recognition is well studied and relatively well understood, much less is known about how shapes are recognized by touch and how such haptic stimuli might be compared with visual shapes. One might expect that the processes of visual and haptic object recognition engage similar brain structures given the advantages of avoiding redundant brain circuitry and indeed there is some evidence that this is the case. A potentially fruitful approach to understanding the differences in how shapes might be neurally represented is to find an algorithmic method of comparing shapes, which agrees with human behavior and determines whether that method differs between different modality conditions. If not, it would provide further evidence for a shared representation of shape. We recruited human participants to perform a one-back same-different visual and haptic shape comparison task both within (i.e., comparing two visual shapes or two haptic shapes) and across (i.e., comparing visual with haptic shapes) modalities. We then used various shape metrics to predict performance based on the shape, orientation, and modality of the two stimuli that were being compared on each trial. We found that the metrics that best predict shape comparison behavior heavily depended on the modality of the two shapes, suggesting differences in which features are used for comparing shapes depending on modality and that object recognition is not necessarily performed in a single, modality-agnostic region.

Multipurpose Spatiomotor Capture System for Haptic and Visual Training and Testing in the Blind and Sighted

We describe the development of a multipurpose haptic stimulus delivery and spatiomotor recording system with tactile map-overlays for electronic processing This innovative multipurpose spatiomotor capture system will serve a wide range of functions in the training and behavioral assessment of spatial memory and precise motor control for blindness rehabilitation, both for STEM learning and for navigation training and map reading. Capacitive coupling through the map-overlays to the touch-tablet screen below them allows precise recording i) of hand movements during haptic exploration of tactile raised-line images on one tablet and ii) of line-drawing trajectories on the other, for analysis of navigational errors, speed, time elapsed, etc. Thus, this system will provide for the first time in an integrated and automated manner quantitative assessments of the whole 'perception-cognition-action' loop - from non-visual exploration strategies, spatial memory, precise spatiomotor control and coordination, drawing performance, and navigation capabilities, as well as of haptic and movement planning and control. The accuracy of memory encoding, in particular, can be assessed by the memory-drawing operation of the capture system. Importantly, this system allows for both remote and in-person operation. Although the focus is on visually impaired populations, the system is designed to equally serve training and assessments in the normally sighted as well.

RGS14414 treatment induces memory enhancement and rescues episodic memory deficits

Memory deficits affect a large proportion of the human population and are associated with aging and many neurologic, neurodegenerative, and psychiatric diseases. Treatment of this mental disorder has been disappointing because all potential candidates studied thus far have failed to produce consistent effects across various types of memory and have shown limited to no effects on memory deficits. Here, we show that the promotion of neuronal arborization through the expression of the regulator of G-protein signaling 14 of 414 amino acids (RGS14₄₁₄) not only induced robust enhancement of multiple types of memory but was also sufficient for the recovery of recognition, spatial, and temporal memory, which are kinds of episodic memory that are primarily affected in patients or individuals with memory dysfunction. We observed that a surge in neuronal arborization was mediated by up-regulation of brain-derived neurotrophic factor (BDNF) signaling and that the deletion of BDNF abrogated both neuronal arborization activation and memory enhancement. The activation of BDNF-dependent neuronal arborization generated almost 2-fold increases in synapse numbers in dendrites of pyramidal neurons and in neurites of nonpyramidal neurons. This increase in synaptic connections might have evoked reorganization within neuronal circuits and eventually supported an increase in the activity of such circuits. Thus, in addition to showing the potential of RGS14₄₁₄ for rescuing memory deficits, our results suggest that a boost in circuit activity could facilitate memory enhancement and the reversal of memory deficits.-Masmudi-Martín, M., Navarro-Lobato, I., López-Aranda, M. F., Delgado, G., Martín-Montañez, E., Quiros-Ortega, M. E., Carretero-Rey, M., Narváez, L., Garcia-Garrido, M. F., Posadas, S., López-Téllez, J. F., Blanco, E., Jiménez-Recuerda, I., Granados-Durán, P., Paez-Rueda, J., López, J. C., Khan, Z. U. RGS14₄₁₄ treatment induces memory enhancement and rescues episodic memory deficits.

Transfer of Learning in People Who Are Blind: Enhancement of Spatial-Cognitive Abilities Through Drawing

Introduction

This study assessed whether basic spatial-cognitive abilities can be enhanced in people who are blind through transfer of learning from drawing training.

Methods

Near-body spatial-cognitive performance was assessed through the Cognitive Test for the Blind (CTB), which assesses a wide range of basic spatial-cognitive skills. The CTB was administered to 21 participants who are blind in two behavioral testing sessions separated by five days. For participants in the "trained" group, these intervening days were occupied by the Cognitive-Kinesthetic Drawing Training method, during which participants learned how to draw freehand from memory. The "control" participants were not trained.

Results

The results showed significantly increased overall CTB performance in the trained but not in the control group, indicating that the drawing training effectively enhanced spatial-cognitive abilities. A three to six month follow-up session with a subset of trained participants suggested that these training-induced spatial-cognitive improvements might persist over time, at least for some tasks.

Discussion

These findings demonstrate that learning to draw from memory without vision over just five sessions can lead to enhancement of basic spatial-cognitive abilities beyond the drawing task. This study is the first to examine the transfer of learning of cognitive ability in blind individuals.

Implications for practitioners

This study sheds light on the Cognitive-Kinesthetic Drawing Training as an effective wide-range rehabilitation technique that could be used to enhance basic spatial-cognitive abilities in those who are blind.

Memory-guided drawing training increases Granger causal influences from the perirhinal cortex to V1 in the blind

The perirhinal cortex (PRC) is a medial temporal lobe structure that has been implicated in not only visual memory in the sighted, but also tactile memory in the blind (Cacciamani & Likova, 2016). It has been proposed that, in the blind, the PRC may contribute to modulation of tactile memory responses that emerge in low-level "visual" area V1 as a result of training-induced cortical reorganization (Likova, 2012, 2015). While some studies in the sighted have indicated that the PRC is indeed structurally and functionally connected to the visual cortex (Clavagnier, Falchier, & Kennedy, 2004; Peterson, Cacciamani, Barense, & Scalf, 2012), the PRC's direct modulation of V1 is unknown-particularly in those who lack the visual input that typically stimulates this region. In the present study, we tested Likova's PRC modulation hypothesis; specifically, we used fMRI to assess the PRC's Granger causal influence on V1 activation in the blind during a tactile memory task. To do so, we trained congenital and acquired blind participants on a unique memory-guided drawing technique previously shown to result in V1 reorganization towards tactile memory representations (Likova, 2012). The tasks (20s each) included: tactile exploration of raised line drawings of faces and objects, tactile memory retrieval via drawing, and a scribble motor/memory control. FMRI before and after a week of the Cognitive-Kinesthetic training on these tasks revealed a significant increase in PRC-to-V1 Granger causality from pre- to post-training during the memory drawing task, but not during the motor/memory control. This increase in causal connectivity indicates that the training strengthened the top-down modulation of visual cortex from the PRC. This is the first study to demonstrate enhanced directed functional connectivity from the PRC to the visual cortex in the blind, implicating the PRC as a potential source of the reorganization towards tactile representations that occurs in V1 in the blind brain (Likova, 2012).

Addressing long-standing controversies in conceptual knowledge representation in the temporal pole: A cross-modal paradigm

Conceptual knowledge allows us to comprehend the multisensory stimulation impinging on our senses. Its representation in the anterior temporal lobe is a subject of considerable debate, with the "enigmatic" temporal pole (TP) being at the center of that debate. The controversial models of the organization of knowledge representation in TP range from unilateral to fully unified bilateral representational systems. To address the multitude of mutually exclusive options, we developed a novel cross-modal approach in a multifactorial brain imaging study of the blind, manipulating the modality (verbal vs pictorial) of both the reception source (reading text/verbal vs images/pictorial) and the expression (writing text/verbal vs drawing/pictorial) of conceptual knowledge. Furthermore, we also varied the level of familiarity. This study is the first to investigate the functional organization of (amodal) conceptual knowledge in TP in the blind, as well as, the first study of drawing based on the conceptual knowledge from memory of sentences delivered through Braille reading. Through this paradigm, we were able to functionally identify two novel subdivisions of the temporal pole - the TPa, at the apex, and the TPdm - dorso-medially. Their response characteristics revealed a complex interplay of non-visual specializations within the temporal pole, with a diversity of excitatory/inhibitory inversions as a function of hemisphere, task-domain and familiarity, which motivate an expanded neurocognitive analysis of conceptual knowledge. The interplay of inter-hemispheric specializations found here accounts for the variety of seemingly conflicting models in previous research for conceptual knowledge representation, reconciling them through the set of factors we have investigated: the two main knowledge domains (verbal and pictorial/sensory-motor) and the two main knowledge processing modes (receptive and expressive), including the level of familiarity as a modifier. Furthermore, the interplay of these factors allowed us to also reveal for the first time a system of complementary symmetries, asymmetries and unexpected anti-symmetries in the TP organization. Thus, taken together these results constitute a unifying explanation of the conflicting models in previous research on conceptual knowledge representation.