1
|
Whitwell RL, Hasan HA, MacNeil RR, Enns JT. Coming to grips with reality: Real grasps, but not pantomimed grasps, resist a simultaneous tilt illusion. Neuropsychologia 2023; 191:108726. [PMID: 37931746 DOI: 10.1016/j.neuropsychologia.2023.108726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 10/27/2023] [Accepted: 11/03/2023] [Indexed: 11/08/2023]
Abstract
Investigations of grasping real, 3D objects subjected to illusory effects from a pictorial background often choose in-flight grasp aperture as the primary variable to test the hypothesis that the visuomotor system resists the illusion. Here we test an equally important feature of grasps that has received less attention: in-flight grasp orientation. The current study tested a variant of the simultaneous tilt illusion using a mirror-apparatus to manipulate the availability of haptic feedback. Participants performed grasps with haptic feedback (real grasps) and without it (pantomime grasps), reaching for the reflection of a real, 3D bar atop a background grating that induced a 1.1° bias in the perceived orientation of the bar in a separate sample of participants. Analysis of the hand's in-flight grasp orientation at early, late, and end stages of the reach showed that at no point were the real grasps biased by the illusion. In contrast, pantomimed grasps were affected by the illusion at the late and end stages of the reach. At each stage, the effect on the real grasps was significantly weaker than the effect of the illusion as measured by the mean point of subjective equality (PSE) in a two-alternative forced-choice task. In contrast, the effect on the pantomime grasps was statistically indistinguishable from the mean PSE at all three stages of the reach. These findings reinforce the idea that in-flight grasp orientation, like grasp aperture to pictorial illusions of target size, is refractory to pictorial backgrounds that bias perceived orientation.
Collapse
Affiliation(s)
- R L Whitwell
- Department of Physiology & Pharmacology, The University of Western University, Canada; Department of Psychology, The University of Western University, Canada.
| | - H A Hasan
- Department of Psychology, The University of British Columbia, Canada
| | - R R MacNeil
- Department of Psychology, The University of British Columbia, Canada
| | - J T Enns
- Department of Psychology, The University of British Columbia, Canada
| |
Collapse
|
2
|
Cushing CA, Dawes AJ, Hofmann SG, Lau H, LeDoux JE, Taschereau-Dumouchel V. A generative adversarial model of intrusive imagery in the human brain. PNAS NEXUS 2023; 2:pgac265. [PMID: 36733294 PMCID: PMC9887942 DOI: 10.1093/pnasnexus/pgac265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 01/20/2023] [Indexed: 01/24/2023]
Abstract
The mechanisms underlying the subjective experiences of mental disorders remain poorly understood. This is partly due to long-standing over-emphasis on behavioral and physiological symptoms and a de-emphasis of the patient's subjective experiences when searching for treatments. Here, we provide a new perspective on the subjective experience of mental disorders based on findings in neuroscience and artificial intelligence (AI). Specifically, we propose the subjective experience that occurs in visual imagination depends on mechanisms similar to generative adversarial networks that have recently been developed in AI. The basic idea is that a generator network fabricates a prediction of the world, and a discriminator network determines whether it is likely real or not. Given that similar adversarial interactions occur in the two major visual pathways of perception in people, we explored whether we could leverage this AI-inspired approach to better understand the intrusive imagery experiences of patients suffering from mental illnesses such as post-traumatic stress disorder (PTSD) and acute stress disorder. In our model, a nonconscious visual pathway generates predictions of the environment that influence the parallel but interacting conscious pathway. We propose that in some patients, an imbalance in these adversarial interactions leads to an overrepresentation of disturbing content relative to current reality, and results in debilitating flashbacks. By situating the subjective experience of intrusive visual imagery in the adversarial interaction of these visual pathways, we propose testable hypotheses on novel mechanisms and clinical applications for controlling and possibly preventing symptoms resulting from intrusive imagery.
Collapse
Affiliation(s)
- Cody A Cushing
- Department of Psychology, UCLA, Los Angeles, CA, 90095, USA
| | - Alexei J Dawes
- RIKEN Center for Brain Science, Wako, Saitama 351-0106, Japan
| | - Stefan G Hofmann
- Department of Clinical Psychology, Philipps-University Marburg, 35037 Marburg, Germany
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, 02215, USA
| | - Hakwan Lau
- RIKEN Center for Brain Science, Wako, Saitama 351-0106, Japan
| | - Joseph E LeDoux
- Center for Neural Science and Department of Psychology, New York University, New York, NY, 10012, USA
- Department of Psychiatry, and Department of Child and Adolescent Psychiatry, New York University Langone Medical School, New York, NY, 10016, USA
| | - Vincent Taschereau-Dumouchel
- Department of Psychiatry and Addictology, Université de Montréal, Montreal, Quebec H3T 1J4, Canada
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montreal, Quebec H1N 3M5, Canada
| |
Collapse
|
3
|
Sartin S, Ranzini M, Scarpazza C, Monaco S. Cortical areas involved in grasping and reaching actions with and without visual information: An ALE meta-analysis of neuroimaging studies. CURRENT RESEARCH IN NEUROBIOLOGY 2022; 4:100070. [PMID: 36632448 PMCID: PMC9826890 DOI: 10.1016/j.crneur.2022.100070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 11/23/2022] [Accepted: 12/18/2022] [Indexed: 12/31/2022] Open
Abstract
The functional specialization of the ventral stream in Perception and the dorsal stream in Action is the cornerstone of the leading model proposed by Goodale and Milner in 1992. This model is based on neuropsychological evidence and has been a matter of debate for almost three decades, during which the dual-visual stream hypothesis has received much attention, including support and criticism. The advent of functional magnetic resonance imaging (fMRI) has allowed investigating the brain areas involved in Perception and Action, and provided useful data on the functional specialization of the two streams. Research on this topic has been quite prolific, yet no meta-analysis so far has explored the spatial convergence in the involvement of the two streams in Action. The present meta-analysis (N = 53 fMRI and PET studies) was designed to reveal the specific neural activations associated with Action (i.e., grasping and reaching movements), and the extent to which visual information affects the involvement of the two streams during motor control. Our results provide a comprehensive view of the consistent and spatially convergent neural correlates of Action based on neuroimaging studies conducted over the past two decades. In particular, occipital-temporal areas showed higher activation likelihood in the Vision compared to the No vision condition, but no difference between reach and grasp actions. Frontal-parietal areas were consistently involved in both reach and grasp actions regardless of visual availability. We discuss our results in light of the well-established dual-visual stream model and frame these findings in the context of recent discoveries obtained with advanced fMRI methods, such as multivoxel pattern analysis.
Collapse
Affiliation(s)
- Samantha Sartin
- CIMeC - Center for Mind/Brain Sciences, University of Trento, Italy
| | | | - Cristina Scarpazza
- Department of General Psychology, University of Padua, Italy,IRCCS San Camillo Hospital, Venice, Italy
| | - Simona Monaco
- CIMeC - Center for Mind/Brain Sciences, University of Trento, Italy,Corresponding author. CIMeC - Center for Mind/Brain Sciences, University of Trento, Via delle Regole 101, 38123, Trento, Italy.
| |
Collapse
|
4
|
Bonetti L, Brattico E, Bruzzone SEP, Donati G, Deco G, Pantazis D, Vuust P, Kringelbach ML. Brain recognition of previously learned versus novel temporal sequences: a differential simultaneous processing. Cereb Cortex 2022; 33:5524-5537. [PMID: 36346308 PMCID: PMC10152090 DOI: 10.1093/cercor/bhac439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 10/12/2022] [Accepted: 12/13/2022] [Indexed: 11/09/2022] Open
Abstract
Abstract
Memory for sequences is a central topic in neuroscience, and decades of studies have investigated the neural mechanisms underlying the coding of a wide array of sequences extended over time. Yet, little is known on the brain mechanisms underlying the recognition of previously memorized versus novel temporal sequences. Moreover, the differential brain processing of single items in an auditory temporal sequence compared to the whole superordinate sequence is not fully understood. In this magnetoencephalography (MEG) study, the items of the temporal sequence were independently linked to local and rapid (2–8 Hz) brain processing, while the whole sequence was associated with concurrent global and slower (0.1–1 Hz) processing involving a widespread network of sequentially active brain regions. Notably, the recognition of previously memorized temporal sequences was associated to stronger activity in the slow brain processing, while the novel sequences required a greater involvement of the faster brain processing. Overall, the results expand on well-known information flow from lower- to higher order brain regions. In fact, they reveal the differential involvement of slow and faster whole brain processing to recognize previously learned versus novel temporal information.
Collapse
Affiliation(s)
- L Bonetti
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg , Universitetsbyen 3, 8000, Aarhus C , Denmark
- Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford , Stoke place 7, OX39BX, Oxford , UK
- University of Oxford Department of Psychiatry, , Oxford, UK
- University of Bologna Department of Psychology, , Italy
| | - E Brattico
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg , Universitetsbyen 3, 8000, Aarhus C , Denmark
- University of Bari Aldo Moro Department of Education, Psychology, Communication, , Italy
| | - S E P Bruzzone
- Center for Music in the Brain (MIB) , Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Universitetsbyen 3, 8000, Aarhus C , Denmark
- Copenhagen University Hospital Rigshospitalet Neurobiology Research Unit (NRU), , Inge Lehmanns Vej 6, 2100, Copenhagen , Denmark
- Faculty of Health and Medical Sciences, University of Copenhagen , Blegdamsvej 3B, 2200, Copenhagen , Denmark
| | - G Donati
- University of Bologna Department of Psychology, , Italy
| | - G Deco
- Center for Brain and Cognition, Universitat Pompeu Fabra Computational and Theoretical Neuroscience Group, , Edifici Merce Rodereda, C/ de Ramon Trias Fargas, 25, 08018 Barcelona , Spain
| | - D Pantazis
- McGovern Institute for Brain Research, Massachusetts Institute of Technology (MIT) , 77 Massachusetts Ave, Cambridge, MA 02139 , USA
| | - P Vuust
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg , Universitetsbyen 3, 8000, Aarhus C , Denmark
| | - M L Kringelbach
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg , Universitetsbyen 3, 8000, Aarhus C , Denmark
- Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford , Stoke place 7, OX39BX, Oxford , UK
- University of Oxford Department of Psychiatry, , Oxford, UK
| |
Collapse
|
5
|
Rossion B. Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis. Neuropsychologia 2022; 173:108279. [PMID: 35667496 DOI: 10.1016/j.neuropsychologia.2022.108279] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 04/30/2022] [Accepted: 05/25/2022] [Indexed: 10/18/2022]
Abstract
Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.
Collapse
Affiliation(s)
- Bruno Rossion
- Université de Lorraine, CNRS, CRAN, F-54000, Nancy, France; CHRU-Nancy, Service de Neurologie, F-5400, France; Psychological Sciences Research Institute, Institute of Neuroscience, University of Louvain, Belgium.
| |
Collapse
|
6
|
Unilateral resection of both cortical visual pathways in a pediatric patient alters action but not perception. Neuropsychologia 2022; 168:108182. [PMID: 35182580 DOI: 10.1016/j.neuropsychologia.2022.108182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 12/21/2021] [Accepted: 02/08/2022] [Indexed: 11/23/2022]
Abstract
The human cortical visual system consists of two major pathways, a ventral pathway that subserves perception and a dorsal pathway that primarily subserves visuomotor control. Previous studies have found that children with cortical resections of the ventral visual pathway retain largely normal visuoperceptual abilities. Whether visually guided actions, supported by computations carried out by the dorsal pathway, follow a similar pattern of preservation remains unknown. To address this question, we examined visuoperceptual and visuomotor behaviors in a pediatric patient, TC, who underwent a cortical resection that included portions of the left ventral and dorsal pathways. We collected kinematic data when TC used her right and left hands to perceptually estimate the width of blocks that varied in width and length, and, separately, to grasp the same blocks. TC's perceptual estimation performance was comparable to that of controls, independent of the hand used. In contrast, relative to controls, she showed reduced visuomotor sensitivity to object shape and this was more evident when she grasped the objects with her contralesional right hand. These results provide novel evidence for a striking difference in the competence of the two visual pathways to cortical injuries acquired in childhood.
Collapse
|
7
|
Visani E, Sebastiano DR, Duran D, Garofalo G, Magliocco F, Silipo F, Buccino G. The Semantics of Natural Objects and Tools in the Brain: A Combined Behavioral and MEG Study. Brain Sci 2022; 12:brainsci12010097. [PMID: 35053840 PMCID: PMC8774003 DOI: 10.3390/brainsci12010097] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 01/05/2022] [Accepted: 01/07/2022] [Indexed: 12/29/2022] Open
Abstract
Current literature supports the notion that the recognition of objects, when visually presented, is sub-served by neural structures different from those responsible for the semantic processing of their nouns. However, embodiment foresees that processing observed objects and their verbal labels should share similar neural mechanisms. In a combined behavioral and MEG study, we compared the modulation of motor responses and cortical rhythms during the processing of graspable natural objects and tools, either verbally or pictorially presented. Our findings demonstrate that conveying meaning to an observed object or processing its noun similarly modulates both motor responses and cortical rhythms; being natural graspable objects and tools differently represented in the brain, they affect in a different manner both behavioral and MEG findings, independent of presentation modality. These results provide experimental evidence that neural substrates responsible for conveying meaning to objects overlap with those where the object is represented, thus supporting an embodied view of semantic processing.
Collapse
Affiliation(s)
- Elisa Visani
- Neurophysiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milan, Italy; (E.V.); (D.R.S.); (D.D.)
| | - Davide Rossi Sebastiano
- Neurophysiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milan, Italy; (E.V.); (D.R.S.); (D.D.)
| | - Dunja Duran
- Neurophysiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milan, Italy; (E.V.); (D.R.S.); (D.D.)
| | - Gioacchino Garofalo
- Division of Neuroscience, IRCCS San Raffaele Scientific Institute, University San Raffaele, Via Olgettina 60, 20132 Milan, Italy;
| | - Fabio Magliocco
- Centro Psico-Sociale di Seregno—Azienda Socio-Sanitaria Territoriale di Vimercate, 20871 Vimercate, Italy;
| | - Francesco Silipo
- Dipartimento di Scienze Mediche e Chirurgiche, University “Magna Graecia” of Catanzaro, Viale Salvatore Venuta, 88100 Germaneto, Italy;
| | - Giovanni Buccino
- Division of Neuroscience, IRCCS San Raffaele Scientific Institute, University San Raffaele, Via Olgettina 60, 20132 Milan, Italy;
- Correspondence:
| |
Collapse
|
8
|
Ozana A, Berman S, Ganel T. Grasping Weber's Law in a Virtual Environment: The Effect of Haptic Feedback. Front Psychol 2020; 11:573352. [PMID: 33329216 PMCID: PMC7710620 DOI: 10.3389/fpsyg.2020.573352] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2020] [Accepted: 10/05/2020] [Indexed: 11/13/2022] Open
Abstract
Recent findings suggest that the functional separation between vision-for-action and vision-for-perception does not generalize to situations in which virtual objects are used as targets. For instance, unlike actions toward real objects that violate Weber's law, a basic law of visual perception, actions toward virtual objects presented on flat-screens, or in remote virtual environments, obey to Weber's law. These results suggest that actions in virtual environments are performed in an inefficient manner and are subjected to perceptual effects. It is unclear, however, whether this inefficiency reflects extensive variation in the way in which visual information is processed in virtual environments or more local aspects related to the settings of the virtual environment. In the current study, we focused on grasping performance in a state-of-the-art virtual reality system that provides an accurate representation of the 3D space. Within this environment, we tested the effect of haptic feedback on grasping trajectories. Participants were asked to perform bimanual grasping movements toward the edges of virtual targets. In the haptic feedback condition, physical stimuli of matching dimensions were embedded in the virtual environment. Haptic feedback was not provided in the no-feedback condition. The results showed that grasping trajectories in the feedback, but not in the no-feedback condition, could be performed more efficiently, and evade the influence of Weber's law. These findings are discussed in relevance to previous literature on 2D and 3D grasping.
Collapse
Affiliation(s)
- Aviad Ozana
- Department of Psychology, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,Zlotowski Center, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Sigal Berman
- Zlotowski Center, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Tzvi Ganel
- Department of Psychology, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,Zlotowski Center, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|
9
|
Abstract
The size-weight illusion is a perceptual illusion where smaller objects are judged as heavier than equally weighted larger objects. A previous informal report suggests that visual form agnosic patient DF does not experience the size-weight illusion when vision is the only available cue to object size. We tested this experimentally, comparing the magnitudes of DF's visual, kinesthetic and visual-kinesthetic size-weight illusions to those of 28 similarly-aged controls. A modified t-test found that DF's visual size-weight illusion was significantly smaller than that of controls (zcc = -1.7). A test of simple dissociation based on the Revised Standardized Difference Test found that the discrepancy between the magnitude of DF's visual and kinesthetic size-weight illusions was not significantly different from that of controls (zdcc = -1.054), thereby failing to establish a dissociation between the visual and kinesthetic conditions. These results are consistent with previous suggestions that visual form agnosia, following ventral visual stream damage, is associated with an abnormally reduced size-weight illusion. The results, however, do not confirm that this reduction is specific to the use of visual size cues to predict object weight, rather than reflecting more general changes in the processing of object size cues or in the use of predictive strategies for lifting.
Collapse
Affiliation(s)
| | - Anna Sedda
- School of Social Sciences,Psychology, Heriot-Watt University , Edinburgh, UK
| | | | - Robert D McIntosh
- Human Cognitive Neuroscience, Psychology, University of Edinburgh , Edinburgh, UK
| |
Collapse
|
10
|
Chang AYC, Biehl M, Yu Y, Kanai R. Information Closure Theory of Consciousness. Front Psychol 2020; 11:1504. [PMID: 32760320 PMCID: PMC7374725 DOI: 10.3389/fpsyg.2020.01504] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Accepted: 06/05/2020] [Indexed: 11/13/2022] Open
Abstract
Information processing in neural systems can be described and analyzed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained but can be coarse-grained at higher levels. However, only information processed at specific scales of coarse-graining appears to be available for conscious awareness. We do not have direct experience of information available at the scale of individual neurons, which is noisy and highly stochastic. Neither do we have experience of more macro-scale interactions, such as interpersonal communications. Neurophysiological evidence suggests that conscious experiences co-vary with information encoded in coarse-grained neural states such as the firing pattern of a population of neurons. In this article, we introduce a new informational theory of consciousness: Information Closure Theory of Consciousness (ICT). We hypothesize that conscious processes are processes which form non-trivial informational closure (NTIC) with respect to the environment at certain coarse-grained scales. This hypothesis implies that conscious experience is confined due to informational closure from conscious processing to other coarse-grained scales. Information Closure Theory of Consciousness (ICT) proposes new quantitative definitions of both conscious content and conscious level. With the parsimonious definitions and a hypothesize, ICT provides explanations and predictions of various phenomena associated with consciousness. The implications of ICT naturally reconcile issues in many existing theories of consciousness and provides explanations for many of our intuitions about consciousness. Most importantly, ICT demonstrates that information can be the common language between consciousness and physical reality.
Collapse
|
11
|
Karimpur H, Eftekharifar S, Troje NF, Fiehler K. Spatial coding for memory-guided reaching in visual and pictorial spaces. J Vis 2020; 20:1. [PMID: 32271893 PMCID: PMC7405696 DOI: 10.1167/jov.20.4.1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 11/20/2019] [Indexed: 01/10/2023] Open
Abstract
An essential difference between pictorial space displayed as paintings, photographs, or computer screens, and the visual space experienced in the real world is that the observer has a defined location, and thus valid information about distance and direction of objects, in the latter but not in the former. Thus egocentric information should be more reliable in visual space, whereas allocentric information should be more reliable in pictorial space. The majority of studies relied on pictorial representations (images on a computer screen), leaving it unclear whether the same coding mechanisms apply in visual space. Using a memory-guided reaching task in virtual reality, we investigated allocentric coding in both visual space (on a table in virtual reality) and pictorial space (on a monitor that is on the table in virtual reality). Our results suggest that the brain uses allocentric information to represent objects in both pictorial and visual space. Contrary to our hypothesis, the influence of allocentric cues was stronger in visual space than in pictorial space, also after controlling for retinal stimulus size, confounding allocentric cues, and differences in presentation depth. We discuss possible reasons for stronger allocentric coding in visual than in pictorial space.
Collapse
Affiliation(s)
- Harun Karimpur
- Experimental Psychology, Justus Liebig University, Giessen, Germany
- Center for Mind, Brain, and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany
| | | | - Nikolaus F. Troje
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
- Centre for Vision Research and Department of Biology, York University, Toronto, ON, Canada
| | - Katja Fiehler
- Experimental Psychology, Justus Liebig University, Giessen, Germany
- Center for Mind, Brain, and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany
| |
Collapse
|
12
|
Pisu V, Uccelli S, Riggio L, Bruno N. Action preparation in grasping reveals generalization of precision between implicit and explicit motor processes. Neuropsychologia 2020; 141:107406. [DOI: 10.1016/j.neuropsychologia.2020.107406] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2019] [Revised: 02/14/2020] [Accepted: 02/17/2020] [Indexed: 10/24/2022]
|
13
|
Language Processing. Cognition 2019. [DOI: 10.1017/9781316271988.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
14
|
Methods of Cognitive Psychology. Cognition 2019. [DOI: 10.1017/9781316271988.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
15
|
Cognitive Psychologists’ Approach to Research. Cognition 2019. [DOI: 10.1017/9781316271988.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
16
|
Visual Imagery. Cognition 2019. [DOI: 10.1017/9781316271988.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
17
|
Index. Cognition 2019. [DOI: 10.1017/9781316271988.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
18
|
Decision Making and Reasoning. Cognition 2019. [DOI: 10.1017/9781316271988.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
19
|
Attention. Cognition 2019. [DOI: 10.1017/9781316271988.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
20
|
Long-Term Memory Structure. Cognition 2019. [DOI: 10.1017/9781316271988.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
21
|
Problem Solving. Cognition 2019. [DOI: 10.1017/9781316271988.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
22
|
Preface. Cognition 2019. [DOI: 10.1017/9781316271988.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
23
|
Sensory and Working Memory. Cognition 2019. [DOI: 10.1017/9781316271988.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
24
|
Memory Retrieval. Cognition 2019. [DOI: 10.1017/9781316271988.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
25
|
Visual Perception. Cognition 2019. [DOI: 10.1017/9781316271988.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
26
|
References. Cognition 2019. [DOI: 10.1017/9781316271988.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
27
|
Language Structure. Cognition 2019. [DOI: 10.1017/9781316271988.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
28
|
Concepts and Categories. Cognition 2019. [DOI: 10.1017/9781316271988.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
29
|
Long-Term Memory Processes. Cognition 2019. [DOI: 10.1017/9781316271988.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
30
|
Glossary. Cognition 2019. [DOI: 10.1017/9781316271988.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
31
|
A pantomiming priming study on the grasp and functional use actions of tools. Exp Brain Res 2019; 237:2155-2165. [PMID: 31203403 DOI: 10.1007/s00221-019-05581-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2018] [Accepted: 06/11/2019] [Indexed: 12/31/2022]
Abstract
It has previously been demonstrated that tool recognition is facilitated by the repeated visual presentation of object features affording actions, such as those related to grasping and their functional use. It is unclear, however, if this can also facilitate pantomiming. Participants were presented with an image of a prime followed by a target tool and were required to pantomime the appropriate action for each one. The grasp and functional use attributes of the target tool were either the same or different to the prime. Contrary to expectations, participants were slower at pantomiming the target tool relative to the prime regardless of whether the grasp and function of the tool were the same or different-except when the prime and target tools consisted of identical images of the same exemplar. We also found a decrease in accuracy of performing functional use actions for the target tool relative to the prime when the two differed in functional use but not grasp. We reconcile differences between our findings and those that have performed priming studies on tool recognition with differences in task demands and known differences in how the brain recognises tools and performs actions to make use of them.
Collapse
|
32
|
Ganel T, Goodale MA. Still holding after all these years: An action-perception dissociation in patient DF. Neuropsychologia 2019; 128:249-254. [DOI: 10.1016/j.neuropsychologia.2017.09.016] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2017] [Accepted: 09/17/2017] [Indexed: 10/18/2022]
|
33
|
The Uznadze illusion reveals similar effects of relative size on perception and action. Exp Brain Res 2019; 237:953-965. [DOI: 10.1007/s00221-019-05480-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2018] [Accepted: 01/19/2019] [Indexed: 11/25/2022]
|
34
|
Xu Y. A Tale of Two Visual Systems: Invariant and Adaptive Visual Information Representations in the Primate Brain. Annu Rev Vis Sci 2018; 4:311-336. [PMID: 29949722 DOI: 10.1146/annurev-vision-091517-033954] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Visual information processing contains two opposite needs. There is both a need to comprehend the richness of the visual world and a need to extract only pertinent visual information to guide thoughts and behavior at a given moment. I argue that these two aspects of visual processing are mediated by two complementary visual systems in the primate brain-specifically, the occipitotemporal cortex (OTC) and the posterior parietal cortex (PPC). The role of OTC in visual processing has been documented extensively by decades of neuroscience research. I review here recent evidence from human imaging and monkey neurophysiology studies to highlight the role of PPC in adaptive visual processing. I first document the diverse array of visual representations found in PPC. I then describe the adaptive nature of visual representation in PPC by contrasting visual processing in OTC and PPC and by showing that visual representations in PPC largely originate from OTC.
Collapse
Affiliation(s)
- Yaoda Xu
- Visual Sciences Laboratory, Psychology Department, Harvard University, Cambridge, Massachusetts 02138, USA;
| |
Collapse
|
35
|
Castaldi E, Tinelli F, Cicchini GM, Morrone MC. Supramodal agnosia for oblique mirror orientation in patients with periventricular leukomalacia. Cortex 2018; 103:179-198. [PMID: 29655042 PMCID: PMC6004039 DOI: 10.1016/j.cortex.2018.03.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2017] [Revised: 03/09/2018] [Accepted: 03/12/2018] [Indexed: 01/11/2023]
Abstract
Periventricular leukomalacia (PVL) is characterized by focal necrosis at the level of the periventricular white matter, often observed in preterm infants. PVL is frequently associated with motor impairment and with visual deficits affecting primary stages of visual processes as well as higher visual cognitive abilities. Here we describe six PVL subjects, with normal verbal IQ, showing orientation perception deficits in both the haptic and visual domains. Subjects were asked to compare the orientation of two stimuli presented simultaneously or sequentially, using both a two alternative forced choice (2AFC) orientation-discrimination and a matching procedure. Visual stimuli were oriented gratings or bars or collinear short lines embedded within a random pattern. Haptic stimuli comprised two rotatable wooden sticks. PVL patients performed at chance in discriminating the oblique orientation, both for visual and haptic stimuli. Moreover when asked to reproduce the oblique orientation, they often oriented the stimulus along the symmetric mirror orientation. The deficit generalized to stimuli varying in many low level features, was invariant for spatiotopic object orientation, and also occurred for sequential presentations. The deficit was specific to oblique orientations, and not for horizontal or vertical stimuli. These findings show that PVL can affect a specific network involved with the supramodal perception of mirror symmetry orientation.
Collapse
Affiliation(s)
- Elisa Castaldi
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Francesca Tinelli
- Department of Developmental Neuroscience, Stella Maris Scientific Institute, Pisa, Italy
| | | | - M Concetta Morrone
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy; Department of Developmental Neuroscience, Stella Maris Scientific Institute, Pisa, Italy.
| |
Collapse
|
36
|
The Size Congruity Effect Vanishes in Grasping: Implications for the Processing of Numerical Information. Sci Rep 2018; 8:2723. [PMID: 29426827 PMCID: PMC5807327 DOI: 10.1038/s41598-018-21003-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2017] [Accepted: 01/29/2018] [Indexed: 01/28/2023] Open
Abstract
Judgments of the physical size in which a numeral is presented are often affected by the task-irrelevant attribute of its numerical magnitude, the Size Congruity Effect (SCE). The SCE is typically interpreted as a marker of the automatic activation of numerical magnitude. However, a growing literature shows that the SCE is not robust, a possible indication that numerical information is not always activated in an automatic fashion. In the present study, we tested the SCE via grasping by way of resolving the automaticity debate. We found results that challenge the robustness of the SCE and, consequently, the validity of the automaticity assumption. The SCE was absent when participants grasped the physically larger object of a pair of 3D wooden numerals. An SCE was still recorded when the participants perceptually indicated the general location of the larger object, but not when they grasped that object. These results highlight the importance of the sensory domain when considering the generality of a perceptual effect.
Collapse
|
37
|
Shi X, Shen X, Qian X. Grasping and Pointing — Visual Conflict and Interference. Multisens Res 2018; 31:439-454. [DOI: 10.1163/22134808-00002576] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2016] [Accepted: 04/16/2017] [Indexed: 11/19/2022]
Abstract
There have been many debates of the two-visual-systems (whatvs. how or perceptionvs. action) hypothesis that was proposed by Goodale and his colleagues. Many researchers have provided a variety of evidence for or against the hypothesis. For instance, a study performed by Agliotiet al. offered good evidence for the two-visual-systems theory using the Ebbinghaus illusion, but some researchers who used other visual illusions failed to find consistent results. Therefore, we used a perceptual task of conflict or interference to test this hypothesis. If the conflict or interference in perception had an influence on the processing of perception alone and did not affect the processing of action, we could infer that the two visual systems are separated, and vice versa. In the current study, we carried out two experiments which employed the Stroop, Garner and SNARC paradigms and used graspable 3-D Arabic numerals. We aimed to find if the effects resulting from perceptual conflicts or interferences would affect participants’ grasping and pointing. The results showed that the interaction between Stroop and numeral order (ascending or descending, or SNARC) was significant, and the SNARC effect significantly affected action, but the main effects of Stroop and Garner interference were not significant. The results indicated that, to some degree, perceptual conflict affects action processing. The results did not provide evidence for two separate visual systems.
Collapse
Affiliation(s)
- Xia Shi
- Department of Psychology, Jiangxi University of Traditional Chinese Medicine, No. 1688 Meiling Avenue, Wanli District, Nanchang 330004, China
- Tianjin University of Technology and Education, Tianjin, China
- Zhejiang University, Hangzhou, China
| | - Xunbing Shen
- Department of Psychology, Jiangxi University of Traditional Chinese Medicine, No. 1688 Meiling Avenue, Wanli District, Nanchang 330004, China
- Zhejiang University, Hangzhou, China
| | | |
Collapse
|
38
|
Two visual pathways – Where have they taken us and where will they lead in future? Cortex 2018; 98:283-292. [DOI: 10.1016/j.cortex.2017.12.002] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Accepted: 12/05/2017] [Indexed: 01/05/2023]
|
39
|
Rossit S, Harvey M, Butler SH, Szymanek L, Morand S, Monaco S, McIntosh RD. Impaired peripheral reaching and on-line corrections in patient DF: Optic ataxia with visual form agnosia. Cortex 2018; 98:84-101. [DOI: 10.1016/j.cortex.2017.04.004] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2016] [Revised: 02/15/2017] [Accepted: 04/07/2017] [Indexed: 11/16/2022]
|
40
|
Abstract
In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.
Collapse
Affiliation(s)
- Jason P Gallivan
- Department of Psychology, Queen's University, Kingston, Ontario, Canada; Department of Biomedical and Molecular Sciences, Queen's University, Kingston, Ontario, Canada; Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Melvyn A Goodale
- Department of Psychology, University of Western Ontario, London, Ontario, Canada; Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada.
| |
Collapse
|
41
|
|
42
|
Martinaud O. Visual agnosia and focal brain injury. Rev Neurol (Paris) 2017; 173:451-460. [DOI: 10.1016/j.neurol.2017.07.009] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2017] [Revised: 07/11/2017] [Accepted: 07/17/2017] [Indexed: 11/29/2022]
|
43
|
Chouinard PA, Meena DK, Whitwell RL, Hilchey MD, Goodale MA. A TMS Investigation on the Role of Lateral Occipital Complex and Caudal Intraparietal Sulcus in the Perception of Object Form and Orientation. J Cogn Neurosci 2017; 29:881-895. [DOI: 10.1162/jocn_a_01094] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
We used TMS to assess the causal roles of the lateral occipital (LO) and caudal intraparietal sulcus (cIPS) areas in the perceptual discrimination of object features. All participants underwent fMRI to localize these areas using a protocol in which they passively viewed images of objects that varied in both form and orientation. fMRI identified six significant brain regions: LO, cIPS, and the fusiform gyrus, bilaterally. In a separate experimental session, we applied TMS to LO or cIPS while the same participants performed match-to-sample form or orientation discrimination tasks. Compared with sham stimulation, TMS to either the left or right LO increased RTs for form but not orientation discrimination, supporting a critical role for LO in form processing for perception- and judgment-based tasks. In contrast, we did not observe any effects when we applied TMS to cIPS. Thus, despite the clear functional evidence of engagement for both LO and cIPS during the passive viewing of objects in the fMRI experiment, the TMS experiment revealed that cIPS is not critical for making perceptual judgments about their form or orientation.
Collapse
Affiliation(s)
| | | | | | | | - Melvyn A. Goodale
- 1La Trobe University, Melbourne, Australia
- 2University of Western Ontario, Canada
| |
Collapse
|
44
|
Mirrored and rotated stimuli are not the same: A neuropsychological and lesion mapping study. Cortex 2016; 78:100-114. [DOI: 10.1016/j.cortex.2016.03.002] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2015] [Revised: 01/30/2016] [Accepted: 03/01/2016] [Indexed: 11/18/2022]
|
45
|
Potocanac Z, Pijnappels M, Verschueren S, van Dieën J, Duysens J. Two-stage muscle activity responses in decisions about leg movement adjustments during trip recovery. J Neurophysiol 2015; 115:143-56. [PMID: 26561597 DOI: 10.1152/jn.00263.2015] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2015] [Accepted: 10/27/2015] [Indexed: 12/13/2022] Open
Abstract
Studies on neural decision making mostly investigated fast corrective adjustments of arm movements. However, fast leg movement corrections deserve attention as well, since they are often required to avoid falling after balance perturbations. The present study aimed at elucidating the mechanisms behind fast corrections of tripping responses by analyzing the concomitant leg muscle activity changes. This was investigated in seven young adults who were tripped in between normal walking trials and took a recovery step by elevating the tripped leg over the obstacle. In some trials, a forbidden landing zone (FZ) was presented behind the obstacle, at the subjects' preferred foot landing position, forcing a step correction. Muscle activity of the tripped leg gastrocnemius medialis (iGM), tibialis anterior (iTA), rectus femoris (iRF), and biceps femoris (iBF) muscles was compared between normal trips presented before any FZ appearance, trips with a FZ, and normal trips presented in between trips with a FZ ("catch" trials). When faced with a real or expected (catch trials) FZ, subjects shortened their recovery steps. The underlying changes in muscle activity consisted of two stages. The first stage involved reduced iGM activity, occurring at a latency shorter than voluntary reaction, followed by reduced iTA and increased iBF and iGM activities occurring at longer latencies. The fast response was not related to step shortening, but longer latency responses clearly were functional. We suggest that the initial response possibly acts as a "pause," allowing the nervous system to integrate the necessary information and prepare the subsequent, functional movement adjustment.
Collapse
Affiliation(s)
| | - Mirjam Pijnappels
- Department of Human Movement Sciences, MOVE Research Institute Amsterdam, Vrije Universiteit Amsterdam, the Netherlands; and
| | | | - Jaap van Dieën
- Department of Human Movement Sciences, MOVE Research Institute Amsterdam, Vrije Universiteit Amsterdam, the Netherlands; and
| | | |
Collapse
|
46
|
Glazebrook CM, Welsh TN, Tremblay L. The processing of visual and auditory information for reaching movements. PSYCHOLOGICAL RESEARCH 2015; 80:757-73. [PMID: 26253323 DOI: 10.1007/s00426-015-0689-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2015] [Accepted: 07/11/2015] [Indexed: 11/28/2022]
Abstract
Presenting target and non-target information in different modalities influences target localization if the non-target is within the spatiotemporal limits of perceptual integration. When using auditory and visual stimuli, the influence of a visual non-target on auditory target localization is greater than the reverse. It is not known, however, whether or how such perceptual effects extend to goal-directed behaviours. To gain insight into how audio-visual stimuli are integrated for motor tasks, the kinematics of reaching movements towards visual or auditory targets with or without a non-target in the other modality were examined. When present, the simultaneously presented non-target could be spatially coincident, to the left, or to the right of the target. Results revealed that auditory non-targets did not influence reaching trajectories towards a visual target, whereas visual non-targets influenced trajectories towards an auditory target. Interestingly, the biases induced by visual non-targets were present early in the trajectory and persisted until movement end. Subsequent experimentation indicated that the magnitude of the biases was equivalent whether participants performed a perceptual or motor task, whereas variability was greater for the motor versus the perceptual tasks. We propose that visually induced trajectory biases were driven by the perceived mislocation of the auditory target, which in turn affected both the movement plan and subsequent control of the movement. Such findings provide further evidence of the dominant role visual information processing plays in encoding spatial locations as well as planning and executing reaching action, even when reaching towards auditory targets.
Collapse
Affiliation(s)
- Cheryl M Glazebrook
- Faculty of Kinesiology and Recreation Management, University of Manitoba, 319 Max Bell Centre, Winnipeg, MB, R3T 2N2, Canada. .,Health, Leisure, and Human Performance Research Institute, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.
| | - Timothy N Welsh
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, M5S 2W6, Canada
| | - Luc Tremblay
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, M5S 2W6, Canada
| |
Collapse
|
47
|
Whitwell RL, Ganel T, Byrne CM, Goodale MA. Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a "natural" grasping task induces pantomime-like grasps. Front Hum Neurosci 2015; 9:216. [PMID: 25999834 PMCID: PMC4422037 DOI: 10.3389/fnhum.2015.00216] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2014] [Accepted: 04/02/2015] [Indexed: 11/13/2022] Open
Abstract
Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. “Natural” prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object (“haptics-based object information”) once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets (“grip scaling”) when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF’s grip scaling slopes. In the second experiment, we examined an “unnatural” grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts.
Collapse
Affiliation(s)
- Robert L Whitwell
- Graduate Program in Neuroscience, The University of Western Ontario London, ON, Canada ; Department of Psychology, The University of Western Ontario London, ON, Canada ; The Brain and Mind Institute, The University of Western Ontario London, ON, Canada
| | - Tzvi Ganel
- Department of Psychology, Ben-Gurion University of the Negev Beer-Sheva, Israel
| | - Caitlin M Byrne
- Department of Psychology, The University of Western Ontario London, ON, Canada
| | - Melvyn A Goodale
- Department of Psychology, The University of Western Ontario London, ON, Canada ; The Brain and Mind Institute, The University of Western Ontario London, ON, Canada ; Department of Physiology and Pharmacology, The University of Western Ontario London, ON, Canada
| |
Collapse
|
48
|
Morris R, Whishaw IQ. Arm and hand movement: current knowledge and future perspective. Front Neurol 2015; 6:19. [PMID: 25705202 PMCID: PMC4319398 DOI: 10.3389/fneur.2015.00019] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2014] [Accepted: 01/24/2015] [Indexed: 12/02/2022] Open
Affiliation(s)
- Renée Morris
- Department of Anatomy, Translational Neuroscience Facility, School of Medical Sciences, UNSW Australia , Sydney, NSW , Australia
| | - Ian Q Whishaw
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge , Lethbridge, AB , Canada
| |
Collapse
|