1
|
Spagna A, Heidenry Z, Miselevich M, Lambert C, Eisenstadt BE, Tremblay L, Liu Z, Liu J, Bartolomeo P. Visual mental imagery: Evidence for a heterarchical neural architecture. Phys Life Rev 2024; 48:113-131. [PMID: 38217888 DOI: 10.1016/j.plrev.2023.12.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Accepted: 12/26/2023] [Indexed: 01/15/2024]
Abstract
Theories of Visual Mental Imagery (VMI) emphasize the processes of retrieval, modification, and recombination of sensory information from long-term memory. Yet, only few studies have focused on the behavioral mechanisms and neural correlates supporting VMI of stimuli from different semantic domains. Therefore, we currently have a limited understanding of how the brain generates and maintains mental representations of colors, faces, shapes - to name a few. Such an undetermined scenario renders unclear the organizational structure of neural circuits supporting VMI, including the role of the early visual cortex. We aimed to fill this gap by reviewing the scientific literature of five semantic domains: visuospatial, face, colors, shapes, and letters imagery. Linking theory to evidence from over 60 different experimental designs, this review highlights three main points. First, there is no consistent activity in the early visual cortex across all VMI domains, contrary to the prediction of the dominant model. Second, there is consistent activity of the frontoparietal networks and the left hemisphere's fusiform gyrus during voluntary VMI irrespective of the semantic domain investigated. We propose that these structures are part of a domain-general VMI sub-network. Third, domain-specific information engages specific regions of the ventral and dorsal cortical visual pathways. These regions partly overlap with those found in visual perception studies (e.g., fusiform face area for faces imagery; lingual gyrus for color imagery). Altogether, the reviewed evidence suggests the existence of domain-general and domain-specific mechanisms of VMI selectively engaged by stimulus-specific properties (e.g., colors or faces). These mechanisms would be supported by an organizational structure mixing vertical and horizontal connections (heterarchy) between sub-networks for specific stimulus domains. Such a heterarchical organization of VMI makes different predictions from current models of VMI as reversed perception. Our conclusions set the stage for future research, which should aim to characterize the spatiotemporal dynamics and interactions among key regions of this architecture giving rise to visual mental images.
Collapse
Affiliation(s)
- Alfredo Spagna
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA.
| | - Zoe Heidenry
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA
| | | | - Chloe Lambert
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA
| | | | - Laura Tremblay
- Department of Psychology, Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California; Department of Neurology, VA Northern California Health Care System, Martinez, California
| | - Zixin Liu
- Department of Human Development, Teachers College, Columbia University, NY, 10027, USA
| | - Jianghao Liu
- Sorbonne Université, Inserm, CNRS, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, Paris 10027, France; Dassault Systèmes, Vélizy-Villacoublay, France
| | - Paolo Bartolomeo
- Sorbonne Université, Inserm, CNRS, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, Paris 10027, France
| |
Collapse
|
2
|
Jordan N, Emanuelle R. Hands off, brain off? A meta-analysis of neuroimaging data during active and passive driving. Brain Behav 2023; 13:e3272. [PMID: 37828722 PMCID: PMC10726911 DOI: 10.1002/brb3.3272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 09/21/2023] [Accepted: 09/23/2023] [Indexed: 10/14/2023] Open
Abstract
BACKGROUND Car driving is more and more automated, to such an extent that driving without active steering control is becoming a reality. Although active driving requires the use of visual information to guide actions (i.e., steering the vehicle), passive driving only requires looking at the driving scene without any need to act (i.e., the human is passively driven). MATERIALS & METHODS After a careful search of the scientific literature, 11 different studies, providing 17 contrasts, were used to run a comprehensive meta-analysis contrasting active driving with passive driving. RESULTS Two brain regions were recruited more consistently for active driving compared to passive driving, the left precentral gyrus (BA3 and BA4) and the left postcentral gyrus (BA4 and BA3/40), whereas a set of brain regions was recruited more consistently in passive driving compared to active driving: the left middle frontal gyrus (BA6), the right anterior lobe and the left posterior lobe of the cerebellum, the right sub-lobar thalamus, the right anterior prefrontal cortex (BA10), the right inferior occipital gyrus (BA17/18/19), the right inferior temporal gyrus (BA37), and the left cuneus (BA17). DISCUSSION From a theoretical perspective, these findings support the idea that the output requirement of the visual scanning process engaged for the same activity can trigger different cerebral pathways, associated with different cognitive processes. A dorsal stream dominance was found during active driving, whereas a ventral stream dominance was obtained during passive driving. From a practical perspective, and contrary to the dominant position in the Human Factors community, our findings support the idea that a transition from passive to active driving would remain challenging as passive and active driving engage distinct neural networks.
Collapse
Affiliation(s)
- Navarro Jordan
- Laboratoire d'Etude des Mécanismes Cognitifs (EA 3082)Université de LyonBron Cedex, LyonFrance
- Institut Universitaire de FranceParisFrance
| | - Reynaud Emanuelle
- Laboratoire d'Etude des Mécanismes Cognitifs (EA 3082)Université de LyonBron Cedex, LyonFrance
| |
Collapse
|
3
|
Abstract
What are mental images needed for? A variety of everyday situations calls for us to plan ahead; one of the clever ways our mind prepares and strategizes our next move is through mental simulation. A powerful tool in running these simulations is visual mental imagery, which can be conceived as a way to activate and maintain an internal representation of the to-be-imagined object, giving rise to predictions. Therefore, under normal conditions imagination is primarily an endogenous process, and only more rarely can mental images be activated exogenously, for example, by means of intracerebral stimulation. A large debate is still ongoing regarding the neural substrates supporting mental imagery, with the neuropsychological and neuroimaging literature agreeing in some cases, but not others. This chapter reviews the neuroscientific literature on mental imagery, and attempts to reappraise the neuropsychological and neuroimaging evidence by drawing a model of mental imagery informed by both structural and functional brain data. Overall, the role of regions in the ventral temporal cortex, especially of the left hemisphere, stands out unequivocally as a key substrate in mental imagery.
Collapse
Affiliation(s)
- Alfredo Spagna
- Department of Psychology, Columbia University, New York City, NY, United States.
| |
Collapse
|
4
|
Hemispheric asymmetries in visual mental imagery. Brain Struct Funct 2021; 227:697-708. [PMID: 33885966 DOI: 10.1007/s00429-021-02277-w] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 04/10/2021] [Indexed: 10/21/2022]
Abstract
Visual mental imagery is the faculty whereby we can "visualize" objects that are not in our line of sight. Longstanding evidence dating back over thirty years has shown that unilateral brain lesions, especially in the left temporal lobe, can impair aspects of this ability. Yet, there is currently no attempt to identify analogies between these neuropsychological findings of hemispheric asymmetry and those from other neuroscientific approaches. Here, we present a critical review of the available literature on the hemispheric laterality of visual mental imagery, by looking at cross-method patterns of evidence in the domains of lesion neuropsychology, neuroimaging, and direct cortical stimulation. Results can be summarized under three main axes. First, frontoparietal networks in both hemispheres appear to be associated with visual mental imagery. Second, lateralization patterns emerge in the temporal lobes, with the left inferior temporal lobe being the most common finding in the literature for endogenously generated images, especially, but not exclusively, when orthographic material is used to ignite imagery. Third, an opposite pattern of hemispheric laterality emerges when visual mental images are induced by exogenous stimulation; direct cortical electrical stimulation tends to produce visual imagery experiences predominantly when applied to the right temporal lobe. These patterns of hemispheric asymmetry are difficult to reconcile with the dominant model of visual mental imagery, which emphasizes the implication of early sensory cortices. They suggest instead that visual mental imagery relies on large-scale brain networks, with a crucial participation of high-level visual regions in the temporal lobes.
Collapse
|
5
|
Spagna A, Hajhajate D, Liu J, Bartolomeo P. Visual mental imagery engages the left fusiform gyrus, but not the early visual cortex: A meta-analysis of neuroimaging evidence. Neurosci Biobehav Rev 2021; 122:201-217. [PMID: 33422567 DOI: 10.1016/j.neubiorev.2020.12.029] [Citation(s) in RCA: 67] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 12/03/2020] [Accepted: 12/23/2020] [Indexed: 12/13/2022]
Abstract
The dominant neural model of visual mental imagery (VMI) stipulates that memories from the medial temporal lobe acquire sensory features in early visual areas. However, neurological patients with damage restricted to the occipital cortex typically show perfectly vivid VMI, while more anterior damages extending into the temporal lobe, especially in the left hemisphere, often cause VMI impairments. Here we present two major results reconciling neuroimaging findings in neurotypical subjects with the performance of brain-damaged patients: (1) A large-scale meta-analysis of 46 fMRI studies, of which 27 investigated specifically visual mental imagery, revealed that VMI engages fronto-parietal networks and a well-delimited region in the left fusiform gyrus. (2) A Bayesian analysis showed no evidence for imagery-related activity in early visual cortices. We propose a revised neural model of VMI that draws inspiration from recent cytoarchitectonic and lesion studies, whereby fronto-parietal networks initiate, modulate, and maintain activity in a core temporal network centered on the fusiform imagery node, a high-level visual region in the left fusiform gyrus.
Collapse
Affiliation(s)
- Alfredo Spagna
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA; Sorbonne Université, Inserm U 1127, CNRS UMR 7225, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, F-75013, Paris, France
| | - Dounia Hajhajate
- Sorbonne Université, Inserm U 1127, CNRS UMR 7225, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, F-75013, Paris, France
| | - Jianghao Liu
- Sorbonne Université, Inserm U 1127, CNRS UMR 7225, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, F-75013, Paris, France; Dassault Systèmes, Vélizy-Villacoublay, France
| | - Paolo Bartolomeo
- Sorbonne Université, Inserm U 1127, CNRS UMR 7225, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, F-75013, Paris, France.
| |
Collapse
|
6
|
Winlove CI, Milton F, Ranson J, Fulford J, MacKisack M, Macpherson F, Zeman A. The neural correlates of visual imagery: A co-ordinate-based meta-analysis. Cortex 2018; 105:4-25. [DOI: 10.1016/j.cortex.2017.12.014] [Citation(s) in RCA: 63] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2017] [Revised: 12/11/2017] [Accepted: 12/18/2017] [Indexed: 02/07/2023]
|
7
|
Mańkowska A, Harciarek M, Williamson JB, Heilman KM. The influence of rightward and leftward spatial deviations of spatial attention on emotional picture recognition. J Clin Exp Neuropsychol 2018; 40:951-962. [DOI: 10.1080/13803395.2018.1457138] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Affiliation(s)
- Aleksandra Mańkowska
- Division of Clinical Psychology and Neuropsychology, Institute of Psychology, University of Gdańsk, Gdańsk, Poland
| | - Michał Harciarek
- Division of Clinical Psychology and Neuropsychology, Institute of Psychology, University of Gdańsk, Gdańsk, Poland
| | - John B. Williamson
- Department of Neurology, University of Florida College of Medicine, Gainesville, FL, USA
- Brain Rehabilitation Research Center, North Florida/South Georgia Veterans Affairs Medical Center, Gainesville, FL, USA
| | - Kenneth M. Heilman
- Department of Neurology, University of Florida College of Medicine, Gainesville, FL, USA
- Brain Rehabilitation Research Center, North Florida/South Georgia Veterans Affairs Medical Center, Gainesville, FL, USA
| |
Collapse
|
8
|
Chan E, Baumann O, Bellgrove MA, Mattingley JB. Extrinsic reference frames modify the neural substrates of object-location representations. Neuropsychologia 2013; 51:781-8. [DOI: 10.1016/j.neuropsychologia.2013.02.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2013] [Revised: 02/07/2013] [Accepted: 02/09/2013] [Indexed: 10/27/2022]
|
9
|
Villarreal MF, Fridman EA, Leiguarda RC. The effect of the visual context in the recognition of symbolic gestures. PLoS One 2012; 7:e29644. [PMID: 22363406 PMCID: PMC3283587 DOI: 10.1371/journal.pone.0029644] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2011] [Accepted: 12/02/2011] [Indexed: 11/19/2022] Open
Abstract
Background To investigate, by means of fMRI, the influence of the visual environment in the process of symbolic gesture recognition. Emblems are semiotic gestures that use movements or hand postures to symbolically encode and communicate meaning, independently of language. They often require contextual information to be correctly understood. Until now, observation of symbolic gestures was studied against a blank background where the meaning and intentionality of the gesture was not fulfilled. Methodology/Principal Findings Normal subjects were scanned while observing short videos of an individual performing symbolic gesture with or without the corresponding visual context and the context scenes without gestures. The comparison between gestures regardless of the context demonstrated increased activity in the inferior frontal gyrus, the superior parietal cortex and the temporoparietal junction in the right hemisphere and the precuneus and posterior cingulate bilaterally, while the comparison between context and gestures alone did not recruit any of these regions. Conclusions/Significance These areas seem to be crucial for the inference of intentions in symbolic gestures observed in their natural context and represent an interrelated network formed by components of the putative human neuron mirror system as well as the mentalizing system.
Collapse
Affiliation(s)
- Mirta F Villarreal
- Department of Cognitive Neurology, Institute for Neurological Research-FLENI, Buenos Aires, Argentina.
| | | | | |
Collapse
|
10
|
Abstract
Unilateral spatial neglect is a common neurological syndrome following predominantly right hemisphere injuries and is characterized by both spatial and non-spatial deficits. Core spatial deficits involve mechanisms for saliency coding, spatial attention, and short-term memory and occur in conjunction with nonspatial deficits that involve reorienting, target detection, and arousal/vigilance. We argue that neglect is better explained by the dysfunction of distributed cortical networks for the control of attention than by structural damage of specific brain regions. Ventral lesions in right parietal, temporal, and frontal cortex that cause neglect directly impair nonspatial functions partly mediated by a ventral frontoparietal attention network. Structural damage in ventral cortex also induces physiological abnormalities of task-evoked activity and functional connectivity in a dorsal frontoparietal network that controls spatial attention. The anatomy and right hemisphere dominance of neglect follow from the anatomy and laterality of the ventral regions that interact with the dorsal attention network.
Collapse
Affiliation(s)
- Maurizio Corbetta
- Departments of Neurology, Radiology, and Anatomy and Neurobiology, Washington University School of Medicine, 314-362-4530, 4525 Scott Avenue, St. Louis, MO 63110
| | - Gordon L. Shulman
- Department of Neurology, Washington University School of Medicine, 314-362-8880, 4525 Scott Avenue. St. Louis, MO 63110
| |
Collapse
|
11
|
Kukolja J, Thiel CM, Eggermann T, Zerres K, Fink GR. Medial temporal lobe dysfunction during encoding and retrieval of episodic memory in non-demented APOE epsilon4 carriers. Neuroscience 2010; 168:487-97. [PMID: 20350587 DOI: 10.1016/j.neuroscience.2010.03.044] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2010] [Revised: 02/25/2010] [Accepted: 03/20/2010] [Indexed: 01/05/2023]
Abstract
Presence of the apolipoprotein E (APOE) epsilon4 allele is linked to an increased risk to develop Alzheimer's dementia (AD). However, there are controversial data concerning the impact of the APOE genotype on cognitive functioning and brain activity in healthy subjects. We used event-related functional magnetic resonance imaging (fMRI) to investigate the effects of APOE genotype on spatial contextual memory encoding and retrieval success in healthy older adults. Eighteen subjects (eight APOE4 heterozygotes (epsilon4+) and 10 non-carriers (epsilon4-), mean age 60.0+/-5.0 years) were included in the present analysis. Behaviorally, epsilon4+ subjects performed significantly worse than epsilon4- subjects in item memory and spatial context retrieval. fMRI data revealed that epsilon4+ subjects, compared to epsilon4-subjects, predominantly showed an increase of neural activity specific to encoding of items and their spatial context in prefrontal, temporal and parietal regions. In contrast, epsilon4+ subjects showed activity decreases in the right amygdala during successful item recognition and in the prefrontal cortex bilaterally during spatial context retrieval when compared to epsilon4- subjects. While the activity increases during encoding may reflect compensatory activity in the attempt to maintain normal performance, the decreases during retrieval indicate incipient neural decline in epsilon4+ subjects. These data highlight that preclinical ApoE-related changes in neural activity are not unidirectional but dissociate depending on the memory phase, i.e., encoding or retrieval.
Collapse
Affiliation(s)
- J Kukolja
- Cognitive Neurology Section, Institute of Neuroscience and Medicine (INM-3), Research Centre Jülich, Jülich, Germany.
| | | | | | | | | |
Collapse
|
12
|
Ciçek M, Deouell LY, Knight RT. Brain activity during landmark and line bisection tasks. Front Hum Neurosci 2009; 3:7. [PMID: 19521543 PMCID: PMC2694675 DOI: 10.3389/neuro.09.007.2009] [Citation(s) in RCA: 105] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2008] [Accepted: 04/09/2009] [Indexed: 11/17/2022] Open
Abstract
Neglect patients bisect lines far rightward of center whereas normal subjects typically bisect lines with a slight leftward bias supporting a right hemisphere bias for attention allocation. We used fMRI to assess the brain regions related to this function in normals, using two complementary tasks. In the Landmark task subjects were required to judge whether or not a presented line was bisected correctly. During the line bisection task, subjects moved a cursor and indicated when it reached the center of the line. The conjunction of BOLD activity for both tasks showed right lateralized intra-parietal sulcus and lateral peristriate cortex activity. The results provide evidence that predominantly right hemisphere lateralized processes are engaged in normal subjects during tasks that are failed in patients with unilateral neglect and highlight the importance of a right fronto-parietal network in attention allocation.
Collapse
Affiliation(s)
- Metehan Ciçek
- Department of Physiology, University of Ankara Turkiye.
| | | | | |
Collapse
|
13
|
The egocentric reference for visual exploration and orientation. Brain Cogn 2009; 69:227-35. [DOI: 10.1016/j.bandc.2008.07.011] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2008] [Revised: 07/15/2008] [Accepted: 07/16/2008] [Indexed: 12/21/2022]
|
14
|
The neural substrate of gesture recognition. Neuropsychologia 2008; 46:2371-82. [PMID: 18433807 DOI: 10.1016/j.neuropsychologia.2008.03.004] [Citation(s) in RCA: 92] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2007] [Revised: 03/10/2008] [Accepted: 03/11/2008] [Indexed: 11/22/2022]
|
15
|
The two sides of the mental clock: the Imaginal HemiSpatial Effect in the healthy brain. Brain Cogn 2007; 66:298-305. [PMID: 18006132 DOI: 10.1016/j.bandc.2007.10.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2006] [Revised: 09/05/2007] [Accepted: 10/08/2007] [Indexed: 11/21/2022]
Abstract
When subjects are asked to compare the mental images of two analog clocks telling different times (the mental clock test), they are faster to process angles formed by hands located in the right than in the left half of the dial. In the present paper, we demonstrate that this Imaginal HemiSpatial Effect (IHSE) can be also observed in two modified versions of the mental clock test: in Experiment 1 subjects had to imagine the position occupied by two numbers within a clock face and to judge if the subtended angle was smaller or greater than 90 degrees , while in Experiment 2 subjects were asked to match two imagined positions on a clock face with two visually presented locations. The finding of the IHSE in these tasks suggested that it is a genuine phenomenon related to spatial imagery tasks, and is consistent with recent neuroimaging evidence that the left parietal lobe is mainly involved in the generation of spatial mental images.
Collapse
|