1
|
Schmidt F, Tiedemann H, Fleming RW, Morgenstern Y. Inferring shape transformations in a drawing task. Mem Cognit 2023:10.3758/s13421-023-01452-0. [PMID: 37668880 DOI: 10.3758/s13421-023-01452-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2023] [Indexed: 09/06/2023]
Abstract
Many objects and materials in our environment are subject to transformations that alter their shape. For example, branches bend in the wind, ice melts, and paper crumples. Still, we recognize objects and materials across these changes, suggesting we can distinguish an object's original features from those caused by the transformations ("shape scission"). Yet, if we truly understand transformations, we should not only be able to identify their signatures but also actively apply the transformations to new objects (i.e., through imagination or mental simulation). Here, we investigated this ability using a drawing task. On a tablet computer, participants viewed a sample contour and its transformed version, and were asked to apply the same transformation to a test contour by drawing what the transformed test shape should look like. Thus, they had to (i) infer the transformation from the shape differences, (ii) envisage its application to the test shape, and (iii) draw the result. Our findings show that drawings were more similar to the ground truth transformed test shape than to the original test shape-demonstrating the inference and reproduction of transformations from observation. However, this was only observed for relatively simple shapes. The ability was also modulated by transformation type and magnitude but not by the similarity between sample and test shapes. Together, our findings suggest that we can distinguish between representations of original object shapes and their transformations, and can use visual imagery to mentally apply nonrigid transformations to observed objects, showing how we not only perceive but also 'understand' shape.
Collapse
Affiliation(s)
- Filipp Schmidt
- Department of Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10F, 35394, Giessen, Germany.
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany.
| | - Henning Tiedemann
- Department of Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10F, 35394, Giessen, Germany
| | - Roland W Fleming
- Department of Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10F, 35394, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany
| | - Yaniv Morgenstern
- Department of Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10F, 35394, Giessen, Germany
- University of Leuven (KU Leuven), Leuven, Belgium
| |
Collapse
|
2
|
Preparatory attention to visual features primarily relies on non-sensory representation. Sci Rep 2022; 12:21726. [PMID: 36526653 PMCID: PMC9758135 DOI: 10.1038/s41598-022-26104-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Accepted: 12/09/2022] [Indexed: 12/23/2022] Open
Abstract
Prior knowledge of behaviorally relevant information promotes preparatory attention before the appearance of stimuli. A key question is how our brain represents the attended information during preparation. A sensory template hypothesis assumes that preparatory signals evoke neural activity patterns that resembled the perception of the attended stimuli, whereas a non-sensory, abstract template hypothesis assumes that preparatory signals reflect the abstraction of attended stimuli. To test these hypotheses, we used fMRI and multivariate analysis to characterize neural activity patterns when human participants were prepared to attend a feature and then select it from a compound stimulus. In an fMRI experiment using basic visual feature (motion direction), we observed reliable decoding of the to-be-attended feature from the preparatory activity in both visual and frontoparietal areas. However, while the neural patterns constructed by a single feature from a baseline task generalized to the activity patterns during stimulus selection, they could not generalize to the activity patterns during preparation. Our findings thus suggest that neural signals during attentional preparation are predominantly non-sensory in nature that may reflect an abstraction of the attended feature. Such a representation could provide efficient and stable guidance of attention.
Collapse
|
3
|
Henderson MM, Rademaker RL, Serences JT. Flexible utilization of spatial- and motor-based codes for the storage of visuo-spatial information. eLife 2022; 11:e75688. [PMID: 35522567 PMCID: PMC9075954 DOI: 10.7554/elife.75688] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 04/24/2022] [Indexed: 01/26/2023] Open
Abstract
Working memory provides flexible storage of information in service of upcoming behavioral goals. Some models propose specific fixed loci and mechanisms for the storage of visual information in working memory, such as sustained spiking in parietal and prefrontal cortex during working memory maintenance. An alternative view is that information can be remembered in a flexible format that best suits current behavioral goals. For example, remembered visual information might be stored in sensory areas for easier comparison to future sensory inputs, or might be re-coded into a more abstract action-oriented format and stored in motor areas. Here, we tested this hypothesis using a visuo-spatial working memory task where the required behavioral response was either known or unknown during the memory delay period. Using functional magnetic resonance imaging (fMRI) and multivariate decoding, we found that there was less information about remembered spatial position in early visual and parietal regions when the required response was known versus unknown. Furthermore, a representation of the planned motor action emerged in primary somatosensory, primary motor, and premotor cortex during the same task condition where spatial information was reduced in early visual cortex. These results suggest that the neural networks supporting working memory can be strategically reconfigured depending on specific behavioral requirements during a canonical visual working memory paradigm.
Collapse
Affiliation(s)
- Margaret M Henderson
- Neurosciences Graduate Program, University of California, San DiegoSan DiegoUnited States
- Department of Machine Learning, Carnegie Mellon UniversityPittsburghUnited States
- Neuroscience Institute, Carnegie Mellon UniversityPittsburghUnited States
| | - Rosanne L Rademaker
- Department of Psychology, University of California, San DiegoSan DiegoUnited States
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
| | - John T Serences
- Neurosciences Graduate Program, University of California, San DiegoSan DiegoUnited States
- Department of Psychology, University of California, San DiegoSan DiegoUnited States
- Kavli Foundation for the Brain and Mind, University of California, San DiegoSan DiegoUnited States
| |
Collapse
|
4
|
Vo VA, Sutterer DW, Foster JJ, Sprague TC, Awh E, Serences JT. Shared Representational Formats for Information Maintained in Working Memory and Information Retrieved from Long-Term Memory. Cereb Cortex 2021; 32:1077-1092. [PMID: 34428283 DOI: 10.1093/cercor/bhab267] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 06/08/2021] [Accepted: 07/13/2021] [Indexed: 11/13/2022] Open
Abstract
Current theories propose that the short-term retention of information in working memory (WM) and the recall of information from long-term memory (LTM) are supported by overlapping neural mechanisms in occipital and parietal cortex. However, the extent of the shared representations between WM and LTM is unclear. We designed a spatial memory task that allowed us to directly compare the representations of remembered spatial information in WM and LTM with carefully matched behavioral response precision between tasks. Using multivariate pattern analyses on functional magnetic resonance imaging data, we show that visual memories were represented in a sensory-like code in both memory tasks across retinotopic regions in occipital and parietal cortex. Regions in lateral parietal cortex also encoded remembered locations in both tasks, but in a format that differed from sensory-evoked activity. These results suggest a striking correspondence in the format of representations maintained in WM and retrieved from LTM across occipital and parietal cortex. On the other hand, we also show that activity patterns in nearly all parietal regions, but not occipital regions, contained information that could discriminate between WM and LTM trials. Our data provide new evidence for theories of memory systems and the representation of mnemonic content.
Collapse
Affiliation(s)
- Vy A Vo
- Brain-Inspired Computing, Emerging Technologies Research, Intel Labs, Hillsboro, OR 97124, USA.,Neurosciences Graduate Program, University of California San Diego, La Jolla, CA 92093, USA.,Department of Psychology, University of California San Diego, La Jolla, CA 92093, USA
| | - David W Sutterer
- Department of Psychological Sciences, Vanderbilt University, Nashville, TN 37235, USA
| | - Joshua J Foster
- Department of Psychological and Brain Sciences, Boston University, Boston, MA 02215, USA.,Center for Systems Neuroscience, Boston University, Boston, MA, USA
| | - Thomas C Sprague
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA
| | - Edward Awh
- Department of Psychology, The University of Chicago, Chicago, IL 60637, USA.,Institute for Mind and Biology, The University of Chicago, Chicago, IL 60637, USA
| | - John T Serences
- Neurosciences Graduate Program, University of California San Diego, La Jolla, CA 92093, USA.,Department of Psychology, University of California San Diego, La Jolla, CA 92093, USA.,Kavli Foundation for the Brain and Mind, University of California San Diego, La Jolla, CA 92093, USA
| |
Collapse
|
5
|
Bedini M, Baldauf D. Structure, function and connectivity fingerprints of the frontal eye field versus the inferior frontal junction: A comprehensive comparison. Eur J Neurosci 2021; 54:5462-5506. [PMID: 34273134 PMCID: PMC9291791 DOI: 10.1111/ejn.15393] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 06/16/2021] [Accepted: 07/02/2021] [Indexed: 02/01/2023]
Abstract
The human prefrontal cortex contains two prominent areas, the frontal eye field and the inferior frontal junction, that are crucially involved in the orchestrating functions of attention, working memory and cognitive control. Motivated by comparative evidence in non-human primates, we review the human neuroimaging literature, suggesting that the functions of these regions can be clearly dissociated. We found remarkable differences in how these regions relate to sensory domains and visual topography, top-down and bottom-up spatial attention, spatial versus non-spatial (i.e., feature- and object-based) attention and working memory and, finally, the multiple-demand system. Functional magnetic resonance imaging (fMRI) studies using multivariate pattern analysis reveal the selectivity of the frontal eye field and inferior frontal junction to spatial and non-spatial information, respectively. The analysis of functional and effective connectivity provides evidence of the modulation of the activity in downstream visual areas from the frontal eye field and inferior frontal junction and sheds light on their reciprocal influences. We therefore suggest that future studies should aim at disentangling more explicitly the role of these regions in the control of spatial and non-spatial selection. We propose that the analysis of the structural and functional connectivity (i.e., the connectivity fingerprints) of the frontal eye field and inferior frontal junction may be used to further characterize their involvement in a spatial ('where') and a non-spatial ('what') network, respectively, highlighting segregated brain networks that allow biasing visual selection and working memory performance to support goal-driven behaviour.
Collapse
Affiliation(s)
- Marco Bedini
- Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| | - Daniel Baldauf
- Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| |
Collapse
|
6
|
Matheson HE, Garcea FE, Buxbaum LJ. Scene context shapes category representational geometry during processing of tools. Cortex 2021; 141:1-15. [PMID: 34020166 DOI: 10.1016/j.cortex.2021.03.021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 02/05/2021] [Accepted: 03/12/2021] [Indexed: 10/21/2022]
Abstract
Tools are ubiquitous in human environments and to think about them we use concepts. Increasingly, conceptual representation is thought to be dynamic and sensitive to the goals of the observer. Indeed, observer goals can reshape representational geometry within cortical networks supporting concepts. In the present study, we investigated the novel hypothesis that task-irrelevant scene context may implicitly alter the representational geometry of regions within the tool network. Participants performed conceptual judgments on images of tools embedded in scenes that either suggested their use (i.e., a kitchen timer sitting on a kitchen counter with vegetables in a frying pan) or that they would simply be moved (i.e., a kitchen timer sitting in an open drawer with other miscellaneous kitchen items around). We investigated whether representations in the tool network reflect category, grip, and shape information using a representational similarity analysis (RSA). We show that a) a number of regions of the tool network reflect category information about tools and b) category information predicts patterns in supramarginal gyrus more strongly in use contexts than in move contexts. Together, these results show that information about tool category is distributed across different regions of the tool network and that scene context helps shape the representational geometry of the tool network.
Collapse
Affiliation(s)
- Heath E Matheson
- University of Northern British Columbia, Prince George, BC, Canada.
| | - Frank E Garcea
- Moss Rehabilitation Research Institute, Elkins Park, PA, USA; Department of Neurosurgery, University of Rochester Medical Center, New York, USA
| | | |
Collapse
|
7
|
Perceptual Learning beyond Perception: Mnemonic Representation in Early Visual Cortex and Intraparietal Sulcus. J Neurosci 2021; 41:4476-4486. [PMID: 33811151 DOI: 10.1523/jneurosci.2780-20.2021] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Revised: 03/22/2021] [Accepted: 03/24/2021] [Indexed: 01/08/2023] Open
Abstract
The ability to discriminate between stimuli relies on a chain of neural operations associated with perception, memory and decision-making. Accumulating studies show learning-dependent plasticity in perception or decision-making, yet whether perceptual learning modifies mnemonic processing remains unclear. Here, we trained human participants of both sexes in an orientation discrimination task, while using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) to separately examine training-induced changes in working memory (WM) representation. fMRI decoding revealed orientation-specific neural patterns during the delay period in primary visual cortex (V1) before, but not after, training, whereas neurodisruption of V1 during the delay period led to behavioral deficits in both phases. In contrast, both fMRI decoding and disruptive effect of TMS showed that intraparietal sulcus (IPS) represented WM content after, but not before, training. These results suggest that training does not affect the necessity of sensory area in representing WM information, consistent with the sensory recruitment hypothesis in WM, but likely alters the coding format of the stored stimulus in this region. On the other hand, training can render WM content to be maintained in higher-order parietal areas, complementing sensory area to support more robust maintenance of information.SIGNIFICANCE STATEMENT There has been accumulating progresses regarding experience-dependent plasticity in perception or decision-making, yet how perceptual experience moulds mnemonic processing of visual information remains less explored. Here, we provide novel findings that learning-dependent improvement of discriminability accompanies altered WM representation at different cortical levels. Critically, we suggest a role of training in modulating cortical locus of WM representation, providing a plausible explanation to reconcile the discrepant findings between human and animal studies regarding the recruitment of sensory or higher-order areas in WM.
Collapse
|
8
|
Valenzano A, Scarinci A, Monda V, Sessa F, Messina A, Monda M, Precenzano F, Mollica MP, Carotenuto M, Messina G, Cibelli G. The Social Brain and Emotional Contagion: COVID-19 Effects. MEDICINA (KAUNAS, LITHUANIA) 2020; 56:E640. [PMID: 33255569 PMCID: PMC7760735 DOI: 10.3390/medicina56120640] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Revised: 11/19/2020] [Accepted: 11/22/2020] [Indexed: 02/06/2023]
Abstract
BACKGROUND AND OBJECTIVES Coronavirus disease 2019 (COVID-19) is a highly contagious infectious disease, responsible for a global pandemic that began in January 2020. Human/COVID-19 interactions cause different outcomes ranging from minor health consequences to death. Since social interaction is the default mode by which individuals communicate with their surroundings, different modes of contagion can play a role in determining the long-term consequences for mental health and emotional well-being. We examined some basic aspects of human social interaction, emphasizing some particular features of the emotional contagion. Moreover, we analyzed the main report that described brain damage related to the COVID-19 infection. Indeed, the goal of this review is to suggest a possible explanation for the relationships among emotionally impaired people, brain damage, and COVID-19 infection. RESULTS COVID-19 can cause several significant neurological disorders and the pandemic has been linked to a rise in people reporting mental health problems, such as depression and anxiety. Neurocognitive symptoms associated with COVID-19 include delirium, both acute and chronic attention and memory impairment related to hippocampal and cortical damage, as well as learning deficits in both adults and children. CONCLUSIONS Although our knowledge on the biology and long-term clinical outcomes of the COVID-19 infection is largely limited, approaching the pandemic based on lessons learnt from previous outbreaks of infectious diseases and the biology of other coronaviruses will provide a suitable pathway for developing public mental health strategies, which could be positively translated into therapeutic approaches, attempting to improve stress coping responses, thus contributing to alleviate the burden driven by the pandemic.
Collapse
Affiliation(s)
- Anna Valenzano
- Department of Clinical and Experimental Medicine, University of Foggia, 71122 Foggia, Italy; (A.V.); (F.S.); (G.C.)
| | - Alessia Scarinci
- Department of Education Sciences, Psychology, and Communication, University of Bari, 70121 Bari, Italy;
| | - Vincenzo Monda
- Department of Experimental Medicine, Section of Human Physiology and Unit of Dietetics and Sports Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80100 Naples, Italy; (V.M.); (A.M.); (M.M.)
| | - Francesco Sessa
- Department of Clinical and Experimental Medicine, University of Foggia, 71122 Foggia, Italy; (A.V.); (F.S.); (G.C.)
| | - Antonietta Messina
- Department of Experimental Medicine, Section of Human Physiology and Unit of Dietetics and Sports Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80100 Naples, Italy; (V.M.); (A.M.); (M.M.)
| | - Marcellino Monda
- Department of Experimental Medicine, Section of Human Physiology and Unit of Dietetics and Sports Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80100 Naples, Italy; (V.M.); (A.M.); (M.M.)
| | - Francesco Precenzano
- Clinic of Child and Adolescent Neuropsychiatry, Department of Mental Health, Physical and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80100 Naples, Italy; (F.P.); (M.C.)
| | - Maria Pina Mollica
- Department of Clinical and Experimental Medicine, University of Naples, 80138 Naples, Italy;
| | - Marco Carotenuto
- Clinic of Child and Adolescent Neuropsychiatry, Department of Mental Health, Physical and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80100 Naples, Italy; (F.P.); (M.C.)
| | - Giovanni Messina
- Department of Clinical and Experimental Medicine, University of Foggia, 71122 Foggia, Italy; (A.V.); (F.S.); (G.C.)
| | - Giuseppe Cibelli
- Department of Clinical and Experimental Medicine, University of Foggia, 71122 Foggia, Italy; (A.V.); (F.S.); (G.C.)
| |
Collapse
|
9
|
Wu MH, Kleinschmidt D, Emberson L, Doko D, Edelman S, Jacobs R, Raizada R. Cortical Transformation of Stimulus Space in Order to Linearize a Linearly Inseparable Task. J Cogn Neurosci 2020; 32:2342-2355. [PMID: 31951157 DOI: 10.1162/jocn_a_01533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The human brain is able to learn difficult categorization tasks, even ones that have linearly inseparable boundaries; however, it is currently unknown how it achieves this computational feat. We investigated this by training participants on an animal categorization task with a linearly inseparable prototype structure in a morph shape space. Participants underwent fMRI scans before and after 4 days of behavioral training. Widespread representational changes were found throughout the brain, including an untangling of the categories' neural patterns that made them more linearly separable after behavioral training. These neural changes were task dependent, as they were only observed while participants were performing the categorization task, not during passive viewing. Moreover, they were found to occur in frontal and parietal areas, rather than ventral temporal cortices, suggesting that they reflected attentional and decisional reweighting, rather than changes in object recognition templates. These results illustrate how the brain can flexibly transform neural representational space to solve computationally challenging tasks.
Collapse
|