1
|
Borra D, Bossi F, Rivolta D, Magosso E. Deep learning applied to EEG source-data reveals both ventral and dorsal visual stream involvement in holistic processing of social stimuli. Sci Rep 2023; 13:7365. [PMID: 37147445 PMCID: PMC10162973 DOI: 10.1038/s41598-023-34487-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 05/02/2023] [Indexed: 05/07/2023] Open
Abstract
Perception of social stimuli (faces and bodies) relies on "holistic" (i.e., global) mechanisms, as supported by picture-plane inversion: perceiving inverted faces/bodies is harder than perceiving their upright counterpart. Albeit neuroimaging evidence suggested involvement of face-specific brain areas in holistic processing, their spatiotemporal dynamics and selectivity for social stimuli is still debated. Here, we investigate the spatiotemporal dynamics of holistic processing for faces, bodies and houses (adopted as control non-social category), by applying deep learning to high-density electroencephalographic signals (EEG) at source-level. Convolutional neural networks were trained to classify cortical EEG responses to stimulus orientation (upright/inverted), separately for each stimulus type (faces, bodies, houses), resulting to perform well above chance for faces and bodies, and close to chance for houses. By explaining network decision, the 150-200 ms time interval and few visual ventral-stream regions were identified as mostly relevant for discriminating face and body orientation (lateral occipital cortex, and for face only, precuneus cortex, fusiform and lingual gyri), together with two additional dorsal-stream areas (superior and inferior parietal cortices). Overall, the proposed approach is sensitive in detecting cortical activity underlying perceptual phenomena, and by maximally exploiting discriminant information contained in data, may reveal spatiotemporal features previously undisclosed, stimulating novel investigations.
Collapse
Affiliation(s)
- Davide Borra
- Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi" (DEI), University of Bologna, Cesena Campus, Cesena, Italy
| | - Francesco Bossi
- MoMiLab Research Unit, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Davide Rivolta
- Department of Education, Psychology, and Communication, University of Bari Aldo Moro, Bari, Italy
| | - Elisa Magosso
- Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi" (DEI), University of Bologna, Cesena Campus, Cesena, Italy.
- Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna, Italy.
| |
Collapse
|
2
|
Cattarinussi G, Bellani M, Maggioni E, Sambataro F, Brambilla P, Delvecchio G. Resting-state functional connectivity and spontaneous brain activity in early-onset bipolar disorder: A review of functional Magnetic Resonance Imaging studies. J Affect Disord 2022; 311:463-471. [PMID: 35580695 DOI: 10.1016/j.jad.2022.05.055] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 05/04/2022] [Accepted: 05/10/2022] [Indexed: 10/18/2022]
Abstract
BACKGROUND Early-onset bipolar disorder (BD) is a complex psychiatric illness characterized by mood swings, irritability and functional impairments. To improve our understanding of the pathophysiology of the disorder, we collected the existing resting-state functional Magnetic Resonance Imaging (rs-fMRI) studies exploring resting-state functional connectivity (rs-FC) and spontaneous activity alterations in children and adolescents with BD. METHODS A search on PubMed, Web of Science and Scopus was conducted to identify all the relevant rs-fMRI investigations conducted in early-onset BD. A total of 14 studies employing different methodological approaches to explore rs-FC and spontaneous activity in early-onset BD were included (independent component analysis, n = 1; seed-based analysis, n = 7; amplitude of low frequency fluctuations analysis, n = 2; regional homogeneity analysis, n = 4). RESULTS Overall, the studies showed abnormalities within the Default Mode Network (DMN) and between the DMN and the Salience Network (SN). Moreover, widespread alterations in rs-FC and spontaneous brain activity within and between cortico-limbic structures, involving primarily the occipital and frontal lobes, amygdala, hippocampus, insula, thalamus and striatum were also reported. LIMITATIONS The small sample sizes, the use of medications, the presence of comorbidities and the heterogeneity in methods hamper the integration of the study findings. CONCLUSIONS Early-onset BD seems to be characterized by selective rs-FC and spontaneous activity dysfunctions in DMN and SN as well as in the cortico-limbic and cortico-striatal circuits, which could explain the emotive and cognitive deficits observed in this disabling psychiatric illness.
Collapse
Affiliation(s)
- Giulia Cattarinussi
- Department of Neuroscience (DNS), University of Padova, Padua, Italy; Padua Neuroscience Center, University of Padova, Padua, Italy
| | - Marcella Bellani
- Section of Psychiatry, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | - Eleonora Maggioni
- Department of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy; Department of Electronics Information and Bioengineering, Politecnico di Milano, Milano, Italy
| | - Fabio Sambataro
- Department of Neuroscience (DNS), University of Padova, Padua, Italy; Padua Neuroscience Center, University of Padova, Padua, Italy
| | - Paolo Brambilla
- Department of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy; Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
| | - Giuseppe Delvecchio
- Department of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy.
| |
Collapse
|
3
|
Machizawa MG, Driver J, Watanabe T. Gray Matter Volume in Different Cortical Structures Dissociably Relates to Individual Differences in Capacity and Precision of Visual Working Memory. Cereb Cortex 2020; 30:4759-4770. [PMID: 32396203 DOI: 10.1093/cercor/bhaa046] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
Visual working memory (VWM) refers to our ability to selectively maintain visual information in a mental representation. While cognitive limits of VWM greatly influence a variety of mental operations, it remains controversial whether the quantity or quality of representations in mind constrains VWM. Here, we examined behavior-to-brain anatomical relations as well as brain activity to brain anatomy associations with a "neural" marker specific to the retention interval of VWM. Our results consistently indicated that individuals who maintained a larger number of items in VWM tended to have a larger gray matter (GM) volume in their left lateral occipital region. In contrast, individuals with a superior ability to retain with high precision tended to have a larger GM volume in their right parietal lobe. These results indicate that individual differences in quantity and quality of VWM may be associated with regional GM volumes in a dissociable manner, indicating willful integration of information in VWM may recruit separable cortical subsystems.
Collapse
Affiliation(s)
- Maro G Machizawa
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, 734-8551 Japan.,Institute of Cognitive Neuroscience and Institute of Neurology, University College London WC1N 3AZ, London, UK.,Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI 02912, USA
| | - Jon Driver
- Institute of Cognitive Neuroscience and Institute of Neurology, University College London WC1N 3AZ, London, UK.,Wellcome Trust Center for Neuroimaging, University College London WC1N 3BG, London, UK
| | - Takeo Watanabe
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI 02912, USA
| |
Collapse
|
4
|
Reorganization of spatial configurations in visual working memory: A matter of set size? PLoS One 2019; 14:e0225068. [PMID: 31721792 PMCID: PMC6853316 DOI: 10.1371/journal.pone.0225068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Accepted: 10/28/2019] [Indexed: 11/19/2022] Open
Abstract
Humans process single objects in relation to other simultaneously maintained objects in visual working memory. This interdependence is called spatial configuration. Humans are able to reorganize global spatial configurations into relevant partial configurations. We conducted three experiments investigating the process underlying reorganization by manipulating memory set size and the presence of configurations at retrieval. Participants performed a location change detection task for a single object probed at retrieval. At the beginning of each trial, participants memorized the locations of all objects (set size: 4, 8, 12, or 16). During maintenance, a valid retro cue highlighted the side containing the object probed at retrieval, thus enabling participants to reorganize the memorized global spatial configuration to the partial cued configuration. At retrieval, the object probed was shown together with either all objects (complete configuration; Experiment 1a), the cued objects only (congruent configuration; all Experiments), the non-cued objects only (incongruent configuration, all Experiments) or alone (no configuration; Experiment 1b). We observed reorganization of spatial configurations as indicated by a superior location change detection performance with a congruent partial configuration than an incongruent partial configuration across all three experiments. We also observed an overall decrease in accuracy with increasing set size. Most importantly, however, we did not find evidence for a reliable impairment of reorganization with increasing set size. We discuss these findings with regard to the memory representation underlying spatial configurations.
Collapse
|
5
|
Woytowicz EJ, Sours C, Gullapalli RP, Rosenberg J, Westlake KP. Modulation of working memory load distinguishes individuals with and without balance impairments following mild traumatic brain injury. Brain Inj 2017; 32:191-199. [PMID: 29182372 DOI: 10.1080/02699052.2017.1403045] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
OBJECTIVES Balance and gait deficits can persist after mild traumatic brain injury (TBI), yet an understanding of the underlying neural mechanism remains limited. The purpose of this study was to investigate differences in attention network modulation in patients with and without balance impairments 2-8 weeks following mild TBI. METHODS Using functional magnetic resonance imaging, we compared activity and functional connectivity of cognitive brain regions of the default mode, central-executive and salience networks during a 2-back working memory task in participants with mild TBI and balance impairments (n = 7, age 47 ± 15 years) or no balance impairments (n = 7, age 47 ± 15 years). RESULTS We first identified greater activation in the lateral occipital cortex in the balance impaired group. Second, we observed stronger connectivity of left pre-supplementary motor cortex in the balance impaired group during the working memory task, which was related to decreased activation of regions within the salience and central executive networks and greater suppression of the default mode network. CONCLUSIONS Results suggest a link between impaired balance and modulation of cognitive resources in patients in mTBI. Findings also highlight the potential importance of moving beyond traditional balance assessments towards an integrative assessment of cognition and balance in this population.
Collapse
Affiliation(s)
- Elizabeth J Woytowicz
- a Department of Physical Therapy and Rehabilitation Science , University of Maryland School of Medicine , Baltimore , MD , USA
| | - Chandler Sours
- b Department of Diagnostic Radiology & Nuclear Medicine , University of Maryland School of Medicine , Baltimore , MD , USA
| | - Rao P Gullapalli
- b Department of Diagnostic Radiology & Nuclear Medicine , University of Maryland School of Medicine , Baltimore , MD , USA
| | - Joseph Rosenberg
- a Department of Physical Therapy and Rehabilitation Science , University of Maryland School of Medicine , Baltimore , MD , USA
| | - Kelly P Westlake
- a Department of Physical Therapy and Rehabilitation Science , University of Maryland School of Medicine , Baltimore , MD , USA
| |
Collapse
|
6
|
Task Encoding across the Multiple Demand Cortex Is Consistent with a Frontoparietal and Cingulo-Opercular Dual Networks Distinction. J Neurosci 2016; 36:6147-55. [PMID: 27277793 PMCID: PMC4899522 DOI: 10.1523/jneurosci.4590-15.2016] [Citation(s) in RCA: 79] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2015] [Accepted: 04/04/2016] [Indexed: 02/02/2023] Open
Abstract
UNLABELLED Multiple-demand (MD) regions of the human brain show coactivation during many different kinds of task performance. Previous work based on resting-state functional magnetic resonance imaging (fMRI) has shown that MD regions may be divided into two closely coupled subnetworks centered around the lateral frontoparietal (FP) and cingulo-opercular cortex. Here, we used on-task fMRI to test whether this division is apparent during the performance of an executive task. Furthermore, we investigated whether there is a difference in the encoding of task between the two subnetworks. Using connectivity methods, we found that activity across the entire MD cortex is correlated during task performance. Meanwhile, however, there was significantly stronger connectivity within each of the subnetworks than between them. Using multivoxel pattern analysis, we also found that, although we were able to decode task-relevant information from all regions of the MD cortex, classification accuracy scores were significantly higher in the FP subnetwork. These results suggest a nested picture with MD regions as a whole showing coactivation and broad rule representation, but with significant functional distinctions between component subnetworks. SIGNIFICANCE STATEMENT Multiple-demand (MD) regions of frontal and parietal cortex appear essential for the orchestration of goal-directed behavior and problem solving. Understanding the relative specialization of regions within the MD cortex is crucial to understanding how we can coordinate and execute complex action plans. By examining functional connectivity during task performance, we extend previous findings suggesting that the MD cortex can be divided into two subnetworks centered around the frontoparietal (FP) and cingulo-opercular (CO) cortex. Furthermore, using multivoxel pattern analysis, we show that, compared with the CO subnetwork, the FP subnetwork manifests more differentiated coding of specific task events.
Collapse
|
7
|
Dissociable cortical pathways for qualitative and quantitative mechanisms in the face inversion effect. J Neurosci 2015; 35:4268-79. [PMID: 25762673 DOI: 10.1523/jneurosci.3960-14.2015] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Humans' ability to recognize objects is remarkably robust across a variety of views unless faces are presented upside-down. Whether this face inversion effect (FIE) results from qualitative (distinct mechanisms) or quantitative processing differences (a matter of degree within common mechanisms) between upright and inverted faces has been intensely debated. Studies have focused on preferential responses to faces in face-specific brain areas, although face recognition also involves nonpreferential responses in non-face-specific brain areas. By using dynamic causal modeling with Bayesian model selection, here we show that dissociable cortical pathways are responsible for qualitative and quantitative mechanisms in the FIE in the distributed network for face recognition. When faces were upright, the early visual cortex (VC) and occipital and fusiform face areas (OFA, FFA) suppressed couplings to the lateral occipital cortex (LO), a primary locus of object processing. In contrast, they did not inhibit the LO when faces were inverted but increased couplings to the intraparietal sulcus, which has been associated with visual working memory. Furthermore, we found that upright and inverted face processing together involved the face network consisting of the VC, OFA, FFA, and inferior frontal gyrus. Specifically, modulatory connectivity within the common pathways (VC-OFA), implicated in the parts-based processing of faces, strongly correlated with behavioral FIE performance. The orientation-dependent dynamic reorganization of effective connectivity indicates that the FIE is mediated by both qualitative and quantitative differences in upright and inverted face processing, helping to resolve a central debate over the mechanisms of the FIE.
Collapse
|
8
|
Matsuyoshi D, Osaka M, Osaka N. Age and individual differences in visual working memory deficit induced by overload. Front Psychol 2014; 5:384. [PMID: 24847293 PMCID: PMC4019885 DOI: 10.3389/fpsyg.2014.00384] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2013] [Accepted: 04/11/2014] [Indexed: 11/23/2022] Open
Abstract
Many studies on working memory have assumed that one can determine an individual's fixed memory capacity. In the current study, we took an individual differences approach to investigate whether visual working memory (VWM) capacity was stable irrespective of the number of to-be-remembered objects and participant age. Younger and older adults performed a change detection task using several objects defined by color. Results showed wide variability in VWM capacity across memory set sizes, age, and individuals. A marked decrease in the number of objects held in VWM was observed in both younger and older adults with low memory capacity, but not among high-capacity individuals, when set size went well beyond the limits of VWM capacity. In addition, a decrease in the number of objects held in VWM was alleviated among low-capacity younger adults by increasing VWM encoding time; however, increasing encoding time did not benefit low-capacity older adults. These findings suggest that low-capacity individuals are likely to show decreases in VWM capacity induced by overload, and aging exacerbates this deficit such that it cannot be recovered by simply increasing encoding time. Overall, our findings challenge the prevailing assumption that VWM capacity is fixed and stable, encouraging a revision to the strict view that VWM capacity is constrained by a fixed number of distinct “slots” in which high-resolution object representations are stored.
Collapse
Affiliation(s)
- Daisuke Matsuyoshi
- Department of Psychology, Graduate School of Letters, Kyoto University Sakyo, Japan ; Department of Integrative Physiology, National Institute for Physiological Sciences Okazaki, Japan ; Department of Psychology, Graduate School of Human Sciences, Osaka University Suita, Japan ; Research Center for Advanced Science and Technology, The University of Tokyo Komaba, Japan
| | - Mariko Osaka
- Department of Psychology, Graduate School of Human Sciences, Osaka University Suita, Japan
| | - Naoyuki Osaka
- Department of Psychology, Graduate School of Letters, Kyoto University Sakyo, Japan
| |
Collapse
|