1
|
Lewis N, Miller R, Gazula H, Calhoun V. Fine temporal brain network structure modularizes and localizes differently in men and women: insights from a novel explainability framework. Cereb Cortex 2023; 33:5817-5828. [PMID: 36843049 PMCID: PMC10183744 DOI: 10.1093/cercor/bhac462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 10/05/2022] [Accepted: 10/06/2022] [Indexed: 02/28/2023] Open
Abstract
Deep learning has become an effective tool for classifying biological sex based on functional magnetic resonance imaging (fMRI). However, research on what features within the brain are most relevant to this classification is still lacking. Model interpretability has become a powerful way to understand "black box" deep-learning models, and select features within the input data that are most relevant to the correct classification. However, very little work has been done employing these methods to understand the relationship between the temporal dimension of functional imaging signals and the classification of biological sex. Consequently, less attention has been paid to rectifying problems and limitations associated with feature explanation models, e.g. underspecification and instability. In this work, we first provide a methodology to limit the impact of underspecification on the stability of the measured feature importance. Then, using intrinsic connectivity networks from fMRI data, we provide a deep exploration of sex differences among functional brain networks. We report numerous conclusions, including activity differences in the visual and cognitive domains and major connectivity differences.
Collapse
Affiliation(s)
- Noah Lewis
- Computational Science and Engineering, Georgia Institute of Technology, North Ave, 30332, GA, United States
| | - Robyn Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), 55 Park Pl NE, 30303, GA, United States
- Georgia State University, 33 Gilmer St SE, 30303, GA, United States
| | - Harshvardhan Gazula
- Athinoula A. Martinos Center for Biomedical Imaging, 149 13th Street, 02129, MA, United States
- Harvard Medical School, 25 Shattuck St, 02115, MA, United States
| | - Vince Calhoun
- Computational Science and Engineering, Georgia Institute of Technology, North Ave, 30332, GA, United States
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), 55 Park Pl NE, 30303, GA, United States
- Georgia State University, 33 Gilmer St SE, 30303, GA, United States
| |
Collapse
|
5
|
Zhang Y, Luo Q, Huang CC, Lo CYZ, Langley C, Desrivières S, Quinlan EB, Banaschewski T, Millenet S, Bokde ALW, Flor H, Garavan H, Gowland P, Heinz A, Ittermann B, Martinot JL, Artiges E, Paillère-Martinot ML, Nees F, Orfanos DP, Poustka L, Fröhner JH, Smolka MN, Walter H, Whelan R, Tsai SJ, Lin CP, Bullmore E, Schumann G, Sahakian BJ, Feng J. The Human Brain Is Best Described as Being on a Female/Male Continuum: Evidence from a Neuroimaging Connectivity Study. Cereb Cortex 2021; 31:3021-3033. [PMID: 33471126 PMCID: PMC8107794 DOI: 10.1093/cercor/bhaa408] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2020] [Revised: 11/17/2020] [Accepted: 12/25/2020] [Indexed: 12/30/2022] Open
Abstract
Psychological androgyny has long been associated with greater cognitive flexibility, adaptive behavior, and better mental health, but whether a similar concept can be defined using neural features remains unknown. Using the neuroimaging data from 9620 participants, we found that global functional connectivity was stronger in the male brain before middle age but became weaker after that, when compared with the female brain, after systematic testing of potentially confounding effects. We defined a brain gender continuum by estimating the likelihood of an observed functional connectivity matrix to represent a male brain. We found that participants mapped at the center of this continuum had fewer internalizing symptoms compared with those at the 2 extreme ends. These findings suggest a novel hypothesis proposing that there exists a neuroimaging concept of androgyny using the brain gender continuum, which may be associated with better mental health in a similar way to psychological androgyny.
Collapse
Affiliation(s)
- Yi Zhang
- Shanghai Centre for Mathematical Sciences, Fudan University, Shanghai, 200433, China.,Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China.,Department of Psychiatry, University of Cambridge, Cambridge, CB2 0SZ, UK
| | - Qiang Luo
- Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China.,State Key Laboratory of Medical Neurobiology and Ministry of Education Frontiers Center for Brain Science, Institutes of Brain Science and National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, 200433, China
| | - Chu-Chung Huang
- Institute of Cognitive Neuroscience, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
| | - Chun-Yi Zac Lo
- Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China
| | - Christelle Langley
- Department of Psychiatry, University of Cambridge, Cambridge, CB2 0SZ, UK.,Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, UK
| | - Sylvane Desrivières
- Medical Research Council-Social, Genetic, and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology, and Neuroscience, King's College London, London, SE5 8AF, UK
| | - Erin Burke Quinlan
- Medical Research Council-Social, Genetic, and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology, and Neuroscience, King's College London, London, SE5 8AF, UK
| | - Tobias Banaschewski
- Department of Child and Adolescent Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, 69117, Germany
| | - Sabina Millenet
- Department of Child and Adolescent Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, 69117, Germany
| | - Arun L W Bokde
- Discipline of Psychiatry, School of Medicine and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, D02 PN40, Ireland
| | - Herta Flor
- Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Manheim, 69117, Germany.,Department of Psychology, School of Social Sciences, University of Mannheim, Mannheim, 68131, Germany
| | - Hugh Garavan
- Departments of Psychiatry and Psychology, University of Vermont, Burlington, VT 05405, USA
| | - Penny Gowland
- Sir Peter Mansfield Imaging Centre School of Physics and Astronomy, University of Nottingham, University Park, Nottingham, NG7 2RD, UK
| | - Andreas Heinz
- Department of Psychiatry and Psychotherapy, Campus Charité Mitte, Charité, Universitätsmedizin Berlin, Berlin, 10117, Germany
| | - Bernd Ittermann
- Physikalisch-Technische Bundesanstalt (PTB), Abbestraße 2, 10587 Berlin, Germany
| | - Jean-Luc Martinot
- Institut National de la Santé et de la Recherche Médicale, INSERM U1299 ``Developmental trajectories & psychiatry''; Université Paris-Saclay, Ecole Normale supérieure Paris-Saclay, CNRS, Centre Borelli; 91190 Gif-sur-Yvette, France.,Etablissement Public de Santé (EPS) Barthélemy Durand, 91700 Sainte-Geneviève-des-Bois, France
| | - Eric Artiges
- Institut National de la Santé et de la Recherche Médicale, INSERM U1299 ``Developmental trajectories & psychiatry''; Université Paris-Saclay, Ecole Normale supérieure Paris-Saclay, CNRS, Centre Borelli; 91190 Gif-sur-Yvette, France.,Etablissement Public de Santé (EPS) Barthélemy Durand, 91700 Sainte-Geneviève-des-Bois, France
| | - Marie-Laure Paillère-Martinot
- Institut National de la Santé et de la Recherche Médicale, INSERM U1299 ``Developmental trajectories & psychiatry''; Université Paris-Saclay, Ecole Normale supérieure Paris-Saclay, CNRS, Centre Borelli; 91190 Gif-sur-Yvette, France.,Assistance Publique-Hêpitaux de Paris, Department of Child and Adolescent Psychiatry, Pitié-Salpêtrière Hospital, Paris, 75006, France
| | - Frauke Nees
- Discipline of Psychiatry, School of Medicine and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, D02 PN40, Ireland.,Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Manheim, 69117, Germany.,Institute of Medical Psychology and Medical Sociology, University Medical Center Schleswig Holstein, Kiel University, Kiel, 24118, Germany
| | - Dimitri Papadopoulos Orfanos
- Department of Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, 37075, Germany
| | - Luise Poustka
- Clinic for Child and Adolescent Psychiatry, Medical University of Vienna, Vienna, 1090 Wien, Austria.,Department of Psychiatry and Neuroimaging Center, Technische Universität Dresden, Dresden, 01087, Germany
| | - Juliane H Fröhner
- School of Psychology and Global Brain Health Institute, Trinity College Dublin, Dublin, D02 PN40, Ireland
| | - Michael N Smolka
- Department of Psychiatry, Taipei Veterans General Hospital, Taipei, 11217, Taiwan
| | - Henrik Walter
- Department of Psychiatry and Psychotherapy, Campus Charité Mitte, Charité, Universitätsmedizin Berlin, Berlin, 10117, Germany
| | - Robert Whelan
- School of Psychology and Global Brain Health Institute, Trinity College Dublin, Dublin, D02 PN40, Ireland
| | - Shih-Jen Tsai
- Department of Psychiatry, Taipei Veterans General Hospital, Taipei, 11217, Taiwan.,School of Medicine, National Yang-Ming University, Taipei, 11221, Taiwan
| | - Ching-Po Lin
- Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China.,Institute of Neuroscience, National Yang-Ming University, Taipei, 11221, Taiwan
| | - Ed Bullmore
- Department of Psychiatry, University of Cambridge, Cambridge, CB2 0SZ, UK.,Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, UK.,Cambridgeshire and Peterborough National Health Service (NHS) Foundation Trust, Huntingdon, CB21 5EF, UK
| | - Gunter Schumann
- PONS Research Group, Department of Psychiatry and Psychotherapy, Campus Charité Mitte, Charitéplatz 1, Berlin, 10117, Germany.,PONS Centre, Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China
| | - Barbara J Sahakian
- Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China.,Department of Psychiatry, University of Cambridge, Cambridge, CB2 0SZ, UK.,Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, CB2 3EB, UK
| | - Jianfeng Feng
- Shanghai Centre for Mathematical Sciences, Fudan University, Shanghai, 200433, China.,Institute of Science and Technology for Brain-Inspired Intelligence, Ministry of Education-Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence and Research and Research Institute of Intelligent Complex Systems, Fudan University, Shanghai, 200433, China.,Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK.,Collaborative Innovation Center for Brain Science, Fudan University, Shanghai, 200433, China
| | | |
Collapse
|