1
|
Jirsaraie RJ, Gatavins MM, Pines AR, Kandala S, Bijsterbosch JD, Marek S, Bogdan R, Barch DM, Sotiras A. Mapping the neurodevelopmental predictors of psychopathology. Mol Psychiatry 2024:10.1038/s41380-024-02682-7. [PMID: 39107582 DOI: 10.1038/s41380-024-02682-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 07/13/2024] [Accepted: 07/22/2024] [Indexed: 08/10/2024]
Abstract
Neuroimaging research has uncovered a multitude of neural abnormalities associated with psychopathology, but few prediction-based studies have been conducted during adolescence, and even fewer used neurobiological features that were extracted across multiple neuroimaging modalities. This gap in the literature is critical, as deriving accurate brain-based models of psychopathology is an essential step towards understanding key neural mechanisms and identifying high-risk individuals. As such, we trained adaptive tree-boosting algorithms on multimodal neuroimaging features from the Lifespan Human Connectome Developmental (HCP-D) sample that contained 956 participants between the ages of 8 to 22 years old. Our feature space consisted of 1037 anatomical, 1090 functional, and 192 diffusion MRI features, which were used to derive models that separately predicted internalizing symptoms, externalizing symptoms, and the general psychopathology factor. We found that multimodal models were the most accurate, but all brain-based models of psychopathology yielded out-of-sample predictions that were weakly correlated with actual symptoms (r2 < 0.15). White matter microstructural properties, including orientation dispersion indices and intracellular volume fractions, were the most predictive of general psychopathology, followed by cortical thickness and functional connectivity. Spatially, the most predictive features of general psychopathology were primarily localized within the default mode and dorsal attention networks. These results were mostly consistent across all dimensions of psychopathology, except orientation dispersion indices and the default mode network were not as heavily weighted in the prediction of internalizing and externalizing symptoms. Taken with prior literature, it appears that neurobiological features are an important part of the equation for predicting psychopathology but relying exclusively on neural markers is clearly not sufficient, especially among adolescent samples with subclinical symptoms. Consequently, risk factor models of psychopathology may benefit from incorporating additional sources of information that have also been shown to explain individual differences, such as psychosocial factors, environmental stressors, and genetic vulnerabilities.
Collapse
Affiliation(s)
- Robert J Jirsaraie
- Division of Computational and Data Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | - Martins M Gatavins
- Lifespan Brain Institute, Children's Hospital of Philadelphia, University of Pennsylvania, Philadelphia, PA, USA
| | - Adam R Pines
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Sridhar Kandala
- Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | - Janine D Bijsterbosch
- Department of Radiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Scott Marek
- Department of Radiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
- Mallinckrodt Institute of Radiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
- AI for Health Institute, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Ryan Bogdan
- Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | - Deanna M Barch
- Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
- Department of Radiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
- Department of Psychiatry, Washington University in St. Louis, St. Louis, MO, USA
| | - Aristeidis Sotiras
- Department of Radiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA.
- Institute for Informatics, Data Science & Biostatistics, Washington University School of Medicine in St. Louis, St. Louis, MO, USA.
| |
Collapse
|
2
|
Lotfaliany M, Agustini B, Walker AJ, Turner A, Wrobel AL, Williams LJ, Dean OM, Miles S, Rossell SL, Berk M, Mohebbi M. Development of a harmonized sociodemographic and clinical questionnaire for mental health research: A Delphi-method-based consensus recommendation. Aust N Z J Psychiatry 2024; 58:656-667. [PMID: 38845137 PMCID: PMC11308274 DOI: 10.1177/00048674241253452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/07/2024]
Abstract
OBJECTIVE Harmonized tools are essential for reliable data sharing and accurate identification of relevant factors in mental health research. The primary objective of this study was to create a harmonized questionnaire to collect demographic, clinical and behavioral data in diverse clinical trials in adult psychiatry. METHODS We conducted a literature review and examined 24 questionnaires used in previously published randomized controlled trials in psychiatry, identifying a total of 27 domains previously explored. Using a Delphi-method process, a task force team comprising experts in psychiatry, epidemiology and statistics selected 15 essential domains for inclusion in the final questionnaire. RESULTS The final selection resulted in a concise set of 22 questions. These questions cover factors such as age, sex, gender, ancestry, education, living arrangement, employment status, home location, relationship status, and history of medical and mental illness. Behavioral factors like physical activity, diet, smoking, alcohol and illicit drug use were also included, along with one question addressing family history of mental illness. Income was excluded due to high confounding and redundancy, while language was included as a measure of migration status. CONCLUSION The recommendation and adoption of this harmonized tool for the assessment of demographic, clinical and behavioral data in mental health research can enhance data consistency and enable comparability across clinical trials.
Collapse
Affiliation(s)
- Mojtaba Lotfaliany
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
| | - Bruno Agustini
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
| | - Adam J Walker
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
| | - Alyna Turner
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
| | - Anna L Wrobel
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
- School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Lana J Williams
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
| | - Olivia M Dean
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
- Florey Institute for Neuroscience & Mental Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Stephanie Miles
- Orygen, Parkville, VIC, Australia
- Department of Psychological Sciences, Swinburne University of Technology, Hawthorn, VIC, Australia
- Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Susan L Rossell
- Centre for Mental Health, Swinburne University of Technology, Melbourne, VIC, Australia
- Psychiatry, St Vincent’s Hospital, Melbourne, VIC, Australia
| | - Michael Berk
- Deakin University, School of Medicine, IMPACT, The Institute for Mental and Physical Health and Clinical Translation, Geelong, Australia
- Florey Institute for Neuroscience & Mental Health, The University of Melbourne, Melbourne, VIC, Australia
- Orygen, Parkville, VIC, Australia
- Department of Psychiatry, The University of Melbourne, Melbourne, VIC, Australia
| | - Mohammadreza Mohebbi
- Biostatistics Unit, Faculty of Health, Deakin University, Burwood, VIC, Australia
| | | |
Collapse
|
3
|
Makowski C, Nichols TE, Dale AM. Quality over quantity: powering neuroimaging samples in psychiatry. Neuropsychopharmacology 2024:10.1038/s41386-024-01893-4. [PMID: 38902353 DOI: 10.1038/s41386-024-01893-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 05/06/2024] [Accepted: 05/24/2024] [Indexed: 06/22/2024]
Abstract
Neuroimaging has been widely adopted in psychiatric research, with hopes that these non-invasive methods will provide important clues to the underpinnings and prediction of various mental health symptoms and outcomes. However, the translational impact of neuroimaging has not yet reached its promise, despite the plethora of computational methods, tools, and datasets at our disposal. Some have lamented that too many psychiatric neuroimaging studies have been underpowered with respect to sample size. In this review, we encourage this discourse to shift from a focus on sheer increases in sample size to more thoughtful choices surrounding experimental study designs. We propose considerations at multiple decision points throughout the study design, data modeling and analysis process that may help researchers working in psychiatric neuroimaging boost power for their research questions of interest without necessarily increasing sample size. We also provide suggestions for leveraging multiple datasets to inform each other and strengthen our confidence in the generalization of findings to both population-level and clinical samples. Through a greater emphasis on improving the quality of brain-based and clinical measures rather than merely quantity, meaningful and potentially translational clinical associations with neuroimaging measures can be achieved with more modest sample sizes in psychiatry.
Collapse
Affiliation(s)
- Carolina Makowski
- Department of Radiology, University of California San Diego, San Diego, CA, USA.
| | - Thomas E Nichols
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Anders M Dale
- Departments of Radiology and Neurosciences, University of California San Diego, San Diego, CA, USA
| |
Collapse
|
4
|
Kalani M, Anjankar A. Revolutionizing Neurology: The Role of Artificial Intelligence in Advancing Diagnosis and Treatment. Cureus 2024; 16:e61706. [PMID: 38975469 PMCID: PMC11224934 DOI: 10.7759/cureus.61706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 06/04/2024] [Indexed: 07/09/2024] Open
Abstract
Artificial intelligence (AI) has emerged as a powerful tool in the field of neurology, significantly impacting the diagnosis and treatment of neurological disorders. Recent technological breakthroughs have given us access to a plethora of information relevant to many aspects of neurology. Neuroscience and AI share a long history of collaboration. Along with great potential, we encounter obstacles relating to data quality, ethics, and inherent difficulty in applying data science in healthcare. Neurological disorders pose intricate challenges due to their complex manifestations and variability. Automating image interpretation tasks, AI algorithms accurately identify brain structures and detect abnormalities. This accelerates diagnosis and reduces the workload on medical professionals. Treatment optimization benefits from AI simulations that model different scenarios and predict outcomes. These AI systems can currently perform many of the sophisticated perceptual and cognitive capacities of biological systems, such as object identification and decision making. Furthermore, AI is rapidly being used as a tool in neuroscience research, altering our understanding of brain functioning. It has the ability to revolutionize healthcare as we know it into a system in which humans and robots collaborate to deliver better care for our patients. Image analysis activities such as recognizing particular brain regions, calculating changes in brain volume over time, and detecting abnormalities in brain scans can be automated by AI systems. This lessens the strain on radiologists and neurologists while improving diagnostic accuracy and efficiency. It is now obvious that cutting-edge artificial intelligence models combined with high-quality clinical data will lead to enhanced prognostic and diagnostic models in neurological illness, permitting expert-level clinical decision aids across healthcare settings. In conclusion, AI's integration into neurology has revolutionized diagnosis, treatment, and research. As AI technologies advance, they promise to unravel the complexities of neurological disorders further, leading to improved patient care and quality of life. The symbiosis of AI and neurology offers a glimpse into a future where innovation and compassion converge to reshape neurological healthcare. This abstract provides a concise overview of the role of AI in neurology and its transformative potential.
Collapse
Affiliation(s)
- Meetali Kalani
- Biochemistry, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Ashish Anjankar
- Biochemistry, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
5
|
Wiersch L, Friedrich P, Hamdan S, Komeyer V, Hoffstaedter F, Patil KR, Eickhoff SB, Weis S. Sex classification from functional brain connectivity: Generalization to multiple datasets. Hum Brain Mapp 2024; 45:e26683. [PMID: 38647035 PMCID: PMC11034006 DOI: 10.1002/hbm.26683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 03/19/2024] [Accepted: 04/02/2024] [Indexed: 04/25/2024] Open
Abstract
Machine learning (ML) approaches are increasingly being applied to neuroimaging data. Studies in neuroscience typically have to rely on a limited set of training data which may impair the generalizability of ML models. However, it is still unclear which kind of training sample is best suited to optimize generalization performance. In the present study, we systematically investigated the generalization performance of sex classification models trained on the parcelwise connectivity profile of either single samples or compound samples of two different sizes. Generalization performance was quantified in terms of mean across-sample classification accuracy and spatial consistency of accurately classifying parcels. Our results indicate that the generalization performance of parcelwise classifiers (pwCs) trained on single dataset samples is dependent on the specific test samples. Certain datasets seem to "match" in the sense that classifiers trained on a sample from one dataset achieved a high accuracy when tested on the respected other one and vice versa. The pwCs trained on the compound samples demonstrated overall highest generalization performance for all test samples, including one derived from a dataset not included in building the training samples. Thus, our results indicate that both a large sample size and a heterogeneous data composition of a training sample have a central role in achieving generalizable results.
Collapse
Affiliation(s)
- Lisa Wiersch
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Patrick Friedrich
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Sami Hamdan
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Vera Komeyer
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
- Department of Biology, Faculty of Mathematics and Natural SciencesHeinrich Heine University DüsseldorfDüsseldorfGermany
| | - Felix Hoffstaedter
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Kaustubh R. Patil
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Simon B. Eickhoff
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Susanne Weis
- Institute of Systems NeuroscienceHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| |
Collapse
|
6
|
Jia Y, Yang B, Yang Y, Zheng W, Wang L, Huang C, Lu J, Chen N. Application of machine learning techniques in the diagnostic approach of PTSD using MRI neuroimaging data: A systematic review. Heliyon 2024; 10:e28559. [PMID: 38571633 PMCID: PMC10988057 DOI: 10.1016/j.heliyon.2024.e28559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2023] [Revised: 03/20/2024] [Accepted: 03/20/2024] [Indexed: 04/05/2024] Open
Abstract
Background At present, the diagnosis of post-traumatic stress disorder(PTSD) mainly relies on clinical symptoms and psychological scales, and finding objective indicators that are helpful for diagnosis has always been a challenge in clinical practice and academic research. Neuroimaging is a useful and powerful tool for discovering the biomarkers of PTSD,especially functional MRI (fMRI), structural MRI (sMRI) and Diffusion Weighted Imaging(DTI)are the most commonly used technologies, which can provide multiple perspectives on brain function, structure and its connectivity. Machine learning (ML) is an emerging and potentially powerful method, which has aroused people's interest because it is used together with neuroimaging data to define brain structural and functional abnormalities related to diseases, and identify phenotypes, such as helping physicians make early diagnosis. Objectives According to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) declaration, a systematic review was conducted to assess its accuracy in distinguishing between PTSD patients, TEHC(Trauma-Exposed Healthy Controls), and HC(healthy controls). Methods We searched PubMed, Embase, and Web of Science using common words for ML methods and PTSD until June 2023, with no language or time limits. This review includes 13 studies, with sensitivity, specificity, and accuracy taken from each publication or acquired directly from the authors. Results All ML techniques have an diagnostic accuracy rate above 70%,and support vector machine(SVM) are the most commonly used techniques. This series of studies has revealed significant neurobiological differences in key brain regions among individuals with PTSD, TEHC, and HC. The connectivity patterns of regions such as the Insula and Amygdala hold particular significance in distinguishing these groups. TEHC exhibits more normal connectivity patterns compared to PTSD, providing valuable insights for the application of machine learning in PTSD diagnosis. Conclusion In contrast to any currently available assessment and clinical diagnosis, ML techniques can be used as an effective and non-invasive support for early identification and detection of patients as well as for early screening of high-risk populations.
Collapse
Affiliation(s)
- Y.L. Jia
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - B.N. Yang
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - Y.H. Yang
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - W.M. Zheng
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - L. Wang
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - C.Y. Huang
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - J. Lu
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| | - N. Chen
- Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, 100053, China
- Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, 100053, China
| |
Collapse
|
7
|
Wiersch L, Friedrich P, Hamdan S, Komeyer V, Hoffstaedter F, Patil KR, Eickhoff SB, Weis S. Sex classification from functional brain connectivity: Generalization to multiple datasets Generalizability of sex classifiers. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.30.555495. [PMID: 37693374 PMCID: PMC10491190 DOI: 10.1101/2023.08.30.555495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
Machine learning (ML) approaches are increasingly being applied to neuroimaging data. Studies in neuroscience typically have to rely on a limited set of training data which may impair the generalizability of ML models. However, it is still unclear which kind of training sample is best suited to optimize generalization performance. In the present study, we systematically investigated the generalization performance of sex classification models trained on the parcelwise connectivity profile of either single samples or a compound sample containing data from four different datasets. Generalization performance was quantified in terms of mean across-sample classification accuracy and spatial consistency of accurately classifying parcels. Our results indicate that generalization performance of pwCs trained on single dataset samples is dependent on the specific test samples. Certain datasets seem to "match" in the sense that classifiers trained on a sample from one dataset achieved a high accuracy when tested on the respected other one and vice versa. The pwC trained on the compound sample demonstrated overall highest generalization performance for all test samples, including one derived from a dataset not included in building the training samples. Thus, our results indicate that a big and heterogenous training sample comprising data of multiple datasets is best suited to achieve generalizable results.
Collapse
Affiliation(s)
- Lisa Wiersch
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Patrick Friedrich
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Sami Hamdan
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Vera Komeyer
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Department of Biology, Faculty of Mathematics and Natural Sciences, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Felix Hoffstaedter
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Kaustubh R Patil
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Susanne Weis
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| |
Collapse
|
8
|
Xing Y, van Erp TG, Pearlson GD, Kochunov P, Calhoun VD, Du Y. More reliable biomarkers and more accurate prediction for mental disorders using a label-noise filtering-based dimensional prediction method. iScience 2024; 27:109319. [PMID: 38482500 PMCID: PMC10933544 DOI: 10.1016/j.isci.2024.109319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 09/17/2023] [Accepted: 02/19/2024] [Indexed: 04/26/2024] Open
Abstract
The integration of neuroimaging with artificial intelligence is crucial for advancing the diagnosis of mental disorders. However, challenges arise from incomplete matching between diagnostic labels and neuroimaging. Here, we propose a label-noise filtering-based dimensional prediction (LAMP) method to identify reliable biomarkers and achieve accurate prediction for mental disorders. Our method proposes to utilize a label-noise filtering model to automatically filter out unclear cases from a neuroimaging perspective, and then the typical subjects whose diagnostic labels align with neuroimaging measures are used to construct a dimensional prediction model to score independent subjects. Using fMRI data of schizophrenia patients and healthy controls (n = 1,245), our method yields consistent scores to independent subjects, leading to more distinguishable relabeled groups with an enhanced classification accuracy of 31.89%. Additionally, it enables the exploration of stable abnormalities in schizophrenia. In summary, our LAMP method facilitates the identification of reliable biomarkers and accurate diagnosis of mental disorders using neuroimages.
Collapse
Affiliation(s)
- Ying Xing
- School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China
| | - Theo G.M. van Erp
- Department of Psychiatry and Human Behavior, School of Medicine, University of California, Irvine, Irvine, CA 92617, USA
- Center for the Neurobiology of Learning and Memory, University of California, Irvine, Irvine, CA 92617, USA
| | - Godfrey D. Pearlson
- Departments of Psychiatry and of Neurobiology, Yale University, New Haven, CT 06519, USA
- Olin Neuropsychiatry Research Center, Institute of Living, Hartford, CT 06106, USA
| | - Peter Kochunov
- Maryland Psychiatric Research Center and Department of Psychiatry, University of Maryland, School of Medicine, Baltimore, MD 21201, USA
| | - Vince D. Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30030, USA
| | - Yuhui Du
- School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China
| |
Collapse
|
9
|
Borchert RJ, Azevedo T, Badhwar A, Bernal J, Betts M, Bruffaerts R, Burkhart MC, Dewachter I, Gellersen HM, Low A, Lourida I, Machado L, Madan CR, Malpetti M, Mejia J, Michopoulou S, Muñoz-Neira C, Pepys J, Peres M, Phillips V, Ramanan S, Tamburin S, Tantiangco HM, Thakur L, Tomassini A, Vipin A, Tang E, Newby D, Ranson JM, Llewellyn DJ, Veldsman M, Rittman T. Artificial intelligence for diagnostic and prognostic neuroimaging in dementia: A systematic review. Alzheimers Dement 2023; 19:5885-5904. [PMID: 37563912 DOI: 10.1002/alz.13412] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/18/2023] [Accepted: 06/02/2023] [Indexed: 08/12/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) and neuroimaging offer new opportunities for diagnosis and prognosis of dementia. METHODS We systematically reviewed studies reporting AI for neuroimaging in diagnosis and/or prognosis of cognitive neurodegenerative diseases. RESULTS A total of 255 studies were identified. Most studies relied on the Alzheimer's Disease Neuroimaging Initiative dataset. Algorithmic classifiers were the most commonly used AI method (48%) and discriminative models performed best for differentiating Alzheimer's disease from controls. The accuracy of algorithms varied with the patient cohort, imaging modalities, and stratifiers used. Few studies performed validation in an independent cohort. DISCUSSION The literature has several methodological limitations including lack of sufficient algorithm development descriptions and standard definitions. We make recommendations to improve model validation including addressing key clinical questions, providing sufficient description of AI methods and validating findings in independent datasets. Collaborative approaches between experts in AI and medicine will help achieve the promising potential of AI tools in practice. HIGHLIGHTS There has been a rapid expansion in the use of machine learning for diagnosis and prognosis in neurodegenerative disease Most studies (71%) relied on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset with no other individual dataset used more than five times There has been a recent rise in the use of more complex discriminative models (e.g., neural networks) that performed better than other classifiers for classification of AD vs healthy controls We make recommendations to address methodological considerations, addressing key clinical questions, and validation We also make recommendations for the field more broadly to standardize outcome measures, address gaps in the literature, and monitor sources of bias.
Collapse
Affiliation(s)
- Robin J Borchert
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - AmanPreet Badhwar
- Department of Pharmacology and Physiology, University of Montreal, Montreal, Canada
- Centre de recherche de l'Institut Universitaire de Gériatrie (CRIUGM), Montreal, Canada
| | - Jose Bernal
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
| | - Matthew Betts
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Center for Behavioral Brain Sciences, University of Magdeburg, Magdeburg, Germany
| | - Rose Bruffaerts
- Computational Neurology, Experimental Neurobiology Unit, Department of Biomedical Sciences, University of Antwerp, Antwerp, Belgium
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | | | - Ilse Dewachter
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | - Helena M Gellersen
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Audrey Low
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | | | - Luiza Machado
- Department of Biochemistry, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | | | - Maura Malpetti
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Jhony Mejia
- Department of Biomedical Engineering, Universidad de Los Andes, Bogotá, Colombia
| | - Sofia Michopoulou
- Imaging Physics, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Carlos Muñoz-Neira
- Research into Memory, Brain sciences and dementia Group (ReMemBr Group), Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Artificial Intelligence & Computational Neuroscience Group (AICN Group), Sheffield Institute for Translational Neuroscience (SITraN), Department of Neuroscience, University of Sheffield, Sheffield, UK
| | - Jack Pepys
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Marion Peres
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | | | - Siddharth Ramanan
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | - Lokendra Thakur
- Division of Genetics and Genomics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
- Broad Institute of MIT and Harvard, Cambridge, UK
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Alessandro Tomassini
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | | | - Eugene Tang
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Danielle Newby
- Department of Psychiatry, University of Oxford, Oxford, UK
| | | | - David J Llewellyn
- University of Exeter Medical School, Exeter, UK
- Alan Turing Institute, London, UK
| | - Michele Veldsman
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| |
Collapse
|
10
|
Gaus R, Pölsterl S, Greimel E, Schulte‐Körne G, Wachinger C. Can we diagnose mental disorders in children? A large-scale assessment of machine learning on structural neuroimaging of 6916 children in the adolescent brain cognitive development study. JCPP ADVANCES 2023; 3:e12184. [PMID: 38054056 PMCID: PMC10694548 DOI: 10.1002/jcv2.12184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 05/09/2023] [Indexed: 12/07/2023] Open
Abstract
Background Prediction of mental disorders based on neuroimaging is an emerging area of research with promising first results in adults. However, research on the unique demographic of children is underrepresented and it is doubtful whether findings obtained on adults can be transferred to children. Methods Using data from 6916 children aged 9-10 in the multicenter Adolescent Brain Cognitive Development study, we extracted 136 regional volume and thickness measures from structural magnetic resonance images to rigorously evaluate the capabilities of machine learning to predict 10 different psychiatric disorders: major depressive disorder, bipolar disorder (BD), psychotic symptoms, attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder, conduct disorder, post-traumatic stress disorder, obsessive-compulsive disorder, generalized anxiety disorder, and social anxiety disorder. For each disorder, we performed cross-validation and assessed whether models discovered a true pattern in the data via permutation testing. Results Two of 10 disorders can be detected with statistical significance when using advanced models that (i) allow for non-linear relationships between neuroanatomy and disorder, (ii) model interdependencies between disorders, and (iii) avoid confounding due to sociodemographic factors: ADHD (AUROC = 0.567, p = 0.002) and BD (AUROC = 0.551, p = 0.002). In contrast, traditional models perform consistently worse and predict only ADHD with statistical significance (AUROC = 0.529, p = 0.002). Conclusion While the modest absolute classification performance does not warrant application in the clinic, our results provide empirical evidence that embracing and explicitly accounting for the complexities of mental disorders via advanced machine learning models can discover patterns that would remain hidden with traditional models.
Collapse
Affiliation(s)
- Richard Gaus
- The Lab for Artificial Intelligence in Medical Imaging (AI‐Med)Department of Child and Adolescent PsychiatryLudwig‐Maximilians‐UniversitätMunichGermany
| | - Sebastian Pölsterl
- The Lab for Artificial Intelligence in Medical Imaging (AI‐Med)Department of Child and Adolescent PsychiatryLudwig‐Maximilians‐UniversitätMunichGermany
| | - Ellen Greimel
- Department of Child and Adolescent Psychiatry, Psychosomatics and PsychotherapyUniversity HospitalLudwig‐Maximilians‐UniversitätMunichGermany
| | - Gerd Schulte‐Körne
- Department of Child and Adolescent Psychiatry, Psychosomatics and PsychotherapyUniversity HospitalLudwig‐Maximilians‐UniversitätMunichGermany
| | - Christian Wachinger
- The Lab for Artificial Intelligence in Medical Imaging (AI‐Med)Department of Child and Adolescent PsychiatryLudwig‐Maximilians‐UniversitätMunichGermany
- Department of RadiologyTechnical University of MunichSchool of MedicineMunichGermany
| |
Collapse
|
11
|
Yang CM, Shin J, Kim JI, Lim YB, Park SH, Kim BN. Classifying Children with ADHD Based on Prefrontal Functional Near-infrared Spectroscopy Using Machine Learning. CLINICAL PSYCHOPHARMACOLOGY AND NEUROSCIENCE : THE OFFICIAL SCIENTIFIC JOURNAL OF THE KOREAN COLLEGE OF NEUROPSYCHOPHARMACOLOGY 2023; 21:693-700. [PMID: 37859442 PMCID: PMC10591175 DOI: 10.9758/cpn.22.1025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 11/09/2022] [Accepted: 11/10/2022] [Indexed: 10/21/2023]
Abstract
Objective : Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in children and adults characterized by cognitive and emotional self-control deficiencies. Previous functional near-infrared spectroscopy (fNIRS) studies found significant group differences between ADHD children and healthy controls during cognitive flexibility tasks in several brain regions. This study aims to apply a machine learning approach to identify medication-naive ADHD patients and healthy control (HC) groups using task-based fNIRS data. Methods : fNIRS signals from 33 ADHD children and 39 HC during the Stroop task were analyzed. In addition, regularized linear discriminant analysis (RLDA) was used to identify ADHD individuals from healthy controls, and classification performance was evaluated. Results : We found that participants can be correctly classified in RLDA leave-one-out cross validation, with a sensitivity of 0.67, specificity of 0.93, and accuracy of 0.82. Conclusion : RLDA using only fNIRS data can effectively discriminate children with ADHD from HC. This study suggests the potential utility of the fNIRS signal as a diagnostic biomarker for ADHD children.
Collapse
Affiliation(s)
- Chan-Mo Yang
- Department of Psychiatry, Wonkwang University School of Medicine, Iksan, Korea
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| | - Jaeyoung Shin
- Department of Electronic Engineering, Wonkwang University, Iksan, Korea
| | | | - You Bin Lim
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| | - So Hyun Park
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| | - Bung-Nyun Kim
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| |
Collapse
|
12
|
Dang T, Fermin ASR, Machizawa MG. oFVSD: a Python package of optimized forward variable selection decoder for high-dimensional neuroimaging data. Front Neuroinform 2023; 17:1266713. [PMID: 37829329 PMCID: PMC10566623 DOI: 10.3389/fninf.2023.1266713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 09/08/2023] [Indexed: 10/14/2023] Open
Abstract
The complexity and high dimensionality of neuroimaging data pose problems for decoding information with machine learning (ML) models because the number of features is often much larger than the number of observations. Feature selection is one of the crucial steps for determining meaningful target features in decoding; however, optimizing the feature selection from such high-dimensional neuroimaging data has been challenging using conventional ML models. Here, we introduce an efficient and high-performance decoding package incorporating a forward variable selection (FVS) algorithm and hyper-parameter optimization that automatically identifies the best feature pairs for both classification and regression models, where a total of 18 ML models are implemented by default. First, the FVS algorithm evaluates the goodness-of-fit across different models using the k-fold cross-validation step that identifies the best subset of features based on a predefined criterion for each model. Next, the hyperparameters of each ML model are optimized at each forward iteration. Final outputs highlight an optimized number of selected features (brain regions of interest) for each model with its accuracy. Furthermore, the toolbox can be executed in a parallel environment for efficient computation on a typical personal computer. With the optimized forward variable selection decoder (oFVSD) pipeline, we verified the effectiveness of decoding sex classification and age range regression on 1,113 structural magnetic resonance imaging (MRI) datasets. Compared to ML models without the FVS algorithm and with the Boruta algorithm as a variable selection counterpart, we demonstrate that the oFVSD significantly outperformed across all of the ML models over the counterpart models without FVS (approximately 0.20 increase in correlation coefficient, r, with regression models and 8% increase in classification models on average) and with Boruta variable selection algorithm (approximately 0.07 improvement in regression and 4% in classification models). Furthermore, we confirmed the use of parallel computation considerably reduced the computational burden for the high-dimensional MRI data. Altogether, the oFVSD toolbox efficiently and effectively improves the performance of both classification and regression ML models, providing a use case example on MRI datasets. With its flexibility, oFVSD has the potential for many other modalities in neuroimaging. This open-source and freely available Python package makes it a valuable toolbox for research communities seeking improved decoding accuracy.
Collapse
Affiliation(s)
- Tung Dang
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Alan S. R. Fermin
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| | - Maro G. Machizawa
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| |
Collapse
|
13
|
Wiersch L, Hamdan S, Hoffstaedter F, Votinov M, Habel U, Clemens B, Derntl B, Eickhoff SB, Patil KR, Weis S. Accurate sex prediction of cisgender and transgender individuals without brain size bias. Sci Rep 2023; 13:13868. [PMID: 37620339 PMCID: PMC10449927 DOI: 10.1038/s41598-023-37508-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 06/22/2023] [Indexed: 08/26/2023] Open
Abstract
The increasing use of machine learning approaches on neuroimaging data comes with the important concern of confounding variables which might lead to biased predictions and in turn spurious conclusions about the relationship between the features and the target. A prominent example is the brain size difference between women and men. This difference in total intracranial volume (TIV) can cause bias when employing machine learning approaches for the investigation of sex differences in brain morphology. A TIV-biased model will not capture qualitative sex differences in brain organization but rather learn to classify an individual's sex based on brain size differences, thus leading to spurious and misleading conclusions, for example when comparing brain morphology between cisgender- and transgender individuals. In this study, TIV bias in sex classification models applied to cis- and transgender individuals was systematically investigated by controlling for TIV either through featurewise confound removal or by matching the training samples for TIV. Our results provide strong evidence that models not biased by TIV can classify the sex of both cis- and transgender individuals with high accuracy, highlighting the importance of appropriate modeling to avoid bias in automated decision making.
Collapse
Affiliation(s)
- Lisa Wiersch
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Sami Hamdan
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Felix Hoffstaedter
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Mikhail Votinov
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
- Institute of Neuroscience and Medicine (INM-10: Brain Structure-Function Relationships), Research Centre Jülich, Jülich, Germany
| | - Ute Habel
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
- Institute of Neuroscience and Medicine (INM-10: Brain Structure-Function Relationships), Research Centre Jülich, Jülich, Germany
| | - Benjamin Clemens
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
- Institute of Neuroscience and Medicine (INM-10: Brain Structure-Function Relationships), Research Centre Jülich, Jülich, Germany
| | - Birgit Derntl
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, University of Tübingen, Tübingen, Germany
- LEAD Graduate School and Research Network, University of Tübingen, Tübingen, Germany
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
| | - Kaustubh R Patil
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany.
| | - Susanne Weis
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany.
| |
Collapse
|
14
|
Nebe S, Reutter M, Baker DH, Bölte J, Domes G, Gamer M, Gärtner A, Gießing C, Gurr C, Hilger K, Jawinski P, Kulke L, Lischke A, Markett S, Meier M, Merz CJ, Popov T, Puhlmann LMC, Quintana DS, Schäfer T, Schubert AL, Sperl MFJ, Vehlen A, Lonsdorf TB, Feld GB. Enhancing precision in human neuroscience. eLife 2023; 12:e85980. [PMID: 37555830 PMCID: PMC10411974 DOI: 10.7554/elife.85980] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 07/23/2023] [Indexed: 08/10/2023] Open
Abstract
Human neuroscience has always been pushing the boundary of what is measurable. During the last decade, concerns about statistical power and replicability - in science in general, but also specifically in human neuroscience - have fueled an extensive debate. One important insight from this discourse is the need for larger samples, which naturally increases statistical power. An alternative is to increase the precision of measurements, which is the focus of this review. This option is often overlooked, even though statistical power benefits from increasing precision as much as from increasing sample size. Nonetheless, precision has always been at the heart of good scientific practice in human neuroscience, with researchers relying on lab traditions or rules of thumb to ensure sufficient precision for their studies. In this review, we encourage a more systematic approach to precision. We start by introducing measurement precision and its importance for well-powered studies in human neuroscience. Then, determinants for precision in a range of neuroscientific methods (MRI, M/EEG, EDA, Eye-Tracking, and Endocrinology) are elaborated. We end by discussing how a more systematic evaluation of precision and the application of respective insights can lead to an increase in reproducibility in human neuroscience.
Collapse
Affiliation(s)
- Stephan Nebe
- Zurich Center for Neuroeconomics, Department of Economics, University of ZurichZurichSwitzerland
| | - Mario Reutter
- Department of Psychology, Julius-Maximilians-UniversityWürzburgGermany
| | - Daniel H Baker
- Department of Psychology and York Biomedical Research Institute, University of YorkYorkUnited Kingdom
| | - Jens Bölte
- Institute for Psychology, University of Münster, Otto-Creuzfeldt Center for Cognitive and Behavioral NeuroscienceMünsterGermany
| | - Gregor Domes
- Department of Biological and Clinical Psychology, University of TrierTrierGermany
- Institute for Cognitive and Affective NeuroscienceTrierGermany
| | - Matthias Gamer
- Department of Psychology, Julius-Maximilians-UniversityWürzburgGermany
| | - Anne Gärtner
- Faculty of Psychology, Technische Universität DresdenDresdenGermany
| | - Carsten Gießing
- Biological Psychology, Department of Psychology, School of Medicine and Health Sciences, Carl von Ossietzky University of OldenburgOldenburgGermany
| | - Caroline Gurr
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe UniversityFrankfurtGermany
- Brain Imaging Center, Goethe UniversityFrankfurtGermany
| | - Kirsten Hilger
- Department of Psychology, Julius-Maximilians-UniversityWürzburgGermany
- Department of Psychology, Psychological Diagnostics and Intervention, Catholic University of Eichstätt-IngolstadtEichstättGermany
| | - Philippe Jawinski
- Department of Psychology, Humboldt-Universität zu BerlinBerlinGermany
| | - Louisa Kulke
- Department of Developmental with Educational Psychology, University of BremenBremenGermany
| | - Alexander Lischke
- Department of Psychology, Medical School HamburgHamburgGermany
- Institute of Clinical Psychology and Psychotherapy, Medical School HamburgHamburgGermany
| | - Sebastian Markett
- Department of Psychology, Humboldt-Universität zu BerlinBerlinGermany
| | - Maria Meier
- Department of Psychology, University of KonstanzKonstanzGermany
- University Psychiatric Hospitals, Child and Adolescent Psychiatric Research Department (UPKKJ), University of BaselBaselSwitzerland
| | - Christian J Merz
- Department of Cognitive Psychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University BochumBochumGermany
| | - Tzvetan Popov
- Department of Psychology, Methods of Plasticity Research, University of ZurichZurichSwitzerland
| | - Lara MC Puhlmann
- Leibniz Institute for Resilience ResearchMainzGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Daniel S Quintana
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- NevSom, Department of Rare Disorders & Disabilities, Oslo University HospitalOsloNorway
- KG Jebsen Centre for Neurodevelopmental Disorders, University of OsloOsloNorway
- Norwegian Centre for Mental Disorders Research (NORMENT), University of OsloOsloNorway
| | - Tim Schäfer
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe UniversityFrankfurtGermany
- Brain Imaging Center, Goethe UniversityFrankfurtGermany
| | | | - Matthias FJ Sperl
- Department of Clinical Psychology and Psychotherapy, University of GiessenGiessenGermany
- Center for Mind, Brain and Behavior, Universities of Marburg and GiessenGiessenGermany
| | - Antonia Vehlen
- Department of Biological and Clinical Psychology, University of TrierTrierGermany
| | - Tina B Lonsdorf
- Department of Systems Neuroscience, University Medical Center Hamburg-EppendorfHamburgGermany
- Department of Psychology, Biological Psychology and Cognitive Neuroscience, University of BielefeldBielefeldGermany
| | - Gordon B Feld
- Department of Clinical Psychology, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg UniversityMannheimGermany
- Department of Psychology, Heidelberg UniversityHeidelbergGermany
- Department of Addiction Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg UniversityMannheimGermany
- Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg UniversityMannheimGermany
| |
Collapse
|
15
|
Porter A, Fei S, Damme KSF, Nusslock R, Gratton C, Mittal VA. A meta-analysis and systematic review of single vs. multimodal neuroimaging techniques in the classification of psychosis. Mol Psychiatry 2023; 28:3278-3292. [PMID: 37563277 PMCID: PMC10618094 DOI: 10.1038/s41380-023-02195-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 08/12/2023]
Abstract
BACKGROUND Psychotic disorders are characterized by structural and functional abnormalities in brain networks. Neuroimaging techniques map and characterize such abnormalities using unique features (e.g., structural integrity, coactivation). However, it is unclear if a specific method, or a combination of modalities, is particularly effective in identifying differences in brain networks of someone with a psychotic disorder. METHODS A systematic meta-analysis evaluated machine learning classification of schizophrenia spectrum disorders in comparison to healthy control participants using various neuroimaging modalities (i.e., T1-weighted imaging (T1), diffusion tensor imaging (DTI), resting state functional connectivity (rs-FC), or some combination (multimodal)). Criteria for manuscript inclusion included whole-brain analyses and cross-validation to provide a complete picture regarding the predictive ability of large-scale brain systems in psychosis. For this meta-analysis, we searched Ovid MEDLINE, PubMed, PsychInfo, Google Scholar, and Web of Science published between inception and March 13th 2023. Prediction results were averaged for studies using the same dataset, but parallel analyses were run that included studies with pooled sample across many datasets. We assessed bias through funnel plot asymmetry. A bivariate regression model determined whether differences in imaging modality, demographics, and preprocessing methods moderated classification. Separate models were run for studies with internal prediction (via cross-validation) and external prediction. RESULTS 93 studies were identified for quantitative review (30 T1, 9 DTI, 40 rs-FC, and 14 multimodal). As a whole, all modalities reliably differentiated those with schizophrenia spectrum disorders from controls (OR = 2.64 (95%CI = 2.33 to 2.95)). However, classification was relatively similar across modalities: no differences were seen across modalities in the classification of independent internal data, and a small advantage was seen for rs-FC studies relative to T1 studies in classification in external datasets. We found large amounts of heterogeneity across results resulting in significant signs of bias in funnel plots and Egger's tests. Results remained similar, however, when studies were restricted to those with less heterogeneity, with continued small advantages for rs-FC relative to structural measures. Notably, in all cases, no significant differences were seen between multimodal and unimodal approaches, with rs-FC and unimodal studies reporting largely overlapping classification performance. Differences in demographics and analysis or denoising were not associated with changes in classification scores. CONCLUSIONS The results of this study suggest that neuroimaging approaches have promise in the classification of psychosis. Interestingly, at present most modalities perform similarly in the classification of psychosis, with slight advantages for rs-FC relative to structural modalities in some specific cases. Notably, results differed substantially across studies, with suggestions of biased effect sizes, particularly highlighting the need for more studies using external prediction and large sample sizes. Adopting more rigorous and systematized standards will add significant value toward understanding and treating this critical population.
Collapse
Affiliation(s)
- Alexis Porter
- Department of Psychology, Northwestern University, Evanston, IL, USA.
| | - Sihan Fei
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Katherine S F Damme
- Department of Psychology, Northwestern University, Evanston, IL, USA
- Institute for Innovations in Developmental Sciences, Northwestern University, Evanston and Chicago, IL, USA
| | - Robin Nusslock
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Caterina Gratton
- Department of Psychology, Florida State University, Tallahassee, FL, USA
| | - Vijay A Mittal
- Department of Psychology, Northwestern University, Evanston, IL, USA
- Institute for Innovations in Developmental Sciences, Northwestern University, Evanston and Chicago, IL, USA
- Department of Psychiatry, Northwestern University, Chicago, IL, USA
- Medical Social Sciences, Northwestern University, Chicago, IL, USA
- Institute for Policy Research, Northwestern University, Chicago, IL, USA
| |
Collapse
|
16
|
Botvinik-Nezer R, Wager TD. Reproducibility in Neuroimaging Analysis: Challenges and Solutions. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:780-788. [PMID: 36906444 DOI: 10.1016/j.bpsc.2022.12.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 11/27/2022] [Accepted: 12/11/2022] [Indexed: 12/23/2022]
Abstract
Recent years have marked a renaissance in efforts to increase research reproducibility in psychology, neuroscience, and related fields. Reproducibility is the cornerstone of a solid foundation of fundamental research-one that will support new theories built on valid findings and technological innovation that works. The increased focus on reproducibility has made the barriers to it increasingly apparent, along with the development of new tools and practices to overcome these barriers. Here, we review challenges, solutions, and emerging best practices with a particular emphasis on neuroimaging studies. We distinguish 3 main types of reproducibility, discussing each in turn. Analytical reproducibility is the ability to reproduce findings using the same data and methods. Replicability is the ability to find an effect in new datasets, using the same or similar methods. Finally, robustness to analytical variability refers to the ability to identify a finding consistently across variation in methods. The incorporation of these tools and practices will result in more reproducible, replicable, and robust psychological and brain research and a stronger scientific foundation across fields of inquiry.
Collapse
Affiliation(s)
- Rotem Botvinik-Nezer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire.
| | - Tor D Wager
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire
| |
Collapse
|
17
|
Rosenblatt M, Rodriguez RX, Westwater ML, Dai W, Horien C, Greene AS, Constable RT, Noble S, Scheinost D. Connectome-based machine learning models are vulnerable to subtle data manipulations. PATTERNS (NEW YORK, N.Y.) 2023; 4:100756. [PMID: 37521052 PMCID: PMC10382940 DOI: 10.1016/j.patter.2023.100756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 03/10/2023] [Accepted: 04/24/2023] [Indexed: 08/01/2023]
Abstract
Neuroimaging-based predictive models continue to improve in performance, yet a widely overlooked aspect of these models is "trustworthiness," or robustness to data manipulations. High trustworthiness is imperative for researchers to have confidence in their findings and interpretations. In this work, we used functional connectomes to explore how minor data manipulations influence machine learning predictions. These manipulations included a method to falsely enhance prediction performance and adversarial noise attacks designed to degrade performance. Although these data manipulations drastically changed model performance, the original and manipulated data were extremely similar (r = 0.99) and did not affect other downstream analysis. Essentially, connectome data could be inconspicuously modified to achieve any desired prediction performance. Overall, our enhancement attacks and evaluation of existing adversarial noise attacks in connectome-based models highlight the need for counter-measures that improve the trustworthiness to preserve the integrity of academic research and any potential translational applications.
Collapse
Affiliation(s)
- Matthew Rosenblatt
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT 06510, USA
| | - Raimundo X. Rodriguez
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
| | - Margaret L. Westwater
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT 06510, USA
| | - Wei Dai
- Department of Biostatistics, Yale School of Public Health, New Haven, CT 06510, USA
| | - Corey Horien
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
| | - Abigail S. Greene
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
| | - R. Todd Constable
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT 06510, USA
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Neurosurgery, Yale School of Medicine, New Haven, CT 06510, USA
| | - Stephanie Noble
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT 06510, USA
| | - Dustin Scheinost
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT 06510, USA
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Statistics & Data Science, Yale University, New Haven, CT 06510, USA
- Child Study Center, Yale School of Medicine, New Haven, CT 06510, USA
- Wu Tsai Institute, Yale University, New Haven, CT 06510, USA
| |
Collapse
|
18
|
Chen Z, Hu B, Liu X, Becker B, Eickhoff SB, Miao K, Gu X, Tang Y, Dai X, Li C, Leonov A, Xiao Z, Feng Z, Chen J, Chuan-Peng H. Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry. BMC Med 2023; 21:241. [PMID: 37400814 DOI: 10.1186/s12916-023-02941-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 06/13/2023] [Indexed: 07/05/2023] Open
Abstract
BACKGROUND The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation. METHODS Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses. RESULTS A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β = - 2.75, p < .001, R2adj = 0.40; r = - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF10 > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance. CONCLUSIONS Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.
Collapse
Affiliation(s)
- Zhiyi Chen
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
- Faculty of Psychology, Southwest University, Chongqing, China.
| | - Bowen Hu
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Xuerong Liu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Benjamin Becker
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, Chengdu, China
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Kuan Miao
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Xingmei Gu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Yancheng Tang
- School of Business and Management, Shanghai International Studies University, Shanghai, China
| | - Xin Dai
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Chao Li
- Department of Radiology, The Third Affiliated Hospital, Sun Yat-Sen University, Guangdong, China
| | - Artemiy Leonov
- School of Psychology, Clark University, Worcester, MA, USA
| | - Zhibing Xiao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zhengzhi Feng
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China.
- Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China.
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
19
|
Chan L, Simmons C, Tillem S, Conley M, Brazil IA, Baskin-Sommers A. Classifying Conduct Disorder Using a Biopsychosocial Model and Machine Learning Method. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:599-608. [PMID: 35217219 PMCID: PMC9393206 DOI: 10.1016/j.bpsc.2022.02.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 01/10/2022] [Accepted: 02/08/2022] [Indexed: 05/11/2023]
Abstract
BACKGROUND Conduct disorder (CD) is a common syndrome with far-reaching effects. Risk factors for the development of CD span social, psychological, and biological domains. Researchers note that predictive models of CD are limited if the focus is on a single risk factor or even a single domain. Machine learning methods are optimized for the extraction of trends across multidomain data but have yet to be implemented in predicting the development of CD. METHODS Social (e.g., family, income), psychological (e.g., psychiatric, neuropsychological), and biological (e.g., resting-state graph metrics) risk factors were measured using data from the baseline visit of the Adolescent Brain Cognitive Development Study when youth were 9 to 10 years old (N = 2368). Applying a feed-forward neural network machine learning method, risk factors were used to predict CD diagnoses 2 years later. RESULTS A model with factors that included social, psychological, and biological domains outperformed models representing factors within any single domain, predicting the presence of a CD diagnosis with 91.18% accuracy. Within each domain, certain factors stood out in terms of their relationship to CD (social: lower parental monitoring, more aggression in the household, lower income; psychological: greater attention-deficit/hyperactivity disorder and oppositional defiant disorder symptoms, worse crystallized cognition and card sorting performance; biological: disruptions in the topology of subcortical and frontoparietal networks). CONCLUSIONS The development of an accurate, sensitive, and specific predictive model of CD has the potential to aid in prevention and intervention efforts. Key risk factors for CD appear best characterized as reflecting unpredictable, impulsive, deprived, and emotional external and internal contexts.
Collapse
Affiliation(s)
- Lena Chan
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Cortney Simmons
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Scott Tillem
- Department of Psychology, University of Michigan Ann Arbor, Ann Arbor, Michigan
| | - May Conley
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Inti A Brazil
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands; Forensic Psychiatric Centre Pompestichting, Nijmegen, the Netherlands
| | | |
Collapse
|
20
|
Faiyaz A, Doyley MM, Schifitto G, Uddin MN. Artificial intelligence for diffusion MRI-based tissue microstructure estimation in the human brain: an overview. Front Neurol 2023; 14:1168833. [PMID: 37153663 PMCID: PMC10160660 DOI: 10.3389/fneur.2023.1168833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 03/27/2023] [Indexed: 05/10/2023] Open
Abstract
Artificial intelligence (AI) has made significant advances in the field of diffusion magnetic resonance imaging (dMRI) and other neuroimaging modalities. These techniques have been applied to various areas such as image reconstruction, denoising, detecting and removing artifacts, segmentation, tissue microstructure modeling, brain connectivity analysis, and diagnosis support. State-of-the-art AI algorithms have the potential to leverage optimization techniques in dMRI to advance sensitivity and inference through biophysical models. While the use of AI in brain microstructures has the potential to revolutionize the way we study the brain and understand brain disorders, we need to be aware of the pitfalls and emerging best practices that can further advance this field. Additionally, since dMRI scans rely on sampling of the q-space geometry, it leaves room for creativity in data engineering in such a way that it maximizes the prior inference. Utilization of the inherent geometry has been shown to improve general inference quality and might be more reliable in identifying pathological differences. We acknowledge and classify AI-based approaches for dMRI using these unifying characteristics. This article also highlighted and reviewed general practices and pitfalls involving tissue microstructure estimation through data-driven techniques and provided directions for building on them.
Collapse
Affiliation(s)
- Abrar Faiyaz
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, United States
| | - Marvin M. Doyley
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, United States
- Department of Imaging Sciences, University of Rochester, Rochester, NY, United States
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, United States
| | - Giovanni Schifitto
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, United States
- Department of Imaging Sciences, University of Rochester, Rochester, NY, United States
- Department of Neurology, University of Rochester, Rochester, NY, United States
| | - Md Nasir Uddin
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, United States
- Department of Neurology, University of Rochester, Rochester, NY, United States
| |
Collapse
|
21
|
Liu XQ, Ji XY, Weng X, Zhang YF. Artificial intelligence ecosystem for computational psychiatry: Ideas to practice. World J Meta-Anal 2023; 11:79-91. [DOI: 10.13105/wjma.v11.i4.79] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 03/18/2023] [Accepted: 04/04/2023] [Indexed: 04/14/2023] Open
Abstract
Computational psychiatry is an emerging field that not only explores the biological basis of mental illness but also considers the diagnoses and identifies the underlying mechanisms. One of the key strengths of computational psychiatry is that it may identify patterns in large datasets that are not easily identifiable. This may help researchers develop more effective treatments and interventions for mental health problems. This paper is a narrative review that reviews the literature and produces an artificial intelligence ecosystem for computational psychiatry. The artificial intelligence ecosystem for computational psychiatry includes data acquisition, preparation, modeling, application, and evaluation. This approach allows researchers to integrate data from a variety of sources, such as brain imaging, genetics, and behavioral experiments, to obtain a more complete understanding of mental health conditions. Through the process of data preprocessing, training, and testing, the data that are required for model building can be prepared. By using machine learning, neural networks, artificial intelligence, and other methods, researchers have been able to develop diagnostic tools that can accurately identify mental health conditions based on a patient’s symptoms and other factors. Despite the continuous development and breakthrough of computational psychiatry, it has not yet influenced routine clinical practice and still faces many challenges, such as data availability and quality, biological risks, equity, and data protection. As we move progress in this field, it is vital to ensure that computational psychiatry remains accessible and inclusive so that all researchers may contribute to this significant and exciting field.
Collapse
Affiliation(s)
- Xin-Qiao Liu
- School of Education, Tianjin University, Tianjin 300350, China
| | - Xin-Yu Ji
- School of Education, Tianjin University, Tianjin 300350, China
| | - Xing Weng
- Huzhou Educational Science & Research Center, Huzhou 313000, Zhejiang Province, China
| | - Yi-Fan Zhang
- School of Education, Tianjin University, Tianjin 300350, China
| |
Collapse
|
22
|
Chen Z, Liu X, Yang Q, Wang YJ, Miao K, Gong Z, Yu Y, Leonov A, Liu C, Feng Z, Chuan-Peng H. Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review. JAMA Netw Open 2023; 6:e231671. [PMID: 36877519 PMCID: PMC9989906 DOI: 10.1001/jamanetworkopen.2023.1671] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/07/2023] Open
Abstract
IMPORTANCE Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated. OBJECTIVE To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis. EVIDENCE REVIEW PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality. FINDINGS A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%). CONCLUSIONS AND RELEVANCE This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.
Collapse
Affiliation(s)
- Zhiyi Chen
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Xuerong Liu
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Qingwu Yang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Yan-Jiang Wang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Kuan Miao
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Zheng Gong
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Yang Yu
- School of Psychology, Third Military Medical University, Chongqing, China
| | - Artemiy Leonov
- Department of Psychology, Clark University, Worcester, Massachusetts
| | - Chunlei Liu
- School of Psychology, Qufu Normal University, Qufu, China
| | - Zhengzhi Feng
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
23
|
Gómez-Carrillo A, Paquin V, Dumas G, Kirmayer LJ. Restoring the missing person to personalized medicine and precision psychiatry. Front Neurosci 2023; 17:1041433. [PMID: 36845417 PMCID: PMC9947537 DOI: 10.3389/fnins.2023.1041433] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Accepted: 01/09/2023] [Indexed: 02/11/2023] Open
Abstract
Precision psychiatry has emerged as part of the shift to personalized medicine and builds on frameworks such as the U.S. National Institute of Mental Health Research Domain Criteria (RDoC), multilevel biological "omics" data and, most recently, computational psychiatry. The shift is prompted by the realization that a one-size-fits all approach is inadequate to guide clinical care because people differ in ways that are not captured by broad diagnostic categories. One of the first steps in developing this personalized approach to treatment was the use of genetic markers to guide pharmacotherapeutics based on predictions of pharmacological response or non-response, and the potential risk of adverse drug reactions. Advances in technology have made a greater degree of specificity or precision potentially more attainable. To date, however, the search for precision has largely focused on biological parameters. Psychiatric disorders involve multi-level dynamics that require measures of phenomenological, psychological, behavioral, social structural, and cultural dimensions. This points to the need to develop more fine-grained analyses of experience, self-construal, illness narratives, interpersonal interactional dynamics, and social contexts and determinants of health. In this paper, we review the limitations of precision psychiatry arguing that it cannot reach its goal if it does not include core elements of the processes that give rise to psychopathological states, which include the agency and experience of the person. Drawing from contemporary systems biology, social epidemiology, developmental psychology, and cognitive science, we propose a cultural-ecosocial approach to integrating precision psychiatry with person-centered care.
Collapse
Affiliation(s)
- Ana Gómez-Carrillo
- Culture, Mind, and Brain Program, Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, QC, Canada
- Culture and Mental Health Research Unit, Lady Davis Institute, Jewish General Hospital, Montreal, QC, Canada
| | - Vincent Paquin
- Culture, Mind, and Brain Program, Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, QC, Canada
| | - Guillaume Dumas
- Culture, Mind, and Brain Program, Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, QC, Canada
- Precision Psychiatry and Social Physiology Laboratory at the CHU Sainte-Justine Research Center, Université de Montréal, Montreal, QC, Canada
- Mila–Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Laurence J. Kirmayer
- Culture, Mind, and Brain Program, Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, QC, Canada
- Culture and Mental Health Research Unit, Lady Davis Institute, Jewish General Hospital, Montreal, QC, Canada
| |
Collapse
|
24
|
Gancz NN, Forster SE. Threats to external validity in the neuroprediction of substance use treatment outcomes. THE AMERICAN JOURNAL OF DRUG AND ALCOHOL ABUSE 2023; 49:5-20. [PMID: 36099534 PMCID: PMC9974755 DOI: 10.1080/00952990.2022.2116712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Revised: 08/09/2022] [Accepted: 08/21/2022] [Indexed: 10/14/2022]
Abstract
Background: Tools predicting individual relapse risk would invaluably inform clinical decision-making (e.g. level-of-care) in substance use treatment. Studies of neuroprediction - use of neuromarkers to predict individual outcomes - have the dual potential to create such tools and inform etiological models leading to new treatments. However, financial limitations, statistical power demands, and related factors encourage restrictive selection criteria, yielding samples that do not fully represent the target population. This problem may be further compounded by a lack of statistical optimism correction in neuroprediction research, resulting in predictive models that are overfit to already-restricted samples.Objectives: This systematic review aims to identify potential threats to external validity related to restrictive selection criteria and underutilization of optimism correction in the existing neuroprediction literature targeting substance use treatment outcomes.Methods: Sixty-seven studies of neuroprediction in substance use treatment were identified and details of sample selection criteria and statistical optimism correction were extracted.Results: Most publications were found to report restrictive selection criteria (e.g. excluding psychiatric (94% of publications) and substance use comorbidities (69% of publications)) that would rule-out a considerable portion of the treatment population. Furthermore, only 21% of publications reported optimism correction.Conclusion: Restrictive selection criteria and underutilization of optimism correction are common in the existing literature and may limit the generalizability of identified neural predictors to the target population whose treatment they would ultimately inform. Greater attention to the inclusivity and generalizability of addiction neuroprediction research, as well as new opportunities provided through open science initiatives, have the potential to address this issue.
Collapse
Affiliation(s)
- Naomi N. Gancz
- VA Pittsburgh Healthcare System, VISN 4 Mental Illness Research, Education, & Clinical Center (MIRECC)
- University of California, Los Angeles, Department of Psychology
| | - Sarah E. Forster
- VA Pittsburgh Healthcare System, VISN 4 Mental Illness Research, Education, & Clinical Center (MIRECC)
| |
Collapse
|
25
|
Cao M, Wu K, Halperin JM, Li X. Abnormal structural and functional network topological properties associated with left prefrontal, parietal, and occipital cortices significantly predict childhood TBI-related attention deficits: A semi-supervised deep learning study. Front Neurosci 2023; 17:1128646. [PMID: 36937671 PMCID: PMC10017753 DOI: 10.3389/fnins.2023.1128646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 02/17/2023] [Indexed: 03/06/2023] Open
Abstract
Introduction Traumatic brain injury (TBI) is a major public health concern in children. Children with TBI have elevated risk in developing attention deficits. Existing studies have found that structural and functional alterations in multiple brain regions were linked to TBI-related attention deficits in children. Most of these existing studies have utilized conventional parametric models for group comparisons, which have limited capacity in dealing with large-scale and high dimensional neuroimaging measures that have unknown nonlinear relationships. Nevertheless, none of these existing findings have been successfully implemented to clinical practice for guiding diagnoses and interventions of TBI-related attention problems. Machine learning techniques, especially deep learning techniques, are able to handle the multi-dimensional and nonlinear information to generate more robust predictions. Therefore, the current research proposed to construct a deep learning model, semi-supervised autoencoder, to investigate the topological alterations in both structural and functional brain networks in children with TBI and their predictive power for post-TBI attention deficits. Methods Functional magnetic resonance imaging data during sustained attention processing task and diffusion tensor imaging data from 110 subjects (55 children with TBI and 55 group-matched controls) were used to construct the functional and structural brain networks, respectively. A total of 60 topological properties were selected as brain features for building the model. Results The model was able to differentiate children with TBI and controls with an average accuracy of 82.86%. Functional and structural nodal topological properties associated with left frontal, inferior temporal, postcentral, and medial occipitotemporal regions served as the most important brain features for accurate classification of the two subject groups. Post hoc regression-based machine learning analyses in the whole study sample showed that among these most important neuroimaging features, those associated with left postcentral area, superior frontal region, and medial occipitotemporal regions had significant value for predicting the elevated inattentive and hyperactive/impulsive symptoms. Discussion Findings of this study suggested that deep learning techniques may have the potential to help identifying robust neurobiological markers for post-TBI attention deficits; and the left superior frontal, postcentral, and medial occipitotemporal regions may serve as reliable targets for diagnosis and interventions of TBI-related attention problems in children.
Collapse
Affiliation(s)
- Meng Cao
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States
| | - Kai Wu
- School of Biomedical Sciences and Engineering, South China University of Technology, Guangzhou, China
| | - Jeffery M. Halperin
- Department of Psychology, Queens College, City University of New York, New York, NY, United States
| | - Xiaobo Li
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ, United States
- *Correspondence: Xiaobo Li, ,
| |
Collapse
|
26
|
Wu K, Li Y, Zou Y, Ren Y, Wang Y, Hu X, Wang Y, Chen C, Lu M, Xu L, Wu L, Li K. Tai Chi increases functional connectivity and decreases chronic fatigue syndrome: A pilot intervention study with machine learning and fMRI analysis. PLoS One 2022; 17:e0278415. [PMID: 36454926 PMCID: PMC9714925 DOI: 10.1371/journal.pone.0278415] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 10/18/2022] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND The latest guidance on chronic fatigue syndrome (CFS) recommends exercise therapy. Tai Chi, an exercise method in traditional Chinese medicine, is reportedly helpful for CFS. However, the mechanism remains unclear. The present longitudinal study aimed to detect the influence of Tai Chi on functional brain connectivity in CFS. METHODS The study recruited 20 CFS patients and 20 healthy controls to receive eight sessions of Tai Chi exercise over a period of one month. Before the Tai Chi exercise, an abnormal functional brain connectivity for recognizing CFS was generated by a linear support vector model. The prediction ability of the structure was validated with a random forest classification under a permutation test. Then, the functional connections (FCs) of the structure were analyzed in the large-scale brain network after Tai Chi exercise while taking the changes in the Fatigue Scale-14, Pittsburgh Sleep Quality Index (PSQI), and the 36-item short-form health survey (SF-36) as clinical effectiveness evaluation. The registration number is ChiCTR2000032577 in the Chinese Clinical Trial Registry. RESULTS 1) The score of the Fatigue Scale-14 decreased significantly in the CFS patients, and the scores of the PSQI and SF-36 changed significantly both in CFS patients and healthy controls. 2) Sixty FCs were considered significant to discriminate CFS (P = 0.000, best accuracy 90%), with 80.5% ± 9% average accuracy. 3) The FCs that were majorly related to the left frontoparietal network (FPN) and default mode network (DMN) significantly increased (P = 0.0032 and P = 0.001) in CFS patients after Tai Chi exercise. 4) The change of FCs in the left FPN and DMN were positively correlated (r = 0.40, P = 0.012). CONCLUSION These results demonstrated that the 60 FCs we found using machine learning could be neural biomarkers to discriminate between CFS patients and healthy controls. Tai Chi exercise may improve CFS patients' fatigue syndrome, sleep quality, and body health statement by strengthening the functional connectivity of the left FPN and DMN under these FCs. The findings promote our understanding of Tai Chi exercise's value in treating CFS.
Collapse
Affiliation(s)
- Kang Wu
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
- Xinhua Hospital, Tongzhou District, Beijing, China
| | - Yuanyuan Li
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Yihuai Zou
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Yi Ren
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Yahui Wang
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Xiaojie Hu
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Yue Wang
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Chen Chen
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Mengxin Lu
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Lingling Xu
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Linlu Wu
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
| | - Kuangshi Li
- Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
- * E-mail:
| |
Collapse
|
27
|
Vilgis V, Yee D, Silk TJ, Vance A. Distinct Neural Profiles of Frontoparietal Networks in Boys with ADHD and Boys with Persistent Depressive Disorder. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2022; 22:1183-1198. [PMID: 35349053 PMCID: PMC10149107 DOI: 10.3758/s13415-022-00999-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/12/2022] [Indexed: 05/02/2023]
Abstract
Working memory deficits are common in attention-deficit/hyperactivity disorder (ADHD) and depression-two common neurodevelopmental disorders with overlapping cognitive profiles but distinct clinical presentation. Multivariate techniques have previously been utilized to understand working memory processes in functional brain networks in healthy adults but have not yet been applied to investigate how working memory processes within the same networks differ within typical and atypical developing populations. We used multivariate pattern analysis (MVPA) to identify whether brain networks discriminated between spatial versus verbal working memory processes in ADHD and Persistent Depressive Disorder (PDD). Thirty-six male clinical participants and 19 typically developing (TD) boys participated in a fMRI scan while completing a verbal and a spatial working memory task. Within a priori functional brain networks (frontoparietal, default mode, salience), the TD group demonstrated differential response patterns to verbal and spatial working memory. The PDD group showed weaker differentiation than TD, with lower classification accuracies observed in primarily the left frontoparietal network. The neural profiles of the ADHD and PDD differed specifically in the SN where the ADHD group's neural profile suggests significantly less specificity in neural representations of spatial and verbal working memory. We highlight within-group classification as an innovative tool for understanding the neural mechanisms of how cognitive processes may deviate in clinical disorders, an important intermediary step towards improving translational psychiatry.
Collapse
Affiliation(s)
- Veronika Vilgis
- Department of Paediatrics, University of Melbourne, Melbourne, Australia
| | - Debbie Yee
- Washington University in St. Louis, St. Louis, MO, USA.
- Cognitive, Linguistic & Psychological Sciences, Brown University, Box 182, Metcalf Research Building, 190 Thayer Street, Providence, RI, 02912, USA.
| | - Tim J Silk
- Department of Paediatrics, University of Melbourne, Melbourne, Australia
- Murdoch Children's Research Institute, Melbourne, Australia
- School of Psychology, Deakin University, Providence, Australia
| | - Alasdair Vance
- Department of Paediatrics, University of Melbourne, Melbourne, Australia
- School of Psychology, Deakin University, Providence, Australia
- Royal Children's Hospital, Parkville, Australia
| |
Collapse
|
28
|
Chen J, Zhang X, Qu Y, Peng Y, Song Y, Zhuo C, Zou S, Tian H. Exploring neurometabolic alterations in bipolar disorder with suicidal ideation based on proton magnetic resonance spectroscopy and machine learning technology. Front Neurosci 2022; 16:944585. [PMID: 36161155 PMCID: PMC9500192 DOI: 10.3389/fnins.2022.944585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Accepted: 08/04/2022] [Indexed: 11/13/2022] Open
Abstract
Bipolar disorder (BD) is associated with a high risk of suicide. We used proton magnetic resonance spectroscopy (1H-MRS) to detect biochemical metabolite ratios in the bilateral prefrontal white matter (PWM) and hippocampus in 32 BD patients with suicidal ideation (SI) and 18 BD patients without SI, identified potential brain biochemical differences and used abnormal metabolite ratios to predict the severity of suicide risk based on the support vector machine (SVM) algorithm. Furthermore, we analyzed the correlations between biochemical metabolites and clinical variables in BD patients with SI. There were three main findings: (1) the highest classification accuracy of 88% and an area under the curve of 0.9 were achieved in distinguishing BD patients with and without SI, with N-acetyl aspartate (NAA)/creatine (Cr), myo-inositol (mI)/Cr values in the bilateral PWM, NAA/Cr and choline (Cho)/Cr values in the left hippocampus, and Cho/Cr values in the right hippocampus being the features contributing the most; (2) the above seven features could be used to predict Self-rating Idea of Suicide Scale scores (r = 0.4261, p = 0.0302); and (3) the level of neuronal function in the left hippocampus may be related to the duration of illness, the level of membrane phospholipid catabolism in the left hippocampus may be related to the severity of depression, and the level of inositol metabolism in the left PWM may be related to the age of onset in BD patients with SI. Our results showed that the combination of multiple brain biochemical metabolites could better predict the risk and severity of suicide in patients with BD and that there was a significant correlation between biochemical metabolic values and clinical variables in BD patients with SI.
Collapse
Affiliation(s)
- Jiayue Chen
- Department of Psychiatry, Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Department of Key Laboratory of Real Time Imaging of Brian Circuits in Psychiatry and Neurology (RTIBNP_Lab), Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Department of Psychiatry, School of Basic Medical Science, Tianjin Medical University, Tianjin, China
| | - Xinxin Zhang
- Department of Medical Imaging, Tianjin Children's Hospital, Tianjin, China
| | - Yuan Qu
- Department of Radiology, People's Hospital of Xinjiang Uygur Autonomous Region, Ürümqi, China
| | - Yanmin Peng
- School of Medical Imaging, Tianjin Medical University, Tianjin, China
- Tianjin Key Laboratory of Functional Imaging, Tianjin Medical University, Tianjin, China
| | - Yingchao Song
- School of Medical Imaging, Tianjin Medical University, Tianjin, China
- Tianjin Key Laboratory of Functional Imaging, Tianjin Medical University, Tianjin, China
| | - Chuanjun Zhuo
- Department of Psychiatry, Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Department of Key Laboratory of Real Time Imaging of Brian Circuits in Psychiatry and Neurology (RTIBNP_Lab), Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Department of Psychiatry, School of Basic Medical Science, Tianjin Medical University, Tianjin, China
- Psychiatric-Neuroimaging-Genetics and Comorbidity Laboratory (PNGC_Lab), Tianjin Anding Hospital, Mental Health Teaching Hospital of Tianjin Medical University, Tianjin, China
- Department of Psychiatry, First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
- Department of Psychiatry, First Hospital/First Clinical Medical College of Shanxi Medical University, Taiyuan, China
- *Correspondence: Chuanjun Zhuo
| | - Shaohong Zou
- Department of Clinical Psychology, People's Hospital of Xinjiang Uygur Autonomous Region, Ürümqi, China
- Shaohong Zou
| | - Hongjun Tian
- Department of Psychiatry, Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Department of Key Laboratory of Real Time Imaging of Brian Circuits in Psychiatry and Neurology (RTIBNP_Lab), Tianjin Fourth Center Hospital, The Fourth Central Clinical College, Tianjin Medical University, Tianjin, China
- Hongjun Tian
| |
Collapse
|
29
|
Tejavibulya L, Rolison M, Gao S, Liang Q, Peterson H, Dadashkarimi J, Farruggia MC, Hahn CA, Noble S, Lichenstein SD, Pollatou A, Dufford AJ, Scheinost D. Predicting the future of neuroimaging predictive models in mental health. Mol Psychiatry 2022; 27:3129-3137. [PMID: 35697759 PMCID: PMC9708554 DOI: 10.1038/s41380-022-01635-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 05/09/2022] [Accepted: 05/18/2022] [Indexed: 12/11/2022]
Abstract
Predictive modeling using neuroimaging data has the potential to improve our understanding of the neurobiology underlying psychiatric disorders and putatively information interventions. Accordingly, there is a plethora of literature reviewing published studies, the mathematics underlying machine learning, and the best practices for using these approaches. As our knowledge of mental health and machine learning continue to evolve, we instead aim to look forward and "predict" topics that we believe will be important in current and future studies. Some of the most discussed topics in machine learning, such as bias and fairness, the handling of dirty data, and interpretable models, may be less familiar to the broader community using neuroimaging-based predictive modeling in psychiatry. In a similar vein, transdiagnostic research and targeting brain-based features for psychiatric intervention are modern topics in psychiatry that predictive models are well-suited to tackle. In this work, we target an audience who is a researcher familiar with the fundamental procedures of machine learning and who wishes to increase their knowledge of ongoing topics in the field. We aim to accelerate the utility and applications of neuroimaging-based predictive models for psychiatric research by highlighting and considering these topics. Furthermore, though not a focus, these ideas generalize to neuroimaging-based predictive modeling in other clinical neurosciences and predictive modeling with different data types (e.g., digital health data).
Collapse
Affiliation(s)
- Link Tejavibulya
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA.
| | - Max Rolison
- Child Study Center, Yale School of Medicine, New Haven, CT, USA
| | - Siyuan Gao
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, USA
| | - Qinghao Liang
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, USA
| | - Hannah Peterson
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Javid Dadashkarimi
- Department of Computer Science, Yale School of Engineering and Applied Science, New Haven, CT, USA
| | - Michael C Farruggia
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
| | - C Alice Hahn
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Stephanie Noble
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | | | - Angeliki Pollatou
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
| | - Alexander J Dufford
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Dustin Scheinost
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
- Child Study Center, Yale School of Medicine, New Haven, CT, USA
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, USA
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
- Wu Tsai Institute, Yale University, New Haven, CT, USA
| |
Collapse
|
30
|
Hoyniak CP, Bates JE, Catalina Camacho M, McQuillan ME, Whalen DJ, Staples AD, Rudasill KM, Deater-Deckard K. The physical home environment and sleep: What matters most for sleep in early childhood. JOURNAL OF FAMILY PSYCHOLOGY : JFP : JOURNAL OF THE DIVISION OF FAMILY PSYCHOLOGY OF THE AMERICAN PSYCHOLOGICAL ASSOCIATION (DIVISION 43) 2022; 36:757-769. [PMID: 35266772 PMCID: PMC9747092 DOI: 10.1037/fam0000977] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The physical home environment is thought to play a crucial role in facilitating healthy sleep in young children. However, relatively little is known about how various features of the physical home environment are associated with sleep in early childhood, and some of the recommendations clinicians make for improving child sleep environments are based on limited research evidence. The present study examined how observer and parent descriptions of the child's physical home environment were associated with child sleep, measured using actigraphy and parent's reports, across a year in early childhood. The study used a machine learning approach (elastic net regression) to specify which aspects of the physical home environment were most important for predicting five aspects of child sleep, sleep duration, sleep variability, sleep timing, sleep activity, and latency to fall asleep. The study included 546 toddlers (265 females) recruited at 30 months of age and reassessed at 36 and 42 months of age. Poorer quality physical home environments were associated with later sleep schedules, more variable sleep schedules, shorter sleep durations, and more parent-reported sleep problems in young children. The most important environmental predictors of sleep were room sharing with an adult, bed sharing, and quality of both the child's sleep space and the wider home environment. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
- Caroline P. Hoyniak
- Department of Psychiatry, Washington University in St. Louis School of Medicine, St. Louis, USA
| | - John E. Bates
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, USA
| | - M. Catalina Camacho
- Department of Psychiatry, Washington University in St. Louis School of Medicine, St. Louis, USA
| | - Maureen E. McQuillan
- Department of Pediatrics, Indiana University School of Medicine, Indianapolis, USA
| | - Diana J. Whalen
- Department of Psychiatry, Washington University in St. Louis School of Medicine, St. Louis, USA
| | | | | | - Kirby Deater-Deckard
- Department of Psychological and Brain Sciences, University of Massachusetts, Amherst, USA
| |
Collapse
|
31
|
Jiang R, Woo CW, Qi S, Wu J, Sui J. Interpreting Brain Biomarkers: Challenges and solutions in interpreting machine learning-based predictive neuroimaging. IEEE SIGNAL PROCESSING MAGAZINE 2022; 39:107-118. [PMID: 36712588 PMCID: PMC9880880 DOI: 10.1109/msp.2022.3155951] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Predictive modeling of neuroimaging data (predictive neuroimaging) for evaluating individual differences in various behavioral phenotypes and clinical outcomes is of growing interest. However, the field is experiencing challenges regarding the interpretability of the results. Approaches to defining the specific contribution of functional connections, regions, or networks in prediction models are urgently needed, which may help explore the underlying mechanisms. In this article, we systematically review the methods and applications for interpreting brain signatures derived from predictive neuroimaging based on a survey of 326 research articles. Strengths, limitations, and the suitable conditions for major interpretation strategies are also deliberated. In-depth discussion of common issues in existing literature and the corresponding recommendations to address these pitfalls are provided. We highly recommend exhaustive validation on the reliability and interpretability of the biomarkers across multiple datasets and contexts, which thereby could translate technical advances in neuroimaging into concrete improvements in precision medicine.
Collapse
Affiliation(s)
- Rongtao Jiang
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA, 06520
| | - Choong-Wan Woo
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea, 16419
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea, 16419
- Department of Intelligent Precision Healthcare Convergence, Sungkyunkwan University, Suwon, Korea, 16419
| | - Shile Qi
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China, 211106
| | - Jing Wu
- Department of Medical Oncology, Beijing You-An Hospital, Capital Medical University, Beijing, China, 100069
| | - Jing Sui
- State Key Laboratory of Brain Cognition and Learning, Beijing Normal University, Beijing, China, 100875
| |
Collapse
|
32
|
Baker MR, Padmaja DL, Puviarasi R, Mann S, Panduro-Ramirez J, Tiwari M, Samori IA. Implementing Critical Machine Learning (ML) Approaches for Generating Robust Discriminative Neuroimaging Representations Using Structural Equation Model (SEM). COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:6501975. [PMID: 35465018 PMCID: PMC9023163 DOI: 10.1155/2022/6501975] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 03/09/2022] [Accepted: 03/21/2022] [Indexed: 11/18/2022]
Abstract
Critical ML or CML is a critical approach development of the standard ML (SML) procedure. Conventional ML (ML) is being used in radiology departments where complex neuroimages are discriminated using ML technology. Radiologists and researchers found that sole decision by the ML algorithms is not accurate enough to implement the treatment procedure. Thus, an intelligent decision is required further by the radiologists after evaluating the ML outcomes. The current research is based on the critical ML, where radiologists' critical thinking ability, IQ (intelligence quotient), and experience in radiology have been examined to understand how these factors affect the accuracy of neuroimaging discrimination. A primary quantitative survey has been carried out, and the data were analysed in IBM SPSS. The results showed that experience in works has a positive impact on neuroimaging discrimination accuracy. IQ and trained ML are also responsible for improving the accuracy as well. Thus, radiologists with more experience in that field are able to improve the discriminative and diagnostic capability of CML.
Collapse
Affiliation(s)
- Mohammed Rashad Baker
- Department of Computer Techniques Engineering, College of Information Technology, Imam Ja'afar Al-Sadiq University, Baghdad, Iraq
| | - D. Lakshmi Padmaja
- Department of Information Technology, Anurag University, Hyderabad, Telangana State, India
| | - R. Puviarasi
- Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, Tamil Nadu, India
| | - Suman Mann
- Information Technology Department, Maharaja Surajmal Institute of Technology, New Delhi, India
| | | | - Mohit Tiwari
- Department of Computer Science and Engineering, Bharati Vidyapeeth's College of Engineering, A-4, Rohtak Road, Paschim Vihar, Delhi, India
| | | |
Collapse
|
33
|
Chaddad A, Li J, Lu Q, Li Y, Okuwobi IP, Tanougast C, Desrosiers C, Niazi T. Can Autism Be Diagnosed with Artificial Intelligence? A Narrative Review. Diagnostics (Basel) 2021; 11:2032. [PMID: 34829379 PMCID: PMC8618159 DOI: 10.3390/diagnostics11112032] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 10/31/2021] [Accepted: 10/31/2021] [Indexed: 11/16/2022] Open
Abstract
Radiomics with deep learning models have become popular in computer-aided diagnosis and have outperformed human experts on many clinical tasks. Specifically, radiomic models based on artificial intelligence (AI) are using medical data (i.e., images, molecular data, clinical variables, etc.) for predicting clinical tasks such as autism spectrum disorder (ASD). In this review, we summarized and discussed the radiomic techniques used for ASD analysis. Currently, the limited radiomic work of ASD is related to the variation of morphological features of brain thickness that is different from texture analysis. These techniques are based on imaging shape features that can be used with predictive models for predicting ASD. This review explores the progress of ASD-based radiomics with a brief description of ASD and the current non-invasive technique used to classify between ASD and healthy control (HC) subjects. With AI, new radiomic models using the deep learning techniques will be also described. To consider the texture analysis with deep CNNs, more investigations are suggested to be integrated with additional validation steps on various MRI sites.
Collapse
Affiliation(s)
- Ahmad Chaddad
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
- The Laboratory for Imagery, Vision and Artificial Intelligence, École de Technologie Supérieure (ETS), Montreal, QC H3C 1K3, Canada;
| | - Jiali Li
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Qizong Lu
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Yujie Li
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Idowu Paul Okuwobi
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Camel Tanougast
- Laboratoire de Conception, Optimisation et Modélisation des Systèmes, University of Lorraine, 57070 Metz, France;
| | - Christian Desrosiers
- The Laboratory for Imagery, Vision and Artificial Intelligence, École de Technologie Supérieure (ETS), Montreal, QC H3C 1K3, Canada;
| | - Tamim Niazi
- Lady Davis Institute for Medical Research, McGill University, Montreal, QC H3T 1E2, Canada;
| |
Collapse
|
34
|
Prediction of tuberous sclerosis-associated neurocognitive disorders and seizures via machine learning of structural magnetic resonance imaging. Neuroradiology 2021; 64:611-620. [PMID: 34532765 DOI: 10.1007/s00234-021-02789-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Accepted: 08/06/2021] [Indexed: 10/20/2022]
Abstract
PURPOSE Tuberous sclerosis complex (TSC) is a genetic disorder characterized by multiorgan hamartomas, including cerebral lesions, with seizures as a common presentation. Most TSC patients will also experience neurocognitive comorbidities. Our objective was to use machine learning techniques incorporating clinical and imaging data to predict the occurrence of major neurocognitive disorders and seizures in TSC patients. METHODS A cohort of TSC patients were enrolled in this retrospective study. Clinical data included genetic, demographic, and seizure characteristics. Imaging parameters included the number, characteristics, and location of cortical tubers and the presence of subependymal nodules, SEGAs, and cerebellar tubers. A random forest machine learning scheme was used to predict seizures and neurodevelopmental delay or intellectual developmental disability. Prediction ability was assessed by the area-under-the-curve of receiver-operating-characteristics (AUC-ROC) of ten-fold cross-validation training set and an independent validation set. RESULTS The study population included 77 patients, 55% male (17.1 ± 11.7 years old). The model achieved AUC-ROC of 0.72 ± 0.1 and 0.68 in the training and internal validation datasets, respectively, for predicting neurocognitive comorbidity. Performance was limited in predicting seizures (AUC-ROC of 0.54 ± 0.19 and 0.71 in the training and internal validation datasets, respectively). The integration of seizure characteristics into the model improved the prediction of neurocognitive comorbidity with AUC-ROC of 0.84 ± 0.07 and 0.75 in the training and internal validation datasets, respectively. CONCLUSIONS This proof of concept study shows that it is possible to achieve a reasonable prediction of major neurocognitive morbidity in TSC patients using structural brain imaging and machine learning techniques. These tools can help clinicians identify subgroups of TSC patients with an increased risk of developing neurocognitive comorbidities.
Collapse
|
35
|
Kwak S, Kim H, Kim H, Youm Y, Chey J. Distributed functional connectivity predicts neuropsychological test performance among older adults. Hum Brain Mapp 2021; 42:3305-3325. [PMID: 33960591 PMCID: PMC8193511 DOI: 10.1002/hbm.25436] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2020] [Revised: 03/23/2021] [Accepted: 03/25/2021] [Indexed: 01/30/2023] Open
Abstract
Neuropsychological test is an essential tool in assessing cognitive and functional changes associated with late-life neurocognitive disorders. Despite the utility of the neuropsychological test, the brain-wide neural basis of the test performance remains unclear. Using the predictive modeling approach, we aimed to identify the optimal combination of functional connectivities that predicts neuropsychological test scores of novel individuals. Resting-state functional connectivity and neuropsychological tests included in the OASIS-3 dataset (n = 428) were used to train the predictive models, and the identified models were iteratively applied to the holdout internal test set (n = 216) and external test set (KSHAP, n = 151). We found that the connectivity-based predicted score tracked the actual behavioral test scores (r = 0.08-0.44). The predictive models utilizing most of the connectivity features showed better accuracy than those composed of focal connectivity features, suggesting that its neural basis is largely distributed across multiple brain systems. The discriminant and clinical validity of the predictive models were further assessed. Our results suggest that late-life neuropsychological test performance can be formally characterized with distributed connectome-based predictive models, and further translational evidence is needed when developing theoretically valid and clinically incremental predictive models.
Collapse
Affiliation(s)
- Seyul Kwak
- Department of PsychologySeoul National UniversitySeoulRepublic of Korea
| | - Hairin Kim
- Department of PsychologySeoul National UniversitySeoulRepublic of Korea
| | - Hoyoung Kim
- Department of PsychologyChonbuk National UniversityJeonjuRepublic of Korea
| | - Yoosik Youm
- Department of SociologyYonsei UniversitySeoulRepublic of Korea
| | - Jeanyung Chey
- Department of PsychologySeoul National UniversitySeoulRepublic of Korea
| |
Collapse
|
36
|
Zhou SK, Greenspan H, Davatzikos C, Duncan JS, van Ginneken B, Madabhushi A, Prince JL, Rueckert D, Summers RM. A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2021; 109:820-838. [PMID: 37786449 PMCID: PMC10544772 DOI: 10.1109/jproc.2021.3054390] [Citation(s) in RCA: 202] [Impact Index Per Article: 67.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Since its renaissance, deep learning has been widely used in various medical imaging tasks and has achieved remarkable success in many medical imaging applications, thereby propelling us into the so-called artificial intelligence (AI) era. It is known that the success of AI is mostly attributed to the availability of big data with annotations for a single task and the advances in high performance computing. However, medical imaging presents unique challenges that confront deep learning approaches. In this survey paper, we first present traits of medical imaging, highlight both clinical needs and technical challenges in medical imaging, and describe how emerging trends in deep learning are addressing these issues. We cover the topics of network architecture, sparse and noisy labels, federating learning, interpretability, uncertainty quantification, etc. Then, we present several case studies that are commonly found in clinical practice, including digital pathology and chest, brain, cardiovascular, and abdominal imaging. Rather than presenting an exhaustive literature survey, we instead describe some prominent research highlights related to these case study applications. We conclude with a discussion and presentation of promising future directions.
Collapse
Affiliation(s)
- S Kevin Zhou
- School of Biomedical Engineering, University of Science and Technology of China and Institute of Computing Technology, Chinese Academy of Sciences
| | - Hayit Greenspan
- Biomedical Engineering Department, Tel-Aviv University, Israel
| | - Christos Davatzikos
- Radiology Department and Electrical and Systems Engineering Department, University of Pennsylvania, USA
| | - James S Duncan
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University
| | | | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University and Louis Stokes Cleveland Veterans Administration Medical Center, USA
| | - Jerry L Prince
- Electrical and Computer Engineering Department, Johns Hopkins University, USA
| | - Daniel Rueckert
- Klinikum rechts der Isar, TU Munich, Germany and Department of Computing, Imperial College, UK
| | | |
Collapse
|
37
|
Xiao Y, Lin Y, Ma J, Qian J, Ke Z, Li L, Yi Y, Zhang J, Dai Z. Predicting visual working memory with multimodal magnetic resonance imaging. Hum Brain Mapp 2021; 42:1446-1462. [PMID: 33277955 PMCID: PMC7927291 DOI: 10.1002/hbm.25305] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2020] [Revised: 11/18/2020] [Accepted: 11/21/2020] [Indexed: 12/15/2022] Open
Abstract
The indispensability of visual working memory (VWM) in human daily life suggests its importance in higher cognitive functions and neurological diseases. However, despite the extensive research efforts, most findings on the neural basis of VWM are limited to a unimodal context (either structure or function) and have low generalization. To address the above issues, this study proposed the usage of multimodal neuroimaging in combination with machine learning to reveal the neural mechanism of VWM across a large cohort (N = 547). Specifically, multimodal magnetic resonance imaging features extracted from voxel-wise amplitude of low-frequency fluctuations, gray matter volume, and fractional anisotropy were used to build an individual VWM capacity prediction model through a machine learning pipeline, including the steps of feature selection, relevance vector regression, cross-validation, and model fusion. The resulting model exhibited promising predictive performance on VWM (r = .402, p < .001), and identified features within the subcortical-cerebellum network, default mode network, motor network, corpus callosum, anterior corona radiata, and external capsule as significant predictors. The main results were then compared with those obtained on emotional regulation and fluid intelligence using the same pipeline, confirming the specificity of our findings. Moreover, the main results maintained well under different cross-validation regimes and preprocess strategies. These findings, while providing richer evidence for the importance of multimodality in understanding cognitive functions, offer a solid and general foundation for comprehensively understanding the VWM process from the top down.
Collapse
Affiliation(s)
- Yu Xiao
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Ying Lin
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Junji Ma
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Jiehui Qian
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Zijun Ke
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Liangfang Li
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Yangyang Yi
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Jinbo Zhang
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Cam‐CAN
- Cambridge Centre for Ageing and Neuroscience (Cam‐CAN)University of Cambridge and MRC Cognition and Brain Sciences UnitCambridgeUK
| | - Zhengjia Dai
- Department of PsychologySun Yat‐sen UniversityGuangzhouChina
| |
Collapse
|
38
|
Vitale A, Villa R, Ugga L, Romeo V, Stanzione A, Cuocolo R. Artificial intelligence applied to neuroimaging data in Parkinsonian syndromes: Actuality and expectations. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:1753-1773. [PMID: 33757209 DOI: 10.3934/mbe.2021091] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Idiopathic Parkinson's Disease (iPD) is a common motor neurodegenerative disorder. It affects more frequently the elderly population, causing a significant emotional burden both for the patient and caregivers, due to the disease-related onset of motor and cognitive disabilities. iPD's clinical hallmark is the onset of cardinal motor symptoms such as bradykinesia, rest tremor, rigidity, and postural instability. However, these symptoms appear when the neurodegenerative process is already in an advanced stage. Furthermore, the greatest challenge is to distinguish iPD from other similar neurodegenerative disorders, "atypical parkinsonisms", such as Multisystem Atrophy, Progressive Supranuclear Palsy and Cortical Basal Degeneration, since they share many phenotypic manifestations, especially in the early stages. The diagnosis of these neurodegenerative motor disorders is essentially clinical. Consequently, the diagnostic accuracy mainly depends on the professional knowledge and experience of the physician. Recent advances in artificial intelligence have made it possible to analyze the large amount of clinical and instrumental information in the medical field. The application machine learning algorithms to the analysis of neuroimaging data appear to be a promising tool for identifying microstructural alterations related to the pathological process in order to explain the onset of symptoms and the spread of the neurodegenerative process. In this context, the search for quantitative biomarkers capable of identifying parkinsonian patients in the prodromal phases of the disease, of correctly distinguishing them from atypical parkinsonisms and of predicting clinical evolution and response to therapy represent the main goal of most current clinical research studies. Our aim was to review the recent literature and describe the current knowledge about the contribution given by machine learning applications to research and clinical management of parkinsonian syndromes.
Collapse
Affiliation(s)
- Annalisa Vitale
- Department of Advanced Biomedical Sciences, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| | - Rossella Villa
- Department of Advanced Biomedical Sciences, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| | - Lorenzo Ugga
- Department of Advanced Biomedical Sciences, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| | - Valeria Romeo
- Department of Advanced Biomedical Sciences, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| | - Arnaldo Stanzione
- Department of Advanced Biomedical Sciences, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| | - Renato Cuocolo
- Department of Clinical Medicine and Surgery, University of Naples "Federico Ⅱ", Via S. Pansini 5, 80131-Naples, Italy
| |
Collapse
|
39
|
Millar PR, Ances BM, Gordon BA, Benzinger TLS, Morris JC, Balota DA. Evaluating Cognitive Relationships with Resting-State and Task-driven Blood Oxygen Level-Dependent Variability. J Cogn Neurosci 2021; 33:279-302. [PMID: 33135966 PMCID: PMC7877897 DOI: 10.1162/jocn_a_01645] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Recent functional magnetic resonance imaging studies have reported that moment-to-moment variability in the blood oxygen level-dependent (BOLD) signal is positively associated with task performance and, thus, may reflect a behaviorally sensitive signal. However, it is not clear whether estimates of resting-state and task-driven BOLD variability are differentially related to cognition, as they may be driven by distinct sources of variance in the BOLD signal. Moreover, other studies have suggested that age differences in resting-state BOLD variability may be particularly sensitive to individual differences in cardiovascular, rather than neural, factors. In this study, we tested relationships between measures of behavioral task performance and BOLD variability during both resting-state and task-driven runs of a Stroop and an animacy judgment task in a large, well-characterized sample of cognitively normal middle-aged to older adults. Resting-state BOLD variability was related to composite measures of global cognition and attentional control, but these relationships were eliminated after correction for age or cardiovascular estimates. In contrast, task-driven BOLD variability was related to attentional control measured both inside and outside the scanner, and importantly, these relationships persisted after correction for age and cardiovascular measures. Overall, these results suggest that BOLD variability is a behaviorally sensitive signal. However, resting-state and task-driven estimates of BOLD variability may differ in the degree to which they are sensitive to age-related, cardiovascular, and neural mechanisms.
Collapse
Affiliation(s)
- Peter R Millar
- Department of Psychological & Brain Sciences, Washington University in St. Louis,Department of Neurology, Washington University in St. Louis,Peter R Millar, , 314-935-6524, One Brookings Drive, Campus Box 1125, St. Louis, MO 63130
| | - Beau M Ances
- Department of Neurology, Washington University in St. Louis,Department of Radiology, Washington University in St. Louis
| | - Brian A Gordon
- Department of Psychological & Brain Sciences, Washington University in St. Louis,Department of Radiology, Washington University in St. Louis
| | | | - John C Morris
- Department of Neurology, Washington University in St. Louis
| | - David A Balota
- Department of Psychological & Brain Sciences, Washington University in St. Louis,Department of Neurology, Washington University in St. Louis
| |
Collapse
|
40
|
A Comparative Analysis of Machine Learning classifiers for Dysphonia-based classification of Parkinson’s Disease. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS 2020. [DOI: 10.1007/s41060-020-00234-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
41
|
Millar PR, Ances BM, Gordon BA, Benzinger TLS, Fagan AM, Morris JC, Balota DA. Evaluating resting-state BOLD variability in relation to biomarkers of preclinical Alzheimer's disease. Neurobiol Aging 2020; 96:233-245. [PMID: 33039901 DOI: 10.1016/j.neurobiolaging.2020.08.007] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 07/21/2020] [Accepted: 08/10/2020] [Indexed: 02/09/2023]
Abstract
Recent functional magnetic resonance imaging studies have demonstrated that moment-to-moment variability in the blood oxygen level-dependent (BOLD) signal is related to age differences, cognition, and symptomatic Alzheimer's disease (AD). However, no studies have examined BOLD variability in the context of preclinical AD. We tested relationships between resting-state BOLD variability and biomarkers of amyloidosis, tauopathy, and neurodegeneration in a large (N = 321), well-characterized sample of cognitively normal adults (age = 39-93), using multivariate machine learning techniques. Furthermore, we controlled for cardiovascular health factors, which may contaminate resting-state BOLD variability estimates. BOLD variability, particularly in the default mode network, was related to cerebrospinal fluid (CSF) amyloid-β42 but was not related to CSF phosphorylated tau-181. Furthermore, BOLD variability estimates were also related to markers of neurodegeneration, including CSF neurofilament light protein, hippocampal volume, and a cortical thickness composite. Notably, relationships with hippocampal volume and cortical thickness survived correction for cardiovascular health and also contributed to age-related differences in BOLD variability. Thus, BOLD variability may be sensitive to preclinical pathology, including amyloidosis and neurodegeneration in AD-sensitive areas.
Collapse
Affiliation(s)
- Peter R Millar
- Department of Psychological & Brain Sciences, St. Louis, MO, USA; Department of Neurology, St. Louis, MO, USA.
| | - Beau M Ances
- Department of Neurology, St. Louis, MO, USA; Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Brian A Gordon
- Department of Psychological & Brain Sciences, St. Louis, MO, USA; Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | | | | | | | - David A Balota
- Department of Psychological & Brain Sciences, St. Louis, MO, USA; Department of Neurology, St. Louis, MO, USA
| |
Collapse
|
42
|
Paulus MP. Pragmatic and Explanatory Progress Using Statistical Models of Disturbed Mind, Brain, and Behavior to Improve Mental Health. BIOLOGICAL PSYCHIATRY: COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2020; 5:723-725. [PMID: 32771178 DOI: 10.1016/j.bpsc.2020.06.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Accepted: 06/09/2020] [Indexed: 11/30/2022]
|
43
|
Barch DM. Understanding the Nature and Treatment of Psychopathology: Can the Data Guide the Way? BIOLOGICAL PSYCHIATRY: COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2020; 5:719-722. [PMID: 32771177 DOI: 10.1016/j.bpsc.2020.06.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 06/30/2020] [Indexed: 10/23/2022]
Affiliation(s)
- Deanna M Barch
- Departments of Psychological and Brain Sciences, Psychiatry, and Radiology, Washington University in St. Louis, St. Louis, Missouri.
| |
Collapse
|
44
|
Millar PR, Petersen SE, Ances BM, Gordon BA, Benzinger TLS, Morris JC, Balota DA. Evaluating the Sensitivity of Resting-State BOLD Variability to Age and Cognition after Controlling for Motion and Cardiovascular Influences: A Network-Based Approach. Cereb Cortex 2020; 30:5686-5701. [PMID: 32515824 DOI: 10.1093/cercor/bhaa138] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Revised: 05/01/2020] [Accepted: 05/01/2020] [Indexed: 12/14/2022] Open
Abstract
Recent functional magnetic resonance imaging (fMRI) studies report that moment-to-moment variability in the BOLD signal is related to differences in age and cognition and, thus, may be sensitive to age-dependent decline. However, head motion and/or cardiovascular health (CVH) may contaminate these relationships. We evaluated relationships between resting-state BOLD variability, age, and cognition, after characterizing and controlling for motion-related and cardiovascular influences, including pulse, blood pressure, BMI, and white matter hyperintensities (WMH), in a large (N = 422) resting-state fMRI sample of cognitively normal individuals (age 43-89). We found that resting-state BOLD variability was negatively related to age and positively related to cognition after maximally controlling for head motion. Age relationships also survived correction for CVH, but were greatly reduced when correcting for WMH alone. Our results suggest that network-based machine learning analyses of resting-state BOLD variability might yield reliable, sensitive measures to characterize age-related decline across a broad range of networks. Age-related differences in resting-state BOLD variability may be largely sensitive to processes related to WMH burden.
Collapse
Affiliation(s)
- Peter R Millar
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Steven E Petersen
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA.,Department of Neurology, Washington University in St. Louis, St. Louis, MO 63130, USA.,Department of Radiology, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Beau M Ances
- Department of Neurology, Washington University in St. Louis, St. Louis, MO 63130, USA.,Department of Radiology, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Brian A Gordon
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA.,Department of Radiology, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Tammie L S Benzinger
- Department of Radiology, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - John C Morris
- Department of Neurology, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - David A Balota
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA.,Department of Neurology, Washington University in St. Louis, St. Louis, MO 63130, USA
| |
Collapse
|
45
|
Black KJ, Kim S, Schlaggar BL, Greene DJ. The New Tics study: A Novel Approach to Pathophysiology and Cause of Tic Disorders. JOURNAL OF PSYCHIATRY AND BRAIN SCIENCE 2020; 5:e200012. [PMID: 32587895 PMCID: PMC7316401 DOI: 10.20900/jpbs.20200012] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
We report on the ongoing project "The New Tics Study: A Novel Approach to Pathophysiology and Cause of Tic Disorders," describing the work completed to date, ongoing studies and long-term goals. The overall goals of this research are to study the pathophysiology of Provisional Tic Disorder, and to study tic remission (or improvement) in a prospective fashion. Preliminary data collection for the project began almost 10 years ago. The current study is nearing completion of its third year, and has already reported several novel and important results. First, surprisingly, at least 90% of children who had experienced tics for only a mean of 3 months still had tics at the 12-month anniversary of their first tic, though in some cases tics were seen only with remote video observation of the child sitting alone. Thus almost all of them now had a DSM-5 diagnosis of Tourette's Disorder or Persistent (Chronic) Tic Disorder. Baseline clinical features that predicted 12-month outcome included tic severity, subsyndromal autism spectrum symptoms, an anxiety disorder, and a history of 3 or more phonic tics. Second, we found that poorer tic suppression ability when immediately rewarded for suppression predicted greater tic severity at follow-up. Third, striatal volumes did not predict outcome as hypothesized, but a larger hippocampus at baseline predicted worse severity at follow-up. Enrollment and data collection continue, including functional connectivity MRI (fcMRI) imaging, and additional analyses are planned once the full sample is enrolled.
Collapse
Affiliation(s)
- Kevin J. Black
- Departments of Psychiatry, Neurology, Radiology and Neuroscience, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, USA
| | - Soyoung Kim
- Departments of Psychiatry and Radiology, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, USA
| | - Bradley L. Schlaggar
- Kennedy Krieger Institute, Baltimore, MD 21205; and Departments of Neurology and Pediatrics, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Deanna J. Greene
- Departments of Psychiatry and Radiology, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, USA
| |
Collapse
|