1
|
Mukerji SS, Petersen KJ, Pohl KM, Dastgheyb RM, Fox HS, Bilder RM, Brouillette MJ, Gross AL, Scott-Sheldon LAJ, Paul RH, Gabuzda D. Machine Learning Approaches to Understand Cognitive Phenotypes in People With HIV. J Infect Dis 2023; 227:S48-S57. [PMID: 36930638 PMCID: PMC10022709 DOI: 10.1093/infdis/jiac293] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/18/2023] Open
Abstract
Cognitive disorders are prevalent in people with HIV (PWH) despite antiretroviral therapy. Given the heterogeneity of cognitive disorders in PWH in the current era and evidence that these disorders have different etiologies and risk factors, scientific rationale is growing for using data-driven models to identify biologically defined subtypes (biotypes) of these disorders. Here, we discuss the state of science using machine learning to understand cognitive phenotypes in PWH and their associated comorbidities, biological mechanisms, and risk factors. We also discuss methods, example applications, challenges, and what will be required from the field to successfully incorporate machine learning in research on cognitive disorders in PWH. These topics were discussed at the National Institute of Mental Health meeting on "Biotypes of CNS Complications in People Living with HIV" held in October 2021. These ongoing research initiatives seek to explain the heterogeneity of cognitive phenotypes in PWH and their associated biological mechanisms to facilitate clinical management and tailored interventions.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | - Dana Gabuzda
- Correspondence: Dana Gabuzda, MD, Department of Cancer Immunology and Virology, Dana-Farber Cancer Institute, Center for Life Science 1010, 450 Brookline Avenue, Boston, MA 02215 ()
| |
Collapse
|
2
|
Pombo G, Gray R, Cardoso MJ, Ourselin S, Rees G, Ashburner J, Nachev P. Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models. Med Image Anal 2023; 84:102723. [PMID: 36542907 PMCID: PMC10591114 DOI: 10.1016/j.media.2022.102723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 11/21/2022] [Accepted: 12/02/2022] [Indexed: 12/12/2022]
Abstract
We describe CounterSynth, a conditional generative model of diffeomorphic deformations that induce label-driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data augmentations for downstream discriminative modelling tasks where fidelity is limited by data imbalance, distributional instability, confounding, or underspecification, and exhibits inequitable performance across distinct subpopulations. Focusing on demographic attributes, we evaluate the quality of synthesised counterfactuals with voxel-based morphometry, classification and regression of the conditioning attributes, and the Fréchet inception distance. Examining downstream discriminative performance in the context of engineered demographic imbalance and confounding, we use UK Biobank and OASIS magnetic resonance imaging data to benchmark CounterSynth augmentation against current solutions to these problems. We achieve state-of-the-art improvements, both in overall fidelity and equity. The source code for CounterSynth is available at https://github.com/guilherme-pombo/CounterSynth.
Collapse
Affiliation(s)
- Guilherme Pombo
- UCL Queen Square Institute of Neurology, University College London, London, UK.
| | - Robert Gray
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - M Jorge Cardoso
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | - Sebastien Ourselin
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | - Geraint Rees
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - John Ashburner
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Parashkev Nachev
- UCL Queen Square Institute of Neurology, University College London, London, UK
| |
Collapse
|
3
|
Identification of key somatic oncogenic mutation based on a confounder-free causal inference model. PLoS Comput Biol 2022; 18:e1010529. [PMID: 36137089 PMCID: PMC9499235 DOI: 10.1371/journal.pcbi.1010529] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 08/31/2022] [Indexed: 11/30/2022] Open
Abstract
Abnormal cell proliferation and epithelial-mesenchymal transition (EMT) are the essential events that induce cancer initiation and progression. A fundamental goal in cancer research is to develop an efficient method to detect mutational genes capable of driving cancer. Although several computational methods have been proposed to identify these key mutations, many of them focus on the association between genetic mutations and functional changes in relevant biological processes, but not their real causality. Causal effect inference provides a way to estimate the real induce effect of a certain mutation on vital biological processes of cancer initiation and progression, through addressing the confounder bias due to neutral mutations and unobserved latent variables. In this study, integrating genomic and transcriptomic data, we construct a novel causal inference model based on a deep variational autoencoder to identify key oncogenic somatic mutations. Applied to 10 cancer types, our method quantifies the causal effect of genetic mutations on cell proliferation and EMT by reducing both observed and unobserved confounding biases. The experimental results indicate that genes with higher mutation frequency do not necessarily mean they are more potent in inducing cancer and promoting cancer development. Moreover, our study fills a gap in the use of machine learning for causal inference to identify oncogenic mutations. Identifying key mutations of cancers is helpful to better understand the mechanisms of cancer cell transformation and is critical for therapeutic approaches. Besides sequence and structure-based computational approaches, some functional impact-based methods which consider the association between mutation events and the activity of cancer-related biological processes have also been developed to detect key mutations. However, these methods mainly consider the correlation but ignore that the correlation is far from causality due to the existence of observed and unobserved confounding factors. We develop a confounder-free machine learning-based causal inference framework to estimate the causal effect of mutations on abnormal cell proliferation and epithelial-mesenchymal transition (EMT). It fills a gap in the use of causal mechanisms to discover potential driver mutations in cancer biological systems. Applying our method to 10 cancer types, the identified key mutations are highly consistent with public well-verified ones. Additionally, some new key mutations have also been discovered.
Collapse
|
4
|
Khobo IL, Jankiewicz M, Holmes MJ, Little F, Cotton MF, Laughton B, van der Kouwe AJW, Moreau A, Nwosu E, Meintjes EM, Robertson FC. Multimodal magnetic resonance neuroimaging measures characteristic of early cART-treated pediatric HIV: A feature selection approach. Hum Brain Mapp 2022; 43:4128-4144. [PMID: 35575438 PMCID: PMC9374890 DOI: 10.1002/hbm.25907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Revised: 04/03/2022] [Accepted: 04/26/2022] [Indexed: 11/09/2022] Open
Abstract
Children with perinatally acquired HIV (CPHIV) have poor cognitive outcomes despite early combination antiretroviral therapy (cART). While CPHIV-related brain alterations can be investigated separately using proton magnetic resonance spectroscopy (1 H-MRS), structural magnetic resonance imaging (sMRI), diffusion tensor imaging (DTI), and functional MRI (fMRI), a set of multimodal MRI measures characteristic of children on cART has not been previously identified. We used the embedded feature selection of a logistic elastic-net (EN) regularization to select neuroimaging measures that distinguish CPHIV from controls and measured their classification performance via the area under the receiver operating characteristic curve (AUC) using repeated cross validation. We also wished to establish whether combining MRI modalities improved the models. In single modality analysis, sMRI volumes performed best followed by DTI, whereas individual EN models on spectroscopic, gyrification, and cortical thickness measures showed no class discrimination capability. Adding DTI and 1 H-MRS in basal measures to sMRI volumes produced the highest classification performancevalidation accuracy = 85 % AUC = 0.80 . The best multimodal MRI set consisted of 22 DTI and sMRI volume features, which included reduced volumes of the bilateral globus pallidus and amygdala, as well as increased mean diffusivity (MD) and radial diffusivity (RD) in the right corticospinal tract in cART-treated CPHIV. Consistent with previous studies of CPHIV, select subcortical volumes obtained from sMRI provide reasonable discrimination between CPHIV and controls. This may give insight into neuroimaging measures that are relevant in understanding the effects of HIV on the brain, thereby providing a starting point for evaluating their link with cognitive performance in CPHIV.
Collapse
Affiliation(s)
- Isaac L. Khobo
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
| | - Marcin Jankiewicz
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
- Cape Universities Body Imaging CenterUniversity of Cape TownCape TownSouth Africa
| | - Martha J. Holmes
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
| | - Francesca Little
- Department of Statistical SciencesUniversity of Cape TownCape TownSouth Africa
| | - Mark F. Cotton
- Department of Pediatrics & Child Health, Family Center for Research with Ubuntu, Tygerberg HospitalStellenbosch UniversityCape TownSouth Africa
| | - Barbara Laughton
- Department of Pediatrics & Child Health, Family Center for Research with Ubuntu, Tygerberg HospitalStellenbosch UniversityCape TownSouth Africa
| | - Andre J. W. van der Kouwe
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- A.A. Martinos Centre for Biomedical ImagingMassachusetts General HospitalBostonMassachusettsUSA
- Department of RadiologyHarvard Medical SchoolBostonMassachusettsUSA
| | | | - Emmanuel Nwosu
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
| | - Ernesta M. Meintjes
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
- Cape Universities Body Imaging CenterUniversity of Cape TownCape TownSouth Africa
| | - Frances C. Robertson
- Division of Biomedical Engineering, Department of Human Biology, Biomedical Engineering Research CenterUniversity of Cape TownCape TownSouth Africa
- Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
- Cape Universities Body Imaging CenterUniversity of Cape TownCape TownSouth Africa
| |
Collapse
|
5
|
Vento A, Zhao Q, Paul R, Pohl K, Adeli E. A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Models. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13433:387-397. [PMID: 36331278 PMCID: PMC9629333 DOI: 10.1007/978-3-031-16437-8_37] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Translating the use of modern machine learning algorithms into clinical applications requires settling challenges related to explain-ability and management of nuanced confounding factors. To suitably interpret the results, removing or explaining the effect of confounding variables (or metadata) is essential. Confounding variables affect the relationship between input training data and target outputs. Accordingly, when we train a model on such data, confounding variables will bias the distribution of the learned features. A recent promising solution, Meta-Data Normalization (MDN), estimates the linear relationship between the metadata and each feature based on a non-trainable closed-form solution. However, this estimation is confined by the sample size of a mini-batch and thereby may result in an oscillating performance. In this paper, we extend the MDN method by applying a Penalty approach (referred to as PDMN). We cast the problem into a bi-level nested optimization problem. We then approximate that objective using a penalty method so that the linear parameters within the MDN layer are trainable and learned on all samples. This enables PMDN to be plugged into any architectures, even those unfit to run batch-level operations such as transformers and recurrent models. We show improvement in model accuracy and independence from the confounders using PMDN over MDN in a synthetic experiment and a multi-label, multi-site classification of magnetic resonance images.
Collapse
Affiliation(s)
| | | | - Robert Paul
- Missouri Institute of Mental Health, St. Louis MO 63121, USA
| | - Kilian Pohl
- Stanford University, Stanford CA 94305, USA
- SRI International, Menlo Park CA 94025, USA
| | | |
Collapse
|
6
|
Zhang J, Zhao Q, Adeli E, Pfefferbaum A, Sullivan EV, Paul R, Valcour V, Pohl KM. Multi-label, multi-domain learning identifies compounding effects of HIV and cognitive impairment. Med Image Anal 2022; 75:102246. [PMID: 34706304 PMCID: PMC8678333 DOI: 10.1016/j.media.2021.102246] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 09/12/2021] [Accepted: 09/14/2021] [Indexed: 01/03/2023]
Abstract
Older individuals infected by Human Immunodeficiency Virus (HIV) are at risk for developing HIV-Associated Neurocognitive Disorder (HAND), i.e., from reduced cognitive functioning similar to HIV-negative individuals with Mild Cognitive Impairment (MCI) or to Alzheimer's Disease (AD) if more severely affected. Incompletely understood is how brain structure can serve to differentiate cognitive impairment (CI) in the HIV-positive (i.e., HAND) from the HIV-negative cohort (i.e., MCI and AD). To that end, we designed a multi-label classifier that labels the structural magnetic resonance images (MRI) of individuals by their HIV and CI status via two binary variables. Proper training of such an approach traditionally requires well-curated datasets containing large number of samples for each of the corresponding four cohorts (healthy controls, CI HIV-negative adults a.k.a. CI-only, HIV-positive patients without CI a.k.a. HIV-only, and HAND). Because of the rarity of such datasets, we proposed to improve training of the multi-label classifier via a multi-domain learning scheme that also incorporates domain-specific classifiers on auxiliary single-label datasets specific to either binary label. Specifically, we complement the training dataset of MRIs of the four cohorts (Control: 156, CI-only: 335, HIV-only: 37, HAND: 145) acquired by the Memory and Aging Center at the University of California - San Francisco with a CI-specific dataset only containing MRIs of HIV-negative subjects (Controls: 229, CI-only: 397) from the Alzheimer's Disease Neuroimaging Initiative and an HIV-specific dataset (Controls: 75, HIV-only: 75) provided by SRI International. Based on cross-validation on the UCSF dataset, the multi-domain and multi-label learning strategy leads to superior classification accuracy compared with one-domain or multi-class learning approaches, specifically for the undersampled HIV-only cohort. The 'prediction logits' of CI computed by the multi-label formulation also successfully stratify motor performance among the HIV-positive subjects (including HAND). Finally, brain patterns driving the subject-level predictions across all four cohorts characterize the independent and compounding effects of HIV and CI in the HAND cohort.
Collapse
Affiliation(s)
- Jiequan Zhang
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305
| | - Qingyu Zhao
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305
| | - Ehsan Adeli
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305
| | - Adolf Pfefferbaum
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305,Center for Biomedical Sciences, SRI International, Menlo Park, CA 94205
| | - Edith V. Sullivan
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305
| | - Robert Paul
- Missouri Institute of Mental Health - St. Louis, MO 63134
| | - Victor Valcour
- Memory and Aging Center, University of California - San Francisco, San Fransisco, CA 94158
| | - Kilian M. Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305,Center for Biomedical Sciences, SRI International, Menlo Park, CA 94205,Corresponding author: (Kilian M. Pohl)
| |
Collapse
|
7
|
Adeli E, Zhao Q, Pfefferbaum A, Sullivan EV, Fei-Fei L, Niebles JC, Pohl KM. Representation Learning with Statistical Independence to Mitigate Bias. IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION. IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION 2021; 2021:2512-2522. [PMID: 34522832 PMCID: PMC8436589 DOI: 10.1109/wacv48630.2021.00256] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between variables in medical studies to the bias of race in gender or face recognition systems. Controlling for all types of biases in the dataset curation stage is cumbersome and sometimes impossible. The alternative is to use the available data and build models incorporating fair representation learning. In this paper, we propose such a model based on adversarial training with two competing objectives to learn features that have (1) maximum discriminative power with respect to the task and (2) minimal statistical mean dependence with the protected (bias) variable(s). Our approach does so by incorporating a new adversarial loss function that encourages a vanished correlation between the bias and the learned features. We apply our method to synthetic data, medical images (containing task bias), and a dataset for gender classification (containing dataset bias). Our results show that the learned features by our method not only result in superior prediction performance but also are unbiased.
Collapse
Affiliation(s)
- Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford University, CA 94305.,Department of Computer Science, Stanford University, CA 94305
| | - Qingyu Zhao
- Department of Psychiatry and Behavioral Sciences, Stanford University, CA 94305
| | - Adolf Pfefferbaum
- Department of Psychiatry and Behavioral Sciences, Stanford University, CA 94305.,Center for Biomedical Sciences, SRI International, Menlo Park, CA 94205
| | - Edith V Sullivan
- Department of Psychiatry and Behavioral Sciences, Stanford University, CA 94305
| | - Li Fei-Fei
- Department of Computer Science, Stanford University, CA 94305
| | | | - Kilian M Pohl
- Department of Psychiatry and Behavioral Sciences, Stanford University, CA 94305.,Center for Biomedical Sciences, SRI International, Menlo Park, CA 94205
| |
Collapse
|
8
|
Ouyang J, Zhao Q, Sullivan EV, Pfefferbaum A, Tapert SF, Adeli E, Pohl KM. Longitudinal Pooling & Consistency Regularization to Model Disease Progression From MRIs. IEEE J Biomed Health Inform 2021; 25:2082-2092. [PMID: 33270567 PMCID: PMC8221531 DOI: 10.1109/jbhi.2020.3042447] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Many neurological diseases are characterized by gradual deterioration of brain structure andfunction. Large longitudinal MRI datasets have revealed such deterioration, in part, by applying machine and deep learning to predict diagnosis. A popular approach is to apply Convolutional Neural Networks (CNN) to extract informative features from each visit of the longitudinal MRI and then use those features to classify each visit via Recurrent Neural Networks (RNNs). Such modeling neglects the progressive nature of the disease, which may result in clinically implausible classifications across visits. To avoid this issue, we propose to combine features across visits by coupling feature extraction with a novel longitudinal pooling layer and enforce consistency of the classification across visits in line with disease progression. We evaluate the proposed method on the longitudinal structural MRIs from three neuroimaging datasets: Alzheimer's Disease Neuroimaging Initiative (ADNI, N=404), a dataset composed of 274 normal controls and 329 patients with Alcohol Use Disorder (AUD), and 255 youths from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA). In allthree experiments our method is superior to other widely used approaches for longitudinal classification thus making a unique contribution towards more accurate tracking of the impact of conditions on the brain. The code is available at https://github.com/ouyangjiahong/longitudinal-pooling.
Collapse
|
9
|
Lu M, Zhao Q, Zhang J, Pohl KM, Fei-Fei L, Niebles JC, Adeli E. Metadata Normalization. PROCEEDINGS. IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION 2021; 2021:10912-10922. [PMID: 34776724 PMCID: PMC8589298 DOI: 10.1109/cvpr46437.2021.01077] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Batch Normalization (BN) and its variants have delivered tremendous success in combating the covariate shift induced by the training step of deep learning methods. While these techniques normalize feature distributions by standardizing with batch statistics, they do not correct the influence on features from extraneous variables or multiple distributions. Such extra variables, referred to as metadata here, may create bias or confounding effects (e.g., race when classifying gender from face images). We introduce the Metadata Normalization (MDN) layer, a new batch-level operation which can be used end-to-end within the training framework, to correct the influence of metadata on feature distributions. MDN adopts a regression analysis technique traditionally used for preprocessing to remove (regress out) the metadata effects on model features during training. We utilize a metric based on distance correlation to quantify the distribution bias from the metadata and demonstrate that our method successfully removes metadata effects on four diverse settings: one synthetic, one 2D image, one video, and one 3D medical image dataset.
Collapse
Affiliation(s)
- Mandy Lu
- Stanford University, Stanford, CA 94305
| | | | | | | | | | | | | |
Collapse
|
10
|
Zhao Q, Sullivan EV, Műller‐Oehring EM, Honnorat N, Adeli E, Podhajsky S, Baker FC, Colrain IM, Prouty D, Tapert SF, Brown SA, Meloy MJ, Brumback T, Nagel BJ, Morales AM, Clark DB, Luna B, De Bellis MD, Voyvodic JT, Nooner KB, Pfefferbaum A, Pohl KM. Adolescent alcohol use disrupts functional neurodevelopment in sensation seeking girls. Addict Biol 2021; 26:e12914. [PMID: 32428984 DOI: 10.1111/adb.12914] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 02/20/2020] [Accepted: 04/17/2020] [Indexed: 01/11/2023]
Abstract
Exogenous causes, such as alcohol use, and endogenous factors, such as temperament and sex, can modulate developmental trajectories of adolescent neurofunctional maturation. We examined how these factors affect sexual dimorphism in brain functional networks in youth drinking below diagnostic threshold for alcohol use disorder (AUD). Based on the 3-year, annually acquired, longitudinal resting-state functional magnetic resonance imaging (MRI) data of 526 adolescents (12-21 years at baseline) from the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) cohort, developmental trajectories of 23 intrinsic functional networks (IFNs) were analyzed for (1) sexual dimorphism in 259 participants who were no-to-low drinkers throughout this period; (2) sex-alcohol interactions in two age- and sex-matched NCANDA subgroups (N = 76 each), half no-to-low, and half moderate-to-heavy drinkers; and (3) moderating effects of gender-specific alcohol dose effects and a multifactorial impulsivity measure on IFN connectivity in all NCANDA participants. Results showed that sex differences in no-to-low drinkers diminished with age in the inferior-occipital network, yet girls had weaker within-network connectivity than boys in six other networks. Effects of adolescent alcohol use were more pronounced in girls than boys in three IFNs. In particular, girls showed greater within-network connectivity in two motor networks with more alcohol consumption, and these effects were mediated by sensation-seeking only in girls. Our results implied that drinking might attenuate the naturally diminishing sexual differences by disrupting the maturation of network efficiency more severely in girls. The sex-alcohol-dose effect might explain why women are at higher risk of alcohol-related health and psychosocial consequences than men.
Collapse
Affiliation(s)
- Qingyu Zhao
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
| | - Edith V. Sullivan
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
| | - Eva M. Műller‐Oehring
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
- Center for Health Sciences SRI International Menlo Park CA USA
| | | | - Ehsan Adeli
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
| | - Simon Podhajsky
- Center for Health Sciences SRI International Menlo Park CA USA
| | - Fiona C. Baker
- Center for Health Sciences SRI International Menlo Park CA USA
| | - Ian M. Colrain
- Center for Health Sciences SRI International Menlo Park CA USA
| | - Devin Prouty
- Center for Health Sciences SRI International Menlo Park CA USA
| | - Susan F. Tapert
- Department of Psychiatry University of California San Diego CA USA
| | - Sandra A. Brown
- Department of Psychiatry University of California San Diego CA USA
- Department of Psychology University of California San Diego CA USA
| | - Mary J. Meloy
- Department of Psychiatry University of California San Diego CA USA
| | - Ty Brumback
- Department of Psychological Science Northern Kentucky University Highland Heights KY USA
| | - Bonnie J. Nagel
- Departments of Psychiatry and Behavioral Neuroscience Oregon Health & Sciences University Portland OR USA
| | - Angelica M. Morales
- Departments of Psychiatry and Behavioral Neuroscience Oregon Health & Sciences University Portland OR USA
| | - Duncan B. Clark
- Department of Psychiatry University of Pittsburgh Pittsburgh PA USA
| | - Beatriz Luna
- Department of Psychiatry University of Pittsburgh Pittsburgh PA USA
| | - Michael D. De Bellis
- Department of Psychiatry & Behavioral Sciences Duke University School of Medicine Durham NC USA
| | - James T. Voyvodic
- Department of Radiology Duke University School of Medicine Durham NC USA
| | - Kate B. Nooner
- Department of Psychology University of North Carolina Wilmington Wilmington NC USA
| | - Adolf Pfefferbaum
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
- Center for Health Sciences SRI International Menlo Park CA USA
| | - Kilian M. Pohl
- Department of Psychiatry & Behavioral Sciences Stanford University School of Medicine Stanford CA USA
- Center for Health Sciences SRI International Menlo Park CA USA
| |
Collapse
|
11
|
Xu Y, Lin Y, Bell RP, Towe SL, Pearson JM, Nadeem T, Chan C, Meade CS. Machine learning prediction of neurocognitive impairment among people with HIV using clinical and multimodal magnetic resonance imaging data. J Neurovirol 2021; 27:1-11. [PMID: 33464541 PMCID: PMC8001877 DOI: 10.1007/s13365-020-00930-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Revised: 11/29/2020] [Accepted: 12/02/2020] [Indexed: 01/24/2023]
Abstract
Diagnosis of HIV-associated neurocognitive impairment (NCI) continues to be a clinical challenge. The purpose of this study was to develop a prediction model for NCI among people with HIV using clinical- and magnetic resonance imaging (MRI)-derived features. The sample included 101 adults with chronic HIV disease. NCI was determined using a standardized neuropsychological testing battery comprised of seven domains. MRI features included gray matter volume from high-resolution anatomical scans and white matter integrity from diffusion-weighted imaging. Clinical features included demographics, substance use, and routine laboratory tests. Least Absolute Shrinkage and Selection Operator Logistic regression was used to perform variable selection on MRI features. These features were subsequently used to train a support vector machine (SVM) to predict NCI. Three different classification tasks were performed: one used only clinical features; a second used only selected MRI features; a third used both clinical and selected MRI features. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity with a tenfold cross-validation. The SVM classifier that combined selected MRI with clinical features outperformed the model using clinical features or MRI features alone (AUC: 0.83 vs. 0.62 vs. 0.79; accuracy: 0.80 vs. 0.65 vs. 0.72; sensitivity: 0.86 vs. 0.85 vs. 0.86; specificity: 0.71 vs. 0.37 vs. 0.52). Our results provide preliminary evidence that combining clinical and MRI features can increase accuracy in predicting NCI and could be developed as a potential tool for NCI diagnosis in HIV clinical practice.
Collapse
Affiliation(s)
- Yunan Xu
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA.
| | - Yizi Lin
- Department of Statistical Science, Duke University, Durham, NC, USA
| | - Ryan P Bell
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Sheri L Towe
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA
| | - John M Pearson
- Center for Cognitive Neuroscience and Department of Psychology and Neuroscience, Duke University, Durham, NC, USA
- Department of Biostatistics and Bioinformatics, Duke University Medical School, Durham, NC, USA
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Tauseef Nadeem
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Cliburn Chan
- Department of Biostatistics and Bioinformatics, Duke University Medical School, Durham, NC, USA
| | - Christina S Meade
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA
| |
Collapse
|
12
|
Zhao Q, Adeli E, Pohl KM. Training confounder-free deep learning models for medical applications. Nat Commun 2020; 11:6010. [PMID: 33243992 PMCID: PMC7691500 DOI: 10.1038/s41467-020-19784-9] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 10/28/2020] [Indexed: 02/08/2023] Open
Abstract
The presence of confounding effects (or biases) is one of the most critical challenges in using deep learning to advance discovery in medical imaging studies. Confounders affect the relationship between input data (e.g., brain MRIs) and output variables (e.g., diagnosis). Improper modeling of those relationships often results in spurious and biased associations. Traditional machine learning and statistical models minimize the impact of confounders by, for example, matching data sets, stratifying data, or residualizing imaging measurements. Alternative strategies are needed for state-of-the-art deep learning models that use end-to-end training to automatically extract informative features from large set of images. In this article, we introduce an end-to-end approach for deriving features invariant to confounding factors while accounting for intrinsic correlations between the confounder(s) and prediction outcome. The method does so by exploiting concepts from traditional statistical methods and recent fair machine learning schemes. We evaluate the method on predicting the diagnosis of HIV solely from Magnetic Resonance Images (MRIs), identifying morphological sex differences in adolescence from those of the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA), and determining the bone age from X-ray images of children. The results show that our method can accurately predict while reducing biases associated with confounders. The code is available at https://github.com/qingyuzhao/br-net .
Collapse
Affiliation(s)
- Qingyu Zhao
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, 94305, USA
| | - Ehsan Adeli
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, 94305, USA
- Department of Computer Science, Stanford University, Stanford, CA, 94305, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, 94305, USA.
- Center for Biomedical Sciences, SRI International, Menlo Park, CA, 94205, USA.
| |
Collapse
|
13
|
Adeli E, Zhao Q, Zahr NM, Goldstone A, Pfefferbaum A, Sullivan EV, Pohl KM. Deep learning identifies morphological determinants of sex differences in the pre-adolescent brain. Neuroimage 2020; 223:117293. [PMID: 32841716 PMCID: PMC7780846 DOI: 10.1016/j.neuroimage.2020.117293] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 07/06/2020] [Accepted: 08/17/2020] [Indexed: 12/11/2022] Open
Abstract
The application of data-driven deep learning to identify sex differences in developing brain structures of pre-adolescents has heretofore not been accomplished. Here, the approach identifies sex differences by analyzing the minimally processed MRIs of the first 8144 participants (age 9 and 10 years) recruited by the Adolescent Brain Cognitive Development (ABCD) study. The identified pattern accounted for confounding factors (i.e., head size, age, puberty development, socioeconomic status) and comprised cerebellar (corpus medullare, lobules III, IV/V, and VI) and subcortical (pallidum, amygdala, hippocampus, parahippocampus, insula, putamen) structures. While these have been individually linked to expressing sex differences, a novel discovery was that their grouping accurately predicted the sex in individual pre-adolescents. Another novelty was relating differences specific to the cerebellum to pubertal development. Finally, we found that reducing the pattern to a single score not only accurately predicted sex but also correlated with cognitive behavior linked to working memory. The predictive power of this score and the constellation of identified brain structures provide evidence for sex differences in pre-adolescent neurodevelopment and may augment understanding of sex-specific vulnerability or resilience to psychiatric disorders and presage sex-linked learning disabilities.
Collapse
Affiliation(s)
- Ehsan Adeli
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA
| | - Qingyu Zhao
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA
| | - Natalie M Zahr
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA; Center for Biomedical Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Aimee Goldstone
- Center for Biomedical Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Adolf Pfefferbaum
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA; Center for Biomedical Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Edith V Sullivan
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, USA; Center for Biomedical Sciences, SRI International, Menlo Park, CA 94025, USA.
| |
Collapse
|
14
|
Zhao Q, Adeli E, Pfefferbaum A, Sullivan EV, Pohl KM. Confounder-Aware Visualization of ConvNets. MACHINE LEARNING IN MEDICAL IMAGING. MLMI (WORKSHOP) 2019; 11861:328-336. [PMID: 32549051 PMCID: PMC7297409 DOI: 10.1007/978-3-030-32692-0_38] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
With recent advances in deep learning, neuroimaging studies increasingly rely on convolutional networks (ConvNets) to predict diagnosis based on MR images. To gain a better understanding of how a disease impacts the brain, the studies visualize the salience maps of the ConvNet highlighting voxels within the brain majorly contributing to the prediction. However, these salience maps are generally confounded, i.e., some salient regions are more predictive of confounding variables (such as age) than the diagnosis. To avoid such misinterpretation, we propose in this paper an approach that aims to visualize confounder-free saliency maps that only highlight voxels predictive of the diagnosis. The approach incorporates univariate statistical tests to identify confounding effects within the intermediate features learned by ConvNet. The influence from the subset of confounded features is then removed by a novel partial back-propagation procedure. We use this two-step approach to visualize confounder-free saliency maps extracted from synthetic and two real datasets. These experiments reveal the potential of our visualization in producing unbiased model-interpretation.
Collapse
Affiliation(s)
- Qingyu Zhao
- School of Medicine, Stanford University, Stanford, USA
| | - Ehsan Adeli
- School of Medicine, Stanford University, Stanford, USA
| | - Adolf Pfefferbaum
- School of Medicine, Stanford University, Stanford, USA
- Center of Health Sciences, SRI International, Menlo Park, USA
| | | | - Kilian M Pohl
- School of Medicine, Stanford University, Stanford, USA
- Center of Health Sciences, SRI International, Menlo Park, USA
| |
Collapse
|
15
|
Leng T, Zhao Q, Yang C, Lu Z, Adeli E, Pohl KM. Data Augmentation Based on Substituting Regional MRIs Volume Scores. LARGE-SCALE ANNOTATION OF BIOMEDICAL DATA AND EXPERT LABEL SYNTHESIS AND HARDWARE AWARE LEARNING FOR MEDICAL IMAGING AND COMPUTER ASSISTED INTERVENTION : INTERNATIONAL WORKSHOPS, LABELS 2019, HAL-MICCAI 2019, AND CURIOUS 2019, HELD IN C... 2019; 11851:32-41. [PMID: 32924031 PMCID: PMC7486010 DOI: 10.1007/978-3-030-33642-4_4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/30/2024]
Abstract
Due to difficulties in collecting sufficient training data, recent advances in neural-network-based methods have not been fully explored in the analysis of brain Magnetic Resonance Imaging (MRI). A possible solution to the limited-data issue is to augment the training set with synthetically generated data. In this paper, we propose a data augmentation strategy based on regional feature substitution. We demonstrate the advantages of this strategy with respect to training a simple neural-network-based classifier in predicting when individual youth transition from no-to-low to medium-to-heavy alcohol drinkers solely based on their volumetric MRI measurements. Based on 20-fold cross-validation, we generate more than one million synthetic samples from less than 500 subjects for each training run. The classifier achieves an accuracy of 74.1% in correctly distinguishing non-drinkers from drinkers at baseline and a 43.2% weighted accuracy in predicting the transition over a three year period (5-group classification task). Both accuracy scores are significantly better than training the classifier on the original dataset.
Collapse
Affiliation(s)
- Tuo Leng
- School of Computer Engineering and Sciences, Shanghai University, Shanghai, China
- School of Medicine, Stanford University, Stanford, CA, USA
| | - Qingyu Zhao
- School of Medicine, Stanford University, Stanford, CA, USA
| | - Chao Yang
- School of Computer Engineering and Sciences, Shanghai University, Shanghai, China
| | - Zhufu Lu
- School of Computer Engineering and Sciences, Shanghai University, Shanghai, China
| | - Ehsan Adeli
- School of Medicine, Stanford University, Stanford, CA, USA
| | - Kilian M Pohl
- School of Medicine, Stanford University, Stanford, CA, USA
- SRI International, Center for Health Sciences, Menlo Park, CA, USA
| |
Collapse
|
16
|
Zhao Q, Adeli E, Honnorat N, Leng T, Pohl KM. Variational AutoEncoder For Regression: Application to Brain Aging Analysis. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2019; 11765:823-831. [PMID: 32705091 PMCID: PMC7377006 DOI: 10.1007/978-3-030-32245-8_91] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for learning the latent space of imaging data and performing supervised regression. Based on recent advances in learning disentangled representations, the novel generative process explicitly models the conditional distribution of latent representations with respect to the regression target variable. Performing a variational inference procedure on this model leads to joint regularization between the VAE and a neural-network regressor. In predicting the age of 245 subjects from their structural Magnetic Resonance (MR) images, our model is more accurate than state-of-the-art methods when applied to either region-of-interest (ROI) measurements or raw 3D volume images. More importantly, unlike simple feed-forward neural-networks, disentanglement of age in latent representations allows for intuitive interpretation of the structural developmental patterns of the human brain.
Collapse
Affiliation(s)
| | | | | | - Tuo Leng
- Stanford University, Stanford, CA, USA
| | - Kilian M Pohl
- Stanford University, Stanford, CA, USA
- SRI International, Menlo Park, CA, USA
| |
Collapse
|
17
|
Adeli E, Zahr NM, Pfefferbaum A, Sullivan EV, Pohl KM. Novel Machine Learning Identifies Brain Patterns Distinguishing Diagnostic Membership of Human Immunodeficiency Virus, Alcoholism, and Their Comorbidity of Individuals. BIOLOGICAL PSYCHIATRY: COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2019; 4:589-599. [PMID: 30982583 DOI: 10.1016/j.bpsc.2019.02.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Revised: 02/15/2019] [Accepted: 02/15/2019] [Indexed: 12/13/2022]
Abstract
The incidence of alcohol use disorder (AUD) in human immunodeficiency virus (HIV) infection is twice that of the rest of the population. This study documents complex radiologically identified, neuroanatomical effects of AUD+HIV comorbidity by identifying structural brain systems that predicted diagnosis on an individual basis. Applying novel machine learning analysis to 549 participants (199 control subjects, 222 with AUD, 68 with HIV, 60 with AUD+HIV), 298 magnetic resonance imaging brain measurements were automatically reduced to small subsets per group. Significance of each diagnostic pattern was inferred from its accuracy in predicting diagnosis and performance on six cognitive measures. While all three diagnostic patterns predicted the learning and memory score, the AUD+HIV pattern was the largest and had the highest predication accuracy (78.1%). Providing a roadmap for analyzing large, multimodal datasets, the machine learning analysis revealed imaging phenotypes that predicted diagnostic membership of magnetic resonance imaging scans of individuals with AUD, HIV, and their comorbidity.
Collapse
Affiliation(s)
- Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford School of Medicine, Stanford, California
| | - Natalie M Zahr
- Department of Psychiatry and Behavioral Sciences, Stanford School of Medicine, Stanford, California; Center for Biomedical Sciences, SRI International, Menlo Park, California
| | - Adolf Pfefferbaum
- Department of Psychiatry and Behavioral Sciences, Stanford School of Medicine, Stanford, California; Center for Biomedical Sciences, SRI International, Menlo Park, California
| | - Edith V Sullivan
- Department of Psychiatry and Behavioral Sciences, Stanford School of Medicine, Stanford, California
| | - Kilian M Pohl
- Department of Psychiatry and Behavioral Sciences, Stanford School of Medicine, Stanford, California; Center for Biomedical Sciences, SRI International, Menlo Park, California.
| |
Collapse
|