1
|
Stolte SE, Indahlastari A, Chen J, Albizu A, Dunn A, Pedersen S, See KB, Woods AJ, Fang R. Precise and Rapid Whole-Head Segmentation from Magnetic Resonance Images of Older Adults using Deep Learning. Imaging Neurosci (Camb) 2024; 2:10.1162/imag_a_00090. [PMID: 38465203 PMCID: PMC10922731 DOI: 10.1162/imag_a_00090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
Whole-head segmentation from Magnetic Resonance Images (MRI) establishes the foundation for individualized computational models using finite element method (FEM). This foundation paves the path for computer-aided solutions in fields, particularly in non-invasive brain stimulation. Most current automatic head segmentation tools are developed using healthy young adults. Thus, they may neglect the older population that is more prone to age-related structural decline such as brain atrophy. In this work, we present a new deep learning method called GRACE, which stands for General, Rapid, And Comprehensive whole-hEad tissue segmentation. GRACE is trained and validated on a novel dataset that consists of 177 manually corrected MR-derived reference segmentations that have undergone meticulous manual review. Each T1-weighted MRI volume is segmented into 11 tissue types, including white matter, grey matter, eyes, cerebrospinal fluid, air, blood vessel, cancellous bone, cortical bone, skin, fat, and muscle. To the best of our knowledge, this work contains the largest manually corrected dataset to date in terms of number of MRIs and segmented tissues. GRACE outperforms five freely available software tools and a traditional 3D U-Net on a five-tissue segmentation task. On this task, GRACE achieves an average Hausdorff Distance of 0.21, which exceeds the runner-up at an average Hausdorff Distance of 0.36. GRACE can segment a whole-head MRI in about 3 seconds, while the fastest software tool takes about 3 minutes. In summary, GRACE segments a spectrum of tissue types from older adults T1-MRI scans at favorable accuracy and speed. The trained GRACE model is optimized on older adult heads to enable high-precision modeling in age-related brain disorders. To support open science, the GRACE code and trained weights are made available online and open to the research community at https://github.com/lab-smile/GRACE.
Collapse
Affiliation(s)
- Skylar E. Stolte
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Aprinda Indahlastari
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Jason Chen
- Department Of Computer & Information Science & Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Alejandro Albizu
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA
- Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Ayden Dunn
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Samantha Pedersen
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Kyle B. See
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Adam J. Woods
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
- Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA
- Department of Electrical and Computer Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| |
Collapse
|
2
|
Albizu A, Indahlastari A, Huang Z, Waner J, Stolte SE, Fang R, Woods AJ. Machine-learning defined precision tDCS for improving cognitive function. Brain Stimul 2023; 16:969-974. [PMID: 37279860 PMCID: PMC11080612 DOI: 10.1016/j.brs.2023.05.020] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 05/08/2023] [Accepted: 05/22/2023] [Indexed: 06/08/2023] Open
Abstract
BACKGROUND Transcranial direct current stimulation (tDCS) paired with cognitive training (CT) is widely investigated as a therapeutic tool to enhance cognitive function in older adults with and without neurodegenerative disease. Prior research demonstrates that the level of benefit from tDCS paired with CT varies from person to person, likely due to individual differences in neuroanatomical structure. OBJECTIVE The current study aims to develop a method to objectively optimize and personalize current dosage to maximize the functional gains of non-invasive brain stimulation. METHODS A support vector machine (SVM) model was trained to predict treatment response based on computational models of current density in a sample dataset (n = 14). Feature weights of the deployed SVM were used in a weighted Gaussian Mixture Model (GMM) to maximize the likelihood of converting tDCS non-responders to responders by finding the most optimum electrode montage and applied current intensity (optimized models). RESULTS Current distributions optimized by the proposed SVM-GMM model demonstrated 93% voxel-wise coherence within target brain regions between the originally non-responders and responders. The optimized current distribution in original non-responders was 3.38 standard deviations closer to the current dose of responders compared to the pre-optimized models. Optimized models also achieved an average treatment response likelihood and normalized mutual information of 99.993% and 91.21%, respectively. Following tDCS dose optimization, the SVM model successfully predicted all tDCS non-responders with optimized doses as responders. CONCLUSIONS The results of this study serve as a foundation for a custom dose optimization strategy towards precision medicine in tDCS to improve outcomes in cognitive decline remediation for older adults.
Collapse
Affiliation(s)
- Alejandro Albizu
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Aprinda Indahlastari
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Ziqian Huang
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Electrical and Computer Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Jori Waner
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Skylar E Stolte
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Ruogu Fang
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA; Department of Electrical and Computer Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA.
| | - Adam J Woods
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA.
| |
Collapse
|
3
|
Stolte SE, Volle K, Indahlastari A, Albizu A, Woods AJ, Brink K, Hale M, Fang R. DOMINO: Domain-aware loss for deep learning calibration. Softw Impacts 2023; 15:100478. [PMID: 37091721 PMCID: PMC10118072 DOI: 10.1016/j.simpa.2023.100478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Deep learning has achieved the state-of-the-art performance across medical imaging tasks; however, model calibration is often not considered. Uncalibrated models are potentially dangerous in high-risk applications since the user does not know when they will fail. Therefore, this paper proposes a novel domain-aware loss function to calibrate deep learning models. The proposed loss function applies a class-wise penalty based on the similarity between classes within a given target domain. Thus, the approach improves the calibration while also ensuring that the model makes less risky errors even when incorrect. The code for this software is available at https://github.com/lab-smile/DOMINO.
Collapse
Affiliation(s)
- Skylar E. Stolte
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, USA
| | - Kyle Volle
- Department of Mechanical and Aerospace Engineering, Herbert Wertheim College of Engineering, University of Florida, USA
| | - Aprinda Indahlastari
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, USA
| | - Alejandro Albizu
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, USA
- Department of Neuroscience, College of Medicine, University of Florida, USA
| | - Adam J. Woods
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, USA
- Department of Neuroscience, College of Medicine, University of Florida, USA
| | - Kevin Brink
- United States Air Force Research Laboratory, Eglin Air Force Base, FL, USA
| | - Matthew Hale
- Department of Mechanical and Aerospace Engineering, Herbert Wertheim College of Engineering, University of Florida, USA
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, USA
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, USA
- Department of Electrical and Computer Engineering, Herbert Wertheim College of Engineering, University of Florida, USA
- Department of Computer and Information Science and Engineering, University of Florida, USA
- Corresponding author at: J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, USA. (R. Fang)
| |
Collapse
|
4
|
Yu Z, Yang X, Sweeting GL, Ma Y, Stolte SE, Fang R, Wu Y. Identify diabetic retinopathy-related clinical concepts and their attributes using transformer-based natural language processing methods. BMC Med Inform Decis Mak 2022; 22:255. [PMID: 36167551 PMCID: PMC9513862 DOI: 10.1186/s12911-022-01996-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 09/14/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Diabetic retinopathy (DR) is a leading cause of blindness in American adults. If detected, DR can be treated to prevent further damage causing blindness. There is an increasing interest in developing artificial intelligence (AI) technologies to help detect DR using electronic health records. The lesion-related information documented in fundus image reports is a valuable resource that could help diagnoses of DR in clinical decision support systems. However, most studies for AI-based DR diagnoses are mainly based on medical images; there is limited studies to explore the lesion-related information captured in the free text image reports. METHODS In this study, we examined two state-of-the-art transformer-based natural language processing (NLP) models, including BERT and RoBERTa, compared them with a recurrent neural network implemented using Long short-term memory (LSTM) to extract DR-related concepts from clinical narratives. We identified four different categories of DR-related clinical concepts including lesions, eye parts, laterality, and severity, developed annotation guidelines, annotated a DR-corpus of 536 image reports, and developed transformer-based NLP models for clinical concept extraction and relation extraction. We also examined the relation extraction under two settings including 'gold-standard' setting-where gold-standard concepts were used-and end-to-end setting. RESULTS For concept extraction, the BERT model pretrained with the MIMIC III dataset achieve the best performance (0.9503 and 0.9645 for strict/lenient evaluation). For relation extraction, BERT model pretrained using general English text achieved the best strict/lenient F1-score of 0.9316. The end-to-end system, BERT_general_e2e, achieved the best strict/lenient F1-score of 0.8578 and 0.8881, respectively. Another end-to-end system based on the RoBERTa architecture, RoBERTa_general_e2e, also achieved the same performance as BERT_general_e2e in strict scores. CONCLUSIONS This study demonstrated the efficiency of transformer-based NLP models for clinical concept extraction and relation extraction. Our results show that it's necessary to pretrain transformer models using clinical text to optimize the performance for clinical concept extraction. Whereas, for relation extraction, transformers pretrained using general English text perform better.
Collapse
Affiliation(s)
- Zehao Yu
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL USA
| | - Xi Yang
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL USA
| | - Gianna L. Sweeting
- Department of Biomedical Engineering, College of Engineering, University of Florida, Gainesville, FL USA
| | - Yinghan Ma
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL USA
| | - Skylar E. Stolte
- Department of Biomedical Engineering, College of Engineering, University of Florida, Gainesville, FL USA
| | - Ruogu Fang
- Department of Biomedical Engineering, College of Engineering, University of Florida, Gainesville, FL USA
| | - Yonghui Wu
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL USA
| |
Collapse
|
5
|
Albizu A, Fang R, Indahlastari A, O'Shea A, Stolte SE, See KB, Boutzoukas EM, Kraft JN, Nissim NR, Woods AJ. Machine learning and individual variability in electric field characteristics predict tDCS treatment response. Brain Stimul 2020; 13:1753-1764. [PMID: 33049412 PMCID: PMC7731513 DOI: 10.1016/j.brs.2020.10.001] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 09/30/2020] [Accepted: 10/02/2020] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Transcranial direct current stimulation (tDCS) is widely investigated as a therapeutic tool to enhance cognitive function in older adults with and without neurodegenerative disease. Prior research demonstrates that electric current delivery to the brain can vary significantly across individuals. Quantification of this variability could enable person-specific optimization of tDCS outcomes. This pilot study used machine learning and MRI-derived electric field models to predict working memory improvements as a proof of concept for precision cognitive intervention. METHODS Fourteen healthy older adults received 20 minutes of 2 mA tDCS stimulation (F3/F4) during a two-week cognitive training intervention. Participants performed an N-back working memory task pre-/post-intervention. MRI-derived current models were passed through a linear Support Vector Machine (SVM) learning algorithm to characterize crucial tDCS current components (intensity and direction) that induced working memory improvements in tDCS responders versus non-responders. MAIN RESULTS SVM models of tDCS current components had 86% overall accuracy in classifying treatment responders vs. non-responders, with current intensity producing the best overall model differentiating changes in working memory performance. Median current intensity and direction in brain regions near the electrodes were positively related to intervention responses (r=0.811,p<0.001 and r=0.774,p=0.001). CONCLUSIONS This study provides the first evidence that pattern recognition analyses of MRI-derived tDCS current models can provide individual prognostic classification of tDCS treatment response with 86% accuracy. Individual differences in current intensity and direction play important roles in determining treatment response to tDCS. These findings provide important insights into mechanisms of tDCS response as well as proof of concept for future precision dosing models of tDCS intervention.
Collapse
Affiliation(s)
- Alejandro Albizu
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Ruogu Fang
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Aprinda Indahlastari
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Andrew O'Shea
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Skylar E Stolte
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Kyle B See
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, USA
| | - Emanuel M Boutzoukas
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA
| | - Jessica N Kraft
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Nicole R Nissim
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA
| | - Adam J Woods
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, USA; Department of Neuroscience, College of Medicine, University of Florida, Gainesville, USA; Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA.
| |
Collapse
|