1
|
Liu Y, Bao S, Englot DJ, Morgan VL, Taylor WD, Wei Y, Oguz I, Landman BA, Lyu I. Hierarchical particle optimization for cortical shape correspondence in temporal lobe resection. Comput Biol Med 2023; 152:106414. [PMID: 36525831 PMCID: PMC9832438 DOI: 10.1016/j.compbiomed.2022.106414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 11/18/2022] [Accepted: 12/03/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND Anterior temporal lobe resection is an effective treatment for temporal lobe epilepsy. The post-surgical structural changes could influence the follow-up treatment. Capturing post-surgical changes necessitates a well-established cortical shape correspondence between pre- and post-surgical surfaces. Yet, most cortical surface registration methods are designed for normal neuroanatomy. Surgical changes can introduce wide ranging artifacts in correspondence, for which conventional surface registration methods may not work as intended. METHODS In this paper, we propose a novel particle method for one-to-one dense shape correspondence between pre- and post-surgical surfaces with temporal lobe resection. The proposed method can handle partial structural abnormality involving non-rigid changes. Unlike existing particle methods using implicit particle adjacency, we consider explicit particle adjacency to establish a smooth correspondence. Moreover, we propose hierarchical optimization of particles rather than full optimization of all particles at once to avoid trappings of locally optimal particle update. RESULTS We evaluate the proposed method on 25 pairs of T1-MRI with pre- and post-simulated resection on the anterior temporal lobe and 25 pairs of patients with actual resection. We show improved accuracy over several cortical regions in terms of ROI boundary Hausdorff distance with 4.29 mm and Dice similarity coefficients with average value 0.841, compared to existing surface registration methods on simulated data. In 25 patients with actual resection of the anterior temporal lobe, our method shows an improved shape correspondence in qualitative and quantitative evaluation on parcellation-off ratio with average value 0.061 and cortical thickness changes. We also show better smoothness of the correspondence without self-intersection, compared with point-wise matching methods which show various degrees of self-intersection. CONCLUSION The proposed method establishes a promising one-to-one dense shape correspondence for temporal lobe resection. The resulting correspondence is smooth without self-intersection. The proposed hierarchical optimization strategy could accelerate optimization and improve the optimization accuracy. According to the results on the paired surfaces with temporal lobe resection, the proposed method outperforms the compared methods and is more reliable to capture cortical thickness changes.
Collapse
Affiliation(s)
- Yue Liu
- College of Information Science and Engineering, Northeastern University, Shenyang, China; Department of Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| | - Shunxing Bao
- Department of Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| | - Dario J Englot
- Department of Neurological Surgery, Vanderbilt University Medical Center, TN, USA
| | - Victoria L Morgan
- Department of Radiology & Radiological Science, Vanderbilt University Medical Center, TN, USA
| | - Warren D Taylor
- Department of Psychiatry & Behavioral Science, Vanderbilt University Medical Center, TN, USA
| | - Ying Wei
- College of Information Science and Engineering, Northeastern University, Shenyang, China; Information Technology R&D Innovation Center of Peking University, Shaoxing, China; Changsha Hisense Intelligent System Research Institute Co., Ltd, China
| | - Ipek Oguz
- Department of Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| | - Bennett A Landman
- Department of Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| | - Ilwoo Lyu
- Department of Computer Science and Engineering, UNIST, Ulsan, South Korea.
| |
Collapse
|
2
|
Vicory J, Herz C, Allemang D, Nam HH, Cianciulli A, Vigil C, Han Y, Lasso A, Jolley MA, Paniagua B. Statistical shape analysis of the tricuspid valve in hypoplastic left heart sydrome. STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART. STACOM (WORKSHOP) 2022; 13131:132-140. [PMID: 35088061 PMCID: PMC8788948 DOI: 10.1007/978-3-030-93722-5_15] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Hypoplastic left heart syndrome (HLHS) is a congenital heart disease characterized by incomplete development of the left heart. Children with HLHS undergo a series of operations which result in the tricuspid valve (TV) becoming the only functional atrioventricular valve. Some of those patients develop tricuspid regurgitation which is associated with heart failure and death and necessitates further surgical intervention. Repair of the regurgitant TV, and understanding the connections between structure and function of this valve remains extremely challenging. Adult cardiac populations have used 3D echocardiography (3DE) combined with computational modeling to better understand cardiac conditions affecting the TV. However, these structure-function analyses rely on simplistic point-based techniques that do not capture the leaflet surface in detail, nor do they allow robust comparison of shapes across groups. We propose using statistical shape modeling and analysis of the TV using Spherical Harmonic Representation Point Distribution Models (SPHARM-PDM) in order to generate a reproducible representation, which in turn enables high dimensional low sample size statistical analysis techniques such as principal component analysis and distance weighted discrimination. Our initial results suggest that visualization of the differences in regurgitant vs. non-regurgitant valves can precisely locate populational structural differences as well as how an individual regurgitant valve differs from the mean shape of functional valves. We believe that these results will support the creation of modern image-based modeling tools, and ultimately increase the understanding of the relationship between valve structure and function needed to inform and improve surgical planning in HLHS.
Collapse
Affiliation(s)
| | - Christian Herz
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | - David Allemang
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | - Hannah H Nam
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | - Alana Cianciulli
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | - Chad Vigil
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | - Ye Han
- Kitware Inc, North Carolina, USA
| | | | - Matthew A Jolley
- Children's Hospital of Philadelphia, Philadelphia, PA, 02115, USA
| | | |
Collapse
|
3
|
Lyu I, Bao S, Hao L, Yao J, Miller JA, Voorhies W, Taylor WD, Bunge SA, Weiner KS, Landman BA. Labeling lateral prefrontal sulci using spherical data augmentation and context-aware training. Neuroimage 2021; 229:117758. [PMID: 33497773 PMCID: PMC8366030 DOI: 10.1016/j.neuroimage.2021.117758] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 12/18/2020] [Accepted: 01/07/2021] [Indexed: 02/06/2023] Open
Abstract
The inference of cortical sulcal labels often focuses on deep (primary and secondary) sulcal regions, whereas shallow (tertiary) sulcal regions are largely overlooked in the literature due to the scarcity of manual/well-defined annotations and their large neuroanatomical variability. In this paper, we present an automated framework for regional labeling of both primary/secondary and tertiary sulci of the dorsal portion of lateral prefrontal cortex (LPFC) using spherical convolutional neural networks. We propose two core components that enhance the inference of sulcal labels to overcome such large neuroanatomical variability: (1) surface data augmentation and (2) context-aware training. (1) To take into account neuroanatomical variability, we synthesize training data from the proposed feature space that embeds intermediate deformation trajectories of spherical data in a rigid to non-rigid fashion, which bridges an augmentation gap in conventional rotation data augmentation. (2) Moreover, we design a two-stage training process to improve labeling accuracy of tertiary sulci by informing the biological associations in neuroanatomy: inference of primary/secondary sulci and then their spatial likelihood to guide the definition of tertiary sulci. In the experiments, we evaluate our method on 13 deep and shallow sulci of human LPFC in two independent data sets with different age ranges: pediatric (N=60) and adult (N=36) cohorts. We compare the proposed method with a conventional multi-atlas approach and spherical convolutional neural networks without/with rotation data augmentation. In both cohorts, the proposed data augmentation improves labeling accuracy of deep and shallow sulci over the baselines, and the proposed context-aware training offers further improvement in the labeling of shallow sulci over the proposed data augmentation. We share our tools with the field and discuss applications of our results for understanding neuroanatomical-functional organization of LPFC and the rest of cortex (https://github.com/ilwoolyu/SphericalLabeling).
Collapse
Affiliation(s)
- Ilwoo Lyu
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville TN, 37235 USA.
| | - Shuxing Bao
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville TN, 37235 USA
| | - Lingyan Hao
- Institute for Computational & Mathematical Engineering, Stanford University, Stanford, CA 94305, USA
| | - Jewelia Yao
- Department of Psychology, The University of California, Berkeley, CA 94720, USA
| | - Jacob A Miller
- Helen Wills Neuroscience Institute, The University of California, Berkeley, CA 94720, USA
| | - Willa Voorhies
- Department of Psychology, The University of California, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, The University of California, Berkeley, CA 94720, USA
| | - Warren D Taylor
- Psychiatry & Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN 37203 USA
| | - Silvia A Bunge
- Department of Psychology, The University of California, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, The University of California, Berkeley, CA 94720, USA
| | - Kevin S Weiner
- Department of Psychology, The University of California, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, The University of California, Berkeley, CA 94720, USA
| | - Bennett A Landman
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville TN, 37235 USA
| |
Collapse
|
4
|
Yu C, Liu Y, Cai LY, Kerley CI, Xu K, Taylor WD, Kang H, Shafer AT, Beason-Held LL, Resnick SM, Landman BA, Lyu I. Validation of Group-wise Registration for Surface-based Functional MRI Analysis. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11596:115961X. [PMID: 34531631 PMCID: PMC8442945 DOI: 10.1117/12.2580771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Resting-state functional MRI (rsfMRI) provides important information for studying and mapping the activities and functions of the brain. Conventionally, rsfMRIs are often registered to structural images in the Euclidean space without considering cortical surface geometry. Meanwhile, a surface-based representation offers a relaxed coordinate chart, but this still requires surface registration for group-wise data analysis. In this work, we investigate the performance of two existing surface registration methods in a surface-based rsfMRI analysis framework: FreeSurfer and Hierarchical Spherical Deformation (HSD). To minimize registration bias, we establish shape correspondence using both methods in a group-wise manner that estimates the unbiased average of a given cohort. To evaluate their performance, we focus on neuroanatomical alignment as well as the amount of distortion that can potentially bias surface tessellation for secondary level rsfMRI data analyses. In the pilot analysis, we examine a single timepoint of imaging data from 100 subjects out of an aging cohort. Overall, HSD establishes improved shape correspondence with reduced mean curvature deviation (10.94% less on average per subject, paired t-test: p <10-10) and reduced registration distortion (FreeSurfer: average 41.91% distortion per subject, HSD: 18.63%, paired t-test: p <10-10). Furthermore, HSD introduces less distortion than FreeSurfer in the areas identified in the individual components that were extracted by surface-based independent component analysis (ICA) after spatial smoothing and time series normalization. Consequently, we show that FreeSurfer capture individual components with globally similar but locally different patterns in ICA in visual inspection.
Collapse
Affiliation(s)
- Chang Yu
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Yue Liu
- College of Information Science and Engineering, Northeastern University, Shenyang, China
- Department of Electrical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Leon Y Cai
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Cailey I Kerley
- Department of Electrical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Kaiwen Xu
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Warren D Taylor
- Psychiatry & Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Hakmook Kang
- Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Andrea T Shafer
- Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, USA
| | - Lori L Beason-Held
- Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, USA
| | - Susan M Resnick
- Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, USA
| | - Bennett A Landman
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
- Department of Electrical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Psychiatry & Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Ilwoo Lyu
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
- Department of Electrical Engineering, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
5
|
Liu Y, Englot DJ, Morgan VL, Taylor WD, Wei Y, Oguz I, Landman BA, Lyu I. Establishing Surface Correspondence for Post-surgical Cortical Thickness Changes in Temporal Lobe Epilepsy. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11596. [PMID: 34531630 DOI: 10.1117/12.2580808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
In pre- and post-surgical surface shape analysis, establishing shape correspondence is necessary to investigate the postoperative surface changes. However, structural absence after the operation accompanies focal non-rigid changes, which leads to challenges in existing surface registration methods. In this paper, we present a fully automatic particle-based method to establish surface correspondence that can handle partial structural abnormality in the temporal lobe resection. Our method optimizes the coordinates of points which are modeled as particles on surfaces in a hierarchical way to reduce a chance of being trapped in a local minimum during the optimization. In the experiments, we evaluate the effectiveness of our method in comparison with conventional spherical registration (FreeSurfer) on two scenarios: cortical thickness changes in healthy controls within a short scan-rescan time window and patients with temporal lobe resection. The post-surgical scan is acquired at least 1 year after the presurgical scan. In region of interest-wise (ROI-wise) analysis, no changes on cortical thickness are found in both methods on the healthy control group. In patients, since there is no ground truth available, we instead investigated the disagreement between our method and FreeSurfer. We see poorly matched ROIs and large cortical thickness changes using FreeSurfer. On the contrary, our method shows well-matched ROIs and subtle cortical thickness changes. This suggests that the proposed method can establish a stable shape correspondence, which is not fully captured in a conventional spherical registration.
Collapse
Affiliation(s)
- Yue Liu
- College of Information Science and Engineering, Northeastern University, Shenyang, China.,Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Dario J Englot
- Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Victoria L Morgan
- Radiology & Radiological Science, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Warren D Taylor
- Psychiatry & Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Ying Wei
- College of Information Science and Engineering, Northeastern University, Shenyang, China
| | - Ipek Oguz
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Bennett A Landman
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Ilwoo Lyu
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
6
|
Gil N, Lipton ML, Fleysher R. Registration quality filtering improves robustness of voxel-wise analyses to the choice of brain template. Neuroimage 2020; 227:117657. [PMID: 33338620 PMCID: PMC7880909 DOI: 10.1016/j.neuroimage.2020.117657] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 10/22/2020] [Accepted: 12/03/2020] [Indexed: 12/05/2022] Open
Abstract
Motivation: Many clinical and scientific conclusions that rely on voxel-wise analyses of neuroimaging depend on the accurate comparison of corresponding anatomical regions. Such comparisons are made possible by registration of the images of subjects of interest onto a common brain template, such as the Johns Hopkins University (JHU) template. However, current image registration algorithms are prone to errors that are distributed in a template-dependent manner. Therefore, the results of voxel-wise analyses can be sensitive to template choice. Despite this problem, the issue of appropriate template choice for voxel-wise analyses is not generally addressed in contemporary neuroimaging studies, which may lead to the reporting of spurious results. Results: We present a novel approach to determine the suitability of a brain template for voxel-wise analysis. The approach is based on computing a “distance” between automatically-generated atlases of the subjects of interest and templates that is indicative of the extent of subject-to-template registration errors. This allows for the filtering of subjects and candidate templates based on a quantitative measure of registration quality. We benchmark our approach by evaluating alternative templates for a voxel-wise analysis that reproduces the well-known decline in fractional anisotropy (FA) with age. Our results show that filtering registrations minimizes errors and decreases the sensitivity of voxel-wise analysis to template choice. In addition to carrying important implications for future neuroimaging studies, the developed framework of template induction can be used to evaluate robustness of data analysis methods to template choice.
Collapse
Affiliation(s)
- Nelson Gil
- Department of Systems and Computational Biology, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA; Department of Biochemistry, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA
| | - Michael L Lipton
- Department of Radiology, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA; Gruss Magnetic Resonance Research Center, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA; Department of Psychiatry and Behavioral Sciences, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA; Dominick P. Purpura Department of Neuroscience, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA
| | - Roman Fleysher
- Department of Radiology, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA; Gruss Magnetic Resonance Research Center, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, USA.
| |
Collapse
|
7
|
Lyu I, Kang H, Woodward ND, Styner MA, Landman BA. Hierarchical spherical deformation for cortical surface registration. Med Image Anal 2019; 57:72-88. [PMID: 31280090 PMCID: PMC6733638 DOI: 10.1016/j.media.2019.06.013] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Revised: 04/30/2019] [Accepted: 06/24/2019] [Indexed: 11/30/2022]
Abstract
We present hierarchical spherical deformation for a group-wise shape correspondence to address template selection bias and to minimize registration distortion. In this work, we aim at a continuous and smooth deformation field to guide accurate cortical surface registration. In conventional spherical registration methods, a global rigid alignment and local deformation are independently performed. Motivated by the composition of precession and intrinsic rotation, we simultaneously optimize global rigid rotation and non-rigid local deformation by utilizing spherical harmonics interpolation of local composite rotations in a single framework. To this end, we indirectly encode local displacements by such local composite rotations as functions of spherical locations. Furthermore, we introduce an additional regularization term to the spherical deformation, which maximizes its rigidity while reducing registration distortion. To improve surface registration performance, we employ the second order approximation of the energy function that enables fast convergence of the optimization. In the experiments, we validate our method on healthy normal subjects with manual cortical surface parcellation in registration accuracy and distortion. We show an improved shape correspondence with high accuracy in cortical surface parcellation and significantly low registration distortion in surface area and edge length. In addition to validation, we discuss parameter tuning, optimization, and implementation design with potential acceleration.
Collapse
Affiliation(s)
- Ilwoo Lyu
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
| | - Hakmook Kang
- Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN 37203, USA
| | - Neil D Woodward
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Martin A Styner
- Department of Computer Science, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA; Department of Psychiatry, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27514, USA
| | - Bennett A Landman
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| |
Collapse
|
8
|
Parvathaneni P, Nath V, McHugo M, Huo Y, Resnick SM, Woodward ND, Landman BA, Lyu I. Improving human cortical sulcal curve labeling in large scale cross-sectional MRI using deep neural networks. J Neurosci Methods 2019; 324:108311. [PMID: 31201823 PMCID: PMC6663093 DOI: 10.1016/j.jneumeth.2019.108311] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2019] [Revised: 05/24/2019] [Accepted: 06/11/2019] [Indexed: 02/04/2023]
Abstract
BACKGROUND Human cortical primary sulci are relatively stable landmarks and commonly observed across the population. Despite their stability, the primary sulci exhibit phenotypic variability. NEW METHOD We propose a fully automated pipeline that integrates both sulcal curve extraction and labeling. In this study, we use a large normal control population (n = 1424) to train neural networks for accurately labeling the primary sulci. Briefly, we use sulcal curve distance map, surface parcellation, mean curvature and spectral features to delineate their sulcal labels. We evaluate the proposed method with 8 primary sulcal curves in the left and right hemispheres compared to an established multi-atlas curve labeling method. RESULTS Sulcal labels by the proposed method reasonably well agree with manual labeling. The proposed method outperforms the existing multi-atlas curve labeling method. COMPARISON WITH EXISTING METHOD Significantly improved sulcal labeling results are achieved with over 12.5 and 20.6 percent improvement on labeling accuracy in the left and right hemispheres, respectively compared to that of a multi-atlas curve labeling method in eight curves (p≪0.001, two-sample t-test). CONCLUSION The proposed method offers a computationally efficient and robust labeling of major sulci.
Collapse
Affiliation(s)
| | - Vishwesh Nath
- Computer Science, Vanderbilt Universitay, Nashville, TN, USA
| | - Maureen McHugo
- Department of Psychiatry and Behavioral Science, Vanderbilt Universitay, Nashville, TN, USA
| | - Yuankai Huo
- Electrical Engineering, Vanderbilt Universitay, Nashville, TN, USA
| | | | - Neil D Woodward
- Department of Psychiatry and Behavioral Science, Vanderbilt Universitay, Nashville, TN, USA
| | - Bennett A Landman
- Electrical Engineering, Vanderbilt Universitay, Nashville, TN, USA; Computer Science, Vanderbilt Universitay, Nashville, TN, USA; Department of Psychiatry and Behavioral Science, Vanderbilt Universitay, Nashville, TN, USA
| | - Ilwoo Lyu
- Computer Science, Vanderbilt Universitay, Nashville, TN, USA.
| |
Collapse
|
9
|
Vicory J, Pascal L, Hernandez P, Fishbaugh J, Prieto J, Mostapha M, Huang C, Shah H, Hong J, Liu Z, Michoud L, Fillion-Robin JC, Gerig G, Zhu H, Pizer SM, Styner M, Paniagua B. SlicerSALT: Shape AnaLysis Toolbox. SHAPE IN MEDICAL IMAGING : INTERNATIONAL WORKSHOP, SHAPEMI 2018, HELD IN CONJUNCTION WITH MICCAI 2018, GRANADA, SPAIN, SEPTEMBER 20, 2018 : PROCEEDINGS. SHAPEMI (WORKSHOP) (2018 : GRANADA, SPAIN) 2018; 11167:65-72. [PMID: 31032495 PMCID: PMC6482453 DOI: 10.1007/978-3-030-04747-4_6] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
Abstract
SlicerSALT is an open-source platform for disseminating state-of-the-art methods for performing statistical shape analysis. These methods are developed as 3D Slicer extensions to take advantage of its powerful underlying libraries. SlicerSALT itself is a heavily customized 3D Slicer package that is designed to be easy to use for shape analysis researchers. The packaged methods include powerful techniques for creating and visualizing shape representations as well as performing various types of analysis.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Chao Huang
- University of North Carolina at Chapel Hill
| | | | | | | | | | | | | | - Hongtu Zhu
- University of North Carolina at Chapel Hill
| | | | | | | |
Collapse
|
10
|
Lyu I, Styner MA, Landman BA. Hierarchical Spherical Deformation for Shape Correspondence. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2018; 11070:853-861. [PMID: 31803863 PMCID: PMC6892465 DOI: 10.1007/978-3-030-00928-1_96] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
We present novel spherical deformation for a landmark-free shape correspondence in a group-wise manner. In this work, we aim at both addressing template selection bias and minimizing registration distortion in a single framework. The proposed spherical deformation yields a non-rigid deformation field without referring to any particular spherical coordinate system. Specifically, we extend a rigid rotation represented by well-known Euler angles to general non-rigid local deformation via spatial-varying Euler angles. The proposed method employs spherical harmonics interpolation of the local displacements to simultaneously solve rigid and non-rigid local deformation during the optimization. This consequently leads to a continuous, smooth, and hierarchical representation of the deformation field that minimizes registration distortion. In addition, the proposed method is group-wise registration that requires no specific template to establish a shape correspondence. In the experiments, we show an improved shape correspondence with high accuracy in cortical surface parcellation as well as significantly low registration distortion in surface area and edge length compared to the existing registration methods while achieving fast registration in 3 mins per subject.
Collapse
Affiliation(s)
- Ilwoo Lyu
- Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| | - Martin A Styner
- Psychiatry, The University of North Carolina at Chapel Hill, NC, USA
| | - Bennett A Landman
- Electrical Engineering and Computer Science, Vanderbilt University, TN, USA
| |
Collapse
|
11
|
Lyu I, Kim SH, Woodward ND, Styner MA, Landman BA. TRACE: A Topological Graph Representation for Automatic Sulcal Curve Extraction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1653-1663. [PMID: 29969416 PMCID: PMC6889090 DOI: 10.1109/tmi.2017.2787589] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
A proper geometric representation of the cortical regions is a fundamental task for cortical shape analysis and landmark extraction. However, a significant challenge has arisen due to the highly variable, convoluted cortical folding patterns. In this paper, we propose a novel topological graph representation for automatic sulcal curve extraction (TRACE). In practice, the reconstructed surface suffers from noise influences introduced during image acquisition/surface reconstruction. In the presence of noise on the surface, TRACE determines stable sulcal fundic regions by employing the line simplification method that prevents the sulcal folding pattern from being significantly smoothed out. The sulcal curves are then traced over the connected graph in the determined regions by the Dijkstra's shortest path algorithm. For validation, we used the state-of-the-art surface reconstruction pipelines on a reproducibility data set. The experimental results showed higher reproducibility and robustness to noise in TRACE than the existing method (Li et al. 2010) with over 20% relative improvement in error for both surface reconstruction pipelines. In addition, the extracted sulcal curves by TRACE were well-aligned with manually delineated primary sulcal curves. We also provided a choice of parameters to control quality of the extracted sulcal curves and showed the influences of the parameter selection on the resulting curves.
Collapse
Affiliation(s)
- Ilwoo Lyu
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235 USA
| | - Sun Hyung Kim
- Department of Psychiatry, The University of North Carolina, Chapel Hill, NC 27599, USA
| | - Neil D. Woodward
- Department of Psychiatry, Vanderbilt University, Nashville, TN 37235 USA
| | - Martin A. Styner
- Department of Psychiatry, The University of North Carolina, Chapel Hill, NC 27599, USA
| | - Bennett A. Landman
- Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235 USA
| |
Collapse
|
12
|
Lyu I, Kim SH, Girault JB, Gilmore JH, Styner MA. A cortical shape-adaptive approach to local gyrification index. Med Image Anal 2018; 48:244-258. [PMID: 29990689 DOI: 10.1016/j.media.2018.06.009] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Revised: 04/17/2018] [Accepted: 06/26/2018] [Indexed: 11/16/2022]
Abstract
The amount of cortical folding, or gyrification, is typically measured within local cortical regions covered by an equidistant geodesic or nearest neighborhood-ring kernel. However, without careful design, such a kernel can easily cover multiple sulcal and gyral regions that may not be functionally related. Furthermore, this can result in smoothing out details of cortical folding, which consequently blurs local gyrification measurements. In this paper, we propose a novel kernel shape to locally quantify cortical gyrification within sulcal and gyral regions. We adapt wavefront propagation to generate a spatially varying kernel shape that encodes cortical folding patterns: neighboring gyral crowns, sulcal fundi, and sulcal banks. For this purpose, we perform anisotropic wavefront propagation that runs fast along gyral crowns and sulcal fundi by solving a static Hamilton-Jacobi partial differential equation. The resulting kernel adaptively elongates along gyral crowns and sulcal fundi, while keeping a uniform shape over flat regions like sulcal banks. We then measure local gyrification within the proposed spatially varying kernel. The experimental results show that the proposed kernel-based gyrification measure achieves a higher reproducibility than the conventional method in a multi-scan dataset. We further apply the proposed kernel to a brain development study in the early postnatal phase from neonate to 2 years of age. In this study we find that our kernel yields both positive and negative associations of gyrification with age, whereas the conventional method only captures positive associations. In general, our method yields sharper and more detailed statistical maps that associate cortical folding with sex and gestational age.
Collapse
Affiliation(s)
- Ilwoo Lyu
- Department of Computer Science, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
| | - Sun Hyung Kim
- Department of Psychiatry, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Jessica B Girault
- Department of Psychiatry, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - John H Gilmore
- Department of Psychiatry, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Martin A Styner
- Department of Computer Science, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA; Department of Psychiatry, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
13
|
Parvathaneni P, Lyu I, Huo Y, Blaber J, Hainline AE, Kang H, Woodward ND, Landman BA. Constructing Statistically Unbiased Cortical Surface Templates Using Feature-Space Covariance. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 10574. [PMID: 29887664 DOI: 10.1117/12.2293641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
The choice of surface template plays an important role in cross-sectional subject analyses involving cortical brain surfaces because there is a tendency toward registration bias given variations in inter-individual and inter-group sulcal and gyral patterns. In order to account for the bias and spatial smoothing, we propose a feature-based unbiased average template surface. In contrast to prior approaches, we factor in the sample population covariance and assign weights based on feature information to minimize the influence of covariance in the sampled population. The mean surface is computed by applying the weights obtained from an inverse covariance matrix, which guarantees that multiple representations from similar groups (e.g., involving imaging, demographic, diagnosis information) are down-weighted to yield an unbiased mean in feature space. Results are validated by applying this approach in two different applications. For evaluation, the proposed unbiased weighted surface mean is compared with un-weighted means both qualitatively and quantitatively (mean squared error and absolute relative distance of both the means with baseline). In first application, we validated the stability of the proposed optimal mean on a scan-rescan reproducibility dataset by incrementally adding duplicate subjects. In the second application, we used clinical research data to evaluate the difference between the weighted and unweighted mean when different number of subjects were included in control versus schizophrenia groups. In both cases, the proposed method achieved greater stability that indicated reduced impacts of sampling bias. The weighted mean is built based on covariance information in feature space as opposed to spatial location, thus making this a generic approach to be applicable to any feature of interest.
Collapse
Affiliation(s)
| | - Ilwoo Lyu
- Computer Science, Vanderbilt University, Nashville, TN
| | - Yuankai Huo
- Electrical Engineering, Vanderbilt University, Nashville, TN
| | - Justin Blaber
- Electrical Engineering, Vanderbilt University, Nashville, TN
| | | | - Hakmook Kang
- Department of Biostatistics, Vanderbilt University, Nashville, TN.,Center for Quantitative Sciences, Vanderbilt University, Nashville, TN
| | - Neil D Woodward
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University School of Medicine, Nashville, TN
| | - Bennett A Landman
- Electrical Engineering, Vanderbilt University, Nashville, TN.,Computer Science, Vanderbilt University, Nashville, TN.,Vanderbilt University Institute of Imaging Science, Vanderbilt University, Nashville, TN.,Department of Psychiatry and Behavioral Sciences, Vanderbilt University School of Medicine, Nashville, TN.,Center for Quantitative Sciences, Vanderbilt University, Nashville, TN
| |
Collapse
|
14
|
Lyu I, Perdomo J, Yapuncich GS, Paniagua B, Boyer DM, Styner MA. Group-wise Shape Correspondence of Variable and Complex Objects. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 10574:105742T. [PMID: 30381780 PMCID: PMC6205236 DOI: 10.1117/12.2293273] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
We present a group-wise shape correspondence method for analyzing variable and complex objects in a population study. The proposed method begins with the standard spherical harmonics (SPHARM) point distribution models (PDM) with their spherical mappings. In case of complex and variable objects, the equal area spherical mapping based SPHARM correspondence is imperfect. For such objects, we present here a novel group-wise correspondence. As an example dataset, we use 12 second mandibular molars representing 6 living or fossil euarchontan species. To improve initial correspondence of the SPHARM-PDM representation, we first apply a rigid transformation on each subject using five well-known landmarks (molar cusps). We further enhance the correspondence by optimizing landmarks (local) and multidimensional geometric property (global) over each subject with spherical harmonic representation. The resulting average shape model better captures sharp landmark representation in quantitative evaluation as well as a nice separation of different species compared with that of the SPHARM-PDM method.
Collapse
Affiliation(s)
- Ilwoo Lyu
- EECS, Vanderbilt University, Nashville, TN 37235, USA
| | - Jonathan Perdomo
- Department of Computer Science, University of North Carolina, Chapel Hill, NC 27599, USA
| | - Gabriel S Yapuncich
- Department of Evolutionary Anthropology, Duke University, Durham, NC 27708, USA
| | | | - Doug M Boyer
- Department of Evolutionary Anthropology, Duke University, Durham, NC 27708, USA
| | - Martin A Styner
- Department of Computer Science, University of North Carolina, Chapel Hill, NC 27599, USA
- Department of Psychiatry, University of North Carolina, Chapel Hill, NC 27599, USA
| |
Collapse
|
15
|
Robinson EC, Garcia K, Glasser MF, Chen Z, Coalson TS, Makropoulos A, Bozek J, Wright R, Schuh A, Webster M, Hutter J, Price A, Cordero Grande L, Hughes E, Tusor N, Bayly PV, Van Essen DC, Smith SM, Edwards AD, Hajnal J, Jenkinson M, Glocker B, Rueckert D. Multimodal surface matching with higher-order smoothness constraints. Neuroimage 2017; 167:453-465. [PMID: 29100940 DOI: 10.1016/j.neuroimage.2017.10.037] [Citation(s) in RCA: 155] [Impact Index Per Article: 22.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2017] [Revised: 10/13/2017] [Accepted: 10/17/2017] [Indexed: 02/05/2023] Open
Abstract
In brain imaging, accurate alignment of cortical surfaces is fundamental to the statistical sensitivity and spatial localisation of group studies, and cortical surface-based alignment has generally been accepted to be superior to volume-based approaches at aligning cortical areas. However, human subjects have considerable variation in cortical folding, and in the location of functional areas relative to these folds. This makes alignment of cortical areas a challenging problem. The Multimodal Surface Matching (MSM) tool is a flexible, spherical registration approach that enables accurate registration of surfaces based on a variety of different features. Using MSM, we have previously shown that driving cross-subject surface alignment, using areal features, such as resting state-networks and myelin maps, improves group task fMRI statistics and map sharpness. However, the initial implementation of MSM's regularisation function did not penalize all forms of surface distortion evenly. In some cases, this allowed peak distortions to exceed neurobiologically plausible limits, unless regularisation strength was increased to a level which prevented the algorithm from fully maximizing surface alignment. Here we propose and implement a new regularisation penalty, derived from physically relevant equations of strain (deformation) energy, and demonstrate that its use leads to improved and more robust alignment of multimodal imaging data. In addition, since spherical warps incorporate projection distortions that are unavoidable when mapping from a convoluted cortical surface to the sphere, we also propose constraints that enforce smooth deformation of cortical anatomies. We test the impact of this approach for longitudinal modelling of cortical development for neonates (born between 31 and 43 weeks of post-menstrual age) and demonstrate that the proposed method increases the biological interpretability of the distortion fields and improves the statistical significance of population-based analysis relative to other spherical methods.
Collapse
Affiliation(s)
- Emma C Robinson
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom; Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom; Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom.
| | - Kara Garcia
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA
| | - Matthew F Glasser
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA; St. Luke's Hospital, St Louis, MO, USA
| | - Zhengdao Chen
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA
| | - Timothy S Coalson
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA
| | - Antonios Makropoulos
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Jelena Bozek
- Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
| | - Robert Wright
- Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Andreas Schuh
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Matthew Webster
- Centre for Functional Magnetic Resonance Imaging of the Brain, John Radcliffe Hospital, Oxford University, United Kingdom
| | - Jana Hutter
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Anthony Price
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Lucilio Cordero Grande
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Emer Hughes
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Nora Tusor
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Philip V Bayly
- Department of Mechanical Engineering and Material Science, Washington University in St. Louis, St. Louis, MO, USA
| | - David C Van Essen
- Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA
| | - Stephen M Smith
- Centre for Functional Magnetic Resonance Imaging of the Brain, John Radcliffe Hospital, Oxford University, United Kingdom
| | - A David Edwards
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Joseph Hajnal
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Mark Jenkinson
- Centre for Functional Magnetic Resonance Imaging of the Brain, John Radcliffe Hospital, Oxford University, United Kingdom
| | - Ben Glocker
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Daniel Rueckert
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| |
Collapse
|