26
|
Chen X, Qu L, Xie Y, Ahmad S, Yap PT. A paired dataset of T1- and T2-weighted MRI at 3 Tesla and 7 Tesla. Sci Data 2023; 10:489. [PMID: 37500686 PMCID: PMC10374655 DOI: 10.1038/s41597-023-02400-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 07/20/2023] [Indexed: 07/29/2023] Open
Abstract
Brain magnetic resonance imaging (MRI) provides detailed soft tissue contrasts that are critical for disease diagnosis and neuroscience research. Higher MRI resolution typically comes at the cost of signal-to-noise ratio (SNR) and tissue contrast, particularly for more common 3 Tesla (3T) MRI scanners. At ultra-high magnetic field strength, 7 Tesla (7T) MRI allows for higher resolution with greater tissue contrast and SNR. However, the prohibitively high costs of 7T MRI scanners deter their widespread adoption in clinical and research centers. To obtain higher-quality images without 7T MRI scanners, algorithms that can synthesize 7T MR images from 3T MR images are under active development. Here, we make available a dataset of paired T1-weighted and T2-weighted MR images at 3T and 7T of 10 healthy subjects to facilitate the development and evaluation of 3T-to-7T MR image synthesis models. The quality of the dataset is assessed using image quality metrics implemented in MRIQC.
Collapse
|
27
|
Chung SH, Huynh KM, Goralski JL, Chen Y, Yap PT, Ceppe AS, Powell MZ, Donaldson SH, Lee YZ. Feasibility of free-breathing 19 F MRI image acquisition to characterize ventilation defects in CF and healthy volunteers at wash-in. Magn Reson Med 2023; 90:79-89. [PMID: 36912481 PMCID: PMC10149612 DOI: 10.1002/mrm.29630] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 01/27/2023] [Accepted: 02/15/2023] [Indexed: 03/14/2023]
Abstract
PURPOSE To explore the feasibility of measuring ventilation defect percentage (VDP) using 19 F MRI during free-breathing wash-in of fluorinated gas mixture with postacquisition denoising and to compare these results with those obtained through traditional Cartesian breath-hold acquisitions. METHODS Eight adults with cystic fibrosis and 5 healthy volunteers completed a single MR session on a Siemens 3T Prisma. 1 H Ultrashort-TE MRI sequences were used for registration and masking, and ventilation images with 19 F MRI were obtained while the subjects breathed a normoxic mixture of 79% perfluoropropane and 21% oxygen (O2 ). 19 F MRI was performed during breath holds and while free breathing with one overlapping spiral scan at breath hold for VDP value comparison. The 19 F spiral data were denoised using a low-rank matrix recovery approach. RESULTS VDP measured using 19 F VIBE and 19 F spiral images were highly correlated (r = 0.84) at 10 wash-in breaths. Second-breath VDPs were also highly correlated (r = 0.88). Denoising greatly increased SNR (pre-denoising spiral SNR, 2.46 ± 0.21; post-denoising spiral SNR, 33.91 ± 6.12; and breath-hold SNR, 17.52 ± 2.08). CONCLUSION Free-breathing 19 F lung MRI VDP analysis was feasible and highly correlated with breath-hold measurements. Free-breathing methods are expected to increase patient comfort and extend ventilation MRI use to patients who are unable to perform breath holds, including younger subjects and those with more severe lung disease.
Collapse
|
28
|
Chen G, Hong Y, Huynh KM, Yap PT. Deep learning prediction of diffusion MRI data with microstructure-sensitive loss functions. Med Image Anal 2023; 85:102742. [PMID: 36682154 PMCID: PMC9974781 DOI: 10.1016/j.media.2023.102742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 12/05/2022] [Accepted: 01/05/2023] [Indexed: 01/15/2023]
Abstract
Deep learning prediction of diffusion MRI (DMRI) data relies on the utilization of effective loss functions. Existing losses typically measure the signal-wise differences between the predicted and target DMRI data without considering the quality of derived diffusion scalars that are eventually utilized for quantification of tissue microstructure. Here, we propose two novel loss functions, called microstructural loss and spherical variance loss, to explicitly consider the quality of both the predicted DMRI data and derived diffusion scalars. We apply these loss functions to the prediction of multi-shell data and enhancement of angular resolution. Evaluation based on infant and adult DMRI data indicates that both microstructural loss and spherical variance loss improve the quality of derived diffusion scalars.
Collapse
|
29
|
Hering A, Hansen L, Mok TCW, Chung ACS, Siebert H, Hager S, Lange A, Kuckertz S, Heldmann S, Shao W, Vesal S, Rusu M, Sonn G, Estienne T, Vakalopoulou M, Han L, Huang Y, Yap PT, Brudfors M, Balbastre Y, Joutard S, Modat M, Lifshitz G, Raviv D, Lv J, Li Q, Jaouen V, Visvikis D, Fourcade C, Rubeaux M, Pan W, Xu Z, Jian B, De Benetti F, Wodzinski M, Gunnarsson N, Sjolund J, Grzech D, Qiu H, Li Z, Thorley A, Duan J, Grosbrohmer C, Hoopes A, Reinertsen I, Xiao Y, Landman B, Huo Y, Murphy K, Lessmann N, van Ginneken B, Dalca AV, Heinrich MP. Learn2Reg: Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:697-712. [PMID: 36264729 DOI: 10.1109/tmi.2022.3213983] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods.
Collapse
|
30
|
Cheng F, Liu Y, Chen Y, Yap PT. High-Resolution 3D Magnetic Resonance Fingerprinting With a Graph Convolutional Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:674-683. [PMID: 36269931 PMCID: PMC10081960 DOI: 10.1109/tmi.2022.3216527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Magnetic resonance fingerprinting (MRF) is a novel quantitative imaging framework for rapid and simultaneous quantification of multiple tissue properties. 3D MRF allows higher through-plane resolution, but the acquisition process is slow when whole-brain coverage is needed. Existing methods for acceleration mainly rely on GRAPPA for k-space interpolation in the partition-encoding direction, limiting the acceleration factor to 2 or 3. In this work, we replace GRAPPA with a deep learning approach for accurate tissue quantification with greater acceleration. Specifically, a graph convolution network (GCN) is developed to cater to the non-Cartesian spiral sampling trajectories typical in MRF acquisition. The GCN maintains high quantification accuracy with up to 6-fold acceleration and allows 1mm isotropic resolution whole-brain 3D MRF data to be acquired in 3min and submillimeter 3D MRF (0.8mm) in 5min, greatly improving the feasibility of MRF in clinical settings.
Collapse
|
31
|
Ma L, Xiao D, Kim D, Lian C, Kuang T, Liu Q, Deng H, Yang E, Liebschner MAK, Gateno J, Xia JJ, Yap PT. Simulation of Postoperative Facial Appearances via Geometric Deep Learning for Efficient Orthognathic Surgical Planning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:336-345. [PMID: 35657829 PMCID: PMC10037541 DOI: 10.1109/tmi.2022.3180078] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Orthognathic surgery corrects jaw deformities to improve aesthetics and functions. Due to the complexity of the craniomaxillofacial (CMF) anatomy, orthognathic surgery requires precise surgical planning, which involves predicting postoperative changes in facial appearance. To this end, most conventional methods involve simulation with biomechanical modeling methods, which are labor intensive and computationally expensive. Here we introduce a learning-based framework to speed up the simulation of postoperative facial appearances. Specifically, we introduce a facial shape change prediction network (FSC-Net) to learn the nonlinear mapping from bony shape changes to facial shape changes. FSC-Net is a point transform network weakly-supervised by paired preoperative and postoperative data without point-wise correspondence. In FSC-Net, a distance-guided shape loss places more emphasis on the jaw region. A local point constraint loss restricts point displacements to preserve the topology and smoothness of the surface mesh after point transformation. Evaluation results indicate that FSC-Net achieves 15× speedup with accuracy comparable to a state-of-the-art (SOTA) finite-element modeling (FEM) method.
Collapse
|
32
|
Ma L, Lian C, Kim D, Xiao D, Wei D, Liu Q, Kuang T, Ghanbari M, Li G, Gateno J, Shen SGF, Wang L, Shen D, Xia JJ, Yap PT. Bidirectional prediction of facial and bony shapes for orthognathic surgical planning. Med Image Anal 2023; 83:102644. [PMID: 36272236 PMCID: PMC10445637 DOI: 10.1016/j.media.2022.102644] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 07/18/2022] [Accepted: 09/27/2022] [Indexed: 11/07/2022]
Abstract
This paper proposes a deep learning framework to encode subject-specific transformations between facial and bony shapes for orthognathic surgical planning. Our framework involves a bidirectional point-to-point convolutional network (P2P-Conv) to predict the transformations between facial and bony shapes. P2P-Conv is an extension of the state-of-the-art P2P-Net and leverages dynamic point-wise convolution (i.e., PointConv) to capture local-to-global spatial information. Data augmentation is carried out in the training of P2P-Conv with multiple point subsets from the facial and bony shapes. During inference, network outputs generated for multiple point subsets are combined into a dense transformation. Finally, non-rigid registration using the coherent point drift (CPD) algorithm is applied to generate surface meshes based on the predicted point sets. Experimental results on real-subject data demonstrate that our method substantially improves the prediction of facial and bony shapes over state-of-the-art methods.
Collapse
|
33
|
Ahmad S, Wu Y, Wu Z, Thung KH, Liu S, Lin W, Li G, Wang L, Yap PT. Multifaceted atlases of the human brain in its infancy. Nat Methods 2023; 20:55-64. [PMID: 36585454 PMCID: PMC9834057 DOI: 10.1038/s41592-022-01703-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 10/25/2022] [Indexed: 12/31/2022]
Abstract
Brain atlases are spatial references for integrating, processing, and analyzing brain features gathered from different individuals, sources, and scales. Here we introduce a collection of joint surface-volume atlases that chart postnatal development of the human brain in a spatiotemporally dense manner from two weeks to two years of age. Our month-specific atlases chart normative patterns and capture key traits of early brain development and are therefore conducive to identifying aberrations from normal developmental trajectories. These atlases will enhance our understanding of early structural and functional development by facilitating the mapping of diverse features of the infant brain to a common reference frame for precise multifaceted quantification of cortical and subcortical changes.
Collapse
|
34
|
Guan H, Yue L, Yap PT, Xiao S, Bozoki A, Liu M. Attention-Guided Autoencoder for Automated Progression Prediction of Subjective Cognitive Decline With Structural MRI. IEEE J Biomed Health Inform 2023; PP. [PMID: 37030725 DOI: 10.1109/jbhi.2023.3257081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/18/2023]
Abstract
Subjective cognitive decline (SCD) is the preclinical stage of Alzheimer's disease (AD) which happens even earlier than mild cognitive impairment (MCI). Progressive SCD will convert to MCI with the potential of further evolving to AD. Therefore, early identification of progressive SCD with neuroimaging techniques (eg, structural MRI) is of great clinical value for early intervention of AD. However, existing MRI-based machine/deep learning methods usually suffer the small-sample-size problem and lack interpretability. To this end, we propose an interpretable autoencoder model with domain transfer learning (IADT) for progression prediction of SCD. Firstly, the proposed model can leverage MRIs from both the target domain (eg., SCD) and auxiliary domains (, AD and NC) for progressive SCD identification. Besides, it can automatically locate the disease-related brain regions of interest (defined in brain atlases) through an attention mechanism, which shows good interpretability. In addition, the IADT model is straightforward to train and test with only 5 ∼ 10 seconds on CPUs and is suitable for medical tasks with small datasets. Extensive experiments on the publicly available ADNI dataset and a private CLAS dataset have demonstrated the effectiveness of the proposed method.
Collapse
|
35
|
Chen X, Kuang T, Deng H, Fung SH, Gateno J, Xia JJ, Yap PT. Dual Adversarial Attention Mechanism for Unsupervised Domain Adaptive Medical Image Segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3445-3453. [PMID: 35759585 PMCID: PMC9748599 DOI: 10.1109/tmi.2022.3186698] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Domain adaptation techniques have been demonstrated to be effective in addressing label deficiency challenges in medical image segmentation. However, conventional domain adaptation based approaches often concentrate on matching global marginal distributions between different domains in a class-agnostic fashion. In this paper, we present a dual-attention domain-adaptative segmentation network (DADASeg-Net) for cross-modality medical image segmentation. The key contribution of DADASeg-Net is a novel dual adversarial attention mechanism, which regularizes the domain adaptation module with two attention maps respectively from the space and class perspectives. Specifically, the spatial attention map guides the domain adaptation module to focus on regions that are challenging to align in adaptation. The class attention map encourages the domain adaptation module to capture class-specific instead of class-agnostic knowledge for distribution alignment. DADASeg-Net shows superior performance in two challenging medical image segmentation tasks.
Collapse
|
36
|
Lang Y, Lian C, Xiao D, Deng H, Thung KH, Yuan P, Gateno J, Kuang T, Alfi DM, Wang L, Shen D, Xia JJ, Yap PT. Localization of Craniomaxillofacial Landmarks on CBCT Images Using 3D Mask R-CNN and Local Dependency Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2856-2866. [PMID: 35544487 PMCID: PMC9673501 DOI: 10.1109/tmi.2022.3174513] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Cephalometric analysis relies on accurate detection of craniomaxillofacial (CMF) landmarks from cone-beam computed tomography (CBCT) images. However, due to the complexity of CMF bony structures, it is difficult to localize landmarks efficiently and accurately. In this paper, we propose a deep learning framework to tackle this challenge by jointly digitalizing 105 CMF landmarks on CBCT images. By explicitly learning the local geometrical relationships between the landmarks, our approach extends Mask R-CNN for end-to-end prediction of landmark locations. Specifically, we first apply a detection network on a down-sampled 3D image to leverage global contextual information to predict the approximate locations of the landmarks. We subsequently leverage local information provided by higher-resolution image patches to refine the landmark locations. On patients with varying non-syndromic jaw deformities, our method achieves an average detection accuracy of 1.38± 0.95mm, outperforming a related state-of-the-art method.
Collapse
|
37
|
Xu T, Wu Y, Hong Y, Ahmad S, Huynh KM, Wang Z, Lin W, Chang WT, Yap PT. Rapid Diffusion Magnetic Resonance Imaging Using Slice-Interleaved Encoding. Med Image Anal 2022; 81:102548. [PMID: 35917693 PMCID: PMC9988327 DOI: 10.1016/j.media.2022.102548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Revised: 06/24/2022] [Accepted: 07/12/2022] [Indexed: 11/28/2022]
Abstract
In this paper, we present a robust reconstruction scheme for diffusion MRI (dMRI) data acquired using slice-interleaved diffusion encoding (SIDE). When combined with SIDE undersampling and simultaneous multi-slice (SMS) imaging, our reconstruction strategy is capable of significantly reducing the amount of data that needs to be acquired, enabling high-speed diffusion imaging for pediatric, elderly, and claustrophobic individuals. In contrast to the conventional approach of acquiring a full diffusion-weighted (DW) volume per diffusion wavevector, SIDE acquires in each repetition time (TR) a volume that consists of interleaved slice groups, each group corresponding to a different diffusion wavevector. This strategy allows SIDE to rapidly acquire data covering a large number of wavevectors within a short period of time. The proposed reconstruction method uses a diffusion spectrum model and multi-dimensional total variation to recover full DW images from DW volumes that are slice-undersampled due to unacquired SIDE volumes. We formulate an inverse problem that can be solved efficiently using the alternating direction method of multipliers (ADMM). Experiment results demonstrate that DW images can be reconstructed with high fidelity even when the acquisition is accelerated by 25 folds.
Collapse
|
38
|
Chen G, Jiang H, Liu J, Ma J, Cui H, Xia Y, Yap PT. Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13431:113-122. [PMID: 37126477 PMCID: PMC10141974 DOI: 10.1007/978-3-031-16431-6_11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Advanced contemporary diffusion models for tissue microstructure often require diffusion MRI (DMRI) data with sufficiently dense sampling in the diffusion wavevector space for reliable model fitting, which might not always be feasible in practice. A potential remedy to this problem is by using deep learning techniques to predict high-quality diffusion microstructural indices from sparsely sampled data. However, existing methods are either agnostic to the data geometry in the diffusion wavevector space ( q -space) or limited to leveraging information from only local neighborhoods in the physical coordinate space ( x -space). Here, we propose a hybrid graph transformer (HGT) to explicitly consider the q -space geometric structure with a graph neural network (GNN) and make full use of spatial information with a novel residual dense transformer (RDT). The RDT consists of multiple densely connected transformer layers and a residual connection to facilitate model training. Extensive experiments on the data from the Human Connectome Project (HCP) demonstrate that our method significantly improves the quality of microstructural estimations over existing state-of-the-art methods.
Collapse
|
39
|
Ahmad S, Nan F, Wu Y, Wu Z, Lin W, Wang L, Li G, Wu D, Yap PT. Harmonization of Multi-site Cortical Data Across the Human Lifespan. MACHINE LEARNING IN MEDICAL IMAGING. MLMI (WORKSHOP) 2022; 13583:220-229. [PMID: 37126478 PMCID: PMC10134963 DOI: 10.1007/978-3-031-21014-3_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Neuroimaging data harmonization has become a prerequisite in integrative data analytics for standardizing a wide variety of data collected from multiple studies and enabling interdisciplinary research. The lack of standardized image acquisition and computational procedures introduces non-biological variability and inconsistency in multi-site data, complicating downstream statistical analyses. Here, we propose a novel statistical technique to retrospectively harmonize multi-site cortical data collected longitudinally and cross-sectionally between birth and 100 years. We demonstrate that our method can effectively eliminate non-biological disparities from cortical thickness and myelination measurements, while preserving biological variation across the entire lifespan. Our harmonization method will foster large-scale population studies by providing comparable data required for investigating developmental and aging processes.
Collapse
|
40
|
Guan H, Liu S, Lin W, Yap PT, Liu M. Fast Image-Level MRI Harmonization via Spectrum Analysis. MACHINE LEARNING IN MEDICAL IMAGING. MLMI (WORKSHOP) 2022; 13583:201-209. [PMID: 36594909 PMCID: PMC9805301 DOI: 10.1007/978-3-031-21014-3_21] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Pooling structural magnetic resonance imaging (MRI) data from different imaging sites helps increase sample size to facilitate machine learning based neuroimage analysis, but usually suffers from significant cross-site and/or cross-scanner data heterogeneity. Existing studies often focus on reducing cross-site and/or cross-scanner heterogeneity at handcrafted feature level targeting specific tasks (e.g., classification or segmentation), limiting their adaptability in clinical practice. Research on image-level MRI harmonization targeting a broad range of applications is very limited. In this paper, we develop a spectrum swapping based image-level MRI harmonization (SSIMH) framework. Different from previous work, our method focuses on alleviating cross-scanner heterogeneity at raw image level. We first construct spectrum analysis to explore the influences of different frequency components on MRI harmonization. We then utilize a spectrum swapping method for the harmonization of raw MRIs acquired by different scanners. Our method does not rely on complex model training, and can be directly applied to fast real-time MRI harmonization. Experimental results on T1- and T2-weighted MRIs of phantom subjects acquired by using different scanners from the public ABCD dataset suggest the effectiveness of our method in structural MRI harmonization at the image level.
Collapse
|
41
|
Pang Y, Chen X, Huang Y, Yap PT, Lian J. Weakly Supervised MR-TRUS Image Synthesis for Brachytherapy of Prostate Cancer. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13436:485-494. [PMID: 38863462 PMCID: PMC11165422 DOI: 10.1007/978-3-031-16446-0_46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2024]
Abstract
Prostate magnetic resonance imaging (MRI) offers accurate details of structures and tumors for prostate cancer brachytherapy. However, it is unsuitable for routine treatment since MR images differ significantly from trans-rectal ultrasound (TRUS) images conventionally used for radioactive seed implants in brachytherapy. TRUS imaging is fast, convenient, and widely available in the operation room but is known for its low soft-tissue contrast and tumor visualization capability in the prostate area. Conventionally, practitioners usually rely on prostate segmentation to fuse the two imaging modalities with non-rigid registration. However, prostate delineation is often not available on diagnostic MR images. Besides, the high non-linear intensity relationship between two imaging modalities poses a challenge to non-rigid registration. Hence, we propose a method to generate a TRUS-styled image from a prostate MR image to replace the role of the TRUS image in radiation therapy dose pre-planning. We propose a structural constraint to handle non-linear projections of anatomical structures between MR and TRUS images. We further include an adversarial mechanism to enforce the model to preserve anatomical features in an MR image (such as prostate boundary and dominant intraprostatic lesion (DIL)) while synthesizing the TRUS-styled counterpart image. The proposed method is compared with other state-of-art methods with real TRUS images as the reference. The results demonstrate that the TRUS images synthesized by our method can be used for brachytherapy treatment planning for prostate cancer.
Collapse
|
42
|
Li G, Yap PT. From descriptive connectome to mechanistic connectome: Generative modeling in functional magnetic resonance imaging analysis. Front Hum Neurosci 2022; 16:940842. [PMID: 36061504 PMCID: PMC9428697 DOI: 10.3389/fnhum.2022.940842] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 07/28/2022] [Indexed: 01/28/2023] Open
Abstract
As a newly emerging field, connectomics has greatly advanced our understanding of the wiring diagram and organizational features of the human brain. Generative modeling-based connectome analysis, in particular, plays a vital role in deciphering the neural mechanisms of cognitive functions in health and dysfunction in diseases. Here we review the foundation and development of major generative modeling approaches for functional magnetic resonance imaging (fMRI) and survey their applications to cognitive or clinical neuroscience problems. We argue that conventional structural and functional connectivity (FC) analysis alone is not sufficient to reveal the complex circuit interactions underlying observed neuroimaging data and should be supplemented with generative modeling-based effective connectivity and simulation, a fruitful practice that we term "mechanistic connectome." The transformation from descriptive connectome to mechanistic connectome will open up promising avenues to gain mechanistic insights into the delicate operating principles of the human brain and their potential impairments in diseases, which facilitates the development of effective personalized treatments to curb neurological and psychiatric disorders.
Collapse
|
43
|
Maffei C, Girard G, Schilling KG, Aydogan DB, Adluru N, Zhylka A, Wu Y, Mancini M, Hamamci A, Sarica A, Teillac A, Baete SH, Karimi D, Yeh FC, Yildiz ME, Gholipour A, Bihan-Poudec Y, Hiba B, Quattrone A, Quattrone A, Boshkovski T, Stikov N, Yap PT, de Luca A, Pluim J, Leemans A, Prabhakaran V, Bendlin BB, Alexander AL, Landman BA, Canales-Rodríguez EJ, Barakovic M, Rafael-Patino J, Yu T, Rensonnet G, Schiavi S, Daducci A, Pizzolato M, Fischi-Gomez E, Thiran JP, Dai G, Grisot G, Lazovski N, Puch S, Ramos M, Rodrigues P, Prčkovska V, Jones R, Lehman J, Haber SN, Yendiki A. Insights from the IronTract challenge: Optimal methods for mapping brain pathways from multi-shell diffusion MRI. Neuroimage 2022; 257:119327. [PMID: 35636227 PMCID: PMC9453851 DOI: 10.1016/j.neuroimage.2022.119327] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/06/2022] [Accepted: 05/19/2022] [Indexed: 01/25/2023] Open
Abstract
Limitations in the accuracy of brain pathways reconstructed by diffusion MRI (dMRI) tractography have received considerable attention. While the technical advances spearheaded by the Human Connectome Project (HCP) led to significant improvements in dMRI data quality, it remains unclear how these data should be analyzed to maximize tractography accuracy. Over a period of two years, we have engaged the dMRI community in the IronTract Challenge, which aims to answer this question by leveraging a unique dataset. Macaque brains that have received both tracer injections and ex vivo dMRI at high spatial and angular resolution allow a comprehensive, quantitative assessment of tractography accuracy on state-of-the-art dMRI acquisition schemes. We find that, when analysis methods are carefully optimized, the HCP scheme can achieve similar accuracy as a more time-consuming, Cartesian-grid scheme. Importantly, we show that simple pre- and post-processing strategies can improve the accuracy and robustness of many tractography methods. Finally, we find that fiber configurations that go beyond crossing (e.g., fanning, branching) are the most challenging for tractography. The IronTract Challenge remains open and we hope that it can serve as a valuable validation tool for both users and developers of dMRI analysis methods.
Collapse
|
44
|
Wei D, Ahmad S, Guo Y, Chen L, Huang Y, Ma L, Wu Z, Li G, Wang L, Lin W, Yap PT, Shen D, Wang Q. Recurrent Tissue-Aware Network for Deformable Registration of Infant Brain MR Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1219-1229. [PMID: 34932474 PMCID: PMC9064923 DOI: 10.1109/tmi.2021.3137280] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Deformable registration is fundamental to longitudinal and population-based image analyses. However, it is challenging to precisely align longitudinal infant brain MR images of the same subject, as well as cross-sectional infant brain MR images of different subjects, due to fast brain development during infancy. In this paper, we propose a recurrently usable deep neural network for the registration of infant brain MR images. There are three main highlights of our proposed method. (i) We use brain tissue segmentation maps for registration, instead of intensity images, to tackle the issue of rapid contrast changes of brain tissues during the first year of life. (ii) A single registration network is trained in a one-shot manner, and then recurrently applied in inference for multiple times, such that the complex deformation field can be recovered incrementally. (iii) We also propose both the adaptive smoothing layer and the tissue-aware anti-folding constraint into the registration network to ensure the physiological plausibility of estimated deformations without degrading the registration accuracy. Experimental results, in comparison to the state-of-the-art registration methods, indicate that our proposed method achieves the highest registration accuracy while still preserving the smoothness of the deformation field. The implementation of our proposed registration network is available online https://github.com/Barnonewdm/ACTA-Reg-Net.
Collapse
|
45
|
Zhang H, Alexander DC, Shen D, Yap PT. Special issue on machine learning and deep learning in magnetic resonance. NMR IN BIOMEDICINE 2022; 35:e4713. [PMID: 35253294 DOI: 10.1002/nbm.4713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 02/09/2022] [Accepted: 02/12/2022] [Indexed: 06/14/2023]
|
46
|
Wei J, Wu Z, Wang L, Bui TD, Qu L, Yap PT, Xia Y, Li G, Shen D. A cascaded nested network for 3T brain MR image segmentation guided by 7T labeling. PATTERN RECOGNITION 2022; 124:108420. [PMID: 38469076 PMCID: PMC10927017 DOI: 10.1016/j.patcog.2021.108420] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
Accurate segmentation of the brain into gray matter, white matter, and cerebrospinal fluid using magnetic resonance (MR) imaging is critical for visualization and quantification of brain anatomy. Compared to 3T MR images, 7T MR images exhibit higher tissue contrast that is contributive to accurate tissue delineation for training segmentation models. In this paper, we propose a cascaded nested network (CaNes-Net) for segmentation of 3T brain MR images, trained by tissue labels delineated from the corresponding 7T images. We first train a nested network (Nes-Net) for a rough segmentation. The second Nes-Net uses tissue-specific geodesic distance maps as contextual information to refine the segmentation. This process is iterated to build CaNes-Net with a cascade of Nes-Net modules to gradually refine the segmentation. To alleviate the misalignment between 3T and corresponding 7T MR images, we incorporate a correlation coefficient map to allow well-aligned voxels to play a more important role in supervising the training process. We compared CaNes-Net with SPM and FSL tools, as well as four deep learning models on 18 adult subjects and the ADNI dataset. Our results indicate that CaNes-Net reduces segmentation errors caused by the misalignment and improves segmentation accuracy substantially over the competing methods.
Collapse
|
47
|
Ghanbari M, Soussia M, Jiang W, Wei D, Yap PT, Shen D, Zhang H. Alterations of dynamic redundancy of functional brain subnetworks in Alzheimer's disease and major depression disorders. Neuroimage Clin 2021; 33:102917. [PMID: 34929585 PMCID: PMC8688702 DOI: 10.1016/j.nicl.2021.102917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 12/05/2021] [Accepted: 12/13/2021] [Indexed: 11/15/2022]
Abstract
The human brain is not only efficiently but also "redundantly" connected. The redundancy design could help the brain maintain resilience to disease attacks. This paper explores subnetwork-level redundancy dynamics and the potential of such metrics in disease studies. As such, we looked into specific functional subnetworks, including those associated with high-level functions. We investigated how the subnetwork redundancy dynamics change along with Alzheimer's disease (AD) progression and with major depressive disorder (MDD), two major disorders that could share similar subnetwork alterations. We found an increased dynamic redundancy of the subcortical-cerebellum subnetwork and its connections to other high-order subnetworks in the mild cognitive impairment (MCI) and AD compared to the normal control (NC). With gained spatial specificity, we found such a redundancy index was sensitive to disease symptoms and could act as a protective mechanism to prevent the collapse of the brain network and functions. The dynamic redundancy of the medial frontal subnetwork and its connections to the frontoparietal subnetwork was also found decreased in MDD compared to NC. The spatial specificity of the redundancy dynamics changes may provide essential knowledge for a better understanding of shared neural substrates in AD and MDD.
Collapse
|
48
|
Chen X, Lian C, Deng HH, Kuang T, Lin HY, Xiao D, Gateno J, Shen D, Xia JJ, Yap PT. Fast and Accurate Craniomaxillofacial Landmark Detection via 3D Faster R-CNN. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3867-3878. [PMID: 34310293 PMCID: PMC8686670 DOI: 10.1109/tmi.2021.3099509] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Automatic craniomaxillofacial (CMF) landmark localization from cone-beam computed tomography (CBCT) images is challenging, considering that 1) the number of landmarks in the images may change due to varying deformities and traumatic defects, and 2) the CBCT images used in clinical practice are typically large. In this paper, we propose a two-stage, coarse-to-fine deep learning method to tackle these challenges with both speed and accuracy in mind. Specifically, we first use a 3D faster R-CNN to roughly locate landmarks in down-sampled CBCT images that have varying numbers of landmarks. By converting the landmark point detection problem to a generic object detection problem, our 3D faster R-CNN is formulated to detect virtual, fixed-size objects in small boxes with centers indicating the approximate locations of the landmarks. Based on the rough landmark locations, we then crop 3D patches from the high-resolution images and send them to a multi-scale UNet for the regression of heatmaps, from which the refined landmark locations are finally derived. We evaluated the proposed approach by detecting up to 18 landmarks on a real clinical dataset of CMF CBCT images with various conditions. Experiments show that our approach achieves state-of-the-art accuracy of 0.89 ± 0.64mm in an average time of 26.2 seconds per volume.
Collapse
|
49
|
Ghanbari M, Zhou Z, Hsu LM, Han Y, Sun Y, Yap PT, Zhang H, Shen D. Altered Connectedness of the Brain Chronnectome During the Progression to Alzheimer's Disease. Neuroinformatics 2021; 20:391-403. [PMID: 34837154 DOI: 10.1007/s12021-021-09554-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/03/2021] [Indexed: 11/24/2022]
Abstract
Graph theory has been extensively used to investigate brain network topology and its changes in disease cohorts. However, many graph theoretic analysis-based brain network studies focused on the shortest paths or, more generally, cost-efficiency. In this work, we use two new concepts, connectedness and 2-connectedness, to measure different global properties compared to the previously widely adopted ones. We apply them to unravel interesting characteristics in the brain, such as redundancy design and further conduct a time-varying brain functional network analysis for characterizing the progression of Alzheimer's disease (AD). Specifically, we define different connectedness and 2-connectedness states and evaluate their dynamics in AD and its preclinical stage, mild cognitive impairment (MCI), compared to the normal controls (NC). Results indicate that, compared to MCI and NC, brain networks of AD tend to be more frequently connected at a sparse level. For MCI, we found that their brains are more likely to be 2-connected in the minimal connected state as well indicating increasing redundancy in brain connectivity. Such a redundant design could ensure maintained connectedness of the MCI's brain network in the case that pathological damages break down any link or silenced any node, making it possible to preserve cognitive abilities. Our study suggests that the redundancy in the brain functional chronnectome could be altered in the preclinical stage of AD. The findings can be successfully replicated in a retest study and with an independent MCI dataset. Characterizing redundancy design in the brain chronnectome using connectedness and 2-connectedness analysis provides a unique viewpoint for understanding disease affected brain networks.
Collapse
|
50
|
Abstract
Magnetic resonance fingerprinting (MRF) is increasingly being used to evaluate brain development and differentiate normal and pathologic tissues in children. MRF can provide reliable and accurate intrinsic tissue properties, such as T1 and T2 relaxation times. MRF is a powerful tool in evaluating brain disease in pediatric population. MRF is a new quantitative MR imaging technique for rapid and simultaneous quantification of multiple tissue properties.
Collapse
|