1
|
Sarala B, Sumathy G, Kalpana A, Jasmine Hephzipah J. Glioma brain tumor detection using dual convolutional neural networks and histogram density segmentation algorithm. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
2
|
Yang Z, Hu Z, Ji H, Lafata K, Vaios E, Floyd S, Yin FF, Wang C. A neural ordinary differential equation model for visualizing deep neural network behaviors in multi-parametric MRI-based glioma segmentation. Med Phys 2023; 50:4825-4838. [PMID: 36840621 PMCID: PMC10440249 DOI: 10.1002/mp.16286] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 01/26/2023] [Accepted: 01/30/2023] [Indexed: 02/26/2023] Open
Abstract
PURPOSE To develop a neural ordinary differential equation (ODE) model for visualizing deep neural network behavior during multi-parametric MRI-based glioma segmentation as a method to enhance deep learning explainability. METHODS By hypothesizing that deep feature extraction can be modeled as a spatiotemporally continuous process, we implemented a novel deep learning model, Neural ODE, in which deep feature extraction was governed by an ODE parameterized by a neural network. The dynamics of (1) MR images after interactions with the deep neural network and (2) segmentation formation can thus be visualized after solving the ODE. An accumulative contribution curve (ACC) was designed to quantitatively evaluate each MR image's utilization by the deep neural network toward the final segmentation results. The proposed Neural ODE model was demonstrated using 369 glioma patients with a 4-modality multi-parametric MRI protocol: T1, contrast-enhanced T1 (T1-Ce), T2, and FLAIR. Three Neural ODE models were trained to segment enhancing tumor (ET), tumor core (TC), and whole tumor (WT), respectively. The key MRI modalities with significant utilization by deep neural networks were identified based on ACC analysis. Segmentation results by deep neural networks using only the key MRI modalities were compared to those using all four MRI modalities in terms of Dice coefficient, accuracy, sensitivity, and specificity. RESULTS All Neural ODE models successfully illustrated image dynamics as expected. ACC analysis identified T1-Ce as the only key modality in ET and TC segmentations, while both FLAIR and T2 were key modalities in WT segmentation. Compared to the U-Net results using all four MRI modalities, the Dice coefficient of ET (0.784→0.775), TC (0.760→0.758), and WT (0.841→0.837) using the key modalities only had minimal differences without significance. Accuracy, sensitivity, and specificity results demonstrated the same patterns. CONCLUSION The Neural ODE model offers a new tool for optimizing the deep learning model inputs with enhanced explainability. The presented methodology can be generalized to other medical image-related deep-learning applications.
Collapse
Affiliation(s)
- Zhenyu Yang
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Zongsheng Hu
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Hangjie Ji
- Department of Mathematics, North Carolina State University, Raleigh, North Carolina, USA
| | - Kyle Lafata
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
- Department of Radiology, Duke University, Durham, North Carolina, USA
- Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina, USA
| | - Eugene Vaios
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
| | - Scott Floyd
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
| | - Fang-Fang Yin
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Chunhao Wang
- Deparment of Radiation Oncology, Duke University, Durham, North Carolina, USA
| |
Collapse
|
3
|
Jogi SP, Thaha R, Rajan S, Mahajan V, Venugopal VK, Singh A, Mehndiratta A. Model for in-vivo estimation of stiffness of tibiofemoral joint using MR imaging and FEM analysis. J Transl Med 2021; 19:310. [PMID: 34281578 PMCID: PMC8287773 DOI: 10.1186/s12967-021-02977-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2021] [Accepted: 07/04/2021] [Indexed: 01/05/2023] Open
Abstract
BACKGROUND Appropriate structural and material properties are essential for finite-element-modeling (FEM). In knee FEM, structural information could extract through 3D-imaging, but the individual subject's tissue material properties are inaccessible. PURPOSE The current study's purpose was to develop a methodology to estimate the subject-specific stiffness of the tibiofemoral joint using finite-element-analysis (FEA) and MRI data of knee joint with and without load. METHODS In this study, six Magnetic Resonance Imaging (MRI) datasets were acquired from 3 healthy volunteers with axially loaded and unloaded knee joint. The strain was computed from the tibiofemoral bone gap difference (ΔmBGFT) using the knee MR images with and without load. The knee FEM study was conducted using a subject-specific knee joint 3D-model and various soft-tissue stiffness values (1 to 50 MPa) to develop subject-specific stiffness versus strain models. RESULTS Less than 1.02% absolute convergence error was observed during the simulation. Subject-specific combined stiffness of weight-bearing tibiofemoral soft-tissue was estimated with mean values as 2.40 ± 0.17 MPa. Intra-subject variability has been observed during the repeat scan in 3 subjects as 0.27, 0.12, and 0.15 MPa, respectively. All subject-specific stiffness-strain relationship data was fitted well with power function (R2 = 0.997). CONCLUSION The current study proposed a generalized mathematical model and a methodology to estimate subject-specific stiffness of the tibiofemoral joint for FEM analysis. Such a method might enhance the efficacy of FEM in implant design optimization and biomechanics for subject-specific studies. Trial registration The institutional ethics committee (IEC), Indian Institute of Technology, Delhi, India, approved the study on 20th September 2017, with reference number P-019; it was a pilot study, no clinical trail registration was recommended.
Collapse
Affiliation(s)
- Sandeep Panwar Jogi
- Centre for Biomedical Engineering, Indian Institute of Technology, Delhi, New Delhi, 110016, India.,Amity University Haryana, Gurgaon, 122413, India
| | - Rafeek Thaha
- Centre for Biomedical Engineering, Indian Institute of Technology, Delhi, New Delhi, 110016, India
| | - Sriram Rajan
- Mahajan Imaging Centre, New Delhi, 110016, India
| | | | | | - Anup Singh
- Centre for Biomedical Engineering, Indian Institute of Technology, Delhi, New Delhi, 110016, India.,Department of Biomedical Engineering, All India Institute of Medical Sciences, New Delhi, 110029, India
| | - Amit Mehndiratta
- Centre for Biomedical Engineering, Indian Institute of Technology, Delhi, New Delhi, 110016, India. .,Department of Biomedical Engineering, All India Institute of Medical Sciences, New Delhi, 110029, India.
| |
Collapse
|
4
|
Loi I, Stanev D, Moustakas K. Total Knee Replacement: Subject-Specific Modeling, Finite Element Analysis, and Evaluation of Dynamic Activities. Front Bioeng Biotechnol 2021; 9:648356. [PMID: 33937216 PMCID: PMC8085535 DOI: 10.3389/fbioe.2021.648356] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Accepted: 02/23/2021] [Indexed: 11/24/2022] Open
Abstract
This study presents a semi-automatic framework to create subject-specific total knee replacement finite element models, which can be used to analyze locomotion patterns and evaluate knee dynamics. In recent years, much scientific attention was attracted to pre-clinical optimization of customized total knee replacement operations through computational modeling to minimize post-operational adverse effects. However, the time-consuming and laborious process of developing a subject-specific finite element model poses an obstacle to the latter. One of this work's main goals is to automate the finite element model development process, which speeds up the proposed framework and makes it viable for practical applications. This pipeline's reliability was ratified by developing and validating a subject-specific total knee replacement model based on the 6th SimTK Grand Challenge data set. The model was validated by analyzing contact pressures on the tibial insert in relation to the patient's gait and analysis of tibial contact forces, which were found to be in accordance with the ones provided by the Grand Challenge data set. Subsequently, a sensitivity analysis was carried out to assess the influence of modeling choices on tibial insert's contact pressures and determine possible uncertainties on the models produced by the framework. Parameters, such as the position of ligament origin points, ligament stiffness, reference strain, and implant-bone alignment were used for the sensitivity study. Notably, it was found that changes in the alignment of the femoral component in reference to the knee bones significantly affect the load distribution at the tibiofemoral joint, with an increase of 206.48% to be observed at contact pressures during 5° internal rotation. Overall, the models produced by this pipeline can be further used to optimize and personalize surgery by evaluating the best surgical parameters in a simulated manner before the actual surgery.
Collapse
Affiliation(s)
- Iliana Loi
- Department of Electrical and Computer Engineering, University of Patras, Patras, Greece
| | - Dimitar Stanev
- Department of Electrical and Computer Engineering, University of Patras, Patras, Greece.,School of Engineering, Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | | |
Collapse
|
5
|
Multiclass machine learning vs. conventional calculators for stroke/CVD risk assessment using carotid plaque predictors with coronary angiography scores as gold standard: a 500 participants study. Int J Cardiovasc Imaging 2020; 37:1171-1187. [DOI: 10.1007/s10554-020-02099-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 11/03/2020] [Indexed: 02/07/2023]
|
6
|
Imani Nejad Z, Khalili K, Hosseini Nasab SH, Schütz P, Damm P, Trepczynski A, Taylor WR, Smith CR. The Capacity of Generic Musculoskeletal Simulations to Predict Knee Joint Loading Using the CAMS-Knee Datasets. Ann Biomed Eng 2020; 48:1430-1440. [PMID: 32002734 PMCID: PMC7089909 DOI: 10.1007/s10439-020-02465-5] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 01/23/2020] [Indexed: 11/26/2022]
Abstract
Musculoskeletal models enable non-invasive estimation of knee contact forces (KCFs) during functional movements. However, the redundant nature of the musculoskeletal system and uncertainty in model parameters necessitates that model predictions are critically evaluated. This study compared KCF and muscle activation patterns predicted using a scaled generic model and OpenSim static optimization tool against in vivo measurements from six patients in the CAMS-knee datasets during level walking and squatting. Generally, the total KCFs were under-predicted (RMS: 47.55%BW, R2: 0.92) throughout the gait cycle, but substiantially over-predicted (RMS: 105.7%BW, R2: 0.81) during squatting. To understand the underlying etiology of the errors, muscle activations were compared to electromyography (EMG) signals, and showed good agreement during level walking. For squatting, however, the muscle activations showed large descrepancies especially for the biceps femoris long head. Errors in the predicted KCF and muscle activation patterns were greatest during deep squat. Hence suggesting that the errors mainly originate from muscle represented at the hip and an associated muscle co-contraction at the knee. Furthermore, there were substaintial differences in the ranking of subjects and activities based on peak KCFs in the simulations versus measurements. Thus, future simulation study designs must account for subject-specific uncertainties in musculoskeletal predictions.
Collapse
Affiliation(s)
- Zohreh Imani Nejad
- Department of Mechanical Engineering, University of Birjand, Birjand, Iran
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093, Zurich, Switzerland
| | - Khalil Khalili
- Department of Mechanical Engineering, University of Birjand, Birjand, Iran
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093, Zurich, Switzerland
| | | | - Pascal Schütz
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093, Zurich, Switzerland
| | - Philipp Damm
- Julius Wolff Institute, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Adam Trepczynski
- Julius Wolff Institute, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - William R Taylor
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093, Zurich, Switzerland.
| | - Colin R Smith
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093, Zurich, Switzerland
| |
Collapse
|
7
|
Wu G, Shi Z, Chen Y, Wang Y, Yu J, Lv X, Chen L, Ju X, Chen Z. A sparse representation-based radiomics for outcome prediction of higher grade gliomas. Med Phys 2018; 46:250-261. [PMID: 30418680 DOI: 10.1002/mp.13288] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2018] [Revised: 10/29/2018] [Accepted: 10/30/2018] [Indexed: 12/24/2022] Open
Abstract
PURPOSE Accurately predicting outcome (i.e., overall survival (OS) time) for higher grade glioma (HGG) has great clinical value and would provide optimized guidelines for treatment planning. Radiomics focuses on revealing underlying pathophysiological information in biomedical images for disease analysis and demonstrates promising prognostic clinical performance. In this paper, we propose a novel sparse representation-based radiomics framework to predict if HGG patients would have long or short OS time. METHODS First, taking advantages of the scale invariant feature transform (SIFT) feature in image characterizing, we developed a sparse representation-based method to convert a local SIFT descriptor into a global tumor feature. Next, because preserving sample structure is beneficial for feature selection, we proposed a locality preserving projection and sparse representation-combined feature selection method to select more discriminative features for tumor classification. Finally, we employed a multifeature collaborative sparse representation classification to combine the information of multimodal images to classify OS time. RESULTS Three experiments were performed on the two datasets provided by different institutions. Specifically, the proposed model was trained and independently tested on dataset 1 (135 subjects), on dataset 2 (86 subjects), and on the combination of dataset 1 and dataset 2, respectively. Experimental results demonstrated that the proposed method achieved encouraging prediction performance, exhibiting a testing accuracy of 93.33% on dataset 1 (one modality), 92.31% on dataset 2 (two modalities), and 87.93% on the combined dataset (one modality). CONCLUSIONS The sparse representation theory provides reasonable solutions to feature extraction, feature selection, and classification for radiomics. This study provides a promising tool to enhance the prediction performance of HGG patient's outcome.
Collapse
Affiliation(s)
- Guoqing Wu
- Department of Electronic Engineering, Fudan University, Shanghai, 200433, China
| | - Zhifeng Shi
- Department of Neurosurgery, Huashan Hospital, Fudan University, Shanghai, 200433, China
| | - Yinsheng Chen
- Department of Neurosurgery/Neuro-oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, 510000, China
| | - Yuanyuan Wang
- Department of Electronic Engineering, Fudan University and Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention of Shanghai, Shanghai, 200433, China
| | - Jinhua Yu
- Department of Electronic Engineering, Fudan University and Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention of Shanghai, Shanghai, 200433, China
| | - Xiaofei Lv
- Department of Medical Imaging, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, 510000, China
| | - Liang Chen
- Department of Neurosurgery, Huashan Hospital, Fudan University, Shanghai, 200433, China
| | - Xue Ju
- Department of Neurosurgery/Neuro-oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, 510000, China
| | - Zhongping Chen
- Department of Neurosurgery/Neuro-oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, 510000, China
| |
Collapse
|