1
|
Yuan S, Chen R, Liu X, Wang T, Wang A, Fan N, Du P, Xi Y, Gu Z, Zhang Y, Zang L. Artificial intelligence automatic measurement technology of lumbosacral radiographic parameters. Front Bioeng Biotechnol 2024; 12:1404058. [PMID: 39011157 PMCID: PMC11246908 DOI: 10.3389/fbioe.2024.1404058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 06/17/2024] [Indexed: 07/17/2024] Open
Abstract
Background Currently, manual measurement of lumbosacral radiological parameters is time-consuming and laborious, and inevitably produces considerable variability. This study aimed to develop and evaluate a deep learning-based model for automatically measuring lumbosacral radiographic parameters on lateral lumbar radiographs. Methods We retrospectively collected 1,240 lateral lumbar radiographs to train the model. The included images were randomly divided into training, validation, and test sets in a ratio of approximately 8:1:1 for model training, fine-tuning, and performance evaluation, respectively. The parameters measured in this study were lumbar lordosis (LL), sacral horizontal angle (SHA), intervertebral space angle (ISA) at L4-L5 and L5-S1 segments, and the percentage of lumbar spondylolisthesis (PLS) at L4-L5 and L5-S1 segments. The model identified key points using image segmentation results and calculated measurements. The average results of key points annotated by the three spine surgeons were used as the reference standard. The model's performance was evaluated using the percentage of correct key points (PCK), intra-class correlation coefficient (ICC), Pearson correlation coefficient (r), mean absolute error (MAE), root mean square error (RMSE), and box plots. Results The model's mean differences from the reference standard for LL, SHA, ISA (L4-L5), ISA (L5-S1), PLS (L4-L5), and PLS (L5-S1) were 1.69°, 1.36°, 1.55°, 1.90°, 1.60%, and 2.43%, respectively. When compared with the reference standard, the measurements of the model had better correlation and consistency (LL, SHA, and ISA: ICC = 0.91-0.97, r = 0.91-0.96, MAE = 1.89-2.47, RMSE = 2.32-3.12; PLS: ICC = 0.90-0.92, r = 0.90-0.91, MAE = 1.95-2.93, RMSE = 2.52-3.70), and the differences between them were not statistically significant (p > 0.05). Conclusion The model developed in this study could correctly identify key vertebral points on lateral lumbar radiographs and automatically calculate lumbosacral radiographic parameters. The measurement results of the model had good consistency and reliability compared to manual measurements. With additional training and optimization, this technology holds promise for future measurements in clinical practice and analysis of large datasets.
Collapse
Affiliation(s)
- Shuo Yuan
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Ruiyuan Chen
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Xingyu Liu
- School of Life Sciences, Tsinghua University, Beijing, China
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Tianyi Wang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Aobo Wang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Ning Fan
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Peng Du
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Yu Xi
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Zhao Gu
- Longwood Valley Medical Technology Co., Ltd., Beijing, China
| | - Yiling Zhang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
- Longwood Valley Medical Technology Co., Ltd., Beijing, China
| | - Lei Zang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
2
|
Liu Z, Wu J, Gao X, Qin Z, Tian R, Wang C. Deep learning-based automatic measurement system for patellar height: a multicenter retrospective study. J Orthop Surg Res 2024; 19:324. [PMID: 38822361 PMCID: PMC11141039 DOI: 10.1186/s13018-024-04809-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Accepted: 05/22/2024] [Indexed: 06/02/2024] Open
Abstract
BACKGROUND The patellar height index is important; however, the measurement procedures are time-consuming and prone to significant variability among and within observers. We developed a deep learning-based automatic measurement system for the patellar height and evaluated its performance and generalization ability to accurately measure the patellar height index. METHODS We developed a dataset containing 3,923 lateral knee X-ray images. Notably, all X-ray images were from three tertiary level A hospitals, and 2,341 cases were included in the analysis after screening. By manually labeling key points, the model was trained using the residual network (ResNet) and high-resolution network (HRNet) for human pose estimation architectures to measure the patellar height index. Various data enhancement techniques were used to enhance the robustness of the model. The root mean square error (RMSE), object keypoint similarity (OKS), and percentage of correct keypoint (PCK) metrics were used to evaluate the training results. In addition, we used the intraclass correlation coefficient (ICC) to assess the consistency between manual and automatic measurements. RESULTS The HRNet model performed excellently in keypoint detection tasks by comparing different deep learning models. Furthermore, the pose_hrnet_w48 model was particularly outstanding in the RMSE, OKS, and PCK metrics, and the Insall-Salvati index (ISI) automatically calculated by this model was also highly consistent with the manual measurements (intraclass correlation coefficient [ICC], 0.809-0.885). This evidence demonstrates the accuracy and generalizability of this deep learning system in practical applications. CONCLUSION We successfully developed a deep learning-based automatic measurement system for the patellar height. The system demonstrated accuracy comparable to that of experienced radiologists and a strong generalizability across different datasets. It provides an essential tool for assessing and treating knee diseases early and monitoring and rehabilitation after knee surgery. Due to the potential bias in the selection of datasets in this study, different datasets should be examined in the future to optimize the model so that it can be reliably applied in clinical practice. TRIAL REGISTRATION The study was registered at the Medical Research Registration and Filing Information System (medicalresearch.org.cn) MR-61-23-013065. Date of registration: May 04, 2023 (retrospectively registered).
Collapse
Affiliation(s)
- Zeyu Liu
- Department of Bone and Joint Surgery, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Jiangjiang Wu
- College of Information and Communication Engineering, Harbin Engineering University, Heilongjiang, Harbin, China
| | - Xu Gao
- Department of Orthopedics, Xi'an Honghui Hospital, Xi'an, Shaanxi, China
| | - Zhipeng Qin
- Department of Orthopedics, The Second Affiliated Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
| | - Run Tian
- Department of Bone and Joint Surgery, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, China.
| | - Chunsheng Wang
- Department of Bone and Joint Surgery, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, China.
| |
Collapse
|
3
|
Barbosa RM, Serrador L, da Silva MV, Macedo CS, Santos CP. Knee landmarks detection via deep learning for automatic imaging evaluation of trochlear dysplasia and patellar height. Eur Radiol 2024:10.1007/s00330-024-10596-9. [PMID: 38337072 DOI: 10.1007/s00330-024-10596-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 12/13/2023] [Accepted: 12/19/2023] [Indexed: 02/12/2024]
Abstract
OBJECTIVES To develop and validate a deep learning-based approach to automatically measure the patellofemoral instability (PFI) indices related to patellar height and trochlear dysplasia in knee magnetic resonance imaging (MRI) scans. METHODS A total of 763 knee MRI slices from 95 patients were included in the study, and 3393 anatomical landmarks were annotated for measuring sulcus angle (SA), trochlear facet asymmetry (TFA), trochlear groove depth (TGD) and lateral trochlear inclination (LTI) to assess trochlear dysplasia, and Insall-Salvati index (ISI), modified Insall-Salvati index (MISI), Caton Deschamps index (CDI) and patellotrochlear index (PTI) to assess patellar height. A U-Net based network was implemented to predict the landmarks' locations. The successful detection rate (SDR) and the mean absolute error (MAE) evaluation metrics were used to evaluate the performance of the network. The intraclass correlation coefficient (ICC) was also used to evaluate the reliability of the proposed framework to measure the mentioned PFI indices. RESULTS The developed models achieved good accuracy in predicting the landmarks' locations, with a maximum value for the MAE of 1.38 ± 0.76 mm. The results show that LTI, TGD, ISI, CDI and PTI can be measured with excellent reliability (ICC > 0.9), and SA, TFA and MISI can be measured with good reliability (ICC > 0.75), with the proposed framework. CONCLUSIONS This study proposes a reliable approach with promising applicability for automatic patellar height and trochlear dysplasia assessment, assisting the radiologists in their clinical practice. CLINICAL RELEVANCE STATEMENT The objective knee landmarks detection on MRI images provided by artificial intelligence may improve the reproducibility and reliability of the imaging evaluation of trochlear anatomy and patellar height, assisting radiologists in their clinical practice in the patellofemoral instability assessment. KEY POINTS • Imaging evaluation of patellofemoral instability is subjective and vulnerable to substantial intra and interobserver variability. • Patellar height and trochlear dysplasia are reliably assessed in MRI by means of artificial intelligence (AI). • The developed AI framework provides an objective evaluation of patellar height and trochlear dysplasia enhancing the clinical practice of the radiologists.
Collapse
Affiliation(s)
- Roberto M Barbosa
- Center of MicroElectroMechanical Systems (CMEMS), University of Minho, Guimarães, Portugal.
- MIT Portugal Program, School of Engineering, University of Minho, Guimarães, Portugal.
| | - Luís Serrador
- Center of MicroElectroMechanical Systems (CMEMS), University of Minho, Guimarães, Portugal
| | | | | | - Cristina P Santos
- Center of MicroElectroMechanical Systems (CMEMS), University of Minho, Guimarães, Portugal
- LABBELS - Associate Laboratory, Braga/Guimarães, Portugal
| |
Collapse
|
4
|
Wang C, Ni M, Tian S, Ouyang H, Liu X, Fan L, Dong P, Jiang L, Lang N, Yuan H. Deep learning model for measuring the sagittal Cobb angle on cervical spine computed tomography. BMC Med Imaging 2023; 23:196. [PMID: 38017414 PMCID: PMC10685593 DOI: 10.1186/s12880-023-01156-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 11/15/2023] [Indexed: 11/30/2023] Open
Abstract
PURPOSES To develop a deep learning (DL) model to measure the sagittal Cobb angle of the cervical spine on computed tomography (CT). MATERIALS AND METHODS Two VB-Net-based DL models for cervical vertebra segmentation and key-point detection were developed. Four-points and line-fitting methods were used to calculate the sagittal Cobb angle automatically. The average value of the sagittal Cobb angle was manually measured by two doctors as the reference standard. The percentage of correct key points (PCK), matched samples t test, intraclass correlation coefficient (ICC), Pearson correlation coefficient, mean absolute error (MAE), and Bland‒Altman plots were used to evaluate the performance of the DL model and the robustness and generalization of the model on the external test set. RESULTS A total of 991 patients were included in the internal data set, and 112 patients were included in the external data set. The PCK of the DL model ranged from 78 to 100% in the test set. The four-points method, line-fitting method, and reference standard measured sagittal Cobb angles were - 1.10 ± 18.29°, 0.30 ± 13.36°, and 0.50 ± 12.83° in the internal test set and 4.55 ± 20.01°, 3.66 ± 18.55°, and 1.83 ± 12.02° in the external test set, respectively. The sagittal Cobb angle calculated by the four-points method and the line-fitting method maintained high consistency with the reference standard (internal test set: ICC = 0.75 and 0.97; r = 0.64 and 0.94; MAE = 5.42° and 3.23°, respectively; external test set: ICC = 0.74 and 0.80, r = 0.66 and 0.974, MAE = 5.25° and 4.68°, respectively). CONCLUSIONS The DL model can accurately measure the sagittal Cobb angle of the cervical spine on CT. The line-fitting method shows a higher consistency with the doctors and a minor average absolute error.
Collapse
Affiliation(s)
- Chunjie Wang
- Department of Radiology, Peking University Third Hospital, 49 Huayuan North Road, Haidian District, Beijing, 100191, China
| | - Ming Ni
- Department of Radiology, Peking University Third Hospital, 49 Huayuan North Road, Haidian District, Beijing, 100191, China
| | - Shuai Tian
- Department of Radiology, Peking University Third Hospital, 49 Huayuan North Road, Haidian District, Beijing, 100191, China
| | - Hanqiang Ouyang
- Department of Orthopedics, Peking University Third Hospital, Beijing, 100191, China
- Engineering Research Center of Bone and Joint Precision Medicine, Beijing, 100191, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, 100191, China
| | - Xiaoming Liu
- Beijing United Imaging Research Institute of Intelligent Imaging, Beijing, 100089, China
| | - Lianxi Fan
- United Imaging Intelligence (Beijing) Co., Ltd., Beijing, 100089, China
| | - Pei Dong
- United Imaging Intelligence (Beijing) Co., Ltd., Beijing, 100089, China
| | - Liang Jiang
- Department of Orthopedics, Peking University Third Hospital, Beijing, 100191, China
- Engineering Research Center of Bone and Joint Precision Medicine, Beijing, 100191, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, 100191, China
| | - Ning Lang
- Department of Radiology, Peking University Third Hospital, 49 Huayuan North Road, Haidian District, Beijing, 100191, China
| | - Huishu Yuan
- Department of Radiology, Peking University Third Hospital, 49 Huayuan North Road, Haidian District, Beijing, 100191, China.
| |
Collapse
|
5
|
Wu Y, Chen X, Dong F, He L, Cheng G, Zheng Y, Ma C, Yao H, Zhou S. Performance evaluation of a deep learning-based cascaded HRNet model for automatic measurement of X-ray imaging parameters of lumbar sagittal curvature. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2023:10.1007/s00586-023-07937-5. [PMID: 37787781 DOI: 10.1007/s00586-023-07937-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 04/03/2023] [Accepted: 08/30/2023] [Indexed: 10/04/2023]
Abstract
PURPOSE To develop a deep learning-based cascaded HRNet model, in order to automatically measure X-ray imaging parameters of lumbar sagittal curvature and to evaluate its prediction performance. METHODS A total of 3730 lumbar lateral digital radiography (DR) images were collected from picture archiving and communication system (PACS). Among them, 3150 images were randomly selected as the training dataset and validation dataset, and 580 images as the test dataset. The landmarks of the lumbar curve index (LCI), lumbar lordosis angle (LLA), sacral slope (SS), lumbar lordosis index (LLI), and the posterior edge tangent angle of the vertebral body (PTA) were identified and marked. The measured results of landmarks on the test dataset were compared with the mean values of manual measurement as the reference standard. Percentage of correct key-points (PCK), intra-class correlation coefficient (ICC), Pearson correlation coefficient (r), mean absolute error (MAE), mean square error (MSE), root-mean-square error (RMSE), and Bland-Altman plot were used to evaluate the performance of the cascade HRNet model. RESULTS The PCK of the cascaded HRNet model was 97.9-100% in the 3 mm distance threshold. The mean differences between the reference standard and the predicted values for LCI, LLA, SS, LLI, and PTA were 0.43 mm, 0.99°, 1.11°, 0.01 mm, and 0.23°, respectively. There were strong correlation and consistency of the five parameters between the cascaded HRNet model and manual measurements (ICC = 0.989-0.999, R = 0.991-0.999, MAE = 0.63-1.65, MSE = 0.61-4.06, RMSE = 0.78-2.01). CONCLUSION The cascaded HRNet model based on deep learning algorithm could accurately identify the sagittal curvature-related landmarks on lateral lumbar DR images and automatically measure the relevant parameters, which is of great significance in clinical application.
Collapse
Affiliation(s)
- Yuhua Wu
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaofei Chen
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine (The first affiliated hospital of Gansu University of Traditional Chinese Medicine), Lanzhou, 730050, Gansu, China
| | - Fuwen Dong
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine (The first affiliated hospital of Gansu University of Traditional Chinese Medicine), Lanzhou, 730050, Gansu, China
| | - Linyang He
- Hangzhou Jianpei Technology Company Ltd, Hangzhou, 311200, Zhejiang, China
| | - Guohua Cheng
- Hangzhou Jianpei Technology Company Ltd, Hangzhou, 311200, Zhejiang, China
| | - Yuwen Zheng
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Chunyu Ma
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Hongyan Yao
- Department of Radiology, Gansu Provincial Hospital, No. 204, Donggang West Road, Lanzhou, 730000, Gansu, China
| | - Sheng Zhou
- Department of Radiology, Gansu Provincial Hospital, No. 204, Donggang West Road, Lanzhou, 730000, Gansu, China.
| |
Collapse
|
6
|
Mukherjee S, Bandyopadhyay O, Biswas A, Bhattacharya BB. Tracking patellar osteophytes to detect osteoarthritis. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2023. [DOI: 10.1080/21681163.2023.2194453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
7
|
Yan Y, Zhang X, Meng Y, Shen Q, He L, Cheng G, Gong X. Sagittal intervertebral rotational motion: a deep learning-based measurement on flexion–neutral–extension cervical lateral radiographs. BMC Musculoskelet Disord 2022; 23:967. [DOI: 10.1186/s12891-022-05927-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 10/27/2022] [Indexed: 11/10/2022] Open
Abstract
Abstract
Background
The analysis of sagittal intervertebral rotational motion (SIRM) can provide important information for the evaluation of cervical diseases. Deep learning has been widely used in spinal parameter measurements, however, there are few investigations on spinal motion analysis. The purpose of this study is to develop a deep learning-based model for fully automated measurement of SIRM based on flexion–neutral–extension cervical lateral radiographs and to evaluate its applicability for the flexion–extension (F/E), flexion–neutral (F/N), and neutral–extension (N/E) motion analysis.
Methods
A total of 2796 flexion, neutral, and extension cervical lateral radiographs from 932 patients were analyzed. Radiographs from 100 patients were randomly selected as the test set, and those from the remaining 832 patients were used for training and validation. Landmarks were annotated for measuring SIRM at five segments from C2/3 to C6/7 on F/E, F/N, and N/E motion. High-Resolution Net (HRNet) was used as the main structure to train the landmark detection network. Landmark performance was assessed according to the percentage of correct key points (PCK) and mean of the percentage of correct key points (MPCK). Measurement performance was evaluated by intra-class correlation coefficient (ICC), Pearson correlation coefficient, mean absolute error (MAE), root mean square error (RMSE), and Bland-Altman plots.
Results
At a 2-mm distance threshold, the PCK for the model ranged from 94 to 100%. Compared with the reference standards, the model showed high accuracy for SIRM measurements for all segments on F/E and F/N motion. On N/E motion, the model provided reliable measurements from C3/4 to C6/7, but not C2/3. Compared with the radiologists’ measurements, the model showed similar performance to the radiologists.
Conclusions
The developed model can automatically measure SIRM on flexion–neutral–extension cervical lateral radiographs and showed comparable performance with radiologists. It may provide rapid, accurate, and comprehensive information for cervical motion analysis.
Collapse
|
8
|
Development of Deep Learning-based Automatic Scan Range Setting Model for Lung Cancer Screening Low-dose CT Imaging. Acad Radiol 2022; 29:1541-1551. [PMID: 35131147 DOI: 10.1016/j.acra.2021.12.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2021] [Revised: 12/02/2021] [Accepted: 12/03/2021] [Indexed: 12/14/2022]
Abstract
RATIONALE AND OBJECTIVES To develop an automatic setting of a deep learning-based system for detecting low-dose computed tomography (CT) lung cancer screening scan range and compare its efficiency with the radiographer's performance. MATERIALS AND METHODS This retrospective study was performed using 1984 lung cancer screening low-dose CT scans obtained between November 2019 and May 2020. Among 1984 CT scans, 600 CT scans were considered suitable for an observational study to explore the relationship between the scout landmarks and the actual lung boundaries. Further, 1144 CT scans data set was used for the development of a deep learning-based algorithm. This data set was split into an 8:2 ratio divided into a training set (80%, n = 915) and a validation set (20%, n = 229). The performance of the deep learning algorithm was evaluated in the test set (n = 240) using actual lung boundaries and radiographers' scan ranges. RESULTS The mean differences between the upper and lower boundaries of the deep learning-based algorithm and the actual lung boundaries were 4.72 ± 3.15 mm and 16.50 ± 14.06 mm, respectively. The accuracy and over-scanning of the scan ranges generated by the system were 97.08% (233/240) and 0% (0/240) for the upper boundary, and 96.25% (231/240) and 29.58% (71/240) for the lower boundary. CONCLUSION The developed deep learning-based algorithm system can effectively predict lung cancer screening low-dose CT scan range with high accuracy using only the frontal scout.
Collapse
|
9
|
Automatic measurement of the patellofemoral joint parameters in the Laurin view: a deep learning-based approach. Eur Radiol 2022; 33:566-577. [PMID: 35788755 DOI: 10.1007/s00330-022-08967-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Revised: 05/27/2022] [Accepted: 06/14/2022] [Indexed: 11/04/2022]
Abstract
OBJECTIVES To explore the performance of a deep learning-based algorithm for automatic patellofemoral joint (PFJ) parameter measurements from the Laurin view. METHODS A total of 1431 consecutive Laurin views of the PFJ were retrospectively collected and divided into two parts: (1) the model development dataset (dataset 1, n = 1230) and (2) the hold-out test set (dataset 2, n = 201). Dataset 1 was used to develop the U-shaped fully convolutional network (U-Net) model to segment the landmarks of the PFJ. Based on the predicted landmarks, the PFJ parameters were calculated, including the sulcus angle (SA), congruence angle (CA), patellofemoral ratio (PFR), and lateral patellar tilt (LPT). Dataset 2 was used to assess the model performance. The mean of three radiologists who independently measured the PFJ parameters was defined as the reference standard. Model performance was assessed by the intraclass correlation coefficient (ICC), mean absolute difference (MAD), and root mean square (RMS) compared to the reference standard. Ninety-five percent limits of agreement (95% LoA) were calculated pairwise for each radiologist, reference standard, and model. RESULTS Compared with the reference standard, U-Net showed good performance for predicting SA, CA, PFR, and LPT, with ICC = 0.85-0.97, MAD = 0.06-5.09, and RMS = 0.09-6.90 in the hold-out test set. Except for the PFR, the remaining parameters measured between the reference standard and the model were within the 95% LoA in the hold-out test dataset. CONCLUSIONS The U-Net-based deep learning approach had a relatively high model performance in automatically measuring SA, CA, PFR, and LPT. KEY POINTS • The U-Net model could be used to segment the landmarks of the PFJ and calculate the SA, CA, PFR, and LPT, which could be used to evaluate the patellar instability. • In the hold-out test, the automatic measurement model yielded comparable performance with reference standard. • The automatic measurement model could still accurately predict SA, CA, PFR, and LPT in patients with PI and/or PFOA.
Collapse
|
10
|
Yang W, Ye Q, Ming S, Hu X, Jiang Z, Shen Q, He L, Gong X. Feasibility of automatic measurements of hip joints based on pelvic radiography and a deep learning algorithm. Eur J Radiol 2020; 132:109303. [PMID: 33017773 DOI: 10.1016/j.ejrad.2020.109303] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 09/10/2020] [Accepted: 09/22/2020] [Indexed: 02/07/2023]
Abstract
PURPOSE To develop and evaluate an automatic measurement model for hip joints based on anteroposterior (AP) pelvic radiography and a deep learning algorithm. METHODS A total of 1260 AP pelvic radiographs were included. 1060 radiographs were randomly sampled for training and validation and 200 radiographs were used as the test set. Landmarks for four commonly used parameters, such as the center-edge (CE) angle of Wiberg, Tönnis angle, sharp angle, and femoral head extrusion index (FHEI), were identified and labeled. An encoder-decoder convolutional neural network was developed to output a multi-channel heat map. Measurements were obtained through landmarks on the test set. Right and left hips were analyzed respectively. The mean of each parameter obtained by three radiologists was used as the reference standard. The Percentage of Correct Key points (PCK), intraclass correlation coefficient (ICC), Pearson correlation coefficient (r), root mean square error (RMSE), mean absolute error (MAE), and Bland-Altman plots were used to determine the performance of deep learning algorithm. RESULTS PCK of the model at 3 mm distance threshold range was from 87 % to 100 %. The CE angle, Tönnis angle, Sharp angle and FHEI of the left hip generated by the model were 29.8°±6.1°, 5.6°±4.2°, 39.0°±3.5° and 19 %±5 %, respectively. The parameters of the right hip were 30.4°±6.1°, 7.1°±4.4°, 38.9°±3.7° and 18 %±5 %. There were good correlation and consistency of the four parameters between the model and the reference standard (ICC 0.83-0.93, r 0.83-0.93, RMSE 0.02-3.27, MAE 0.02-1.79). CONCLUSIONS The new developed model based on deep learning algorithm can accurately identify landmarks on AP pelvic radiography and automatically generate parameters of hip joint. It will provide convenience for clinical practice of measurement.
Collapse
Affiliation(s)
- Wei Yang
- Bengbu Medical College, Bengbu 233000, China; Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China.
| | - Qin Ye
- Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China.
| | - Shuai Ming
- Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China.
| | - Xingfei Hu
- Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China.
| | - Zhiqiang Jiang
- Hangzhou Jianpei Technology Co., Ltd, Hangzhou 311200, China.
| | - Qiang Shen
- Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China.
| | - Linyang He
- Hangzhou Jianpei Technology Co., Ltd, Hangzhou 311200, China.
| | - Xiangyang Gong
- Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College, Hangzhou 310014, China; Institute of Artificial Intelligence and Remote Imaging, Hangzhou Medical College, Hangzhou 310014, China.
| |
Collapse
|
11
|
A Comparative Systematic Literature Review on Knee Bone Reports from MRI, X-rays and CT Scans Using Deep Learning and Machine Learning Methodologies. Diagnostics (Basel) 2020; 10:diagnostics10080518. [PMID: 32722605 PMCID: PMC7460189 DOI: 10.3390/diagnostics10080518] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Revised: 07/02/2020] [Accepted: 07/15/2020] [Indexed: 01/26/2023] Open
Abstract
The purpose of this research was to provide a “systematic literature review” of knee bone reports that are obtained by MRI, CT scans, and X-rays by using deep learning and machine learning techniques by comparing different approaches—to perform a comprehensive study on the deep learning and machine learning methodologies to diagnose knee bone diseases by detecting symptoms from X-ray, CT scan, and MRI images. This study will help those researchers who want to conduct research in the knee bone field. A comparative systematic literature review was conducted for the accomplishment of our work. A total of 32 papers were reviewed in this research. Six papers consist of X-rays of knee bone with deep learning methodologies, five papers cover the MRI of knee bone using deep learning approaches, and another five papers cover CT scans of knee bone with deep learning techniques. Another 16 papers cover the machine learning techniques for evaluating CT scans, X-rays, and MRIs of knee bone. This research compares the deep learning methodologies for CT scan, MRI, and X-ray reports on knee bone, comparing the accuracy of each technique, which can be used for future development. In the future, this research will be enhanced by comparing X-ray, CT-scan, and MRI reports of knee bone with information retrieval and big data techniques. The results show that deep learning techniques are best for X-ray, MRI, and CT scan images of the knee bone to diagnose diseases.
Collapse
|
12
|
Development of automatic measurement for patellar height based on deep learning and knee radiographs. Eur Radiol 2020; 30:4974-4984. [PMID: 32328760 DOI: 10.1007/s00330-020-06856-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Revised: 03/10/2020] [Accepted: 04/01/2020] [Indexed: 10/24/2022]
Abstract
OBJECTIVES To develop and evaluate the performance of a deep learning-based system for automatic patellar height measurements using knee radiographs. METHODS The deep learning-based algorithm was developed with a data set consisting of 1018 left knee radiographs for the prediction of patellar height parameters, specifically the Insall-Salvati index (ISI), Caton-Deschamps index (CDI), modified Caton-Deschamps index (MCDI), and Keerati index (KI). The performance and generalizability of the algorithm were tested with 200 left knee and 200 right knee radiographs, respectively. The intra-class correlation coefficient (ICC), Pearson correlation coefficient, mean absolute difference (MAD), root mean square (RMS), and Bland-Altman plots for predictions by the system were evaluated in comparison with manual measurements as the reference standard. RESULTS Compared with the reference standard, the deep learning-based algorithm showed high accuracy in predicting the ISI, CDI, and KI (left knee ICC = 0.91-0.95, r = 0.84-0.91, MAD = 0.02-0.05, RMS = 0.02-0.07; right knee ICC = 0.87-0.96, r = 0.78-0.92, MAD = 0.02-0.06, RMS = 0.02-0.10), but not the MCDI (left knee ICC = 0.65, r = 0.50, MAD = 0.14, RMS = 0.18; right knee ICC = 0.62, r = 0.47, MAD = 0.15, RMS = 0.20). The performance of the algorithm met or exceeded that of manual determination of ISI, CDI, and KI by radiologists. CONCLUSIONS In its current state, the developed system can predict the ISI, CDI, and KI for both left and right knee radiographs as accurately as radiologists. Training the system further with more data would increase its utility in helping radiologists measure patellar height in clinical practice. KEY POINTS • Objective and reliable measurement of patellar height parameters is important for clinical diagnosis and the development of a treatment strategy. • Deep learning can be used to create an automatic patellar height measurement system based on knee radiographs. • The deep learning-based patellar height measurement system achieves comparable performance to radiologists in measuring ISI, CDI, and KI.
Collapse
|
13
|
Brehler M, Thawait G, Kaplan J, Ramsay J, Tanaka MJ, Demehri S, Siewerdsen JH, Zbijewski W. Atlas-based algorithm for automatic anatomical measurements in the knee. J Med Imaging (Bellingham) 2019; 6:026002. [PMID: 31259202 PMCID: PMC6582228 DOI: 10.1117/1.jmi.6.2.026002] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Accepted: 06/04/2019] [Indexed: 11/14/2022] Open
Abstract
We present an algorithm for automatic anatomical measurements in tomographic datasets of the knee. The algorithm uses a set of atlases, each consisting of a knee image, surface segmentations of the bones, and locations of landmarks required by the anatomical metrics. A multistage volume-to-volume and surface-to-volume registration is performed to transfer the landmarks from the atlases to the target volume. Manual segmentation of the target volume is not required in this approach. Metrics were computed from the transferred landmarks of a best-matching atlas member (different for each bone), identified based on a mutual information criterion. Leave-one-out validation of the algorithm was performed on 24 scans of the knee obtained using extremity cone-beam computed tomography. Intraclass correlation (ICC) between the algorithm and the expert who generated atlas landmarks was above 0.95 for all metrics. This compares favorably to inter-reader ICC, which varied from 0.19 to 0.95, depending on the metric. Absolute agreement with the expert was also good, with median errors below 0.25 deg for measurements of tibial slope and static alignment, and below 0.2 mm for tibial tuberosity-trochlear groove distance and medial tibial depth. The automatic approach is anticipated to improve measurement workflow and mitigate the effects of operator experience and training on reliability of the metrics.
Collapse
Affiliation(s)
- Michael Brehler
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| | - Gaurav Thawait
- Johns Hopkins University, Russell H. Morgan Department of Radiology, Baltimore, Maryland, United States
| | - Jonathan Kaplan
- U.S. Army Natick Soldier Systems Center, Natick, Massachusetts, United States
| | - John Ramsay
- U.S. Army Natick Soldier Systems Center, Natick, Massachusetts, United States
| | - Miho J. Tanaka
- Johns Hopkins University, Department of Orthopaedic Surgery, Baltimore, Maryland, United States
| | - Shadpour Demehri
- Johns Hopkins University, Russell H. Morgan Department of Radiology, Baltimore, Maryland, United States
| | - Jeffrey H. Siewerdsen
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
- Johns Hopkins University, Russell H. Morgan Department of Radiology, Baltimore, Maryland, United States
| | - Wojciech Zbijewski
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| |
Collapse
|
14
|
A novel method for determining sagittal pediatric patellar height with the Blumensaat-Epiphyseal Containment of the Knee Angle. J Pediatr Orthop B 2018; 27:510-515. [PMID: 29878975 DOI: 10.1097/bpb.0000000000000527] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
UNLABELLED Defining normal pediatric patellar height is complicated. Current methods use ratios calculated from lateral radiographs, but often provide inconsistent results and are time-consuming. It has been observed that the angle formed by Blumensaat's line and the distal femoral physis, when extended, form an area of patellar containment throughout a range of knee flexion. Deemed the Blumensaat-Epiphyseal Containment of the Knee (BECK) Angle, the objective of this study was to investigate this as a simple alternative to identify normal pediatric patellar height. Lateral radiographs were taken every 15° from 0° to 90° flexion on 10 fresh-frozen cadaveric knees. Patellar height was measured as the percentage of pole-to-pole patellar length contained within the BECK angle. The method was then applied to normal lateral radiographs of 105 pediatric knees, divided into age groups of 7-9, 10-12, and 13-16 years old. BECK angle patellar containment was compared with previously described methods. For cadaveric specimens, at least 50% patellar containment occurred between 0° and 71° flexion without quadriceps tension and between 21° and 81° flexion with 30 N of quadriceps tension. For pediatric radiographs, flexion ranged from 9° to 81°. At least 50% patellar containment occurred in 96% of knees in all three age groups. Knee flexion fell within a range of 15°-60° in 92 of the 105 pediatric knees. Limiting the analysis to this range, at least 50% patellar containment occurred in 99% of knees in all three age groups. On the basis of this study, normal pediatric knee lateral radiographs between 15° and 60° flexion should show at least 50% patellar containment within the BECK angle. LEVEL OF EVIDENCE Diagnostic Level II study.
Collapse
|
15
|
Tsai TY, Li JS, Wang S, Li P, Kwon YM, Li G. Principal component analysis in construction of 3D human knee joint models using a statistical shape model method. Comput Methods Biomech Biomed Engin 2013; 18:721-9. [PMID: 24156375 DOI: 10.1080/10255842.2013.843676] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
The statistical shape model (SSM) method that uses 2D images of the knee joint to predict the three-dimensional (3D) joint surface model has been reported in the literature. In this study, we constructed a SSM database using 152 human computed tomography (CT) knee joint models, including the femur, tibia and patella and analysed the characteristics of each principal component of the SSM. The surface models of two in vivo knees were predicted using the SSM and their 2D bi-plane fluoroscopic images. The predicted models were compared to their CT joint models. The differences between the predicted 3D knee joint surfaces and the CT image-based surfaces were 0.30 ± 0.81 mm, 0.34 ± 0.79 mm and 0.36 ± 0.59 mm for the femur, tibia and patella, respectively (average ± standard deviation). The computational time for each bone of the knee joint was within 30 s using a personal computer. The analysis of this study indicated that the SSM method could be a useful tool to construct 3D surface models of the knee with sub-millimeter accuracy in real time. Thus, it may have a broad application in computer-assisted knee surgeries that require 3D surface models of the knee.
Collapse
Affiliation(s)
- Tsung-Yuan Tsai
- a Bioengineering Laboratory, Department of Orthopaedic Surgery , Massachusetts General Hospital, Harvard Medical School , 55 Fruit Street, GRJ-1215, Boston , MA 02114 , USA
| | | | | | | | | | | |
Collapse
|
16
|
Chen HC, Yang TH, Thoreson AR, Zhao C, Amadio PC, Sun YN, Su FC, An KN. Automatic and Quantitative Measurement of Collagen Gel Contraction Using Model-Guided Segmentation. MEASUREMENT SCIENCE & TECHNOLOGY 2013; 24:85702. [PMID: 24092954 PMCID: PMC3786395 DOI: 10.1088/0957-0233/24/8/085702] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Quantitative measurement of collagen gel contraction plays a critical role in the field of tissue engineering because it provides spatial-temporal assessment (e.g., changes of gel area and diameter during the contraction process) reflecting the cell behaviors and tissue material properties. So far the assessment of collagen gels relies on manual segmentation, which is time-consuming and suffers from serious intra- and inter-observer variability. In this study, we propose an automatic method combining various image processing techniques to resolve these problems. The proposed method first detects the maximal feasible contraction range of circular references (e.g., culture dish) and avoids the interference of irrelevant objects in the given image. Then, a three-step color conversion strategy is applied to normalize and enhance the contrast between the gel and background. We subsequently introduce a deformable circular model (DCM) which utilizes regional intensity contrast and circular shape constraint to locate the gel boundary. An adaptive weighting scheme was employed to coordinate the model behavior, so that the proposed system can overcome variations of gel boundary appearances at different contraction stages. Two measurements of collagen gels (i.e., area and diameter) can readily be obtained based on the segmentation results. Experimental results, including 120 gel images for accuracy validation, showed high agreement between the proposed method and manual segmentation with an average dice similarity coefficient larger than 0.95. The results also demonstrated obvious improvement in gel contours obtained by the proposed method over two popular, generic segmentation methods.
Collapse
Affiliation(s)
- Hsin-Chen Chen
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan, ROC
- Department of Neurosurgery, University of Pittsburgh, PA, USA
| | - Tai-Hua Yang
- Division of Orthopedic Research, Mayo Clinic, Rochester, MN, USA
- Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan, ROC
- Department of Orthopedics, China Medical University Hospital, Taichung, Taiwan, ROC
| | | | - Chunfeng Zhao
- Division of Orthopedic Research, Mayo Clinic, Rochester, MN, USA
| | - Peter C. Amadio
- Division of Orthopedic Research, Mayo Clinic, Rochester, MN, USA
| | - Yung-Nien Sun
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan, ROC
| | - Fong-Chin Su
- Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan, ROC
| | - Kai-Nan An
- Division of Orthopedic Research, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
17
|
Liu YP, Li SZ, Yuan F, Xia J, Yu X, Liu X, Yu GR. Infrapatellar fat pad may be with tendon repairing ability and closely related with the developing process of patella Baja. Med Hypotheses 2011; 77:620-3. [PMID: 21821366 DOI: 10.1016/j.mehy.2011.06.048] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2011] [Revised: 06/20/2011] [Accepted: 06/27/2011] [Indexed: 02/07/2023]
Abstract
Patella Baja, as a common complication of knee trauma or knee surgery, was very difficult to deal with, and scarring and shortening of the patellar tendon were looked on as the most important reason for it. Infrapatellar fat pad, also known as Hoffa's fat pad was traditionally regarded as with only buffering and lubricating functions in knee joints, which can limit the knee's excessive activities, absorb shocks from the anterior knee and reduces friction between the patellar tendon and the tibia, it should be with direct protection function and avoid the damage of patella tendon. Recently, a large number of studies had shown that adipose tissue was an accessible and abundant source of mesenchymal stem cells for tissue engineering. Adipose derived stem cells (ADSCs) can be induced to differentiate into adipocytes, osteoblasts, nerve cells, tendon cells and so on. In addition, interestingly, infrapatellar fat pad were just located behind the patellar tendon, and SDF-1 (stromal cell-derived factor-1), as a powerful cytokine that regulates inflammatory cell recruitment and stem cell homing, was unregulated after ligament injury, so there may be a certain correlation between ADSCs from infrapatellar fat pad and injured tendons, maybe ADSCs from infrapatellar fat pad can biologically repair injured tendons when patella tendon was damaged. We hypothesized injured patella tendon repairing should include not only the self-repairing of the tendon, but also the biological repairing from ADSCs in infrapatellar fat pad. When both of the repairing failed to repair the damage of the tendon, patellar tendon may begin to shrink and scar, which will result in patella Baja. In our opinion, healthy infrapatellar fat pad was with direct protection function of patella tendon and full of rich ADSCs, which may play an important part in patella tendon repairing and the developing process of patella Baja.
Collapse
Affiliation(s)
- Yu-Ping Liu
- Department of Orthopedics, Tongji Hospital, and Department of Regenerative Medicine, School of Medicine, Tongji University, Shanghai, PR China
| | | | | | | | | | | | | |
Collapse
|