1
|
Yuan S, Chen R, Liu X, Wang T, Wang A, Fan N, Du P, Xi Y, Gu Z, Zhang Y, Zang L. Artificial intelligence automatic measurement technology of lumbosacral radiographic parameters. Front Bioeng Biotechnol 2024; 12:1404058. [PMID: 39011157 PMCID: PMC11246908 DOI: 10.3389/fbioe.2024.1404058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 06/17/2024] [Indexed: 07/17/2024] Open
Abstract
Background Currently, manual measurement of lumbosacral radiological parameters is time-consuming and laborious, and inevitably produces considerable variability. This study aimed to develop and evaluate a deep learning-based model for automatically measuring lumbosacral radiographic parameters on lateral lumbar radiographs. Methods We retrospectively collected 1,240 lateral lumbar radiographs to train the model. The included images were randomly divided into training, validation, and test sets in a ratio of approximately 8:1:1 for model training, fine-tuning, and performance evaluation, respectively. The parameters measured in this study were lumbar lordosis (LL), sacral horizontal angle (SHA), intervertebral space angle (ISA) at L4-L5 and L5-S1 segments, and the percentage of lumbar spondylolisthesis (PLS) at L4-L5 and L5-S1 segments. The model identified key points using image segmentation results and calculated measurements. The average results of key points annotated by the three spine surgeons were used as the reference standard. The model's performance was evaluated using the percentage of correct key points (PCK), intra-class correlation coefficient (ICC), Pearson correlation coefficient (r), mean absolute error (MAE), root mean square error (RMSE), and box plots. Results The model's mean differences from the reference standard for LL, SHA, ISA (L4-L5), ISA (L5-S1), PLS (L4-L5), and PLS (L5-S1) were 1.69°, 1.36°, 1.55°, 1.90°, 1.60%, and 2.43%, respectively. When compared with the reference standard, the measurements of the model had better correlation and consistency (LL, SHA, and ISA: ICC = 0.91-0.97, r = 0.91-0.96, MAE = 1.89-2.47, RMSE = 2.32-3.12; PLS: ICC = 0.90-0.92, r = 0.90-0.91, MAE = 1.95-2.93, RMSE = 2.52-3.70), and the differences between them were not statistically significant (p > 0.05). Conclusion The model developed in this study could correctly identify key vertebral points on lateral lumbar radiographs and automatically calculate lumbosacral radiographic parameters. The measurement results of the model had good consistency and reliability compared to manual measurements. With additional training and optimization, this technology holds promise for future measurements in clinical practice and analysis of large datasets.
Collapse
Affiliation(s)
- Shuo Yuan
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Ruiyuan Chen
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Xingyu Liu
- School of Life Sciences, Tsinghua University, Beijing, China
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Tianyi Wang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Aobo Wang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Ning Fan
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Peng Du
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Yu Xi
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Zhao Gu
- Longwood Valley Medical Technology Co., Ltd., Beijing, China
| | - Yiling Zhang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
- Longwood Valley Medical Technology Co., Ltd., Beijing, China
| | - Lei Zang
- Department of Orthopedics, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
2
|
Landriel F, Franchi BC, Mosquera C, Lichtenberger FP, Benitez S, Aineseder M, Guiroy A, Hem S. Artificial Intelligence Assistance for the Measurement of Full Alignment Parameters in Whole-Spine Lateral Radiographs. World Neurosurg 2024; 187:e363-e382. [PMID: 38649028 DOI: 10.1016/j.wneu.2024.04.091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Accepted: 04/15/2024] [Indexed: 04/25/2024]
Abstract
BACKGROUND Measuring spinal alignment with radiological parameters is essential in patients with spinal conditions likely to be treated surgically. These evaluations are not usually included in the radiological report. As a result, spinal surgeons commonly perform the measurement, which is time-consuming and subject to errors. We aim to develop a fully automated artificial intelligence (AI) tool to assist in measuring alignment parameters in whole-spine lateral radiograph (WSL X-rays). METHODS We developed a tool called Vertebrai that automatically calculates the global spinal parameters (GSPs): Pelvic incidence, sacral slope, pelvic tilt, L1-L4 angle, L4-S1 lumbo-pelvic angle, T1 pelvic angle, sagittal vertical axis, cervical lordosis, C1-C2 lordosis, lumbar lordosis, mid-thoracic kyphosis, proximal thoracic kyphosis, global thoracic kyphosis, T1 slope, C2-C7 plummet, spino-sacral angle, C7 tilt, global tilt, spinopelvic tilt, and hip odontoid axis. We assessed human-AI interaction instead of AI performance alone. We compared the time to measure GSP and inter-rater agreement with and without AI assistance. Two institutional datasets were created with 2267 multilabel images for classification and 784 WSL X-rays with reference standard landmark labeled by spinal surgeons. RESULTS Vertebrai significantly reduced the measurement time comparing spine surgeons with AI assistance and the AI algorithm alone, without human intervention (3 minutes vs. 0.26 minutes; P < 0.05). Vertebrai achieved an average accuracy of 83% in detecting abnormal alignment values, with the sacral slope parameter exhibiting the lowest accuracy at 61.5% and spinopelvic tilt demonstrating the highest accuracy at 100%. Intraclass correlation analysis revealed a high level of correlation and consistency in the global alignment parameters. CONCLUSIONS Vertebrai's measurements can accurately detect alignment parameters, making it a promising tool for measuring GSP automatically.
Collapse
Affiliation(s)
- Federico Landriel
- Neurosurgical Department, Spine Unit, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina.
| | - Bruno Cruz Franchi
- Health Informatic Department, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | - Candelaria Mosquera
- Health Informatic Department, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | | | - Sonia Benitez
- Health Informatic Department, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | - Martina Aineseder
- Radiology Department, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | | | - Santiago Hem
- Neurosurgical Department, Spine Unit, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| |
Collapse
|
3
|
MohammadiNasrabadi A, Moammer G, Quateen A, Bhanot K, McPhee J. Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment. J Orthop Surg Res 2024; 19:199. [PMID: 38528514 DOI: 10.1186/s13018-024-04654-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 03/02/2024] [Indexed: 03/27/2024] Open
Abstract
PURPOSE An efficient physics-informed deep learning approach for extracting spinopelvic measures from X-ray images is introduced and its performance is evaluated against manual annotations. METHODS Two datasets, comprising a total of 1470 images, were collected to evaluate the model's performance. We propose a novel method of detecting landmarks as objects, incorporating their relationships as constraints (LanDet). Using this approach, we trained our deep learning model to extract five spine and pelvis measures: Sacrum Slope (SS), Pelvic Tilt (PT), Pelvic Incidence (PI), Lumbar Lordosis (LL), and Sagittal Vertical Axis (SVA). The results were compared to manually labelled test dataset (GT) as well as measures annotated separately by three surgeons. RESULTS The LanDet model was evaluated on the two datasets separately and on an extended dataset combining both. The final accuracy for each measure is reported in terms of Mean Absolute Error (MAE), Standard Deviation (SD), and R Pearson correlation coefficient as follows: [ S S ∘ : 3.7 ( 2.7 ) , R = 0.89 ] ,[ P T ∘ : 1.3 ( 1.1 ) , R = 0.98 ] , [ P I ∘ : 4.2 ( 3.1 ) , R = 0.93 ] , [ L L ∘ : 5.1 ( 6.4 ) , R = 0.83 ] , [ S V A ( m m ) : 2.1 ( 1.9 ) , R = 0.96 ] . To assess model reliability and compare it against surgeons, the intraclass correlation coefficient (ICC) metric is used. The model demonstrated better consistency with surgeons with all values over 0.88 compared to what was previously reported in the literature. CONCLUSION The LanDet model exhibits competitive performance compared to existing literature. The effectiveness of the physics-informed constraint method, utilized in our landmark detection as object algorithm, is highlighted. Furthermore, we addressed the limitations of heatmap-based methods for anatomical landmark detection and tackled issues related to mis-identifying of similar or adjacent landmarks instead of intended landmark using this novel approach.
Collapse
Affiliation(s)
- AliAsghar MohammadiNasrabadi
- Department of Systems Design Engineering, University of Waterloo, 200 University Ave W, Waterloo, ON, N2L 3G1, Canada.
| | - Gemah Moammer
- Department of Spine Surgery, Grand River Hospital (GRH), 835 King St W, Kitchener, ON, N2G 1G3, Canada
| | - Ahmed Quateen
- Department of Spine Surgery, Grand River Hospital (GRH), 835 King St W, Kitchener, ON, N2G 1G3, Canada
| | - Kunal Bhanot
- Department of Surgery, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada
| | - John McPhee
- Department of Systems Design Engineering, University of Waterloo, 200 University Ave W, Waterloo, ON, N2L 3G1, Canada
| |
Collapse
|
4
|
Lee S, Kim KG, Kim YJ, Jeon JS, Lee GP, Kim KC, Jeon SH. Automatic Segmentation and Radiologic Measurement of Distal Radius Fractures Using Deep Learning. Clin Orthop Surg 2024; 16:113-124. [PMID: 38304219 PMCID: PMC10825247 DOI: 10.4055/cios23130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 09/10/2023] [Accepted: 10/24/2023] [Indexed: 02/03/2024] Open
Abstract
Background Recently, deep learning techniques have been used in medical imaging studies. We present an algorithm that measures radiologic parameters of distal radius fractures using a deep learning technique and compares the predicted parameters with those measured by an orthopedic hand surgeon. Methods We collected anteroposterior (AP) and lateral X-ray images of 634 wrists in 624 patients with distal radius fractures treated conservatively with a follow-up of at least 2 months. We allocated 507 AP and 507 lateral images to the training set (80% of the images were used to train the model, and 20% were utilized for validation) and 127 AP and 127 lateral images to the test set. The margins of the radius and ulna were annotated for ground truth, and the scaphoid in the lateral views was annotated in the box configuration to determine the volar side of the images. Radius segmentation was performed using attention U-Net, and the volar/dorsal side was identified using a detection and classification model based on RetinaNet. The proposed algorithm measures the radial inclination, dorsal or volar tilt, and radial height by index axes and points from the segmented radius and ulna. Results The segmentation model for the radius exhibited an accuracy of 99.98% and a Dice similarity coefficient (DSC) of 98.07% for AP images, and an accuracy of 99.75% and a DSC of 94.84% for lateral images. The segmentation model for the ulna showed an accuracy of 99.84% and a DSC of 96.48%. Based on the comparison of the radial inclinations measured by the algorithm and the manual method, the Pearson correlation coefficient was 0.952, and the intraclass correlation coefficient was 0.975. For dorsal/volar tilt, the correlation coefficient was 0.940, and the intraclass correlation coefficient was 0.968. For radial height, it was 0.768 and 0.868, respectively. Conclusions The deep learning-based algorithm demonstrated excellent segmentation of the distal radius and ulna in AP and lateral radiographs of the wrist with distal radius fractures and afforded automatic measurements of radiologic parameters.
Collapse
Affiliation(s)
- Sanglim Lee
- Department of Orthopedic Surgery, Inje University Sanggye Paik Hospital, Seoul, Korea
| | - Kwang Gi Kim
- Department of Biomedical Engineering, Gachon University College of Medicine, Incheon, Korea
| | - Young Jae Kim
- Department of Biomedical Engineering, Gachon University College of Medicine, Incheon, Korea
| | - Ji Soo Jeon
- Department of Biomedical Engineering, Gachon University College of Medicine, Incheon, Korea
| | - Gi Pyo Lee
- Department of Biomedical Engineering, Gachon University College of Medicine, Incheon, Korea
| | - Kyung-Chan Kim
- Department of Orthopedic Surgery, Inje University Sanggye Paik Hospital, Seoul, Korea
| | - Suk Ha Jeon
- Department of Orthopaedic Surgery, National Medical Center, Seoul, Korea
| |
Collapse
|
5
|
Vogt S, Scholl C, Grover P, Marks J, Dreischarf M, Braumann UD, Strube P, Hölzl A, Böhle S. Novel AI-Based Algorithm for the Automated Measurement of Cervical Sagittal Balance Parameters. A Validation Study on Pre- and Postoperative Radiographs of 129 Patients. Global Spine J 2024:21925682241227428. [PMID: 38272462 DOI: 10.1177/21925682241227428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/27/2024] Open
Abstract
STUDY DESIGN Retrospective, mono-centric cohort research study. OBJECTIVES The analysis of cervical sagittal balance parameters is essential for preoperative planning and dependent on the physician's experience. A fully automated artificial intelligence-based algorithm could contribute to an objective analysis and save time. Therefore, this algorithm should be validated in this study. METHODS Two surgeons measured C2-C7 lordosis, C1-C7 Sagittal Vertical Axis (SVA), C2-C7-SVA, C7-slope and T1-slope in pre- and postoperative lateral cervical X-rays of 129 patients undergoing anterior cervical surgery. All parameters were measured twice by surgeons and compared to the measurements by the AI algorithm consisting of 4 deep convolutional neural networks. Agreement between raters was quantified, among other metrics, by mean errors and single measure intraclass correlation coefficients for absolute agreement. RESULTS ICC-values for intra- (range: .92-1.0) and inter-rater (.91-1.0) reliability reflect excellent agreement between human raters. The AI-algorithm could determine all parameters with excellent ICC-values (preop:0.80-1.0; postop:0.86-.99). For a comparison between the AI algorithm and 1 surgeon, mean errors were smallest for C1-C7 SVA (preop: -.3 mm (95% CI:-.6 to -.1 mm), post: .3 mm (.0-.7 mm)) and largest for C2-C7 lordosis (preop:-2.2° (-2.9 to -1.6°), postop: 2.3°(-3.0 to -1.7°)). The automatic measurement was possible in 99% and 98% of pre- and postoperative images for all parameters except T1 slope, which had a detection rate of 48% and 51% in pre- and postoperative images. CONCLUSION This study validates that an AI-algorithm can reliably measure cervical sagittal balance parameters automatically in patients suffering from degenerative spinal diseases. It may simplify manual measurements and autonomously analyze large-scale datasets. Further studies are required to validate the algorithm on a larger and more diverse patient cohort.
Collapse
Affiliation(s)
- Sophia Vogt
- Orthopedic department of University Hospital Jena, Waldkliniken Eisenberg GmbH, Germany
| | - Carolin Scholl
- Research and Development, RAYLYTIC GmbH, Leipzig, Germany
| | | | - Julian Marks
- Research and Development, RAYLYTIC GmbH, Leipzig, Germany
- Leipzig University of Aplied Sciences (HTWK Leipzig), Faculty of Engineering, Leipzig, Germany
| | | | - Ulf-Dietrich Braumann
- Leipzig University of Aplied Sciences (HTWK Leipzig), Faculty of Engineering, Leipzig, Germany
- Fraunhofer Institute for Cell Therapy and Immunology, Cell-functional Image Analysis Unit, Leipzig, Germany
| | - Patrick Strube
- Orthopedic department of University Hospital Jena, Waldkliniken Eisenberg GmbH, Germany
| | - Alexander Hölzl
- Orthopedic department of University Hospital Jena, Waldkliniken Eisenberg GmbH, Germany
| | - Sabrina Böhle
- Orthopedic department of University Hospital Jena, Waldkliniken Eisenberg GmbH, Germany
| |
Collapse
|
6
|
Löchel J, Putzier M, Dreischarf M, Grover P, Urinbayev K, Abbas F, Labbus K, Zahn R. Deep learning algorithm for fully automated measurement of sagittal balance in adult spinal deformity. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2024:10.1007/s00586-023-08109-1. [PMID: 38231388 DOI: 10.1007/s00586-023-08109-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 11/03/2023] [Accepted: 12/15/2023] [Indexed: 01/18/2024]
Abstract
AIM Deep learning (DL) algorithms can be used for automated analysis of medical imaging. The aim of this study was to assess the accuracy of an innovative, fully automated DL algorithm for analysis of sagittal balance in adult spinal deformity (ASD). MATERIAL AND METHODS Sagittal balance (sacral slope, pelvic tilt, pelvic incidence, lumbar lordosis and sagittal vertical axis) was evaluated in 141 preoperative and postoperative radiographs of patients with ASD. The DL, landmark-based measurements, were compared with the ground truth values from validated manual measurements. RESULTS The DL algorithm showed an excellent consistency with the ground truth measurements. The intra-class correlation coefficient between the DL and ground truth measurements was 0.71-0.99 for preoperative and 0.72-0.96 for postoperative measurements. The DL detection rate was 91.5% and 84% for preoperative and postoperative images, respectively. CONCLUSION This is the first study evaluating a complete automated DL algorithm for analysis of sagittal balance with high accuracy for all evaluated parameters. The excellent accuracy in the challenging pathology of ASD with long construct instrumentation demonstrates the eligibility and possibility for implementation in clinical routine.
Collapse
Affiliation(s)
- Jannis Löchel
- Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Augustenburger Platz 1, 13353, Berlin, Germany.
| | - Michael Putzier
- Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Charitéplatz 1, 10117, Berlin, Germany
| | - Marcel Dreischarf
- RAYLYTIC - medical data automation, Petersstr. 32-34, 04109, Leipzig, Germany
| | - Priyanka Grover
- RAYLYTIC - medical data automation, Petersstr. 32-34, 04109, Leipzig, Germany
| | | | - Fahad Abbas
- Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Kirsten Labbus
- Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Robert Zahn
- Center for Musculoskeletal Surgery, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Augustenburger Platz 1, 13353, Berlin, Germany
| |
Collapse
|
7
|
Foley D, Hardacker P, McCarthy M. Emerging Technologies within Spine Surgery. Life (Basel) 2023; 13:2028. [PMID: 37895410 PMCID: PMC10608700 DOI: 10.3390/life13102028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 10/02/2023] [Accepted: 10/07/2023] [Indexed: 10/29/2023] Open
Abstract
New innovations within spine surgery continue to propel the field forward. These technologies improve surgeons' understanding of their patients and allow them to optimize treatment planning both in the operating room and clinic. Additionally, changes in the implants and surgeon practice habits continue to evolve secondary to emerging biomaterials and device design. With ongoing advancements, patients can expect enhanced preoperative decision-making, improved patient outcomes, and better intraoperative execution. Additionally, these changes may decrease many of the most common complications following spine surgery in order to reduce morbidity, mortality, and the need for reoperation. This article reviews some of these technological advancements and how they are projected to impact the field. As the field continues to advance, it is vital that practitioners remain knowledgeable of these changes in order to provide the most effective treatment possible.
Collapse
Affiliation(s)
- David Foley
- Department of Orthopaedic Surgery, Indiana University School of Medicine, Indianapolis, IN 46202, USA
| | - Pierce Hardacker
- Indiana University School of Medicine, Indianapolis, IN 46202, USA;
| | | |
Collapse
|
8
|
Wu Y, Chen X, Dong F, He L, Cheng G, Zheng Y, Ma C, Yao H, Zhou S. Performance evaluation of a deep learning-based cascaded HRNet model for automatic measurement of X-ray imaging parameters of lumbar sagittal curvature. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2023:10.1007/s00586-023-07937-5. [PMID: 37787781 DOI: 10.1007/s00586-023-07937-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 04/03/2023] [Accepted: 08/30/2023] [Indexed: 10/04/2023]
Abstract
PURPOSE To develop a deep learning-based cascaded HRNet model, in order to automatically measure X-ray imaging parameters of lumbar sagittal curvature and to evaluate its prediction performance. METHODS A total of 3730 lumbar lateral digital radiography (DR) images were collected from picture archiving and communication system (PACS). Among them, 3150 images were randomly selected as the training dataset and validation dataset, and 580 images as the test dataset. The landmarks of the lumbar curve index (LCI), lumbar lordosis angle (LLA), sacral slope (SS), lumbar lordosis index (LLI), and the posterior edge tangent angle of the vertebral body (PTA) were identified and marked. The measured results of landmarks on the test dataset were compared with the mean values of manual measurement as the reference standard. Percentage of correct key-points (PCK), intra-class correlation coefficient (ICC), Pearson correlation coefficient (r), mean absolute error (MAE), mean square error (MSE), root-mean-square error (RMSE), and Bland-Altman plot were used to evaluate the performance of the cascade HRNet model. RESULTS The PCK of the cascaded HRNet model was 97.9-100% in the 3 mm distance threshold. The mean differences between the reference standard and the predicted values for LCI, LLA, SS, LLI, and PTA were 0.43 mm, 0.99°, 1.11°, 0.01 mm, and 0.23°, respectively. There were strong correlation and consistency of the five parameters between the cascaded HRNet model and manual measurements (ICC = 0.989-0.999, R = 0.991-0.999, MAE = 0.63-1.65, MSE = 0.61-4.06, RMSE = 0.78-2.01). CONCLUSION The cascaded HRNet model based on deep learning algorithm could accurately identify the sagittal curvature-related landmarks on lateral lumbar DR images and automatically measure the relevant parameters, which is of great significance in clinical application.
Collapse
Affiliation(s)
- Yuhua Wu
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaofei Chen
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine (The first affiliated hospital of Gansu University of Traditional Chinese Medicine), Lanzhou, 730050, Gansu, China
| | - Fuwen Dong
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine (The first affiliated hospital of Gansu University of Traditional Chinese Medicine), Lanzhou, 730050, Gansu, China
| | - Linyang He
- Hangzhou Jianpei Technology Company Ltd, Hangzhou, 311200, Zhejiang, China
| | - Guohua Cheng
- Hangzhou Jianpei Technology Company Ltd, Hangzhou, 311200, Zhejiang, China
| | - Yuwen Zheng
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Chunyu Ma
- The First Clinical Medical College of Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Hongyan Yao
- Department of Radiology, Gansu Provincial Hospital, No. 204, Donggang West Road, Lanzhou, 730000, Gansu, China
| | - Sheng Zhou
- Department of Radiology, Gansu Provincial Hospital, No. 204, Donggang West Road, Lanzhou, 730000, Gansu, China.
| |
Collapse
|
9
|
Kim YT, Jeong TS, Kim YJ, Kim WS, Kim KG, Yee GT. Automatic Spine Segmentation and Parameter Measurement for Radiological Analysis of Whole-Spine Lateral Radiographs Using Deep Learning and Computer Vision. J Digit Imaging 2023; 36:1447-1459. [PMID: 37131065 PMCID: PMC10406753 DOI: 10.1007/s10278-023-00830-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/31/2023] [Accepted: 04/03/2023] [Indexed: 05/04/2023] Open
Abstract
Radiographic examination is essential for diagnosing spinal disorders, and the measurement of spino-pelvic parameters provides important information for the diagnosis and treatment planning of spinal sagittal deformities. While manual measurement methods are the golden standard for measuring parameters, they can be time consuming, inefficient, and rater dependent. Previous studies that have used automatic measurement methods to alleviate the downsides of manual measurements showed low accuracy or could not be applied to general films. We propose a pipeline for automated measurement of spinal parameters by combining a Mask R-CNN model for spine segmentation with computer vision algorithms. This pipeline can be incorporated into clinical workflows to provide clinical utility in diagnosis and treatment planning. A total of 1807 lateral radiographs were used for the training (n = 1607) and validation (n = 200) of the spine segmentation model. An additional 200 radiographs, which were also used for validation, were examined by three surgeons to evaluate the performance of the pipeline. Parameters automatically measured by the algorithm in the test set were statistically compared to parameters measured manually by the three surgeons. The Mask R-CNN model achieved an average precision at 50% intersection over union (AP50) of 96.2% and a Dice score of 92.6% for the spine segmentation task in the test set. The mean absolute error values of the spino-pelvic parameters measurement results were within the range of 0.4° (pelvic tilt) to 3.0° (lumbar lordosis, pelvic incidence), and the standard error of estimate was within the range of 0.5° (pelvic tilt) to 4.0° (pelvic incidence). The intraclass correlation coefficient values ranged from 0.86 (sacral slope) to 0.99 (pelvic tilt, sagittal vertical axis).
Collapse
Affiliation(s)
- Yong-Tae Kim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea
| | - Tae Seok Jeong
- Department of Neurosurgery, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea
| | - Young Jae Kim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea
| | - Woo Seok Kim
- Department of Traumatology, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea
| | - Kwang Gi Kim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea.
| | - Gi Taek Yee
- Department of Neurosurgery, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea.
| |
Collapse
|
10
|
Fleiderman Valenzuela JG, Cirillo Totera JI, Turkieltaub DH, Echaurren CV, Álvarez Lemos FL, Arriagada Ramos FI. Spino-pelvic radiological parameters: Comparison of measurements obtained by radiologists using the traditional method versus spine surgeons using a semi-automated software (Surgimap). Acta Radiol Open 2023; 12:20584601231177404. [PMID: 37223123 PMCID: PMC10201147 DOI: 10.1177/20584601231177404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Accepted: 05/04/2023] [Indexed: 05/25/2023] Open
Abstract
Background Spinopelvic balance measurement is a key point to get an appropriate diagnosis and treatment in a group of spine pathologies; thus, it seems necessary the evaluation of different methods for obtaining the most reliable values. For that reason, different automatic and semi-automatic computer-assisted tools have been developed, and one example of them is Surgimap. Purpose To demonstrate that the sagittal balance measurements with Surgimap are equal and more time-efficient than with Agfa-Enterprise. Material and Methods Retrospective-prospective study. Biased comparative analysis of radiographic measurements performed on two different occasions (96 h interval), between two spine surgeons using Surgimap and two radiologists using the traditional Cobb method (TCM) with the Agfa-Enterprise program in 36 full spine lateral X-ray, determining inter- and intra-observer reliability and the mean time required to obtain the measurements. Results Measurements with both methods demonstrated an excellent intra-observer correlation (Surgimap: PCC 0.95 [0.85-0.99]; TCM: PCC 0.90 [0.81-0.99]). Inter-observer correlation also demonstrated an excellent relationship (PCC >0.95). Thoracic kyphosis (TK) demonstrated the lowest levels of inter-observer correlation (PCC: 0.75). The average time in seconds with TCM was 154.6, while with the Surgimap it was 41.8 s. Conclusion Surgimap proved to be equally reliable and 3.5 times faster. Therefore, in consistency with the available literature, our results would allow us to promote the use of Surgimap as a clinical diagnostic tool considering precision and efficiency.
Collapse
|
11
|
Noh SH, Cho PG, Kim KN, Kim SH, Shin DA. Artificial Intelligence for Neurosurgery : Current State and Future Directions. J Korean Neurosurg Soc 2023; 66:113-120. [PMID: 36124365 PMCID: PMC10009243 DOI: 10.3340/jkns.2022.0130] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 09/12/2022] [Indexed: 11/27/2022] Open
Abstract
Artificial intelligence (AI) is a field of computer science that equips machines with human-like intelligence and enables them to learn, reason, and solve problems when presented with data in various formats. Neurosurgery is often at the forefront of innovative and disruptive technologies, which have similarly altered the course of acute and chronic diseases. In diagnostic imaging, such as X-rays, computed tomography, and magnetic resonance imaging, AI is used to analyze images. The use of robots in the field of neurosurgery is also increasing. In neurointensive care units, AI is used to analyze data and provide care to critically ill patients. Moreover, AI can be used to predict a patient's prognosis. Several AI applications have already been introduced in the field of neurosurgery, and many more are expected in the near future. Ultimately, it is our responsibility to keep pace with this evolution to provide meaningful outcomes and personalize each patient's care. Rather than blindly relying on AI in the future, neurosurgeons should gain a thorough understanding of it and use it to enhance their patient care.
Collapse
Affiliation(s)
- Sung Hyun Noh
- Department of Neurosurgery, Ajou University College of Medicine, Suwon, Korea.,Department of Neurosurgery, Yonsei University College of Medicine, Seoul, Korea
| | - Pyung Goo Cho
- Department of Neurosurgery, Ajou University College of Medicine, Suwon, Korea
| | - Keung Nyun Kim
- Department of Neurosurgery, Yonsei University College of Medicine, Seoul, Korea.,Department of Neurosurgery, Spine and Spinal Cord Institute, Severance Hospital, Yonsei University College of Medicine, Seoul, Korea
| | - Sang Hyun Kim
- Department of Neurosurgery, Ajou University College of Medicine, Suwon, Korea
| | - Dong Ah Shin
- Department of Neurosurgery, Yonsei University College of Medicine, Seoul, Korea.,Department of Neurosurgery, Spine and Spinal Cord Institute, Severance Hospital, Yonsei University College of Medicine, Seoul, Korea
| |
Collapse
|
12
|
Charles YP, Lamas V, Ntilikina Y. Artificial intelligence and treatment algorithms in spine surgery. Orthop Traumatol Surg Res 2023; 109:103456. [PMID: 36302452 DOI: 10.1016/j.otsr.2022.103456] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 05/12/2022] [Accepted: 05/25/2022] [Indexed: 12/24/2022]
Abstract
Artificial intelligence (AI) is a set of theories and techniques in which machines are used to simulate human intelligence with complex computer programs. The various machine learning (ML) methods are a subtype of AI. They originate from computer science and use algorithms established from analyzing a database to accomplish certain tasks. Among these methods are decision trees or random forests, support vector machines along with artificial neural networks. Convolutive neural networks were inspired from the visual cortex; they process combinations of information used in image or voice recognition. Deep learning (DL) groups together a set of ML methods and is useful for modeling complex relationships with a high degree of abstraction by using multiple layers of artificial neurons. ML techniques have a growing role in spine surgery. The main applications are the segmentation of intraoperative images for surgical navigation or robotics used for pedicle screw placement, the interpretation of images of intervertebral discs or full spine radiographs, which can be automated using ML algorithms. ML techniques can also be used as aids for surgical decision-making in complex fields, such as preoperative evaluation of adult spinal deformity. ML algorithms "learn" from large clinical databases. They make it possible to establish the intraoperative risk level and make a prognosis on how the postoperative functional scores will change over time as a function of the patient profile. These applications open a new path relative to standard statistical analyses. They make it possible to explore more complex relationships with multiple indirect interactions. In the future, AI algorithms could have a greater role in clinical research, evaluating clinical and surgical practices, and conducting health economics analyses.
Collapse
Affiliation(s)
- Yann Philippe Charles
- Service de chirurgie du rachis, hôpitaux universitaires de Strasbourg, université de Strasbourg, 1, avenue Molière, 67200 Strasbourg, France.
| | - Vincent Lamas
- Service de chirurgie du rachis, hôpitaux universitaires de Strasbourg, université de Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - Yves Ntilikina
- Service de chirurgie du rachis, hôpitaux universitaires de Strasbourg, université de Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| |
Collapse
|
13
|
Development of artificial intelligence for automated measurement of cervical lordosis on lateral radiographs. Sci Rep 2022; 12:15732. [PMID: 36130962 PMCID: PMC9492662 DOI: 10.1038/s41598-022-19914-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Accepted: 09/06/2022] [Indexed: 11/25/2022] Open
Abstract
Cervical sagittal alignment is an essential parameter for the evaluation of spine disorders. Manual measurement is time-consuming and burdensome to measurers. Artificial intelligence (AI) in the form of convolutional neural networks has begun to be used to measure x-rays. This study aimed to develop AI for automated measurement of lordosis on lateral cervical x-rays. We included 4546 cervical x-rays from 1674 patients. For all x-rays, the caudal endplates of C2 and C7 were labeled based on consensus among well-experienced spine surgeons, the data for which were used as ground truth. This ground truth was split into training data and test data, and the AI model learned the training data. The absolute error of the AI measurements relative to the ground truth for 4546 x-rays was determined by fivefold cross-validation. Additionally, the absolute error of AI measurements was compared with the error of other 2 surgeons’ measurements on 415 radiographs of 168 randomly selected patients. In fivefold cross-validation, the absolute error of the AI model was 3.3° in the average and 2.2° in the median. For comparison of other surgeons, the mean absolute error for measurement of 168 patients was 3.1° ± 3.4° for the AI model, 3.9° ± 3.4° for Surgeon 1, and 3.8° ± 4.7° for Surgeon 2. The AI model had a significantly smaller error than Surgeon 1 and Surgeon 2 (P = 0.002 and 0.036). This algorithm is available at (https://ykszk.github.io/c2c7demo/). The AI model measured cervical spine alignment with better accuracy than surgeons. AI can assist in routine medical care and can be helpful in research that measures large numbers of images. However, because of the large errors in rare cases such as highly deformed ones, AI may, in principle, be limited to assisting humans.
Collapse
|
14
|
Zhou S, Zhou F, Sun Y, Chen X, Diao Y, Zhao Y, Huang H, Fan X, Zhang G, Li X. The application of artificial intelligence in spine surgery. Front Surg 2022; 9:885599. [PMID: 36034349 PMCID: PMC9403075 DOI: 10.3389/fsurg.2022.885599] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 07/25/2022] [Indexed: 11/13/2022] Open
Abstract
Due to its obvious advantages in processing big data and image information, the combination of artificial intelligence and medical care may profoundly change medical practice and promote the gradual transition from traditional clinical care to precision medicine mode. In this artical, we reviewed the relevant literatures and found that artificial intelligence was widely used in spine surgery. The application scenarios included etiology, diagnosis, treatment, postoperative prognosis and decision support systems of spinal diseases. The shift to artificial intelligence model in medicine constantly improved the level of doctors' diagnosis and treatment and the development of orthopedics.
Collapse
Affiliation(s)
- Shuai Zhou
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Feifei Zhou
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
- Correspondence: Feifei Zhou
| | - Yu Sun
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Xin Chen
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Yinze Diao
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Yanbin Zhao
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Haoge Huang
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Xiao Fan
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Gangqiang Zhang
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Xinhang Li
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Peking University Third Hospital, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| |
Collapse
|
15
|
Grover P, Siebenwirth J, Caspari C, Drange S, Dreischarf M, Le Huec JC, Putzier M, Franke J. Can artificial intelligence support or even replace physicians in measuring sagittal balance? A validation study on preoperative and postoperative full spine images of 170 patients. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2022; 31:1943-1951. [PMID: 35796837 DOI: 10.1007/s00586-022-07309-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/06/2022] [Accepted: 06/24/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE Sagittal balance (SB) plays an important role in the surgical treatment of spinal disorders. The aim of this research study is to provide a detailed evaluation of a new, fully automated algorithm based on artificial intelligence (AI) for the determination of SB parameters on a large number of patients with and without instrumentation. METHODS Pre- and postoperative sagittal full body radiographs of 170 patients were measured by two human raters, twice by one rater and by the AI algorithm which determined: pelvic incidence, pelvic tilt, sacral slope, L1-S1 lordosis, T4-T12 thoracic kyphosis (TK) and the spino-sacral angle (SSA). To evaluate the agreement between human raters and AI, the mean error (95% confidence interval (CI)), standard deviation and an intra- and inter-rater reliability was conducted using intra-class correlation (ICC) coefficients. RESULTS ICC values for the assessment of the intra- (range: 0.88-0.97) and inter-rater (0.86-0.97) reliability of human raters are excellent. The algorithm is able to determine all parameters in 95% of all pre- and in 91% of all postoperative images with excellent ICC values (PreOP-range: 0.83-0.91, PostOP: 0.72-0.89). Mean errors are smallest for the SSA (PreOP: -0.1° (95%-CI: -0.9°-0.6°); PostOP: -0.5° (-1.4°-0.4°)) and largest for TK (7.0° (6.1°-7.8°); 7.1° (6.1°-8.1°)). CONCLUSION A new, fully automated algorithm that determines SB parameters has excellent reliability and agreement with human raters, particularly on preoperative full spine images. The presented solution will relieve physicians from time-consuming routine work of measuring SB parameters and allow the analysis of large databases efficiently.
Collapse
Affiliation(s)
- Priyanka Grover
- Raylytic GmbH, Petersstrasse 32-34, 04109, Leipzig, Germany.
| | | | | | - Steffen Drange
- Department of Orthopedics, Klinikum Magdeburg, Magdeburg, Germany
| | | | | | | | - Jörg Franke
- Department of Orthopedics, Klinikum Magdeburg, Magdeburg, Germany
| |
Collapse
|
16
|
Weng CH, Huang YJ, Fu CJ, Yeh YC, Yeh CY, Tsai TT. Automatic recognition of whole-spine sagittal alignment and curvature analysis through a deep learning technique. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2022; 31:2092-2103. [PMID: 35366104 DOI: 10.1007/s00586-022-07189-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 02/21/2022] [Accepted: 03/12/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE Artificial intelligence based on deep learning (DL) approaches enables the automatic recognition of anatomic landmarks and subsequent estimation of various spinopelvic parameters. The locations of inflection points (IPs) and apices (APs) in whole-spine lateral radiographs could be mathematically determined by a fully automatic spinal sagittal curvature analysis system. METHODS We developed a DL model for automatic spinal curvature analysis of whole-spine lateral plain radiographs by using 1800 annotated images of various spinal disease etiologies. The DL model comprised a landmark localizer to detect 25 vertebral landmarks and a numerical algorithm for the generation of an individualized spinal sagittal curvature. The characteristics of the spinal curvature, including the IPs, APs, and curvature angle, could thus be analyzed using mathematical definitions. The localization error of each landmark was calculated from the predictions of 300 test images to evaluate the performance of the landmark localizer. The interrater reliability among a senior orthopedic surgeon, a radiologist, and the DL model was assessed using the intraclass correlation coefficient (ICC). RESULTS The accuracy of the landmark localizer was within an acceptable range (median error: 1.7-4.1 mm), and the interrater reliabilities between the proposed DL model and each expert were good to excellent (all ICCs > 0.85) for the measurement of spinal curvature characteristics. CONCLUSION The interrater reliability between the proposed DL model and human experts was good to excellent in predicting the locations of IPs, APs, and curvature angles. Future applications should be explored to validate this system and improve its clinical efficiency.
Collapse
Affiliation(s)
- Chi-Hung Weng
- aetherAI Co., Ltd., 9 F., No. 3-2, Park St., Nangang Dist., Taipei, 115, Taiwan
| | - Yu-Jui Huang
- Spine Division, Department of Orthopaedic Surgery, Bone and Joint Research Center, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, No. 5, Fuxing St., Guishan Dist., Taoyuan, 333, Taiwan
| | - Chen-Ju Fu
- Department of Medical Imaging and Intervention, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Taoyuan, 333, Taiwan
| | - Yu-Cheng Yeh
- Spine Division, Department of Orthopaedic Surgery, Bone and Joint Research Center, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, No. 5, Fuxing St., Guishan Dist., Taoyuan, 333, Taiwan.
| | - Chao-Yuan Yeh
- aetherAI Co., Ltd., 9 F., No. 3-2, Park St., Nangang Dist., Taipei, 115, Taiwan
| | - Tsung-Ting Tsai
- Spine Division, Department of Orthopaedic Surgery, Bone and Joint Research Center, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, No. 5, Fuxing St., Guishan Dist., Taoyuan, 333, Taiwan
| |
Collapse
|
17
|
Spinopelvic measurements of sagittal balance with deep learning: systematic review and critical evaluation. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2022; 31:2031-2045. [PMID: 35278146 DOI: 10.1007/s00586-022-07155-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Revised: 02/04/2022] [Accepted: 02/14/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE To summarize and critically evaluate the existing studies for spinopelvic measurements of sagittal balance that are based on deep learning (DL). METHODS Three databases (PubMed, WoS and Scopus) were queried for records using keywords related to DL and measurement of sagittal balance. After screening the resulting 529 records that were augmented with specific web search, 34 studies published between 2017 and 2022 were included in the final review, and evaluated from the perspective of the observed sagittal spinopelvic parameters, properties of spine image datasets, applied DL methodology and resulting measurement performance. RESULTS Studies reported DL measurement of up to 18 different spinopelvic parameters, but the actual number depended on the image field of view. Image datasets were composed of lateral lumbar spine and whole spine X-rays, biplanar whole spine X-rays and lumbar spine magnetic resonance cross sections, and were increasing in size or enriched by augmentation techniques. Spinopelvic parameter measurement was approached either by landmark detection or structure segmentation, and U-Net was the most frequently applied DL architecture. The latest DL methods achieved excellent performance in terms of mean absolute error against reference manual measurements (~ 2° or ~ 1 mm). CONCLUSION Although the application of relatively complex DL architectures resulted in an improved measurement accuracy of sagittal spinopelvic parameters, future methods should focus on multi-institution and multi-observer analyses as well as uncertainty estimation and error handling implementations for integration into the clinical workflow. Further advances will enhance the predictive analytics of DL methods for spinopelvic parameter measurement. LEVEL OF EVIDENCE I Diagnostic: individual cross-sectional studies with the consistently applied reference standard and blinding.
Collapse
|
18
|
Galbusera F, Bassani T, Panico M, Sconfienza LM, Cina A. A fresh look at spinal alignment and deformities: Automated analysis of a large database of 9832 biplanar radiographs. Front Bioeng Biotechnol 2022; 10:863054. [PMID: 35910028 PMCID: PMC9335010 DOI: 10.3389/fbioe.2022.863054] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 06/27/2022] [Indexed: 11/13/2022] Open
Abstract
We developed and used a deep learning tool to process biplanar radiographs of 9,832 non-surgical patients suffering from spinal deformities, with the aim of reporting the statistical distribution of radiological parameters describing the spinal shape and the correlations and interdependencies between them. An existing tool able to automatically perform a three-dimensional reconstruction of the thoracolumbar spine has been improved and used to analyze a large set of biplanar radiographs of the trunk. For all patients, the following parameters were calculated: spinopelvic parameters; lumbar lordosis; mismatch between pelvic incidence and lumbar lordosis; thoracic kyphosis; maximal coronal Cobb angle; sagittal vertical axis; T1-pelvic angle; maximal vertebral rotation in the transverse plane. The radiological parameters describing the sagittal alignment were found to be highly interrelated with each other, as well as dependent on age, while sex had relatively minor but statistically significant importance. Lumbar lordosis was associated with thoracic kyphosis, pelvic incidence and sagittal vertical axis. The pelvic incidence-lumbar lordosis mismatch was found to be dependent on the pelvic incidence and on age. Scoliosis had a distinct association with the sagittal alignment in adolescent and adult subjects. The deep learning-based tool allowed for the analysis of a large imaging database which would not be reasonably feasible if performed by human operators. The large set of results will be valuable to trigger new research questions in the field of spinal deformities, as well as to challenge the current knowledge.
Collapse
Affiliation(s)
- Fabio Galbusera
- Spine Center, Schulthess Clinic, Zurich, Switzerland
- *Correspondence: Fabio Galbusera,
| | - Tito Bassani
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Matteo Panico
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Department of Chemistry, Materials and Chemical Engineering “Giulio Natta”, Politecnico di Milano, Milan, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Department of Biomedical Sciences for Health, Università Degli Studi di Milano, Milan, Italy
| | - Andrea Cina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
19
|
Qu B, Cao J, Qian C, Wu J, Lin J, Wang L, Ou-Yang L, Chen Y, Yan L, Hong Q, Zheng G, Qu X. Current development and prospects of deep learning in spine image analysis: a literature review. Quant Imaging Med Surg 2022; 12:3454-3479. [PMID: 35655825 PMCID: PMC9131328 DOI: 10.21037/qims-21-939] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 03/04/2022] [Indexed: 10/07/2023]
Abstract
BACKGROUND AND OBJECTIVE As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature. METHODS A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed. KEY CONTENT AND FINDINGS The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability. CONCLUSIONS The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.
Collapse
Affiliation(s)
- Biao Qu
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Jianpeng Cao
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Chen Qian
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jinyu Wu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, Xiamen, China
| | - Liansheng Wang
- Department of Computer Science, School of Informatics, Xiamen University, Xiamen, China
| | - Lin Ou-Yang
- Department of Medical Imaging of Southeast Hospital, Medical College of Xiamen University, Zhangzhou, China
| | - Yongfa Chen
- Department of Pediatric Orthopedic Surgery, The First Affiliated Hospital of Xiamen University, Xiamen, China
| | - Liyue Yan
- Department of Information & Computational Mathematics, Xiamen University, Xiamen, China
| | - Qing Hong
- Biomedical Intelligent Cloud R&D Center, China Mobile Group, Xiamen, China
| | - Gaofeng Zheng
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Xiaobo Qu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| |
Collapse
|
20
|
He Y, Zhao M, Xu T, Li S, Tian H, Li W. Novel cross LSTM for predicting the changes of complementary pelvic angles between standing and sitting. J Biomed Inform 2022; 128:104036. [DOI: 10.1016/j.jbi.2022.104036] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Revised: 02/08/2022] [Accepted: 02/21/2022] [Indexed: 11/26/2022]
|
21
|
Ouyang H, Meng F, Liu J, Song X, Li Y, Yuan Y, Wang C, Lang N, Tian S, Yao M, Liu X, Yuan H, Jiang S, Jiang L. Evaluation of Deep Learning-Based Automated Detection of Primary Spine Tumors on MRI Using the Turing Test. Front Oncol 2022; 12:814667. [PMID: 35359400 PMCID: PMC8962659 DOI: 10.3389/fonc.2022.814667] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Accepted: 02/16/2022] [Indexed: 01/04/2023] Open
Abstract
BackgroundRecently, the Turing test has been used to investigate whether machines have intelligence similar to humans. Our study aimed to assess the ability of an artificial intelligence (AI) system for spine tumor detection using the Turing test.MethodsOur retrospective study data included 12179 images from 321 patients for developing AI detection systems and 6635 images from 187 patients for the Turing test. We utilized a deep learning-based tumor detection system with Faster R-CNN architecture, which generates region proposals by Region Proposal Network in the first stage and corrects the position and the size of the bounding box of the lesion area in the second stage. Each choice question featured four bounding boxes enclosing an identical tumor. Three were detected by the proposed deep learning model, whereas the other was annotated by a doctor; the results were shown to six doctors as respondents. If the respondent did not correctly identify the image annotated by a human, his answer was considered a misclassification. If all misclassification rates were >30%, the respondents were considered unable to distinguish the AI-detected tumor from the human-annotated one, which indicated that the AI system passed the Turing test.ResultsThe average misclassification rates in the Turing test were 51.2% (95% CI: 45.7%–57.5%) in the axial view (maximum of 62%, minimum of 44%) and 44.5% (95% CI: 38.2%–51.8%) in the sagittal view (maximum of 59%, minimum of 36%). The misclassification rates of all six respondents were >30%; therefore, our AI system passed the Turing test.ConclusionOur proposed intelligent spine tumor detection system has a similar detection ability to annotation doctors and may be an efficient tool to assist radiologists or orthopedists in primary spine tumor detection.
Collapse
Affiliation(s)
- Hanqiang Ouyang
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Fanyu Meng
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Jianfang Liu
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Xinhang Song
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
| | - Yuan Li
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Yuan Yuan
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Chunjie Wang
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Ning Lang
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Shuai Tian
- Department of Radiology, Peking University Third Hospital, Beijing, China
| | - Meiyi Yao
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xiaoguang Liu
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
| | - Huishu Yuan
- Department of Radiology, Peking University Third Hospital, Beijing, China
- *Correspondence: Huishu Yuan, ; Shuqiang Jiang, ; Liang Jiang,
| | - Shuqiang Jiang
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- *Correspondence: Huishu Yuan, ; Shuqiang Jiang, ; Liang Jiang,
| | - Liang Jiang
- Department of Orthopaedics, Peking University Third Hospital, Beijing, China
- Engineering Research Center of Bone and Joint Precision Medicine, Beijing, China
- Beijing Key Laboratory of Spinal Disease Research, Beijing, China
- *Correspondence: Huishu Yuan, ; Shuqiang Jiang, ; Liang Jiang,
| |
Collapse
|
22
|
Banerjee S, Lyu J, Huang Z, Leung FH, Lee T, Yang D, Su S, Zheng Y, Ling SH. Ultrasound spine image segmentation using multi-scale feature fusion skip-inception U-Net (SIU-Net). Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.02.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
23
|
Patel AV, White CA, Schwartz JT, Pitaro NL, Shah KC, Singh S, Arvind V, Kim JS, Cho SK. Emerging Technologies in the Treatment of Adult Spinal Deformity. Neurospine 2021; 18:417-427. [PMID: 34610669 PMCID: PMC8497255 DOI: 10.14245/ns.2142412.206] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 07/12/2021] [Indexed: 12/29/2022] Open
Abstract
Outcomes for adult spinal deformity continue to improve as new technologies become integrated into clinical practice. Machine learning, robot-guided spinal surgery, and patient-specific rods are tools that are being used to improve preoperative planning and patient satisfaction. Machine learning can be used to predict complications, readmissions, and generate postoperative radiographs which can be shown to patients to guide discussions about surgery. Robot-guided spinal surgery is a rapidly growing field showing signs of greater accuracy in screw placement during surgery. Patient-specific rods offer improved outcomes through higher correction rates and decreased rates of rod breakage while decreasing operative time. The objective of this review is to evaluate trends in the literature about machine learning, robot-guided spinal surgery, and patient-specific rods in the treatment of adult spinal deformity.
Collapse
Affiliation(s)
- Akshar V Patel
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Christopher A White
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - John T Schwartz
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Nicholas L Pitaro
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Kush C Shah
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Sirjanhar Singh
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Varun Arvind
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Jun S Kim
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Samuel K Cho
- Department of Orthopaedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| |
Collapse
|
24
|
McDonnell JM, Evans SR, McCarthy L, Temperley H, Waters C, Ahern D, Cunniffe G, Morris S, Synnott K, Birch N, Butler JS. The diagnostic and prognostic value of artificial intelligence and artificial neural networks in spinal surgery : a narrative review. Bone Joint J 2021; 103-B:1442-1448. [PMID: 34465148 DOI: 10.1302/0301-620x.103b9.bjj-2021-0192.r1] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
In recent years, machine learning (ML) and artificial neural networks (ANNs), a particular subset of ML, have been adopted by various areas of healthcare. A number of diagnostic and prognostic algorithms have been designed and implemented across a range of orthopaedic sub-specialties to date, with many positive results. However, the methodology of many of these studies is flawed, and few compare the use of ML with the current approach in clinical practice. Spinal surgery has advanced rapidly over the past three decades, particularly in the areas of implant technology, advanced surgical techniques, biologics, and enhanced recovery protocols. It is therefore regarded an innovative field. Inevitably, spinal surgeons will wish to incorporate ML into their practice should models prove effective in diagnostic or prognostic terms. The purpose of this article is to review published studies that describe the application of neural networks to spinal surgery and which actively compare ANN models to contemporary clinical standards allowing evaluation of their efficacy, accuracy, and relatability. It also explores some of the limitations of the technology, which act to constrain the widespread adoption of neural networks for diagnostic and prognostic use in spinal care. Finally, it describes the necessary considerations should institutions wish to incorporate ANNs into their practices. In doing so, the aim of this review is to provide a practical approach for spinal surgeons to understand the relevant aspects of neural networks. Cite this article: Bone Joint J 2021;103-B(9):1442-1448.
Collapse
Affiliation(s)
- Jake M McDonnell
- School of Medicine, Royal College of Surgeons Ireland, Dublin, Ireland.,National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | | | | | | | | | - Daniel Ahern
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland.,Centre for Biomedical Engineering, Trinity College, Dublin, Ireland
| | - Gráinne Cunniffe
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Seamus Morris
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Keith Synnott
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Nick Birch
- Bragborough Hall Health and Wellness Centre, Daventry, UK
| | - Joseph S Butler
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland.,School of Medicine, University College, Dublin, Ireland
| |
Collapse
|
25
|
Schwartz JT, Cho BH, Tang P, Schefflein J, Arvind V, Kim JS, Doshi AH, Cho SK. Deep Learning Automates Measurement of Spinopelvic Parameters on Lateral Lumbar Radiographs. Spine (Phila Pa 1976) 2021; 46:E671-E678. [PMID: 33273436 DOI: 10.1097/brs.0000000000003830] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Cross-sectional database study. OBJECTIVE The objective of this study was to develop an algorithm for the automated measurement of spinopelvic parameters on lateral lumbar radiographs with comparable accuracy to surgeons. SUMMARY OF BACKGROUND DATA Sagittal alignment measurements are important for the evaluation of spinal disorders. Manual measurement methods are time-consuming and subject to rater-dependent error. Thus, a need exists to develop automated methods for obtaining sagittal measurements. Previous studies of automated measurement have been limited in accuracy, inapplicable to common plain films, or unable to measure pelvic parameters. METHODS Images from 816 patients receiving lateral lumbar radiographs were collected sequentially and used to develop a convolutional neural network (CNN) segmentation algorithm. A total of 653 (80%) of these radiographs were used to train and validate the CNN. This CNN was combined with a computer vision algorithm to create a pipeline for the fully automated measurement of spinopelvic parameters from lateral lumbar radiographs. The remaining 163 (20%) of radiographs were used to test this pipeline. Forty radiographs were selected from the test set and manually measured by three surgeons for comparison. RESULTS The CNN achieved an area under the receiver-operating curve of 0.956. Algorithm measurements of L1-S1 cobb angle, pelvic incidence, pelvic tilt, and sacral slope were not significantly different from surgeon measurement. In comparison to criterion standard measurement, the algorithm performed with a similar mean absolute difference to spine surgeons for L1-S1 Cobb angle (4.30° ± 4.14° vs. 4.99° ± 5.34°), pelvic tilt (2.14° ± 6.29° vs. 1.58° ± 5.97°), pelvic incidence (4.56° ± 5.40° vs. 3.74° ± 2.89°), and sacral slope (4.76° ± 6.93° vs. 4.75° ± 5.71°). CONCLUSION This algorithm measures spinopelvic parameters on lateral lumbar radiographs with comparable accuracy to surgeons. The algorithm could be used to streamline clinical workflow or perform large scale studies of spinopelvic parameters.Level of Evidence: 3.
Collapse
Affiliation(s)
- John T Schwartz
- Department of Orthopedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Brian H Cho
- Department of Orthopedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Peter Tang
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Javin Schefflein
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Varun Arvind
- Department of Orthopedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Jun S Kim
- Department of Orthopedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Amish H Doshi
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Samuel K Cho
- Department of Orthopedic Surgery, Icahn School of Medicine at Mount Sinai, New York, NY
| |
Collapse
|
26
|
Cina A, Bassani T, Panico M, Luca A, Masharawi Y, Brayda-Bruno M, Galbusera F. 2-step deep learning model for landmarks localization in spine radiographs. Sci Rep 2021; 11:9482. [PMID: 33947917 PMCID: PMC8096829 DOI: 10.1038/s41598-021-89102-w] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 04/20/2021] [Indexed: 11/25/2022] Open
Abstract
In this work we propose to use Deep Learning to automatically calculate the coordinates of the vertebral corners in sagittal x-rays images of the thoracolumbar spine and, from those landmarks, to calculate relevant radiological parameters such as L1–L5 and L1–S1 lordosis and sacral slope. For this purpose, we used 10,193 images annotated with the landmarks coordinates as the ground truth. We realized a model that consists of 2 steps. In step 1, we trained 2 Convolutional Neural Networks to identify each vertebra in the image and calculate the landmarks coordinates respectively. In step 2, we refined the localization using cropped images of a single vertebra as input to another convolutional neural network and we used geometrical transformations to map the corners to the original image. For the localization tasks, we used a differentiable spatial to numerical transform (DSNT) as the top layer. We evaluated the model both qualitatively and quantitatively on a set of 195 test images. The median localization errors relative to the vertebrae dimensions were 1.98% and 1.68% for x and y coordinates respectively. All the predicted angles were highly correlated with the ground truth, despite non-negligible absolute median errors of 1.84°, 2.43° and 1.98° for L1–L5, L1–S1 and SS respectively. Our model is able to calculate with good accuracy the coordinates of the vertebral corners and has a large potential for improving the reliability and repeatability of measurements in clinical tasks.
Collapse
Affiliation(s)
- Andrea Cina
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy.
| | - Tito Bassani
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy
| | - Matteo Panico
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy
| | - Andrea Luca
- Department of Spine Surgery III, IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy
| | - Youssef Masharawi
- Department of Physiotherapy, Sackler Faculty of Medicine, The Stanley Steyer School of Health Professions, Tel Aviv University, Tel Aviv, Israel
| | - Marco Brayda-Bruno
- Department of Spine Surgery III, IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy
| | - Fabio Galbusera
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161, Milan, Italy
| |
Collapse
|
27
|
Yeh YC, Weng CH, Huang YJ, Fu CJ, Tsai TT, Yeh CY. Deep learning approach for automatic landmark detection and alignment analysis in whole-spine lateral radiographs. Sci Rep 2021; 11:7618. [PMID: 33828159 PMCID: PMC8027006 DOI: 10.1038/s41598-021-87141-x] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Accepted: 03/18/2021] [Indexed: 12/21/2022] Open
Abstract
Human spinal balance assessment relies considerably on sagittal radiographic parameter measurement. Deep learning could be applied for automatic landmark detection and alignment analysis, with mild to moderate standard errors and favourable correlations with manual measurement. In this study, based on 2210 annotated images of various spinal disease aetiologies, we developed deep learning models capable of automatically locating 45 anatomic landmarks and subsequently generating 18 radiographic parameters on a whole-spine lateral radiograph. In the assessment of model performance, the localisation accuracy and learning speed were the highest for landmarks in the cervical area, followed by those in the lumbosacral, thoracic, and femoral areas. All the predicted radiographic parameters were significantly correlated with ground truth values (all p < 0.001). The human and artificial intelligence comparison revealed that the deep learning model was capable of matching the reliability of doctors for 15/18 of the parameters. The proposed automatic alignment analysis system was able to localise spinal anatomic landmarks with high accuracy and to generate various radiographic parameters with favourable correlations with manual measurements.
Collapse
Affiliation(s)
- Yu-Cheng Yeh
- Department of Orthopaedic Surgery, Spine Division, Bone and Joint Research Center, Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Taoyuan, Taiwan, ROC
| | - Chi-Hung Weng
- aetherAI Co., Ltd., 9F., No.3-2, Yuanqu St., Nangang Dist., Taipei City, 115, Taiwan, ROC
| | - Yu-Jui Huang
- Department of Orthopaedic Surgery, Spine Division, Bone and Joint Research Center, Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Taoyuan, Taiwan, ROC
| | - Chen-Ju Fu
- Department of Medical Imaging and Intervention, Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Taoyuan, Taiwan, ROC
| | - Tsung-Ting Tsai
- Department of Orthopaedic Surgery, Spine Division, Bone and Joint Research Center, Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Taoyuan, Taiwan, ROC
| | - Chao-Yuan Yeh
- aetherAI Co., Ltd., 9F., No.3-2, Yuanqu St., Nangang Dist., Taipei City, 115, Taiwan, ROC.
| |
Collapse
|