1
|
Archer H, Reine S, Xia S, Vazquez LC, Ashikyan O, Pezeshk P, Kohli A, Xi Y, Wells JE, Hummer A, Difranco M, Chhabra A. Reliability assessment of leg length and angular alignment on manual reads versus artificial intelligence-generated lower extremity radiographic measurements. Clin Imaging 2024; 113:110233. [PMID: 39029361 DOI: 10.1016/j.clinimag.2024.110233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 06/25/2024] [Accepted: 07/08/2024] [Indexed: 07/21/2024]
Abstract
PURPOSE Leg length discrepancy (LLD) and lower extremity malalignment can lead to pain and osteoarthritis. A variety of radiographic parameters are used to assess LLD and alignment. A 510(k) FDA approved artificial intelligence (AI) software locates landmarks on full leg standing radiographs and performs several measurements. The objective of this study was to assess the reliability of this AI tool compared to three manual readers. METHODS A sample of 320 legs was used. Three readers' measurements were compared to AI output for hip-knee-angle (HKA), anatomical-tibiofemoral angle (aTFA), anatomical-mechanical-axis angle (AMA), joint-line-convergence angle (JLCA), mechanical-lateral-proximal-femur-angle (mLPFA), mechanical-lateral-distal-femur-angle (mLDFA), mechanical-medial-proximal-tibia-angle (mMPTA), mechanical-lateral-distal-tibia- angle (mLDTA), femur length, tibia length, full leg length, leg-length-discrepancy (LLD), and mechanical-axis-deviation (MAD). Intraclass correlation coefficients (ICCs) and Bland-Altman analysis were used to track performance. RESULTS AI output was successfully produced for 272/320 legs in the study. The reader versus AI pairwise ICCs were mostly in the excellent range: 12/13, 12/13, and 9/13 variables were in the excellent range (ICC > 0.75) for readers 1, 2, and 3, respectively. There was better agreement for leg length, femur length, tibia length, LLD, and HKA than for other variables. The median reading times for the three readers and AI were 250, 282, 236, and 38 s, respectively. CONCLUSION This study showed that AI-based software provides reliable assessment of LLD and lower extremity alignment with substantial time savings.
Collapse
Affiliation(s)
- Holden Archer
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA. https://twitter.com/@HoldenArcher
| | - Seth Reine
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Shuda Xia
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Louis Camilo Vazquez
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Oganes Ashikyan
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Parham Pezeshk
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Ajay Kohli
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Yin Xi
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Joel E Wells
- Baylor Scott & White, 5220 W University Dr, McKinney, TX 75071, USA. https://twitter.com/@Joelwellsmd
| | - Allan Hummer
- IB Lab GmbH, Zehetnergasse 6/2/2, 1140 Vienna, Austria
| | | | - Avneesh Chhabra
- University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA.
| |
Collapse
|
2
|
Salzmann M, Hassan Tarek H, Prill R, Becker R, Schreyer AG, Hable R, Ostojic M, Ramadanov N. Artificial intelligence-based assessment of leg axis parameters shows excellent agreement with human raters: A systematic review and meta-analysis. Knee Surg Sports Traumatol Arthrosc 2024. [PMID: 39033340 DOI: 10.1002/ksa.12362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 07/01/2024] [Accepted: 07/02/2024] [Indexed: 07/23/2024]
Abstract
PURPOSE The aim of this study was to conduct a systematic review and meta-analysis on the reliability and applicability of artificial intelligence (AI)-based analysis of leg axis parameters. We hypothesized that AI-based leg axis measurements would be less time-consuming and as accurate as those performed by human raters. METHODS The study protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO). PubMed, Epistemonikos, and Web of Science were searched up to 24 February 2024, using a BOOLEAN search strategy. Titles and abstracts of identified records were screened through a stepwise process. Data extraction and quality assessment of the included papers were followed by a frequentist meta-analysis employing a common effect/random effects model with inverse variance and the Sidik-Jonkman heterogeneity estimator. RESULTS A total of 13 studies encompassing 3192 patients were included in this meta-analysis. All studies compared AI-based leg axis measurements on long-leg radiographs (LLR) with those performed by human raters. The parameters hip knee ankle angle (HKA), mechanical lateral distal femoral angle (mLDFA), mechanical medial proximal tibial angle (mMPTA), and joint-line convergence angle (JLCA) showed excellent agreement between AI and human raters. The AI system was approximately 3 min faster in reading standing long-leg anteroposterior radiographs (LLRs) compared with human raters. CONCLUSION AI-based assessment of leg axis parameters is an efficient, accurate, and time-saving procedure. The quality of AI-based assessment of the investigated parameters does not appear to be affected by the presence of implants or pathological conditions. LEVEL OF EVIDENCE Level I.
Collapse
Affiliation(s)
- Mikhail Salzmann
- Center of Orthopaedics and Traumatology, Brandenburg Medical School, University Hospital Brandenburg an der Havel, Brandenburg an der Havel, Germany
- Faculty of Health Science Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| | - Hakam Hassan Tarek
- Center of Orthopaedics and Traumatology, Brandenburg Medical School, University Hospital Brandenburg an der Havel, Brandenburg an der Havel, Germany
- Faculty of Health Science Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| | - Robert Prill
- Center of Orthopaedics and Traumatology, Brandenburg Medical School, University Hospital Brandenburg an der Havel, Brandenburg an der Havel, Germany
- Faculty of Health Science Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| | - Roland Becker
- Center of Orthopaedics and Traumatology, Brandenburg Medical School, University Hospital Brandenburg an der Havel, Brandenburg an der Havel, Germany
- Faculty of Health Science Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| | - Andreas G Schreyer
- Institute for Diagnostic and Interventional Radiology, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| | - Robert Hable
- Faculty of Applied Computer Science, Deggendorf Institute of Technology, Deggendorf, Germany
| | - Marko Ostojic
- Department of Orthopedics, University Hospital Mostar, Mostar, Bosnia and Herzegovina
| | - Nikolai Ramadanov
- Center of Orthopaedics and Traumatology, Brandenburg Medical School, University Hospital Brandenburg an der Havel, Brandenburg an der Havel, Germany
- Faculty of Health Science Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany
| |
Collapse
|
3
|
Rakhshankhah N, Abbaszadeh M, Kazemi A, Rezaei SS, Roozpeykar S, Arabfard M. Deep learning approach to femoral AVN detection in digital radiography: differentiating patients and pre-collapse stages. BMC Musculoskelet Disord 2024; 25:547. [PMID: 39010001 PMCID: PMC11251364 DOI: 10.1186/s12891-024-07669-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Accepted: 07/08/2024] [Indexed: 07/17/2024] Open
Abstract
OBJECTIVE This study aimed to evaluate a new deep-learning model for diagnosing avascular necrosis of the femoral head (AVNFH) by analyzing pelvic anteroposterior digital radiography. METHODS The study sample included 1167 hips. The radiographs were independently classified into 6 stages by a radiologist using their simultaneous MRIs. After that, the radiographs were given to train and test the deep learning models of the project including SVM and ANFIS layer using the Python programming language and TensorFlow library. In the last step, the test set of hip radiographs was provided to two independent radiologists with different work experiences to compare their diagnosis performance to the deep learning models' performance using the F1 score and Mcnemar test analysis. RESULTS The performance of SVM for AVNFH detection (AUC = 82.88%) was slightly higher than less experienced radiologists (79.68%) and slightly lower than experienced radiologists (88.4%) without reaching significance (p-value > 0.05). Evaluation of the performance of SVM for pre-collapse AVNFH detection with an AUC of 73.58% showed significantly higher performance than less experienced radiologists (AUC = 60.70%, p-value < 0.001). On the other hand, no significant difference is noted between experienced radiologists and SVM for pre-collapse detection. ANFIS algorithm for AVNFH detection with an AUC of 86.60% showed significantly higher performance than less experienced radiologists (AUC = 79.68%, p-value = 0.04). Although reaching less performance compared to experienced radiologists statistically not significant (AUC = 88.40%, p-value = 0.20). CONCLUSIONS Our study has shed light on the remarkable capabilities of SVM and ANFIS as diagnostic tools for AVNFH detection in radiography. Their ability to achieve high accuracy with remarkable efficiency makes them promising candidates for early detection and intervention, ultimately contributing to improved patient outcomes.
Collapse
Affiliation(s)
- Nima Rakhshankhah
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Mahdi Abbaszadeh
- Department of Orthopedic Surgery, Faculty of Medicine, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Atefeh Kazemi
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Soroush Soltan Rezaei
- Student Research Committee, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Saeid Roozpeykar
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran.
| | - Masoud Arabfard
- Chemical Injuries Research Center, Systems Biology and Poisonings Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
4
|
Wang J, Li S, Sun Z, Lao Q, Shen B, Li K, Nie Y. Full-length radiograph based automatic musculoskeletal modeling using convolutional neural network. J Biomech 2024; 166:112046. [PMID: 38467079 DOI: 10.1016/j.jbiomech.2024.112046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 02/27/2024] [Accepted: 03/07/2024] [Indexed: 03/13/2024]
Abstract
Full-length radiographs contain information from which many anatomical parameters of the pelvis, femur, and tibia may be derived, but only a few anatomical parameters are used for musculoskeletal modeling. This study aimed to develop a fully automatic algorithm to extract anatomical parameters from full-length radiograph to generate a musculoskeletal model that is more accurate than linear scaled one. A U-Net convolutional neural network was trained to segment the pelvis, femur, and tibia from the full-length radiograph. Eight anatomic parameters (six for length and width, two for angles) were automatically extracted from the bone segmentation masks and used to generate the musculoskeletal model. Sørensen-Dice coefficient was used to quantify the consistency of automatic bone segmentation masks with manually segmented labels. Maximum distance error, root mean square (RMS) distance error and Jaccard index (JI) were used to evaluate the geometric accuracy of the automatically generated pelvis, femur and tibia models versus CT bone models. Mean Sørensen-Dice coefficients for the pelvis, femur and tibia 2D segmentation masks were 0.9898, 0.9822 and 0.9786, respectively. The algorithm-driven bone models were closer to the 3D CT bone models than the scaled generic models in geometry, with significantly lower maximum distance error (28.3 % average decrease from 24.35 mm) and RMS distance error (28.9 % average decrease from 9.55 mm) and higher JI (17.2 % average increase from 0.46) (P < 0.001). The algorithm-driven musculoskeletal modeling (107.15 ± 10.24 s) was faster than the manual process (870.07 ± 44.79 s) for the same full-length radiograph. This algorithm provides a fully automatic way to generate a musculoskeletal model from full-length radiograph that achieves an approximately 30 % reduction in distance errors, which could enable personalized musculoskeletal simulation based on full-length radiograph for large scale OA populations.
Collapse
Affiliation(s)
- Junqing Wang
- Department of Orthopedic Surgery and Orthopedic Research Institute, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China.
| | - Shiqi Li
- Department of Orthopedic Surgery and Orthopedic Research Institute, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China; College of Electrical Engineering, Sichuan University, Chengdu, Sichuan Province, China.
| | - Zitong Sun
- Sichuan University-Pittsburgh Institute (SCUPI), Sichuan University, Chengdu, Sichuan Province, China.
| | - Qicheng Lao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
| | - Bin Shen
- Department of Orthopedic Surgery and Orthopedic Research Institute, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China.
| | - Kang Li
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China.
| | - Yong Nie
- Department of Orthopedic Surgery and Orthopedic Research Institute, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China.
| |
Collapse
|
5
|
Kim SE, Nam JW, Kim JI, Kim JK, Ro DH. Enhanced deep learning model enables accurate alignment measurement across diverse institutional imaging protocols. Knee Surg Relat Res 2024; 36:4. [PMID: 38217058 PMCID: PMC10785531 DOI: 10.1186/s43019-023-00209-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Accepted: 12/27/2023] [Indexed: 01/14/2024] Open
Abstract
BACKGROUND Achieving consistent accuracy in radiographic measurements across different equipment and protocols is challenging. This study evaluates an advanced deep learning (DL) model, building upon a precursor, for its proficiency in generating uniform and precise alignment measurements in full-leg radiographs irrespective of institutional imaging differences. METHODS The enhanced DL model was trained on over 10,000 radiographs. Utilizing a segmented approach, it separately identified and evaluated regions of interest (ROIs) for the hip, knee, and ankle, subsequently integrating these regions. For external validation, 300 datasets from three distinct institutes with varied imaging protocols and equipment were employed. The study measured seven radiologic parameters: hip-knee-ankle angle, lateral distal femoral angle, medial proximal tibial angle, joint line convergence angle, weight-bearing line ratio, joint line obliquity angle, and lateral distal tibial angle. Measurements by the model were compared with an orthopedic specialist's evaluations using inter-observer and intra-observer intraclass correlation coefficients (ICCs). Additionally, the absolute error percentage in alignment measurements was assessed, and the processing duration for radiograph evaluation was recorded. RESULTS The DL model exhibited excellent performance, achieving an inter-observer ICC between 0.936 and 0.997, on par with an orthopedic specialist, and an intra-observer ICC of 1.000. The model's consistency was robust across different institutional imaging protocols. Its accuracy was particularly notable in measuring the hip-knee-ankle angle, with no instances of absolute error exceeding 1.5 degrees. The enhanced model significantly improved processing speed, reducing the time by 30-fold from an initial 10-11 s to 300 ms. CONCLUSIONS The enhanced DL model demonstrated its ability for accurate, rapid alignment measurements in full-leg radiographs, regardless of protocol variations, signifying its potential for broad clinical and research applicability.
Collapse
Affiliation(s)
- Sung Eun Kim
- Department of Orthopaedic Surgery, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 110-744, Republic of Korea
- Department of Orthopaedic Surgery, Seoul National University Hospital, Seoul, South Korea
| | | | - Joong Il Kim
- Department of Orthopaedic Surgery, Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul, South Korea
| | - Jong-Keun Kim
- Department of Orthopaedic Surgery, Heung-K Hospital, Gyeonggi-do, South Korea
| | - Du Hyun Ro
- Department of Orthopaedic Surgery, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 110-744, Republic of Korea.
- Department of Orthopaedic Surgery, Seoul National University Hospital, Seoul, South Korea.
- CONNECTEVE Co., Ltd, Seoul, South Korea.
| |
Collapse
|