1
|
Hu J, Peng J, Zhou Z, Zhao T, Zhong L, Yu K, Jiang K, Lau TS, Huang C, Lu L, Zhang X. Associating Knee Osteoarthritis Progression with Temporal-Regional Graph Convolutional Network Analysis on MR Images. J Magn Reson Imaging 2025; 61:378-391. [PMID: 38686707 DOI: 10.1002/jmri.29412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 04/09/2024] [Accepted: 04/10/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND Artificial intelligence shows promise in assessing knee osteoarthritis (OA) progression on MR images, but faces challenges in accuracy and interpretability. PURPOSE To introduce a temporal-regional graph convolutional network (TRGCN) on MR images to study the association between knee OA progression status and network outcome. STUDY TYPE Retrospective. POPULATION 194 OA progressors (mean age, 62 ± 9 years) and 406 controls (mean age, 61 ± 9 years) from the OA Initiative were randomly divided into training (80%) and testing (20%) cohorts. FIELD STRENGTH/SEQUENCE Sagittal 2D IW-TSE-FS (IW) and 3D-DESS-WE (DESS) at 3T. ASSESSMENT Anatomical subregions of cartilage, subchondral bone, meniscus, and the infrapatellar fat pad at baseline, 12-month, and 24-month were automatically segmented and served as inputs to form compartment-based graphs for a TRGCN model, which containing both regional and temporal information. The performance of models based on (i) clinical variables alone, (ii) radiologist score alone, (iii) combined features (containing i and ii), (iv) composite TRGCN (combining TRGCN, i and ii), (v) radiomics features, (vi) convolutional neural network based on Densenet-169 were compared. STATISTICAL TESTS DeLong test was performed to compare the areas under the ROC curve (AUC) of all models. Additionally, interpretability analysis was done to evaluate the contributions of individual regions. A P value <0.05 was considered significant. RESULTS The composite TRGCN outperformed all other models with AUCs of 0.841 (DESS) and 0.856 (IW) in the testing cohort (all P < 0.05). Interpretability analysis highlighted cartilage's importance over other structures (42%-45%), tibiofemoral joint's (TFJ) dominance over patellofemoral joint (PFJ) (58%-67% vs. 12%-37%), and importance scores changes in compartments over time (TFJ vs. PFJ: baseline: 44% vs. 43%, 12-month: 52% vs. 39%, 24-month: 31% vs. 48%). DATA CONCLUSION The composite TRGCN, capturing temporal and regional information, demonstrated superior discriminative ability compared with other methods, providing interpretable insights for identifying knee OA progression. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY Stage 2.
Collapse
Affiliation(s)
- Jiaping Hu
- Department of Medical Imaging, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics· Guangdong Province), Guangzhou, China
| | - Junyi Peng
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Zidong Zhou
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Tianyun Zhao
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, Georgia, USA
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, New York, USA
| | - Lijie Zhong
- Department of Medical Imaging, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics· Guangdong Province), Guangzhou, China
| | - Keyan Yu
- Department of Radiology, Peking University Shenzhen Hospital, Shenzhen, Guangdong, China
| | - Kexin Jiang
- Department of Medical Imaging, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics· Guangdong Province), Guangzhou, China
| | - Tzak Sing Lau
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia, USA
| | - Chuan Huang
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, Georgia, USA
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia, USA
| | - Lijun Lu
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
- Pazhou Lab, Guangzhou, China
| | - Xiaodong Zhang
- Department of Medical Imaging, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics· Guangdong Province), Guangzhou, China
| |
Collapse
|
2
|
Tariq T, Suhail Z, Nawaz Z. A Review for automated classification of knee osteoarthritis using KL grading scheme for X-rays. Biomed Eng Lett 2025; 15:1-35. [PMID: 39781063 PMCID: PMC11704124 DOI: 10.1007/s13534-024-00437-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 09/21/2024] [Accepted: 09/28/2024] [Indexed: 01/12/2025] Open
Abstract
Osteoarthritis (OA) is a musculoskeletal disorder that affects weight-bearing joints like the hip, knee, spine, feet, and fingers. It is a chronic disorder that causes joint stiffness and leads to functional impairment. Knee osteoarthritis (KOA) is a degenerative knee joint disease that is a significant disability for over 60 years old, with the most prevalent symptom of knee pain. Radiography is the gold standard for the evaluation of KOA. These radiographs are evaluated using different classification systems. Kellgren and Lawrence's (KL) classification system is used to classify X-rays into five classes (Normal = 0 to Severe = 4) based on osteoarthritis severity levels. In recent years, with the advent of artificial intelligence, machine learning, and deep learning, more emphasis has been given to automated medical diagnostic systems or decision support systems. Computer-aided diagnosis is needed for the improvement of health-related information systems. This survey aims to review the latest advances in automated radiographic classification and detection of KOA using the KL system. A total of 85 articles are reviewed as original research or survey articles. This survey will benefit researchers, practitioners, and medical experts interested in X-rays-based KOA diagnosis and prediction.
Collapse
Affiliation(s)
- Tayyaba Tariq
- Department of Computer Science, University of the Punjab, Allama Iqbal Campus, Lahore, Punjab 54000 Pakistan
| | - Zobia Suhail
- Department of Computer Science, University of the Punjab, Allama Iqbal Campus, Lahore, Punjab 54000 Pakistan
| | - Zubair Nawaz
- Department of Data Science, University of the Punjab, Allama Iqbal Campus, Lahore, Punjab 54000 Pakistan
| |
Collapse
|
3
|
Azhideh A, Pooyan A, Alipour E, Haseli S, Hosseini N, Chalian M. The Role of Artificial Intelligence in Osteoarthritis. Semin Roentgenol 2024; 59:518-525. [PMID: 39490044 DOI: 10.1053/j.ro.2024.07.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 07/11/2024] [Accepted: 07/12/2024] [Indexed: 11/05/2024]
Affiliation(s)
- Arash Azhideh
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA
| | - Atefe Pooyan
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA
| | - Ehsan Alipour
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA
| | - Sara Haseli
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA
| | - Nastaran Hosseini
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA
| | - Majid Chalian
- Department of Radiology, Division of Muscluskeletal and Intervention, University of Washington, Seattle, WA.
| |
Collapse
|
4
|
Liu X, Liu Y, Lee ML, Hsu W, Liow MHL. Identifying who are unlikely to benefit from total knee arthroplasty using machine learning models. NPJ Digit Med 2024; 7:266. [PMID: 39349593 PMCID: PMC11442804 DOI: 10.1038/s41746-024-01265-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Accepted: 09/17/2024] [Indexed: 10/04/2024] Open
Abstract
Identifying and preventing patients who are not likely to benefit long-term from total knee arthroplasty (TKA) would decrease healthcare expenditure significantly. We trained machine learning (ML) models (image-only, clinical-data only, and multimodal) among 5720 knee OA patients to predict postoperative dissatisfaction at 2 years. Dissatisfaction was defined as not achieving a minimal clinically important difference in postoperative Knee Society knee and function scores (KSS), Short Form-36 Health Survey [SF-36, divided into a physical component score (PCS) and mental component score (MCS)], and Oxford Knee Score (OKS). Compared to image-only models, both clinical-data only and multimodal models achieved superior performance at predicting dissatisfaction measured by AUC, clinical-data only model: KSS 0.888 (0.866-0.909), SF-PCS 0.836 (0.812-0.860), SF-MCS 0.833 (0.812-0.854), and OKS 0.806 (0.753-0.859); multimodal model: KSS 0.891 (0.870-0.911), SF-PCS 0.832 (0.808-0.857), SF-MCS 0.835 (0.811-0.856), and OKS 0.816 (0.768-0.863). Our findings highlighted that ML models using clinical or multimodal data were capable to predict post-TKA dissatisfaction.
Collapse
Affiliation(s)
- Xiaodi Liu
- Institute of Data Science, National University of Singapore, Singapore, Singapore.
| | - Yingnan Liu
- Institute of Data Science, National University of Singapore, Singapore, Singapore
- School of Computing, National University of Singapore, Singapore, Singapore
| | - Mong Li Lee
- Institute of Data Science, National University of Singapore, Singapore, Singapore
- School of Computing, National University of Singapore, Singapore, Singapore
| | - Wynne Hsu
- Institute of Data Science, National University of Singapore, Singapore, Singapore
- School of Computing, National University of Singapore, Singapore, Singapore
| | | |
Collapse
|
5
|
Bayramoglu N, Englund M, Haugen IK, Ishijima M, Saarakkala S. Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data, and Symptomatic Assessments. Methods Inf Med 2024; 63:1-10. [PMID: 38604249 PMCID: PMC11495941 DOI: 10.1055/a-2305-2115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Accepted: 03/29/2024] [Indexed: 04/13/2024]
Abstract
OBJECTIVE In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of 7 years. MATERIAL AND METHODS This study included subjects (1,832 subjects, 3,276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a five-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, body mass index, and Western Ontario and McMaster Universities Arthritis Index score, and the radiographic osteoarthritis stage of the tibiofemoral joint (Kellgren and Lawrence [KL] score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data. RESULTS Among the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an area under the receiver operating characteristic curve (AUC) of 0.856 and average precision (AP) of 0.431, slightly outperforming the deep learning approach without attention (AUC = 0.832, AP = 0.4) and the best performing reference GBM model (AUC = 0.767, AP = 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP = 0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur. CONCLUSION This study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.
Collapse
Affiliation(s)
- Neslihan Bayramoglu
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
| | - Martin Englund
- Orthopaedics, Department of Clinical Sciences Lund Faculty of Medicine, Lund University, Lund, Sweden
| | - Ida K. Haugen
- Center for Treatment of Rheumatic and Musculoskeletal Diseases (REMEDY), Diakonhjemmet Hospital, Oslo, Norway
| | - Muneaki Ishijima
- Department of Orthopaedics, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Simo Saarakkala
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
- Department of Diagnostic Radiology, Oulu University Hospital, Oulu, Finland
| |
Collapse
|
6
|
Jiang T, Lau SH, Zhang J, Chan LC, Wang W, Chan PK, Cai J, Wen C. Radiomics signature of osteoarthritis: Current status and perspective. J Orthop Translat 2024; 45:100-106. [PMID: 38524869 PMCID: PMC10958157 DOI: 10.1016/j.jot.2023.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 10/05/2023] [Accepted: 10/10/2023] [Indexed: 03/26/2024] Open
Abstract
Osteoarthritis (OA) is one of the fast-growing disability-related diseases worldwide, which has significantly affected the quality of patients' lives and brings about substantial socioeconomic burdens in medical expenditure. There is currently no cure for OA once the bone damage is established. Unfortunately, the existing radiological examination is limited to grading the disease's severity and is insufficient to precisely diagnose OA, detect early OA or predict OA progression. Therefore, there is a pressing need to develop novel approaches in medical image analysis to detect subtle changes for identifying early OA development and rapid progressors. Recently, radiomics has emerged as a unique approach to extracting high-dimensional imaging features that quantitatively characterise visible or hidden information from routine medical images. Radiomics data mining via machine learning has empowered precise diagnoses and prognoses of disease, mainly in oncology. Mounting evidence has shown its great potential in aiding the diagnosis and contributing to the study of musculoskeletal diseases. This paper will summarise the current development of radiomics at the crossroads between engineering and medicine and discuss the application and perspectives of radiomics analysis for OA diagnosis and prognosis. The translational potential of this article Radiomics is a novel approach used in oncology, and it may also play an essential role in the diagnosis and prognosis of OA. By transforming medical images from qualitative interpretation to quantitative data, radiomics could be the solution for precise early OA detection, progression tracking, and treatment efficacy prediction. Since the application of radiomics in OA is still in the early stages and primarily focuses on fundamental studies, this review may inspire more explorations and bring more promising diagnoses, prognoses, and management results of OA.
Collapse
Affiliation(s)
- Tianshu Jiang
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Sing-Hin Lau
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, Faculty of Health and Social Sciences, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Lok-Chun Chan
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Wei Wang
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Ping-Keung Chan
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, The University of Hong Kong, Hong Kong SAR, China
| | - Jing Cai
- Department of Health Technology and Informatics, Faculty of Health and Social Sciences, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Chunyi Wen
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| |
Collapse
|
7
|
Mohammadi S, Salehi MA, Jahanshahi A, Shahrabi Farahani M, Zakavi SS, Behrouzieh S, Gouravani M, Guermazi A. Artificial intelligence in osteoarthritis detection: A systematic review and meta-analysis. Osteoarthritis Cartilage 2024; 32:241-253. [PMID: 37863421 DOI: 10.1016/j.joca.2023.09.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 08/11/2023] [Accepted: 09/27/2023] [Indexed: 10/22/2023]
Abstract
OBJECTIVES As an increasing number of studies apply artificial intelligence (AI) algorithms in osteoarthritis (OA) detection, we performed a systematic review and meta-analysis to pool the data on diagnostic performance metrics of AI, and to compare them with clinicians' performance. MATERIALS AND METHODS A search in PubMed and Scopus was performed to find studies published up to April 2022 that evaluated and/or validated an AI algorithm for the detection or classification of OA. We performed a meta-analysis to pool the data on the metrics of diagnostic performance. Subgroup analysis based on the involved joint and meta-regression based on multiple parameters were performed to find potential sources of heterogeneity. The risk of bias was assessed using Prediction Model Study Risk of Bias Assessment Tool reporting guidelines. RESULTS Of the 61 studies included, 27 studies with 91 contingency tables provided sufficient data to enter the meta-analysis. The pooled sensitivities for AI algorithms and clinicians on internal validation test sets were 88% (95% confidence interval [CI]: 86,91) and 80% (95% CI: 68,88) and pooled specificities were 81% (95% CI: 75,85) and 79% (95% CI: 80,85), respectively. At external validation, the pooled sensitivity and specificity for AI algorithms were 94% (95% CI: 90,97) and 91% (95% CI: 77,97), respectively. CONCLUSION Although the results of this meta-analysis should be interpreted with caution due to the potential pitfalls in the included studies, the promising role of AI as a diagnostic adjunct to radiologists is indisputable.
Collapse
Affiliation(s)
- Soheil Mohammadi
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.
| | | | - Ali Jahanshahi
- Faculty of Medicine, Guilan University of Medical Sciences, Rasht, Iran.
| | | | - Seyed Sina Zakavi
- Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran.
| | - Sadra Behrouzieh
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.
| | - Mahdi Gouravani
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.
| | - Ali Guermazi
- Department of Radiology, VA Boston Healthcare System, Boston University School of Medicine, Boston, MA, USA.
| |
Collapse
|
8
|
Kim HM, Ko T, Kang H, Choi S, Park JH, Chung MK, Kim M, Kim NY, Lee HJ. Improved prediction of clinical pregnancy using artificial intelligence with enhanced inner cell mass and trophectoderm images. Sci Rep 2024; 14:3240. [PMID: 38331914 PMCID: PMC10853203 DOI: 10.1038/s41598-024-52241-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Accepted: 01/16/2024] [Indexed: 02/10/2024] Open
Abstract
This study aimed to assess the performance of an artificial intelligence (AI) model for predicting clinical pregnancy using enhanced inner cell mass (ICM) and trophectoderm (TE) images. In this retrospective study, we included static images of 2555 day-5-blastocysts from seven in vitro fertilization centers in South Korea. The main outcome of the study was the predictive capability of the model to detect clinical pregnancies (gestational sac). Compared with the original embryo images, the use of enhanced ICM and TE images improved the average area under the receiver operating characteristic curve for the AI model from 0.716 to 0.741. Additionally, a gradient-weighted class activation mapping analysis demonstrated that the enhanced image-trained AI model was able to extract features from crucial areas of the embryo in 99% (506/512) of the cases. Particularly, it could extract the ICM and TE. In contrast, the AI model trained on the original images focused on the main areas in only 86% (438/512) of the cases. Our results highlight the potential efficacy of using ICM- and TE-enhanced embryo images when training AI models to predict clinical pregnancy.
Collapse
Affiliation(s)
| | - Taehoon Ko
- Department of Medical Informatics, College of Medicine, The Catholic University of Korea, Seoul, South Korea
- Department of Biomedicine & Health Sciences, College of Medicine, The Catholic University of Korea, Seoul, South Korea
- CMC Institute for Basic Medical Science, The Catholic Medical Center of The Catholic University of Korea, Seoul, South Korea
| | | | | | | | - Mi Kyung Chung
- Seoul Rachel Fertility Center, IVF Clinic, Seoul, South Korea
| | - Miran Kim
- Department of Obstetrics & Gynecology, Ajou University School of Medicine, Suwon, South Korea
| | | | | |
Collapse
|
9
|
Daneshmand M, Panfilov E, Bayramoglu N, Korhonen RK, Saarakkala S. Deep learning based detection of osteophytes in radiographs and magnetic resonance imagings of the knee using 2D and 3D morphology. J Orthop Res 2024. [PMID: 38323840 DOI: 10.1002/jor.25800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 10/26/2023] [Accepted: 01/19/2024] [Indexed: 02/08/2024]
Abstract
In this study, we investigated the discriminative capacity of knee morphology in automatic detection of osteophytes defined by the Osteoarthritis Research Society International atlas, using X-ray and magnetic resonance imaging (MRI) data. For the X-ray analysis, we developed a deep learning (DL) based model to segment femur and tibia. In case of MRIs, we utilized previously validated segmentations of femur, tibia, corresponding cartilage tissues, and menisci. Osteophyte detection was performed using DL models in four compartments: medial femur (FM), lateral femur (FL), medial tibia (TM), and lateral tibia (TL). To analyze the confounding effects of soft tissues, we investigated their morphology in combination with bones, including bones+cartilage, bones+menisci, and all the tissues. From X-ray-based 2D morphology, the models yielded balanced accuracy of 0.73, 0.69, 0.74, and 0.74 for FM, FL, TM, TL, respectively. Using 3D bone morphology from MRI, balanced accuracy was 0.80, 0.77, 0.71, and 0.76, respectively. The performance was higher than in 2D for all the compartments except for TM, with significant improvements observed for femoral compartments. Adding menisci or cartilage morphology consistently improved balanced accuracy in TM, with the greatest improvement seen for small osteophyte. Otherwise, the models performed similarly to bones-only. Our experiments demonstrated that MRI-based models show higher detection capability than X-ray based models for identifying knee osteophytes. This study highlighted the feasibility of automated osteophyte detection from X-ray and MRI data and suggested further need for development of osteophyte assessment criteria in addition to OARSI, particularly, for early osteophytic changes.
Collapse
Affiliation(s)
| | - Egor Panfilov
- Faculty of Medicine, University of Oulu, Oulu, Finland
| | | | | | - Simo Saarakkala
- University of Oulu and Oulu University Hospital, Oulu, Finland
| |
Collapse
|
10
|
Melekoodappattu JG, Kandambeth Puthiyapurayil C, Vylala A, Sahaya Dhas A. Brain cancer classification based on multistage ensemble generative adversarial network and convolutional neural network. Cell Biochem Funct 2023; 41:1357-1369. [PMID: 37822036 DOI: 10.1002/cbf.3870] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 08/14/2023] [Accepted: 10/03/2023] [Indexed: 10/13/2023]
Abstract
An advanced approach that capitalizes on the synergies between multimodal feature fusion and the dual-path network is presented in this manuscript. Our proposed methodology harnesses a combination of potent techniques, merging the benefits of nonlinear mapping and expansive perception. The foundation of our methodology lies in leveraging well-established pretrained models, namely EfficientNet-B7, ResNet-152, and a meticulously crafted custom convolutional neural network (CNN), to effectively extract salient features from the data. These models are combined in a two-stage ensemble approach. We employ maximum variance unfolding (MVU) to select the most relevant attributes from the extracted features. In this study, we propose a hybrid approach that integrates a generative adversarial network and Neural Autoregressive Distribution Estimation (NADE-K) with a CNN. The resulting two-stage ensemble hybrid CNN model achieves an accuracy of 99.63%. The implementation of the two-stage ensemble hybrid CNN with MVU demonstrates significant improvements in brain tumor classification.
Collapse
Affiliation(s)
| | | | - Anoop Vylala
- Department of Electronics and Communication Engineering, Jyothi Engineering College, Thrissur, Kerala, India
| | - Anto Sahaya Dhas
- Department of Electronics and Communication Engineering, Vimal Jyothi Engineering College, Kannur, Kerala, India
| |
Collapse
|
11
|
Demehri S, Kasaeian A, Roemer FW, Guermazi A. Osteoarthritis year in review 2022: imaging. Osteoarthritis Cartilage 2023; 31:1003-1011. [PMID: 36924919 DOI: 10.1016/j.joca.2023.03.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 02/17/2023] [Accepted: 03/08/2023] [Indexed: 03/18/2023]
Abstract
PURPOSE This narrative review summarizes original research focusing on imaging in osteoarthritis (OA) published between April 1st 2021 and March 31st 2022. We only considered English publications that were in vivo human studies. METHODS The PubMed, Medline, Embase, Scopus, and ISI Web of Science databases were searched for "Osteoarthritis/OA" studies based on the search terms: "Radiography", "Ultrasound/US", "Computed Tomography/CT", "DXA", "Magnetic Resonance Imaging/MRI", "Artificial Intelligence/AI", and "Deep Learning". This review highlights the anatomical focus of research on the structures within the tibiofemoral, patellofemoral, hip, and hand joints. There is also a noted focus on artificial intelligence applications in OA imaging. RESULTS Over the last decade, the increasing trend of using open-access large databases has reached a plateau (from 17 to 37). Compositional MRI has had the most prominent use in OA imaging and its biomarkers have been used in the detection of preclinical OA and prediction of OA outcomes. Most noteworthy, there has been an accelerated rate of publications on the implications of artificial intelligence, used in developing prediction models and performing trabecular texture analysis, in OA imaging (from 17 to 154). CONCLUSIONS While imaging has maintained its key role in OA research, publication trends have shown an emphasis on the integration of AI. During the past year, MRI has maintained the highest prevalence in usage while US and CT remain as readily available modalities. Finally, there has been a notable uptake in the development and validation of AI techniques used to perform texture analysis and predict OA progression.
Collapse
Affiliation(s)
- S Demehri
- Musculoskeletal Radiology, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | - A Kasaeian
- Musculoskeletal Radiology, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | - F W Roemer
- Department of Radiology, Boston University School of Medicine, Boston, MA, USA; Department of Radiology, Universitätsklinikum Erlangen & Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
| | - A Guermazi
- Department of Radiology, Boston University School of Medicine, Boston, MA, USA.
| |
Collapse
|
12
|
Cui T, Liu R, Jing Y, Fu J, Chen J. Development of machine learning models aiming at knee osteoarthritis diagnosing: an MRI radiomics analysis. J Orthop Surg Res 2023; 18:375. [PMID: 37210510 DOI: 10.1186/s13018-023-03837-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Accepted: 05/06/2023] [Indexed: 05/22/2023] Open
Abstract
BACKGROUND To develop and assess the performance of machine learning (ML) models based on magnetic resonance imaging (MRI) radiomics analysis for knee osteoarthritis (KOA) diagnosis. METHODS This retrospective study analysed 148 consecutive patients (72 with KOA and 76 without) with available MRI image data, where radiomics features in cartilage portions were extracted and then filtered. Intraclass correlation coefficient (ICC) was calculated to quantify the reproducibility of features, and a threshold of 0.8 was set. The training and validation cohorts consisted of 117 and 31 cases, respectively. Least absolute shrinkage and selection operator (LASSO) regression method was employed for feature selection. The ML classifiers were logistic regression (LR), K-nearest neighbour (KNN) and support vector machine (SVM). In each algorithm, ten models derived from all available planes of three joint compartments and their various combinations were, respectively, constructed for comparative analysis. The performance of classifiers was mainly evaluated and compared by receiver operating characteristic (ROC) analysis. RESULTS All models achieved satisfying performances, especially the Final model, where accuracy and area under ROC curve (AUC) of LR classifier were 0.968, 0.983 (0.957-1.000, 95% CI) in the validation cohort, and 0.940, 0.984 (0.969-0.995, 95% CI) in the training cohort, respectively. CONCLUSION The MRI radiomics analysis represented promising performance in noninvasive and preoperative KOA diagnosis, especially when considering all available planes of all three compartments of knee joints.
Collapse
Affiliation(s)
- Tingrun Cui
- Medical School of Chinese PLA, Beijing, China
- Department of Orthopaedics, The First Medical Centre of Chinese PLA General Hospital, Beijing, China
| | - Ruilong Liu
- Department of Bone and Joint Surgery, Jining No. 2 People's Hospital, Jining, Shandong, China
| | - Yang Jing
- Huiying Medical Technology Co. Ltd, Beijing, China
| | - Jun Fu
- Department of Orthopaedics, The First Medical Centre of Chinese PLA General Hospital, Beijing, China.
| | - Jiying Chen
- Department of Orthopaedics, The First Medical Centre of Chinese PLA General Hospital, Beijing, China.
| |
Collapse
|
13
|
Khalid A, Senan EM, Al-Wagih K, Ali Al-Azzam MM, Alkhraisha ZM. Hybrid Techniques of X-ray Analysis to Predict Knee Osteoarthritis Grades Based on Fusion Features of CNN and Handcrafted. Diagnostics (Basel) 2023; 13:diagnostics13091609. [PMID: 37175000 PMCID: PMC10178472 DOI: 10.3390/diagnostics13091609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 04/25/2023] [Accepted: 04/28/2023] [Indexed: 05/15/2023] Open
Abstract
Knee osteoarthritis (KOA) is a chronic disease that impedes movement, especially in the elderly, affecting more than 5% of people worldwide. KOA goes through many stages, from the mild grade that can be treated to the severe grade in which the knee must be replaced. Therefore, early diagnosis of KOA is essential to avoid its development to the advanced stages. X-rays are one of the vital techniques for the early detection of knee infections, which requires highly experienced doctors and radiologists to distinguish Kellgren-Lawrence (KL) grading. Thus, artificial intelligence techniques solve the shortcomings of manual diagnosis. This study developed three methodologies for the X-ray analysis of both the Osteoporosis Initiative (OAI) and Rani Channamma University (RCU) datasets for diagnosing KOA and discrimination between KL grades. In all methodologies, the Principal Component Analysis (PCA) algorithm was applied after the CNN models to delete the unimportant and redundant features and keep the essential features. The first methodology for analyzing x-rays and diagnosing the degree of knee inflammation uses the VGG-19 -FFNN and ResNet-101 -FFNN systems. The second methodology of X-ray analysis and diagnosis of KOA grade by Feed Forward Neural Network (FFNN) is based on the combined features of VGG-19 and ResNet-101 before and after PCA. The third methodology for X-ray analysis and diagnosis of KOA grade by FFNN is based on the fusion features of VGG-19 and handcrafted features, and fusion features of ResNet-101 and handcrafted features. For an OAI dataset with fusion features of VGG-19 and handcrafted features, FFNN obtained an AUC of 99.25%, an accuracy of 99.1%, a sensitivity of 98.81%, a specificity of 100%, and a precision of 98.24%. For the RCU dataset with the fusion features of VGG-19 and the handcrafted features, FFNN obtained an AUC of 99.07%, an accuracy of 98.20%, a sensitivity of 98.16%, a specificity of 99.73%, and a precision of 98.08%.
Collapse
Affiliation(s)
- Ahmed Khalid
- Computer Department, Applied College, Najran University, Najran 66462, Saudi Arabia
| | - Ebrahim Mohammed Senan
- Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, Alrazi University, Sana'a, Yemen
| | - Khalil Al-Wagih
- Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, Alrazi University, Sana'a, Yemen
| | | | | |
Collapse
|
14
|
Alshamrani HA, Rashid M, Alshamrani SS, Alshehri AHD. Osteo-NeT: An Automated System for Predicting Knee Osteoarthritis from X-ray Images Using Transfer-Learning-Based Neural Networks Approach. Healthcare (Basel) 2023; 11:healthcare11091206. [PMID: 37174748 PMCID: PMC10178688 DOI: 10.3390/healthcare11091206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 04/20/2023] [Accepted: 04/20/2023] [Indexed: 05/15/2023] Open
Abstract
Knee osteoarthritis is a challenging problem affecting many adults around the world. There are currently no medications that cure knee osteoarthritis. The only way to control the progression of knee osteoarthritis is early detection. Currently, X-ray imaging is a central technique used for the prediction of osteoarthritis. However, the manual X-ray technique is prone to errors due to the lack of expertise of radiologists. Recent studies have described the use of automated systems based on machine learning for the effective prediction of osteoarthritis from X-ray images. However, most of these techniques still need to achieve higher predictive accuracy to detect osteoarthritis at an early stage. This paper suggests a method with higher predictive accuracy that can be employed in the real world for the early detection of knee osteoarthritis. In this paper, we suggest the use of transfer learning models based on sequential convolutional neural networks (CNNs), Visual Geometry Group 16 (VGG-16), and Residual Neural Network 50 (ResNet-50) for the early detection of osteoarthritis from knee X-ray images. In our analysis, we found that all the suggested models achieved a higher level of predictive accuracy, greater than 90%, in detecting osteoarthritis. However, the best-performing model was the pretrained VGG-16 model, which achieved a training accuracy of 99% and a testing accuracy of 92%.
Collapse
Affiliation(s)
- Hassan A Alshamrani
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 11001, Saudi Arabia
| | - Mamoon Rashid
- Department of Computer Engineering, Faculty of Science and Technology, Vishwakarma University, Pune 411048, India
- Research Center of Excellence for Health Informatics, Vishwakarma University, Pune 411048, India
| | - Sultan S Alshamrani
- Department of Information Technology, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia
| | - Ali H D Alshehri
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 11001, Saudi Arabia
| |
Collapse
|
15
|
Farajzadeh N, Sadeghzadeh N, Hashemzadeh M. IJES-OA Net: A residual neural network to classify knee osteoarthritis from radiographic images based on the edges of the intra-joint spaces. Med Eng Phys 2023; 113:103957. [PMID: 36965998 DOI: 10.1016/j.medengphy.2023.103957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 09/30/2022] [Accepted: 02/09/2023] [Indexed: 02/12/2023]
Abstract
Among the musculoskeletal disorders in the world, osteoarthritis is the most common, affecting most of the body joints, especially the knee. Clinical radiographic imaging methods are commonly used to diagnose osteoarthritis thanks to their cheapness and availability. Due to the low quality and indiscernibility of these images, however, accurate osteoarthritis diagnosis has always faced inaccuracies, such as the wrong diagnosis. One of the osteoarthritis hallmarks is joint space narrowing. Thus, its degree and severity can be determined relatively by assessing the space between the bones in the joint. Therefore, in this research, a deep residual neural network, termed IJES-OA Net, is presented to automatically grade (classify) the severity of knee osteoarthritis via radiographs. This is achieved by tuning it in a way to have it focused on the distance of the edges of the bones inside the knee joint. Experimental results which are conducted on MOST (for training) and OAI (for validation and testing) datasets show that the IJES-OA Net achieves high average accuracy as well as average precision (80.23% and 0.802, respectively) while having less complexity compared to other methods. Additionally, the resulting attention maps from IJES-OA Net are accurate enough that increase experts' reliance on the provided results.
Collapse
Affiliation(s)
- Nacer Farajzadeh
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz, Iran; Artificial Intelligence and Machine Learning Research Laboratory, Azarbaijan Shahid Madani University, Tabriz, Iran.
| | - Nima Sadeghzadeh
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz, Iran; Artificial Intelligence and Machine Learning Research Laboratory, Azarbaijan Shahid Madani University, Tabriz, Iran
| | - Mahdi Hashemzadeh
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz, Iran; Artificial Intelligence and Machine Learning Research Laboratory, Azarbaijan Shahid Madani University, Tabriz, Iran
| |
Collapse
|
16
|
Zhang Q, Liang Y, Zhang Y, Tao Z, Li R, Bi H. A comparative study of attention mechanism based deep learning methods for bladder tumor segmentation. Int J Med Inform 2023; 171:104984. [PMID: 36634475 DOI: 10.1016/j.ijmedinf.2023.104984] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 12/17/2022] [Accepted: 01/01/2023] [Indexed: 01/07/2023]
Abstract
BACKGROUND Artificial intelligence aided tumor segmentation has been applied in various medical scenarios and showed effectiveness in helping physicians observe the potential malignant tissues. However, little research has been conducted for the cystoscopic image segmentation problem. METHODS This paper provided a comprehensive comparison of various attention modules for improving the bladder tumor segmentation performance by utilizing the cystoscopic images from Peking University Third Hospital within 2017-2022. Furthermore, this paper presented an attention mechanism based cystoscopic images segmentation (ACS) model, which was featured by the following points: (1) A mixed attention module including both the channel and spatial attention modules was integrated in the encoder-decoder path, which helped to exploit the global information of the tumor area more effectively. (2) A guidance and fusion attention module was introduced in the skip connection part, facilitating the integration of the high-level semantic features with low-level fine-grained features and the discarding of irrelevant features. (3) An inception attention module was added to enhance the feature expression in the scale of pixel level, so as to better discriminate multi-scale targets. RESULTS The proposed ACS model showed obviously better tumor segmentation performance than the compared models, with Dice of 82.7% and MIoU of 69% achieved. CONCLUSIONS The proposed ACS model achieved significantly better diagnostic performance than the previous bladder tumor segmentation method based on U-Net. Our ACS model is expected to be a useful support tool to assist the tumor segmentation under cystoscopy.
Collapse
Affiliation(s)
- Qi Zhang
- School of Information Technology & Management, University of International Business & Economics, Beijing 100029, China
| | - Yinglu Liang
- School of Information Technology & Management, University of International Business & Economics, Beijing 100029, China
| | - Yi Zhang
- School of Information Technology & Management, University of International Business & Economics, Beijing 100029, China
| | - Zihao Tao
- Department of Urology, Peking University Third Hospital, Beijing 100191, China
| | - Rui Li
- School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China.
| | - Hai Bi
- Department of Urology, Peking University Third Hospital, Beijing 100191, China.
| |
Collapse
|
17
|
Almhdie-Imjabbar A, Toumi H, Lespessailles E. Radiographic Biomarkers for Knee Osteoarthritis: A Narrative Review. Life (Basel) 2023; 13:237. [PMID: 36676185 PMCID: PMC9862057 DOI: 10.3390/life13010237] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 01/09/2023] [Accepted: 01/11/2023] [Indexed: 01/18/2023] Open
Abstract
Conventional radiography remains the most widely available imaging modality in clinical practice in knee osteoarthritis. Recent research has been carried out to develop novel radiographic biomarkers to establish the diagnosis and to monitor the progression of the disease. The growing number of publications on this topic over time highlights the necessity of a renewed review. Herein, we propose a narrative review of a selection of original full-text articles describing human studies on radiographic imaging biomarkers used for the prediction of knee osteoarthritis-related outcomes. To achieve this, a PubMed database search was used. A total of 24 studies were obtained and then classified based on three outcomes: (1) prediction of radiographic knee osteoarthritis incidence, (2) knee osteoarthritis progression and (3) knee arthroplasty risk. Results showed that numerous studies have reported the relevance of joint space narrowing score, Kellgren-Lawrence score and trabecular bone texture features as potential bioimaging markers in the prediction of the three outcomes. Performance results of reviewed prediction models were presented in terms of the area under the receiver operating characteristic curves. However, fair and valid comparisons of the models' performance were not possible due to the lack of a unique definition of each of the three outcomes.
Collapse
Affiliation(s)
- Ahmad Almhdie-Imjabbar
- Translational Medicine Research Platform, PRIMMO, University Hospital Centre of Orleans, 45100 Orleans, France
| | - Hechmi Toumi
- Translational Medicine Research Platform, PRIMMO, University Hospital Centre of Orleans, 45100 Orleans, France
- Department of Rheumatology, University Hospital Centre of Orleans, 45100 Orleans, France
| | - Eric Lespessailles
- Translational Medicine Research Platform, PRIMMO, University Hospital Centre of Orleans, 45100 Orleans, France
- Department of Rheumatology, University Hospital Centre of Orleans, 45100 Orleans, France
| |
Collapse
|
18
|
Xuan A, Chen H, Chen T, Li J, Lu S, Fan T, Zeng D, Wen Z, Ma J, Hunter D, Ding C, Zhu Z. The application of machine learning in early diagnosis of osteoarthritis: a narrative review. Ther Adv Musculoskelet Dis 2023; 15:1759720X231158198. [PMID: 36937823 PMCID: PMC10017946 DOI: 10.1177/1759720x231158198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Accepted: 02/01/2023] [Indexed: 03/16/2023] Open
Abstract
Osteoarthritis (OA) is the commonest musculoskeletal disease worldwide, with an increasing prevalence due to aging. It causes joint pain and disability, decreased quality of life, and a huge burden on healthcare services for society. However, the current main diagnostic methods are not suitable for early diagnosing patients of OA. The use of machine learning (ML) in OA diagnosis has increased dramatically in the past few years. Hence, in this review article, we describe the research progress in the application of ML in the early diagnosis of OA, discuss the current trends and limitations of ML approaches, and propose future research priorities to apply the tools in the field of OA. Accurate ML-based predictive models with imaging techniques that are sensitive to early changes in OA ahead of the emergence of clinical features are expected to address the current dilemma. The diagnostic ability of the fusion model that combines multidimensional information makes patient-specific early diagnosis and prognosis estimation of OA possible in the future.
Collapse
Affiliation(s)
| | | | - Tianyu Chen
- Clinical Research Centre, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Jia Li
- Division of Orthopaedic Surgery, Department of Orthopaedics, Nafang Hospital, Southern Medical University, Guangzhou, China
| | - Shilong Lu
- Department of Radiology, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Tianxiang Fan
- Clinical Research Centre, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Dong Zeng
- College of Automation Science and Engineering, South China University of Technology, Guangzhou, China
| | - Zhibo Wen
- Department of Radiology, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| | - David Hunter
- Clinical Research Centre, Zhujiang Hospital, Southern Medical University, Guangzhou, China
- Department of Rheumatology, Royal North Shore Hospital and Institute of Bone and Joint Research, Kolling Institute, University of Sydney, Sydney, NSW, Australia
| | | | | |
Collapse
|
19
|
Hayashi D, Roemer FW, Link T, Li X, Kogan F, Segal NA, Omoumi P, Guermazi A. Latest advancements in imaging techniques in OA. Ther Adv Musculoskelet Dis 2022; 14:1759720X221146621. [PMID: 36601087 PMCID: PMC9806406 DOI: 10.1177/1759720x221146621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Accepted: 12/05/2022] [Indexed: 12/28/2022] Open
Abstract
The osteoarthritis (OA) research community has been advocating a shift from radiography-based screening criteria and outcome measures in OA clinical trials to a magnetic resonance imaging (MRI)-based definition of eligibility and endpoint. For conventional morphological MRI, various semiquantitative evaluation tools are available. We have lately witnessed a remarkable technological advance in MRI techniques, including compositional/physiologic imaging and automated quantitative analyses of articular and periarticular structures. More recently, additional technologies were introduced, including positron emission tomography (PET)-MRI, weight-bearing computed tomography (CT), photon-counting spectral CT, shear wave elastography, contrast-enhanced ultrasound, multiscale X-ray phase contrast imaging, and spectroscopic photoacoustic imaging of cartilage. On top of these, we now live in an era in which artificial intelligence is increasingly utilized in medicine. Osteoarthritis imaging is no exception. Successful implementation of artificial intelligence (AI) will hopefully improve the workflow of radiologists, as well as the level of precision and reproducibility in the interpretation of images.
Collapse
Affiliation(s)
- Daichi Hayashi
- Department of Radiology, Renaissance School of Medicine at Stony Brook University, Stony Brook, NY, USA
- Department of Radiology, Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA
| | - Frank W. Roemer
- Department of Radiology, Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA
- Department of Radiology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Thomas Link
- Department of Radiology, University of California San Francisco, San Franciso, CA, USA
| | - Xiaojuan Li
- Department of Radiology, Cleveland Clinic Lerner College of Medicine, Cleveland, OH, USA
| | - Feliks Kogan
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Neil A. Segal
- Department of Rehabilitation Medicine, The University of Kansas, Kansas City, KS, USA
| | - Patrick Omoumi
- Department of Radiology, Lausanne University Hospital, University of Lausanne, Lausanne, Switzerland
| | - Ali Guermazi
- Department of Radiology, Chobanian & Avedisian School of Medicine, Boston University, Boston, MA 02132, USA
- Department of Radiology, VA Boston Healthcare System, U.S. Department of Veterans Affairs, West Roxbury, MA 02132, USA
| |
Collapse
|
20
|
Busnatu Ș, Niculescu AG, Bolocan A, Petrescu GED, Păduraru DN, Năstasă I, Lupușoru M, Geantă M, Andronic O, Grumezescu AM, Martins H. Clinical Applications of Artificial Intelligence-An Updated Overview. J Clin Med 2022; 11:jcm11082265. [PMID: 35456357 PMCID: PMC9031863 DOI: 10.3390/jcm11082265] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 04/09/2022] [Accepted: 04/14/2022] [Indexed: 12/16/2022] Open
Abstract
Artificial intelligence has the potential to revolutionize modern society in all its aspects. Encouraged by the variety and vast amount of data that can be gathered from patients (e.g., medical images, text, and electronic health records), researchers have recently increased their interest in developing AI solutions for clinical care. Moreover, a diverse repertoire of methods can be chosen towards creating performant models for use in medical applications, ranging from disease prediction, diagnosis, and prognosis to opting for the most appropriate treatment for an individual patient. In this respect, the present paper aims to review the advancements reported at the convergence of AI and clinical care. Thus, this work presents AI clinical applications in a comprehensive manner, discussing the recent literature studies classified according to medical specialties. In addition, the challenges and limitations hindering AI integration in the clinical setting are further pointed out.
Collapse
Affiliation(s)
- Ștefan Busnatu
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Adelina-Gabriela Niculescu
- Department of Science and Engineering of Oxide Materials and Nanomaterials, Faculty of Applied Chemistry and Materials Science, Politehnica University of Bucharest, 011061 Bucharest, Romania;
| | - Alexandra Bolocan
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - George E. D. Petrescu
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Dan Nicolae Păduraru
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Iulian Năstasă
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Mircea Lupușoru
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Marius Geantă
- Centre for Innovation in Medicine, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania;
| | - Octavian Andronic
- “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania; (Ș.B.); (A.B.); (G.E.D.P.); (D.N.P.); (I.N.); (M.L.); (O.A.)
| | - Alexandru Mihai Grumezescu
- Department of Science and Engineering of Oxide Materials and Nanomaterials, Faculty of Applied Chemistry and Materials Science, Politehnica University of Bucharest, 011061 Bucharest, Romania;
- Research Institute of the University of Bucharest—ICUB, University of Bucharest, 050657 Bucharest, Romania
- Academy of Romanian Scientists, Ilfov No. 3, 50044 Bucharest, Romania
- Correspondence:
| | - Henrique Martins
- Faculty of Health Sciences, Universidade da Beira Interior, 6200-506 Covilha, Portugal;
| |
Collapse
|
21
|
Teoh YX, Lai KW, Usman J, Goh SL, Mohafez H, Hasikin K, Qian P, Jiang Y, Zhang Y, Dhanalakshmi S. Discovering Knee Osteoarthritis Imaging Features for Diagnosis and Prognosis: Review of Manual Imaging Grading and Machine Learning Approaches. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:4138666. [PMID: 35222885 PMCID: PMC8881170 DOI: 10.1155/2022/4138666] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 01/24/2022] [Accepted: 01/26/2022] [Indexed: 12/30/2022]
Abstract
Knee osteoarthritis (OA) is a deliberating joint disorder characterized by cartilage loss that can be captured by imaging modalities and translated into imaging features. Observing imaging features is a well-known objective assessment for knee OA disorder. However, the variety of imaging features is rarely discussed. This study reviews knee OA imaging features with respect to different imaging modalities for traditional OA diagnosis and updates recent image-based machine learning approaches for knee OA diagnosis and prognosis. Although most studies recognized X-ray as standard imaging option for knee OA diagnosis, the imaging features are limited to bony changes and less sensitive to short-term OA changes. Researchers have recommended the usage of MRI to study the hidden OA-related radiomic features in soft tissues and bony structures. Furthermore, ultrasound imaging features should be explored to make it more feasible for point-of-care diagnosis. Traditional knee OA diagnosis mainly relies on manual interpretation of medical images based on the Kellgren-Lawrence (KL) grading scheme, but this approach is consistently prone to human resource and time constraints and less effective for OA prevention. Recent studies revealed the capability of machine learning approaches in automating knee OA diagnosis and prognosis, through three major tasks: knee joint localization (detection and segmentation), classification of OA severity, and prediction of disease progression. AI-aided diagnostic models improved the quality of knee OA diagnosis significantly in terms of time taken, reproducibility, and accuracy. Prognostic ability was demonstrated by several prediction models in terms of estimating possible OA onset, OA deterioration, progressive pain, progressive structural change, progressive structural change with pain, and time to total knee replacement (TKR) incidence. Despite research gaps, machine learning techniques still manifest huge potential to work on demanding tasks such as early knee OA detection and estimation of future disease events, as well as fundamental tasks such as discovering the new imaging features and establishment of novel OA status measure. Continuous machine learning model enhancement may favour the discovery of new OA treatment in future.
Collapse
Affiliation(s)
- Yun Xin Teoh
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Juliana Usman
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Siew Li Goh
- Faculty of Medicine, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Hamidreza Mohafez
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Pengjiang Qian
- School of Artificial Intelligence and Computer Sciences, Jiangnan University, Wuxi 214122, China
| | - Yizhang Jiang
- School of Artificial Intelligence and Computer Sciences, Jiangnan University, Wuxi 214122, China
| | - Yuanpeng Zhang
- Department of Medical Informatics of Medical (Nursing) School, Nantong University, Nantong 226001, China
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur 603203, India
| |
Collapse
|