Automatic knee cartilage segmentation from multi-contrast MR images using support vector machine classification with spatial dependencies

Revealing Detailed Cartilage Function Through Nanoparticle Diffusion Imaging: A Computed Tomography & Finite Element Study

The ability of articular cartilage to withstand significant mechanical stresses during activities, such as walking or running, relies on its distinctive structure. Integrating detailed tissue properties into subject-specific biomechanical models is challenging due to the complexity of analyzing these characteristics. This limitation compromises the accuracy of models in replicating cartilage function and impacts predictive capabilities. To address this, methods revealing cartilage function at the constituent-specific level are essential. In this study, we demonstrated that computational modeling derived individual constituent-specific biomechanical properties could be predicted by a novel nanoparticle contrast-enhanced computer tomography (CECT) method. We imaged articular cartilage samples collected from the equine stifle joint (n = 60) using contrast-enhanced micro-computed tomography (µCECT) to determine contrast agents' intake within the samples, and compared those to cartilage functional properties, derived from a fibril-reinforced poroelastic finite element model. Two distinct imaging techniques were investigated: conventional energy-integrating µCECT employing a cationic tantalum oxide nanoparticle (Ta2O5-cNP) contrast agent and novel photon-counting µCECT utilizing a dual-contrast agent, comprising Ta2O5-cNP and neutral iodixanol. The results demonstrate the capacity to evaluate fibrillar and non-fibrillar functionality of cartilage, along with permeability-affected fluid flow in cartilage. This finding indicates the feasibility of incorporating these specific functional properties into biomechanical computational models, holding potential for personalized approaches to cartilage diagnostics and treatment.

Dense Multi-Scale Graph Convolutional Network for Knee Joint Cartilage Segmentation

In this paper, we propose a dense multi-scale adaptive graph convolutional network (DMA-GCN) method for automatic segmentation of the knee joint cartilage from MR images. Under the multi-atlas setting, the suggested approach exhibits several novelties, as described in the following. First, our models integrate both local-level and global-level learning simultaneously. The local learning task aggregates spatial contextual information from aligned spatial neighborhoods of nodes, at multiple scales, while global learning explores pairwise affinities between nodes, located globally at different positions in the image. We propose two different structures of building models, whereby the local and global convolutional units are combined by following an alternating or a sequential manner. Secondly, based on the previous models, we develop the DMA-GCN network, by utilizing a densely connected architecture with residual skip connections. This is a deeper GCN structure, expanded over different block layers, thus being capable of providing more expressive node feature representations. Third, all units pertaining to the overall network are equipped with their individual adaptive graph learning mechanism, which allows the graph structures to be automatically learned during training. The proposed cartilage segmentation method is evaluated on the entire publicly available Osteoarthritis Initiative (OAI) cohort. To this end, we have devised a thorough experimental setup, with the goal of investigating the effect of several factors of our approach on the classification rates. Furthermore, we present exhaustive comparative results, considering traditional existing methods, six deep learning segmentation methods, and seven graph-based convolution methods, including the currently most representative models from this field. The obtained results demonstrate that the DMA-GCN outperforms all competing methods across all evaluation measures, providing DSC=95.71% and DSC=94.02% for the segmentation of femoral and tibial cartilage, respectively.

A Comprehensive Review on MRI-based Knee Joint Segmentation and Analysis Techniques

Using magnetic resonance imaging (MRI) in osteoarthritis pathogenesis research has proven extremely beneficial. However, it is always challenging for both clinicians and researchers to detect morphological changes in knee joints from magnetic resonance (MR) imaging since the surrounding tissues produce identical signals in MR studies, making it difficult to distinguish between them. Segmenting the knee bone, articular cartilage and menisci from the MR images allows one to examine the complete volume of the bone, articular cartilage, and menisci. It can also be used to assess certain characteristics quantitatively. However, segmentation is a laborious and time-consuming operation that requires sufficient training to complete correctly. With the advancement of MRI technology and computational methods, researchers have developed several algorithms to automate the task of individual knee bone, articular cartilage and meniscus segmentation during the last two decades. This systematic review aims to present available fully and semi-automatic segmentation methods for knee bone, cartilage, and meniscus published in different scientific articles. This review provides a vivid description of the scientific advancements to clinicians and researchers in this field of image analysis and segmentation, which helps the development of novel automated methods for clinical applications. The review also contains the recently developed fully automated deep learning-based methods for segmentation, which not only provides better results compared to the conventional techniques but also open a new field of research in Medical Imaging.

Magnetic resonance imaging assessments for knee segmentation and their use in combination with machine/deep learning as predictors of early osteoarthritis diagnosis and prognosis

Knee osteoarthritis (OA) is a prevalent and disabling disease that can develop over decades. This disease is heterogeneous and involves structural changes in the whole joint, encompassing multiple tissue types. Detecting OA before the onset of irreversible changes is crucial for early management, and this could be achieved by allowing knee tissue visualization and quantifying their changes over time. Although some imaging modalities are available for knee structure assessment, magnetic resonance imaging (MRI) is preferred. This narrative review looks at existing literature, first on MRI-developed approaches for evaluating knee articular tissues, and second on prediction using machine/deep-learning-based methodologies and MRI as input or outcome for early OA diagnosis and prognosis. A substantial number of MRI methodologies have been developed to assess several knee tissues in a semi-quantitative and quantitative fashion using manual, semi-automated and fully automated systems. This dynamic field has grown substantially since the advent of machine/deep learning. Another active area is predictive modelling using machine/deep-learning methodologies enabling robust early OA diagnosis/prognosis. Moreover, incorporating MRI markers as input/outcome in such predictive models is important for a more accurate OA structural diagnosis/prognosis. The main limitation of their usage is the ability to move them in rheumatology practice. In conclusion, MRI knee tissue determination and quantification provide early indicators for individuals at high risk of developing this disease or for patient prognosis. Such assessment of knee tissues, combined with the development of models/tools from machine/deep learning using, in addition to other parameters, MRI markers for early diagnosis/prognosis, will maximize opportunities for individualized risk assessment for use in clinical practice permitting precision medicine. Future efforts should be made to integrate such prediction models into open access, allowing early disease management to prevent or delay the OA outcome.

A novel multi-atlas segmentation approach under the semi-supervised learning framework: Application to knee cartilage segmentation

BACKGROUND AND OBJECTIVE

Multi-atlas based segmentation techniques, which rely on an atlas library comprised of training images labeled by an expert, have proven their effectiveness in multiple automatic segmentation applications. However, the usage of exhaustive patch libraries combined with the voxel-wise labeling incur a large computational cost in terms of memory requirements and execution times.

METHODS

To confront this shortcoming, we propose a novel two-stage multi-atlas approach designed under the Semi-Supervised Learning (SSL) framework. The main properties of our method are as follows: First, instead of the voxel-wise labeling approach, the labeling of target voxels is accomplished here by exploiting the spectral content of globally sampled datasets from the target image, along with their spatially correspondent data collected from the atlases. Following SSL, voxels classification is boosted by incorporating unlabeled data from the target image, in addition to the labeled ones from atlas library. Our scheme integrates constructively fruitful concepts, including sparse reconstructions of voxels from linear neighborhoods, HOG feature descriptors of patches/regions, and label propagation via sparse graph constructions. Segmentation of the target image is carried out in two stages: stage-1 focuses on the sampling and labeling of global data, while stage-2 undertakes the above tasks for the out-of-sample data. Finally, we propose different graph-based methods for the labeling of global data, while these methods are extended to deal with the out-of-sample voxels.

RESULTS

A thorough experimental investigation is conducted on 76 subjects provided by the publicly accessible Osteoarthritis Initiative (OAI) repository. Comparative results and statistical analysis demonstrate that the suggested methodology exhibits superior segmentation performance compared to the existing patch-based methods, across all evaluation metrics (DSC:88.89%, Precision: 89.86%, Recall: 88.12%), while at the same time it requires a considerably reduced computational load (>70% reduction on average execution time with respect to other patch-based). In addition, our approach is favorably compared against other non patch-based and deep learning methods in terms of performance accuracy (on the 3-class problem). A final experimentation on a 5-class setting of the problems demonstrates that our approach is capable of achieving performance comparable to existing state-of-the-art knee cartilage segmentation methods (DSC:88.22% and DSC:85.84% for femoral and tibial cartilage respectively).

Knee Bone and Cartilage Segmentation Based on a 3D Deep Neural Network Using Adversarial Loss for Prior Shape Constraint

Fast and accurate segmentation of knee bone and cartilage on MRI images is becoming increasingly important in the orthopaedic area, as the segmentation is an essential prerequisite step to a patient-specific diagnosis, optimising implant design and preoperative and intraoperative planning. However, manual segmentation is time-intensive and subjected to inter- and intra-observer variations. Hence, in this study, a three-dimensional (3D) deep neural network using adversarial loss was proposed to automatically segment the knee bone in a resampled image volume in order to enlarge the contextual information and incorporate prior shape constraints. A restoration network was proposed to further improve the bone segmentation accuracy by restoring the bone segmentation back to the original resolution. A conventional U-Net-like network was used to segment the cartilage. The ultimate results were the combination of the bone and cartilage outcomes through post-processing. The quality of the proposed method was thoroughly assessed using various measures for the dataset from the Grand Challenge Segmentation of Knee Images 2010 (SKI10), together with a comparison with a baseline network U-Net. A fine-tuned U-Net-like network can achieve state-of-the-art results without any post-processing operations. This method achieved a total score higher than 76 in terms of the SKI10 validation dataset. This method showed to be robust to extract bone and cartilage masks from the MRI dataset, even for the pathological case.

A Comprehensive Survey on Bone Segmentation Techniques in Knee Osteoarthritis Research: From Conventional Methods to Deep Learning

Knee osteoarthritis (KOA) is a degenerative joint disease, which significantly affects middle-aged and elderly people. The majority of KOA is primarily based on hyaline cartilage change, according to medical images. However, technical bottlenecks such as noise, artifacts, and modality pose enormous challenges for an objective and efficient early diagnosis. Therefore, the correct prediction of arthritis is an essential step for effective diagnosis and the prevention of acute arthritis, where early diagnosis and treatment can assist to reduce the progression of KOA. However, predicting the development of KOA is a difficult and urgent problem that, if addressed, could accelerate the development of disease-modifying drugs, in turn helping to avoid millions of total joint replacement procedures each year. In knee joint research and clinical practice there are segmentation approaches that play a significant role in KOA diagnosis and categorization. In this paper, we seek to give an in-depth understanding of a wide range of the most recent methodologies for knee articular bone segmentation; segmentation methods allow the estimation of articular cartilage loss rate, which is utilized in clinical practice for assessing the disease progression and morphological change, ranging from traditional techniques to deep learning (DL)-based techniques. Moreover, the purpose of this work is to give researchers a general review of the currently available methodologies in the area. Therefore, it will help researchers who want to conduct research in the field of KOA, as well as highlight deficiencies and potential considerations in application in clinical practice. Finally, we highlight the diagnostic value of deep learning for future computer-aided diagnostic applications to complete this review.

Intelligent Diagnosis Method for New Diseases Based on Fuzzy SVM Incremental Learning

The diagnosis of new diseases is a challenging problem. In the early stage of the emergence of new diseases, there are few case samples; this may lead to the low accuracy of intelligent diagnosis. Because of the advantages of support vector machine (SVM) in dealing with small sample problems, it is selected for the intelligent diagnosis method. The standard SVM diagnosis model updating needs to retrain all samples. It costs huge storage and calculation costs and is difficult to adapt to the changing reality. In order to solve this problem, this paper proposes a new disease diagnosis method based on Fuzzy SVM incremental learning. According to SVM theory, the support vector set and boundary sample set related to the SVM diagnosis model are extracted. Only these sample sets are considered in incremental learning to ensure the accuracy and reduce the cost of calculation and storage. To reduce the impact of noise points caused by the reduction of training samples, FSVM is used to update the diagnosis model, and the generalization is improved. The simulation results on the banana dataset show that the proposed method can improve the classification accuracy from 86.4% to 90.4%. Finally, the method is applied in COVID-19's diagnostic. The diagnostic accuracy reaches 98.2% as the traditional SVM only gets 84%. With the increase of the number of case samples, the model is updated. When the training samples increase to 400, the number of samples participating in training is only 77; the amount of calculation of the updated model is small.

The QIBA Profile for MRI-based Compositional Imaging of Knee Cartilage

MRI-based cartilage compositional analysis shows biochemical and microstructural changes at early stages of osteoarthritis before changes become visible with structural MRI sequences and arthroscopy. This could help with early diagnosis, risk assessment, and treatment monitoring of osteoarthritis. Spin-lattice relaxation time constant in rotating frame (T1ρ) and T2 mapping are the MRI techniques best established for assessing cartilage composition. Only T2 mapping is currently commercially available, which is sensitive to water, collagen content, and orientation of collagen fibers, whereas T1ρ is more sensitive to proteoglycan content. Clinical application of cartilage compositional imaging is limited by high variability and suboptimal reproducibility of the biomarkers, which was the motivation for creating the Quantitative Imaging Biomarkers Alliance (QIBA) Profile for cartilage compositional imaging by the Musculoskeletal Biomarkers Committee of the QIBA. The profile aims at providing recommendations to improve reproducibility and to standardize cartilage compositional imaging. The QIBA Profile provides two complementary claims (summary statements of the technical performance of the quantitative imaging biomarkers that are being profiled) regarding the reproducibility of biomarkers. First, cartilage T1ρ and T2 values are measurable at 3.0-T MRI with a within-subject coefficient of variation of 4%-5%. Second, a measured increase or decrease in T1ρ and T2 of 14% or more indicates a minimum detectable change with 95% confidence. If only an increase in T1ρ and T2 values is expected (progressive cartilage degeneration), then an increase of 12% represents a minimum detectable change over time. The QIBA Profile provides recommendations for clinical researchers, clinicians, and industry scientists pertaining to image data acquisition, analysis, and interpretation and assessment procedures for T1ρ and T2 cartilage imaging and test-retest conformance. This special report aims to provide the rationale for the proposed claims, explain the content of the QIBA Profile, and highlight the future needs and developments for MRI-based cartilage compositional imaging for risk prediction, early diagnosis, and treatment monitoring of osteoarthritis.

Discrete-MultiResUNet: Segmentation and feature extraction model for knee MR images

Deep learning has shown outstanding efficiency in medical image segmentation. Segmentation of knee tissues is an important task for early diagnosis of rheumatoid arthritis (RA) with selecting variant features. Automated segmentation and feature extraction of knee tissues are desirable for faster and reliable analysis of large datasets and further diagnosis. In this paper a novel architecture called as Discrete-MultiResUNet, which is a combination of discrete wavelet transform (DWT) with MultiResUNet architecture is applied for feature extraction and segmentation, respectively. This hybrid architecture captures more prominent features from the knee magnetic resonance image efficiently with segmenting vital knee tissues. The hybrid model is evaluated on the knee MR dataset demonstrating outperforming performance compared with baseline models. The model achieves excellent segmentation performance accuracy of 96.77% with a dice coefficient of 98%.

Rapid CT-based Estimation of Articular Cartilage Biomechanics in the Knee Joint Without Cartilage Segmentation

Knee osteoarthritis (OA) is a painful joint disease, causing disabilities in daily activities. However, there is no known cure for OA, and the best treatment strategy might be prevention. Finite element (FE) modeling has demonstrated potential for evaluating personalized risks for the progression of OA. Current FE modeling approaches use primarily magnetic resonance imaging (MRI) to construct personalized knee joint models. However, MRI is expensive and has lower resolution than computed tomography (CT). In this study, we extend a previously presented atlas-based FE modeling framework for automatic model generation and simulation of knee joint tissue responses using contrast agent-free CT. In this method, based on certain anatomical dimensions measured from bone surfaces, an optimal template is selected and scaled to generate a personalized FE model. We compared the simulated tissue responses of the CT-based models with those of the MRI-based models. We show that the CT-based models are capable of producing similar tensile stresses, fibril strains, and fluid pressures of knee joint cartilage compared to those of the MRI-based models. This study provides a new methodology for the analysis of knee joint and cartilage mechanics based on measurement of bone dimensions from native CT scans.

Classification, Categorization, and Algorithms for Articular Cartilage Defects

There is a critical unmet need in the clinical implementation of valid preventative and therapeutic strategies for patients with articular cartilage pathology based on the significant gap in understanding of the relationships between diagnostic data, disease progression, patient-related variables, and symptoms. In this article, the current state of classification and categorization for articular cartilage pathology is discussed with particular focus on machine learning methods and the authors propose a bedside-bench-bedside approach with highly quantitative techniques as a solution to these hurdles. Leveraging computational learning with available data toward articular cartilage pathology patient phenotyping holds promise for clinical research and will likely be an important tool to identify translational solutions into evidence-based clinical applications to benefit patients. Recommendations for successful implementation of these approaches include using standardized definitions of articular cartilage, to include characterization of depth, size, location, and number; using measurements that minimize subjectivity or validated patient-reported outcome measures; considering not just the articular cartilage pathology but the whole joint, and the patient perception and perspective. Application of this approach through a multistep process by a multidisciplinary team of clinicians and scientists holds promise for validating disease mechanism-based phenotypes toward clinically relevant understanding of articular cartilage pathology for evidence-based application to orthopaedic practice.

Clinical Utility of Advanced Imaging of the Knee

Advanced imaging modalities, including computed tomography, magnetic resonance imaging (MRI), and dynamic fluoroscopic imaging, allow for a comprehensive evaluation of the knee joint. Compositional sequences for MRI can allow for an evaluation of the biochemical properties of cartilage, meniscus, and ligament that offer further insight into pathology that may not be apparent on conventional clinical imaging. Advances in image processing, shape modeling, and dynamic studies also offer a novel way to evaluate common conditions and to monitor patients after treatment. The purpose of this article is to review advanced imaging modalities of the knee and their current and anticipated future applications to clinical practice. © 2019 Orthopaedic Research Society. Published by Wiley Periodicals, Inc. J Orthop Res 38:473-482, 2020.

Quantification in Musculoskeletal Imaging Using Computational Analysis and Machine Learning: Segmentation and Radiomics

Although still limited in clinical practice, quantitative analysis is expected to increase the value of musculoskeletal (MSK) imaging. Segmentation aims at isolating the tissues and/or regions of interest in the image and is crucial to the extraction of quantitative features such as size, signal intensity, or image texture. These features may serve to support the diagnosis and monitoring of disease. Radiomics refers to the process of extracting large amounts of features from radiologic images and combining them with clinical, biological, genetic, or any other type of complementary data to build diagnostic, prognostic, or predictive models. The advent of machine learning offers promising prospects for automatic segmentation and integration of large amounts of data. We present commonly used segmentation methods and describe the radiomics pipeline, highlighting the challenges to overcome for adoption in clinical practice. We provide some examples of applications from the MSK literature.

pyKNEEr: An image analysis workflow for open and reproducible research on femoral knee cartilage

Transparent research in musculoskeletal imaging is fundamental to reliably investigate diseases such as knee osteoarthritis (OA), a chronic disease impairing femoral knee cartilage. To study cartilage degeneration, researchers have developed algorithms to segment femoral knee cartilage from magnetic resonance (MR) images and to measure cartilage morphology and relaxometry. The majority of these algorithms are not publicly available or require advanced programming skills to be compiled and run. However, to accelerate discoveries and findings, it is crucial to have open and reproducible workflows. We present pyKNEEr, a framework for open and reproducible research on femoral knee cartilage from MR images. pyKNEEr is written in python, uses Jupyter notebook as a user interface, and is available on GitHub with a GNU GPLv3 license. It is composed of three modules: 1) image preprocessing to standardize spatial and intensity characteristics; 2) femoral knee cartilage segmentation for intersubject, multimodal, and longitudinal acquisitions; and 3) analysis of cartilage morphology and relaxometry. Each module contains one or more Jupyter notebooks with narrative, code, visualizations, and dependencies to reproduce computational environments. pyKNEEr facilitates transparent image-based research of femoral knee cartilage because of its ease of installation and use, and its versatility for publication and sharing among researchers. Finally, due to its modular structure, pyKNEEr favors code extension and algorithm comparison. We tested our reproducible workflows with experiments that also constitute an example of transparent research with pyKNEEr, and we compared pyKNEEr performances to existing algorithms in literature review visualizations. We provide links to executed notebooks and executable environments for immediate reproducibility of our findings.

Fully automated patellofemoral MRI segmentation using holistically nested networks: Implications for evaluating patellofemoral osteoarthritis, pain, injury, pathology, and adolescent development

PURPOSE

Our clinical understanding of the relationship between 3D bone morphology and knee osteoarthritis, as well as our ability to investigate potential causative factors of osteoarthritis, has been hampered by the time-intensive nature of manually segmenting bone from MR images. Thus, we aim to develop and validate a fully automated deep learning framework for segmenting the patella and distal femur cortex, in both adults and actively growing adolescents.

METHODS

Data from 93 subjects, obtained from on institutional review board-approved protocol, formed the study database. 3D sagittal gradient recalled echo and gradient recalled echo with fat saturation images and manual models of the outer cortex were available for 86 femurs and 90 patellae. A deep-learning-based 2D holistically nested network (HNN) architecture was developed to automatically segment the patella and distal femur using both single (sagittal, uniplanar) and 3 cardinal plane (triplanar) methodologies. Errors in the surface-to-surface distances and the Dice coefficient were the primary measures used to quantitatively evaluate segmentation accuracy using a 9-fold cross-validation.

RESULTS

Average absolute errors for segmenting both the patella and femur were 0.33 mm. The Dice coefficients were 97% and 94% for the femur and patella. The uniplanar, relative to the triplanar, methodology produced slightly superior segmentation. Neither the presence of active growth plates nor pathology influenced segmentation accuracy.

CONCLUSION

The proposed HNN with multi-feature architecture provides a fully automatic technique capable of delineating the often indistinct interfaces between the bone and other joint structures with an accuracy better than nearly all other techniques presented previously, even when active growth plates are present.

Magnetic Resonance Imaging Evaluation of Cartilage Repair and Iron Particle Kinetics After Magnetic Delivery of Stem Cells

IMPACT STATEMENT

This study is very important as a preclinical study of magnetic resonance imaging (MRI) assessment after magnetic targeting of mesenchymal stem cells. The findings of this study show that MRI is useful for evaluating the regenerative process of cartilage with magnetic targeting and kinetics of iron particles, and is less invasive without any complications.

Method for Segmentation of Knee Articular Cartilages Based on Contrast-Enhanced CT Images

Segmentation of contrast-enhanced computed tomography (CECT) images enables quantitative evaluation of morphology of articular cartilage as well as the significance of the lesions. Unfortunately, automatic segmentation methods for CECT images are currently lacking. Here, we introduce a semiautomated technique to segment articular cartilage from in vivo CECT images of human knee. The segmented cartilage geometries of nine knee joints, imaged using a clinical CT-scanner with an intra-articular contrast agent, were compared with manual segmentations from CT and magnetic resonance (MR) images. The Dice similarity coefficients (DSCs) between semiautomatic and manual CT segmentations were 0.79-0.83 and sensitivity and specificity values were also high (0.76-0.86). When comparing semiautomatic and manual CT segmentations, mean cartilage thicknesses agreed well (intraclass correlation coefficient = 0.85-0.93); the difference in thickness (mean ± SD) was 0.27 ± 0.03 mm. Differences in DSC, when MR segmentations were compared with manual and semiautomated CT segmentations, were statistically insignificant. Similarly, differences in volume were not statistically significant between manual and semiautomatic CT segmentations. Semiautomation decreased the segmentation time from 450 ± 190 to 42 ± 10 min per joint. The results reveal that the proposed technique is fast and reliable for segmentation of cartilage. Importantly, this is the first study presenting semiautomated segmentation of cartilage from CECT images of human knee joint with minimal user interaction.

Use of 2D U-Net Convolutional Neural Networks for Automated Cartilage and Meniscus Segmentation of Knee MR Imaging Data to Determine Relaxometry and Morphometry

Purpose To analyze how automatic segmentation translates in accuracy and precision to morphology and relaxometry compared with manual segmentation and increases the speed and accuracy of the work flow that uses quantitative magnetic resonance (MR) imaging to study knee degenerative diseases such as osteoarthritis (OA). Materials and Methods This retrospective study involved the analysis of 638 MR imaging volumes from two data cohorts acquired at 3.0 T: (a) spoiled gradient-recalled acquisition in the steady state T1ρ-weighted images and (b) three-dimensional (3D) double-echo steady-state (DESS) images. A deep learning model based on the U-Net convolutional network architecture was developed to perform automatic segmentation. Cartilage and meniscus compartments were manually segmented by skilled technicians and radiologists for comparison. Performance of the automatic segmentation was evaluated on Dice coefficient overlap with the manual segmentation, as well as by the automatic segmentations' ability to quantify, in a longitudinally repeatable way, relaxometry and morphology. Results The models produced strong Dice coefficients, particularly for 3D-DESS images, ranging between 0.770 and 0.878 in the cartilage compartments to 0.809 and 0.753 for the lateral meniscus and medial meniscus, respectively. The models averaged 5 seconds to generate the automatic segmentations. Average correlations between manual and automatic quantification of T1ρ and T2 values were 0.8233 and 0.8603, respectively, and 0.9349 and 0.9384 for volume and thickness, respectively. Longitudinal precision of the automatic method was comparable with that of the manual one. Conclusion U-Net demonstrates efficacy and precision in quickly generating accurate segmentations that can be used to extract relaxation times and morphologic characterization and values that can be used in the monitoring and diagnosis of OA. © RSNA, 2018 Online supplemental material is available for this article.

Machine Learning in Orthopedics: A Literature Review

In this paper we present the findings of a systematic literature review covering the articles published in the last two decades in which the authors described the application of a machine learning technique and method to an orthopedic problem or purpose. By searching both in the Scopus and Medline databases, we retrieved, screened and analyzed the content of 70 journal articles, and coded these resources following an iterative method within a Grounded Theory approach. We report the survey findings by outlining the articles' content in terms of the main machine learning techniques mentioned therein, the orthopedic application domains, the source data and the quality of their predictive performance.

Learning-Based Cost Functions for 3-D and 4-D Multi-Surface Multi-Object Segmentation of Knee MRI: Data From the Osteoarthritis Initiative

A fully automated knee magnetic resonance imaging (MRI) segmentation method to study osteoarthritis (OA) was developed using a novel hierarchical set of random forests (RF) classifiers to learn the appearance of cartilage regions and their boundaries. A neighborhood approximation forest is used first to provide contextual feature to the second-level RF classifier that also considers local features and produces location-specific costs for the layered optimal graph image segmentation of multiple objects and surfaces (LOGISMOS) framework. Double-echo steady state MRIs used in this paper originated from the OA Initiative study. Trained on 34 MRIs with varying degrees of OA, the performance of the learning-based method tested on 108 MRIs showed significant reduction in segmentation errors ( ) compared with the conventional gradient-based and single-stage RF-learned costs. The 3-D LOGISMOS was extended to longitudinal-3-D (4-D) to simultaneously segment multiple follow-up visits of the same patient. As such, data from all time-points of the temporal sequence contribute information to a single optimal solution that utilizes both spatial 3-D and temporal contexts. 4-D LOGISMOS validation on 108 MRIs from baseline, and 12 month follow-up scans of 54 patients showed significant reduction in segmentation errors ( ) compared with 3-D. Finally, the potential of 4-D LOGISMOS was further explored on the same 54 patients using five annual follow-up scans demonstrating a significant improvement of measuring cartilage thickness ( ) compared with the sequential 3-D approach.

Pressure ulcer image segmentation technique through synthetic frequencies generation and contrast variation using toroidal geometry

Background

Pressure ulcers have become subject of study in recent years due to the treatment high costs and decreased life quality from patients. These chronic wounds are related to the global life expectancy increment, being the geriatric and physical disable patients the principal affected by this condition. Injuries diagnosis and treatment usually takes weeks or even months by medical personel. Using non-invasive techniques, such as image processing techniques, it is possible to conduct an analysis from ulcers and aid in its diagnosis.

Methods

This paper proposes a novel technique for image segmentation based on contrast changes by using synthetic frequencies obtained from the grayscale value available in each pixel of the image. These synthetic frequencies are calculated using the model of energy density over an electric field to describe a relation between a constant density and the image amplitude in a pixel. A toroidal geometry is used to decompose the image into different contrast levels by variating the synthetic frequencies. Then, the decomposed image is binarized applying Otsu’s threshold allowing for obtaining the contours that describe the contrast variations. Morphological operations are used to obtain the desired segment of the image.

Results

The proposed technique is evaluated by synthesizing a Data Base with 51 images of pressure ulcers, provided by the Centre IGURCO. With the segmentation of these pressure ulcer images it is possible to aid in its diagnosis and treatment. To provide evidences of technique performance, digital image correlation was used as a measure, where the segments obtained using the methodology are compared with the real segments. The proposed technique is compared with two benchmarked algorithms. The results over the technique present an average correlation of 0.89 with a variation of ±0.1 and a computational time of 9.04 seconds.

Conclusions

The methodology presents better segmentation results than the benchmarked algorithms using less computational time and without the need of an initial condition.

Segmentation of joint and musculoskeletal tissue in the study of arthritis

As the most frequent cause of physical disability, musculoskeletal diseases such as arthritis and osteoporosis have a great social and economical impact. Quantitative magnetic resonance imaging (MRI) biomarkers are important tools that allow clinicians to better characterize, monitor, and even predict musculoskeletal disease progression. Post-processing pipelines often include image segmentation. Manually identifying the border of the region of interest (ROI) is a difficult and time-consuming task. Manual segmentation is also affected by inter- and intrauser variability, thus limiting standardization. Fully automatic or semi-automatic methods that minimize the user interaction are highly desirable. Unfortunately, an ultimate, highly reliable and extensively evaluated solution for joint and musculoskeletal tissue segmentation has not yet been proposed, and many clinical studies still adopt fully manual procedures. Moreover, the clinical translation of several promising quantitative MRI techniques is highly affected by the lack of an established, fast, and accurate segmentation method. The goal of this review is to present some of the techniques proposed in recent literature that have been adopted in clinical studies for joint and musculoskeletal tissue analyses in arthritis patients. The most widely used MRI sequences and image processing algorithms employed to accomplish segmentation challenges will be discussed in this paper.

Automatic segmentation of cartilage in high-field magnetic resonance images of the knee joint with an improved voxel-classification-driven region-growing algorithm using vicinity-correlated subsampling

Anatomical structures that can deteriorate over time, such as cartilage, can be successfully delineated with voxel-classification approaches in magnetic resonance (MR) images. However, segmentation via voxel-classification is a computationally demanding process for high-field MR images with high spatial resolutions. In this study, the whole femoral, tibial, and patellar cartilage compartments in the knee joint were automatically segmented in high-field MR images obtained from Osteoarthritis Initiative using a voxel-classification-driven region-growing algorithm with sample-expand method. Computational complexity of the classification was alleviated via subsampling of the background voxels in the training MR images and selecting a small subset of significant features by taking into consideration systems with limited memory and processing power. Although subsampling of the voxels may lead to a loss of generality of the training models and a decrease in segmentation accuracies, effective subsampling strategies can overcome these problems. Therefore, different subsampling techniques, which involve uniform, Gaussian, vicinity-correlated (VC) sparse, and VC dense subsampling, were used to generate four training models. The segmentation system was experimented using 10 training and 23 testing MR images, and the effects of different training models on segmentation accuracies were investigated. Experimental results showed that the highest mean Dice similarity coefficient (DSC) values for all compartments were obtained when the training models of VC sparse subsampling technique were used. Mean DSC values optimized with this technique were 82.6%, 83.1%, and 72.6% for femoral, tibial, and patellar cartilage compartments, respectively, when mean sensitivities were 79.9%, 84.0%, and 71.5%, and mean specificities were 99.8%, 99.9%, and 99.9%.

Shape-based acetabular cartilage segmentation: application to CT and MRI datasets

PURPOSE

A new method for acetabular cartilage segmentation in both computed tomography (CT) arthrography and magnetic resonance imaging (MRI) datasets with leg tension is developed and tested.

METHODS

The new segmentation method is based on the combination of shape and intensity information. Shape information is acquired according to the predictable nonlinear relationship between the U-shaped acetabulum region and acetabular cartilage. Intensity information is obtained from the acetabular cartilage region automatically to complete the segmentation procedures. This method is evaluated using 54 CT arthrography datasets with two different radiation doses and 20 MRI datasets. Additionally, the performance of this method in identifying acetabular cartilage is compared with four other acetabular cartilage segmentation methods.

RESULTS

This method performed better than the comparison methods. Indeed, this method maintained good accuracy level for 74 datasets independent of the cartilage modality and with minimum user interaction in the bone segmentation procedures. In addition, this method was efficient in noisy conditions and in detection of the damaged cartilages with zero thickness, which confirmed its potential clinical usefulness.

CONCLUSIONS

Our new method proposes acetabular cartilage segmentation in three different datasets based on the combination of the shape and intensity information. This method executes well in situations where there are clear boundaries between the acetabular and femoral cartilages. However, the acetabular cartilage and pelvic bone information should be obtained from one dataset such as CT arthrography or MRI datasets with leg traction.

Automatic segmentation of high- and low-field knee MRIs using knee image quantification with data from the osteoarthritis initiative

Clinical studies including thousands of magnetic resonance imaging (MRI) scans offer potential for pathogenesis research in osteoarthritis. However, comprehensive quantification of all bone, cartilage, and meniscus compartments is challenging. We propose a segmentation framework for fully automatic segmentation of knee MRI. The framework combines multiatlas rigid registration with voxel classification and was trained on manual segmentations with varying configurations of bones, cartilages, and menisci. The validation included high- and low-field knee MRI cohorts from the Center for Clinical and Basic Research, the osteoarthritis initiative (QAI), and the segmentation of knee images10 (SKI10) challenge. In total, 1907 knee MRIs were segmented during the evaluation. No segmentations were excluded. Our resulting OAI cartilage volume scores are available upon request. The precision and accuracy performances matched manual reader re-segmentation well. The cartilage volume scan-rescan precision was 4.9% (RMS CV). The Dice volume overlaps in the medial/lateral tibial/femoral cartilage compartments were 0.80 to 0.87. The correlations with volumes from independent methods were between 0.90 and 0.96 on the OAI scans. Thus, the framework demonstrated precision and accuracy comparable to manual segmentations. Finally, our method placed second for cartilage segmentation in the SKI10 challenge. The comprehensive validation suggested that automatic segmentation is appropriate for cohorts with thousands of scans.

Utility of T2 mapping and dGEMRIC for evaluation of cartilage repair after allograft chondrocyte implantation in a rabbit model

OBJECTIVE

To investigate the effectiveness of quantitative Magnetic resonance imaging (MRI) for evaluating the quality of cartilage repair over time following allograft chondrocyte implantation using a three-dimensional scaffold for osteochondral lesions.

DESIGN

Thirty knees from 15 rabbits were analyzed. An osteochondral defect (diameter, 4 mm; depth, 1 mm) was created on the patellar groove of the femur in both legs. The defects were filled with a chondrocyte-seeded scaffold in the right knee and an empty scaffold in the left knee. Five rabbits each were euthanized at 4, 8, and 12 weeks and their knees were examined via macroscopic inspection, histological and biochemical analysis, and quantitative MRI (T2 mapping and dGEMRIC) to assess the state of tissue repair following allograft chondrocyte implantation with a three-dimensional scaffold for osteochondral lesions.

RESULTS

Comparatively good regenerative cartilage was observed both macroscopically and histologically. In both chondrocyte-seeded and control knees, the T2 values of repair tissues were highest at 4 weeks and showed a tendency to decrease with time. ΔR1 values of dGEMRIC also tended to decrease with time in both groups, and the mean ΔR1 was significantly lower in the CS-scaffold group than in the control group at all time points. ΔR1 = 1/r (R1post - R1pre), where r is the relaxivity of Gd-DTPA(2-), R1 = 1/T1 (longitudinal relaxation time).

CONCLUSION

T2 mapping and dGEMRIC were both effective for evaluating tissue repair after allograft chondrocyte implantation. ΔR1 values of dGEMRIC represented good correlation with histologically and biochemically even at early stages after the implantation.

Acetabular cartilage segmentation in CT arthrography based on a bone-normalized probabilistic atlas

PURPOSE

Determination of acetabular cartilage loss in the hip joint is a clinically significant metric that requires image segmentation. A new semiautomatic method to segment acetabular cartilage in computed tomography (CT) arthrography scans was developed and tested.

METHODS

A semiautomatic segmentation method was developed based on the combination of anatomical and statistical information. Anatomical information is identified using the pelvic bone position and the contact area between cartilage and bone. Statistical information is acquired from CT intensity modeling of acetabular cartilage and adjacent tissue structures. This method was applied to the identification of acetabular cartilages in 37 intra-articular CT arthrography scans.

RESULTS

The semiautomatic anatomical-statistical method performed better than other segmentation methods. The semiautomatic method was effective in noisy scans and was able to detect damaged cartilage.

CONCLUSIONS

The new semiautomatic method segments acetabular cartilage by fully utilizing the statistical and anatomical information in CT arthrography datasets. This method for hip joint cartilage segmentation has potential for use in many clinical applications.