Automated cartilage segmentation and quantification using 3D ultrashort echo time (UTE) cones MR imaging with deep convolutional neural networks

Visualizing Preosteoarthritis: Updates on UTE-Based Compositional MRI and Deep Learning Algorithms

Osteoarthritis (OA) is heterogeneous and involves structural changes in the whole joint, such as cartilage, meniscus/labrum, ligaments, and tendons, mainly with short T2 relaxation times. Detecting OA before the onset of irreversible changes is crucial for early proactive management and limit growing disease burden. The more recent advanced quantitative imaging techniques and deep learning (DL) algorithms in musculoskeletal imaging have shown great potential for visualizing "pre-OA." In this review, we first focus on ultrashort echo time-based magnetic resonance imaging (MRI) techniques for direct visualization as well as quantitative morphological and compositional assessment of both short- and long-T2 musculoskeletal tissues, and second explore how DL revolutionize the way of MRI analysis (eg, automatic tissue segmentation and extraction of quantitative image biomarkers) and the classification, prediction, and management of OA. PLAIN LANGUAGE SUMMARY: Detecting osteoarthritis (OA) before the onset of irreversible changes is crucial for early proactive management. OA is heterogeneous and involves structural changes in the whole joint, such as cartilage, meniscus/labrum, ligaments, and tendons, mainly with short T2 relaxation times. Ultrashort echo time-based magnetic resonance imaging (MRI), in particular, enables direct visualization and quantitative compositional assessment of short-T2 tissues. Deep learning is revolutionizing the way of MRI analysis (eg, automatic tissue segmentation and extraction of quantitative image biomarkers) and the detection, classification, and prediction of disease. They together have made further advances toward identification of imaging biomarkers/features for pre-OA. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 2.

Cartilage compositional MRI-a narrative review of technical development and clinical applications over the past three decades

Articular cartilage damage and degeneration are among hallmark manifestations of joint injuries and arthritis, classically osteoarthritis. Cartilage compositional MRI (Cart-C MRI), a quantitative technique, which aims to detect early-stage cartilage matrix changes that precede macroscopic alterations, began development in the 1990s. However, despite the significant advancements over the past three decades, Cart-C MRI remains predominantly a research tool, hindered by various technical and clinical hurdles. This paper will review the technical evolution of Cart-C MRI, delve into its clinical applications, and conclude by identifying the existing gaps and challenges that need to be addressed to enable even broader clinical application of Cart-C MRI.

A Comprehensive Review on MRI-based Knee Joint Segmentation and Analysis Techniques

Using magnetic resonance imaging (MRI) in osteoarthritis pathogenesis research has proven extremely beneficial. However, it is always challenging for both clinicians and researchers to detect morphological changes in knee joints from magnetic resonance (MR) imaging since the surrounding tissues produce identical signals in MR studies, making it difficult to distinguish between them. Segmenting the knee bone, articular cartilage and menisci from the MR images allows one to examine the complete volume of the bone, articular cartilage, and menisci. It can also be used to assess certain characteristics quantitatively. However, segmentation is a laborious and time-consuming operation that requires sufficient training to complete correctly. With the advancement of MRI technology and computational methods, researchers have developed several algorithms to automate the task of individual knee bone, articular cartilage and meniscus segmentation during the last two decades. This systematic review aims to present available fully and semi-automatic segmentation methods for knee bone, cartilage, and meniscus published in different scientific articles. This review provides a vivid description of the scientific advancements to clinicians and researchers in this field of image analysis and segmentation, which helps the development of novel automated methods for clinical applications. The review also contains the recently developed fully automated deep learning-based methods for segmentation, which not only provides better results compared to the conventional techniques but also open a new field of research in Medical Imaging.

Preoperative volume of the optic chiasm is an easily obtained predictor for visual recovery of pituitary adenoma patients following endoscopic endonasal transsphenoidal surgery: a cohort study

BACKGROUND

Predicting the postoperative visual outcome of pituitary adenoma patients is important but remains challenging. This study aimed to identify a novel prognostic predictor which can be automatically obtained from routine MRI using a deep learning approach.

MATERIALS AND METHODS

A total of 220 pituitary adenoma patients were prospectively enrolled and stratified into the recovery and nonrecovery groups according to the visual outcome at 6 months after endoscopic endonasal transsphenoidal surgery. The optic chiasm was manually segmented on preoperative coronal T2WI, and its morphometric parameters were measured, including suprasellar extension distance, chiasmal thickness, and chiasmal volume. Univariate and multivariate analyses were conducted on clinical and morphometric parameters to identify predictors for visual recovery. Additionally, a deep learning model for automated segmentation and volumetric measurement of optic chiasm was developed with nnU-Net architecture and evaluated in a multicenter data set covering 1026 pituitary adenoma patients from four institutions.

RESULTS

Larger preoperative chiasmal volume was significantly associated with better visual outcomes ( P =0.001). Multivariate logistic regression suggested it could be taken as the independent predictor for visual recovery (odds ratio=2.838, P <0.001). The auto-segmentation model represented good performances and generalizability in internal (Dice=0.813) and three independent external test sets (Dice=0.786, 0.818, and 0.808, respectively). Moreover, the model achieved accurate volumetric evaluation of the optic chiasm with an intraclass correlation coefficient of more than 0.83 in both internal and external test sets.

CONCLUSION

The preoperative volume of the optic chiasm could be utilized as the prognostic predictor for visual recovery of pituitary adenoma patients after surgery. Moreover, the proposed deep learning-based model allowed for automated segmentation and volumetric measurement of the optic chiasm on routine MRI.

Diagnostic Accuracy of 128-Slice Single-Source CT for the Detection of Dislocated Bucket Handle Meniscal Tears in the Setting of an Acute Knee Trauma—Correlation with MRI and Arthroscopy

(1) Background: Meniscal tears are amongst the most common knee injuries. Dislocated bucket handle meniscal tears in particular should receive early intervention. The purpose of this study was to evaluate the diagnostic performance of CT in detecting dislocated bucket handle meniscal tears compared with the gold-standard MRI and arthroscopy. (2) Methods: Retrospectively, 96 consecutive patients underwent clinically indicated CT of the knee for suspected acute traumatic knee injuries (standard study protocol, 120 kV, 90 mAs). Inclusion criteria were the absence of an acute fracture on CT and a timely MRI (<6 months). Corresponding arthroscopy was assessed. Two experienced musculoskeletal radiologists analyzed the images for dislocated bucket handle meniscal tears, associated signs thereof (double posterior cruciate ligament sign, double delta sign, disproportional posterior horn sign), and subjective diagnostic confidence on a 5-point-Likert scale (1 = ‘non-diagnostic image quality’, 5 = ‘very confident’). (3) Results: Dislocated bucket handle meniscal tears were detected on CT by standard three-plane bone kernel reconstructions with a sensitivity of 90.7% and a specificity of 99.3% by transferring the knowledge of established MRI signs. The additional use of soft-tissue kernel reconstructions in three planes increased the sensitivity by 4.0% to 94.7%, specificity to 100%, inter-rater agreement to 1.0, and the diagnostic confidence of both readers improved to a median 4/5 (‘confident’) in both readers. (4) Conclusions: Trauma CT scan of the knee with three-plane soft-tissue reconstructions delivers the potential for the detection of dislocated bucket handle meniscal tears with very high diagnostic accuracy.

Deep Learning-Based Medical Images Segmentation of Musculoskeletal Anatomical Structures: A Survey of Bottlenecks and Strategies

By leveraging the recent development of artificial intelligence algorithms, several medical sectors have benefited from using automatic segmentation tools from bioimaging to segment anatomical structures. Segmentation of the musculoskeletal system is key for studying alterations in anatomical tissue and supporting medical interventions. The clinical use of such tools requires an understanding of the proper method for interpreting data and evaluating their performance. The current systematic review aims to present the common bottlenecks for musculoskeletal structures analysis (e.g., small sample size, data inhomogeneity) and the related strategies utilized by different authors. A search was performed using the PUBMED database with the following keywords: deep learning, musculoskeletal system, segmentation. A total of 140 articles published up until February 2022 were obtained and analyzed according to the PRISMA framework in terms of anatomical structures, bioimaging techniques, pre/post-processing operations, training/validation/testing subset creation, network architecture, loss functions, performance indicators and so on. Several common trends emerged from this survey; however, the different methods need to be compared and discussed based on each specific case study (anatomical region, medical imaging acquisition setting, study population, etc.). These findings can be used to guide clinicians (as end users) to better understand the potential benefits and limitations of these tools.

Transformer-based multilevel region and edge aggregation network for magnetic resonance image segmentation

To improve the quality of magnetic resonance (MR) image edge segmentation, some researchers applied additional edge labels to train the network to extract edge information and aggregate it with region information. They have made significant progress. However, due to the intrinsic locality of convolution operations, the convolution neural network-based region and edge aggregation has limitations in modeling long-range information. To solve this problem, we proposed a novel transformer-based multilevel region and edge aggregation network for MR image segmentation. To the best of our knowledge, this is the first literature on transformer-based region and edge aggregation. We first extract multilevel region and edge features using a dual-branch module. Then, the region and edge features at different levels are inferred and aggregated through multiple transformer-based inference modules to form multilevel complementary features. Finally, the attention feature selection module aggregates these complementary features with the corresponding level region and edge features to decode the region and edge features. We evaluated our method on a public MR dataset: Medical image computation and computer-assisted intervention atrial segmentation challenge (ASC). Meanwhile, the private MR dataset considered infrapatellar fat pad (IPFP). Our method achieved a dice score of 93.2% for ASC and 91.9% for IPFP. Compared with other 2D segmentation methods, our method improved a dice score by 0.6% for ASC and 3.0% for IPFP.

Making the invisible visible-ultrashort echo time magnetic resonance imaging: Technical developments and applications

Magnetic resonance imaging (MRI) uses a large magnetic field and radio waves to generate images of tissues in the body. Conventional MRI techniques have been developed to image and quantify tissues and fluids with long transverse relaxation times (T2s), such as muscle, cartilage, liver, white matter, gray matter, spinal cord, and cerebrospinal fluid. However, the body also contains many tissues and tissue components such as the osteochondral junction, menisci, ligaments, tendons, bone, lung parenchyma, and myelin, which have short or ultrashort T2s. After radio frequency excitation, their transverse magnetizations typically decay to zero or near zero before the receiving mode is enabled for spatial encoding with conventional MR imaging. As a result, these tissues appear dark, and their MR properties are inaccessible. However, when ultrashort echo times (UTEs) are used, signals can be detected from these tissues before they decay to zero. This review summarizes recent technical developments in UTE MRI of tissues with short and ultrashort T2 relaxation times. A series of UTE MRI techniques for high-resolution morphological and quantitative imaging of these short-T2 tissues are discussed. Applications of UTE imaging in the musculoskeletal, nervous, respiratory, gastrointestinal, and cardiovascular systems of the body are included.

Performance and Robustness of Regional Image Segmentation Driven by Selected Evolutionary and Genetic Algorithms: Study on MR Articular Cartilage Images

The analysis and segmentation of articular cartilage magnetic resonance (MR) images belongs to one of the most commonly routine tasks in diagnostics of the musculoskeletal system of the knee area. Conventional regional segmentation methods, which are based either on the histogram partitioning (e.g., Otsu method) or clustering methods (e.g., K-means), have been frequently used for the task of regional segmentation. Such methods are well known as fast and well working in the environment, where cartilage image features are reliably recognizable. The well-known fact is that the performance of these methods is prone to the image noise and artefacts. In this context, regional segmentation strategies, driven by either genetic algorithms or selected evolutionary computing strategies, have the potential to overcome these traditional methods such as Otsu thresholding or K-means in the context of their performance. These optimization strategies consecutively generate a pyramid of a possible set of histogram thresholds, of which the quality is evaluated by using the fitness function based on Kapur's entropy maximization to find the most optimal combination of thresholds for articular cartilage segmentation. On the other hand, such optimization strategies are often computationally demanding, which is a limitation of using such methods for a stack of MR images. In this study, we publish a comprehensive analysis of the optimization methods based on fuzzy soft segmentation, driven by artificial bee colony (ABC), particle swarm optimization (PSO), Darwinian particle swarm optimization (DPSO), and a genetic algorithm for an optimal thresholding selection against the routine segmentations Otsu and K-means for analysis and the features extraction of articular cartilage from MR images. This study objectively analyzes the performance of the segmentation strategies upon variable noise with dynamic intensities to report a segmentation's robustness in various image conditions for a various number of segmentation classes (4, 7, and 10), cartilage features (area, perimeter, and skeleton) extraction preciseness against the routine segmentation strategies, and lastly the computing time, which represents an important factor of segmentation performance. We use the same settings on individual optimization strategies: 100 iterations and 50 population. This study suggests that the combination of fuzzy thresholding with an ABC algorithm gives the best performance in the comparison with other methods as from the view of the segmentation influence of additive dynamic noise influence, also for cartilage features extraction. On the other hand, using genetic algorithms for cartilage segmentation in some cases does not give a good performance. In most cases, the analyzed optimization strategies significantly overcome the routine segmentation methods except for the computing time, which is normally lower for the routine algorithms. We also publish statistical tests of significance, showing differences in the performance of individual optimization strategies against Otsu and K-means method. Lastly, as a part of this study, we publish a software environment, integrating all the methods from this study.

Multiresolution Aggregation Transformer UNet Based on Multiscale Input and Coordinate Attention for Medical Image Segmentation

The latest medical image segmentation methods uses UNet and transformer structures with great success. Multiscale feature fusion is one of the important factors affecting the accuracy of medical image segmentation. Existing transformer-based UNet methods do not comprehensively explore multiscale feature fusion, and there is still much room for improvement. In this paper, we propose a novel multiresolution aggregation transformer UNet (MRA-TUNet) based on multiscale input and coordinate attention for medical image segmentation. It realizes multiresolution aggregation from the following two aspects: (1) On the input side, a multiresolution aggregation module is used to fuse the input image information of different resolutions, which enhances the input features of the network. (2) On the output side, an output feature selection module is used to fuse the output information of different scales to better extract coarse-grained information and fine-grained information. We try to introduce a coordinate attention structure for the first time to further improve the segmentation performance. We compare with state-of-the-art medical image segmentation methods on the automated cardiac diagnosis challenge and the 2018 atrial segmentation challenge. Our method achieved average dice score of 0.911 for right ventricle (RV), 0.890 for myocardium (Myo), 0.961 for left ventricle (LV), and 0.923 for left atrium (LA). The experimental results on two datasets show that our method outperforms eight state-of-the-art medical image segmentation methods in dice score, precision, and recall.

Articular Cartilage Assessment Using Ultrashort Echo Time MRI: A Review

Articular cartilage is a major component of the human knee joint which may be affected by a variety of degenerative mechanisms associated with joint pathologies and/or the aging process. Ultrashort echo time (UTE) sequences with a TE less than 100 µs are capable of detecting signals from both fast- and slow-relaxing water protons in cartilage. This allows comprehensive evaluation of all the cartilage layers, especially for the short T₂ layers which include the deep and calcified zones. Several ultrashort echo time (UTE) techniques have recently been developed for both morphological imaging and quantitative cartilage assessment. This review article summarizes the current catalog techniques based on UTE Magnetic Resonance Imaging (MRI) that have been utilized for such purposes in the human knee joint, such as T₁, T2∗ , T_1ρ, magnetization transfer (MT), double echo steady state (DESS), quantitative susceptibility mapping (QSM) and inversion recovery (IR). The contrast mechanisms as well as the advantages and disadvantages of these techniques are discussed.

Ultrashort Echo Time Magnetic Resonance Imaging Techniques: Met and Unmet Needs in Musculoskeletal Imaging

This review article summarizes recent technical developments in ultrashort echo time (UTE) magnetic resonance imaging of musculoskeletal (MSK) tissues with short-T2 relaxation times. A series of contrast mechanisms are discussed for high-contrast morphological imaging of short-T2 MSK tissues including the osteochondral junction, menisci, ligaments, tendons, and bone. Quantitative UTE mapping of T1, T2*, T1ρ, adiabatic T1ρ, magnetization transfer ratio, MT modeling of macromolecular proton fraction, quantitative susceptibility mapping, and water content is also introduced. Met and unmet needs in MSK imaging are discussed. EVIDENCE LEVEL: 1 TECHNICAL EFFICACY: Stage 3.