Reliability and Accuracy of MRI in Orthopedics: A Survey of Its Use and Perceived Limitations

Reliability of glenoid measurements performed using Multiplanar Reconstruction (MPR) of Magnetic Resonance (MRI) in patients with shoulder instability

PURPOSE

Measurement of glenoid bone loss in the shoulder instability can be assessed by CT or MRI multiplanar imaging and is crucial for pre-operative planning. The aim of this study is to determine the intra and interobserver reliability of glenoid deficiency measurement using MRI multiplanar reconstruction with 2D assessment in the sagittal plane (MPR MRI).

METHODS

We reviewed MRI images of 80 patients with anterior shoulder instability with Osirix software using MPR. Six observers with basic experience measured the glenoid, erosion edge length, and bone loss twice, with at least one-week interval between measurements. We calculated reliability and repeatability using the intra-class correlation coefficient (ICC) and minimal detectable change with 95% confidence (MDC95%).

RESULTS

Intra and Inter-observer ICC and MDC95% for glenoid width and height were excellent (ICC 0,89-0,96). For erosion edge length and area of the glenoid were acceptable/good (ICC 0,61-0,89). Bone loss and Pico Index were associated with acceptable/good ICC (0,63 -0,86)) but poor MDC95% (45 - 84 %). Intra-observer reliability improved with time, while inter-observer remained unchanged.

CONCLUSION

The MPR MRI measurement of the anterior glenoid lesion is very good tool for linear parameters. This method is not valid for Pico index measurement, as the area of bone loss is variable. The pace of learning is individual, therefore complex calculations based on MPR MRI are not resistant to low experience as opposed to true 3D CT.

Shoulder MRI parameters in anticipating anterior shoulder dislocation: Are they a reliable and reproducible tool in clinical practice?

BACKGROUND

Anterior shoulder dislocation (ASD) is a frequently observed musculoskeletal injury that is often encountered in the context of sports activities or as a result of trauma. Several magnetic resonance imaging (MRI) parameters have been previously investigated for the purpose of characterizing the anatomical features, which could potentially be responsible for the episodes of instability. These measurements have the potential to identify patients who are susceptible to dislocation. Consequently, ensuring the reliability and consistency of these measurements is crucial in the diagnosis and the management of athletic or traumatic shoulder injuries.

METHODS

A group of four students, who had no previous experience in reading MRI series, were selected to perform radiographic measurements on specific parameters of MRI scans. These parameters were glenoid version, glenoid depth, glenoid width, humeral head diameter, humeral containing angle, and the ratio of humeral head diameter to glenoid diameter. The four participants conducted two distinct readings on a total of 28 sets of shoulder MRI scans. Simultaneously, the aforementioned measures were assessed by a consultant shoulder surgeon.

RESULTS

A total of 1512 measurements were categorized into nine sets: eight from students' measurements (two per student) and one from the consultant. Intra-rater reliability assessed by the intra-class correlation (ICC) test indicated excellent or good reliability for all parameters (p < 0.05), with glenoid depth showing the highest (0.925) and humeral-containing angles the lowest (0.675) ICC value. Inter-rater correlation, also evaluated using ICC, demonstrated strong correlation (p < 0.05), with glenoid diameter having the highest ICC score (0.935) and glenoid depth the lowest (0.849). Agreement analysis, expressed by Cohen's Kappa test, revealed substantial agreement (p < 0.05) for all parameters, with humeral head diameter having the highest agreement (0.90) and humeral-containing angle the lowest (0.73).

CONCLUSION

In this study, intra- and inter-rater MRI parameters are substantially concordant. Credibility comes from these reliability and agreement analyses' statistical significance. Glenoid diameter and depth are the most reliable intrarater and interrater, respectively. Best agreement was with the humeral-containing angle. These data demonstrate repeatability and clinical relevance.

LEVEL OF EVIDENCE

Level IV.

Artificial intelligence applied to magnetic resonance imaging reliably detects the presence, but not the location, of meniscus tears: a systematic review and meta-analysis

OBJECTIVES

To review and compare the accuracy of convolutional neural networks (CNN) for the diagnosis of meniscal tears in the current literature and analyze the decision-making processes utilized by these CNN algorithms.

MATERIALS AND METHODS

PubMed, MEDLINE, EMBASE, and Cochrane databases up to December 2022 were searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) statement. Risk of analysis was used for all identified articles. Predictive performance values, including sensitivity and specificity, were extracted for quantitative analysis. The meta-analysis was divided between AI prediction models identifying the presence of meniscus tears and the location of meniscus tears.

RESULTS

Eleven articles were included in the final review, with a total of 13,467 patients and 57,551 images. Heterogeneity was statistically significantly large for the sensitivity of the tear identification analysis (I2 = 79%). A higher level of accuracy was observed in identifying the presence of a meniscal tear over locating tears in specific regions of the meniscus (AUC, 0.939 vs 0.905). Pooled sensitivity and specificity were 0.87 (95% confidence interval (CI) 0.80-0.91) and 0.89 (95% CI 0.83-0.93) for meniscus tear identification and 0.88 (95% CI 0.82-0.91) and 0.84 (95% CI 0.81-0.85) for locating the tears.

CONCLUSIONS

AI prediction models achieved favorable performance in the diagnosis, but not location, of meniscus tears. Further studies on the clinical utilities of deep learning should include standardized reporting, external validation, and full reports of the predictive performances of these models, with a view to localizing tears more accurately.

CLINICAL RELEVANCE STATEMENT

Meniscus tears are hard to diagnose in the knee magnetic resonance images. AI prediction models may play an important role in improving the diagnostic accuracy of clinicians and radiologists.

KEY POINTS

• Artificial intelligence (AI) provides great potential in improving the diagnosis of meniscus tears. • The pooled diagnostic performance for artificial intelligence (AI) in identifying meniscus tears was better (sensitivity 87%, specificity 89%) than locating the tears (sensitivity 88%, specificity 84%). • AI is good at confirming the diagnosis of meniscus tears, but future work is required to guide the management of the disease.

In-office needle arthroscopy is a cost-effective alternative for operating room diversion in medial meniscectomy: a financial analysis

BACKGROUND

In-office needle arthroscopy (IONA) has been described as a diagnostic alternative to magnetic resonance imaging (MRI) for intra-articular pathology. However, few studies have analyzed its impact on cost and wait times when used as a therapeutic intervention. The purpose of this study was to investigate the impact on cost and wait times associated with offering IONA for partial medial meniscectomy as an alternative to traditional operating room (OR) arthroscopy for patients with irreparable medial meniscus tears on MRI.

METHODS

Two models were created comparing the existing care pathway (current state) to a proposed future state utilizing IONA. Data sources were accounting data from an academically affiliated hospital in Canada and supplemented with literature values. A Monte Carlo simulation combined with DuPont analysis running 10,000 simulations was conducted to calculate the revenue, expenses, profits, and effect on surgical waitlists (i.e., throughput) between the states. Sensitivity analyses examined the influence of patient preference and revision rates on profit and throughput. Two-sample Student's t test was performed (p < .05).

RESULTS

An average of 198 (standard deviation (SD) 31) patients underwent arthroscopic meniscectomy or repair each year from 2016 to 2020. The IONA revision rate was calculated as 20.3%. Compared to the current state, annual expenses in the IONA pathway were significantly reduced ($266,912.68 versus $281,415.23, p < .0001), while improving throughput by 21.2% (3.54%). Sensitivity analysis revealed 10% of patients need to select IONA over traditional OR arthroscopy with the revision rate remaining below 40% for the proposed state profit to be higher than the current state.

CONCLUSIONS

IONA is a cost-effective alternative to traditional OR arthroscopy in patients undergoing partial medial meniscectomy. The next steps are to assess patients' perceptions of IONA as an alternative to traditional OR arthroscopy, and to carry out clinical trials to determine the efficacy, patient-reported outcome metrics, and complications of IONA.

Evaluation of Osteochondral Allograft Transplant Using In-Office Needle Arthroscopy

In-office needle arthroscopy (IONA) has been available in various iterations for decades. Studies have described it as comparable if not superior to magnetic resonance imaging for identifying intra-articular pathology with associated cost savings per patient. A new IONA system has been brought to market with a modernized user interface and disposable handpieces offering the opportunity to address intra-articular pathology. This article outlines the use of this IONA system for the postoperative evaluation of an osteochondral allograft transplant.

Utilization of MRI in surgical decision making in the shoulder

Background

The aim of this study is to evaluate both the utility of MRI scans and reports used in the current practice routine of shoulder surgeons and their surgical decision-making process.

Methods

Ninety-three shoulder-specialised orthopaedic surgeons of the Canadian Shoulder and Elbow Society (CSES) Orthopaedic Association were surveyed in 2020 anonymously online to help identify the use of MR-imaging and reports in managing shoulder disorders and surgical decision process.

Results

Thirty out of 93 (32.25%) CSES fellowship-trained orthopaedic surgeons participated. Respondents request MRI scans in about 55% of rotator cuff (RC) pathology and 48% of shoulder instability cases. Fifty percent of patients with potential RC pathology arrive with a completed MRI scan prior first orthopaedic consult. Their surgical decision is primarily based on patient history (45–55%) and physical examination (23–42%) followed by MRI scan review (2.6–18%), reading MRI reports (0–1.6%) or viewing other imaging (3–23%) depending on the shoulder disease. Ninety percent of surgeons would not decide on surgery in ambiguous cases unless the MR-images were personally reviewed. Respondents stated that shoulder MRI scans are ordered too frequently prior specialist visit as identified in more than 50% of cases depending on pathology.

Conclusions

The decision-making process for shoulder surgery depends on the underlying pathology and patient history. The results demonstrate that orthopaedic surgeons are comfortable reviewing shoulder MRI scans without necessarily reading the MRI report prior to a surgical decision. MRI scans are becoming an increasingly important part of surgical management in shoulder pathologies but should not be used without assessment of patient history and or physical examination.

Overview of Methods to Quantify Invasiveness of Surgical Approaches in Orthopedic Surgery—A Scoping Review

Background

There is a trend toward minimally invasive and more automated procedures in orthopedic surgery. An important aspect in the further development of these techniques is the quantitative assessment of the surgical approach. The aim of this scoping review is to deliver a structured overview on the currently used methods for quantitative analysis of a surgical approaches' invasiveness in orthopedic procedures. The compiled metrics presented in the herein study can serve as the basis for digitization of surgery and advanced computational methods that focus on optimizing surgical procedures.

Methods

We performed a blinded literature search in November 2020. In-vivo and ex-vivo studies that quantitatively assess the invasiveness of the surgical approach were included with a special focus on radiological methods. We excluded studies using exclusively one or multiple of the following parameters: risk of reoperation, risk of dislocation, risk of infection, risk of patient-reported nerve injury, rate of thromboembolic event, function, length of stay, blood loss, pain, operation time.

Results

The final selection included 51 articles. In the included papers, approaches to 8 different anatomical structures were investigated, the majority of which examined procedures of the hip (57%) and the spine (29%). The different modalities to measure the invasiveness were categorized into three major groups “biological” (23 papers), “radiological” (25), “measured in-situ” (14) and their use “in-vivo” or “ex-vivo” was analyzed. Additionally, we explain the basic principles of each modality and match it to the anatomical structures it has been used on.

Discussion

An ideal metric used to quantify the invasiveness of a surgical approach should be accurate, cost-effective, non-invasive, comprehensive and integratable into the clinical workflow. We find that the radiological methods best meet such criteria. However, radiological metrics can be more prone to confounders such as coexisting pathologies than in-situ measurements but are non-invasive and possible to perform in-vivo. Additionally, radiological metrics require substantial expertise and are not cost-effective. Owed to their high accuracy and low invasiveness, radiological methods are, in our opinion, the best suited for computational applications optimizing surgical procedures. The key to quantify a surgical approach's invasiveness lies in the integration of multiple metrics.

Diagnostic accuracy of point-of-care knee ultrasound for evaluation of meniscus and collateral ligaments pathology in comparison with MRI

BACKGROUND

Although magnetic resonance imaging (MRI) is often the "gold standard" for diagnosing knee problems, it has many limitations. Therefore, ultrasonography has been suggested as an effective rapid alternative in many knee abnormalities, especially after injuries of the meniscus and collateral ligaments.

PURPOSE

To determine the diagnostic accuracy of point-of-care ultrasound (POCUS) in detecting injuries of the meniscus and collateral ligament compared to MRI.

MATERIAL AND METHODS

An observational cross-sectional blinded study was conducted of 60 patients with clinically suspicious meniscus and collateral ligament injuries who were planned for an arthroscopy and or operative procedure. These patients underwent both blinded POCUS and MRI of the knees before the intervention procedure and results of both imaging modalities were compared according to the operative and arthroscopic findings.

RESULTS

The preoperative reliability of POCUS compared to MRI for the assessment of meniscus injuries was sensitivity (92.9% vs. 90.5%), specificity (88.9% vs. 83.3%), positive predictive value (PPV; 95.1% vs. 92.7%), negative predictive value (NPV; 84.2% vs. 79%), and overall accuracy (91.7% vs. 88.3%). However, for diagnosing collateral ligament injures, POCUS versus MRI assessed sensitivity (92.3% vs. 88.5%), specificity (100% vs. 97.1%), PPV (100% vs. 95.8%), NPV (94.4% vs. 91.7%), and overall accuracy (96.7% vs. 93.3%).

CONCLUSION

Ultrasonography is a useful screening tool for the initial diagnosis of meniscal and collateral ligament pathology compared to or even with potential advantages over MRI, especially when MRI is unavailable or contraindicated. As newly advanced portable ultrasonography becomes available, it could be considered as a point-of-injury diagnostic modality.

Workers' Societal Costs After Knee and Shoulder Injuries and Diagnosis with In-Office Arthroscopy or Delayed MRI: A Cost-Minimization Analysis

The goal of this study was to evaluate the societal costs of using in-office diagnostic arthroscopy (IDA) compared with magnetic resonance imaging (MRI) for the diagnosis of intra-articular knee and shoulder pathology in employed patients receiving Workers' Compensation or disability coverage. The prevalence is estimated at 260,000 total cases per year.

METHODS

A cost-minimization analysis of IDA compared with MRI was conducted. Direct costs (in 2018 U.S. dollars) were calculated from private reimbursement amounts and Medicare. Indirect costs were estimated from a societal perspective including effects of delayed surgical procedures on the ability to work, lost income, Workers' Compensation or disability coverage, and absenteeism. Four regions were selected: Boston, Massachusetts; Detroit, Michigan; Denver, Colorado; and San Bernadino, California. Sensitivity analyses were performed using TreeAge Pro 2019 software. The base assumption was that it would take approximately 4 weeks for a diagnosis with MRI and 0 weeks for a diagnosis with IDA.

RESULTS

Direct costs to determine a knee diagnosis with IDA were $556 less expensive (California) to $470 more expensive (Massachusetts) than MRI. Assuming a 4-week wait, societal costs (indirect and direct) for knee diagnosis were anywhere from $7,852 (Denver) to $11,227 (Boston) less using IDA. Direct costs were similar for shoulder pathology. In order for MRI to be the less costly option, the MRI and the follow-up visit to the physician would need to occur directly after consultation. Under Medicare, direct costs were similar for both the knee and shoulder when comparing IDA and MRI. Including indirect costs resulted in IDA being the less costly option.

CONCLUSIONS

The use of IDA instead of MRI for the diagnosis of knee and shoulder pathology reduced costs. The potential savings to society were approximately $7,852 to $11,227 per operative patient and were dependent on scheduling and follow-up using MRI and on Workers' Compensation.

LEVEL OF EVIDENCE

Economic and Decision Analysis Level IV. See Instructions for Authors for a complete description of levels of evidence.

Diagnostic accuracy of ultrasonography in the assessment of anterior knee pain

Background

Anterior knee pain (AKP) is a problematic complaint, considered to be the most frequent cause of orthopedic consultancy for knee problems. This study aimed to highlight diagnostic accuracy of ultrasonography as a fast imaging technique in assessment of patients with AKP.

Methods and results

A prospective study was conducted on 143 patients with clinically confirmed AKP. All patients underwent ultrasonography and MRI examinations of the knee. The diagnostic accuracy of ultrasonography compared to MRI for evaluating different findings of possible causes of AKP were analyzed using receiver operating characteristic (ROC) curve and judged by area under curve (AUC). A total of 155 knees were included in the study; 26 knees showed no abnormalities, 19 knees showed positive MRI only, and 110 knees showed positive ultrasonography and MRI. Ultrasonography and MRI reported 11 different findings of possible causes of AKP or related to it. Joint effusion was the most common finding (38%) followed by trochlear cartilage defect (20.6%) and superficial infrapatellar subcutaneous edema (20%). The overall accuracy of ultrasonography was 85.3% sensitivity and 100% specificity. The ultrasonography provided the highest sensitivity (100%) in detecting bipartite patella, followed by 91.5% for joint effusion, and 87.5% for quadriceps tendinopathy. The ROC curve analysis of overall accuracy of ultrasonography showed an AUC of 0.93. The overall Kappa agreement between ultrasonography and MRI was good (k = 0.66).

Conclusion

Ultrasonography can be used to make a swift screening and assessment of painful anterior knee and as an alternative to MRI when it is unavailable or contraindicated.

Diagnostic and Therapeutic Elbow Arthroscopy Using Small-Bore Needle Arthroscopy

Needle arthroscopy may provide several potential advantages over standard arthroscopy. The smaller camera size and weight allows for a minimally invasive and percutaneous approach with decreased fluid use. As resolution and image quality improve, the potential to expand clinical use for therapeutic applications becomes possible. One promising use is in elbow arthroscopy. Difference in the technology, such as a zero-degree optic and less-rigid instrumentation, necessitate a modified technique to accommodate thorough diagnostic arthroscopy and therapeutic procedures. This manuscript introduces the authors' approach to diagnostic needle arthroscopy of the anterior and posterior elbow compartments and placement of therapeutic instrumentation. This technique could theoretically decrease the risk of iatrogenic neurovascular injuries, reduce postoperative swelling and pain due to decreased fluid use, and potentially lead to faster recovery.

Diagnostic accuracy of ultrasonography in the assessment of anterior knee pain

Background

Anterior knee pain (AKP) is a problematic complaint, considered to be the most frequent cause of orthopedic consultancy for knee problems. This study aimed to highlight diagnostic accuracy of ultrasonography as a fast imaging technique in assessment of patients with AKP.

Methods and results

A prospective study was conducted on 143 patients with clinically confirmed AKP. All patients underwent ultrasonography and MRI examinations of the knee. The diagnostic accuracy of ultrasonography compared to MRI for evaluating different findings of possible causes of AKP were analyzed using receiver operating characteristic (ROC) curve and judged by area under curve (AUC). A total of 155 knees were included in the study; 26 knees showed no abnormalities, 19 knees showed positive MRI only, and 110 knees showed positive ultrasonography and MRI. Ultrasonography and MRI reported 11 different findings of possible causes of AKP or related to it. Joint effusion was the most common finding (38%) followed by trochlear cartilage defect (20.6%) and superficial infrapatellar subcutaneous edema (20%). The overall accuracy of ultrasonography was 85.3% sensitivity and 100% specificity. The ultrasonography provided the highest sensitivity (100%) in detecting bipartite patella, followed by 91.5% for joint effusion, and 87.5% for quadriceps tendinopathy. The ROC curve analysis of overall accuracy of ultrasonography showed an AUC of 0.93. The overall Kappa agreement between ultrasonography and MRI was good (k = 0.66).

Conclusion

Ultrasonography can be used to make a swift screening and assessment of painful anterior knee and as an alternative to MRI when it is unavailable or contraindicated.

Bubble Sign to Confirm the Integrity of the Shoulder Rotator Cuff

The presence of an intra-articular air bubble adjacent to the rotator cuff at the time of diagnostic shoulder arthroscopy will confirm an intact rotator cuff and is helpful in ambiguous cases. After the introduction of the arthroscope, air is pulled owing to negative air pressure in the joint cavity. Fluid inflow is then started after the inflow has been properly flushed of all air. This creates an intra-articular air bubble, which can be found at the top of the capsular-supraspinatus attachment site in cases with an intact rotator cuff. Secondary subacromial positioning of the arthroscope is used to confirm the intact rotator cuff from the bursal side.