IOTA Simple Rules in Differentiating between Benign and Malignant Adnexal Masses by Non-expert Examiners

IOTA simple rules: An efficient tool for evaluation of ovarian tumors by non-experienced but trained examiners - A prospective study

Objectives

A simple and efficient tool for evaluating ovarian tumors in general hospitals where radiologists without experience in gynecological ultrasound is necessary. This study aims to evaluate the diagnostic performance of IOTA simple rules in initial classification of ovarian tumors by non-experienced examiners who have received simple training.

Materials and method

A prospective single-center study was conducted at Hanoi Obstetrics and Gynecology Hospital. Three resident gynecologists trained themselves for two weeks and then received hands-on practice under the supervision of experts for another two weeks. The examiners performed ultrasound on 424 eligible women scheduled for surgery for ovarian tumors and classified the tumors based on IOTA simple rules. The postoperative pathology of ovarian tumors was used as the gold standard.

Results

90.8 % (385/424) of the tumors were benign. Simple rules were applicable in 399/424 (94.1 %) tumors, with a sensitivity of 84.8 % (95 % CI, 70.2-94.3), specificity of 98.9 % (95 % CI, 97.5-99.7), positive predictive value of 87.5 % (95 % CI, 73.3-95.9), and negative predictive value of 98.6 % (95 % CI, 97.1-99.5). The sensitivity of IOTA simple rules was higher in postmenopausal women (91.7 % vs. 81.0 %), while the specificity was higher in premenopausal women (99.4 % vs. 95.8 %). Accuracy was 100 % in all ten pregnant women were assessed using these rules.

Conclusion

In conclusion, in the hands of non-expert examiners who were trained thoroughly, IOTA simple rules are a simple and efficient tool for clinical practice in centers where expert radiologists in gynecology are not always available. The training program is simple and could be applied widely in other clinical centers. Further studies are necessary to evaluate the effectiveness of the IOTA simple rules in assessing ovarian tumors among pregnant women.

Gynecologic Imaging and Reporting Data System for classifying adnexal masses

INTRODUCTION

To perform a systematic review and meta-analysis of the diagnostic performance of the so-called Gynecologic Imaging and Report Data System (GI-RADS) for classifying adnexal masses.

EVIDENCE ACQUISITION

A search for studies reporting about the use of GI-RADS system for classifying adnexal masses from January 2009 to December 2021 was performed in Medline (Pubmed), Google Scholar, Scopus, Cochrane, and Web of Science databases. Pooled sensitivity, specificity, positive and negative likelihood ratios and diagnostic odd ratio (DOR) were calculated. Studies' quality was evaluated using QUADAS-2.

EVIDENCE SYNTHESIS

We identified 510 citations. Ultimately, 26 studies comprising 7350 masses were included. Mean prevalence of ovarian malignancy was 26%. The risk of bias was high in eight studies for domain "patient selection" and low for "index test," "reference test" domains for all studies. Overall, pooled estimated sensitivity, specificity, positive likelihood ratio, and negative likelihood ratio and DOR of GI-RADS system for classifying adnexal masses were 94% (95% confidence interval [CI]=91-96%), 90% (95% CI=87-92%), 9.1 (95% CI=7.0-11.9), and 0.07 (95% CI=0.05-0.11), and 132 (95% CI=78-221), respectively. Heterogeneity was high for both sensitivity and specificity. Meta-regression showed that multiple observers and study's design explained this heterogeneity among studies.

CONCLUSIONS

GI-RADS system has a good diagnostic performance for classifying adnexal masses.

Comparisons of Effectiveness in Differentiating Benign from Malignant Ovarian Masses between Conventional and Modified Risk of Malignancy Index (RMI)

OBJECTIVE

To compare the predictive performance in differentiating benign from malignant ovarian masses between the modified risk malignancy index (RMI) and the conventional RMI (RMI-1 and RMI-2).

METHODS

Women scheduled for elective surgery because of adnexal masses were recruited to undergo pelvic sonography within 24 h before surgery to assess the sonographic characteristics of the masses, focusing on loculi, solid part, ascites, bilateralness, papillary projection, and color flow mapping (CFM). Preoperative CA-125 levels were also measured. Modified RMI, RMI-1, and RMI-2 systems were used to predict malignant masses. The gold standard was pathological or intraoperative diagnosis.

RESULTS

A total of 342 ovarian masses, benign: 243 (71.1%); malignant: 99 (28.9%), meeting the inclusion criteria were analyzed. The sensitivity and the specificity of the modified RMI (87.9% and 81.9%) were significantly higher than those of RMI-1 (74.7% and 84.4%), and RMI-2 (79.8% and 81.1%, respectively). Based on ROC curves, the area under the curves were 0.930, 0.881 and 0.882 for modified RMI, RMI-1 and RMI-2, respectively.

CONCLUSION

Modified RMI had better predictive performance than the conventional RMI in differentiating between benign and malignant ovarian masses. Modified RMI may be useful to help general gynecologists or practitioners to triage patients with an adnexal mass, especially in settings of low resources.

Sensitivity and Specificity of Ultrasonography Using Ovarian-Adnexal Reporting and Data System Classification Versus Pathology Findings for Ovarian Cancer

Background

One of the limiting factors for early diagnosis of ovarian neoplasms is the lack of standardized terminology for ultrasound. The Ovarian-Adnexal Reporting and Data System (O-RADS) classification aimed to reduce variability between observers and facilitate communication with attending physicians. Recent studies show that O-RADS has higher sensitivity (96.8%) and specificity (92.8%) compared to other classifications. However, to date, there are no reports on O-RADS correlation with pathology findings.

Objectives

To determine sensitivity and specificity of ultrasound, as a tool for detecting malignant ovarian neoplasms, using the O-RADS compared to pathology reports.

Materials and methods

We evaluated 73 transvaginal ultrasound records with adnexal masses and applied the O-RADS system. Then, we compared against definitive histopathology diagnosis. We calculated sensitivity and specificity using SPSS.

Results

O-RADS sensitivity for detection of ovarian cancer was 52%, with a specificity of 84%, negative predictive value of 79%, and positive predictive value of 60%, with an accuracy of 73%.

Conclusions

In our study, O-RADS classification yielded a higher specificity than sensitivity for malignant vs. benign findings. Hence, we propose that this classification could be useful for tailoring treatment appropriately. O-RADS 0 to 2 may benefit from conservative treatment while O-RADS 3 to 5 may require surgical treatment.

Ultrasound Assessment of Adnexal Pathology: Standardized Methods and Different Levels of Experience

Background and objectives: An expert’s subjective assessment is still the most reliable evaluation of adnexal pathology, thus raising the need for methods less dependent on the examiner’s experience. The aim of this study was to evaluate the performance of standardized methods when applied by examiners with different levels of experience and to suggest the most suitable method for less-experienced gynecologists. Materials and methods: This single-center retrospective study included 50 cases of histologically proven first-time benign or malignant adnexal pathology. Three examiners evaluated the same transvaginal ultrasound images: an expert (level III), a 4th year resident in gynecology (level I), and a final year medical student after basic training (labeled as level 0). The assessment methods included subjective evaluation, Simple Rules (SR) with and without algorithm, ADNEX and Gynecologic Imaging Reporting and Data System (GI-RADS) models. Sensitivity, specificity, accuracy, positive and negative predictive values with 95% confidence interval were calculated. Results: Out of 50 cases, 33 (66%) were benign and 17 (34%) were malignant adnexal masses. Using only SR, level III could classify 48 (96%), level I—41 (82%) and level 0—40 (80%) adnexal lesions. Using SR and algorithm, the performance improved the most for all levels and yielded sensitivity and specificity of 100% for level III, 100% and 97% for level I, 94.4% and 100% for level 0, respectively. Compared to subjective assessment, ADNEX lowered the accuracy of level III evaluation from 97.9% to 88% and GI-RADS had no impact. ADNEX and GI-RADS improved the sensitivity up to 100% for the less experienced; however, the specificity and accuracy were notably decreased. Conclusions: SR and SR+ algorithm have the most potential to improve not only sensitivity, but also specificity and accuracy, irrespective of the experience level. ADNEX and GI-RADS can yield sensitivity of 100%; however, the accuracy is decreased.

Prediction Models of Adnexal Masses: State-of-the-Art Review

Importance

Several predictive models and scoring systems have been developed to differentiate between benign and malignant ovarian masses, in order to guide effective management. These models use combinations of patient characteristics, ultrasound markers, and biochemical markers.

Objective

The aim of this study was to describe, compare, and prioritize, according to their strengths and qualities, all the adnexal prediction models.

Evidence Acquisition

This was a state-of-the-art review, synthesizing the findings of the current published literature on the available prediction models of adnexal masses.

Results

The existing models include subjective assessment by expert sonographers, the International Ovarian Tumor Analysis models (logistic regression models 1 and 2, Simple Rules, 3-step strategy, and ADNEX [Assessment of Different NEoplasias in the adneXa] model), the Risk of Malignancy Index, the Risk of Malignancy Ovarian Algorithm, the Gynecologic Imaging Reporting and Data System, and the Ovarian-Adnexal Reporting and Data System. Overall, subjective assessment appears to be superior to all prediction models. However, the International Ovarian Tumor Analysis models are probably the best available methods for nonexpert examiners. The Ovarian-Adnexal Reporting and Data System is an international approach that incorporates both the common European and North American approaches, but still needs to be validated.

Conclusions

Many prediction models exist for the assessment of adnexal masses. The adoption of a particular model is based on local guidelines, as well as sonographer's experience. The safety of expectant management of adnexal masses with benign ultrasound morphology is still under investigation.

Preoperative Evaluation of the ADNEX Model for the Prediction of the Ovarian Cancer Risk of Adnexal Masses at Siriraj Hospital

INTRODUCTION

Distinguishing benign adnexal masses from malignant tumors plays an important role in preoperative planning and improving patients' survival rates. The International Ovarian Tumor Analysis (IOTA) group developed a model termed the Assessment of Different NEoplasias in the adneXa (ADNEX).

OBJECTIVE

Our objective was to evaluate the performance of the ADNEX model in distinguishing between benign and malignant tumors at a cutoff value of 10%.

METHODS

This was a prospective diagnostic study. 357 patients with an adnexal mass who were scheduled for surgery at Siriraj Hospital were included from May 1, 2018, to May 30, 2019. All patients were undergoing ultrasonography, and serum CA125 was measured. Data were calculated by the ADNEX model via an IOTA ADNEX calculator.

RESULTS

Of the 357 patients, 296 had benign tumors and 61 had malignant tumors. The area under the receiver operating characteristic curve for using the ADNEX model was 0.975 (95% confidence interval, 0.953-0.988). At a 10% cutoff, the sensitivity was 98.4% and specificity was 87.2%. The best cutoff value was at 16.6% in our population.

CONCLUSIONS

The performance of the ADNEX model in differentiating benign and malignant tumors was excellent.

Diagnostic Added-Value of Serum CA-125 on the IOTA Simple Rules and Derivation of Practical Combined Prediction Models (IOTA SR X CA-125)

Background: This study aimed to evaluate the diagnostic added-value of serum CA-125 to the International Ovarian Tumor Analysis (IOTA) Simple Rules in order to facilitate differentiation between malignant and benign ovarian tumors before surgery. Methods: A secondary analysis of a cross-sectional cohort of women scheduled for surgery in Maharaj Nakorn Chiang Mai Hospital between April 2010 and March 2018 was carried out. Demographic and clinical data were prospectively collected. Histopathologic diagnosis was used as the reference standard. Logistic regression was used for development of the model. Evaluation of the diagnostic added-value was based on the increment of the area under the receiver operating characteristic curve (AuROC). Results: One hundred and forty-five women (30.3%) out of a total of 479 with adnexal masses had malignant ovarian tumors. The model that included information from the IOTA Simple Rules and serum CA-125 was significantly more superior to the model that used only information from the IOTA Simple Rules (AuROC 0.95 vs. 0.89, p < 0.001 for pre-menopause and AuROC 0.98 vs 0.83, p < 0.001 for post-menopause). Conclusions: The IOTA SR X CA-125 model showed high discriminative ability and is potentially useful as a decision tool for guiding patient referrals to oncologic specialists.

Transvaginal Ultrasound-Guided Fine-Needle Aspiration of Adnexal Cysts With a Low Risk of Malignancy: Our Experience and Recommendations

OBJECTIVES

The purpose of this study was to assess the effectiveness of ultrasound (US)-guided aspiration for the management of low-risk adnexal cysts.

METHODS

A longitudinal cohort of women with a low-risk adnexal cyst who underwent transvaginal US-guided aspiration from January 2012 to April 2018 were included. All procedures were performed on an outpatient basis, without anesthesia, sedation, or antibiotics. The posttreatment follow-up protocol included transvaginal US at 3 and 12 months. Potential risk factors for recurrence (ie, age, menopausal status, comorbidities, symptoms, cyst diameter, incomplete emptying, and location) were analyzed by multiple logistic regression.

RESULTS

A total of 156 patients were included. The median (interquartile range) cyst diameter was 66 (58-80) mm. Fifty-seven (36.5%) cases were resolved by US-guided aspiration. The median follow-up time was 556.5 (344-1070.25) days. The complication rate of the procedure was 2.6% (n = 4), with 3 cases of a major complication due to a pelvic abscess and 1 case of a minor complication due to self-limited vaginal spotting. A larger cyst size (odds ratio, 1.01; 95% confidence interval, 1.04-1.07; P = .002) and an older age (odds ratio, 1.01; 95% confidence interval, 1.03-1.05; P = .007) at diagnosis were independent factors related to recurrence.

CONCLUSIONS

Based on the low resolution rate, US-guided aspiration is not an effective option for the treatment of low-risk adnexal cysts. Risk factors associated with recurrence were age and cyst size at diagnosis. Larger randomized studies are necessary to assess predictive factors for cyst recurrence.

Obstetrics and Gynecology Residents Can Accurately Classify Benign Ovarian Tumors Using the International Ovarian Tumor Analysis Rules

OBJECTIVES

Recognition of benign versus malignant tumors is essential in gynecologic ultrasound (US). The International Ovarian Tumor Analysis (IOTA) rules have been proposed as part of resident US training. The objective of this study was to examine whether they could be accurately used by obstetrics and gynecology residents in Rwanda.

METHODS

Patients undergoing explorative laparotomy for adnexal masses at the University Teaching Hospital of Kigali were included. Before the study, a didactic lecture on the IOTA rules for classifying adnexal masses was performed. Preoperative transabdominal US examinations were performed by residents at different levels of training, who were blinded to the results of prior US examinations. The IOTA classification was compared to the final pathologic diagnosis.

RESULTS

There were 72 patients who underwent 116 US examinations. Only 15.5% of US examinations were considered inconclusive. First-year residents (12) correctly diagnosed 18 of 20 masses (90%) as benign and 4 of 4 as malignant. Second-year residents (9) classified 29 of 29 masses correctly. Third-year residents (10) accurately identified 21 of 22 (95.5%) as benign and 5 of 5 as malignant. Fourth-year residents (13) accurately identified 11 of 12 (91.7%) as benign and 6 of 6 as malignant. Therefore, 74 of 78 tumors (94.9%) considered benign by IOTA rules were confirmed by histologic results. Similarly, all 20 tumors classified as malignant were confirmed. Overall, the sensitivities to diagnose benign and malignant tumors by the IOTA rules were 83.3% and 100%, respectively. The positive and negative predictive values were 100% and 94.9%. There were no significant differences noted between residency years.

CONCLUSIONS

All levels of Rwandan obstetrics and gynecology residents were able to use the IOTA rules to accurately distinguish benign from malignant tumors.

Evaluation of adnexal tumours in the International Ovarian Tumor Analysis system in reference to histopathological results

Aim of the study

To retrospectively evaluate how the International Ovarian Tumor Analysis (IOTA) simple rules used in ultrasound examinations estimate the probability of malignant and benign tumour occurrence in the studied population.

Material and methods

The study was performed on a group of 425 patients with ovarian tumours operated in the Clinic of Surgical and Oncological Gynecology at the Medical University of Lodz in the years 2014-2015. Adnexal tumours were rated according to IOTA simple rules, classifying them as probably malignant, probably benign, or unclassified. The results of the study were compared with final histopathological results. The statistical analysis was performed using STATISTICA 13 PL with Medical Pack.

Results

We analysed data on n = 43 (11%) patients with malignant, n = 346 (86%) patients with benign, and n = 12 (3%) patients with borderline tumours, respectively. Malignant tumour patients were significantly older (mean age 61.0 ±11.6 vs. 43.6 ±16.2 years, p< 0.001), had higher BMI (mean 27.3 ±7.0 vs. 25.2 ±5.2, p< 0.05), more pregnancies (median 2 vs. 1, p = 0.001), and higher cancer antigen 125 (CA 125) concentrations (median 251.5 vs. 18.5, p< 0.001) than patients with a benign tumour. Also, they more often suffered from diabetes mellitus (19% vs. 8%, p = 0.02) and arterial hypertension (60% vs. 42%, p< 0.01) than benign tumour patients.

Conclusions

In our study, IOTA performance in predicting or ruling out a malignant tumour was highly satisfactory and similar to that of CA 125. Both the methods may be complementary and used to assess the risk of malignant vs. benign ovarian neoplasm, although the context of other clinical variables may also be important.

Comparison of the diagnostic accuracy of International Ovarian Tumor Analysis simple rules and the risk of malignancy index to discriminate between benign and malignant adnexal masses

OBJECTIVE

To compare the diagnostic accuracy of International Ovarian Tumor Analysis (IOTA) simple rules and risk of malignancy index (RMI 1/RMI 2) scoring to discriminate between benign and malignant adnexal masses.

METHODS

Secondary analysis of a cohort of patients scheduled for surgery for adnexal masses in a tertiary center between April 2010 and March 2018. Ultrasound examinations were performed by general gynecologists within 24 hours prior to surgery to evaluate sonographic features. Demographic data and preoperative CA 125 levels were recorded. IOTA rules and RMI scoring were applied to predict malignancy and prospectively recorded. Final diagnosis was based on pathological or intraoperative diagnosis.

RESULTS

A total of 479 masses met the inclusion criteria and were retrieved from the database: 334 (69.7%) benign and 145 (30.3%) malignant. IOTA rules could be applied to 392 (81.8%) masses and were inconclusive in 87 (18.2%). Sensitivity and specificity of IOTA rules (83.8% and 92.0%, respectively) were significantly higher than RMI 1 (77.2% and 86.8%, respectively) and RMI 2 (82.1% and 82.6%, respectively).

CONCLUSION

IOTA simple rules had higher diagnostic accuracy compared with RMI to discriminate between benign and malignant adnexal masses; however, nearly 20% of IOTA results were inconclusive and needed expert consultation.

IOTA Simple Ultrasound Rules for Triage of Adnexal Mass: Experience from South India

Objective

To assess the diagnostic performance of International Ovarian Tumor Analysis (IOTA) simple ultrasound rules to discriminate adnexal masses as benign or malignant.

Methods

A cross-sectional prospective study was conducted on women scheduled for elective surgery due to adnexal masses. Ultrasound examiner systematically assessed the tumors according to the IOTA simple rules to determine the risk of the tumor being malignant. If the simple rules yielded inconclusive result, pattern recognition was used to categorize the mass. Results were then compared with histologic findings after surgery. Diagnostic performance was assessed by calculating sensitivity and specificity.

Results

Two hundred and five women undergoing surgery were included. The rules were applicable in 183 (89.3%) of the tumors; and for these tumors, sensitivity was 92.8% (95% CI 77-99%) and specificity was 92.9% (95% CI 88-96.4%). Of the tumors, 144 were benign and 39 were malignant. The simple rules yielded inconclusive results in 22 masses which were analyzed by pattern recognition.

Conclusion

IOTA simple rules provide excellent discrimination between benign and malignant adnexal masses.

Association between the sonographer's experience and diagnostic performance of IOTA simple rules

Background

To validate the clinical value of simple rules in distinguishing malignant adnexal masses from benign ones and to explore the effect of simple rules for experienced and less-experienced sonographers.

Methods

Patients with persistent adnexal masses were enrolled between November 2013 and December 2015. All masses were proven through histological examinations. Five sets of diagnoses were made and compared with one another. Diagnosis 1 was made, according to the simple rules, by a trainee with little clinical diagnostic experience. Diagnoses 2 and 3 were made by experienced and less-experienced sonographers, respectively, according to their clinical experiences. With diagnosis 1 as a reference, the two sonographers were asked to provide a second diagnosis, which were diagnoses 4 and 5. The efficiency of the five sets of diagnoses was compared using ROC curves.

Results

In total, 75 malignant (37.7%) and 124 benign lesions (62.3%) were enrolled in this study. The mean diameter of the benign masses was obviously smaller than that of the malignant ones (6.8 ± 3.4 cm vs. 9.3 ± 4.9 cm, p < 0.01). The malignant ratio in postmenopausal women was much higher (66.1%) than that in the premenopausal population (25.7%) (p < 0.0001). Totally, 156 of the 199 cases (79.4%) resulted in conclusive diagnoses. Sensitivity and specificity were 98.4% and 73.9%, respectively, among the conclusive cases. The area under the ROC curve (Az) for the simple rule diagnosis was significantly lower than that for the experienced sonographer diagnosis (0.85 vs. 0.96, p < 0.0001); compared with the less-experienced sonographer, this difference was not significant (0.85 vs. 0.86, p = 0.9776). No significant difference was found in the comparison between the diagnoses made by the experienced sonographer before and after referencing the simple rule diagnosis (Az, 0.96 vs. 0.97, p = 0.2055). Using diagnosis 1 as a reference, the diagnostic performance of the less-experienced sonographer increased (from 0.86 to 0.92, p = 0.012); however, it was still lower than that of the experienced sonographer (Az, 96% vs. 92%, p = 0.0241).

Conclusions

The simple rules was an appealing method for discriminating malignant masses from benign ones, particularly for a less-experienced sonographer.

Risk scores to guide referral decisions for people with suspected ovarian cancer in secondary care: a systematic review and cost-effectiveness analysis

BACKGROUND

Ovarian cancer is the sixth most common cancer in UK women and can be difficult to diagnose, particularly in the early stages. Risk-scoring can help to guide referral to specialist centres.

OBJECTIVES

To assess the clinical and cost-effectiveness of risk scores to guide referral decisions for women with suspected ovarian cancer in secondary care.

METHODS

Twenty-one databases, including MEDLINE and EMBASE, were searched from inception to November 2016. Review methods followed published guidelines. The meta-analysis using weighted averages and random-effects modelling was used to estimate summary sensitivity and specificity with 95% confidence intervals (CIs). The cost-effectiveness analysis considered the long-term costs and quality-adjusted life-years (QALYs) associated with different risk-scoring methods, and subsequent care pathways. Modelling comprised a decision tree and a Markov model. The decision tree was used to model short-term outcomes and the Markov model was used to estimate the long-term costs and QALYs associated with treatment and progression.

RESULTS

Fifty-one diagnostic cohort studies were included in the systematic review. The Risk of Ovarian Malignancy Algorithm (ROMA) score did not offer any advantage over the Risk of Malignancy Index 1 (RMI 1). Patients with borderline tumours or non-ovarian primaries appeared to account for disproportionately high numbers of false-negative, low-risk ROMA scores. (Confidential information has been removed.) To achieve similar levels of sensitivity to the Assessment of Different NEoplasias in the adneXa (ADNEX) model and the International Ovarian Tumour Analysis (IOTA) group's simple ultrasound rules, a very low RMI 1 decision threshold (25) would be needed; the summary sensitivity and specificity estimates for the RMI 1 at this threshold were 94.9% (95% CI 91.5% to 97.2%) and 51.1% (95% CI 47.0% to 55.2%), respectively. In the base-case analysis, RMI 1 (threshold of 250) was the least effective [16.926 life-years (LYs), 13.820 QALYs] and the second cheapest (£5669). The IOTA group's simple ultrasound rules (inconclusive, assumed to be malignant) were the cheapest (£5667) and the second most effective [16.954 LYs, 13.841 QALYs], dominating RMI 1. The ADNEX model (threshold of 10%), costing £5699, was the most effective (16.957 LYs, 13.843 QALYs), and compared with the IOTA group's simple ultrasound rules, resulted in an incremental cost-effectiveness ratio of £15,304 per QALY gained. At thresholds of up to £15,304 per QALY gained, the IOTA group's simple ultrasound rules are cost-effective; the ADNEX model (threshold of 10%) is cost-effective for higher thresholds.

LIMITATIONS

Information on the downstream clinical consequences of risk-scoring was limited.

CONCLUSIONS

Both the ADNEX model and the IOTA group's simple ultrasound rules may offer increased sensitivity relative to current practice (RMI 1); that is, more women with malignant tumours would be referred to a specialist multidisciplinary team, although more women with benign tumours would also be referred. The cost-effectiveness model supports prioritisation of sensitivity over specificity. Further research is needed on the clinical consequences of risk-scoring.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42016053326.

FUNDING DETAILS

The National Institute for Health Research Health Technology Assessment programme.

Sonographic Diagnosis of Tubal Cancer with IOTA Simple Rules Plus Pattern Recognition

Objective:

To evaluate diagnostic performance of IOTA simple rules plus pattern recognition in predicting tubal cancer.

Methods:

Secondary analysis was performed on prospective database of our IOTA project. The patients recruited in the project were those who were scheduled for pelvic surgery due to adnexal masses. The patients underwent ultrasound examinations within 24 hours before surgery. On ultrasound examination, the masses were evaluated using the well-established IOTA simple rules plus pattern recognition (sausage-shaped appearance, incomplete septum, visible ipsilateral ovaries) to predict tubal cancer. The gold standard diagnosis was based on histological findings or operative findings.

Results:

A total of 482 patients, including 15 cases of tubal cancer, were evaluated by ultrasound preoperatively. The IOTA simple rules plus pattern recognition gave a sensitivity of 86.7% (13 in 15) and specificity of 97.4%. Sausage-shaped appearance was identified in nearly all cases (14 in 15). Incomplete septa and normal ovaries could be identified in 33.3% and 40%, respectively.

Conclusion:

IOTA simple rules plus pattern recognition is relatively effective in predicting tubal cancer. Thus, we propose the simple scheme in diagnosis of tubal cancer as follows. First of all, the adnexal masses are evaluated with IOTA simple rules. If the B-rules could be applied, tubal cancer is reliably excluded. If the M-rules could be applied or the result is inconclusive, careful delineation of the mass with pattern recognition should be performed.

Validation of the Performance of International Ovarian Tumor Analysis (IOTA) Methods in the Diagnosis of Early Stage Ovarian Cancer in a Non-Screening Population

Background: The aim of this study was to assess and compare the performance of different ultrasound-based International Ovarian Tumor Analysis (IOTA) strategies and subjective assessment for the diagnosis of early stage ovarian malignancy. Methods: This is a secondary analysis of a prospective multicenter cross-sectional diagnostic accuracy study that included 1653 patients recruited at 18 centers from 2009 to 2012. All patients underwent standardized transvaginal ultrasonography by experienced ultrasound investigators. We assessed test performance of the IOTA Simple Rules (SRs), Simple Rules Risk (SRR), the Assessment of Different NEoplasias in the adneXa (ADNEX) model and subjective assessment to discriminate between stage I-II ovarian cancer and benign disease. Reference standard was histology after surgery. Results: 230 (13.9%) patients proved to have stage I–II primary invasive ovarian malignancy, and 1423 (86.1%) had benign disease. Sensitivity and specificity with respect to malignancy (95% confidence intervals) of the original SRs (classifying all inconclusive cases as malignant) were 94.3% (90.6% to 96.7%) and 73.4% (71.0% to 75.6%). Subjective assessment had a sensitivity and specificity of 90.0% (85.4% to 93.2%) and 86.7% (84.9% to 88.4%), respectively. The areas under the receiver operator characteristic curves of SRR and ADNEX were 0.917 (0.902 to 0.933) and 0.905 (0.920 to 0.934), respectively. At a 1% risk cut-off, sensitivity and specificity for SRR were 100% (98.4% to 100%) and 38.0% (35.5% to 40.6%), and for ADNEX were 100% (98.4% to 100%) and 19.4% (17.4% to 21.5%). At a 30% risk cut-off, sensitivity and specificity for SRR were 88.3% (83.5% to 91.8%) and 81.1% (79% to 83%), and for ADNEX were 84.5% (80.5% to 89.6%) and 84.5% (82.6% to 86.3%). Conclusion: This study shows that all three IOTA strategies have good ability to discriminate between stage I-II ovarian malignancy and benign disease.

Clinical Utility of Risk Models to Refer Patients with Adnexal Masses to Specialized Oncology Care: Multicenter External Validation Using Decision Curve Analysis

Purpose: To evaluate the utility of preoperative diagnostic models for ovarian cancer based on ultrasound and/or biomarkers for referring patients to specialized oncology care. The investigated models were RMI, ROMA, and 3 models from the International Ovarian Tumor Analysis (IOTA) group [LR2, ADNEX, and the Simple Rules risk score (SRRisk)].Experimental Design: A secondary analysis of prospectively collected data from 2 cross-sectional cohort studies was performed to externally validate diagnostic models. A total of 2,763 patients (2,403 in dataset 1 and 360 in dataset 2) from 18 centers (11 oncology centers and 7 nononcology hospitals) in 6 countries participated. Excised tissue was histologically classified as benign or malignant. The clinical utility of the preoperative diagnostic models was assessed with net benefit (NB) at a range of risk thresholds (5%-50% risk of malignancy) to refer patients to specialized oncology care. We visualized results with decision curves and generated bootstrap confidence intervals.Results: The prevalence of malignancy was 41% in dataset 1 and 40% in dataset 2. For thresholds up to 10% to 15%, RMI and ROMA had a lower NB than referring all patients. SRRisks and ADNEX demonstrated the highest NB. At a threshold of 20%, the NBs of ADNEX, SRrisks, and RMI were 0.348, 0.350, and 0.270, respectively. Results by menopausal status and type of center (oncology vs. nononcology) were similar.Conclusions: All tested IOTA methods, especially ADNEX and SRRisks, are clinically more useful than RMI and ROMA to select patients with adnexal masses for specialized oncology care. Clin Cancer Res; 23(17); 5082-90. ©2017 AACR.

Predicting the risk of malignancy in adnexal masses based on the Simple Rules from the International Ovarian Tumor Analysis group

BACKGROUND

Accurate methods to preoperatively characterize adnexal tumors are pivotal for optimal patient management. A recent metaanalysis concluded that the International Ovarian Tumor Analysis algorithms such as the Simple Rules are the best approaches to preoperatively classify adnexal masses as benign or malignant.

OBJECTIVE

We sought to develop and validate a model to predict the risk of malignancy in adnexal masses using the ultrasound features in the Simple Rules.

STUDY DESIGN

This was an international cross-sectional cohort study involving 22 oncology centers, referral centers for ultrasonography, and general hospitals. We included consecutive patients with an adnexal tumor who underwent a standardized transvaginal ultrasound examination and were selected for surgery. Data on 5020 patients were recorded in 3 phases from 2002 through 2012. The 5 Simple Rules features indicative of a benign tumor (B-features) and the 5 features indicative of malignancy (M-features) are based on the presence of ascites, tumor morphology, and degree of vascularity at ultrasonography. Gold standard was the histopathologic diagnosis of the adnexal mass (pathologist blinded to ultrasound findings). Logistic regression analysis was used to estimate the risk of malignancy based on the 10 ultrasound features and type of center. The diagnostic performance was evaluated by area under the receiver operating characteristic curve, sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), positive predictive value (PPV), negative predictive value (NPV), and calibration curves.

RESULTS

Data on 4848 patients were analyzed. The malignancy rate was 43% (1402/3263) in oncology centers and 17% (263/1585) in other centers. The area under the receiver operating characteristic curve on validation data was very similar in oncology centers (0.917; 95% confidence interval, 0.901-0.931) and other centers (0.916; 95% confidence interval, 0.873-0.945). Risk estimates showed good calibration. In all, 23% of patients in the validation data set had a very low estimated risk (<1%) and 48% had a high estimated risk (≥30%). For the 1% risk cutoff, sensitivity was 99.7%, specificity 33.7%, LR+ 1.5, LR- 0.010, PPV 44.8%, and NPV 98.9%. For the 30% risk cutoff, sensitivity was 89.0%, specificity 84.7%, LR+ 5.8, LR- 0.13, PPV 75.4%, and NPV 93.9%.

CONCLUSION

Quantification of the risk of malignancy based on the Simple Rules has good diagnostic performance both in oncology centers and other centers. A simple classification based on these risk estimates may form the basis of a clinical management system. Patients with a high risk may benefit from surgery by a gynecological oncologist, while patients with a lower risk may be managed locally.