1
|
Han J, Wen J, Hu W. Comparison of O-RADS with the ADNEX model and IOTA SR for risk stratification of adnexal lesions: a systematic review and meta-analysis. Front Oncol 2024; 14:1354837. [PMID: 38756655 PMCID: PMC11096596 DOI: 10.3389/fonc.2024.1354837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 04/15/2024] [Indexed: 05/18/2024] Open
Abstract
Purpose This study aims to systematically compare the diagnostic performance of the Ovarian-Adnexal Reporting and Data System with the International Ovarian Tumor Analysis Simple Rules and the Assessment of Different NEoplasias in the adneXa model for risk stratification of ovarian cancer and adnexal masses. Methods A literature search of online databases for relevant studies up to July 2023 was conducted by two independent reviewers. The summary estimates were pooled with the hierarchical summary receiver-operating characteristic model. The quality of the included studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies-2 and the Quality Assessment of Diagnostic Accuracy Studies-Comparative Tool. Metaregression and subgroup analyses were performed to explore the impact of varying clinical settings. Results A total of 13 studies met the inclusion criteria. The pooled sensitivity and specificity for eight head-to-head studies between the Ovarian-Adnexal Reporting and Data System and the Assessment of Different NEoplasias in the adneXa model were 0.96 (95% CI 0.92-0.98) and 0.82 (95% CI 0.71-0.90) vs. 0.94 (95% CI 0.91-0.95) and 0.83 (95% CI 0.77-0.88), respectively, and for seven head-to-head studies between the Ovarian-Adnexal Reporting and Data System and the International Ovarian Tumor Analysis Simple Rules, the pooled sensitivity and specificity were 0.95 (95% CI 0.93-0.97) and 0.75 (95% CI 0.62-0.85) vs. 0.91 (95% CI 0.82-0.96) and 0.86 (95% CI 0.76-0.93), respectively. No significant differences were found between the Ovarian-Adnexal Reporting and Data System and the Assessment of Different NEoplasias in the adneXa model as well as the International Ovarian Tumor Analysis Simple Rules in terms of sensitivity (P = 0.57 and P = 0.21) and specificity (P = 0.87 and P = 0.12). Substantial heterogeneity was observed among the studies for all three guidelines. Conclusion All three guidelines demonstrated high diagnostic performance, and no significant differences in terms of sensitivity or specificity were observed between the three guidelines.
Collapse
Affiliation(s)
- Jing Han
- Department of Radiology, Suzhou Hospital, Affiliated Hospital of Medical School, Nanjing University, Suzhou, China
| | - Jing Wen
- Department of Medical Imaging, Jiangsu Vocational College of Medicine, Yancheng, China
| | - Wei Hu
- Department of Radiology, Yixing Traditional Chinese Medicine Hospital, Yixing, China
| |
Collapse
|
2
|
Barreñada L, Ledger A, Dhiman P, Collins G, Wynants L, Verbakel JY, Timmerman D, Valentin L, Van Calster B. ADNEX risk prediction model for diagnosis of ovarian cancer: systematic review and meta-analysis of external validation studies. BMJ MEDICINE 2024; 3:e000817. [PMID: 38375077 PMCID: PMC10875560 DOI: 10.1136/bmjmed-2023-000817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 01/25/2024] [Indexed: 02/21/2024]
Abstract
Objectives To conduct a systematic review of studies externally validating the ADNEX (Assessment of Different Neoplasias in the adnexa) model for diagnosis of ovarian cancer and to present a meta-analysis of its performance. Design Systematic review and meta-analysis of external validation studies. Data sources Medline, Embase, Web of Science, Scopus, and Europe PMC, from 15 October 2014 to 15 May 2023. Eligibility criteria for selecting studies All external validation studies of the performance of ADNEX, with any study design and any study population of patients with an adnexal mass. Two independent reviewers extracted the data. Disagreements were resolved by discussion. Reporting quality of the studies was scored with the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) reporting guideline, and methodological conduct and risk of bias with PROBAST (Prediction model Risk Of Bias Assessment Tool). Random effects meta-analysis of the area under the receiver operating characteristic curve (AUC), sensitivity and specificity at the 10% risk of malignancy threshold, and net benefit and relative utility at the 10% risk of malignancy threshold were performed. Results 47 studies (17 007 tumours) were included, with a median study sample size of 261 (range 24-4905). On average, 61% of TRIPOD items were reported. Handling of missing data, justification of sample size, and model calibration were rarely described. 91% of validations were at high risk of bias, mainly because of the unexplained exclusion of incomplete cases, small sample size, or no assessment of calibration. The summary AUC to distinguish benign from malignant tumours in patients who underwent surgery was 0.93 (95% confidence interval 0.92 to 0.94, 95% prediction interval 0.85 to 0.98) for ADNEX with the serum biomarker, cancer antigen 125 (CA125), as a predictor (9202 tumours, 43 centres, 18 countries, and 21 studies) and 0.93 (95% confidence interval 0.91 to 0.94, 95% prediction interval 0.85 to 0.98) for ADNEX without CA125 (6309 tumours, 31 centres, 13 countries, and 12 studies). The estimated probability that the model has use clinically in a new centre was 95% (with CA125) and 91% (without CA125). When restricting analysis to studies with a low risk of bias, summary AUC values were 0.93 (with CA125) and 0.91 (without CA125), and estimated probabilities that the model has use clinically were 89% (with CA125) and 87% (without CA125). Conclusions The results of the meta-analysis indicated that ADNEX performed well in distinguishing between benign and malignant tumours in populations from different countries and settings, regardless of whether the serum biomarker, CA125, was used as a predictor. A key limitation was that calibration was rarely assessed. Systematic review registration PROSPERO CRD42022373182.
Collapse
Affiliation(s)
- Lasai Barreñada
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
| | - Ashleigh Ledger
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
| | - Paula Dhiman
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford Centre for Statistics in Medicine, Oxford, UK
| | - Gary Collins
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford Centre for Statistics in Medicine, Oxford, UK
| | - Laure Wynants
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
- Department of Epidemiology, Universiteit Maastricht Care and Public Health Research Institute, Maastricht, Netherlands
| | - Jan Y Verbakel
- Department of Public Health and Primary care, KU Leuven, Leuven, Belgium
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
- Leuven Unit for Health Technology Assessment Research (LUHTAR), KU Leuven, Leuven, Belgium
| | - Dirk Timmerman
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
- Department of Obstetrics and Gynaecology, UZ Leuven campus Gasthuisberg Dienst gynaecologie en verloskunde, Leuven, Belgium
| | - Lil Valentin
- Department of Obstetrics and Gynaecology, Skåne University Hospital, Malmo, Sweden
- Department of Clinical Sciences Malmö, Lund University, Lund, Sweden
| | - Ben Van Calster
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
- Leuven Unit for Health Technology Assessment Research (LUHTAR), KU Leuven, Leuven, Belgium
- Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands
| |
Collapse
|
3
|
Su N, Yang Y, Liu Z, Gao L, Dai Q, Li J, Wang H, Jiang Y. Validation of the diagnostic efficacy of O-RADS in adnexal masses. Sci Rep 2023; 13:15667. [PMID: 37735610 PMCID: PMC10514283 DOI: 10.1038/s41598-023-42836-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 09/15/2023] [Indexed: 09/23/2023] Open
Abstract
The aim of this study was to validate the performance of the Ovarian-Adnexal Reporting and Data Systems (O-RADS) series models proposed by the American College of Radiology (ACR) in the preoperative diagnosis of adnexal masses (AMs). Two experienced sonologists examined 218 patients with AMs and gave the assessment results after the examination. Pathological findings were used as a reference standard. Of the 218 lesions, 166 were benign and 52 were malignant. Based on the receiver operating characteristic (ROC) curve, we defined a malignant lesion as O-RADS > 3 (i.e., lesions in O-RADS categories 4 and 5 were malignant). The area under the curve (AUC) of O-RADS (v2022) was 0.970 (95% CI 0.938-0.988), which wasn't statistically significantly different from the O-RADS (v1) combined Simple Rules Risk (SRR) assessment model with the largest AUC of 0.976 (95% CI 0.946-0.992) (p = 0.1534), but was significantly higher than the O-RADS (v1) (AUC = 0.959, p = 0.0133) and subjective assessment (AUC = 0.918, p = 0.0255). The O-RADS series models have good diagnostic performance for AMs. Where, O-RADS (v2022) has higher accuracy and specificity than O-RADS (v1). The accuracy and specificity of O-RADS (v1), however, can be further improved when combined with SRR assessment.
Collapse
Affiliation(s)
- Na Su
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Ya Yang
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Zhenzhen Liu
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Luying Gao
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Qing Dai
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Jianchu Li
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China
| | - Hongyan Wang
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China.
| | - Yuxin Jiang
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Shuai Fu Yuan, Dong Cheng District, Beijing, 100730, China.
| |
Collapse
|
4
|
Lee S, Lee JE, Hwang JA, Shin H. O-RADS US: A Systematic Review and Meta-Analysis of Category-specific Malignancy Rates. Radiology 2023; 308:e223269. [PMID: 37642566 DOI: 10.1148/radiol.223269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Background Ovarian-Adnexal Reporting and Data System (O-RADS) US provides a standardized method with which to stratify lesions into risk of malignancy categories, which is crucial for proper management. Purpose To perform a systematic review and meta-analysis to estimate malignancy rates for each O-RADS US score and evaluate the diagnostic performance of combined O-RADS US scores 4 and 5 in the diagnosis of malignancy. Materials and Methods A systematic literature search from the inception of the MEDLINE, EMBASE, and Web of Science databases through January 27, 2023, was performed for articles that reported using the O-RADS US stratification system and included malignancy rates per each O-RADS score. Bivariate random-effects models were used to determine the pooled malignancy rates for each O-RADS US score and to obtain summary estimates of the diagnostic performance of combined O-RADS US scores 4 and 5 in the diagnosis of malignant lesions. Results The final analysis included 18 studies consisting of 11 605 patients and 11 818 ovarian-adnexal lesions, with 2996 malignant (25.4%) and 8822 benign (74.6%) lesions. No malignant lesions were reported in O-RADS 1 category. The pooled percentages of malignancy were 0.6% (95% CI: 0.3, 1.0) for O-RADS 2, 3.9% (95% CI: 2.5, 5.4) for O-RADS 3, 43.5% (95% CI: 33.8, 53.2) for O-RADS 4, and 87.3% (95% CI: 83.0, 91.7) for O-RADS 5. The pooled sensitivity and specificity of combined O-RADS scores 4 and 5 in the diagnosis of malignant lesions were 95.6% (95% CI: 94.0, 97.2) and 76.6% (95% CI: 70.4, 82.7), respectively. Conclusion Each O-RADS US score provided the intended probability of malignant lesions as outlined by the O-RADS risk stratification system. When O-RADS US scores 4 and 5 were combined as a predictor for malignancy, O-RADS US showed a high sensitivity and moderate specificity. Clinical trial registration no. CRD42022352166 © RSNA, 2023 Supplemental material is available for this article.
Collapse
Affiliation(s)
- Sunyoung Lee
- From the Department of Radiology and Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Republic of Korea (S.L.); Department of Radiology, Soonchunhyang University College of Medicine, Bucheon Hospital, Bucheon, Republic of Korea (J.E.L.); Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea (J.A.H.); and Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea (H.S.)
| | - Ji Eun Lee
- From the Department of Radiology and Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Republic of Korea (S.L.); Department of Radiology, Soonchunhyang University College of Medicine, Bucheon Hospital, Bucheon, Republic of Korea (J.E.L.); Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea (J.A.H.); and Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea (H.S.)
| | - Jeong Ah Hwang
- From the Department of Radiology and Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Republic of Korea (S.L.); Department of Radiology, Soonchunhyang University College of Medicine, Bucheon Hospital, Bucheon, Republic of Korea (J.E.L.); Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea (J.A.H.); and Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea (H.S.)
| | - Hyejung Shin
- From the Department of Radiology and Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Republic of Korea (S.L.); Department of Radiology, Soonchunhyang University College of Medicine, Bucheon Hospital, Bucheon, Republic of Korea (J.E.L.); Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea (J.A.H.); and Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea (H.S.)
| |
Collapse
|
5
|
Wu M, Zhang M, Cao J, Wu S, Chen Y, Luo L, Lin X, Su M, Zhang X. Predictive accuracy and reproducibility of the O-RADS US scoring system among sonologists with different training levels. Arch Gynecol Obstet 2023; 308:631-637. [PMID: 35994107 DOI: 10.1007/s00404-022-06752-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 08/12/2022] [Indexed: 11/02/2022]
Abstract
PURPOSE To investigate the predictive performance and reproducibility of Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound (US) system in evaluating adnexal masses between sonologists with varying levels of expertise. METHODS This was a single-center retrospective study conducted between May 2019 and May 2020, which included 147 adnexal mases with pathological results. Four sonologists with varying experiences independently assigned an O-RADS US category to each adnexal mass twice. The intra- and inter-observer agreement was assessed using weighted kappa values. The area under the curve (AUC), sensitivity, specificity, positive and negative predictive value (PPV and NPV) were assessed for each sonologist. RESULTS Of the 147 adnexal mases, 115 (78.2%) lesions were benign and 32 (21.8%) lesions were malignant. Considering O-RADS > 3 as a predictor for adnexal malignancy, the predictive accuracies of the four sonologists were excellent, with AUCs ranging from 0.831 to 0.926. The predictive accuracies of O-RADS US by experienced sonologists were significantly higher compared to inexperienced sonologists (all P values < 0.005). The O-RADS US presented high sensitivity and NPV value for each sonologist. With regard to the reproducibility of O-RADS, the intra- and inter-observer agreement among experienced sonologists performed better than inexperienced sonologists. CONCLUSION O-RADS showed difference in the predictive accuracy and reproducibility in the evaluation of adnexal masses among sonologists with different levels of expertise. Training is required for inexperienced sonologists before the generalization of O-RADS classification system in clinical practice.
Collapse
Affiliation(s)
- Manli Wu
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Man Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Junyan Cao
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Shuangyu Wu
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Ying Chen
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Liping Luo
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Xin Lin
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Manting Su
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Xinling Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China.
| |
Collapse
|
6
|
Roseland ME, Maturen KE, Shampain KL, Wasnik AP, Stein EB. Adnexal Mass Imaging: Contemporary Guidelines for Clinical Practice. Radiol Clin North Am 2023; 61:671-685. [PMID: 37169431 DOI: 10.1016/j.rcl.2023.02.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Several recent guidelines have been published to improve accuracy and consistency of adnexal mass imaging interpretation and to guide management. Guidance from the American College of Radiology (ACR) Appropriateness Criteria establishes preferred adnexal imaging modalities and follow-up. Moreover, the ACR Ovarian-Adnexal Reporting Data System establishes a comprehensive, unified set of evidence-based guidelines for classification of adnexal masses by both ultrasound and MR imaging, communicating risk of malignancy to further guide management.
Collapse
Affiliation(s)
- Molly E Roseland
- Michigan Medicine, University of Michigan, University Hospital B1D502D, 1500 East Medical Center Dr., Ann Arbor, MI 48109, USA.
| | - Katherine E Maturen
- Michigan Medicine, University of Michigan, University Hospital B1D502D, 1500 East Medical Center Dr., Ann Arbor, MI 48109, USA
| | - Kimberly L Shampain
- Michigan Medicine, University of Michigan, University Hospital B1D502D, 1500 East Medical Center Dr., Ann Arbor, MI 48109, USA
| | - Ashish P Wasnik
- Michigan Medicine, University of Michigan, University Hospital B1D502D, 1500 East Medical Center Dr., Ann Arbor, MI 48109, USA
| | - Erica B Stein
- Michigan Medicine, University of Michigan, University Hospital B1D502D, 1500 East Medical Center Dr., Ann Arbor, MI 48109, USA
| |
Collapse
|
7
|
Pelayo M, Sancho-Sauco J, Sanchez-Zurdo J, Abarca-Martinez L, Borrero-Gonzalez C, Sainz-Bueno JA, Alcazar JL, Pelayo-Delgado I. Ultrasound Features and Ultrasound Scores in the Differentiation between Benign and Malignant Adnexal Masses. Diagnostics (Basel) 2023; 13:2152. [PMID: 37443546 DOI: 10.3390/diagnostics13132152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 05/31/2023] [Accepted: 06/16/2023] [Indexed: 07/15/2023] Open
Abstract
BACKGROUND Several ultrasound (US) features help ultrasound experts in the classification of benign vs. malignant adnexal masses. US scores serve in this differentiation, but they all have misdiagnoses. The main objective of this study is to evaluate what ultrasound characteristics are associated with malignancy influencing ultrasound scores. METHODS This is a retrospective analysis of ultrasound features of adnexal lesions of women managed surgically. Ultrasound characteristics were analyzed, and masses were classified by subjective assessment of the ultrasonographer (SA) and other ultrasound scores (IOTA Simple Rules Risk Assessment SRRA, ADNEX model, and O-RADS). RESULTS Of a total of 187 adnexal masses studied, 134 were benign (71.7%) and 53 were malignant (28.3%). SA, IOTA SRRA, ADNEX model with or without CA125 and O-RADS had high levels of sensitivity (93.9%, 81.1%, 94.3%, 88.7%, 98.1%) but lower specificity (80.2%, 82.1%, 82.8%, 77.6%, 73.1%) with similar AUC (0.87, 0.87, 0.92, 0.90, 0.86). Ultrasound features significantly related with malignancy were the presence of irregular contour, absence of acoustic shadowing, vascularized solid areas, ≥1 papillae, vascularized septum, and moderate-severe ascites. CONCLUSION IOTA SRRA, ADNEX model, and O-RADS can help in the classification of benign and malignant masses. Certain ultrasound characteristics studied in ultrasound scores are associated with malignancy.
Collapse
Affiliation(s)
- Mar Pelayo
- HM Puerta del Sur, HM Rivas Hospital, 3428521 Madrid, Spain
| | - Javier Sancho-Sauco
- Department of Obstetrics and Gynecology, Universitary Hospital Ramón y Cajal, Alcalá de Henares University, 3428034 Madrid, Spain
| | | | - Leopoldo Abarca-Martinez
- Department of Obstetrics and Gynecology, Universitary Hospital Ramón y Cajal, Alcalá de Henares University, 3428034 Madrid, Spain
| | | | | | - Juan Luis Alcazar
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 3431008 Pamplona, Spain
| | - Irene Pelayo-Delgado
- Department of Obstetrics and Gynecology, Universitary Hospital Ramón y Cajal, Alcalá de Henares University, 3428034 Madrid, Spain
| |
Collapse
|
8
|
Wang T, Cui W, Nie F, Huang X, Huang L, Liu L, Zhu Y, Zheng R. Comparative Study of the Efficacy of the Ovarian-Adnexa Reporting and Data System Ultrasound Combined With Contrast-Enhanced Ultrasound and the ADNEX MR Scoring System in the Diagnosis of Adnexal Masses. ULTRASOUND IN MEDICINE & BIOLOGY 2023:S0301-5629(23)00170-9. [PMID: 37321953 DOI: 10.1016/j.ultrasmedbio.2023.05.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 04/23/2023] [Accepted: 05/22/2023] [Indexed: 06/17/2023]
Abstract
OBJECTIVE The aims of this study were to develop the Ovarian-Adnexa Reporting and Data System (O-RADS) and O-RADS + contrast-enhanced ultrasound (O-RADS CEUS) scoring system to distinguish adnexal masses (AMs) and to compare the diagnostic efficacy of these systems with that of a magnetic resonance imaging scoring system (ADNEX MR). METHODS We retrospectively evaluated 278 ovarian masses from 240 patients between May 2017 and July 2022. Pathology and adequate follow-up were used as reference standards for comparing the validity of O-RADS, O-RADS CEUS and ADNEX MR scoring to diagnose AMs. Area under the curve (AUC), sensitivity and specificity were calculated. The inter-class correlation coefficient (ICC) was calculated to evaluate inter-reader agreement (IRA) between the two sonographers and two radiologists who analyzed the findings with the three modalities. RESULTS The AUCs of O-RADS, O-RADS CEUS and ADNEX MR scores were 0.928 (95% confidence interval [CI]: 0.895-0.956), 0.951(95% CI: 0.919-0.973) and 0.964 (95% CI: 0.935-0.983), respectively. Their sensitivities were 95.7%, 94.3 and 91.4%, and their specificities were 81.3%, 92.3% and 97.1%, respectively. The three modalities had accuracies of 84.9%, 92.8% and 95.7%, respectively. O-RADS had the highest sensitivity but significantly lower specificity (p < 0.001), whereas the ADNEX MR scoring had the highest specificity (p < 0.001) but lower sensitivity (p < 0.001). O-RADS CEUS had intermediate sensitivity and specificity (p < 0.001). CONCLUSION The addition of CEUS significantly improves the efficacy of O-RADS in diagnosing AMs. The diagnostic efficacy of the combination is comparable to that of the ADNEX MR scoring system.
Collapse
Affiliation(s)
- Ting Wang
- Ultrasound Medical Center, Lanzhou University Second Hospital, Cuiyingmen No.82, Chengguan District, Lanzhou 730030, China; Gansu Province Clinical Research Center for Ultrasonography, Lanzhou, China; Gansu Province Medical Engineering Research Center for Intelligence Ultrasound, Lanzhou, China
| | - Wenjun Cui
- Department of Magnetic Resonance, Lanzhou University Second Hospital, Gansu, China
| | - Fang Nie
- Ultrasound Medical Center, Lanzhou University Second Hospital, Cuiyingmen No.82, Chengguan District, Lanzhou 730030, China; Gansu Province Clinical Research Center for Ultrasonography, Lanzhou, China; Gansu Province Medical Engineering Research Center for Intelligence Ultrasound, Lanzhou, China.
| | - Xiao Huang
- Ultrasound Medical Center, Lanzhou University Second Hospital, Cuiyingmen No.82, Chengguan District, Lanzhou 730030, China; Gansu Province Clinical Research Center for Ultrasonography, Lanzhou, China; Gansu Province Medical Engineering Research Center for Intelligence Ultrasound, Lanzhou, China
| | - Lele Huang
- Department of Nuclear Medicine, Lanzhou University Second Hospital, Gansu, China
| | - Luping Liu
- Ultrasound Medical Center, Lanzhou University Second Hospital, Cuiyingmen No.82, Chengguan District, Lanzhou 730030, China; Gansu Province Clinical Research Center for Ultrasonography, Lanzhou, China; Gansu Province Medical Engineering Research Center for Intelligence Ultrasound, Lanzhou, China
| | - Yangyang Zhu
- Ultrasound Medical Center, Lanzhou University Second Hospital, Cuiyingmen No.82, Chengguan District, Lanzhou 730030, China; Gansu Province Clinical Research Center for Ultrasonography, Lanzhou, China; Gansu Province Medical Engineering Research Center for Intelligence Ultrasound, Lanzhou, China
| | - Rongfang Zheng
- Department of Gynaecology, Lanzhou University Second Hospital, Gansu, China
| |
Collapse
|
9
|
Pelayo M, Pelayo-Delgado I, Sancho-Sauco J, Sanchez-Zurdo J, Abarca-Martinez L, Corraliza-Galán V, Martin-Gromaz C, Pablos-Antona MJ, Zurita-Calvo J, Alcázar JL. Comparison of Ultrasound Scores in Differentiating between Benign and Malignant Adnexal Masses. Diagnostics (Basel) 2023; 13:diagnostics13071307. [PMID: 37046525 PMCID: PMC10093240 DOI: 10.3390/diagnostics13071307] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/26/2023] [Accepted: 03/28/2023] [Indexed: 04/03/2023] Open
Abstract
Subjective ultrasound assessment by an expert examiner is meant to be the best option for the differentiation between benign and malignant adnexal masses. Different ultrasound scores can help in the classification, but whether one of them is significantly better than others is still a matter of debate. The main aim of this work is to compare the diagnostic performance of some of these scores in the evaluation of adnexal masses in the same set of patients. This is a retrospective study of a consecutive series of women diagnosed as having a persistent adnexal mass and managed surgically. Ultrasound characteristics were analyzed according to IOTA criteria. Masses were classified according to the subjective impression of the sonographer and other ultrasound scores (IOTA simple rules -SR-, IOTA simple rules risk assessment -SRRA-, O-RADS classification, and ADNEX model -with and without CA125 value-). A total of 122 women were included. Sixty-two women were postmenopausal (50.8%). Eighty-one women had a benign mass (66.4%), and 41 (33.6%) had a malignant tumor. The sensitivity of subjective assessment, IOTA SR, IOTA SRRA, and ADNEX model with or without CA125 and O-RADS was 87.8%, 66.7%, 78.1%, 95.1%, 87.8%, and 90.2%, respectively. The specificity for these approaches was 69.1%, 89.2%, 72.8%, 74.1%, 67.9%, and 60.5%, respectively. All methods with similar AUC (0.81, 0.78, 0.80, 0.88, 0.84, and 0.75, respectively). We concluded that IOTA SR, IOTA SRRA, and ADNEX models with or without CA125 and O-RADS can help in the differentiation of benign and malignant masses, and their performance is similar to the subjective assessment of an experienced sonographer.
Collapse
Affiliation(s)
- Mar Pelayo
- Department of Radiology, Hospital HM Puerta del Sur, 28938 Móstoles, Spain;
- Department of Radiology, Hospital HM Rivas, 28521 Madrid, Spain
| | - Irene Pelayo-Delgado
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
- Correspondence: (I.P.-D.); (J.L.A.)
| | - Javier Sancho-Sauco
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | | | - Leopoldo Abarca-Martinez
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | - Virginia Corraliza-Galán
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | - Carmen Martin-Gromaz
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | - María Jesús Pablos-Antona
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | - Julia Zurita-Calvo
- Department of Obstetrics and Gynecology, Hospital Ramon y Cajal, 28034 Madrid, Spain; (J.S.-S.); (L.A.-M.); (V.C.-G.); (C.M.-G.); (M.J.P.-A.); (J.Z.-C.)
| | - Juan Luis Alcázar
- Department of Obstetrics and Gynecology, Clinica Universidad de Navarra, 31008 Pamplona, Spain
- Correspondence: (I.P.-D.); (J.L.A.)
| |
Collapse
|
10
|
Alcázar JL, Rodriguez-Guzman L, Vara J, Amor F, Diaz L, Vaccaro H. Gynecologic Imaging and Reporting Data System for classifying adnexal masses. Minerva Obstet Gynecol 2023; 75:69-79. [PMID: 36790399 DOI: 10.23736/s2724-606x.22.05122-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
INTRODUCTION To perform a systematic review and meta-analysis of the diagnostic performance of the so-called Gynecologic Imaging and Report Data System (GI-RADS) for classifying adnexal masses. EVIDENCE ACQUISITION A search for studies reporting about the use of GI-RADS system for classifying adnexal masses from January 2009 to December 2021 was performed in Medline (Pubmed), Google Scholar, Scopus, Cochrane, and Web of Science databases. Pooled sensitivity, specificity, positive and negative likelihood ratios and diagnostic odd ratio (DOR) were calculated. Studies' quality was evaluated using QUADAS-2. EVIDENCE SYNTHESIS We identified 510 citations. Ultimately, 26 studies comprising 7350 masses were included. Mean prevalence of ovarian malignancy was 26%. The risk of bias was high in eight studies for domain "patient selection" and low for "index test," "reference test" domains for all studies. Overall, pooled estimated sensitivity, specificity, positive likelihood ratio, and negative likelihood ratio and DOR of GI-RADS system for classifying adnexal masses were 94% (95% confidence interval [CI]=91-96%), 90% (95% CI=87-92%), 9.1 (95% CI=7.0-11.9), and 0.07 (95% CI=0.05-0.11), and 132 (95% CI=78-221), respectively. Heterogeneity was high for both sensitivity and specificity. Meta-regression showed that multiple observers and study's design explained this heterogeneity among studies. CONCLUSIONS GI-RADS system has a good diagnostic performance for classifying adnexal masses.
Collapse
Affiliation(s)
- Juan L Alcázar
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, Pamplona, Spain -
| | | | - Julio Vara
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, Pamplona, Spain
| | - Fernando Amor
- Panoramic Ultrasonic Ultrasound Center, Santiago, Chile
| | - Linder Diaz
- AGB Ultrasonography Center, Clínica Sanatorio Alemán S.A., Concepción, Chile
| | | |
Collapse
|
11
|
Phillips CH, Guo Y, Strachowski LM, Jha P, Reinhold C, Andreotti RF. The Ovarian/Adnexal Reporting and Data System for Ultrasound: From Standardized Terminology to Optimal Risk Assessment and Management. Can Assoc Radiol J 2023; 74:44-57. [PMID: 35831958 DOI: 10.1177/08465371221108057] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023] Open
Abstract
The American College of Radiology (ACR) Ovarian-Adnexal Reporting and Data System (O-RADS) lexicon and risk assessment tool for ultrasound (US) provides a framework for characterization of ovarian and adnexal pathology with the ultimate goal of harmonizing reporting and patient management strategies. Since the first O-RADS US publication in 2018, multiple validation studies have shown O-RADS US to have excellent diagnostic accuracy, with the majority of these studies using O-RADS 4 as the optimal cut-off for detecting ovarian cancer. Most of the existing validation studies include a dedicated training phase and confirm that ORADS US categories and lexicon descriptors are associated with high level inter-read agreement, regardless of radiologist training level or practice experience. O-RADS US has a similar inter-reader agreement when compared to Gynecologic Imaging Reporting and Data System (GIRADS), Assessment of Different Neoplasias in the adnexa (ADNEX), and International Tumor Analysis Group (IOTA) simple rules. System descriptors have been shown to correlate with expected malignancy rates and the O-RADS US risk stratification system has been shown to perform in the expected range of malignancy risk per category. Further directions will focus on clarifying governing concepts and lexicon terminology as well as further refining risk stratification categories based on data from published validation studies.
Collapse
Affiliation(s)
- Catherine H Phillips
- Department of Radiology and Radiological Sciences, 612495Vanderbilt University Medical Center, Nashville, TN, USA
| | - Yang Guo
- Department of Radiology, 381760Brigham and Women's Hospital, Boston, MA, USA
| | - Loretta M Strachowski
- Department of Radiology and Biomedical Imaging, Department of Obstetrics, Gynecology, and Reproductive Sciences, 192653University of California, San Francisco, CA, USA
| | - Priyanka Jha
- Department of Radiology and Biomedical Imaging, 192653University of California, San Francisco, CA, USA
| | - Caroline Reinhold
- Department of Radiology, McGill University Health Centre, 54473McGill University, Montreal, QC, Canada.,Co-Director, Augmented Intelligence Precision Health Laboratory, Research Institute of the McGill University Health Center, Montreal, Canada.,Montreal Imaging Experts Inc., Montreal, Canada
| | - Rochelle F Andreotti
- Department of Radiology and Radiological Sciences, Department of Obstetrics and Gynecology, 612495Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
12
|
Wu M, Wang Q, Zhang M, Cao J, Chen Y, Zheng J, Luo L, Su M, Lin X, Kuang X, Zhang X. Does Combing O-RADS US and CA-125 Improve Diagnostic Accuracy in Assessing Adnexal Malignancy Risk in Women With Different Menopausal Status? JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2023; 42:675-685. [PMID: 35880406 DOI: 10.1002/jum.16065] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 07/03/2022] [Accepted: 07/10/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVES To evaluate the individual and combined performances of the Ovarian-adnexal Reporting and Data System Ultrasound (O-RADS US) and serum cancer antigen 125 (CA-125) in assessing adnexal malignancy risk in women with different menopausal status. METHODS This retrospective study included patients with adnexal masses scheduled for surgery based on their preoperative US and histopathology results between January 2018 and January 2020. O-RADS were used to assess adnexal malignancy by two experienced radiologists. The area under the receiver operating characteristic curves (AUCs) were used to compare the accuracy of O-RADS and a combination of O-RADS and CA-125. The weighted κ index was used to evaluate the inter-reviewer agreement. RESULTS Overall, the data of 443 lesions in 443 patients were included, involving 312 benign lesions and 131 malignant lesions. There were 361 premenopausal and 82 postmenopausal patients. The inter-reviewer agreement for the two radiologists was very good (weighted κ: 0.833). Combing O-RADS US and CA-125 significantly increased diagnostic accuracy for classifying malignant from benign adnexal masses, compared with O-RADS US alone (AUC: 0.97 vs 0.95, P < .001 for premenopausal population and AUC: 0.93 vs 0.85, P < .001 for postmenopausal population). The AUCs of O-RADS with and without CA-125 ranged from 0.50 to 0.99 for different adnexal pathology subtypes (ie, benign, borderline, Stage I-IV, and metastatic tumors). CONCLUSION The addition of CA-125 helps improve discrimination of O-RADS US between benign and malignant adnexal masses, especially in postmenopausal women.
Collapse
Affiliation(s)
- Manli Wu
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Qingjuan Wang
- Department of Ultrasound, Third Hospital of Longgang, Shenzhen, Guangdong Province, China
| | - Man Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Junyan Cao
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Ying Chen
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Jian Zheng
- Department of Ultrasound, Third Hospital of Longgang, Shenzhen, Guangdong Province, China
| | - Liping Luo
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Manting Su
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Xin Lin
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Xiaohong Kuang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| | - Xinling Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong Province, China
| |
Collapse
|
13
|
Wang H, Wang L, An S, Ma Q, Tu Y, Shang N, Pan Y. American college of radiology ovarian-adnexal reporting and data system ultrasound (O-RADS): Diagnostic performance and inter-reviewer agreement for ovarian masses in children. Front Pediatr 2023; 11:1091735. [PMID: 36969276 PMCID: PMC10030612 DOI: 10.3389/fped.2023.1091735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 02/20/2023] [Indexed: 03/29/2023] Open
Abstract
Objective To evaluate the diagnostic performance and inter-observer agreement of the American College of Radiology Ovarian-Adnexal Reporting and Data System Ultrasound (O-RADS) in the diagnosis of ovarian masses in children. Methods From June 2012 to December 2021, 163 ovarian masses in 159 patients with pathologic results were retrospectively analyzed. Each mass was classified into an O-RADS category according to the criteria. The diagnostic performance of O-RADS for detecting malignant ovarian masses was assessed using histopathology as the reference standard. Kappa (k) statistic was used to assess inter-observer agreement between a less-experienced and a well-experienced radiologist. Results Out of 163 ovarian masses, 18 (11.0%) were malignant and 145 (89.0%) were benign. The malignancy rates of O-RADS 5, O-RADS 4, and O-RADS 3 masses were 72.7%, 34.6%, and 4.8%, respectively. The area under the receiver operating characteristic curve was 0.944 (95% CI, 0.908-0.981). The optimal cutoff value for predicting malignant ovarian masses was > O-RADS 3 with a sensitivity, specificity, and accuracy of 94.4%, 86.2% and 86.2% respectively. The inter-observer agreement of the O-RADS category was good (k = 0.777). Conclusions O-RADS has a high diagnostic performance for children with ovarian masses. It provides an effective malignant risk classification for ovarian masses in children, which shows high consistency between radiologists with different levels of experience.
Collapse
|
14
|
O-RADS Ultrasound Version 1: A Scenario-Based Review of Implementation Challenges. AJR Am J Roentgenol 2022; 219:916-927. [PMID: 35856453 DOI: 10.2214/ajr.22.28061] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound (US) risk stratification and management system was first published by the American College of Radiology in 2020. It provides standardized terminology for evaluation of ovarian and adnexal masses, aids risk stratification, and provides management guidelines for different categories of lesions. This system has been validated by subsequent research and found to be a useful diagnostic and management tool. However, as noted in the system's governing concepts, in some clinical scenarios, such as patients with acute symptoms or with a history of ovarian malignancy, O-RADS US does not apply, or the system's standard management may be adjusted. Additional scenarios, such as an adnexal mass in pregnancy, present challenges in the application of O-RADS US to assist diagnosis and management. The purpose of this article is to highlight 10 clinical scenarios in which O-RADS US version 1 may not apply, may be difficult to apply, or may require modified management. Additional scenarios in which O-RADS US can be appropriately applied are also described.
Collapse
|
15
|
Guo Y, Phillips CH, Suarez-Weiss K, Roller LA, Frates MC, Benson CB, Shinagare AB. Interreader Agreement and Intermodality Concordance of O-RADS US and MRI for Assessing Large, Complex Ovarian-Adnexal Cysts. Radiol Imaging Cancer 2022; 4:e220064. [PMID: 36178350 PMCID: PMC9530774 DOI: 10.1148/rycan.220064] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023]
Abstract
Purpose To assess interreader agreement of the Ovarian-Adnexal Reporting and Data System (O-RADS) and intermodality concordance between US and MRI for characterizing complex adnexal cysts measuring 5 cm or larger. Materials and Methods This retrospective study included 58 "complex cysts" measuring at least 5 cm in size observed at both US and MRI in 54 women (median age, 37 years ± 12 [SD]; seven postmenopausal women) between July 2017 and June 2020, identified from an electronic US database. A separate set of two blinded radiologists independently reviewed the US or MR images to assign the O-RADS category, and an adjudicator resolved discrepancies (a total of six readers). Lesion outcome (49 benign, eight malignant, one lost to follow-up) was recorded. Interreader agreement of O-RADS US and O-RADS MRI and concordance between US and MRI were analyzed. Results Interreader agreement was fair for US (κ = 0.31), moderate for MRI (κ = 0.43), and moderate between US and MRI (κ = 0.58). A significant positive correlation was found between O-RADS US and MRI (τ = 0.72, P < .001). The O-RADS 4 threshold yielded the highest accuracy for both US and MRI (area under the receiver operating characteristic curve = 0.92 and 0.995, respectively). Considering O-RADS US 4 or 5 as potentially malignant and 1-3 as benign, eight lesions that were assessed as potentially malignant at US were correctly downgraded to benign by using findings at MRI. Using findings at MRI, one malignant lesion that was assessed as benign at US was upgraded to potentially malignant. Conclusion O-RADS US and MRI had excellent performance and positive correlation, but significant interobserver variability remains. Keywords: Ovary, MR Imaging, Ultrasonography © RSNA, 2022 See also the commentary by Baumgarten in this issue.
Collapse
|
16
|
Vara J, Manzour N, Chacón E, López-Picazo A, Linares M, Pascual MÁ, Guerriero S, Alcázar JL. Ovarian Adnexal Reporting Data System (O-RADS) for Classifying Adnexal Masses: A Systematic Review and Meta-Analysis. Cancers (Basel) 2022; 14:cancers14133151. [PMID: 35804924 PMCID: PMC9264796 DOI: 10.3390/cancers14133151] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 06/22/2022] [Accepted: 06/22/2022] [Indexed: 11/16/2022] Open
Abstract
Simple Summary We performed a systematic review and meta-analysis aiming to assess the diagnostic performance of the Ovarian Adnexal Report Data System (O-RADS) using transvaginal ultrasound for classifying adnexal masses. Data from 11 studies comprising 4634 masses showed that the pooled estimated sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio of O-RADS system for classifying adnexal masses were 97% (95% confidence interval (CI) = 94%–98%), 77% (95% CI = 68%–84%), 4.2 (95% CI= 2.9–6.0), 0.04 (95% CI = 0.03–0.07), and 96 (95% CI = 50–185), respectively. We concluded that the O-RADS system has good sensitivity and moderate specificity for classifying adnexal masses. Abstract In this systematic review and meta-analysis, we aimed to assess the pooled diagnostic performance of the so-called Ovarian Adnexal Report Data System (O-RADS) for classifying adnexal masses using transvaginal ultrasound, a classification system that was introduced in 2020. We performed a search for studies reporting the use of the O-RADS system for classifying adnexal masses from January 2020 to April 2022 in several databases (Medline (PubMed), Google Scholar, Scopus, Cochrane, and Web of Science). We selected prospective and retrospective cohort studies using the O-RADS system for classifying adnexal masses with histologic diagnosis or conservative management demonstrating spontaneous resolution or persistence in cases of benign appearing masses after follow-up scan as the reference standard. We excluded studies not related to the topic under review, studies not addressing O-RADS classification, studies addressing MRI O-RADS classification, letters to the editor, commentaries, narrative reviews, consensus documents, and studies where data were not available for constructing a 2 × 2 table. The pooled sensitivity, specificity, positive and negative likelihood ratios, and diagnostic odds ratio (DOR) were calculated. The quality of the studies was evaluated using QUADAS-2. A total of 502 citations were identified. Ultimately, 11 studies comprising 4634 masses were included. The mean prevalence of ovarian malignancy was 32%. The risk of bias was high in eight studies for the “patient selection” domain. The risk of bias was low for the “index test” and “reference test” domains for all studies. Overall, the pooled estimated sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and DOR of the O-RADS system for classifying adnexal masses were 97% (95% confidence interval (CI) = 94%–98%), 77% (95% CI = 68%–84%), 4.2 (95% CI = 2.9–6.0), 0.04 (95% CI = 0.03–0.07), and 96 (95% CI = 50–185), respectively. Heterogeneity was moderate for sensitivity and high for specificity. In conclusion, the O-RADS system has good sensitivity and moderate specificity for classifying adnexal masses.
Collapse
Affiliation(s)
- Julio Vara
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 31008 Pamplona, Spain; (J.V.); (N.M.); (E.C.); (A.L.-P.)
| | - Nabil Manzour
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 31008 Pamplona, Spain; (J.V.); (N.M.); (E.C.); (A.L.-P.)
| | - Enrique Chacón
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 31008 Pamplona, Spain; (J.V.); (N.M.); (E.C.); (A.L.-P.)
| | - Ana López-Picazo
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 31008 Pamplona, Spain; (J.V.); (N.M.); (E.C.); (A.L.-P.)
| | - Marta Linares
- Department of Obstetrics and Gynecology, Universitiy Hospital Puerta del Mar, 11009 Cadiz, Spain;
| | - Maria Ángela Pascual
- Department of Obstetrics, Gynecology, and Reproduction, Hospital Universitari Dexeus, 08028 Barcelona, Spain;
| | - Stefano Guerriero
- Department of Obstetrics and Gynecology, University of Cagliari, Policlinico Universitario Duilio Casula, 09042 Monserrato, Cagliari, Italy;
| | - Juan Luis Alcázar
- Department of Obstetrics and Gynecology, Clínica Universidad de Navarra, 31008 Pamplona, Spain; (J.V.); (N.M.); (E.C.); (A.L.-P.)
- Correspondence: ; Tel.: +34-948-296234; Fax: +34-948296500
| |
Collapse
|
17
|
Guo Y, Zhao B, Zhou S, Wen L, Liu J, Fu Y, Xu F, Liu M. A comparison of the diagnostic performance of the O-RADS, RMI4, IOTA LR2, and IOTA SR systems by senior and junior doctors. Ultrasonography 2022; 41:511-518. [PMID: 35196832 PMCID: PMC9262660 DOI: 10.14366/usg.21237] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Accepted: 01/31/2022] [Indexed: 11/04/2022] Open
Abstract
Purpose This study compared the diagnostic performance of the Ovarian-Adnexal Reporting and Data System (O-RADS), the Risk of Malignancy Index 4 (RMI4), the International Ovarian of Tumor Analysis Logistic Regression Model 2 (IOTA LR2), and the IOTA Simple Rules (IOTA SR) in predicting the malignancy of adnexal masses (AMs). Methods This retrospective study included 575 women with AMs between 2017 and 2020. All clinical messages, ultrasound images, and pathological findings were collected. Two senior doctors (group I) and two junior doctors (group II) used the four systems to classify AMs. The postoperative pathological diagnosis was used as the gold standard to evaluate the diagnostic efficiency. A receiver operating characteristic curve was used to test the diagnostic performance. The interrater agreement between the two groups was tested using kappa values. Results Of all 592 AMs, 447 (75.5%) were benign, 123 (20.8%) were malignant, and 22 (3.7%) were borderline. The intergroup consistency test yielded kappa values of 0.71, 0.92, 0.68, and 0.77 for the O-RADS, RMI4, IOTA LR2, and IOTA SR, respectively. To predict malignant lesions, the areas under the curve of the O-RADS, RMI4, IOTA LR2, and IOTA SR systems were 0.90, 0.89, 0.90, and 0.86 for group I and 0.89, 0.87, 0.88, and 0.84 for group II, respectively. The O-RADS had the highest sensitivity (91.0% in group I and 84.8% in group II). Conclusion The four diagnostic systems could compensate for junior doctors’ inexperience in predicting malignant adnexal lesions. The O-RADS performed best and showed the highest sensitivity.
Collapse
Affiliation(s)
- Yuyang Guo
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Baihua Zhao
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Shan Zhou
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Lieming Wen
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Jieyu Liu
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Yaqian Fu
- Health Management Center, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Fang Xu
- Department of Ultrasonography, The First Hospital of Changsha, Changsha, China
| | - Minghui Liu
- Department of Ultrasound Diagnosis, The Second Xiangya Hospital, Central South University, Changsha, China
| |
Collapse
|