Improving the preoperative classification of adnexal masses as benign or malignant by second-stage tests

Benzodiazepine-related dementia risks and protopathic biases revealed by multiple-kernel learning with electronic medical records

Objectives

To simultaneously estimate how the risk of incident dementia nonlinearly varies with the administration period and cumulative dose of benzodiazepines, the duration of disorders with an indication for benzodiazepines, and other potential confounders, with the goal of settling the controversy over the role of benzodiazepines in the development of dementia.

Methods

The classical hazard model was extended using the techniques of multiple-kernel learning. Regularised maximum-likelihood estimation, including determination of hyperparameter values with 10-fold cross-validation, bootstrap goodness-of-fit test, and bootstrap estimation of confidence intervals, was applied to cohorts retrospectively extracted from electronic medical records of our university hospitals between 1 November 2004 and 31 July 2020. The analysis was mainly focused on 8160 patients aged 40 or older with new onset of insomnia, affective disorders, or anxiety disorders, who were followed up for 4.10 ± 3.47 years.

Results

Besides previously reported risk associations, we detected significant nonlinear risk variations over 2-4 years attributable to the duration of insomnia and anxiety disorders, and to the administration period of short-acting benzodiazepines. After nonlinear adjustment for potential confounders, we observed no significant risk associations with long-term use of benzodiazepines.

Conclusions

The pattern of the detected nonlinear risk variations suggested reverse causation and confounding. Their putative bias effects over 2-4 years suggested similar biases in previously reported results. These results, together with the lack of significant risk associations with long-term use of benzodiazepines, suggested the need to reconsider previous results and methods for future analysis.

Vessel morphology depicted by three-dimensional power Doppler ultrasound as second-stage test in adnexal tumors that are difficult to classify: prospective diagnostic accuracy study

OBJECTIVES

To assess whether vessel morphology depicted by three-dimensional (3D) power Doppler ultrasound improves discrimination between benignity and malignancy if used as a second-stage test in adnexal masses that are difficult to classify.

METHODS

This was a prospective observational international multicenter diagnostic accuracy study. Consecutive patients with an adnexal mass underwent standardized transvaginal two-dimensional (2D) grayscale and color or power Doppler and 3D power Doppler ultrasound examination by an experienced examiner, and those with a 'difficult' tumor were included in the current analysis. A difficult tumor was defined as one in which the International Ovarian Tumor Analysis (IOTA) logistic regression model-1 (LR-1) yielded an ambiguous result (risk of malignancy, 8.3% to 25.5%), or as one in which the ultrasound examiner was uncertain regarding classification as benign or malignant when using subjective assessment. Even when the ultrasound examiner was uncertain, he/she was obliged to classify the tumor as most probably benign or most probably malignant. For each difficult tumor, one researcher created a 360° rotating 3D power Doppler image of the vessel tree in the whole tumor and another of the vessel tree in a 5-cm³ spherical volume selected from the most vascularized part of the tumor. Two other researchers, blinded to the patient's history, 2D ultrasound findings and histological diagnosis, independently described the vessel tree using predetermined vessel features. Their agreed classification was used. The reference standard was the histological diagnosis of the mass. The sensitivity of each test for discriminating between benign and malignant difficult tumors was plotted against 1 - specificity on a receiver-operating-characteristics diagram, and the test with the point furthest from the reference line was considered to have the best diagnostic ability.

RESULTS

Of 2403 women with an adnexal mass, 376 (16%) had a difficult mass. Ultrasound volumes were available for 138 of these cases. In 79/138 masses, the ultrasound examiner was uncertain about the diagnosis based on subjective assessment, in 87/138, IOTA LR-1 yielded an ambiguous result and, in 28/138, both methods gave an uncertain result. Of the masses, 38/138 (28%) were malignant. Among tumors that were difficult to classify as benign or malignant by subjective assessment, the vessel feature 'densely packed vessels' had the best discriminative ability (sensitivity 67% (18/27), specificity 83% (43/52)) and was slightly superior to subjective assessment (sensitivity 74% (20/27), specificity 60% (31/52)). In tumors in which IOTA LR-1 yielded an ambiguous result, subjective assessment (sensitivity 82% (14/17), specificity 79% (55/70)) was superior to the best vascular feature, i.e. changes in the diameter of vessels in the whole tumor volume (sensitivity 71% (12/17), specificity 69% (48/70)).

CONCLUSION

Vessel morphology depicted by 3D power Doppler ultrasound may slightly improve discrimination between benign and malignant adnexal tumors that are difficult to classify by subjective ultrasound assessment. For tumors in which the IOTA LR-1 model yields an ambiguous result, subjective assessment is superior to vessel morphology as a second-stage test. © 2020 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.

Diagnostic accuracy of transvaginal ultrasound examination for assigning a specific diagnosis to adnexal masses: A meta-analysis

Transvaginal ultrasound (TVUS) is a standard imaging modality for differentiating patients with benign or malignant suspected adnexal mass. To date, numerous studies have assessed the diagnostic accuracy of TVUS in various settings but with variable results. Therefore, the purpose of the present study was to perform a meta-analysis to evaluate the diagnostic accuracy of TVUS for the differentiation of adnexal masses. An electronic search in the Medline, Scopus, Cochrane and Embase databases from inception till November 2019 was carried out. Meta-analysis was performed to obtain pooled sensitivity and specificity of TVUS to distinguish malignant from benign adnexal masses. The quality assessment of diagnostic accuracy studies-2 tool was used to assess the quality of trials. A total of 41 studies with 18,391 patients were included. The pooled sensitivity and specificity of TVUS was 92% (95% CI: 90-94%) and 89% (95% CI: 85-92%), respectively. The area under the receiver operating characteristic curve was 0.96 (95% CI: 0.84-1.00). There was considerable heterogeneity with a statistically significant chi-square test (P<0.001) and I² of 99%. Meta-regression results indicated that index test standards, patient selection bias and study design were potential sources of heterogeneity (P<0.05). The funnel plot was symmetrical and low publication bias was confirmed by an insignificant Deek's test (P=0.90). The present systematic review and meta-analysis indicated that TVUS is useful in differentiating between benign and malignant tumours among patients with suspected adnexal mass with high sensitivity and specificity.

Imaging techniques for the pre-surgical diagnosis of adnexal tumours

A correct diagnosis of any adnexal mass is essential to triage women to appropriate treatment pathways. Several imaging techniques are available that may be used to provide an assessment of a mass before treatment, such as transvaginal ultrasonography, magnetic resonance imaging, computed tomography, and positron emission tomography combined with computed tomography. In this chapter, we focus in depth on the role of transvaginal ultrasonography, as current evidence suggests it is the most appropriate initial imaging investigation to identify and characterise any mass if present in women suspected of having adnexal pathology. Subjective assessment by an experienced ultrasound examiner is the optimal approach to diagnose masses, followed by risk models and rules developed by the International Ovarian Tumor Analysis study. A group of tumours has proven difficult to classify with transvaginal ultrasound, and remain a diagnostic challenge for which accurate second-stage tests would be of value. Some studies suggest that magnetic resonance imaging (MRI), compared with other imaging modalities, may play a role in the assessment of this cohort of 'difficult to classify' adnexal masses. These studies, however, did not report quality of transvaginal ultrasonography (i.e. experience level of the examiner) and lacked uniformity in describing the criteria used to define such 'difficult' masses. On the basis of standardised terminology developed by the International Ovarian Tumor Analysis study to describe adnexal masses, as well as prediction models and rules developed in the course of the study, we propose new criteria that we can use to clearly define complex or 'difficult to classify' adnexal masses to focus the role for second-line imaging tests, such as conventional magnetic resonance imaging combined with dynamic contrast-enhanced or diffusion-weighted sequences on masses where further tests other than ultrasonography would be of value.

Are serum HE4 or ROMA scores useful to experienced examiners for improving characterization of adnexal masses after transvaginal ultrasonography?

OBJECTIVE

To determine whether serum human-epididymis protein-4 (HE4) levels or Risk of Ovarian Malignancy Algorithm (ROMA) scores are useful second-stage tests for tumors thought to be difficult to characterize as benign or malignant on the basis of ultrasound findings by experienced examiners, and to investigate whether adding information on serum HE4 levels or ROMA scores to ultrasound findings improves diagnostic performance.

METHODS

This was a prospective cross-sectional diagnostic accuracy study conducted in a tertiary referral center that enrolled consecutive women with a known adnexal mass scheduled for surgery. Experienced level III examiners classified each mass as certainly or probably benign, difficult to classify, or probably or certainly malignant after preoperative ultrasound examination. Serum HE4 and CA 125 levels were measured before surgery.

RESULTS

The final database comprised 360 women, of whom 216 (60%) had benign and 144 (40%) had malignant disease. Examiners were highly confident in 196 cases (54%), moderately confident in 135 (38%) and completely uncertain about their diagnosis in 29 (8%) cases. With a sensitivity of 67% and specificity of 70%, subjective assessment outperformed HE4 and ROMA in the subgroup of difficult tumors. Both tests had low discriminatory capacity with poor areas under the receiver-operating characteristics curve of 0.536 (95% CI, 0.302-0.771) and 0.565 (95% CI, 0.294-0.836), respectively. A strategy that incorporates sequential testing of serum HE4 or ROMA scores after transvaginal ultrasonography resulted in a deterioration in overall test performance.

CONCLUSION

Measurement of serum HE4 or calculating scores using the ROMA as secondary tests does not seem useful for classifying adnexal tumors after subjective assessment with transvaginal ultrasonography.

[Sonographic diagnosis of presumed benign ovarian tumors]

To discriminate ovarian lesions is of particular importance in gynecological practice. Two main problems need answers: discrimination of benign and malignant adnexal masses and choice of the appropriate surgical treatment if necessary. Nearly 2% of the adnexal masses are ovarian carcinomas or borderline tumors. It is now, well established that ultrasonography is the gold standard for ovarian cyst diagnosis. The purpose of this data was to review the literature and to establish, with the evidence base medicine model, which parameters and existing diagnostic models using ultrasound and Doppler perform best in the evaluation of adnexal masses. Transvaginal sonography has demonstrated considerable advantage over conventional transabdominal sonography. However, transparietal sonography is still useful in large tumors. Definition of the nomenclature and classification was done and should be used. Unilocular ovarian cyst characterization seems easy using sonography and Doppler. In front of complication, discrimination of such functional cyst may be difficult but spontaneous regression confirms usually the expectative management. Dermoid cysts and endometriomas seem to be easier to discriminate from other adnexal masses. Ultrasound and morphologic parameters have a sensitivity of about 90% and a specificity of 80%; that makes this exam the gold standard for ovarian masses diagnosis. Only 50% of ovarian masses are characterized by sonography. Scoring systems help to differentiate benign from malignant masses (sensitivity of about 90%). Logistic regression and models are good methods especially for LR1 and 2 and RMI and may be useful for malignancy prediction but are difficult to use in current practice. Expert diagnosis is a subjective but most important performing parameter. Any suspicious ovarian mass or not easily diagnosed mass requires sonography by an expert, which can first use all the techniques and the different parameters to discriminate benign and malignant tumors. An explicit report will help the physician to define the right attitude for an appropriate management. Six to 16% of adnexial masses are complex or not classified and will result in MRI prescription or surgery.

Usefulness of the HE4 biomarker as a second-line test in the assessment of suspicious ovarian tumors

Purpose

The aim of our study was the evaluation of HE4 usefulness as a test in assessment of ovarian tumors which are suspicious and difficult to classify correctly via subjective ultrasound examination.

Methods

In this retrospective cohort study 253 women diagnosed with adnexal masses were examined preoperatively. Suspicious tumors (n = 145) were divided into groups of: “probably benign” (n = 70), “uncertain” (n = 34), and “probably malignant” (n = 41). “Uncertain” tumors were also assessed as “benign” (n = 11) or “malignant” (n = 23). The logistic regression model was performed to analyze if the serum marker improves the prediction of a malignant finding and net reclassification improvement (NRI) was calculated to measure diagnostic improvement.

Results

Within the analyzed group 85 (58.6 %) benign and 60 (41.4 %) malignant tumors were confirmed histopathologically. The comparison of HE4 with subjective ultrasound assessment showed lowered NRI in the entire analyzed group as well as in the groups of tumors classified as “probably benign” or “probably malignant” (NRI = −0.16; P = 0.0139 and NRI = −0.133; P = 0.0489, respectively). The analysis of logistic regression model confirmed that biomarkers do not improve diagnostic accuracy. The difference between areas under ROC for HE4 (0.891) and CA125 (0.902) was not statistically significant (P = 0.760).

Conclusions

After subjective ultrasound assessment, the addition of the second-line test—HE4 as well as CA125 serum level does not improve diagnostic performance. However, HE4 evaluation satisfies the clinical expectations of diagnostic tools for ovarian tumors and, thus, may be useful to less experienced sonographers.

Intra- and interobserver agreement when describing adnexal masses using the International Ovarian Tumor Analysis terms and definitions: a study on three-dimensional ultrasound volumes

OBJECTIVES

To estimate intraobserver repeatability and interobserver agreement in: (1) describing adnexal masses using the International Ovarian Tumor Analysis (IOTA) terms and definitions; (2) the risk of malignancy calculated using IOTA logistic regression model 1 (LR1) and model 2 (LR2); and (3) the diagnosis made on the basis of subjective assessment of ultrasound images.

METHODS

One-hundred and three adnexal masses were examined by transvaginal gray-scale and power Doppler ultrasound. Three-dimensional ultrasound volumes of the mass were saved. After 12-18 months the volumes were analyzed twice, 1-6 months apart, by each of two independent experienced sonologists who used the IOTA terms and definitions to describe the masses. The risk of malignancy was calculated using LR1 and LR2. The sonologists also classified the masses as benign or malignant using subjective assessment.

RESULTS

Eighty-four masses were benign, eight were borderline and 11 were invasively malignant. There was substantial variability within and between observers in the results of measurements included in LR1 and LR2 and some variability also when assessing categorical variables included in the models (agreement = 51-100% and kappa = 0.42-1.00). This resulted in substantial variability in the calculated risk of malignancy, the limits of agreement indicating that the calculated risk of malignancy could vary by a factor of 5-20 within and between observers. The reliability of the calculated risk of malignancy was moderate (LR1) or poor (LR2) when the calculated risk of malignancy was > 10% (intraclass correlation coefficients varied from 0.21 to 0.73). Interobserver agreement when classifying tumors as benign or malignant using the predetermined risk of malignancy cut-off of 10% was fair to good (agreement = 85% and kappa = 0.61 for LR1; agreement = 81% and kappa = 0.52 for LR2). Intra- and interobserver agreements for subjective assessment were 96%, 96% and 96% with kappa values of 0.89, 0.87 and 0.88, respectively.

CONCLUSIONS

Intra- and interobserver agreement in classifying tumors as benign or malignant using the risk of malignancy cut-off of 10% for LR1 and LR2 was fair or good, whilst the reproducibility of subjective assessment was excellent. The reliability of calculated risks > 10% was poor, and calculated risk > 10% cannot be used to discriminate between individuals at different risk. These results cannot be extrapolated to real-time ultrasound examinations.