An evaluation of the inter-observer and intra-observer variability of the ultrasound diagnosis of polycystic ovaries

Validation of an Anti-Müllerian Hormone Cutoff for Polycystic Ovarian Morphology in the Diagnosis of Polycystic Ovary Syndrome in the HARMONIA Study: Protocol for a Prospective, Noninterventional Study

BACKGROUND

Polycystic ovary syndrome (PCOS) is one of the most common endocrine disorders in women and is diagnosed using the Rotterdam criteria, including diagnosis of polycystic ovarian morphology (PCOM) by transvaginal ultrasound (TVUS). Due to high cost, availability, and the impact of the operator and ultrasound equipment on the reliability of the antral follicle count (AFC) by TVUS, an unmet need exists for a diagnostic test to determine PCOM without TVUS. A strong positive correlation between elevated anti-Müllerian hormone (AMH) levels and AFCs has been demonstrated in women with PCOS. In addition, recent updates to the international evidence-based PCOS guidelines state that serum AMH can be used as an alternative to TVUS-determined AFC, in the diagnosis of PCOM. The retrospective APHRODITE study derived and validated an AMH cutoff of 3.2 ng/mL for the Elecsys AMH Plus or Elecsys AMH assays (Roche) to diagnose PCOM in patients with PCOS.

OBJECTIVE

This study aims to further validate, in an independent prospective cohort, the AMH cutoff (3.2 ng/mL) for PCOM determination, which was previously derived and validated in the APHRODITE study.

METHODS

This large, prospective, multicenter, population-based, noninterventional study will evaluate the previously established AMH cutoff for the determination of PCOM during the diagnosis of PCOS using the Elecsys AMH Plus immunoassay in an independent population. Participants were women born between July 1985 and December 1987 in Northern Finland; the study partially links to the Northern Finland Birth Cohort 1986. We assessed the enrolled women, determined with the 2023 PCOS Guidelines, for current PCOS status and divided them by phenotype if positive. Each participant had 1 study visit to collect serum samples, record clinical data, and undergo a gynecological examination including TVUS. All data were collected by highly trained midwives or trained gynecologists. Sensitivity, specificity, and agreement measures were used to validate the previously determined cutoff in the whole population and in subpopulations based on phenotype and relevant demographic or clinical factors. The minimum target sample size was approximately 1800 women, including approximately 10% with PCOS.

RESULTS

At the time of manuscript submission, participant recruitment had concluded, and 1803 women were enrolled into the study. Data collection is complete and biostatistical analysis is planned for 2023.

CONCLUSIONS

To limit variability, there were few TVUS operators and only 2 TVUS machines of the same type. Additionally, all women who were taking oral contraceptives were excluded from the primary analysis population. Selection bias was limited as this was a population-based study and participants were not seeking treatment for PCOS symptoms. Validating the AMH cutoff in a large, population-based study will provide further evidence on the utility of the Elecsys AMH Plus or Elecsys AMH assays in PCOM diagnosis as an alternative to TVUS. Measuring AMH for PCOM diagnosis could reduce delayed or missed diagnoses due to operator-dependent TVUS examinations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05527353; http://tinyurl.com/2f3ffbdz.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/48854.

Determining the age group-based cut-off values of serum anti-Mullerian hormone concentrations to diagnose polycystic ovary syndrome

OBJECTIVE

To determine the cut-off values of the serum anti-Müllerian hormone (AMH) concentration for different age groups (21-25, 26-30, 31-35 years) to diagnose polycystic ovary syndrome (PCOS).

METHODS

In total, 187 women aged 21-35 years were included in this descriptive study. Patients diagnosed with PCOS according to the Rotterdam Criteria formed the PCOS group (n = 93), whereas those without symptoms related to PCOS formed the control group (n = 94). Follicular phase serum hormone concentrations were evaluated during the endocrinological assessment of patients with PCOS. Serum levels of estradiol, follicle-stimulating hormone (FSH), luteinizing hormone (LH), prolactin, total testosterone, dehydroepiandrosterone sulfate, sex hormone-binding globulin, androstenedione, and AMH were measured. The free androgen index and LH/FSH ratio were calculated. Cut-off values of serum AMH concentrations for the age groups were measured using receiver operating characteristic curve analysis.

RESULTS

The prevalence rates of frank, ovulatory, normoandrogenic, and non-polycystic ovary PCOS were 69.9, 10.8, 10.8, and 8.6%, respectively. Serum AMH concentrations >5.56 ng/mL were associated with PCOS in the 21-25-year-old group. The cut-off value was 4.01 ng/mL in the 26-30-year-old group, whereas it was 3.42 ng/mL in the oldest age group. The correlation between the antral follicle count (AFC) and serum AMH level was strong for each age group.

CONCLUSIONS

The serum AMH concentration is a valuable parameter for assessing patients with symptoms indicative of PCOS. We recommend measuring serum AMH levels to support the diagnosis or to use them instead of the AFC for the Rotterdam criteria.

Utility of trans-vaginal ultrasound in diagnosis and follow-up of non-pregnant sexually active females with lower ureteric calculi

Objective

To assess the utility of trans-vaginal ultrasonography in evaluation of non-pregnant sexually active female patients with lower ureteric calculi.

Methods

A prospective study was done from January 2015 to December 2017 including non-pregnant sexually active females with suspected ureteric calculus. Trans-abdominal ultrasound was initially done in all patients. In those patients in whom trans-abdominal ultrasound was inconclusive or there was indirect evidence of lower ureteric calculus in form of ureteral dilation but no calculus was evident, trans-vaginal ultrasound was done. The patients with ureteric calculi detected on trans-vaginal ultrasound and kept on conservative management were also followed up with trans-vaginal ultrasound. Non-contrast computed tomography was done in patients with inconclusive trans-vaginal ultrasound.

Results

As per the study protocol, 156 out of the total 468 patients evaluated by trans-abdominal ultrasound were eligible for trans-vaginal ultrasound. Trans-vaginal ultrasound was done in 149 patients, as seven patients did not give consent. Seventy-nine patients were detected with a lower ureteric calculus on trans-vaginal ultrasound and 27 patients had gynecologic or other cause for their symptoms. Forty-three patients had an inconclusive trans-vaginal ultrasound of which 36 underwent non-contrast computed tomography, among them only one patient had a lower ureteric calculus. Stone free status could be easily demonstrated on follow-up trans-vaginal ultrasound.

Conclusion

Trans-vaginal ultrasound in addition to trans-abdominal ultrasound is a very useful tool in evaluation of sexually active females with suspected lower ureteric calculus.

Comparison of uterine and ovarian stromal blood flow in patients with polycystic ovarian syndrome

Polycystic ovarian syndrome (PCOS) is one of the most common endocrine disorders. The aim of this study was to find the correlation between color Doppler ultrasound and serum tests as auxiliary diagnostic criteria in areas where there is no possibility of some tests. A total of 108 patients were enrolled. They were divided into three groups including patients with PCOS, patients with PCOA ultrasound, patients with ovaries and normal hormone tests. Transvaginal sonography was performed from three groups and the results were evaluated in gray scale. The volume of the ovary, the number of follicles and the placement of follicles were recorded using using Doppler spectrum of uterine artery and ovarian stroma. Their arterial resistance index was also calculated. In the next step, serum samples were evaluated to determine the level of LH, FSH, free testosterone, DHEAS and 17-OHP hormones in the early follicular phase. Gray scale ultrasonographic findings (volume and number of ovarian follicles) as well as LH values were higher in patients with PCOS than those in the other two groups. These results proved the reliability of using these factors in the prediction of PCOS. In this study, Doppler indexes did not correlate with the size of the ovaries, the number of ovarian follicles and the measured hormone levels. The findings of transvaginal ultrasound and investigating the relationship with clinical and laboratory outcomes, a more suitable pattern could be chosen for more accurate patient selection and, leading to timely treatment and reducing the complications of the disease.

Reproducibility of the transvaginal sonographic assessment of bladder wall thickness

OBJECTIVE

To assess whether transvaginal sonographic measurements of bladder wall thickness (BWT) have adequate reproducibility to detect differences in BWT potentially indicative of detrusor overactivity in women with overactive bladder.

STUDY DESIGN

Three reproducibility studies were undertaken to assess (A) total measurement error, (B) intra-observer variability and (C) inter-observer measurement in the interpretation of scans. Women recruited to the Bladder Ultrasound Study underwent a transvaginal ultrasound scan to obtain a measurement of BWT. When a second observer was available, women who agreed to have two transvaginal scans by different operators were recruited into study A. For study B the first observer reassessed a sample of the recorded images at a later date whilst for study C, a random selection of BWT images were read by a second assessor. Analytical variability, percentage of variability attributable to measurement error, within-person variation and the smallest real difference detectable were estimated.

RESULTS

One hundred and twenty-one women took part: 27 had repeat scans, 37 had scans re-read by the same observer, and 57 had scans read by two observers. In study A, 39% of the total variability in measurements was explained by measurement error (the remainder to within person change); the standard deviation (SD) of measurement error was 0.76mm and the smallest detectable clinical difference was 2.1mm. The SD of measurement error from scan interpretation was 0.42mm within observers (study B) and 0.35mm between observers (studyC).

CONCLUSION

The high levels of measurement error for a small measurement of BWT means it is unlikely Transvaginal ultrasound measurements have insufficient reliability and reproducibility to be an accurate diagnostic test.

Bladder ultrasonography for diagnosing detrusor overactivity: test accuracy study and economic evaluation

BACKGROUND

Urodynamics (UDS) has been considered the gold standard test for detrusor overactivity (DO) in women with an overactive bladder (OAB). Bladder ultrasonography to measure bladder wall thickness (BWT) is less invasive and has been proposed as an alternative test.

OBJECTIVES

To estimate the reliability, reproducibility, accuracy and acceptability of BWT in women with OAB, measured by ultrasonography, in the diagnosis of DO; to explore the role of UDS and its impact on treatment outcomes; and to conduct an economic evaluation of alternative care pathways.

DESIGN

A cross-sectional test accuracy study.

SETTING

22 UK hospitals.

PARTICIPANTS

687 women with OAB.

METHODS

BWT was measured using transvaginal ultrasonography, and DO was assessed using UDS, which was performed blind to ultrasonographic findings. Intraobserver and interobserver reproducibility were assessed by repeated measurements from scans in 37 and 57 women, respectively, and by repeated scans in 27 women. Sensitivity and specificity were computed at pre-specified thresholds. The smallest real differences detectable of BWT were estimated using one-way analysis of variance. The pain and acceptability of both tests were evaluated by a questionnaire. Patient symptoms were measured before testing and after 6 and 12 months using the International Consultation on Incontinence modular Questionnaire Overactive Bladder (short form) (ICIQ-OAB) questionnaire and a global impression of improvement elicited at 12 months. Interventions and patient outcomes were analysed according to urodynamic diagnoses and BWT measurements. A decision-analytic model compared the cost-effectiveness of care strategies using UDS, ultrasonography or clinical history, estimating the cost per woman successfully treated and the cost per quality-adjusted life-year (QALY).

RESULTS

BWT showed very low sensitivity and specificity at all pre-specified cut-off points, and there was no evidence of discrimination at any threshold (p = 0.25). Extensive sensitivity and subgroup analyses did not alter the interpretation of these findings. The smallest detectable difference in BWT was estimated to be 2 mm. Pain levels following both tests appeared relatively low. The proportion of women who found the test 'totally acceptable' was significantly higher with ultrasonography than UDS (81% vs. 56%; p < 0.001). Overall, subsequent treatment was highly associated with urodynamic diagnosis (p < 0.0001). There was no evidence that BWT had any relationship with the global impression of improvement responses at 20 months (p = 0.4). Bladder ultrasonography was more costly and less effective than the other strategies. The incremental cost-effectiveness ratio (ICER) of basing treatment on the primary clinical presentation compared with UDS was £491,500 per woman successfully treated and £60,200 per QALY. Performing a UDS in those women with a clinical history of mixed urinary incontinence had an ICER of £19,500 per woman successfully treated and £12,700 per QALY compared with the provision of urodynamic to all women. For DO cases detected, UDS was the most cost-effective strategy.

CONCLUSION

There was no evidence that BWT had any relationship with DO, regardless of the cut-off point, nor any relationship to symptoms as measured by the ICIQ-OAB. Bladder ultrasonography has no diagnostic or prognostic value as a test in this condition. Furthermore, despite its greater acceptability, BWT measurement was not sufficiently reliable or reproducible.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN46820623.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 20, No. 7. See the NIHR Journals Library website for further project information.

Sonographic evaluation of polycystic ovaries

The morphological features of the ovaries in women with polycystic ovary syndrome (PCOS) have been well described by ultrasound imaging technology. These include enlarged ovary size, multiple small follicles of similar size, increased ovarian stromal volume and echogenicity, peripheral distribution of the follicles, and higher stromal blood flow. Ultrasound identification of the presence of polycystic ovarian morphology (PCOM) has been recognized as a component of PCOS diagnosis. With the advance of ultrasound technology, new definition has been proposed recently. There is, however, a paucity of data for the ovarian morphology in normal and PCOS adolescents. Magnetic resonance imaging has the potential to be an alternative imaging modality for diagnosing PCOM in adolescence.

Dealing with inter-expert variability in retinopathy of prematurity: A machine learning approach

BACKGROUND AND OBJECTIVE

Understanding the causes of disagreement among experts in clinical decision making has been a challenge for decades. In particular, a high amount of variability exists in diagnosis of retinopathy of prematurity (ROP), which is a disease affecting low birth weight infants and a major cause of childhood blindness. A possible cause of variability, that has been mostly neglected in the literature, is related to discrepancies in the sets of important features considered by different experts. In this paper we propose a methodology which makes use of machine learning techniques to understand the underlying causes of inter-expert variability.

METHODS

The experiments are carried out on a dataset consisting of 34 retinal images, each with diagnoses provided by 22 independent experts. Feature selection techniques are applied to discover the most important features considered by a given expert. Those features selected by each expert are then compared to the features selected by other experts by applying similarity measures. Finally, an automated diagnosis system is built in order to check if this approach can be helpful in solving the problem of understanding high inter-rater variability.

RESULTS

The experimental results reveal that some features are mostly selected by the feature selection methods regardless the considered expert. Moreover, for pairs of experts with high percentage agreement among them, the feature selection algorithms also select similar features. By using the relevant selected features, the classification performance of the automatic system was improved or maintained.

CONCLUSIONS

The proposed methodology provides a handy framework to identify important features for experts and check whether the selected features reflect the pairwise agreements/disagreements. These findings may lead to improved diagnostic accuracy and standardization among clinicians, and pave the way for the application of this methodology to other problems which present inter-expert variability.

True Reproducibility of UltraSound Techniques (TRUST): systematic review of reliability studies in obstetrics and gynecology

OBJECTIVES

To examine the quality of methods used and the accuracy of the interpretation of agreement in existing studies that examine the reliability of ultrasound measurements and judgments in obstetrics and gynecology.

METHODS

A systematic search of MEDLINE was performed on 25 March 2014, looking for studies that examined the reliability of ultrasound measurements and judgments in obstetrics and gynecology with evaluation of concordance (CCC) or intraclass (ICC) correlation coefficients or kappa as a main objective.

RESULTS

Seven hundred and thirty-three records were examined on the basis of their title and abstract, of which 141 full-text articles were examined completely for eligibility. We excluded 29 studies because they did not report CCC/ICC/kappa, leaving 112 studies that were included in our analysis. Two studies reported both ICC and kappa and were counted twice, therefore, the number used as the denominator in the analyses was 114. Only 16/114 (14.0%) studies were considered to be well designed (independent acquisition and blinded analysis) and to have interpreted the results properly. Most errors occurring in the studies are likely to overestimate the reliability of the method examined.

CONCLUSIONS

The vast majority of published studies examined had important flaws in design, interpretation and/or reporting. Such limitations are important to identify as they might create false confidence in the existing measurements and judgments, jeopardizing clinical practice and future research. Specific guidelines aimed at improving the quality of reproducibility studies that examine ultrasound methods should be encouraged.

Comparative evaluation of sonographic ovarian morphology of Indian women with polycystic ovary syndrome versus those of normal women

OBJECTIVES

To study ovarian morphology by ultrasound in women with or without polycystic ovary syndrome (PCOS) and to establish cut-off values of these parameters in Indian women with PCOS.

MATERIALS AND METHODS

A total of 119 consecutive women diagnosed PCOS and 77 apparently healthy women were enrolled. Transabdominal ultrasound examination was carried out to assess ovarian volume, stromal echogenecity, follicle number and size. Cut-off values of the above ovarian parameters with sensitivity, specificity, positive predictive value (PPV) and negative predictive values (NPV) were calculated.

RESULTS

Sensitivity of 79.49% and specificity of 90.67% was achieved with a cut-off of 8 mL as ovarian volume. A cut-off value of 9 follicles to distinguish between PCOS and control women yielded a sensitivity of 82.35% and specificity of 92.0% while as a follicular size of 5 mm yielded sensitivity and specificity of 74.67% and 78.15% respectively. With all the three parameters sensitivity was 87.39% and specificity 87.84% with 92.04% PPV and 81.25% NPV.

CONCLUSION

Using two or three sonographic criteria in combination improves sensitivity and helps diagnose additional patients with PCOS. Our results are at variance with the established cut-off values highlighting the fact that American Society for Reproductive Medicine consensus cut-off values are not reproducible in Indian context.

Grid analysis improves reliability in follicle counts made by ultrasonography in women with polycystic ovary syndrome

Poor reliability has been reported when counting the total number of follicles in polycystic ovaries using conventional two-dimensional (2-D) ultrasound viewing methods. In the current study, we report good reliability in follicle counts when observers imposed a programmable grid system over the viewing window. Four observers estimated total follicle counts in 45 ovarian ultrasound scans by compartmentalizing the ovary into 9 to 12 grid sections and performing focused follicle counts per section. The mean number of follicles counted per ovary was 44.6 +/- 2.3. The level of inter-observer agreement when making follicle counts was 0.82 and total follicle counts did not differ among observers. The level of intra-observer agreement was 0.93 which further corroborated the utility of this method for making dependable follicle counts. In summary, the ability to obtain reproducible follicle counts will help to establish reliable diagnostic criteria for polycystic ovarian morphology.

Assessment of ultrasonographic features of polycystic ovaries is associated with modest levels of inter-observer agreement

Background

There is growing acceptance that polycystic ovaries are an important marker of polycystic ovary syndrome (PCOS) despite significant variability when making the ultrasound diagnosis. To better understand the nature of this variability, we proposed to evaluate the level of inter-observer agreement when identifying and quantifying individual ultrasonographic features of polycystic ovaries.

Methods

Digital recordings of transvaginal ultrasound scans performed in thirty women with PCOS were assessed by four observers with training in Radiology or Reproductive Endocrinology. Observers evaluated the scans for: 1) number of follicles ≥ 2 mm per ovary, 2) largest follicle diameter, 3) ovarian volume, 4) follicle distribution pattern and 5) presence of a corpus luteum (CL). Lin's concordance correlation coefficients and kappa statistics for multiple raters were used to assess inter-observer agreement.

Results

Agreement between observers ranged from 0.08 to 0.63 for follicle counts, 0.27 to 0.88 for largest follicle diameter, 0.63 to 0.86 for ovarian volume, 0.51 to 0.76 for follicle distribution pattern and 0.76 to 0.90 for presence of a CL. Overall, reproductive endocrinologists demonstrated better agreement when evaluating ultrasonographic features of polycystic ovaries compared to radiologists (0.71 versus 0.53; p = 0.04).

Conclusion

Inter-observer agreement for assessing ultrasonographic features of polycystic ovaries was moderate to poor. These findings support the need for standardized training modules to characterize polycystic ovarian morphology on ultrasonography.

The Androgen Excess and PCOS Society criteria for the polycystic ovary syndrome: the complete task force report

OBJECTIVE

To review all available data and recommend a definition for polycystic ovary syndrome (PCOS) based on published peer-reviewed data, whether already in use or not, to guide clinical diagnosis and future research.

DESIGN

Literature review and expert consensus.

SETTING

Professional society.

PATIENTS

None.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

A systematic review of the published peer-reviewed medical literature, by querying MEDLINE databases, to identify studies evaluating the epidemiology or phenotypic aspects of PCOS.

RESULT(S)

The Task Force drafted the initial report, following a consensus process via electronic communication, which was then reviewed and critiqued by the Androgen Excess and PCOS (AE-PCOS) Society AE-PCOS Board of Directors. No section was finalized until all members were satisfied with the contents, and minority opinions noted. Statements were not included that were not supported by peer-reviewed evidence.

CONCLUSION(S)

Based on the available data, it is the view of the AE-PCOS Society Task Force that PCOS should be defined by the presence of hyperandrogenism (clinical and/or biochemical), ovarian dysfunction (oligo-anovulation and/or polycystic ovaries), and the exclusion of related disorders. However, a minority considered the possibility that there may be forms of PCOS without overt evidence of hyperandrogenism, but recognized that more data are required before validating this supposition. Finally, the Task Force recognized and fully expects that the definition of this syndrome will evolve over time to incorporate new research findings.

Insulin resistance and polycystic ovary syndrome

Polycystic ovary syndrome (PCOS) is one of the most common endocrine disorders in humans, affecting approximately 7-8% of women of reproductive age. Despite the criteria adopted, PCOS is considered to be a predominantly hyperandrogenetic syndrome and the evaluation of metabolic parameters and insulin sensitivity is not mandatory. Most women with PCOS also exhibit features of the metabolic syndrome, including insulin resistance, obesity and dyslipidaemia. While the association with type 2 diabetes is well established, whether the incidence of cardiovascular disease is increased in women with PCOS remains unclear. Acknowledging the strong impact of insulin-resistance in the genesis of PCOS could be helpful not only to make the diagnosis more robust, but also for conferring better cardiovascular risk prevention. Several current studies support a strong recommendation that women with PCOS should undergo comprehensive evaluation for the metabolic syndrome and recognized cardiovascular risk factors, and receive appropriate treatment as needed. Lifestyle modifications remain the first-line therapy for all obese women with PCOS. However, many of these women do not lose weight easily. Insulin-sensitizing drugs are discussed as a promising and unique therapeutic option for the chronic treatment of PCOS.

Diagnostic criteria for polycystic ovary syndrome: pitfalls and controversies

It is estimated that as many as 1.4 million Canadian women may be afflicted with polycystic ovary syndrome (PCOS). Although PCOS is heralded as one of the most common endocrine disorders occurring in women, its diagnosis, management, and associated long-term health risks remain controversial. Historically, the combination of androgen excess and anovulation has been considered the hallmark of PCOS. To date, while these symptoms remain the most prevalent among PCOS patients, neither is considered an absolute requisite for the syndrome. Inclusion of ultrasonographic evidence of polycystic ovaries as a diagnostic marker has substantially broadened the phenotypic spectrum of PCOS, yet much debate surrounds the validity of these newly identified milder variants of the syndrome. Difficulty in resolving the spectrum of PCOS stems from the continued use of inconsistent and inaccurate methods of evaluating androgen excess, anovulation, and polycystic ovaries on ultrasound. At present, there is no clear-cut definition of biochemical hyperandrogenemia, particularly since we depend on poor laboratory standards for measuring androgens in women. Clinical signs of hyperandrogenism are ill-defined in women with PCOS, and the diagnosis of both hirsutism and polycystic ovarian morphology remains alarmingly subjective. Lastly, there is an inappropriate tendency to assign ovulatory status solely on the basis of menstrual cycle history or poorly timed endocrine measurements. In this review, we elaborate on these limitations and propose possible resolutions for clinical and research settings. By stimulating awareness of these limitations, we hope to generate a dialogue aimed at solidifying the evaluation of PCOS in Canadian women.

Improving inter-observer variability in the evaluation of ultrasonographic features of polycystic ovaries

BACKGROUND

We recently reported poor inter-observer agreement in identifying and quantifying individual ultrasonographic features of polycystic ovaries. Our objective was to determine the effect of a training workshop on reducing inter-observer variation in the ultrasonographic evaluation of polycystic ovaries.

METHODS

Transvaginal ultrasound recordings from thirty women with polycystic ovary syndrome (PCOS) were evaluated by three radiologists and three reproductive endocrinologists both before and after an ultrasound workshop. The following endpoints were assessed: 1) follicle number per ovary (FNPO), 2) follicle number per single cross-section (FNPS), 3) largest follicle diameter, 4) ovarian volume, 5) follicle distribution pattern and 6) presence of a corpus luteum (CL). Lin's concordance correlation coefficients (rho) and kappa statistics for multiple raters (kappa) were used to assess level of inter-observer agreement (>0.80 good, 0.60 - 0.80 moderate/fair, <0.60 poor).

RESULTS

Following the workshop, inter-observer agreement improved for the evaluation of FNPS (rho = 0.70, delta rho = +0.11), largest follicle diameter (rho = 0.77, delta rho = +0.10), ovarian volume (rho = 0.84, delta rho = +0.12), follicle distribution pattern (kappa = 0.80, delta kappa = +0.21) and presence of a CL (kappa = 0.87, delta kappa = +0.05). No improvement was evident for FNPO (rho = 0.54, delta rho = -0.01). Both radiologists and reproductive endocrinologists demonstrated improvement in scores (p < 0.001).

CONCLUSION

Reliability in evaluating ultrasonographic features of polycystic ovaries can be significantly improved following participation in a training workshop. If ultrasonographic evidence of polycystic ovaries is to be used as an objective measure in the diagnosis of PCOS, then standardized training modules should be implemented to unify the approach to evaluating polycystic ovarian morphology.

The diagnosis of polycystic ovary syndrome: the criteria are insufficiently robust for clinical research

Polycystic ovary syndrome (PCOS) is a common disorder but has considerable phenotypic variability and this has led to controversy over its exact definition and diagnosis. The objective of this study was to review the recently proposed diagnostic criteria to determine whether they were sufficiently robust for clinical and research practise. We have reviewed the literature pertaining to clinical measurement and quality of laboratory analysis in relation to clinical and biochemical hyperandrogenism. The recently published statements regarding the diagnosis of PCOS assume that the clinical, laboratory and imaging studies are dichotomous variables, without considering the effect of observer subjectivity or measurement variability on the outcome. The data suggest that there is considerable uncertainty of all measurements and lack of clarity of the definition of the term 'hyperandrogenaemia' which can lead to misdiagnosis. The current diagnostic strategies for PCOS are defined too vaguely to ascertain that individuals fit the definition of the syndrome. A pragmatic approach may be taken in the management of an individual depending upon her particular symptoms and needs. However, research into the epidemiology, pathophysiology and treatment of PCOS will require the production of robust definitions of the diagnostic criteria. We propose specific criteria that would answer the criticisms that we have raised.

Positions statement: criteria for defining polycystic ovary syndrome as a predominantly hyperandrogenic syndrome: an Androgen Excess Society guideline

OBJECTIVE

The Androgen Excess Society (AES) charged a task force to review all available data and recommend an evidence-based definition for polycystic ovary syndrome (PCOS), whether already in use or not, to guide clinical diagnosis and future research.

PARTICIPANTS

Participants included expert investigators in the field.

EVIDENCE

Based on a systematic review of the published peer-reviewed medical literature, by querying MEDLINE databases, we tried to identify studies evaluating the epidemiology or phenotypic aspects of PCOS.

CONSENSUS PROCESS

The task force drafted the initial report, following a consensus process via electronic communication, which was then reviewed and critiqued by the AES Board of Directors. No section was finalized until all members were satisfied with the contents and minority opinions noted. Statements that were not supported by peer-reviewed evidence were not included.

CONCLUSIONS

Based on the available data, it is the view of the AES Task Force on the Phenotype of PCOS that there should be acceptance of the original 1990 National Institutes of Health criteria with some modifications, taking into consideration the concerns expressed in the proceedings of the 2003 Rotterdam conference. A principal conclusion was that PCOS should be first considered a disorder of androgen excess or hyperandrogenism, although a minority considered the possibility that there may be forms of PCOS without overt evidence of hyperandrogenism but recognized that more data are required before validating this supposition. Finally, the task force recognized, and fully expects, that the definition of this syndrome will evolve over time to incorporate new research findings.

Polycystic ovarian syndrome: marked differences between endocrinologists and gynaecologists in diagnosis and management

BACKGROUND

Women with polycystic ovarian syndrome (PCOS) commonly consult endocrinologists or gynaecologists and it is not known whether these specialty groups differ in their approach to management.

OBJECTIVE

To compare the investigation, diagnosis and treatment practices of endocrinologists and gynaecologists who treat PCOS.

DESIGN AND SETTING

A mailed questionnaire containing a hypothetical patient's case history with varying presentations--oligomenorrhoea, hirsutism, infertility and obesity--was sent to Australian clinical endocrinologists and gynaecologists in teaching hospitals and private practice.

RESULTS

Evaluable responses were obtained from 138 endocrinologists and 172 gynaecologists. The two specialty groups differed in their choice of essential diagnostic criteria and investigations. Endocrinologists regarded androgenization (81%) and menstrual irregularity (70%) as essential diagnostic criteria, whereas gynaecologists required polycystic ovaries (61%), androgenization (59%), menstrual irregularity (47%) and an elevated LH/FSH ratio (47%) (all P-values < 0.001). In investigation, gynaecologists were more likely to request ovarian ultrasound (91%vs. 44%, P < 0.001) and endocrinologists more likely to measure adrenal androgens (80%vs. 58%, P < 0.001) and lipids (67%vs. 34%, P < 0.001). Gynaecologists were less likely to assess glucose homeostasis but more likely to use a glucose tolerance test to do so. Diet and exercise were chosen by most respondents as first-line treatment for all presentations. However, endocrinologists were more likely to use insulin sensitizers, particularly metformin, for these indications. In particular, for infertility, endocrinologists favoured metformin treatment whereas gynaecologists recommended clomiphene.

CONCLUSIONS

There is a lack of consensus between endocrinologists and gynaecologists in the definition, diagnosis and treatment of PCOS. As a consequence, women may receive a different diagnosis or treatment depending on the type of specialist consulted.

Management of ovarian cysts

BACKGROUND

The treatment of an ovarian cyst relies on its nature, and accurate preoperative discrimination of benign and malignant cysts is therefore of crucial importance. This study was undertaken to review the literature concerning the preoperative diagnosis and treatment of ovarian cysts.

METHODS

Articles concerning ovarian cysts from a medline literature search during the period 1985-2003 were included in addition to articles found as references in the initial publications.

RESULTS

Different methods for discriminating between benign and malignant ovarian cysts are discussed. The diagnosis and the treatment are assessed in relation to age, menopausal status, pregnancy, and whether the cyst is presumed to be benign or malignant. In general, expectant management is the choice in premenopausal and pregnant women with non-suspicious cysts and normal levels of CA-125. In postmenopausal women, unilocular, anechoic cysts less than 5 cm in diameter together with a normal CA-125 may be followed up. Operation is recommended in women with cysts larger than 5 cm and/or elevated levels of CA-125. Women with symptoms should be operated regardless of age, menopausal status, or ultrasound findings.

CONCLUSIONS

The preoperative discrimination between benign and malignant ovarian cysts is a challenge. Multimodal methods improve the results of single modalities, but we still need improved preoperative diagnostic tools. Furthermore, these methods should be validated in consecutive patient populations large enough to give a reliable estimate of the method's sensitivity and specificity.

Polycystic Ovary Syndrome in Adolescents

Polycystic ovary syndrome is a heterogeneous clinical syndrome, which has been defined as the association of hyperandrogenism with chronic anovulation in women without specific adrenal and pituitary gland disease. A family history of polycystic ovary syndrome may be present in a subset of patients; however, the genetic basis of the syndrome remains unclear. Most often, the age of onset is perimenarchal and it is characterized by the appearance of menstrual disturbances, hirsutism, acne, and more rarely, a male pattern of alopecia. In some cases, premature adrenarche may present as a precursor to the development of the syndrome. Polycystic ovary syndrome is also associated with metabolic disturbances, such as obesity and insulin resistance with hyperinsulinemia, for which the pathophysiological role in the development of the syndrome has been recognized. The therapeutic approaches to polycystic ovary syndrome include lifestyle modifications, dietary-induced weight loss, insulin-sensitizing agents, antiandrogens, and oral contraceptives. These treatments may improve the clinical manifestations of excess androgen production and normalize menses in many adolescents and young women with polycystic ovary syndrome. Early recognition of the syndrome and thus, early treatment, may prevent and possibly ameliorate all the symptoms and the potential later development of metabolic and cardiovascular complications.