An independent agreement study of modified Pfirrmann grading system for cervical inter-vertebral disc degeneration in cervical spondylotic myelopathy

OBJECTIVE

Neck pain, sensory disturbance and motor dysfunction in most patients suffered cervical spondylotic myelopathy (CSM). For CSM surgery, it is necessary to evaluate preoperative inter-vertebral disc degeneration (IDD) which determines whether to adopt fusion strategy, and postoperative IDD which is one of the main reasons for reoperation. Modified Pfirrmann grading system is commonly used to evaluate IDD. The objective of this study is to evaluate its reliability and reproducibility on cervical IDD in CSM patients, and to explore its clinical application value.

METHODS

All 165 patients with CSM were enrolled. 6 physicians (3 spine surgeons and 3 radiologists) who have certain clinical experience were selected. They graded cervical inter-vertebral disc according to modified Pfirrmann grading system, we used intra-class correlation coefficient (ICC) and weighted kappa (wκ) to assess the inter- and intra-observer agreement. After 12 weeks, we repeated the analysis.

RESULTS

The inter-observer reliability of modified Pfirrmann grading system was excellent with an ICC value of 0.76 and near perfect with wκ value of 0.82. The intra-observer reproducibility of modified Pfirrmann grading system was excellent with ICC values ranging from 0.80 to 0.91, and near perfect with wκ values ranging from 0.83-0.92.

CONCLUSION

Modified Pfirrmann grading system has excellent inter-observer reliability and intra-observer reproducibility on cervical IDD in CSM. In addition, it indicates a good appliance among spine surgeons and radiologists, clinical and radiological studies applying it should be deemed accurate. Thus, modified Pfirrmann grading system can be widely used as an appropriate instrument in clinical care.

Agreement in the CARTaGENE cohort between self-reported medication use and claim data

OBJECTIVES

To describe the agreement of self-reported medication use with claim prescription records and to ascertain factors associated with agreement between the two data sources.

METHODS

Baseline data on self-reported medication use was extracted from CARTaGENE, a cohort study in Quebec, Canada, and from the provincial health insurance records (dispensation database) of the same individuals. Kappa statistics were used to estimate concordance beyond chance between the two data sources. Logistic regression models were adjusted to estimate the association between agreement and selected individual's characteristics (sex, age, education, region, income, utilization of health care system, and comorbidities).

RESULTS

Agreement between self-reported medication use and administrative data varied considerably across medication classes (kappa 0.54 for respiratory system and 0.91 for systemic hormonal preparations). Overall, agreement improved when a fixed time window of 90 days was used for exposure measurement. Sex, education level, frequency of health care use and the number of reported medications were associated with agreement.

DISCUSSION

Overall, there was a reasonable agreement between the two data sources, but important variations were found for the different drug classes. These results could be used by researchers to more accurately assess drug exposures using real-world data, which are increasingly important to regulators.

Reliability of the sperm chromatin dispersion assay to evaluate sperm deoxyribonucleic acid damage in men with infertility

OBJECTIVE

To investigate the intraindividual agreement of the sperm chromatin dispersion (SCD) assay results to assess sperm DNA fragmentation (SDF) in men with infertility.

DESIGN

Diagnostic test reliability study.

SETTING

Andrology laboratories.

PATIENT(S)

A total of 219 men with infertility.

INTERVENTION(S)

Sperm DNA fragmentation assessment in two ejaculates of the same subjects within a 3-month interval, using the SCD assay performed and analyzed by the same observers under similar testing conditions.

MAIN OUTCOME MEASURE(S)

Cohen's κ statistics to assess the degree of agreement between the pairs of results after converting the nominal SCD values into categorical data, that is, normal (<20%), intermediate (21%-29%), and high (≥30%) SDF rates. We also assessed the pairs of results using reliability measures for numerical variables (intraclass correlation coefficient for consistency using the two-way mixed-effects model and Bland-Altman plots).

RESULT(S)

The degree of agreement in classifying patients according to normal and pathological SDF classes was overall substantial (κ = 0.632; 95% confidence interval [CI], 0.546-0.718). A total of 76.7% of individuals were classified under the same class using paired ejaculates. The agreement rate was highest (approximately 80%) in ejaculates initially classified as either normal or high and lowest (approximately 60%) among those with intermediate SDF levels. The frequency of intermediate SDF ejaculates downgraded to normal or upgrade to high SDF classes in the second test was similar (approximately 20%). The intraclass correlation coefficient was 0.856 (95% CI, 0.812-0.887), and the mean difference between the pairs of observations was 0.80% (95% CI, -0.72 to 2.23), indicating no systematic difference between paired observations.

CONCLUSION(S)

Our study indicates a substantial intraindividual agreement of paired SCD assay results to classify men with infertility into three SDF categories: normal, intermediate, and high. The reliability of the SCD assay was adequate and exceeded 0.80 using two ejaculates analyzed within a 3-month interval under similar conditions. Although this evidence overall supports a single SCD test for patient classification using predefined SDF thresholds, particularly when the first test shows normal or high SDF levels, one in four men will have discordant values in paired ejaculates. Clinicians should be judicious when using SDF test results in decision-making.

An independent inter- and intra-observer agreement assessment of the Eno classification of sacroiliac joint degeneration

BACKGROUND

Recently, a scoring system to grade sacroiliac joint (SIJ) degeneration using computed tomography (CT) scans was described. No independent evaluation has determined the inter- and intra-observer agreement using this scheme.

PURPOSE

To perform an independent inter- and intra-observer agreement assessment using the Eno classification and determining gas in the SIJ.

MATERIAL AND METHODS

We studied 64 patients aged ≥60 years who were evaluated with abdominal and pelvic computed tomography scans. Six physicians (three orthopaedic spine surgeons and three musculoskeletal radiologists) assessed axial images to grade SIJ degeneration into grade 0 (normal), grade 1 (mild degeneration), grade 2 (significant degeneration), and grade 3 (ankylosis). We also evaluated the agreement assessing the presence of gas in the SIJ. After a four-week interval, all cases were presented in a random sequence for repeat assessment. We determined the agreement using the kappa (κ) or weighted kappa coefficient (wκ).

RESULTS

The inter-observer agreement was moderate (wκ = 0.50 [0.44-0.56]), without differences among surgeons (wκ = 0.53 [0.45-0.61]) and radiologists (wκ = 0.49 [0.42-0.57]). The agreement evaluating the presence of gas was also moderate (κ = 0.45 [0.35-0.54]), but radiologists obtained better agreement (κ = 0.61 [0.48-0.72]) than surgeons (κ = 0.29 [0.18-0.39]). The intra-observer agreement using the classification was substantial (wκ = 0.79 [0.76-0.82]), without differences comparing surgeons (wκ = 0.75 [0.70-0.80]) and radiologists (wκ = 0.83 [0.79-0.87]). The intra-rater agreement evaluating gas was substantial (κ = 0.77 [0.72-0.82]), without differences between surgeons (κ = 0.71 [0.63-0.78]) and radiologists (κ = 0.84 [0.78-0.90]).

CONCLUSION

Given the only moderate agreement obtained using the Eno classification, it does not seem adequate to be used in clinical practice or in research.

Parental questionnaires provided reliable data on childhood asthma compared with national registers

BACKGROUND

Much of our knowledge of childhood asthma comes from questionnaire-based studies. Our main aim was to assess the agreement between parental-reported data at 12 years of age and data from two national Swedish registers.

METHODS

Data were obtained from the prospective, longitudinal, population-based Children of Western Sweden cohort, which focused on children born in 2003. The parents answered questionnaires at six months and one, four, eight and 12 years of age. Personal identity numbers linked 3634 children to the Swedish Prescribed Drug Register (SPDR) and the National Patient Register (NPR).

RESULTS

At 12 years of age, there was substantial overall agreement between the asthma medication reported by the parents in the questionnaire and the SPDR for any asthma medication (94.8%, kappa 0.71) and maintenance treatment (95.3%, kappa 0.68). In contrast, the agreement between the outpatient asthma diagnoses in the NPR and the questionnaire-based asthma was 30.5% and it was 32.8% between the NPR and the dispensed asthma medication in the SPDR. Hospitalization was rare for obstructive diseases after early childhood, and 38.2% of the 12-year-old children only received a short-acting beta agonist, with no maintenance treatment.

CONCLUSION

There was good agreement between the questionnaire-based data on asthma medication and the national drug register, but the National Patient Register provided incomplete information on asthma diagnoses, probably because it did not include primary care diagnoses. The results show that well-constructed parental questionnaires can provide reliable data on childhood asthma.

Antral follicle count and anti-Müllerian hormone to classify low-prognosis women under the POSEIDON criteria: a classification agreement study of over 9000 patients

STUDY QUESTION

What is the agreement between antral follicle count (AFC) and anti-Müllerian hormone (AMH) levels when used to patient classification according to the Patient-Oriented Strategies Encompassing IndividualizeD Oocyte Number (POSEIDON) criteria?

SUMMARY ANSWER

Our study indicates a strong agreement between the AFC and the AMH levels in classifying POSEIDON patients; thus, either can be used for this purpose, although one in four women will have discordant values when both biomarkers are used.

WHAT IS KNOWN ALREADY

According to the POSEIDON criteria, both AFC and AMH may be used to classify low-prognosis patients. Proposed AFC and AMH thresholds of 5 and 1.2 ng/ml, respectively, have their basis in published literature; however, no study has yet determined the reproducibility of patient classification in comparing one biomarker with the other, nor have their thresholds ever been validated within this patient population.

STUDY DESIGN, SIZE, DURATION

A population-based cohort study involving 9484 consecutive patients treated in three fertility clinics in Brazil, Turkey and Vietnam between 2015 and 2017.

PARTICIPANTS/MATERIALS, SETTING, METHODS

Participants were infertile women between 22 and 46 years old in their first in vitro fertilization/intracytoplasmic sperm injection cycle of standard ovarian stimulation with exogenous gonadotropins whose baseline ovarian reserves had been assessed by both AFC and AMH. Details of pre- and post-treatment findings were input into a coded research file. Two indicators of interest were created to classify patients according to the POSEIDON criteria based upon AFC and AMH values. Patients who did not fit any of the four POSEIDON groups were classified as non-POSEIDON. AFC was determined in the early follicular phase using two-dimensional (2D) transvaginal ultrasonography, whereas AMH values were based on the modified Beckman Coulter generation II enzyme-linked immunosorbent assay. Agreement rates were computed between AFC and AMH to classify patients using Cohen's kappa statistics. Logistic regression analyzes were carried out to examine the association between ovarian markers and low (<4) and suboptimal (4-9) oocyte yield.

MAIN RESULTS AND THE ROLE OF CHANCE

The degree of agreement in classifying patients according to POSEIDON groups was strong overall (kappa = 0.802; 95% CI: 0.792-0.811). A total of 73.8% of individuals were classified under the same group using both biomarkers. The disagreement rates were ∼26% and did not diverge when AFC or AMH was used as the primary biomarker criterion. Significant regression equations were found between ovarian markers and oocyte yield (P < 0.0001). For low oocyte yield, the optimal AFC and AMH cutoff values were 5 and 1.27 ng/ml with sensitivities of 0.61 and 0.66, specificities of 0.81 and 0.72, and AUC receiver operating characteristics of 0.791 and 0.751, respectively. For suboptimal oocyte yield respective AFC and AMH cutoffs were 12 and 2.97 ng/ml with sensitivities of 0.74 and 0.69, specificities of 0.76 and 0.66 and AUCs of 0.81 and 0.80.

LIMITATIONS, REASONS FOR CAUTION

Our study relied on 2D transvaginal sonography to quantify the AFC and manual Gen II assay for AMH determination and classification of patients. AMH data must be interpreted in an assay-specific manner. Treatment protocols varied across centers potentially affecting patient classification.

WIDER IMPLICATIONS OF THE FINDINGS

Three of four patients will be classified the same using either AFC or AMH values. Both biomarkers provide acceptable and equivalent accuracy in predicting oocyte yield further supporting their use and proposed thresholds in daily clinical practice for patient classification according to the POSEIDON criteria. However, the sensitivity of POSEIDON thresholds in predicting low oocyte yield is low. Clinicians should adopt the biomarker that may best reflect their clinical setting.

STUDY FUNDING/COMPETING INTEREST(S)

Unrestricted investigator-sponsored study grant (MS200059_0013) from Merck KGaA, Darmstadt, Germany. The funder had no role in study design, data collection, analysis, decision to publish or manuscript preparation. S.C.E. declares receipt of unrestricted research grants from Merck and lecture fees from Merck and Med.E.A. H.Y. declares receipt of payment for lectures from Merck and Ferring. L.N.V. receives speaker fees and conferences from Merck, Merck Sharp and Dohme (MSD) and Ferring and research grants from MSD and Ferring. T.M.H. received speaker fees and conferences from Merck, MSD and Ferring. The remaining authors have nothing to disclose.

TRIAL REGISTRATION NUMBER

not applicable.

An independent inter- and intra-observer agreement assessment of Yeom classification for bone cement leakage following vertebroplasty/kyphoplasty

STUDY DESIGN

An inter- and intra-observer agreement study.

BACKGROUND

In recent years, vertebroplasty and kyphoplasty have been widely used in treating osteoporotic vertebral compression fractures (OVCF) though the clinical efficacy of them is still controversial. However, there are also inevitable complications, first and foremost is bone cement leakage (BCL). Yeom classification is commonly used to evaluate BCL. The objective of this study is to assess its reliability and reproducibility, and to explore its clinical application value.

METHODS

All 58 patients with BCL following vertebroplasty/kyphoplasty were involved. Six spine surgeons were selected to be evaluators as they were unaware of the identity of the patients and the treatment they received. They classified BCL according to Yeom system, we used kappa (K) to assess the inter- and intra-observer agreement. After 12 weeks, we repeated the analysis.

RESULTS

The inter-observer reliability of Yeom classification was substantial with K value of 0.71 (1st assessment) and 0.73 (2nd assessment). The intra-observer reproducibility of Yeom classification was near perfect with K value of 0.88.

CONCLUSION

Yeom classification system has substantial inter-observer reliability and near perfect intra-observer reproducibility in BCL following vertebroplasty/kyphoplasty, which can be widely used in clinical care as an appropriate instrument for early observation, mechanism and severity cognition, and prognosis predicting of BCL. Besides, the adding of type M (the mixed type) may improve the classification.

STUDY OF AGREEMENT BETWEEN THE ROSSO-MARDONES AND ATALAH SCALES FOR NUTRITIONAL ASSESSMENT IN PREGNANCY. LA ERMITA CLINIC, CARTAGENA, 2017

OBJECTIVE

To assess the degree of agreement between the model for maternal nutritional assessment proposed by Rosso-Mardones and the one proposed by Atalah.

METHODS

Diagnostic agreement study. Pregnant women between the ages of 19 and 37 years with a gestational age of 10 or more weeks were incuded; patients with diabetes, thyroid disease, pregnancy-associated hypertension, twin pregnancy, severe fetal malformation, fetal death and hydrops fetalis were excluded. Non-probabilistic sampling. Sociodemographic, obstetrical and nutritional status variables were measured.

RESULTS

Overall, 98 pregnant women were included. With the use of the Rosso-Mardones scale, 33% of the patients were classified as having a normal nutritional status, 22% as low weight, and 44% as overweight or obese. With the Atalah scale, 41% of the women were classified as having a normal nutritional status, 10% as low weight and 48% as overweight or obese. The weighted kappa value was 0.74 with a standard error of 0.04, a 95% CI of 0.66-0.82 and a p value < 0.05.

CONCLUSIONS

There is substantial agreement between nutritional assessment scales used in pregnancy, namely the Rosso-Mardones nomogram and the Atalah scale. Further studies to assess the agreement of these scales in the pregnant population are required.

Speech perception, real-ear measurements and self-perceived hearing impairment after remote and face-to-face programming of hearing aids: A randomized single-blind agreement study

INTRODUCTION

Current literature does not provide strong evidence that remote programming of hearing aids is effective, despite its increasing use by audiologists. We tested speech perception outcomes, real-ear insertion gain, and changes in self-perceived hearing impairment after face-to-face and remote programming of hearing aids in a randomized multicentre, single-blind crossover study.

METHODS

Adult experienced hearing aid users were enrolled during routine follow-up visits to audiology clinics. Hearing aids were programmed both face to face and remotely, then participants randomly received either the face-to-face or remote settings in a blinded manner and were evaluated 5 weeks later. Participants then received the other settings and were evaluated 5 weeks later.

RESULTS

Data from 52 out of 60 participants were analysed. We found excellent concordance in performance of hearing aids programmed face to face and remotely for speech understanding in quiet (phonetically balanced kindergarten test - intraclass correlation coefficient of 0.92 (95% confidence interval: 0.87-0.95)), and good concordance in performance for speech understanding in noise (phonetically balanced kindergarten +5 dB signal-to-noise ratio - intraclass correlation coefficient of 0.71 (95% confidence interval: 0.55-0.82)). Face-to-face and remote programming took 10 minutes (±2.9) and 10 minutes (±2.8), respectively. Real-ear insertion gains were highly correlated for input sound at 50, 65 and 80 dB sound pressure levels. The programming type did not affect the abbreviated profile of hearing aid questionnaire scores.

CONCLUSIONS

In experienced hearing aid users, face-to-face and remote programming of hearing aids give similar results in terms of speech perception, with no increase in the time spent on patients' care and no difference in self-reported hearing benefit.

CLINICALTRIALS.GOV IDENTIFIER

NCT02589561.

Agreement between asthma questionnaire and health care register data

PURPOSE

Risk factors and consequences of asthma can be studied by using validated questionnaires. The overall objective of this study was to assess the agreement of parental-reported asthma-related questions regarding their children against Swedish health care registers.

METHODS

We linked a population-based twin cohort of 27 055 children aged 9 to 12 years to the Swedish Prescribed Drug Register, National Patient Register, and the primary care register. Parent-reported asthma was obtained from questionnaires, and diagnoses and medication were retrieved from the registers. For the agreement between the questionnaire and the registers, Cohen's kappa was estimated.

RESULTS

The kappa of the "reported ever asthma" against a "register-based ever asthma" was 0.69 and 0.57 between the parental-"reported doctor's diagnosis" and "register-based doctor's diagnosis." The highest agreement between "reported current asthma" and "register-based current asthma" with at least 1 dispensed medication or a diagnosis applied to different time windows was seen for an 18-month window (kappa = 0.70).

CONCLUSIONS

We found that parent-reported asthma-related questions showed on average good agreement with the Swedish health care registers. This implies that in-depth questionnaires with rich information on phenotypes are suitable proxies for asthma in general and can be used for health care research purposes.

Agreement between patient self-assessment and physician assessment of shoulder range of motion

BACKGROUND

Shoulder outcome scores that include range of motion (ROM) and apprehension signs are limited by the need for direct involvement of the physician. Patient-reported outcome measures are patient centered and self-administered, and they can help physicians track the patient's progress between office visits and for long-term follow-up once the patient has been discharged.

METHODS

Thirty consecutive patients completed a form before their 6-month follow-up after surgery on the labrum or capsule as a result of instability or pain related to instability. The form included bilateral ROM, apprehension, and instability episodes. The same parameters were measured by the physician during the visit. The patient's and physician's responses were compared. The primary outcome was the percentage agreement with exact and approximate agreement.

RESULTS

Exact agreement was moderate for forward elevation at 56.6%; fair for abduction and external rotation at 90° at 24.5% and 34%, respectively; and poor for internal rotation at 90° and external rotation with the arm at the side at 2.6% and 12%, respectively. Approximate agreement within a range of positive or negative 20° range was very good for forward elevation (94%), abduction (92%), and external rotation at 90° (87%); moderate for external rotation with the arm at the side; and fair for internal rotation at 90°. There was 70% agreement regarding apprehension, 93% regarding subluxation events, and 100% regarding redislocation events.

CONCLUSION

Some measures of shoulder ROM showed a moderate to high level of agreement between patient-reported measurements and the physician's measurements. This method for short- and long-term follow-up could potentially replace routine clinic visits.

Comparing Abbott m2000 RealTime HIV test and Roche COBAS Ampliprep/COBAS Taqman HIV test, v2.0 in treated HIV-1 B and non-B subjects with low viraemia

Viral load testing is a valuable tool in HIV clinical care and research. Discrepancies among diverse viral load assays, especially with regard to non-B HIV-1 subtypes have been reported. Our study aimed to explore the impact of HIV subtype (B versus non-B) on the agreement between CAP/CTM, v2.0 and m2000 RealTime in treated HIV patients, focusing on low viral loads (<200 copies/ml). Our findings indicate that there is a significant difference in the performance of the compared assays in the low-viremic range and non-B subtypes, suggesting that a single assay should be used for follow-up.

Development and reliability testing of the frequency, etiology, direction, and severity (FEDS) system for classifying glenohumeral instability

HYPOTHESIS

Classification systems for glenohumeral instability (GHI) are opinion based, not validated, and poorly defined. The hypothesis driving this investigation is that a classification system with content validity will have high inter-observer and intra-observer agreement.

MATERIALS AND METHODS

The classification system was developed by first conducting systematic literature review that identified 18 systems for classifying GHI. The frequency of characteristics used was recorded. Additionally, 31 members of the American Shoulder and Elbow Surgeons responded to a survey to identify features important to characterize GHI. Frequency, etiology, direction, and severity (FEDS) were most important. Frequency was defined as solitary (1 episode), occasional (2 to 5 times/y), or frequent (>5 times/year). Etiology was defined as traumatic or atraumatic. Direction referred to the primary direction of instability (anterior, posterior, or inferior). Severity was subluxation or dislocation. For reliability testing, 50 GHI patients completed a questionnaire at their initial visit. One of 6 sports medicine fellowship-trained physicians completed a similar questionnaire after examining the patient. Patients returned after 2 weeks and were examined by the original physician and 2 other physicians. Interrater and intrarater agreement for the FEDS classification system was calculated.

RESULTS

Agreement between patients and physicians was lowest for frequency (39%; κ = 0.130) and highest for direction (82%; κ = 0.636). Physician intrarater agreement was 84% to 97% for the individual FEDS characteristics (κ = 0.69-0.87), and interrater agreement was 82% to 90% (κ = 0.44-0.76).

CONCLUSIONS

The FEDS system has content validity and is highly reliable for classifying GHI. Physical examination using provocative testing to determine the primary direction of instability produces very high levels of interrater and intrarater agreement.