Interobserver agreement in the interpretation of outpatient head CT scans in an academic neuroradiology practice

Inter Observer Agreement Among Radiologist and Otorhinolaryngologists on Paranasal Sinus Computed Tomography Scans in Chronic Rhinosinusitis

To evaluate inter observer agreement between Radiologist and Otorhinolaryngologists in identifying important structures and pathologies on pre operative computed tomography (CT) scans of paranasal sinus (PNS) in chronic rhinosinusitis (CRS). A retrospective review of CT scans PNS of CRS patients. Archived CT scans were evaluated by 3 observers, similarly experienced radiologist and otorhinolaryngologist and a less experienced otorhinolarygologist. The degree of intra- as well as inter observer agreement was assessed by Cohen's kappa statistics. A moderate and a fair inter observer agreement was noted among experienced radiologist and otorhinolaryngologist; & experienced experts and less experienced otorhinolaryngologist respectively. The greatest disagreements among all observers were found in superior attachment of uncinate process, optic nerve's relationship with sphenoid sinus and dehiscence of anterior ethmoid canal. The present study demonstrated a considerable inter observer variability among radiologists and otorhinolaryngologists, irrespective of their experience in the field of speciality. A few critically important structures which showed an unsatisfactory level of agreement and thus need to be sought after with more training and practice, were also identified. These included Keros type, optic nerve's location, dehiscence of anterior ethmoid artery, vidian and maxillary nerves, lamina papyracia defect, sphenoid sinus pneumatization and attachment of uncinate process. The study also emphasized the importance of inter disciplinary conferences for pre operative evaluation of sinus CT scans of CRS patients.

Interobserver Variability in the Recognition of Hypoxic-Ischemic Brain Injury on Computed Tomography Soon After Out-of-Hospital Cardiac Arrest

BACKGROUND

Cerebral edema and loss of gray-white matter differentiation on head computed tomography (CT) after cardiac arrest generally portend a poor prognosis. The interobserver variability in physician recognition of hypoxic-ischemic brain injury (HIBI) on early CT after out-of-hospital cardiac arrest has not been studied.

METHODS

In this survey study, participating physicians and a neuroradiologist reviewed 20 randomly selected head CTs obtained within 2 h of out-of-hospital cardiac arrest and decided if HIBI was present. All participants were blinded to clinical details. Interobserver agreement on the presence of HIBI (primary outcome) and pairwise agreement between participants and the neuroradiologist (secondary outcome) were determined using multi- and dual-rater kappa statistics with 95% confidence intervals (CIs).

RESULTS

Agreement among physicians regarding the presence of HIBI on head CT was fair (kappa 0.34; 95% CI 0.19-0.49). Individual physician agreement with the neuroradiologist varied from poor to moderate (kappa 0.0-0.48), with 8 of 10 physicians having no more than fair agreement. Regarding the perceived severity of HIBI on head CT, physician agreement was moderate (ICC = 0.56; 95% CI 0.38-0.77).

CONCLUSION

Physicians, including radiologists, demonstrated substantial interobserver variability when identifying HIBI on head CT soon after out-of-hospital cardiac arrest.

Added value of double reading in diagnostic radiology,a systematic review

Objectives

Double reading in diagnostic radiology can find discrepancies in the original report, but a systematic program of double reading is resource consuming. There are conflicting opinions on the value of double reading. The purpose of the current study was to perform a systematic review on the value of double reading.

Methods

A systematic review was performed to find studies calculating the rate of misses and overcalls with the aim of establishing the added value of double reading by human observers.

Results

The literature search resulted in 1610 hits. After abstract and full-text reading, 46 articles were selected for analysis. The rate of discrepancy varied from 0.4 to 22% depending on study setting. Double reading by a sub-specialist, in general, led to high rates of changed reports.

Conclusions

The systematic review found rather low discrepancy rates. The benefit of double reading must be balanced by the considerable number of working hours a systematic double-reading scheme requires. A more profitable scheme might be to use systematic double reading for selected, high-risk examination types. A second conclusion is that there seems to be a value of sub-specialisation for increased report quality. A consequent implementation of this would have far-reaching organisational effects.

Key Points

• In double reading, two or more radiologists read the same images.

• A systematic literature review was performed.

• The discrepancy rates varied from 0.4 to 22% in various studies.

• Double reading by sub-specialists found high discrepancy rates.

Electronic supplementary material

The online version of this article (10.1007/s13244-018-0599-0) contains supplementary material, which is available to authorised users.