Variabilities in Reference Standard by Radiologists and Performance Assessment in Detection of Pulmonary Embolism in CT Pulmonary Angiography

Annotating lesion locations by radiologists' manual marking is a key step to provide reference standard for the training and testing of a computer-aided detection system by supervised machine learning. Inter-reader variability is not uncommon in readings even by expert radiologists. This study evaluated the variability of the radiologist-identified pulmonary emboli (PEs) to demonstrate the importance of improving the reliability of the reference standard by a multi-step process for performance evaluation. In an initial reading of 40 CTPA PE cases, two experienced thoracic radiologists independently marked the PE locations. For markings from the two radiologists that did not agree, each radiologist re-read the cases independently to assess the discordant markings. Finally, for markings that still disagreed after the second reading, the two radiologists read together to reach a consensus. The variability of radiologists was evaluated by analyzing the agreement between two radiologists. For the 40 cases, 475 and 514 PEs were identified by radiologists R1 and R2 in the initial independent readings, respectively. For a total of 545 marks by the two radiologists, 81.5% (444/545) of the marks agreed but 101 marks in 36 cases differed. After consensus, 65 (64.4%) and 36 (35.6%) of the 101 marks were determined to be true PEs and false positives (FPs), respectively. Of these, 48 and 17 were false negatives (FNs) and 14 and 22 were FPs by R1 and R2, respectively. Our study demonstrated that there is substantial variability in reference standards provided by radiologists, which impacts the performance assessment of a lesion detection system. Combination of multiple radiologists' readings and consensus is needed to improve the reliability of a reference standard.

Qualitative evaluation of pulmonary CT angiography findings in pregnant and postpartum women with suspected pulmonary thromboembolism

Background:

Considering the importance of using more appropriate imaging technique for accurate diagnosis of pulmonary thromboembolism (PTE) with less side effects, we aimed to evaluate the quality of pulmonary 64-multidetector computed tomographic (MDCT) angiography in pregnant and postpartum women with suspected PTE in Isfahan.

Materials and Methods:

In this descriptive study, radiological findings of pregnant and postpartum women with suspected PTE who underwent pulmonary 64-MDCT angiography were evaluated. Prevalence of PTE in pregnant and postpartum women, mean of pulmonary arteries density for right and left pulmonary arteries, and their lobar and segmental branches, diagnostic quality of the pulmonary arteries density and their scoring, frequency of diagnostic and nondiagnostic images, mean of radiation dose and mean of bolus time, and the correlation between the quality of the vascular density with the peak density of the pulmonary artery were determined.

Results:

In this study, 44 pregnant and postpartum women with suspected PTE were selected. The overall prevalence of PTE was 9.1% (4/44). PTE was diagnosed in 1 (3.7%) pregnant and 3 (17.5%) postpartum women (P = 0.14). Mean density of pulmonary trunk was 278.81± 108.16 Hounsfield unit (HU) and 308.41 ± 59.30 HU in pregnant and postpartum women, respectively. Mean of bolus timing, kilovoltage peak (kVp), tube current, and dose length product (DLP) were 12.53 ± 2.36 s, 105.22± 45.71 milliamperage (MA), 382.9 ± 173.5 MA, and 317.98 ± 78.92 mGy/cm, respectively. The rate of nondiagnostic images was 4.5%.

Conclusion:

Our findings indicated that pulmonary 64-MDCT angiography is an appropriate imaging method for diagnosing PTE in pregnant and postpartum women with suspected PTE. It seems that, using fast CT systems (64-MDCT), in accordance with high flow rate, high contrast medium concentration and low kVp could explain the obtained appropriate quality of images more efficiently than computed tomographic pulmonary angiography (CTPA).