Impact of time of day on radiology image interpretations

Variations in breast cancer detection rates during mammogram-reading sessions: does experience have an impact?

OBJECTIVES

To examine whether radiologists' performances are consistent throughout a reading session and whether any changes in performance over the reading task differ depending on experience of the reader.

METHODS

The performance of ten radiologists reading a test set of 60 mammographic cases without breaks was assessed using an ANOVA, 2 × 3 factorial design. Participants were categorized as more (≥2,000 mammogram readings per year) or less (<2,000 readings per year) experienced. Three series of 20 cases were chosen to ensure comparable difficulty and presented in the same sequence to all readers. It usually takes around 30 min for a radiologist to complete each of the 20-case series, resulting in a total of 90 min for the 60 mammographic cases. The sensitivity, specificity, lesion sensitivity, and area under the ROC curve were calculated for each series. We hypothesized that the order in which a series was read (i.e. fixed-series sequence) would have a significant main effect on the participants' performance. We also determined if significant interactions exist between the fixed-series sequence and radiologist experience.

RESULTS

Significant linear interactions were found between experience and the fixed sequence of the series for sensitivity (F[1] =5.762, p = .04, partial η² = .41) and lesion sensitivity. (F[1] =6.993, p = .03, partial η² = .46). The two groups' mean scores were similar for the first series but progressively diverged. By the end of the third series, significant differences in sensitivity and lesion sensitivity were evident, with the more experienced individuals demonstrating improving and the less experienced declining performance. Neither experience nor series sequence significantly affected the specificity or the area under the ROC curve.

CONCLUSIONS

Radiologists' performance may change considerably during a reading session, apparently as a function of experience, with less experienced radiologists declining in sensitivity and lesion sensitivity while more experienced radiologists actually improve. With the increasing demands on radiologists to undertake high-volume reporting, we suggest that junior radiologists be made aware of possible sensitivity and lesion sensitivity deterioration over time so they can schedule breaks during continuous reading sessions that are appropriate to them, rather than try to emulate their more experienced colleagues.

ADVANCES IN KNOWLEDGE

Less-experienced radiologists demonstrated a reduction in mammographic diagnostic accuracy in later stages of the reporting sessions. This may suggest that extending the duration of reporting sessions to compensate for increasing workloads may not represent the optimal solution for less-experienced radiologists.

Impact of Hours Awake and Hours Slept at Night on Radiologists' Mammogram Interpretations

OBJECTIVES

To examine whether radiologists' mammogram reading performance varies according to how long they have been awake ("hours awake") and the number of hours they slept ("hours slept") the night before a reading session.

METHODS

Retrospective data were retrieved from the BreastScreen Reader Assessment Strategy database. Malignancy-enriched mammographic readings were performed by 133 radiologists. Information on their hours awake and hours slept was collected. Analysis of covariance was performed to determine whether these two variables influenced radiologists' sensitivity, specificity, lesion sensitivity, receiver operating characteristic (ROC) curve, and jackknife alternative free-response ROC. Radiologists were divided into a more experienced and a less experienced groups (based on reading ≥2,000 and <2,000 mammogram readings per year, respectively).

RESULTS

The hours awake significantly influenced less experienced radiologists' lesion sensitivity (F_6,63 = 2.51; P = .03). Those awake for <2 hours had significantly lower lesion sensitivity than those awake for 8 to 10 hours (P = .01), and those awake for 4 to 6 hours had significantly lower lesion sensitivity than those awake for 8 to 10 hours (P = .002) and 10 to 12 hours (P = .02). The hours slept also influenced the ROC values of less experienced radiologists (F_1,68 = 4.96; P = .02). Radiologists with up to 6 hours of sleep had a significantly lower value (0.72) than those who had slept more than 6 hours (0.77). No statistically significant findings were noted for more experienced radiologists.

CONCLUSION

Inexperienced radiologists' performance may be influenced by the hours awake and hours slept before reading sessions.