Should previous mammograms be digitised in the transition to digital mammography?

Optimising the diagnostic accuracy of First post-contrAst SubtracTed breast MRI (FAST MRI) through interpretation-training: a multicentre e-learning study, mapping the learning curve of NHS Breast Screening Programme (NHSBSP) mammogram readers using an enriched dataset

BACKGROUND

Abbreviated breast MRI (FAST MRI) is being introduced into clinical practice to screen women with mammographically dense breasts or with a personal history of breast cancer. This study aimed to optimise diagnostic accuracy through the adaptation of interpretation-training.

METHODS

A FAST MRI interpretation-training programme (short presentations and guided hands-on workstation teaching) was adapted to provide additional training during the assessment task (interpretation of an enriched dataset of 125 FAST MRI scans) by giving readers feedback about the true outcome of each scan immediately after each scan was interpreted (formative assessment). Reader interaction with the FAST MRI scans used developed software (RiViewer) that recorded reader opinions and reading times for each scan. The training programme was additionally adapted for remote e-learning delivery.

STUDY DESIGN

Prospective, blinded interpretation of an enriched dataset by multiple readers.

RESULTS

43 mammogram readers completed the training, 22 who interpreted breast MRI in their clinical role (Group 1) and 21 who did not (Group 2). Overall sensitivity was 83% (95%CI 81-84%; 1994/2408), specificity 94% (95%CI 93-94%; 7806/8338), readers' agreement with the true outcome kappa = 0.75 (95%CI 0.74-0.77) and diagnostic odds ratio = 70.67 (95%CI 61.59-81.09). Group 1 readers showed similar sensitivity (84%) to Group 2 (82% p = 0.14), but slightly higher specificity (94% v. 93%, p = 0.001). Concordance with the ground truth increased significantly with the number of FAST MRI scans read through the formative assessment task (p = 0.002) but by differing amounts depending on whether or not a reader had previously attended FAST MRI training (interaction p = 0.02). Concordance with the ground truth was significantly associated with reading batch size (p = 0.02), tending to worsen when more than 50 scans were read per batch. Group 1 took a median of 56 seconds (range 8-47,466) to interpret each FAST MRI scan compared with 78 (14-22,830, p < 0.0001) for Group 2.

CONCLUSIONS

Provision of immediate feedback to mammogram readers during the assessment test set reading task increased specificity for FAST MRI interpretation and achieved high diagnostic accuracy. Optimal reading-batch size for FAST MRI was 50 reads per batch. Trial registration (25/09/2019): ISRCTN16624917.

[Mental Workload Assessment of Health Care Staff by NASA-TLX]

The National Aeronautics Space Administration Task Load Index (NASA-TLX) is the most frequently used mental workload assessment method. This article reviews 26 papers which report mental workload evaluation in health care staff, categorizing them into laparoscopic surgery, anesthesia, ICU, electronic record, patient controlled analgesia, emergency, display and others. Although indices other than NASA-TLX were also used in these papers, this review describes the results of NASA-TLX only.

Double Reading in Breast Cancer Screening: Cohort Evaluation in the CO-OPS Trial

Purpose To investigate the effect of double readings by a second radiologist on recall rates, cancer detection, and characteristics of cancers detected in the National Health Service Breast Screening Program in England. Materials and Methods In this retrospective analysis, 805 206 women were evaluated through screening and diagnostic test results by extracting 1 year of routine data from 33 English breast screening centers. Centers used double reading of digital mammograms, with arbitration if there were discrepant interpretations. Information on reader decisions, with results of follow-up tests, were used to explore the effect of the second reader. The statistical tests used were the test for equality of proportions, the χ2 test for independence, and the t test. Results The first reader recalled 4.76% of women (38 295 of 805 206 women; 95% confidence interval [CI]: 4.71%, 4.80%). Two readers recalled 6.19% of women in total (49 857 of 805 206 women; 95% CI: 6.14%, 6.24%), but arbitration of discordant readings reduced the recall rate to 4.08% (32 863 of 805 206 women; 95% CI: 4.04%, 4.12%; P < .001). A total of 7055 cancers were detected, of which 627 (8.89%; 95% CI: 8.22%, 9.55%; P < .001) were detected by the second reader only. These additional cancers were more likely to be ductal carcinoma in situ (30.5% [183 of 600] vs 22.0% [1344 of 6114]; P < .001), and additional invasive cancers were smaller (mean size, 14.2 vs 16.7 mm; P < .001), had fewer involved nodes, and were likely to be lower grade. Conclusion Double reading with arbitration reduces recall and increases cancer detection compared with single reading. Cancers detected only by the second reader were smaller, of lower grade, and had less nodal involvement. © RSNA, 2018.

Changing case Order to Optimise patterns of Performance in mammography Screening (CO-OPS): study protocol for a randomized controlled trial

BACKGROUND

X-ray mammography remains the predominant test for screening for breast cancer, with the aim of reducing breast cancer mortality. In the English NHS Breast Screening Programme each woman's mammograms are examined separately by two expert readers. The two readers read each batch in the same order and each indicates if there should be recall for further tests. This is a highly skilled, pressurised, repetitive and frequently intellectually unchallenging activity where readers examine one or more batches of 30-50 women's mammograms in each session. A vigilance decrement or performance decrease over time has been observed in similar repetitive visual tasks such as radar operation.

METHODS/DESIGN

The CO-OPS study is a pragmatic, multi-centre, two-arm, double blind cluster randomised controlled trial of a computer software intervention designed to reduce the effects of a vigilance decrement in breast cancer screening. The unit of randomisation is the batch. Intervention batches will be examined in the opposite order by the two readers (one forwards, one backwards). Control batches will be read in the same order as one another, as is current standard practice. The hypothesis is that cancer detection rates will be higher in the intervention group because each readers' peak performance will occur when examining different women's mammograms. The trial will take place in 44 English breast screening centres for 1 year and 4 months. The primary outcome is cancer detection rate, which will be extracted from computer records after 1 year of the trial. The secondary outcomes include rate of disagreement between readers (a more statistically powerful surrogate for cancer detection rate), recall rate, positive predictive value, and interval cancer rate (cancers found between screening rounds which will be measured three years after the end of the trial).

DISCUSSION

This is the first trial of an intervention to ameliorate a vigilance decrement in breast cancer screening.

TRIAL REGISTRATION

ISRCTN46603370 (submitted: 24 October 2012, date of registration: 26 March 2013).

Measurement of mental workload in clinical medicine: a review study

Background:

Measures of mental workload are now commonly used in industries to identify sources of error and to improve performance.

Objectives:

This study aimed to review the evidence for the use of this technique within medicine.

Patients and Methods:

We used search engines and the internet to identify experimental studies that included a measure of mental workload in medical practitioners or trainees/students. Studies that aimed to measure mental “stress” as a disorder, or “productivity” were excluded. Each abstract and then the full paper were appraised prior to inclusion.

Results:

Thirty-three studies were identified that matched the inclusion criteria. Although these covered a variety of settings, common methods were identifiable. The results support the concept of mental workload measurement as an important factor in medical performance.

Conclusions:

The limited number of studies and the variety of definitions and measurement techniques used in these studies, make direct comparisons difficult. However, the utility of this methodology in medical education appears to have been established, and guidelines for further research methods are proposed.

Use of prior mammograms in the transition to digital mammography: a performance and cost analysis

Breast screening in Europe is gradually changing from film to digital imaging and reporting of cases. In the transition period prior mammograms (from the preceding screening round) are films thereby potentially causing difficulties in comparison to current digital mammograms. To examine this breast screening performance was measured at a digital mammography workstation with prior mammograms displayed in different formats, and the associated costs calculated. 160 selected difficult cases (41% malignant) were read by eight UK qualified mammography readers in three conditions: with film prior mammograms; with digitised prior mammograms; or without prior mammograms. Lesion location and probability of malignancy were recorded, alongside a decision of whether to recall each case for further tests. JAFROC analysis showed a difference between conditions (p=.006); performance with prior mammograms in either film or digitised formats was superior to that without prior mammograms (p<.05). There was no difference in the performance when the prior mammograms were presented in film or digitised form. The number of benign or normal cases recalled was 26% higher without prior mammograms than with digitised or film prior mammograms (p<.05). This would correspond to an increase in recall rate at the study hospital from 4.3% to 5.5% with no associated increase in cancer detection rate. The cost of this increase was estimated to be £11,581 (€13,666) per 10,000 women screened, which is higher than the cost of digitised (£11,114/€13,115), or film display (£6451/€7612) of the prior mammograms. It is recommended that, where available, prior mammograms are used in the transition to digital breast screening.