Cognitive errors and logistical breakdowns contributing to missed and delayed diagnoses of breast and colorectal cancers: a process analysis of closed malpractice claims

Health information technology tools to accelerate gastrointestinal evaluation in patients with iron deficiency anaemia: a cluster randomised controlled trial

OBJECTIVE

System-level safety measures do not exist to ensure that patients with iron deficiency anaemia (IDA) undergo proper diagnostic evaluations. We sought to determine if a set of EHR (electronic health record) tools and an expedited referral workflow increase short-term completion of bidirectional endoscopy in higher risk patients with IDA.

MATERIALS AND METHODS

We conducted a pragmatic, cluster-randomised trial randomised by primary care physician (PCP) that included 16 PCPs and 316 patients with IDA. Physicians were randomised to intervention or control groups. Intervention components included a patient registry visible within the EHR, point-of-care alert and expedited diagnostic evaluation workflow for IDA. Outcomes were assessed at 120 days. The primary outcome was completion of bidirectional endoscopy. Secondary outcomes were any endoscopy completed or scheduled, gastroenterology consultation completed, and gastroenterology referral or endoscopy ordered or completed.

RESULTS

There were no differences in the primary or secondary outcomes. At 120 days, the primary outcome had occurred for 7 (4%) of the intervention group and 5 (3.5%) of the control group. For the three secondary outcomes, rates were 15 (8.6%), 12 (6.9%) and 39 (22.4%) for the immediate intervention group and 10 (7.0%), 9 (6.3%) and 25 (17.6%) for the control group, respectively, p>0.2. Lack of physician time to use the registry tools was identified as a barrier.

DISCUSSION AND CONCLUSION

Providing PCPs with lists of patients with IDA and a pathway for expedited evaluation did not increase rates of completing endoscopic evaluation in the short term.

TRIAL REGISTRATION NUMBER

NCT05365308.

Exploring why European primary care physicians sometimes do not think of, or act on, a possible cancer diagnosis. A qualitative study

BACKGROUND

While primary care physicians (PCPs) play a key role in cancer detection, they can find cancer diagnosis challenging, and some patients have considerable delays between presentation and onward referral.

AIM

To explore European PCPs' experiences and views on cases where they considered that they had been slow to think of, or act on, a possible cancer diagnosis.

DESIGN & SETTING

A multicentre European qualitative study, based on an online survey with open-ended questions, asking PCPs for their narratives about cases when they had missed a diagnosis of cancer.

METHOD

Using maximum variation sampling, PCPs in 23 European countries were asked to describe what happened in a case where they were slow to think of a cancer diagnosis, and for their views on why it happened. Thematic analysis was used to analyse the data.

RESULTS

A total of 158 PCPs completed the questionnaire. The main themes were as follows: patients' descriptions did not suggest cancer; distracting factors reduced PCPs' cancer suspicions; patients' hesitancy delayed the diagnosis; system factors not facilitating timely diagnosis; PCPs felt that they had acted wrongly; and problems with communicating adequately.

CONCLUSION

The study identified six overarching themes that need to be addressed. Doing so should reduce morbidity and mortality in the small proportion of patients who have a significant, avoidable delay in their cancer diagnosis. The 'Swiss cheese' model of accident causation showed how the themes related to each other.

Misdiagnoses in a Brazilian population with amyotrophic lateral sclerosis

BACKGROUND

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease that affects the upper and lower motor neurons. The correct diagnosis at the onset of the disease is sometimes very difficult, due to the symptoms being very similar to those of other neurological syndromes.

OBJECTIVE

This study aimed to analyze the initial manifestations, the specialty of the first physician visited due the initial complaint, the misdiagnoses, as well as the unnecessary surgical interventions in a new ALS Brazilian population.

METHODS

The medical records of 173 patients with typical ALS were reviewed.

RESULTS

The present study demonstrated that other symptoms, besides weakness, were very frequent as initial presentation of ALS, and orthopedics was the medical specialty most sought by patients at the onset of symptoms. Our frequency of misdiagnoses was 69.7%, and in 7.1% of them, an unnecessary surgical intervention was performed.

CONCLUSIONS

Amyotrophic lateral sclerosis presents a very large pool of signs and symptoms; therefore, there is an urgent need of increasing the disease awareness to other specialties due to the high frequency of misdiagnoses observed in clinical practice.

A Quality Improvement Intervention Leveraging a Safety Net Model for Surveillance Colonoscopy Completion

Systems to address follow-up testing of clinically positive surveillance colonoscopy results are lacking. The impact of an ambulatory safety net (ASN) intervention on rates of colonoscopy completion was assessed. The ASN team identified patients using an electronic registry, conducted patient outreach, coordinated care, and tracked colonoscopy completion. In all, 701 patients were captured in the ASN program: 58.1% (407/701) had possible barriers to follow-up colonoscopy completion, with rates of 80.1% (236/294) if no barrier, and 40.9% (287/701) overall. Colonoscopy completion likelihood increased with prior polypectomy (odds ratio [OR], 1.6; 95% confidence interval [CI], 1.1-2.3), and decreased with White race (OR, 0.5; 95% CI, 0.3-0.9), increased inpatient visits (OR, 0.6; 95% CI, 0.4-0.9), more outreach attempts (OR, 0.6; 95% CI, 0.5-0.7), and fair/poor/inadequate preparation (OR, 0.4; 95% CI, 0.2-0.7) in logistic regression models. An ASN model for quality improvement promotes colonoscopy completion rates and identifies patient barriers.

Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review

Background

Successful breast cancer screening relies on timely follow-up of abnormal mammograms. Delayed or failure to follow-up abnormal mammograms undermines the potential benefits of screening and is associated with poorer outcomes. However, a comprehensive review of inadequate follow-up of abnormal mammograms in primary care has not previously been reported in the literature. This review could identify modifiable factors that influence follow-up, which if addressed, may lead to improved follow-up and patient outcomes.

Methods

A systematic literature review to determine the extent of inadequate follow-up of abnormal screening mammograms in primary care and identify factors impacting on follow-up was conducted. Relevant studies published between 1 January, 1990 and 29 October, 2020 were identified by searching MEDLINE®, Embase, CINAHL® and Cochrane Library, including reference and citation checking. Joanna Briggs Institute Critical Appraisal Checklists were used to assess the risk of bias of included studies according to study design.

Results

Eighteen publications reporting on 17 studies met inclusion criteria; 16 quantitative and two qualitative studies. All studies were conducted in the United States, except one study from the Netherlands. Failure to follow-up abnormal screening mammograms within 3 and at 6 months ranged from 7.2–33% and 27.3–71.6%, respectively. Women of ethnic minority and lower education attainment were more likely to have inadequate follow-up. Factors influencing follow-up included physician-patient miscommunication, information overload created by automated alerts, the absence of adequate retrieval systems to access patient’s results and a lack of coordination of patient records. Logistical barriers to follow-up included inconvenient clinic hours and inconsistent primary care providers. Patient navigation and case management with increased patient education and counselling by physicians was demonstrated to improve follow-up.

Conclusions

Follow-up of abnormal mammograms in primary care is suboptimal. However, interventions addressing amendable factors that negatively impact on follow-up have the potential to improve follow-up, especially for populations of women at risk of inadequate follow-up.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-021-08100-3.

Association between primary care physician diagnostic knowledge and death, hospitalisation and emergency department visits following an outpatient visit at risk for diagnostic error: a retrospective cohort study using medicare claims

OBJECTIVE

Diagnostic error is a key healthcare concern and can result in substantial morbidity and mortality. Yet no study has investigated the relationship between adverse outcomes resulting from diagnostic errors and one potentially large contributor to these errors: deficiencies in diagnostic knowledge. Our objective was to measure that associations between diagnostic knowledge and adverse outcomes after visits to primary care physicians that were at risk for diagnostic errors.

SETTING/PARTICIPANTS

1410 US general internists who recently took their American Board of Internal Medicine Maintenance of Certification (ABIM-IM-MOC) exam treating 42 407 Medicare beneficiaries who experienced 48 632 'index' outpatient visits for new problems at risk for diagnostic error because the presenting problem (eg, dizziness) was related to prespecified diagnostic error sensitive conditions (eg, stroke).

OUTCOME MEASURES

90-day risk of all-cause death, and, for outcome conditions related to the index visits diagnosis, emergency department (ED) visits and hospitalisations.

DESIGN

Using retrospective cohort study design, we related physician performance on ABIM-IM-MOC diagnostic exam questions to patient outcomes during the 90-day period following an index visit at risk for diagnostic error after controlling for practice characteristics, patient sociodemographic and baseline clinical characteristics.

RESULTS

Rates of 90-day adverse outcomes per 1000 index visits were 7 for death, 11 for hospitalisations and 14 for ED visits. Being seen by a physician in the top versus bottom third of diagnostic knowledge during an index visit for a new problem at risk for diagnostic error was associated with 2.9 fewer all-cause deaths (95% CI -5.0 to -0.7, p=0.008), 4.1 fewer hospitalisations (95% CI -6.9 to -1.2, p=0.006) and 4.9 fewer ED visits (95% CI -8.1% to -1.6%, p=0.003) per 1000 visits.

CONCLUSION

Higher diagnostic knowledge was associated with lower risk of adverse outcomes after visits for problems at heightened risk for diagnostic error.

Specific Disease Knowledge as Predictor of Susceptibility to Availability Bias in Diagnostic Reasoning: a Randomized Controlled Experiment

BACKGROUND

Bias in reasoning rather than knowledge gaps has been identified as the origin of most diagnostic errors. However, the role of knowledge in counteracting bias is unclear.

OBJECTIVE

To examine whether knowledge of discriminating features (findings that discriminate between look-alike diseases) predicts susceptibility to bias.

DESIGN

Three-phase randomized experiment. Phase 1 (bias-inducing): Participants were exposed to a set of clinical cases (either hepatitis-IBD or AMI-encephalopathy). Phase 2 (diagnosis): All participants diagnosed the same cases; 4 resembled hepatitis-IBD, 4 AMI-encephalopathy (but all with different diagnoses). Availability bias was expected in the 4 cases similar to those encountered in phase 1. Phase 3 (knowledge evaluation): For each disease, participants decided (max. 2 s) which of 24 findings was associated with the disease. Accuracy of decisions on discriminating features, taken as a measure of knowledge, was expected to predict susceptibility to bias.

PARTICIPANTS

Internal medicine residents at Erasmus MC, Netherlands.

MAIN MEASURES

The frequency with which higher-knowledge and lower-knowledge physicians gave biased diagnoses based on phase 1 exposure (range 0-4). Time to diagnose was also measured.

KEY RESULTS

Sixty-two physicians participated. Higher-knowledge physicians yielded to availability bias less often than lower-knowledge physicians (0.35 vs 0.97; p = 0.001; difference, 0.62 [95% CI, 0.28-0.95]). Whereas lower-knowledge physicians tended to make more of these errors on subjected-to-bias than on not-subjected-to-bias cases (p = 0.06; difference, 0.35 [CI, - 0.02-0.73]), higher-knowledge physicians resisted the bias (p = 0.28). Both groups spent more time to diagnose subjected-to-bias than not-subjected-to-bias cases (p = 0.04), without differences between groups.

CONCLUSIONS

Knowledge of features that discriminate between look-alike diseases reduced susceptibility to bias in a simulated setting. Reflecting further may be required to overcome bias, but succeeding depends on having the appropriate knowledge. Future research should examine whether the findings apply to real practice and to more experienced physicians.

Nutrition Information in Oncology - Extending the Electronic Patient-Record Data Set

Electronic health records (EHRs) present extensive patient information and may be used as a tool to improve health care. However, the oncology context presents a complex content that increases the difficulties of EHR application. This study aimed at developing openEHR-archetypes representing clinical concepts in cancer nutrition-care, as well as to develop an openEHR-template including the aforementioned archetypes. The study involved the following stages: 1) a thorough literature review, followed by an expert’s (nutrition guideline authors) survey, aiming to identify the main statements of published clinical guidelines on nutrition in cancer patients that were not included on the Clinical Knowledge Manager (CKM) repository; 2) modelling of the archetypes using the Ocean Archetype Software and submission to the CKM repository; 3) creating an example template with Template Designer; and 4) automatic conversion of the openEHR-template into a readily usable EHR using VCIntegrator. The clinical concepts (among 17 clinical concepts not yet available in the CKM repository) chosen for further development were: body composition, diet plan, dietary nutrients, dietary supplements, dietary intake assessment, and Malnutrition Screening Tool (MST). So far, four archetypes were accepted for review in the CKM repository and a template was created and converted into an EHR. This study designed new openEHR-archetypes for nutrition management in cancer patients. These archetypes can be included in EHR. Future studies are needed to assess their applicability in other areas and their practical impact on data quality, system interoperability and, ultimately, on clinical practice and research.

Think Twice: Effects on Diagnostic Accuracy of Returning to the Case to Reflect Upon the Initial Diagnosis

PURPOSE

Diagnostic errors have been attributed to failure to sufficiently reflect on initial diagnoses. However, evidence of the benefits of reflection is conflicting. This study examined whether reflection upon initial diagnoses on difficult cases improved diagnostic accuracy and whether reflection triggered by confrontation with case evidence was more beneficial than simply revising initial diagnoses.

METHOD

Participants were physicians in Bern, Switzerland, registered for the 2018 Swiss internal medicine certification exam. They diagnosed written clinical cases, providing an initial diagnosis by following the same instructions and returning to the case to provide a final diagnosis. The latter required different types of reflection depending on the physician's experimental condition: return without instructions, identify confirmatory evidence, identify contradictory evidence, or identify both confirmatory and contradictory evidence. The authors examined diagnostic accuracy scores (range 0-1) as a function of diagnostic phase and reflection type.

RESULTS

One hundred and sixty-seven physicians participated. Diagnostic accuracy scores did not significantly differ between the 4 groups of physicians in the initial (I) or the final (F) diagnostic phase (mean [95% CI]: return without instructions, I: 0.21 [0.17, 0.26], F: 0.23 [0.18, 0.28]; confirmatory evidence, I: 0.24 [0.19, 0.29], F: 0.31 [0.25, 0.37]; contradictory evidence, I: 0.22 [0.17, 0.26], F: 0.26 [0.22, 0.30]; confirmatory and contradictory evidence, I: 0.19 [0.15, 0.23], F: 0.25 [0.20, 0.31]). Regardless of type of reflection employed while revising the case, accuracy increased significantly between initial and final diagnosis, I: 0.22 (0.19, 0.24) vs F: 0.26 (0.24, 0.29); P < .001.

CONCLUSIONS

Physicians' diagnostic accuracy improved after reflecting upon initial diagnoses provided for difficult cases, independently of the evidence searched for while reflecting. The findings support the importance attributed to reflection in clinical teaching. Future research should investigate whether revising the case can become more beneficial by triggering additional reflection.

Time to diagnosis and factors affecting diagnostic delay in amyotrophic lateral sclerosis

Amyotrophic lateral sclerosis (ALS) is a progressive, degenerative neuromuscular disease with limited treatment options. The diagnosis of ALS can be challenging for numerous reasons, resulting in delays that may compromise optimal management and enrollment into clinical trials. Several studies have examined the process and challenges regarding the clinical diagnosis of ALS. Twenty-one studies that were almost exclusively from the English literature published between 1990 and 2020 were identified via PubMed using relevant search terms and included patient populations from the United States, Canada, Japan, Egypt, and several countries in South America and Europe. Probable or definitive ALS patients were identified using El Escorial or revised El Escorial/Airlie House Criteria. Time to diagnosis or diagnostic delay was defined as mean or median time from patient-reported first symptom onset to formal diagnosis by a physician, as recorded in medical records. The typical time to diagnosis was 10-16 months from symptom onset. Several points of delay in the diagnosis course were identified, including specialist referrals and misdiagnoses, often resulting in unnecessary procedures and surgeries. Bulbar onset was noted to significantly reduce time to ALS diagnosis. Future interventions and potential research opportunities were reviewed.

Immunising' physicians against availability bias in diagnostic reasoning: a randomised controlled experiment

Background

Diagnostic errors have often been attributed to biases in physicians’ reasoning. Interventions to ‘immunise’ physicians against bias have focused on improving reasoning processes and have largely failed.

Objective

To investigate the effect of increasing physicians’ relevant knowledge on their susceptibility to availability bias.

Design, settings and participants

Three-phase multicentre randomised experiment with second-year internal medicine residents from eight teaching hospitals in Brazil.

Interventions

Immunisation: Physicians diagnosed one of two sets of vignettes (either diseases associated with chronic diarrhoea or with jaundice) and compared/contrasted alternative diagnoses with feedback. Biasing phase (1 week later): Physicians were biased towards either inflammatory bowel disease or viral hepatitis. Diagnostic performance test: All physicians diagnosed three vignettes resembling inflammatory bowel disease, three resembling hepatitis (however, all with different diagnoses). Physicians who increased their knowledge of either chronic diarrhoea or jaundice 1 week earlier were expected to resist the bias attempt.

Main outcome measurements

Diagnostic accuracy, measured by test score (range 0–1), computed for subjected-to-bias and not-subjected-to-bias vignettes diagnosed by immunised and not-immunised physicians.

Results

Ninety-one residents participated in the experiment. Diagnostic accuracy differed on subjected-to-bias vignettes, with immunised physicians performing better than non-immunised physicians (0.40 vs 0.24; difference in accuracy 0.16 (95% CI 0.05 to 0.27); p=0.004), but not on not-subjected-to-bias vignettes (0.36 vs 0.41; difference −0.05 (95% CI −0.17 to 0.08); p=0.45). Bias only hampered non-immunised physicians, who performed worse on subjected-to-bias than not-subjected-to-bias vignettes (difference −0.17 (95% CI −0.28 to −0.05); p=0.005); immunised physicians’ accuracy did not differ (p=0.56).

Conclusions

An intervention directed at increasing knowledge of clinical findings that discriminate between similar-looking diseases decreased physicians’ susceptibility to availability bias, reducing diagnostic errors, in a simulated setting. Future research needs to examine the degree to which the intervention benefits other disease clusters and performance in clinical practice.

Trial registration number

68745917.1.1001.0068.

Comparing Diagnostic Evaluations for Rectal Bleeding and Breast Lumps in Primary Care: a Retrospective Cohort Study

BACKGROUND

Inadequate diagnostic evaluations of breast lumps and rectal bleeding in primary care are an important source of medical errors. Delays appear particularly common in evaluation of rectal bleeding. Comparing pursuit and completion of diagnostic testing for these two conditions within the same practice settings could help highlight barriers and inform interventions.

OBJECTIVES

To examine processes undertaken for diagnostic evaluations of breast lumps and rectal bleeding within the same practices and to compare them with regard to (a) the likelihood that diagnostic tests are ordered according to guidelines and (b) the timeliness of order placement and completion.

DESIGN

A retrospective cohort study using explicit chart abstraction methods.

PARTICIPANTS

Three hundred women aged 30-80 presenting with breast lumps and 300 men and women aged 40-80 years presenting with rectal bleeding to 15 academically affiliated primary care practices, 2012-2016.

MAIN MEASURES

Rates and timing of test ordering and completion and patterns of visits and communications.

KEY RESULTS

At initial presentation, physicians ordered recommended imaging or procedures at higher rates for patients with breast lumps compared to those with rectal bleeding (97% vs. 86% of patients recommended to receive imaging or endoscopy; p < 0.01). Most (90%) patients with breast lumps completed recommended diagnostic testing within 1 month, versus 31% of patients with rectal bleeding (p < 0.01). By 1 year, 7% of patients with breast lumps had not completed indicated imaging, versus 27% of those with rectal bleeding. Patients with breast lumps had fewer subsequent primary care visits related or unrelated to their symptom and had fewer related communications with specialists.

LIMITATIONS

The study relied on documented care, and findings may be most generalizable to academically affiliated institutions.

CONCLUSIONS

Diagnostic processes for rectal bleeding were less frequently guideline-concordant and timely than those for breast lumps. The largest discrepancies occurred in initial ordering of indicated tests and the timeliness of test completion.

An IDEA: Safety Training to Improve Critical Thinking by Individuals and Teams

Errors in thinking contribute to harm, delays in diagnosis, incorrect treatments, or failures to recognize clinical changes. Models of cognition are useful in understanding error occurrence and avoidance. Intra-team conflict can represent failures in joint cognitive processing. The authors developed training focused on recognizing and managing cognitive bias and resolving conflicts. The program provides context and introduces models of cognition, concepts of bias, team cognition, conflict resolution, and 2 tools. "IDEA" incorporates 4 de-biasing strategies: Identify assumptions; Don't assume correctness; Explore expectations; Assess alternatives. "TLA" presents strategies for resolving conflicts: Tell your thoughts; Listen actively, and Ask questions. A total of 4941 care providers participated in training using didactic presentations, group discussion, and simulation. Learners rated training effectiveness at 4.68 on a scale of 1 to 5 (5 as optimum) and perceived improvement in recognizing or managing errors. Nonphysician caregivers reported greatest improvement. Training to improve critical thinking is feasible, well received, and effective.

Informatics External Quality Assurance (IEQA) Down Under: evaluation of a pilot implementation

External quality assurance (EQA) provides ongoing evaluation to verify that laboratory medicine results conform to quality standards expected for patient care. While attention has focused predominantly on test accuracy, the diagnostic phases, consisting of pre- and post-laboratory phases of testing, have thus far lagged in the development of an appropriate diagnostic-phase EQA program. One of the challenges faced by Australian EQA has been a lack of standardisation or “harmonisation” resulting from variations in reporting between different laboratory medicine providers. This may introduce interpretation errors and misunderstanding of results by clinicians, resulting in a threat to patient safety. While initiatives such as the Australian Pathology Information, Terminology and Units Standardisation (PITUS) program have produced Standards for Pathology Informatics in Australia (SPIA), conformity to these requires regular monitoring to maintain integrity of data between sending (laboratory medicine providers) and receiving (physicians, MyHealth Record, registries) organisations’ systems. The PITUS 16 Informatics EQA (IEQA) Project together with the Royal College of Pathologists of Australasia Quality Assurance Programs (RCPAQAP) has created a system to perform quality assurance on the electronic laboratory message when the laboratory sends a result back to the EQA provider. The purpose of this study was to perform a small scale pilot implementation of an IEQA protocol, which was performed to test the suitability of the system to check compliance of existing Health Level-7 (HL7 v2.4) reporting standards localised and constrained by the RCPA SPIA. Here, we present key milestones from the implementation, including: (1) software development, (2) installation, and verification of the system and communication services, (3) implementation of the IEQA program and compliance testing of the received HL7 v2.4 report messages, (4) compilation of a draft Informatics Program Survey Report for each laboratory and (5) review consisting of presentation of a report showing the compliance checking tool to each participating laboratory.

Responsibility for follow-up during the diagnostic process in primary care: a secondary analysis of International Cancer Benchmarking Partnership data

BACKGROUND

It is unclear to what extent primary care practitioners (PCPs) should retain responsibility for follow-up to ensure that patients are monitored until their symptoms or signs are explained.

AIM

To explore the extent to which PCPs retain responsibility for diagnostic follow-up actions across 11 international jurisdictions.

DESIGN AND SETTING

A secondary analysis of survey data from the International Cancer Benchmarking Partnership.

METHOD

The authors counted the proportion of 2879 PCPs who retained responsibility for each area of follow-up (appointments, test results, and non-attenders). Proportions were weighted by the sample size of each jurisdiction. Pooled estimates were obtained using a random-effects model, and UK estimates were compared with non-UK ones. Free-text responses were analysed to contextualise quantitative findings using a modified grounded theory approach.

RESULTS

PCPs varied in their retention of responsibility for follow-up from 19% to 97% across jurisdictions and area of follow-up. Test reconciliation was inadequate in most jurisdictions. Significantly fewer UK PCPs retained responsibility for test result communication (73% versus 85%, P = 0.04) and non-attender follow-up (78% versus 93%, P<0.01) compared with non-UK PCPs. PCPs have developed bespoke, inconsistent solutions to follow-up. In cases of greatest concern, 'double safety netting' is described, where both patient and PCP retain responsibility.

CONCLUSION

The degree to which PCPs retain responsibility for follow-up is dependent on their level of concern about the patient and their primary care system's properties. Integrated systems to support follow-up are at present underutilised, and research into their development, uptake, and effectiveness seems warranted.

Diagnostic Evaluation of Patients Presenting to Primary Care with Rectal Bleeding

BACKGROUND

Rectal bleeding is a common, frequently benign problem that can also be an early sign of colorectal cancer. Diagnostic evaluation for rectal bleeding is complex, and clinical practice may deviate from available guidelines.

OBJECTIVE

To assess the degree to which primary care physicians document risk factors for colorectal cancer among patients with rectal bleeding and order colonoscopies when indicated, and the likelihood of physicians ordering and patients receiving recommended colonoscopies based on demographic characteristics, visit patterns, and clinical presentations.

DESIGN

Cross-sectional study using explicit chart abstraction methods.

PARTICIPANTS

Three hundred adults, 40-80 years of age, presenting with rectal bleeding to 15 academically affiliated primary care practices between 2012 and 2016.

MAIN MEASURES

1) The frequency at which colorectal cancer risk factors were documented in patients' charts, 2) the frequency at which physicians ordered colonoscopies and patients received them, and 3) the odds of ordering and patients receiving recommended colonoscopies based on patient demographic characteristics, visit patterns, and clinical presentations.

KEY RESULTS

Risk factors for colorectal cancer were documented between 9% and 66% of the time. Most patients (89%) with rectal bleeding needed a colonoscopy according to a clinical guideline. Physicians placed colonoscopy orders for 74% of these patients, and 56% completed the colonoscopy within a year (36% within 60 days). The odds of physicians ordering recommended colonoscopies were significantly higher in patients aged 50-64 years of age than in those aged 40-50 years (OR = 2.23, 95% CI: 1.04, 4.80), and for patients whose most recent colonoscopy was 5 or more years ago (OR = 4.04, 95% CI: 1.50, 10.83). The odds of physicians ordering and patients receiving recommended colonoscopies were significantly lower for each primary care visit unrelated to rectal bleeding (OR = 0.85, 95% CI: 0.75, 0.96).

CONCLUSIONS

Diagnostic evaluation of patients presenting to primary care with rectal bleeding may be suboptimal because of inadequate risk factor assessment and prioritization of patients' other concurrent medical problems.

Electronic Triggers to Identify Delays in Follow-Up of Mammography: Harnessing the Power of Big Data in Health Care

PURPOSE

We previously developed electronic triggers to automatically flag records for patients experiencing potential delays in diagnostic evaluation for certain cancers. Because of the unique clinical, logistic, and legal aspects of mammography, this study was conducted to evaluate the effectiveness of a trigger to flag delayed follow-up on mammography.

METHODS

An algorithm was developed to detect delays in follow-up of abnormal mammographic results (>60 days for BI-RADS^® 0, 4, and 5 and >7 months for BI-RADS 3) using clinical data in the electronic health record. Flagged records were then manually reviewed to determine the trigger's performance characteristics (positive and negative predictive value, sensitivity, and specificity). The frequency of delays and patient communication related to abnormal results, reasons for lack of follow-up, and whether patients were subsequently diagnosed with breast cancer were also assessed.

RESULTS

Of 365,686 patients seen between January 1, 2010, and May 31, 2015, the trigger identified 2,129 patients with abnormal findings on mammography, of whom it flagged 552 as having delays in follow-up. From these, review of 400 randomly selected records revealed 283 true delays (positive predictive value, 71%; 95% confidence interval, 66%-75%), including 280 records without any documented plan and three patients with plans that were not adhered to. Transcription and reporting inconsistencies were identified in 27% of externally performed mammographic reports. Only 335 records (84%) contained specific documentation that the patient was informed of the abnormal result.

CONCLUSIONS

Care delays appear to continue despite federal laws requiring patient notification of mammographic results within 30 days. Clinical application of mammography-related triggers could help detect these delays.

Delayed Workup of Rectal Bleeding in Adult Primary Care: Examining Process-of-Care Failures

BACKGROUND

Although delayed colorectal cancer diagnoses figure prominently in medical malpractice claims, little is known about the quality of primary care clinicians' workup of rectal bleeding.

METHODS

In this study, 438 patients were identified using International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes for rectal bleeding, hemorrhoids, and blood in the stool at 10 Boston adult primary care practices. Following nurse chart abstraction, physician reviewers assessed the overall quality of care and key care processes. Subjects' characteristics and physician reviewers' processes-of-care assessments were tabulated, and logistic regression models were used to examine the association of process failures with overall quality and guideline concordance.

RESULTS

Although reviewers judged the overall quality of care to be good or excellent in 337 (77%) of 438 cases, 312 (71%) patients experienced at least one process-of-care failure in the workup of rectal bleeding. Clinicians failed to obtain an adequate family history in 38% of cases, complete a pertinent physical exam in 23%, and order laboratory tests in 16%. Failure to order or perform tests, or to make follow-up plans were associated with increased odds of poor or fair care. Guideline concordance bore little relationship with quality judgments. Reviewers judged that 128 delays could have been reduced or prevented.

CONCLUSION

Process-of-care failures among adult primary care patients with rectal bleeding were frequent and associated with fair or poor quality. Educating practitioners and creating systems to ensure adequate history taking, physical examination, and processes for ordering, performing, and interpreting diagnostic tests may improve performance.

Patient Preferences for Test Result Notification

IMPORTANCE

Patients are increasingly being given access to their test results, but little is known about how preferences vary with the test under consideration or the results of the test (normal or abnormal).

OBJECTIVE

This study was conducted to examine preferences for test result communication.

DESIGN, SETTING, AND PARTICIPANTS

We surveyed adults to explore their preferences for test result notification for three common diagnostic tests of varying "emotional impact" (dual-energy x-ray absorptiometry [DXA], genital herpes, and cancer biopsy) when test results were 1) normal and 2) abnormal. We conducted our survey between June and August 2012 on the campus of an academic medical center. For each scenario, subjects were asked to rank seven methods that might be used to communicate test results (letter, unsecured email, secured email, text message, telephone call, secure Web portal, office visit) in order of acceptability.

MAIN OUTCOME MEASURES

The main measures were the percentage of respondents who ranked a particular test result notification method favorably and the percentage who ranked it as unacceptable.

RESULTS

When test results were normal, subjects' notification preferences were generally similar for DXA, herpes and cancer biopsy, with telephone and letter ranked most favorably for all three tests. Conversely, text message and unsecured email were viewed as unacceptable notification methods for normal results by 45.0-55.0 % of subjects across all three tests. When test results were abnormal, office visits became more popular. A higher proportion of subjects ranked office visits as their most preferred notification method for our test with high "emotional impact" (cancer biopsy) (38.4 %) as compared to DXA (28.2 %) and herpes (27.9 %) (P = 0.02). For most test scenarios, younger subjects appeared to rank electronic communication modalities (secure email or Web portal) higher than older subjects, though this difference did not reach statistical significance (P = 0.29).

CONCLUSIONS

Preferences for test result notification can differ substantially depending upon the test under consideration and results of the test. Providers and health care systems should consider these factors when deciding how to communicate results to patients.

Development and Validation of Electronic Health Record-based Triggers to Detect Delays in Follow-up of Abnormal Lung Imaging Findings

Purpose To develop an electronic health record (EHR)-based trigger algorithm to identify delays in follow-up of patients with imaging results that are suggestive of lung cancer and to validate this trigger on retrospective data. Materials and Methods The local institutional review board approved the study. A "trigger" algorithm was developed to automate the detection of delays in diagnostic evaluation of chest computed tomographic (CT) images and conventional radiographs that were electronically flagged by reviewing radiologists as being "suspicious for malignancy." The trigger algorithm was developed through literature review and expert input. It included patients who were alive and 40-70 years old, and it excluded instances in which appropriate timely follow-up (defined as occurring within 30 days) was detected (eg, pulmonary visit) or when follow-up was unnecessary (eg, in patients with a terminal illness). The algorithm was iteratively applied to a retrospective test cohort in an EHR data warehouse at a large Veterans Affairs facility, and manual record reviews were used to validate each individual criterion. The final algorithm aimed at detecting an absence of timely follow-up was retrospectively applied to an independent validation cohort to determine the positive predictive value (PPV). Trigger performance, time to follow-up, reasons for lack of follow-up, and cancer outcomes were analyzed and reported by using descriptive statistics. Results The trigger algorithm was retrospectively applied to the records of 89 168 patients seen between January 1, 2009, and December 31, 2009. Of 538 records with an imaging report that was flagged as suspicious for malignancy, 131 were identified by the trigger as being high risk for delayed diagnostic evaluation. Manual chart reviews confirmed a true absence of follow-up in 75 cases (trigger PPV of 57.3% for detecting evaluation delays), of which four received a diagnosis of primary lung cancer within the subsequent 2 years. Conclusion EHR-based triggers can be used to identify patients with suspicious imaging findings in whom follow-up diagnostic evaluation was delayed. (©) RSNA, 2015.

Assessment of follow-up completeness and notification preferences for imaging findings of possible cancer: what happens after radiologists submit their reports?

RATIONALE AND OBJECTIVES

To understand the reasons leading to potentially inappropriate management of imaging findings concerning for malignancy and identify optimal methods for communicating these findings to providers.

MATERIALS AND METHODS

We identified all abdominal imaging examinations with findings of possible cancer performed on six randomly selected days in August to December 2013. Electronic medical records (EMR) of one patient group were reviewed 3 months after the index examination to determine whether management was appropriate (completed follow-up or documented reason for no follow-up) or potentially inappropriate (no follow-up or no documented reason). Providers of a second patient group were contacted 5-6 days after imaging examinations to determine notification preferences.

RESULTS

Among 43 patients in the first group, five (12%) received potentially inappropriate management. Reasons included patient loss to follow-up and provider failure to review imaging results, document known imaging findings, or communicate findings to providers outside the health system. Among 16 providers caring for patients in the second group, 33% were unaware of the findings, 75% preferred to be notified of abnormal findings via e-mail or EMR, 56% wanted an embedded hyperlink enabling immediate follow-up order entry, and only 25% had a system to monitor whether patients had completed ordered testing.

CONCLUSIONS

One in eight patients did not receive potentially necessary follow-up care within 3 months of imaging findings of possible cancer. Automated notification of imaging findings and follow-up monitoring not only is desired by providers but can also address many of the reasons we found for inappropriate management.

Electronic health record-based triggers to detect potential delays in cancer diagnosis

BACKGROUND

Delayed diagnosis of cancer can lead to patient harm, and strategies are needed to proactively and efficiently detect such delays in care. We aimed to develop and evaluate 'trigger' algorithms to electronically flag medical records of patients with potential delays in prostate and colorectal cancer (CRC) diagnosis.

METHODS

We mined retrospective data from two large integrated health systems with comprehensive electronic health records (EHR) to iteratively develop triggers. Data mining algorithms identified all patient records with specific demographics and a lack of appropriate and timely follow-up actions on four diagnostic clues that were newly documented in the EHR: abnormal prostate-specific antigen (PSA), positive faecal occult blood test (FOBT), iron-deficiency anaemia (IDA), and haematochezia. Triggers subsequently excluded patients not needing follow-up (eg, terminal illness) or who had already received appropriate and timely care. Each of the four final triggers was applied to a test cohort, and chart reviews of randomly selected records identified by the triggers were used to calculate positive predictive values (PPV).

RESULTS

The PSA trigger was applied to records of 292 587 patients seen between 1 January 2009 and 31 December 2009, and the CRC triggers were applied to 291 773 patients seen between 1 March 2009 and 28 February 2010. Overall, 1564 trigger positive patients were identified (426 PSA, 355 FOBT, 610 IDA and 173 haematochezia). Record reviews revealed PPVs of 70.2%, 66.7%, 67.5%, and 58.3% for the PSA, FOBT, IDA and haematochezia triggers, respectively. Use of all four triggers at the study sites could detect an estimated 1048 instances of delayed or missed follow-up of abnormal findings annually and 47 high-grade cancers.

CONCLUSIONS

EHR-based triggers can be used successfully to flag patient records lacking follow-up of abnormal clinical findings suspicious for cancer.