Surgical Care and Outcomes Assessment Program (SCOAP): A Nuanced, Flexible Platform for Colorectal Surgical Research

The Surgical Care and Outcomes Assessment Program (SCOAP) is a surgeon-led quality improvement (QI) initiative developed in Washington State to track and reduce variability in surgical care. It has developed into a collaboration of over two-thirds of the hospitals in the state, who share data and receive regular benchmarking reports. Data are abstracted at each site by trained abstractors. While there has some overlap with other national QI databases, the data captured by SCOAP has clinical nuances that make it pragmatic for studying surgical care. We review the unique properties of SCOAP and offer some examples of its novel applications.

The Reliability of a Standardized Reporting System for the Diagnosis of Appendicitis

PURPOSE

Computed tomography (CT) is a fast and ubiquitous tool to evaluate intra-abdominal organs and diagnose appendicitis. However, traditional CT reporting does not necessarily capture the degree of uncertainty and indeterminate findings are still common. The purpose of this study was to evaluate the reproducibility of a standardized CT reporting system for appendicitis across a large population and the system's impact on radiologists' certainty in diagnosing appendicitis.

METHODS

Using a previously described standardized reporting system, eight radiologists retrospectively evaluated CT scans, blinded to all clinical information, in a stratified random sample of 237 patients from a larger cohort of patients imaged for possible appendicitis (2010-2014). Receiver operating characteristic (ROC) curves and the area under the ROC curve (AUC) were used to evaluate the diagnostic performance of readers for identifying appendicitis. Two-thirds of these scans were randomly selected to be independently read by a second reader, using the original CT reports to balance the number of positive, negative and indeterminate exams across all readers. Inter-reader agreement was evaluated.

RESULTS

There were 113 patients with appendicitis (mean age 38, 67% male). Using the standardized report, radiologists were highly accurate at identifying appendicitis (AUC=0.968, 95%CI confidence interval: 0.95, 0.99. Inter-reader agreement was >80% for most objective findings, and certainty in diagnosing appendicitis was high and reproducible (AUC=0.955 and AUC=0.936 for the first and second readers, respectively).

CONCLUSIONS

Using a standardized reporting system resulted in high reproducibility of objective CT findings for appendicitis and achieved high diagnostic accuracy in an at-risk population. Predictive tools based on this reporting system may further improve communication about certainty in diagnosis and guide patient management, especially when CT findings are indeterminate.

Number of Diverticulitis Episodes Before Resection and Factors Associated With Earlier Interventions

IMPORTANCE

Despite professional recommendations to delay elective colon resection for patients with uncomplicated diverticulitis, early surgery (after <3 preceding episodes) appears to be common. Several factors have been suggested to contribute to early surgery, including increasing numbers of younger patients, a lower threshold to operate laparoscopically, and growing recognition of "smoldering" (or nonrecovering) diverticulitis episodes. However, the relevance of these factors in early surgery has not been well tested, and most prior studies have focused on hospitalizations, missing outpatient events and making it difficult to assess guideline adherence in earlier interventions.

OBJECTIVE

To describe patterns of episodes of diverticulitis before surgery and factors associated with earlier interventions using inpatient, outpatient, and antibiotic prescription claims.

DESIGN, SETTING, AND PARTICIPANTS

This investigation was a nationwide retrospective cohort study from January 1, 2009, to December 31, 2012. The dates of the analysis were July 2014 to May 2015. Participants were immunocompetent adult patients (age range, 18-64 years) with incident, uncomplicated diverticulitis.

EXPOSURE

Elective colectomy for diverticulitis.

MAIN OUTCOMES AND MEASURES

Inpatient, outpatient, and antibiotic prescription claims for diverticulitis captured in the MarketScan (Truven Health Analytics) databases.

RESULTS

Of 87 461 immunocompetent patients having at least 1 claim for diverticulitis, 6.4% (n = 5604) underwent a resection. The final study cohort comprised 3054 nonimmunocompromised patients who underwent elective resection for uncomplicated diverticulitis, of whom 55.6% (n = 1699) were male. Before elective surgery, they had a mean (SD) of 1.0 (0.9) inpatient claims, 1.5 (1.5) outpatient claims, and 0.5 (1.2) antibiotic prescription claims related to diverticulitis. Resection occurred after fewer than 3 episodes in 94.9% (2897 of 3054) of patients if counting inpatient claims only, in 80.5% (2459 of 3054) if counting inpatient and outpatient claims only, and in 56.3% (1720 of 3054) if counting all types of claims. Based on all types of claims, patients having surgery after fewer than 3 episodes were of similar mean age compared with patients having delayed surgery (both 47.7 years, P = .91), were less likely to undergo laparoscopy (65.1% [1120 of 1720] vs 70.8% [944 of 1334], P = .001), and had more time between the last 2 episodes preceding surgery (157 vs 96 days, P < .001). Patients with health maintenance organization or capitated insurance plans had lower rates of early surgery (50.1% [247 of 493] vs 57.4% [1429 of 2490], P = .01) than those with other insurance plan types.

CONCLUSIONS AND RELEVANCE

After considering all types of diverticulitis claims, 56.3% (1720 of 3054) of elective resections for uncomplicated diverticulitis occurred after fewer than 3 episodes. Earlier surgery was not explained by younger age, laparoscopy, time between the last 2 episodes preceding surgery, or financial risk-bearing for patients. In delivering value-added surgical care, factors driving early, elective resection for diverticulitis need to be determined.

Diagnosing Surgical Site Infection Using Wound Photography: A Scenario-Based Study

BACKGROUND

Postoperative surgical site infections (SSI) are common and costly. Most occur post discharge, and can result in potentially preventable readmission or unnecessary urgent evaluation. Mobile health approaches incorporating patient-generated wound photos are being implemented in an attempt to optimize triage and management. We assessed how adding wound photos to existing data sources modifies provider decision making.

STUDY DESIGN

We used a web-based simulation survey using a convenience sample of providers with expertise in surgical infections. Participants viewed a range of scenarios, including surgical history, physical exam, and description of wound appearance. All participants reported SSI diagnosis, diagnostic confidence, and management recommendations (main outcomes) first without, and then with, accompanying wound photos. At each step, participants ranked the most important features contributing to their decision.

RESULTS

Eighty-three participants completed a median of 5 scenarios (interquartile range 4 to 7). Most participants were physicians in academic surgical specialties (n = 70 [84%]). The addition of photos improved overall diagnostic accuracy from 67% to 76% (p < 0.001), and increased specificity from 77% to 92% (p < 0.001), but did not significantly increase sensitivity (55% to 65%; p = 0.16). Photos increased mean confidence in diagnosis from 5.9 of 10 to 7.4 of 10 (p < 0.001). Overtreatment recommendations decreased from 48% to 16% (p < 0.001), and undertreatment did not change (28% to 23%; p = 0.20) with the addition of photos.

CONCLUSIONS

The addition of wound photos to existing data as available via chart review and telephone consultation with patients significantly improved diagnostic accuracy and confidence, and prevented proposed overtreatment in scenarios without SSI. Post-discharge mobile health technologies have the potential to facilitate patient-centered care, decrease costs, and improve clinical outcomes.

Use of Computed Tomography to Determine Perforation in Patients With Acute Appendicitis

PURPOSE

Urgent appendectomy has long been the standard of care for acute appendicitis. Six randomized trials have demonstrated that antibiotics can safely treat appendicitis, but approximately 1 in 4 of these patients eventually requires appendectomy. Overall treatment success may be limited by complex disease including perforation. Patients׳ success on antibiotic therapy may depend on preoperative identification of complex disease on imaging. However, the effectiveness of computed tomography (CT) in differentiating complex disease including perforated from nonperforated appendicitis remains to be determined. The purpose of this study was to assess the preoperative diagnostic accuracy of CT in determining appendiceal perforation in patients operated for acute appendicitis.

METHODS

We performed a retrospective review of pathology and radiology reports from consecutive patients who presented to the emergency department with suspicion for acute appendicitis between January 2012 and May 2015. CT scans were re-reviewed by abdominal imaging fellowship-trained radiologists using standardized criteria, and the radiologists were blinded to pathology and surgical findings. Radiologists specifically noted presence or absence of periappendiceal gas, abscess, appendicolith, fat stranding, and bowel wall thickening. The overall radiologic impression as well as these specific imaging findings was compared to results of pathology and operative reports. Pathology reports were considered the standard for diagnostic accuracy.

RESULTS

Eighty-nine patients (65% male, average age of 34 years) presenting with right lower quadrant pain underwent CT imaging and prompt appendectomy. Final pathology reported perforation in 48% (n = 43) of cases. Radiologic diagnosis of perforation was reported in 9% (n = 8), correctly identifying perforation in 37.5% (n = 3), and incorrectly reporting perforation in 62.5% of nonperforated cases per pathology. Radiology missed 93% (n = 40) of perforations postoperatively diagnosed by pathology. There was no secondary finding (fat stranding, diameter >13mm, abscess, cecal wall thickening, periappendiceal gas, simple fluid collection, appendicolith, and phlegmon) with a clinically reliable sensitivity or specificity to predict perforated appendicitis. Surgeon׳s report of perforation was consistent with the pathology report of perforation in only 28% of cases.

CONCLUSIONS

The usefulness of a CT for determining perforation in acute appendicitis is limited, and methods to improve precision in identifying patients with complicated appendicitis should be explored as this may help for improving risk prediction for failure of treatment with antibiotic therapy and help guide patients and providers in shared decision-making for treatment options.

Understanding clinical and non-clinical decisions under uncertainty: a scenario-based survey

BACKGROUND

Prospect theory suggests that when faced with an uncertain outcome, people display loss aversion by preferring to risk a greater loss rather than incurring certain, lesser cost. Providing probability information improves decision making towards the economically optimal choice in these situations. Clinicians frequently make decisions when the outcome is uncertain, and loss aversion may influence choices. This study explores the extent to which prospect theory, loss aversion, and probability information in a non-clinical domain explains clinical decision making under uncertainty.

METHODS

Four hundred sixty two participants (n = 117 non-medical undergraduates, n = 113 medical students, n = 117 resident trainees, and n = 115 medical/surgical faculty) completed a three-part online task. First, participants completed an iced-road salting task using temperature forecasts with or without explicit probability information. Second, participants chose between less or more risk-averse ("defensive medicine") decisions in standardized scenarios. Last, participants chose between recommending therapy with certain outcomes or risking additional years gained or lost.

RESULTS

In the road salting task, the mean expected value for decisions made by clinicians was better than for non-clinicians(-$1,022 vs -$1,061; <0.001). Probability information improved decision making for all participants, but non-clinicians improved more (mean improvement of $64 versus $33; p = 0.027). Mean defensive decisions decreased across training level (medical students 2.1 ± 0.9, residents 1.6 ± 0.8, faculty1.6 ± 1.1; p-trend < 0.001) and prospect-theory-concordant decisions increased (25.4%, 33.9%, and 40.7%;p-trend = 0.016). There was no relationship identified between road salting choices with defensive medicine and prospect-theory-concordant decisions.

CONCLUSIONS

All participants made more economically-rational decisions when provided explicit probability information in a non-clinical domain. However, choices in the non-clinical domain were not related to prospect-theory concordant decision making and risk aversion tendencies in the clinical domain. Recognizing this discordance may be important when applying prospect theory to interventions aimed at improving clinical care.

Assessing surgeon behavior change after anastomotic leak in colorectal surgery

BACKGROUND

Recency effect suggests that people disproportionately value events from the immediate past when making decisions, but the extent of this impact on surgeons' decisions is unknown. This study evaluates for recency effect in surgeons by examining use of preventative leak testing before and after colorectal operations with anastomotic leaks.

MATERIALS AND METHODS

Prospective cohort of adult patients (≥18 y) undergoing elective colorectal operations at Washington State hospitals participating in the Surgical Care and Outcomes Assessment Program (2006-2013). The main outcome measure was surgeons' change in leak testing from 6 mo before to 6 mo after an anastomotic leak occurred.

RESULTS

Across 4854 elective colorectal operations performed by 282 surgeons at 44 hospitals, there was a leak rate of 2.6% (n = 124). The 40 leaks (32%) in which the anastomosis was not tested occurred across 25 surgeons. While the ability to detect an overall difference in use of leak testing was limited by small sample size, nine (36%) of 25 surgeons increased their leak testing by 5% points or more after leaks in cases where the anastomosis was not tested. Surgeons who increased their leak testing more frequently performed operations for diverticulitis (45% versus 33%), more frequently began their cases laparoscopically (65% versus 37%), and had longer mean operative times (195 ± 99 versus 148 ± 87 min), all P < 0.001.

CONCLUSIONS

Recency effect was demonstrated by only one-third of eligible surgeons. Understanding the extent to which clinical decisions may be influenced by recency effect may be important in crafting quality improvement initiatives that require clinician behavior change.

Evaluating disparities in inpatient surgical cancer care among American Indian/Alaska Native patients

BACKGROUND

American Indian/Alaska Native (AI/AN) patients with cancer have the lowest survival rates of all racial and ethnic groups, possibly because they are less likely to receive "best practice" surgical care than patients of other races.

METHODS

Prospective cohort study comparing adherence with generic and cancer-specific guidelines on processes of surgical care between AI/AN and non-Hispanic white (NHW) patients in Washington State (2010 to 2014) was conducted.

RESULTS

A total of 156 AI/AN and 6,030 NHW patients underwent operations for 10 different cancers, and had similar mean adherence to generic surgical guidelines (91.5% vs 91.9%, P = .57). AI/AN patients with breast cancer less frequently received preoperative diagnostic core needle biopsy (81% vs 94%, P = .004). AI/AN patients also less frequently received care adherent to prostate cancer-specific guidelines (74% vs 92%, P = .001).

CONCLUSION

Although AI/ANs undergoing cancer operations in Washington receive similar overall best practice surgical cancer care to NHW patients, there remain important, modifiable disparities that may contribute to their lower survival.

Positron emission tomography for initial staging of esophageal cancer among medicare beneficiaries

BACKGROUND

The role of positron emission tomography (PET) in the initial staging of esophageal cancer is to detect occult metastases, but its ability to do so has not been evaluated at the population-level. In 2001, Medicare approved reimbursement of PET for esophageal cancer staging. We hypothesized rapid adoption of PET after 2001 and a coincident increase in the prevalence of stage IV disease.

METHODS

A retrospective cohort study [1997-2009] was conducted of 12,870 Medicare beneficiaries with esophageal cancer using the Surveillance, Epidemiology, and End-Results (SEER)-Medicare database.

RESULTS

PET use increased from <3% before 2001 to 44% in 2009 (post-PET era) (P trend <0.001). Over the same period, the prevalence of stage IV disease also increased (20% in 1997 and 28% in 2009, P trend <0.001). After adjusting for changing patient characteristics over time, the rate of increase in stage IV disease in the post-PET era [relative risk (RR) =1.06; 95% confidence interval (CI), 1.00-1.13] was no different than the rate of increase in the pre-PET era (RR =1.02; 95% CI, 1.02-1.04). Over the entire study period, the prevalence of unrecorded stage decreased by more than half (43% to 18%, adjusted P trend <0.001) with coincident increases in stage 0-III (37% to 53%, adjusted P trend <0.001) as well as stage IV disease.

CONCLUSIONS

The increasing frequency of PET use and stage IV disease over time is more likely explained by improved documentation rather than PET's ability to detect occult metastases. The absence of compelling population-level impact compliments previous studies, revealing an opportunity to increase value through selective use of PET.

A Large Animal Survival Model to Evaluate Bariatric Surgery Mechanisms

Background

The impact of Roux-en-Y gastric bypass (RYGB) on type 2 diabetes mellitus is thought to result from upper and/or lower gut hormone alterations. Evidence supporting these mechanisms is incomplete, in part because of limitations in relevant bariatric-surgery animal models, specifically the lack of naturally insulin-resistant large animals. With overfeeding, Ossabaw swine develop a robust metabolic syndrome, and may be suitable for studying post-surgical physiology. Whether bariatric surgery is feasible in these animals with acceptable survival is unknown.

Methods

Thirty-two Ossabaws were fed a high-fat, high-cholesterol diet to induce obesity and insulin resistance. These animals were assigned to RYGB (n = 8), RYGB with vagotomy (RYGB-V, n = 5), gastrojejunostomy (GJ, n = 10), GJ with duodenal exclusion (GJD, n = 7), or sham operation (n = 2) and were euthanized 60 days post-operatively. Post-operative changes in weight and food intake are reported.

Results

Survival to scheduled necropsy among surgical groups was 77%, living an average of 57 days post-operatively. Cardiac arrest under anesthesia occurred in 4 pigs. Greatest weight loss (18.0% ± 6%) and food intake decrease (57.0% ± 20%) occurred following RYGB while animals undergoing RYGB-V showed only 6.6% ± 3% weight loss despite 50.8% ± 25% food intake decrease. GJ (12.7% ± 4%) and GJD (1.2% ± 1%) pigs gained weight, but less than sham controls (13.4% ± 10%).

Conclusions

A survival model of metabolic surgical procedures is feasible, leads to significant weight loss, and provides the opportunity to evaluate new interventions and subtle variations in surgical technique (e.g. vagus nerve sparing) that may provide new mechanistic insights.

Alvimopan Use, Outcomes, and Costs: A Report from the Surgical Care and Outcomes Assessment Program Comparative Effectiveness Research Translation Network Collaborative

BACKGROUND

Randomized trials have found that alvimopan hastens return of bowel function and reduces length of stay (LOS) by 1 day among patients undergoing colorectal surgery. However, its effectiveness in routine clinical practice and its impact on hospital costs remain uncertain.

STUDY DESIGN

We performed a retrospective cohort study of patients undergoing elective colorectal surgery in Washington state (2009 to 2013) using data from a clinical registry (Surgical Care and Outcomes Assessment Program) linked to a statewide hospital discharge database (Comprehensive Hospital Abstract Reporting System). We used generalized estimating equations to evaluate the relationship between alvimopan and outcomes, and adjusted for patient, operative, and management characteristics. Hospital charges were converted to costs using hospital-specific charge to cost ratios, and were adjusted for inflation to 2013 US dollars.

RESULTS

Among 14,781 patients undergoing elective colorectal surgery at 51 hospitals, 1,615 (11%) received alvimopan. Patients who received alvimopan had a LOS that was 1.8 days shorter (p < 0.01) and costs that were $2,017 lower (p < 0.01) compared with those who did not receive alvimopan. After adjustment, LOS was 0.9 days shorter (p < 0.01), and hospital costs were $636 lower (p = 0.02) among those receiving alvimopan compared with those who did not.

CONCLUSIONS

When used in routine clinical practice, alvimopan was associated with a shorter LOS and limited but significant hospital cost savings. Both efficacy and effectiveness data support the use of alvimopan in routine clinical practice, and its use could be measured as a marker of higher quality care.

Thromboembolic Complications and Prophylaxis Patterns in Colorectal Surgery

IMPORTANCE

Venous thromboembolism (VTE) is an important complication of colorectal surgery, but its incidence is unclear in the era of VTE prophylaxis.

OBJECTIVE

To describe the incidence of and risk factors associated with thromboembolic complications and contemporary VTE prophylaxis patterns following colorectal surgery.

DESIGN, SETTING, AND PARTICIPANTS

Prospective data from the Washington State Surgical Care and Outcomes Assessment Program (SCOAP) linked to a statewide hospital discharge database. At 52 Washington State SCOAP hospitals, participants included consecutive patients undergoing colorectal surgery between January 1, 2006, and December 31, 2011.

MAIN OUTCOMES AND MEASURES

Venous thromboembolism complications in-hospital and up to 90 days after surgery.

RESULTS

Among 16,120 patients (mean age, 61.4 years; 54.5% female), the use of perioperative and in-hospital VTE chemoprophylaxis increased significantly from 31.6% to 86.4% and from 59.6% to 91.4%, respectively, by 2011 (P < .001 for trend for both). Overall, 10.6% (1399 of 13,230) were discharged on a chemoprophylaxis regimen. The incidence of VTE was 2.2% (360 of 16,120). Patients undergoing abdominal operations had higher rates of 90-day VTE compared with patients having pelvic operations (2.5% [246 of 9702] vs 1.8% [114 of 6413], P = .001). Those having an operation for cancer had a similar incidence of 90-day VTE compared with those having an operation for nonmalignant processes (2.1% [128 of 6213] vs 2.3% [232 of 9902], P = .24). On adjusted analysis, older age, nonelective surgery, history of VTE, and operations for inflammatory disease were associated with increased risk of 90-day VTE (P < .05 for all). There was no significant decrease in VTE over time.

CONCLUSIONS AND RELEVANCE

Venous thromboembolism rates are low and largely unchanged despite increases in perioperative and postoperative prophylaxis. These data should be considered in developing future guidelines.

High-quality results of cytoreductive surgery and heated intraperitoneal chemotherapy perfusion for carcinomatosis at a low volume institution

BACKGROUND AND OBJECTIVES

Maximal cytoreductive surgery (CS) with heated intraperitoneal chemotherapy perfusion (HIPEC) for peritoneal carcinomatosis can improve oncologic outcomes, but is associated with significant morbidity. Whether low-volume experience with CS/HIPEC results in acceptable outcomes is unknown.

METHODS

A retrospective review of all patients undergoing CS/HIPEC by a single surgeon. Experience was divided into first versus second 50 cases, and patient characteristics, operative details, and outcomes were compared.

RESULTS

Ninety patients underwent 100 CS/HIPEC procedures (mean age 57 years, 68% female). -Compared to the initial experience, the second 50 cases included more high grade tumors (68 vs. 52%) and greater disease burden (PCI 14.2 vs. 12.4). Operative times remained unchanged and mean blood loss decreased (978 vs. 684 ml). Hospital stay (mean 18.1 vs. 12.6 days), major complications (24 vs. 16%), and perioperative mortality (8 vs. 2%) declined. Overall median survival was 18 months and was longer with low grade tumors (26 vs. 16 months, P = 0.03).

CONCLUSIONS

Patients experienced reduced EBL, fewer major complications, and shorter hospital stay, despite having higher disease burden and higher grade tumors. This suggests that even low-volume experience with CS/HIPEC can lead to a trend in reduction of adverse perioperative events with acceptable oncologic outcomes.

Use of the surgical safety checklist to improve communication and reduce complications

Existing evidence suggests that communication failures are common in the operating room, and that they lead to increased complications, including infections. Use of a surgical safety checklist may prevent communication failures and reduce complications. Initial data from the World Health Organization Surgical Safety Checklist (WHO SSC) demonstrated significant reductions in both morbidity and mortality with checklist implementation. A growing body of literature points out that while the physical act of "checking the box" may not necessarily prevent all adverse events, the checklist is a scaffold on which attitudes toward teamwork and communication can be encouraged and improved. Recent evidence reinforces the fact the compliance with the checklist is critical for the effects on patient safety to be realized.

Rethinking elective colectomy for diverticulitis: A strategic approach to population health

Diverticulitis is one of the leading indications for elective colon resection. Surgeons are trained to offer elective operations after a few episodes of diverticulitis in order to prevent future recurrences and potential emergency. However, most emergency surgery happens during the initial presentation. After recovery from an episode, much of the subsequent management of diverticulitis occurs in the outpatient setting, rendering inpatient “episode counting” a poor measure of the severity or burden of disease. Evidence also suggests that the risk of recurrence of diverticulitis is small and similar with or without an operation. Accordingly, contemporary evaluations of the epidemiologic patterns of treatments for diverticulitis have failed to demonstrate that the substantial rise in elective surgery over the last few decades has been successful at preventing emergency surgery at a population level. Multiple professional societies are calling to “individualize” decisions for elective colectomy and there is an international focus on “appropriate” indications for surgery. The rethinking of elective colectomy should come from a patient-centered approach that considers the risks of recurrence, quality of life, patient wishes and experiences about surgical and medical treatment options as well as operative morbidity and risks.