Adverse events in neurosurgery and their relationship to quality improvement

Enhancing the quality of evidence, comparability, and reproducibility in brain arteriovenous malformations treated with open surgery research: a systematic review and proposal of a reporting guideline for surgical and clinical outcomes

Brain Arteriovenous Malformations (bAVMs) are rare but high-risk developmental anomalies of the vascular system. Microsurgery through craniotomy is believed to be the mainstay standard treatment for many grades of bAVMs. However, a significant challenge emerges in the existing body of clinical studies on open surgery for bAVMs: the lack of reproducibility and comparability. This study aims to assess the quality of studies reporting clinical and surgical outcomes for bAVMs treated by open surgery and develop a reporting guideline checklist focusing on essential elements to ensure comparability and reproducibility. This is a systematic literature review that followed the PRISMA guidelines with the search in Medline, Embase, and Web of Science databases, for studies published between January 1, 2018, and December 1, 2023. Included studies were scrutinized focusing on seven domains: (1) Assessment of How Studies Reported on the Baseline Characteristics of the Patient Sample; (2) Assessment and reporting on bAVMs grading, anatomical characteristics, and radiological aspects; (3) Angioarchitecture Assessment and Reporting; (4) Reporting on Pivotal Concepts Definitions; (5) Reporting on Neurosurgeon(s) and Staff Characteristics; (6) Reporting on Surgical Details; (7) Assessing and Reporting Clinical and Surgical Outcomes and AEs. A total of 47 studies comprising 5,884 patients were included. The scrutiny of the studies identified that the current literature in bAVM open surgery is deficient in many aspects, ranging from fundamental pieces of information of methodology to baseline characteristics of included patients and data reporting. Included studies demonstrated a lack of reproducibility that hinders building cumulative evidence. A bAVM Open Surgery Reporting Guideline with 65 items distributed across eight domains was developed and is proposed in this study aiming to address these shortcomings. This systematic review identified that the available literature regarding microsurgery for bAVM treatment, particularly in studies reporting clinical and surgical outcomes, lacks rigorous scientific methodology and quality in reporting. The proposed bAVM Open Surgery Reporting Guideline covers all essential aspects and is a potential solution to address these shortcomings and increase transparency, comparability, and reproducibility in this scenario. This proposal aims to advance the level of evidence and enhance knowledge regarding the Open Surgery treatment for bAVMs.

Perioperative quality indicators among neurosurgery patients: A retrospective cohort study of 1142 cases at a tertiary center

OBJECTIVE

The purpose of this study was to present the first comprehensive analysis of perioperative quality indicators; length of hospital stay; readmission; reoperation; pre-, intra, and postoperative events; and mortality in a diverse neurosurgical patient cohort in Europe.

METHODS

Electronic medical records of all patients who were admitted to our institution between January 1 and December 31 of 2020, and underwent an index neurosurgical operation (n = 1142) were retrospectively reviewed.

RESULTS

The median length of hospital stay at the index admission and readmission was 8 days (range: 1-242 days) and 5 days (range: 0-94 days), respectively. Of the 1142 patients, 22.9% (n = 262) had an extended length of hospital stay of ≥14 days. The all-cause 7-, 15-, 30-, 60-, and 90-day readmission rates were 3.9% (n = 44), 5.7% (n = 65), 8.8% (n = 100), 12.3% (n = 141), and 16.5% (n = 188), respectively. The main reason for unplanned readmission was deterioration of medical and/or neurological condition. The all-cause 7-, 15-, 30-, 60-, and 90-day reoperation rates were 11.1% (n = 127), 13.8% (n = 158), 16.5% (n = 189), 18.7% (n = 213), and 19.4% (n = 221), respectively. Unplanned reoperations were due primarily to hydrocephalus. The rate of preoperative events was 1.1% (n = 13), one-third of which were associated with infection. The rate of intraoperative events was 11.0% (n = 126), of which 98 (64.47%) were surgical, 37 (24.34%) were anesthesiologic, and 17 (11.18%) were associated with technical equipment. The rate of postoperative events was 9.5% (n = 109). The most common postoperative event was malfunction, disconnection, or dislocation of an implanted device (n = 24, 17.91%). The mortality rates within 7, 15, 30, 60, and 90 days after the index operation were 0.9% (n = 10), 1.8% (n = 21), 2.5% (n = 29), 3.4% (n = 39), and 4.7% (n = 54), respectively. Several patient characteristics and perioperative factors were significantly associated with outcome parameters.

CONCLUSIONS

This study provides an in-depth analysis of quality indicators in neurosurgery, highlighting a variety of inherent and modifiable factors influencing patient outcomes.

The "STARS" study: advanced preoperative rehearsal and intraoperative navigation in neurosurgical oncology

BACKGROUND

Neurosurgical 3D visualizers and simulators are innovative devices capable of defining a surgical strategy in advance and possibly making neurosurgery safer by rehearsing the phases of the operation beforehand. The aim of this study is to evaluate Surgical Theater™ (Surgical Theater LLC, Mayfield, OH, USA), a new 3D neurosurgical planning, simulation, and navigation system, and qualitatively assess its use in the operating room.

METHODS

Clinical data were collected from 30 patients harboring various types of brain tumors; Surgical Theater™ was used for the preoperative planning and intraoperative 3D navigation. Preoperative and postoperative questionnaires were completed by first and second operators to get qualitative feedback on the system's functionality. Furthermore, we measured and compared the impact of this technology on surgery duration.

RESULTS

Neurosurgeons were overall satisfied when using this rehearsal and navigation tool and found it efficient and easy to use; interestingly, residents considered this device more useful as compared to their more senior colleagues (with significantly higher scores, P<0.05), possibly because of their limited anatomical experience and spatial/surgical rehearsal ability. The length of the surgical procedure was not affected by this technology (P>0.05).

CONCLUSIONS

Surgical Theater™ system was found to be clinically useful in improving anatomical understanding, surgical planning, and intraoperative navigation, especially for younger and less experienced neurosurgeons.

Addressing Problems in Reporting and Classification of Complications in Neurosurgery

Objective. The purpose of this study was to quantify the rate of adverse events associated to in neurosurgery interventions, to evaluate the differences in reporting of such events among different authors and reviews, and to find the reason behind the occurrence of this differences. Methods. A systematic literature review of scientific publications on existing classifications and reports of frequency on complications in neurosurgery was performed by analysing articles from international databases. Results and conclusion. This current overview is taking an outlook on the existing issues in the classification and reporting of complications in neurosurgery. Complications are common in neurosurgery. Because of nonuniform criteria, unstandardized data gathering procedures, and retrospective data collection, their reporting is inconsistent and varies considerably among authors and reviews. The best way to address this issue is by gathering prospective, multi-institutional outcomes data on neurosurgical patients. The data collection initiatives in the future should be using same terminology and be based on the same universally accepted criteria.

Impact of system approach and personal performance on preventable morbidity and mortality events in neurosurgery patients

PURPOSE

Adverse events in neurosurgery are a serious problem. The approach for seeking solutions for adverse events has shifted from a personal approach to a systemic approach. However, to some extent, preventable morbidity events could be related to personal performance. This study aimed to clarify the impact of personal performance and systematic failure on the occurrence of morbidity and mortality events in neurosurgery patients.

METHODS

All morbidity and mortality conference data stored within our department over a 9-year period were analyzed. There were 4580 admitted patients and 3262 surgical procedures performed. We performed a three-step classification of morbidity and mortality events based on the possibility of prevention, root of the event, and personal or systemic issues.

RESULTS

As a result of the first step, 214 preventable and 278 unpreventable events were identified. Of the preventable events, two mortality and 212 morbidity events were analyzed. In the second step, 155 (72.4%), 34 (15.9%), 13 (6.1%), and 12 (5.6%) events were categorized as technical complications, critical events, judgment errors, and human factors, respectively. There were 179 events (83.6%) classified as personal performance issues and 35 events (16.4%) as systemic issues. The ratio of personal performance to systemic issues varied widely, with significant differences among the four categories (P < 0.01).

CONCLUSIONS

Among neurosurgery patients who have preventable morbidity, issues related to personal performance were more frequent than systemic issues. Efforts to improve systems should be unwavering. However, the personal responsibility of neurosurgeons to avoid preventable complications should not be ignored.

Developing standardized titles to classify the adverse events in 7,418 cranial and spinal neurosurgical procedures

BACKGROUND

Neurosurgical procedures are life- and function-saving but carry a risk of adverse events (AE) which can cause permanent neurologic deficits. Unfortunately, there is lack of clearly defined AEs associated with given procedures, and their reporting is non-uniform and often arbitrary. However, with an increasing number of neurosurgical procedures performed, there is a need for standardization of AEs for systematic tracking. Such a system would establish a baseline for future quality improvement strategies.

OBJECTIVE

To review our institutional AEs and devise standardized titles specific to the spine, tumor, functional, and vascular neurosurgery divisions.

METHODS

A review of prospective monthly-reported morbidity and mortality (M&M) conference data within the Department of Neurological Surgery was conducted from January 2017 to December 2019. An AE was defined as any mortality, an "unintended and undesirable diagnostic or therapeutic event", "an event that prolongs the patient's hospital stay", or an outcome with permanent or transient neurologic deficit.

RESULTS

A total of 1096 AEs from 7418 total procedures (14.8 %) were identified. Of those, 418 (5.6 %) were in cerebrovascular, 249 (3.4 %) were in neuro-oncology and 429 (5.8 %) were in the spine & functional divisions. The most common AEs across all divisions were infection (17 %), hemorrhage (11 %) and cerebrospinal fluid (CSF) leak (7.8 %). Other AEs were indirectly related to the neurosurgical procedure, such as deep vein thrombosis or pulmonary embolism (2.7 %), or pneumothorax (0.3 %).

CONCLUSION

This work illustrates standardized AEs can be implemented universally across the spectrum of neurological surgery. Standardization can help identify recurring AE patterns through better tracking.

The impact of craniotomy for brain tumor case volume on patient safety indicators and in-hospital mortality

OBJECTIVES

The relationship between outcomes, patient safety indicators and volume has been well established in patient's undergoing craniotomy for brain tumor. However, the determination of "high" and "low" volume centers have been subjectively derived. We present a paper with a novel method of objectively determining "high" volume centers for craniotomy for brain tumor.

METHODS

Patients from 2002 to 2011 were identified in the Nationwide Inpatient Sample database using ICD-9 codes related to craniotomy for brain tumor. Primary endpoints of interest were hospital PSI event rate, in-hospital mortality rate, observed-to-expected PSI event ratio, and O/E in-hospital mortality ratio. Using a zero-inflated gamma model analysis and a cutpoint analysis we determined the volume threshold between and "high" and "low" volume hospitals. We then completed an analysis using this determined threshold to look at PSI events and mortality as they relate to "high" volume and "low" volume hospitals.

RESULTS

12.4 % of hospitals were categorized as good performers using O/E ratios. Regarding in-hospital mortality, 16.8 % were good performers. Using the above statistical analysis the threshold to define high vs. low volume centers was determined to be 27 craniotomies. High volume centers had significantly lower O/E ratios for both PSI and mortality events. The PSI O/E ratio was reduced 55 % and mortality O/E ratio reduced 73 % at high volume centers as defined by our analysis.

CONCLUSIONS

Patients treated at institutions performing >27 craniotomies per year for brain tumors have a lower likelihood of PSI events and decreased in-hospital morbidity and mortality.

Quality of British and American Nationwide Quality of Care and Patient Safety Benchmarking Programs: Case Neurosurgery

BACKGROUND

Multiple nationwide outcome registries are utilized for quality benchmarking between institutions and individual surgeons.

OBJECTIVE

To evaluate whether nationwide quality of care programs in the United Kingdom and United States can measure differences in neurosurgical quality.

METHODS

This prospective observational study comprised 418 consecutive adult patients undergoing elective craniotomy at Helsinki University Hospital between December 7, 2011 and December 31, 2012.We recorded outcome event rates and categorized them according to British Neurosurgical National Audit Programme (NNAP), American National Surgical Quality Improvement Program (NSQIP), and American National Neurosurgery Quality and Outcomes Database (N2QOD) to assess the applicability of these programs for quality benchmarking and estimated sample sizes required for reliable quality comparisons.

RESULTS

The rate of in-hospital major and minor morbidity was 18.7% and 38.0%, respectively, and 30-d mortality rate was 2.4%. The NSQIP criteria identified 96.2% of major but only 38.4% of minor complications. N2QOD performed better, but almost one-fourth (23.2%) of all patients with adverse outcomes, mostly minor, went unnoticed. For NNAP, a sample size of over 4200 patients per surgeon is required to detect a 50.0% increase in mortality rates between surgeons. The sample size required for reliable comparisons between the rates of complications exceeds 600 patients per center per year.

CONCLUSION

The implemented benchmarking programs in the United Kingdom and United States fail to identify a considerable number of complications in a high-volume center. Health care policy makers should be cautious as outcome comparisons between most centers and individual surgeons are questionable if based on the programs.

Incorporating Quality Improvement into Resident Education: Structured Curriculum, Evaluation, and Quality Improvement Projects

BACKGROUND

Quality Improvement (QI) is essential for improving health care delivery and is now a required component of neurosurgery residency. However, neither a formal curriculum nor implementation strategies have been established by the Accreditation Council for Graduate Medical Education.

METHODS

We describe our experience with implementing a formal QI curriculum, including structured didactics and resident led group-based QI projects. Course materials and didactics were provided by the Mayo Quality Academy. Participants were required to take a 30-question multiple-choice exam to demonstrate basic proficiency in QI methods following completion of didactic. An anonymous survey also was performed to elicit feedback from course participants.

RESULTS

All of the 40 student participants (17 residents) were able to demonstrate basic proficiency in QI methods on a standardized exam upon course completion. Of the 9 attempted QI projects, 7 were completed, with 5 of those resulting in sustained process changes. The majority of participants felt formal training improved confidence in QI processes and was a valuable professional tool for their careers.

CONCLUSIONS

A formal didactic curriculum and practical application of QI methodologies adds value to resident training. Further, it has the potential to positively impact practice. Consideration should be given to adopting a formal QI curriculum by other neurosurgery departments and perhaps standardization on national level.

Relationship between patient safety indicator events and comprehensive stroke center volume status in the treatment of unruptured cerebral aneurysms

OBJECTIVE

The Agency of Healthcare Research and Quality (AHRQ) has defined Patient Safety Indicators (PSIs) for assessments in quality of inpatient care. The hypothesis of this study is that, in the treatment of unruptured cerebral aneurysms (UCAs), PSI events are less likely to occur in hospitals meeting the volume thresholds defined by The Joint Commission for Comprehensive Stroke Center (CSC) certification.

METHODS

Using the 2002–2011 National (Nationwide) Inpatient Sample, patients treated electively for a nonruptured cerebral aneurysm were selected. Patients were evaluated for PSI events (e.g., pressure ulcers, retained surgical item, perioperative hemorrhage, pulmonary embolism, sepsis) defined by AHRQ-specified ICD-9 codes. Hospitals were categorized by treatment volume into CSC or non-CSC volume status based on The Joint Commission’s annual volume thresholds of at least 20 patients with subarachnoid hemorrhage and performance of 15 or more endovascular coiling or surgical clipping procedures for aneurysms.

RESULTS

A total of 65,824 patients underwent treatment for an unruptured cerebral aneurysm. There were 4818 patients (7.3%) in whom at least 1 PSI event occurred. The overall inpatient mortality rate was 0.7%. In patients with a PSI event, this rate increased to 7% compared with 0.2% in patients without a PSI event (p < 0.0001). The overall rate of poor outcome was 3.8%. In patients with a PSI event, this rate increased to 23.3% compared with 2.3% in patients without a PSI event (p < 0.0001). There were significant differences in PSI event, poor outcome, and mortality rates between non-CSC and CSC volume-status hospitals (PSI event, 8.4% vs 7.2%; poor outcome, 5.1% vs 3.6%; and mortality, 1% vs 0.6%). In multivariate analysis, all patients treated at a non-CSC volume-status hospital were more likely to suffer a PSI event with an OR of 1.2 (1.1–1.3). In patients who underwent surgery, this relationship was more substantial, with an OR of 1.4 (1.2–1.6). The relationship was not significant in the endovascularly treated patients.

CONCLUSIONS

In the treatment of unruptured cerebral aneurysms, PSI events occur relatively frequently and are associated with significant increases in morbidity and mortality. In patients treated at institutions achieving the volume thresholds for CSC certification, the likelihood of having a PSI event, and therefore the likelihood of poor outcome and mortality, was significantly decreased. These improvements are being driven by the improved outcomes in surgical patients, whereas outcomes and mortality in patients treated endovascularly were not sensitive to the CSC volume status of the hospital and showed no significant relationship with treatment volumes.

Variability in Standard Outcomes of Posterior Lumbar Fusion Determined by National Databases

OBJECTIVE

National databases are used with increasing frequency in spine surgery literature to evaluate patient outcomes. The differences between individual databases in relationship to outcomes of lumbar fusion are not known. We evaluated the variability in standard outcomes of posterior lumbar fusion between the University HealthSystem Consortium (UHC) database and the Healthcare Cost and Utilization Project National Inpatient Sample (NIS).

METHODS

NIS and UHC databases were queried for all posterior lumbar fusions (International Classification of Diseases, Ninth Revision code 81.07) performed in 2012. Patient demographics, comorbidities (including obesity), length of stay (LOS), in-hospital mortality, and complications such as urinary tract infection, deep venous thrombosis, pulmonary embolism, myocardial infarction, durotomy, and surgical site infection were collected using specific International Classification of Diseases, Ninth Revision codes.

RESULTS

Analysis included 21,470 patients from the NIS database and 14,898 patients from the UHC database. Demographic data were not significantly different between databases. Obesity was more prevalent in UHC (P = 0.001). Mean LOS was 3.8 days in NIS and 4.55 in UHC (P < 0.0001). Complications were significantly higher in UHC, including urinary tract infection, deep venous thrombosis, pulmonary embolism, myocardial infarction, surgical site infection, and durotomy. In-hospital mortality was similar between databases.

CONCLUSIONS

NIS and UHC databases had similar demographic patient populations undergoing posterior lumbar fusion. However, the UHC database reported significantly higher complication rate and longer LOS. This difference may reflect academic institutions treating higher-risk patients; however, a definitive reason for the variability between databases is unknown. The inability to precisely determine the basis of the variability between databases highlights the limitations of using administrative databases for spinal outcome analysis.

The present and future of quality measures and public reporting in neurosurgery

Quality measurement and public reporting are intended to facilitate targeted outcome improvement, practice-based learning, shared decision making, and effective resource utilization. However, regulatory implementation has created a complex network of reporting requirements for physicians and medical practices. These include Medicare’s Physician Quality Reporting System, Electronic Health Records Meaningful Use, and Value-Based Payment Modifier programs. The common denominator of all these initiatives is that to avoid penalties, physicians must meet “generic” quality standards that, in the case of neurosurgery and many other specialties, are not pertinent to everyday clinical practice and hold specialists accountable for care decisions outside of their direct control.

The Centers for Medicare and Medicaid Services has recently authorized alternative quality reporting mechanisms for the Physician Quality Reporting System, which allow registries to become subspecialty-reporting mechanisms under the Qualified Clinical Data Registry (QCDR) program. These programs further give subspecialties latitude to develop measures of health care quality that are relevant to the care provided. As such, these programs amplify the power of clinical registries by allowing more accurate assessment of practice patterns, patient experiences, and overall health care value. Neurosurgery has been at the forefront of these developments, leveraging the experience of the National Neurosurgery Quality and Outcomes Database to create one of the first specialty-specific QCDRs.

Recent legislative reform has continued to change this landscape and has fueled optimism that registries (including QCDRs) and other specialty-driven quality measures will be a prominent feature of federal and private sector quality improvement initiatives. These physician- and patient-driven methods will allow neurosurgery to underscore the value of interventions, contribute to the development of sustainable health care solutions, and actively participate in meaningful quality initiatives for the benefit of the patients served.

Length of hospital stay after craniotomy for tumor: a National Surgical Quality Improvement Program analysis

OBJECT

Although the length of hospital stay is often used as a measure of quality of care, data evaluating the predictors of extended hospital stay after craniotomy for tumor are limited. The goals of this study were to use multivariate regression to examine which preoperative characteristics and postoperative complications predict a prolonged hospital stay and to assess the impact of length of stay on unplanned hospital readmission.

METHODS

Data were extracted from the National Surgical Quality Improvement Program (NSQIP) database from 2007 to 2013. Patients who underwent craniotomy for resection of a brain tumor were included. Stratification was based on length of hospital stay, which was dichotomized by the upper quartile of the interquartile range (IQR) for the entire population. Covariates included patient age, sex, race, tumor histology, comorbidities, American Society of Anesthesiologists (ASA) class, functional status, preoperative laboratory values, preoperative neurological deficits, operative time, and postoperative complications. Multivariate logistic regression with forward prediction was used to evaluate independent predictors of extended hospitalization. Thereafter, hierarchical multivariate logistic regression assessed the impact of length of stay on unplanned readmission.

RESULTS

The study included 11,510 patients. The median hospital stay was 4 days (IQR 3-8 days), and 27.7% (n = 3185) had a hospital stay of at least 8 days. Independent predictors of extended hospital stay included age greater than 70 years (OR 1.53, 95% CI 1.28%-1.83%, p < 0.001); African American (OR 1.75, 95% CI 1.44%-2.14%, p < 0.001) and Hispanic (OR 1.68, 95% CI 1.36%-2.08%) race or ethnicity; ASA class 3 (OR 1.52, 95% CI 1.34%-1.73%) or 4-5 (OR 2.18, 95% CI 1.82%-2.62%) designation; partially (OR 1.94, 95% CI 1.61%-2.35%) or totally dependent (OR 3.30, 95% CI 1.95%-5.55%) functional status; insulin-dependent diabetes mellitus (OR 1.46, 95% CI 1.16%-1.84%); hematological comorbidities (OR 1.68, 95% CI 1.25%-2.24%); and preoperative hypoalbuminemia (OR 1.78, 95% CI 1.51%-2.09%, all p ≤ 0.009). Several postoperative complications were additional independent predictors of prolonged hospitalization including pulmonary emboli (OR 13.75, 95% CI 4.73%-39.99%), pneumonia (OR 5.40, 95% CI 2.89%-10.07%), and urinary tract infections (OR 11.87, 95% CI 7.09%-19.87%, all p < 0.001). The C-statistic of the model based on preoperative characteristics was 0.79, which increased to 0.83 after the addition of postoperative complications. A length of stay after craniotomy for tumor score was created based on preoperative factors significant in regression models, with a moderate correlation with length of stay (p = 0.43, p < 0.001). Extended hospital stay was not associated with differential odds of an unplanned hospital readmission (OR 0.97, 95% CI 0.89%-1.06%, p = 0.55).

CONCLUSIONS

In this NSQIP analysis that evaluated patients who underwent craniotomy for tumor, much of the variance in hospital stay was attributable to baseline patient characteristics, suggesting length of stay may be an imperfect proxy for quality. Additionally, longer hospitalizations were not found to be associated with differential rates of unplanned readmission.