Quality assessment in surgery: mission impossible?

Enhancing the quality of evidence, comparability, and reproducibility in brain arteriovenous malformations treated with open surgery research: a systematic review and proposal of a reporting guideline for surgical and clinical outcomes

Brain Arteriovenous Malformations (bAVMs) are rare but high-risk developmental anomalies of the vascular system. Microsurgery through craniotomy is believed to be the mainstay standard treatment for many grades of bAVMs. However, a significant challenge emerges in the existing body of clinical studies on open surgery for bAVMs: the lack of reproducibility and comparability. This study aims to assess the quality of studies reporting clinical and surgical outcomes for bAVMs treated by open surgery and develop a reporting guideline checklist focusing on essential elements to ensure comparability and reproducibility. This is a systematic literature review that followed the PRISMA guidelines with the search in Medline, Embase, and Web of Science databases, for studies published between January 1, 2018, and December 1, 2023. Included studies were scrutinized focusing on seven domains: (1) Assessment of How Studies Reported on the Baseline Characteristics of the Patient Sample; (2) Assessment and reporting on bAVMs grading, anatomical characteristics, and radiological aspects; (3) Angioarchitecture Assessment and Reporting; (4) Reporting on Pivotal Concepts Definitions; (5) Reporting on Neurosurgeon(s) and Staff Characteristics; (6) Reporting on Surgical Details; (7) Assessing and Reporting Clinical and Surgical Outcomes and AEs. A total of 47 studies comprising 5,884 patients were included. The scrutiny of the studies identified that the current literature in bAVM open surgery is deficient in many aspects, ranging from fundamental pieces of information of methodology to baseline characteristics of included patients and data reporting. Included studies demonstrated a lack of reproducibility that hinders building cumulative evidence. A bAVM Open Surgery Reporting Guideline with 65 items distributed across eight domains was developed and is proposed in this study aiming to address these shortcomings. This systematic review identified that the available literature regarding microsurgery for bAVM treatment, particularly in studies reporting clinical and surgical outcomes, lacks rigorous scientific methodology and quality in reporting. The proposed bAVM Open Surgery Reporting Guideline covers all essential aspects and is a potential solution to address these shortcomings and increase transparency, comparability, and reproducibility in this scenario. This proposal aims to advance the level of evidence and enhance knowledge regarding the Open Surgery treatment for bAVMs.

Complications after open and laparoscopic right-sided colectomy with central lymphadenectomy for colon cancer: randomized controlled trial

BACKGROUND

A central lymphadenectomy in right-sided colon cancer involves dissection along the superior mesenteric axis, but the extent is debated due to a lack of consensus and the fear of major complications. This randomized controlled trial compared the rate of postoperative morbidity in patients undergoing laparoscopic versus open right-sided colectomy with central lymphadenectomy.

METHODS

This open, prospective, randomized controlled trial compared patients operated on with open and laparoscopic right-sided colectomy (cStages I-III) with a central lymphadenectomy at two Norwegian institutions between October 2016 and December 2021. Dissections were conducted along the superior mesenteric vein in the laparoscopic group, and along the left anterior border of the superior mesenteric artery in the open group, both according to complete mesocolic excision principles. Surgery was standardized and performed by three experienced surgeons for each study group. The primary outcome of interest was to measure postoperative 30-day complications (Clavien-Dindo ≥ grade II).

RESULTS

Of 273 eligible patients, 135 were randomized and 128 analysed (63 operated on with open and 65 using laparoscopic procedures). Postoperative complications occurred in 42.8 per cent of the patients treated with open and 38.4 per cent of the patients treated using laparoscopic surgery, P = 0.372. The incidence of Clavien-Dindo grade IIIb complications was 7.9 per cent in the open versus 4.6 per cent in the laparoscopic group, P = 0.341. There were no grade IV or V complications, and no re-operations due to anastomotic leakages. There was no significant difference in the mean(s.e.m.) number of removed lymph nodes (open versus laparoscopic respectively: 31.9(1.8) versus 29.3(1.3); P = 0.235).

CONCLUSION

There was no significant difference in complications between the two groups. Standardized oncologic right-sided colectomy with central lymphadenectomy along the mesenterial root was performed safely, both open and laparoscopic, with incidence of major complications ranging between 4.6 and 7.9 per cent and no re-operations for anastomotic leakage. Radicality in terms of lymphadenectomy was comparable between the two groups.Registration number: NCT03776591 (http://www.clinicaltrials.gov).

Surgical Complexity and Complications: The Need for a Common Language

BACKGROUND

Quality measurement and outcome assessment have recently caught an attention of the neurosurgical community, but lack of standardized definitions and methodology significantly complicates these tasks.

OBJECTIVE

To identify a uniform definition of neurosurgical complications, to classify them according to etiology, and to evaluate them comprehensively in cases of intracranial tumor removal in order to establish a new, easy, and practical grading system capable of predicting the risk of postoperative clinical worsening of the patient condition.

METHODS

A retrospective analysis was conducted on all elective surgeries directed at removal of intracranial tumor in the authors' institution during 2-year study period. All sociodemographic, clinical, and surgical factors were extracted from prospectively compiled comprehensive patient registry. Data on all complications, defined as any deviation from the ideal postoperative course occurring within 30 days of the procedure, were collected with consideration of the required treatment and etiology. A logistic regression model was created for identification of independent factors associated with worsening of the Karnofsky Performance Scale (KPS) score at discharge after surgery in comparison with preoperative period. For each identified statistically significant independent predictor of the postoperative worsening, corresponding score was defined, and grading system, subsequently named Milan Complexity Scale (MCS), was formed.

RESULTS

Overall, 746 cases of surgeries for removal of intracranial tumor were analyzed. Postoperative complications of any kind were observed in 311 patients (41.7%). In 223 cases (29.9%), worsening of the KPS score at the time of discharge in comparison with preoperative period was noted. It was independently associated with 5 predictive factors-major brain vessel manipulation, surgery in the posterior fossa, cranial nerve manipulation, surgery in the eloquent area, tumor size >4 cm-which comprised MCS with a range of the total score from 0 to 8 (higher score indicates more complex clinical situations). Patients who demonstrated KPS worsening after surgery had significantly higher total MCS scores in comparison with individuals whose clinical status at discharge was improved or unchanged (3.24 ± 1.55 versus 1.47 ± 1.58; P < 0.001).

CONCLUSION

It is reasonable to define neurosurgical complication as any deviation from the ideal postoperative course occurring within 30 days of the procedure. Suggested MCS allows for standardized assessment of surgical complexity before intervention and for estimating the risk of clinical worsening after removal of intracranial tumor. Collection of data on surgical complexity, occurrence of complications, and postoperative outcomes, using standardized prospectively maintained comprehensive patient registries seems very important for quality measurement and should be attained in all neurosurgical centers.

Spine surgery complexity score predicts outcomes in 671 consecutive spine surgery patients

Background:

The spine surgery complexity score (SSCS), previously reported by us, is a simple grading system to predict postoperative complications and hospital length of stay (LOS). This scale is based on the technical difficulty of the spinal procedures being performed.

Methods:

We performed a retrospective chart review to validate SSCS in 671 consecutive patients undergoing spine procedures at a quaternary academic hospital.

Results:

The SSCS was predictive of the hospital LOS and postoperative complications (defined by the ClavienDindo score), based on linear regression analysis (P < 0.001 for both).

Conclusion:

Categorizing procedures according to the SSCS may enable neurosurgeons to assess surgical risk and predict longer LOS courses after spine surgery. Thus, it may prove useful in preoperative patient evaluation/ education and determining a prognosis based on surgical complexity.

Categorisation of complications and validation of the Clavien score for percutaneous nephrolithotomy

BACKGROUND

Although widely used, the validity and reliability of the Clavien classification of postoperative complications have not been tested in urologic procedures, such as percutaneous nephrolithotomy (PCNL).

OBJECTIVE

To validate the Clavien score and categorise complications of PCNL.

DESIGN, SETTING, AND PARTICIPANTS

Data for 528 patients with complications after PCNL were used to create a set of 70 unique complication-management combinations. Clinical case summaries for each complication-management combination were compiled in a survey distributed to 98 urologists, who rated each combination using the Clavien classification.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Interrater agreement for Clavien scores was estimated using Fleiss' kappa (κ). The relationship between Clavien score and the duration of postoperative hospital stay was analysed using multivariate nonlinear regression models that adjusted for operating time, preoperative urine microbial culture, presence of staghorn stone, and use of postoperative nephrostomy tube.

RESULTS AND LIMITATIONS

Overall interrater agreement in grading postoperative complications was moderate (κ=0.457; p<0.001). Agreement was highest for Clavien score 5 and decreased with lower Clavien scores. Higher agreement was found for Clavien scores 3 and 4 than in subcategories of these scores. Postoperative stay increased with higher Clavien scores and was unaffected by inherent differences between study centres. A standard list of post-PCNL complications and their corresponding Clavien scores was created.

CONCLUSIONS

Although the Clavien classification demonstrates high validity, interrater reliability is low for minor complications. To improve the reliability and consistency of reporting adverse outcomes of PCNL, we have assigned Clavien scores to complications of PCNL.

Incidence, nature and impact of error in surgery

Background

Adverse events occur in 3·8–17 per cent of hospital admissions. The purpose of this study was to analyse the incidence of medical errors and assess the feasibility of an error registry for quality improvement programmes.

Methods

Errors were recorded prospectively in a complication registry between 1 June 2005 and 31 December 2007. Events were coded according to the Trauma Registry of the American College of Surgeons; the nature of events was recorded and the severity graded using the 1992 Clavien system. Recorded events were discussed by the medical staff on a daily basis and, if by consensus judged to be errors, were saved to the registry database.

Results

Of 12 121 patients admitted to the surgical ward during the study interval, 2033 (16·8 per cent) had a complication and 735 (6·1 per cent) had an error documented in the registry. Of 873 recorded errors, 607 (69·5 per cent) were of little or no consequence (Clavien grade I) and 220 (25·2 per cent) required therapeutic intervention (Clavien grade IIa and IIb). Errors leading to permanent injury (Clavien grade III) occurred in 41 instances (4·7 per cent) and five patients (0·6 per cent) died (Clavien grade IV).

Conclusion

This study shows that errors are common in surgery, and that near misses are more frequent than errors with serious consequences. It is hypothesized that registration of near misses might prevent errors with serious consequences and thus improve quality of care.