Correlation Between Press Ganey Scores and Quality Outcomes From The National Neurosurgery Quality and Outcomes Database (Lumbar Spine) for a Hospital Employed Neurosurgical Practice

Correlation of Press Ganey Scores With Early Patient Satisfaction After Anterior Cruciate Ligament Reconstruction

Background:

Patient satisfaction metrics are commonly used to assess the quality of health care and affect reimbursement. The Press Ganey Ambulatory Surgery (PGAS) is a satisfaction survey that has emerged as a prominent quality assessment tool; however, no data exist on whether PGAS scores correlate with early postsurgical satisfaction during the PGAS survey administration period in patients who underwent anterior cruciate ligament reconstruction (ACLR).

Purpose:

To determine if PGAS scores correlate with measures of satisfaction and patient-reported outcomes (PROs) at 2 weeks postoperatively in ACLR patients.

Study Design:

Cohort study (diagnosis); Level of evidence, 3.

Methods:

A retrospective review of patients who underwent ACLR at a single institution was performed. Patients who completed the PGAS survey and PROs at 2 weeks postoperatively were included in the study. Surgical satisfaction was measured with the Surgical Satisfaction Questionnaire (SSQ-8), and PROs included 6 Patient-Reported Outcomes Measurement Information System domains. Bivariate analysis between PGAS and PRO scores was conducted using the Spearman rank correlation coefficient (r_S).

Results:

Of the 716 patients who received the PGAS survey after ACLR, 81 patients completed the survey, and 39 patients also completed PROs and were included in the study. Total converted (mean scaled score) and “top box” (percentages of questions with highest rating selected) PGAS scores showed no significant correlations with the SSQ-8 (r_S =–0.24; P = .14). There were no significant correlations between SSQ-8 and PGAS domain scores except for a negative correlation with Facility domain top box scores (r_S =–0.33; P = .04), meaning that patients with higher surgical satisfaction had lower PGAS Facility scores. Total PGAS (converted and top box scores) and PGAS domain scores showed no significant correlation with any of the other PROs.

Conclusion:

PGAS scores showed no significant positive correlation with surgical satisfaction, function, pain, mental health, activity, or expectations of surgery in patients 2 weeks after ACLR. This suggests little to no relationship between PGAS score and surgical satisfaction in the early recovery period after ACLR.

Metrics of Resident Achievement for Defining Program Aims

Introduction

Resident achievement data is a powerful but underutilized means of program evaluation, allowing programs to empirically measure whether they are meeting their program aims, facilitate refinement of curricula and improve resident recruitment efforts. The goal was to provide an overview of available metrics of resident achievement and how these metrics can be used to inform program aims.

Methods

A literature search was performed using PubMed and Google Scholar between May and November of 2020. Publications were eligible for inclusion if they discussed or assessed “excellence” or “success” during residency training. A narrative review structure was chosen due to the intention to provide an examination of the literature on available resident achievement metrics.

Results

57 publications met inclusion criteria and were included in the review. Metrics of excellence were grouped into larger categories, including success defined by program factors, academics, national competencies, employer factors, and possible new metrics.

Conclusions

Programs can best evaluate whether they are meeting their program aims by creating a list of important resident-level metrics based on their stated goals and values using one or more of the published definitions as a foundation. Each program must define which metrics align best with their individual program aims and mission.

An approach to predicting patient experience through machine learning and social network analysis

OBJECTIVE

Improving the patient experience has become an essential component of any healthcare system's performance metrics portfolio. In this study, we developed a machine learning model to predict a patient's response to the Hospital Consumer Assessment of Healthcare Providers and Systems survey's "Doctor Communications" domain questions while simultaneously identifying most impactful providers in a network.

MATERIALS AND METHODS

This is an observational study of patients admitted to a single tertiary care hospital between 2016 and 2020. Using machine learning algorithms, electronic health record data were used to predict patient responses to Hospital Consumer Assessment of Healthcare Providers and Systems survey questions in the doctor domain, and patients who are at risk for responding negatively were identified. Model performance was assessed by area under receiver-operating characteristic curve. Social network analysis metrics were also used to identify providers most impactful to patient experience.

RESULTS

Using a random forest algorithm, patients' responses to the following 3 questions were predicted: "During this hospital stay how often did doctors. 1) treat you with courtesy and respect? 2) explain things in a way that you could understand? 3) listen carefully to you?" with areas under the receiver-operating characteristic curve of 0.876, 0.819, and 0.819, respectively. Social network analysis found that doctors with higher centrality appear to have an outsized influence on patient experience, as measured by rank in the random forest model in the doctor domain.

CONCLUSIONS

A machine learning algorithm identified patients at risk of a negative experience. Furthermore, a doctor social network framework provides metrics for identifying those providers that are most influential on the patient experience.

Clinical utility of enhanced recovery after surgery pathways in pediatric spinal deformity surgery: systematic review of the literature

OBJECTIVES

More than 7500 children undergo surgery for scoliosis each year, at an estimated annual cost to the health system of $1.1 billion. There is significant interest among patients, parents, providers, and payors in identifying methods for delivering quality outcomes at lower costs. Enhanced recovery after surgery (ERAS) protocols have been suggested as one possible solution. Here the authors conducted a systematic review of the literature describing the clinical and economic benefits of ERAS protocols in pediatric spinal deformity surgery.

METHODS

The authors identified all English-language articles on ERAS protocol use in pediatric spinal deformity surgery by using the following databases: PubMed/MEDLINE, Web of Science, Cochrane Reviews, EMBASE, CINAHL, and OVID MEDLINE. Quantitative analyses of comparative articles using random effects were performed for the following clinical outcomes: 1) length of stay (LOS); 2) complication rate; 3) wound infection rate; 4) 30-day readmission rate; 5) reoperation rate; and 6) postoperative pain scores.

RESULTS

Of 950 articles reviewed, 7 were included in the qualitative analysis and 6 were included in the quantitative analysis. The most frequently cited benefits of ERAS protocols were shorter LOS, earlier urinary catheter removal, and earlier discontinuation of patient-controlled analgesia pumps. Quantitative analyses showed ERAS protocols to be associated with shorter LOS (mean difference -1.12 days; 95% CI -1.51, -0.74; p < 0.001), fewer postoperative complications (OR 0.37; 95% CI 0.20, 0.68; p = 0.001), and lower pain scores on postoperative day (POD) 0 (mean -0.92; 95% CI -1.29, -0.56; p < 0.001) and POD 2 (-0.61; 95% CI -0.75, -0.47; p < 0.001). There were no differences in reoperation rate or POD 1 pain scores. ERAS-treated patients had a trend toward higher 30-day readmission rates and earlier discontinuation of patient-controlled analgesia (both p = 0.06). Insufficient data existed to reach a conclusion about cost differences.

CONCLUSIONS

The results of this systematic review suggest that ERAS protocols may shorten hospitalizations, reduce postoperative complication rates, and reduce postoperative pain scores in children undergoing scoliosis surgery. Publication biases exist, and therefore larger, prospective, multicenter data are needed to validate these results.

Predictors of Patient Satisfaction in Spine Surgery: A Systematic Review

BACKGROUND

Recently, there has been increased interest in patient satisfaction measures such as Press Ganey and Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) surveys. In this systematic review, the spine surgery literature is analyzed to evaluate factors predictive of patient satisfaction as measured by these surveys.

METHODS

A thorough literature search was performed in PubMed/MEDLINE, Google Scholar, and Cochrane databases. All English-language articles from database inception to July 2020 were screened for study inclusion according to PRISMA guidelines.

RESULTS

Twenty-four of the 1899 published studies were included for qualitative analysis. There has been a statistically significant increase in the number of publications across years (P = 0.04). Overall, the studies evaluated the relationship between patient satisfaction and patient demographics (71%), preoperative and intraoperative clinical factors (21%), and postoperative factors (33%). Top positive predictors of patient satisfaction were patient and nursing/medical staff relationship (n = 4; 17%), physician-patient relationship (n = 4; 17%), managerial oversight of received care (n = 3; 13%), same sex/ethnicity between patient and physician (n = 2; 8%), and older age (n = 2; 8%). Top negative predictors of patient satisfaction were high Charlson Comorbidity Index/high disability/worse overall health functioning (n = 7; 29%), increased length of hospital stay (n = 4; 17%), high rating for pain/complications/readmissions (n = 4; 17%), and psychosocial factors (n = 3; 13%).

CONCLUSIONS

There is heterogeneity in terms of different factors, both clinical and nonclinically related, that affect patient satisfaction ratings. More research is warranted to investigate the role of hospital consumer surveys in the spine surgical patient population.