Development and Validation of an Agency for Healthcare Research and Quality Indicator for Mortality After Congenital Heart Surgery Harmonized With Risk Adjustment for Congenital Heart Surgery (RACHS-1) Methodology

Development of a set of quality indicators in paediatric and perinatal care in Japan with a modified Delphi method

BACKGROUNDS

Few paediatric and perinatal quality indicators (QIs) have been developed in the Japanese setting, and the quality of care is not assured or validated. The aim of this study was to develop QIs in paediatric and perinatal care in Japan using an administrative database and confirm the feasibility and applicability of the indicators using a single-site practice test.

METHODS

We used a RAND-modified Delphi method that integrates evidence review with expert consensus development. QI candidates were generated from clinical practice guidelines (CPGs) available in English or Japanese and existing QIs in nine selected paediatric or perinatal conditions. Consensus building was based on independent panel ratings. The performance of QIs was retrospectively assessed using data from an administrative database at the National Children's Hospital. Data between April 2018 and March 2019 were used, while data between April 2019 and March 2021 were also used for selected condition, considering the small number of patients. Each QI was calculated as follows: number of times the indicator was met/number of participants×100.

RESULTS

From the literature review conducted between 2010 and 2020, 124 CPGs and 193 existing indicators were identified to generate QI candidates. Through the consensus-building process, 133 QI candidates were assessed and 79 QIs were accepted. The practice test revealed wide variations in the process-level performance of QIs in four categories: patient safety: median 43.9% (IQR 16.7%-85.6%), general paediatrics: median 98.8% (IQR 84.2%-100%), advanced paediatrics: median 94.4% (IQR 46.0%-100%) and advanced obstetrics: median 80.3% (IQR 59.6%-100%).

CONCLUSIONS

We established 79 QIs for paediatric and perinatal care in Japan using an administrative database that can be applied to hospitals nationwide. The practice test confirmed the measurability of the developed QIs. Benchmarking these QIs will be an attractive approach to improving the quality of care.

Operative mortality after Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery Mortality Category 1 to 3 procedures: Deficiencies and opportunities for quality improvement

OBJECTIVES

We examined cases of operative mortality at a single quaternary academic center for patients undergoing relatively lower-risk (Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery Mortality Category 1-3) procedures, as a means of identifying systemic weaknesses and opportunities for quality improvement.

METHODS

A retrospective review of all operative mortality events for patients who underwent a Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery Mortality Category 1, 2, or 3 index procedure (2009-2020) at our institution was performed. After a detailed chart review was performed by 2 independent faculty for each case, factors and system deficiencies that contributed to mortality were identified.

RESULTS

A total of 42 mortalities were identified. A total of 37 patients (88%) had at least 1 Society of Thoracic Surgeons-designated risk factor, including prior cardiac operations (48%), extracardiac malformations (43%), and preoperative ventilation (33%). Eight patients (19%) had non-Society of Thoracic Surgeons-designated preoperative patient-level variables considered as at potential risk, including severe ventricular dysfunction, pulmonary hypertension, lung hypoplasia, and undiagnosed severe coronary abnormalities. Four patients (10%) had no identified preoperative risk factors. After detailed chart review, 5 broad categories were identified: patient-related factors (n = 33; 78%), postoperative infection (n = 13; 31%), postoperative residual lesions (n = 7; 17%), Fontan physiology failure (n = 4; 10%), and unexplained left ventricular failure after tetralogy of Fallot repair (n = 3; 7%). A total of 74% of patients had at least 1 preoperative, intraoperative, or postoperative system deficiency. A total of 50% of surgeries were urgent or emergency.

CONCLUSIONS

Operative mortality after Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery Mortality Category 1 to 3 procedures is related to the presence of multifactorial risk patterns (Society of Thoracic Surgeons and non-Society of Thoracic Surgeons-designated patient-level risk factors and variables, broad risk categories, system deficiencies, emergency surgery). A multidisciplinary approach to care, with early recognition and treatment of modifiable additional burdens, could reduce this risk.

Broad- Versus Narrow-Spectrum Perioperative Antibiotics and Outcomes in Pediatric Congenital Heart Disease Surgery: Analysis of the Vizient Clinical Data Base

BACKGROUND

Despite guidelines recommending narrow-spectrum perioperative antibiotics (NSPA) as prophylaxis for most children undergoing congenital heart disease (CHD) surgery, broad-spectrum perioperative antibiotics (BSPA) are variably used, and their impact on postoperative outcomes is poorly understood.

METHODS

We used administrative data from U.S. hospitals participating in the Vizient Clinical Data Base. Admissions from 2011 to 2018 containing a qualifying CHD surgery in children 0-17 years old were evaluated for exposure to BSPA versus NSPA. Propensity score-adjusted models were used to compare postoperative length of hospital stay (PLOS) by exposure group, while adjusting for confounders. Secondary outcomes included subsequent antimicrobial treatment and in-hospital mortality.

RESULTS

Among 18 088 eligible encounters from 24 U.S. hospitals, BSPA were given in 21.4% of CHD surgeries, with mean BSPA use varying from 1.7% to 96.1% between centers. PLOS was longer for BSPA-exposed cases (adjusted hazard ratio 0.79; 95% confidence interval [CI]: 0.71-0.89, P < .0001). BSPA was associated with higher adjusted odds of subsequent antimicrobial treatment (odds ratio [OR] 1.24; 95% CI: 1.06-1.48), and there was no significant difference in adjusted mortality between exposure groups (OR 2.06; 95% CI: 1.0-4.31; P = .05). Analyses of subgroups with the most BSPA exposure, including high-complexity procedures and delayed sternal closure, also did not find (but could not exclude) a measurable benefit from BSPA on PLOS.

CONCLUSIONS

BSPA use was common in high-risk populations, and varied substantially between centers. Standardizing perioperative antibiotic practices between centers may reduce unnecessary broad-spectrum antibiotic exposure and improve clinical outcomes.

Machine Learning Model for Predicting Risk of In-Hospital Mortality after Surgery in Congenital Heart Disease Patients

Background

A machine learning model was developed to estimate the in-hospital mortality risk after congenital heart disease (CHD) surgery in pediatric patient.

Methods

Patients with CHD who underwent surgery were included in the study. A Extreme Gradient Boosting (XGBoost) model was constructed based onsurgical risk stratification and preoperative variables to predict the risk of in-hospital mortality. We compared the predictive value of the XGBoost model with Risk Adjustment in Congenital Heart Surgery-1 (RACHS-1) and Society of Thoracic Surgery-European Association for Cardiothoracic Surgery (STS-EACTS) categories.

Results

A total of 24,685 patients underwent CHD surgery and 595 (2.4%) died in hospital. The area under curve (AUC) of the STS-EACTS and RACHS-1 risk stratification scores were 0.748 [95% Confidence Interval (CI): 0.707-0.789, p < 0.001] and 0.677 (95% CI: 0.627-0.728, p < 0.001), respectively. Our XGBoost model yielded the best AUC (0.887, 95% CI: 0.866-0.907, p < 0.001), and sensitivity and specificity were 0.785 and 0.824, respectively. The top 10 variables that contribute most to the predictive performance of the machine learning model were saturation of pulse oxygen categories, risk categories, age, preoperative mechanical ventilation, atrial shunt, pulmonary insufficiency, ventricular shunt, left atrial dimension, a history of cardiac surgery, numbers of defects.

Conclusions

The XGBoost model was more accurate than RACHS-1 and STS-EACTS in predicting in-hospital mortality after CHD surgery in China.

RACHS - ANZ : A Modified Risk Adjustment in Congenital Heart Surgery Model for Outcome Surveillance in Australia and New Zealand

Background

Outcomes for pediatric cardiac surgery are commonly reported from international databases compiled from voluntary data submissions. Surgical outcomes for all children in a country or region are less commonly reported. We aimed to describe the bi‐national population‐based outcome for children undergoing cardiac surgery in Australia and New Zealand and determine whether the Risk Adjustment for Congenital Heart Surgery (RACHS) classification could be used to create a model that accurately predicts in‐hospital mortality in this population.

Methods and Results

The study was conducted in all children's hospitals performing cardiac surgery in Australia and New Zealand between January 2007 and December 2015. The performance of the original RACHS‐1 model was assessed and compared with an alternative RACHS‐ANZ (Australia and New Zealand) model, developed balancing discrimination with parsimonious variable selection. A total of 14 324 hospital admissions were analyzed. The overall hospital mortality was 2.3%, ranging from 0.5% for RACHS category 1 procedures, to 17.0% for RACHS category 5 or 6 procedures. The original RACHS‐1 model was poorly calibrated with death overpredicted (1161 deaths predicted, 289 deaths observed). The RACHS‐ANZ model had better performance in this population with excellent discrimination (Az‐ROC of 0.830) and acceptable Hosmer and Lemeshow goodness‐of‐fit (P=0.216).

Conclusions

The original RACHS‐1 model overpredicts mortality in children undergoing heart surgery in the current era. The RACHS‐ANZ model requires only 3 risk variables in addition to the RACHS procedure category, can be applied to a wider range of patients than RACHS‐1, and is suitable to use to monitor regional pediatric cardiac surgery outcomes.

Establishing a High-Quality Congenital Cardiac Surgery Program in a Developing Country: Lessons Learned

Background: Developing countries are profoundly affected by the burden of congenital heart disease (CHD) because of limited resources, poverty, cost, and inefficient governance. The outcome of pediatric cardiac surgery in developing countries is suboptimal, and the availability of sustainable programs is minimal. Aim: This study describes the establishment of a high quality in-situ pediatric cardiac surgery program in Lebanon, a limited resource country. Methods: We enrolled all patients operated for CHD at the Children's Heart Center at the American University of Beirut between January 2014 and December 2018. Financial information was obtained. We established a partnership between the state, private University hospital, and philanthropic organizations to support the program. Results: In 5 years, 856 consecutive patients underwent 993 surgical procedures. Neonates and infants constituted 22.5 and 22.6% of our cohort, respectively. Most patients (82.6%) underwent one cardiac procedure. Our results were similar to those of the Society of Thoracic Surgeons (STS) harvest and to the expected mortalities in RACHS-1 scores with an overall mortality of 2.8%. The government (Public) covered 43% of the hospital bill, the Philanthropic organizations covered 30%, and the Private hospital provided a 25% discount. The parents' out-of-pocket contribution included another 2%. The average cost per patient, including neonates, was $19,800. Conclusion: High standard pediatric cardiac surgery programs can be achieved in limited-resource countries, with outcome measures comparable to developed countries. We established a viable financial model through a tripartite partnership between Public, Private, and Philanthropy (3P system) to provide high caliber care to children with CHD.

Current Epidemiology of Vocal Cord Dysfunction After Congenital Heart Surgery in Young Infants

OBJECTIVES

Surgery of the aortic arch poses risk of recurrent laryngeal nerve injury due to the anatomic proximity and can manifest as vocal cord dysfunction after surgery. We assessed risk factors for vocal cord dysfunction and calculated surgical procedure associated rates in young infants after congenital heart surgery.

DESIGN

Cross section analysis.

SETTING

Forty-four children's hospitals reporting administrative data to Pediatric Health Information System.

PARTICIPANTS

Cardiac surgical patients less than or equal to 90 days old and discharged between January 2004 and June 2014.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Overall, 2,319 of 46,567 subjects (5%) had vocal cord dysfunction, increasing from 4% to 7% over the study period. Of those with vocal cord dysfunction, 75% had unilateral partial paralysis. Vocal cord dysfunction was significantly more common in newborn infants (74%), those with aortic arch procedures (77%) and with greater surgical complexity. Rates of vocal cord dysfunction ranged from 0.7% to 22.4% across surgical procedure groups. Vocal cord dysfunction was significantly associated with greater use of: prolonged mechanical ventilation (53% vs 40%), diaphragmatic plication (3% vs 1%), feeding tube use (32% vs 8%), surgical airways (4% vs 2%), and prolonged length of stay (44 vs 21 d). Vocal cord dysfunction testing increased significantly over the study (6-14 %), and vocal cord dysfunction diagnosis increased almost two-fold (odds ratio, 1.9; 95% CI, 1.7-2.1) comparing the last to first study quarters with the increase in vocal cord dysfunction diagnosis occurring predominately in surgeries to the aortic arch supported by cardiopulmonary bypass. However, aortic procedures without cardiopulmonary bypass and nonaortic arch procedures were common surgeries accounting for 27% and 23% of vocal cord dysfunction cases despite low overall vocal cord dysfunction rates (3.7% and 2.6%).

CONCLUSIONS

Vocal cord dysfunction complicated all cardiac surgical procedures among infants including those without aortic arch involvement. Increased efforts to determine appropriate indications for prevention, screening and treatment of vocal cord dysfunction among young infants after congenital heart surgery are needed.

Wider intraoperative glycemic fluctuation increases risk of acute kidney injury after pediatric cardiac surgery

OBJECTIVE

The association between poor intraoperative glycemic control and postoperative acute kidney injury (AKI) in adult cardiac surgery has been observed, but data in the pediatrics remain unknown. We performed a hypothesis that intraoperative hyperglycemia and/or wider glycemic fluctuation were associated with the incidence of postoperative AKI in pediatric cardiac surgery.

METHODS

A retrospective study was performed in pediatrics who underwent cardiac surgery from 2013 to 2016. Perioperative glycemic data up to 48 hours after surgery were collected and analyzed. Patients with AKI were matched 1:1 with patients without AKI by a propensity score. Variables of demographic data, preoperative renal function and glycemic level, perioperative cardiac condition were matched.

RESULTS

The incidence of AKI was 11.5% (118/1026), with 53.4% (63/118), 30.5% (36/118), and 16.1% (19/118) categorized as AKIN stages I, II, and III, respectively. Children who experienced AKI were younger and cyanotic, underwent more complex surgeries, had higher peak intraoperative glucose levels, wider intraoperative glycemic fluctuation, greater inotropic scores and more transfusions, and poor outcomes (all p < .05). After matching, the AKI group had significantly wider intraoperative glycemic fluctuation (p < .05). Logistic regression showed intraoperative glycemic fluctuation was one of the risk factors for AKI (p = .033) and degree of AKI severity stage increased when the glycemic fluctuation increased (p < .01).

CONCLUSIONS

Wider intraoperative glycemic fluctuation, but not hyperglycemia, was associated with an increased incidence of postoperative AKI after pediatric cardiac surgery.

[Association of hypoalbuminemia with acute kidney injury in children after cardiac surgery]

OBJECTIVE

To study whether hypoalbuminemia after pediatric cardiopulmonary bypass (CPB) for cardiac surgery is a risk factor for postoperative acute kidney injury (AKI).

METHODS

A retrospective analysis was performed on the clinical data of 1 110 children who underwent CPB surgery between 2012 and 2016. According to the minimum serum albumin within 48 hours postoperatively, these patients were divided into hypoalbuminemia group (≤35 g/L) and normal albumin group (>35 g/L). The two groups were compared in terms of perioperative data and the incidence of AKI. Furthermore, the incidence of AKI was compared again after propensity score matching for the unbalanced factors during the perioperative period. The perioperative risk factors for postoperative AKI were analyzed by logistic regression.

RESULTS

The overall incidence rate of postoperative AKI was 13.78% (153/1 110), and the mortality rate was 2.52% (28/1 110). The mortality rate of children with AKI was 13.1% (20/153). The patients with hypoalbuminemia after surgery (≤35 g/L) accounted for 44.50% (494/1 110). Before and after propensity score matching, the hypoalbuminemia group had a significantly higher incidence of AKI than the normal albumin group (P<0.05). The children with AKI had a significantly lower serum albumin level after surgery than those without AKI (P<0.05). The multivariate logistic regression analysis showed albumin ≤35 g/L was one of the independent risk factors for postoperative AKI.

CONCLUSIONS

Albumin ≤35 g/L within 48 hours postoperatively is an independent risk factor for postoperative AKI in children after CPB surgery.

[Association of hypoalbuminemia with acute kidney injury in children after cardiac surgery]

OBJECTIVE

To study whether hypoalbuminemia after pediatric cardiopulmonary bypass (CPB) for cardiac surgery is a risk factor for postoperative acute kidney injury (AKI).

METHODS

A retrospective analysis was performed on the clinical data of 1 110 children who underwent CPB surgery between 2012 and 2016. According to the minimum serum albumin within 48 hours postoperatively, these patients were divided into hypoalbuminemia group (≤35 g/L) and normal albumin group (>35 g/L). The two groups were compared in terms of perioperative data and the incidence of AKI. Furthermore, the incidence of AKI was compared again after propensity score matching for the unbalanced factors during the perioperative period. The perioperative risk factors for postoperative AKI were analyzed by logistic regression.

RESULTS

The overall incidence rate of postoperative AKI was 13.78% (153/1 110), and the mortality rate was 2.52% (28/1 110). The mortality rate of children with AKI was 13.1% (20/153). The patients with hypoalbuminemia after surgery (≤35 g/L) accounted for 44.50% (494/1 110). Before and after propensity score matching, the hypoalbuminemia group had a significantly higher incidence of AKI than the normal albumin group (P<0.05). The children with AKI had a significantly lower serum albumin level after surgery than those without AKI (P<0.05). The multivariate logistic regression analysis showed albumin ≤35 g/L was one of the independent risk factors for postoperative AKI.

CONCLUSIONS

Albumin ≤35 g/L within 48 hours postoperatively is an independent risk factor for postoperative AKI in children after CPB surgery.

[Clinical characteristics and prognostic analysis of children with congenital heart disease complicated by postoperative acute kidney injury]

OBJECTIVE

To analyze the perioperative clinical data of children with congenital heart disease complicated by acute kidney injury (AKI) after cardiopulmonary bypass (CPB) surgery, and to explore potential factors influencing the prognosis.

METHODS

A retrospective analysis was performed among 118 children with congenital heart disease who developed AKI within 48 hours after CPB surgery.

RESULTS

In the 118 patients, 18 died after 48 hours of surgery. Compared with the survivors, the dead children had significantly higher incidence of cyanotic disease and Risk Adjustment for Congenital Heart Surgery-1 (RACHS-1) scores before surgery; during surgery, the dead children had significantly longer CPB time and aortic cross-clamping time, a significantly higher proportion of patients receiving crystalloid solution for myocardial protection, and a significantly higher mean blood glucose level. Within 48 hours after surgery, the dead children had significantly higher positive inotropic drug scores, significantly higher creatinine values, a significantly higher incidence of stage 3 AKI, a significantly higher proportion of patients receiving renal replacement the, and significantly higher usage of blood products (P<0.05). The mortality rate of the patients increased with increased intraoperative blood glucose levels (P<0.05). Patients with intraoperative blood glucose levels >8.3 mmol/L had a significantly lower postoperative cumulative survival rate and a significantly shorter mean survival time than those with blood glucose levels ≤ 8.3 mmol/L (P<0.05).

CONCLUSIONS

Intraoperative blood glucose levels are associated with the prognosis in children with congenital heart disease complicated by AKI after CPB surgery. Maintaining good intraoperative blood glucose control can improve the prognosis of the children.

Metrics to Assess Extracorporeal Membrane Oxygenation Utilization in Pediatric Cardiac Surgery Programs

OBJECTIVES

Only a small fraction of pediatric cardiac surgical patients are supported with extracorporeal membrane oxygenation following cardiac surgery, but extracorporeal membrane oxygenation use is more common among those undergoing higher complexity surgery. We evaluated extracorporeal membrane oxygenation metrics indexed to annual cardiac surgical volume to better understand extracorporeal membrane oxygenation use among U.S. cardiac surgical programs.

DESIGN

Retrospective analysis SETTING:: Forty-three U.S. Children's Hospitals in the Pediatric Health Information System that performed cardiac surgery and used extracorporeal membrane oxygenation.

PATIENTS

All patients (< 19 yr) undergoing cardiac surgery during January 2003 to July 2014.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Both extracorporeal membrane oxygenation use and surgical mortality were risk adjusted using Risk Adjustment for Congenital Heart Surgery 1. Extracorporeal membrane oxygenation metrics indexed to annual cardiac surgery cases were calculated for each hospital and the metric values divided into quintiles for comparison across hospitals. Among 131,786 cardiac surgical patients, 3,782 (2.9%) received extracorporeal membrane oxygenation. Median case mix adjusted rate of extracorporeal membrane oxygenation use was 2.8% (interquartile range, 1.6-3.4%). Median pediatric cardiac case mix adjusted surgical mortality was 3.5%. Extracorporeal membrane oxygenation-associated surgical mortality was 1.3% (interquartile range, 0.7-1.6%); without extracorporeal membrane oxygenation, median case mix adjusted surgical mortality would increase from 3.5% to 5.0%. Among patients who died, 36.7% (median) were supported with extracorporeal membrane oxygenation. The median reduction in case mix adjusted surgical mortality from extracorporeal membrane oxygenation surgical survival was 30.1%. The median extracorporeal membrane oxygenation free surgical survival was 95% (interquartile range, 94-96%). Centers with less than 150 annual surgical cases had significantly lower median extracorporeal membrane oxygenation use (0.78%) than centers with greater than 275 cases (≥ 2.8% extracorporeal membrane oxygenation use). Extracorporeal membrane oxygenation use and mortality varied within quintiles and across quintiles of center annual surgical case volume.

CONCLUSIONS

Risk adjusted extracorporeal membrane oxygenation metrics indexed to annual surgical volume provide potential for benchmarking as well as a greater understanding of extracorporeal membrane oxygenation utilization, efficacy, and impact on cardiac surgery mortality.

Current trends in racial, ethnic, and healthcare disparities associated with pediatric cardiac surgery outcomes

OBJECTIVE

Despite overall improvements in congenital heart disease outcomes, racial and ethnic disparities have continued. The purpose of this study is to examine the effect of race and ethnicity, as well as other risk factors on congenital heart surgery length of stay and in-hospital mortality.

DESIGN

From the 2012 Healthcare Cost and Utilization Project Kids Inpatient Database (KID), we identified 13 130 records with Risk Adjustment in Congenital Heart Surgery complexity score-eligible procedures. Multivariate logistic and linear regression modeling with survey weights, stratification and clustering was used to examine the relationships between predictor variables and length of stay as well as in-hospital mortality.

RESULTS

No significant mortality differences were found among all race and ethnicity groups across each age group. Black neonates and black infants had a longer length of stay (neonatal estimate = 8.73 days, P = .0034; infant estimate 1.10 days, P = .0253), relative to whites. Government-sponsored insurance was associated with increased odds of neonatal mortality (odds ratio = 1.51, P = .0055), increased length of stay in neonates (estimate = 4.26 days, P = .0009) and infants (estimate = 1.52 days, P = .0181), relative to private insurance. Government-sponsored insurance was associated with increased number of chronic conditions, which were also associated with increased LOS (estimate 8.39 days, P < .001 in neonates; estimate 3.60 days, P < .001 in infants; estimate 1.87 days, P < .001 children).

CONCLUSIONS

Racial/ethnic disparities in congenital heart surgical outcomes may be changing compared with previous studies using the KID database. Increased length of stay in children with government-sponsored insurance may reflect expansion of individual states government-sponsored insurance eligibility criteria for children with complex chronic medical conditions. These findings warrant cautious optimism regarding racial and ethnic disparities in congenital heart surgery outcomes.