Nursing Activities Score (NAS): 5 Years of experience in the intensive care units of an Italian University hospital

Instruments to measure complexity of care based on nursing workload in intensive care units: A systematic review

OBJECTIVE

To establish an evidence-based recommendation on the use of validated scoring systems that measure nursing workload in relation to the complexity of care in adult Intensive Care Units.

METHODS

A systematic review based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) was conducted (PROSPERO registration: CRD42021251272). We searched for validation studies until July 2023 using the bibliographic databases CINAHL, Scopus, Pubmed, WOS, Cochrane Database, SCIELO, Cuiden and Cuidatge. Reference selection and data extraction was performed by two independent reviewers. The assessment of risk of bias was performed using QUADAS-2 and the overall quality according to COSMIN and GRADE approach.

RESULTS

We included 22 articles identifying 10 different scoring systems. Reliability, criterion validity and hypothesis testing were the most frequently measurement properties reported. The NAS was the only tool to demonstrate a Class A recommendation (the best performing instrument).

CONCLUSIONS

NAS is the best currently available scoring system to assess complexity of care from nursing workload in ICU. However, it barely met the criteria for a class A recommendation. Future efforts should be made to develop, evaluate, and implement new systems based on innovative approaches such as intensity or complexity of care.

IMPLICATIONS FOR CLINICAL PRACTICE

The results facilitate decision making as it establishes a ranking of which instruments are recommended, promising or not recommended to measure the nursing workload in the intensive care units.

The comparison of the Nursing Activities Score and TrendCare to accurately measure critical care nursing workload: A prospective observational design

INTRODUCTION

Intensive care units commonly use the Nursing Activities Score (NAS) to measure nursing workload, however, some settings use TrendCare. Historically 100 NAS points reflected one nurse, however research now suggests greater than 61 NAS points per nurse increases hospital mortality.

OBJECTIVES

To determine if: 1) TrendCare accurately reflects critical care nursing workload as measured by the NAS and 2) the required nursing hours calculated by each of the scoring systems differed between indigenous and non-indigenous patients.

METHODS

Using a prospective observational design, data were collected between 9 August - 25 November 2021. Nursing workload was assessed over three shifts using TrendCare and the NAS.

RESULTS

Analysis included 183 patients and 829 TrendCare and NAS scores. The mean NAS for intensive care patients was >61 on all three shifts (morning M = 67.1 ± 18.2, afternoon M = 66.1 ± 18.1, night M = 64.0 ± 18.1). The mean NAS for high dependency patients (morning M = 46.1 ± 11.1, afternoon M 45.9 ± 11.0, night Mdn 46.1 [40.5-54.1]) identified a nurse:patient ratio of 1:2 reflected a NAS >90. The NAS and TrendCare found no difference in nursing hours between indigenous and non-indigenous patients, however higher scores for respiratory (H = 7.3, p = <.01), cardiovascular (H = 12.7, p = <.001) and renal (H = 12.7, p = <.001) support, and care for relatives and patients (H = 13.8, p = <.001) on some shifts were identified in indigenous patients.

CONCLUSION

TrendCare nursing hours likely reflect a 1:1 nurse: patient ratio for intensive care patients but likely under-estimates high dependency care nursing workload. The NAS activities highlighted some activities required more time for indigenous patients on some shifts.

IMPLICATIONS FOR CLINICAL PRACTICE

TrendCare likely reflects intensive care nursing workload but not high dependency nursing workload. A NAS of no greater than 61 points per nurse better reflects nursing workload in both the intensive and high dependency care units. Indigenous patients may require more nursing hours for nursing activities related to severity of illness.

Determinants of increased nursing workload in the COVID-era: A retrospective analysis of prospectively collected data

BACKGROUND

COVID-19 is associated with increased nursing workload, therefore a high nurse-to-patient ratio would be required.

AIM

To analyse difference in nursing workload, as expressed with the Nursing Activities Score (NAS), between COVID-19 patients versus control patients without COVID-19 disease (NCOVID-19 group) in an Italian Extracorporeal Membrane Oxygenation (ECMO) centre.

STUDY DESIGN

Retrospective analysis of prospectively collected data, enrolling consecutive patients admitted to a general Intensive Care Unit, between 1st May 2019 and 28th February 2021. A multivariate analysis was then performed to assess if COVID-19 disease was an independent predictor of higher NAS and to assess which other factors and procedures are independently associated with increased workload.

RESULTS

We enrolled 574 patients, of which 135 (24%) were in the COVID-19 group and 439 (76%) in the NCOVID-19 group. The average NAS was higher in the COVID-19 group (79 ± 11 vs. 65 ± 15, T = -10.026; p < 0.001). Prone positioning, continuous renal replacement therapy (CRRT) and ECMO were used more frequently in the COVID-19 group. A higher fraction of patients in the COVID group showed colonization from multidrug resistant bacteria. COVID-19 group had a higher duration of mechanical ventilation and longer ICU stay. The COVID-19 diagnosis was independently associated with a higher NAS. Other independent predictors of higher NAS were the use of prone positioning and continuous renal replacement therapy (CRRT). Colonization from multidrug resistant bacteria and ECMO support were not independently associated with higher NAS.

CONCLUSIONS

The higher nursing workload in COVID-19 patients is mainly due to specific procedures required to treat the most hypoxemic patients, such as prone positioning. Colonization with multidrug resistant bacteria and ECMO support were not independently associated with a higher NAS.

RELEVANCE TO CLINICAL PRACTICE

Higher workload in COVID-19 patients was due to specific interventions, such as prone positioning and CRRT, with the related nursing activities, as continuous presence at patient's bed, mobilization, positioning and complex hygienic procedures.

Nursing workload and patient-focused outcomes in intensive care: A systematic review

The aim of this systematic review was to examine the association of nursing workload on patient outcomes in intensive care units. The primary outcome measure was patient mortality, with adverse events (AE), the secondary outcome measures. Electronic search of databases including MEDLINE, CINAHL, Cochrane, EMCARE, Scopus, and Web of Science were performed. Studies were excluded if they were in non-ICU settings, pediatric, neonatal populations, or if the abstract/full text was unavailable. Risk of bias was assessed by the ROBINS-I tool. After screening 4129 articles, 32 studies were identified as meeting inclusion criteria. The majority of included studies were assessed as having a moderate risk of bias. The nursing activities score (NAS) was the most frequently used tool to assess nursing workload. Our systematic review identified that higher nursing workload was associated with patient-focused outcomes, including increased mortality and AE in the intensive care setting. The varied approaches of measuring and reporting nursing workload make it difficult to translate the findings of the impact of nursing workload on patient outcomes in intensive care settings.

The Impact of Nursing Skill-mix on Adverse Events in Intensive Care: A Single Centre Cohort Study

BACKGROUND

The highly complex and technological environment of critical care manages the most critically unwell patients in the hospital system, as such there is a need for a highly trained nursing workforce. Intensive care is considered a high-risk area for errors and adverse events (AE) due to the severity of illness and number of procedures performed.

OBJECTIVE

To investigate if the percentage of Critical Care Registered Nurses (CCRN) within an Intensive Care Unit (ICU) is associated with an increased risk of patients experiencing an AE.

DESIGN & SETTING

We conducted a retrospective cohort study of patients admitted between January 2016 and December 2020 to a tertiary ICU in Australia. Descriptive statistics and multivariable logistic regression were used to investigate the relationship between the proportion of CCRNs each month and the occurrence of an AE defined as any one of a medication error, fall, pressure injury or unplanned removal of a central venous catheter or endotracheal tube per patient.

RESULTS

A total of 13,560 patients were included in the study, with 854 (6.3%) experiencing one AE. Patients with an AE were associated with higher illness severity and frailty scores. They were more commonly admitted after medical emergency team response calls and were less commonly elective ICU admissions. Those with an AE had longer ICU and in-hospital length of stay, and higher ICU and in-hospital mortality, on average. After adjusting for ICU LOS and acute severity of illness, being admitted during a month of higher critical care nursing skill-mix was associated with a statistically significant lower odds of having a subsequent AE (OR 0.966 [95% CI: 0.944-0.988], p 0.003).

CONCLUSION

An increasing percentage of CCRNs is independently associated with a lower risk-adjusted likelihood of an AE. Increasing the skill-mix of the ICU nursing staff may reduce the occurrence of AEs and lead to improved patient outcomes.

Nursing workload assessment in an intensive care unit: A retrospective observational study using the Nursing Activities Score

BACKGROUND

Nursing Activities Score (NAS) is a promising tool for calculating the nursing workload in intensive care units (ICU). However, data on intensive care nursing activities in Portugal are practically non-existent.

AIM

To assess the nursing workload in a Portuguese ICU using the NAS.

STUDY DESIGN

Retrospective cohort study developed throughout the analysis of the electronic health record database from 56 adult patients admitted to a six-bed Portuguese ICU between 1 June-31 August 2020. The nursing workload was assessed by the Portuguese version of the NAS. The study was approved by the Hospital Council Board and Ethics Committee. The study report followed the STROBE guidelines.

RESULTS

The average occupancy rate was 73.55% (±16.60%). The average nursing workload per participant was 67.52 (±10.91) points. There was a correlation between the occupancy rate and the nursing workload. In 35.78% of the days, the nursing workload was higher than the available human resources, overloading nurse staffing/team.

CONCLUSIONS

The nursing workload reported follows the trend of the international studies and the results reinforce the importance of adjusting the nursing staffing to the complexity of nursing care in this ICU. This study highlighted periods of nursing workload that could compromise patient safety.

RELEVANCE TO CLINICAL PRACTICE

This was one of the first studies carried out with the NAS after its cross-cultural adaptation and validation for the Portuguese population. The nursing workload at the patient level was higher in the first 24 h of ICU stays. Because of the 'administrative and management activities' related to the 'patient discharge procedures', the last 24 h of ICU stays also presented high levels of nursing workload. The implementation of a nurse-to-patient ratio of 1:1 may contribute to safer nurse staffing and to improve patient safety in this Tertiary (level 3) ICU.

Carga laboral de profesionales de enfermería en Unidad de Cuidado Intensivo según Nursing Activities Score

Highlights: La NAS es una herramienta que toma relevancia al momento de evaluar la carga de trabajo de los profesionales de enfermería. Se evidencia que el personal de enfermería está expuesto a altas cargas de trabajo que, en la mayoría de casos, supera lo sugerido por Consejos y Asociaciones de enfermería. Algunos factores que pueden afectar la carga de trabajo son el tipo de turnos de trabajo, sexo del profesional, tipo de UCI, el número de pacientes a cargo, entre otros. Es necesario evaluar la implementación de la NAS en distintos tipos de servicios para entender la situación y trabajo actual de los profesionales de enfermería. Introducción: Nursing Activities Score ha sido utilizada como un instrumento principalmente en la Unidad de Cuidados Intensivos para medir las actividades de enfermería, siendo esta la unidad que maneja pacientes de mayor complejidad para el cuidado. Objetivo: establecer la carga de trabajo, evaluada por Nursing Activities Score, y factores relacionados a la misma en Unidades de Cuidado Intensivo. Metodología: Revisión cualitativa tipo scoping Review, utilizando el método PRISMA. Búsqueda en las bases de datos CINAHL, LILACS, SCOPUS, SCIENCE DIRECT, SCIELO y PUBMED. Resultados: La muestra final se compone de 87 textos, que van desde el año 2007 hasta 2021. Se clasificaron en cinco categorías: Carga de trabajo en UCI, comparación entre unidades, carga de trabajo relacionada al personal de enfermería, carga de trabajo relacionada a las características de los pacientes y consecuencias de la carga de trabajo. Discusión: La revisión revela una carga de trabajo mayor al 50% en la mayoría de los estudios, esto debido a diferentes factores: principalmente las características particulares de los pacientes, no se observó una diferencia significativa entre unidades generales y especializadas, las cargas de trabajo elevadas suponen un factor de riesgo para la ocurrencia de eventos adversos. Conclusiones: Los resultados de esta revisión permiten evidenciar que el personal de enfermería está expuesto constantemente a altas cargas de trabajo. Esta carga de trabajo puede verse influenciada o influenciar diversos factores, como lo son las características de los pacientes a quienes se brinda atención o puede afectar positiva o negativamente la calidad de la atención de enfermería. Como citar este artículo: Cruz López Laura Nathalie, Quintero Osorio Jenny Fernanda, Melo Roa Juan David, Henao Castaño Ángela María. Carga laboral de profesionales de enfermería en Unidad de Cuidado Intensivo según Nursing Activities Score. Revista Cuidarte. 2023;14(1):e2680. http://dx.doi.org/10.15649/cuidarte.2680

Associations between two nursing workload scales and the cost of intensive care unit nursing staff: A retrospective study of one Belgian hospital

AIMS

The aim of this study was to assess associations between a general nursing funding scale and an intensive care unit specific nursing workload scale and the cost of nursing staff.

BACKGROUND

Nurse staffing represents the most important cost in the intensive care unit, so it is essential to evaluate it accurately. In addition, the assessment of nursing workload is important for the daily management of the intensive care unit and to ensure quality of care.

METHODS

This was a retrospective and quantitative study carried out in the intensive care unit of a Belgian hospital. The extraction of data from the Nursing Activities Score and the Minimum Hospital Summary Nursing Dataset were carried out during 2 periods of 15 days, from 1 June 2018 to 15 June 2018 and from 1 September 2018 to 15 September 2018.

RESULTS

A total of 234 patients were included in the study. A total of 773 Nursing Activities Score and Minimum Hospital Summary Nursing Dataset recordings were analyzed in the study per intensive care unit day. A strong correlation was observed between Nursing Activities Score and Minimum Hospital Summary Nursing Dataset for the entire intensive care unit stay with a rho (95% CI) of .88 (0.83-.93); however, the correlation was moderate per intensive care unit day with a rho of .51 (0.45-0.57). A strong association was observed between the Minimum Hospital Summary Nursing Dataset and the Nursing Activities Score with the costs of intensive care unit nurses with a rho (95% CI) of .78 (0.72-0.86) and .74 (0.65-0.84), respectively.

CONCLUSIONS

A general nursing funding scale in Belgium was strongly correlated with the nursing workload for the whole intensive care unit stay, but this correlation was moderate per intensive care unit day. In contrast, both scales showed a good correlation with intensive care unit nursing costs.

IMPLICATIONS FOR NURSING MANAGEMENT

In Belgium, a general funding scale for nurses does not allow for an assessment of the nursing workload in the intensive care unit. The Nursing Activities Score is strongly correlated with the cost of nursing staff in the intensive care unit. The authors recommend that the Belgian authorities carry out this type of study in several intensive care units in the country and eventually replace the general funding scale for nurses with the Nursing Activities Score.

The impact of COVID-19 on nursing workload and planning of nursing staff on the Intensive Care: A prospective descriptive multicenter study

INTRODUCTION

The impact of the care for COVID-19 patients on nursing workload and planning nursing staff on the Intensive Care Unit has been huge. Nurses were confronted with a high workload and an increase in the number of patients per nurse they had to take care of.

OBJECTIVE

The primary aim of this study is to describe differences in the planning of nursing staff on the Intensive Care in the COVID period versus a recent non-COVID period. The secondary aim was to describe differences in nursing workload in COVID-19 patients, pneumonia patients and other patients on the Intensive Care. We finally wanted to assess the cause of possible differences in Nursing Activities Scores between the different groups.

METHODS

We analyzed data on nursing staff and nursing workload as measured by the Nursing Activities Score of 3,994 patients and 36,827 different shifts in 6 different hospitals in the Netherlands. We compared data from the COVID-19 period, March 1st 2020 till July 1st 2020, with data in a non-COVID period, March 1st 2019 till July 1st 2019. We analyzed the Nursing Activities Score per patient, the number of patients per nurse and the Nursing Activities Score per nurse in the different cohorts and time periods. Differences were tested by a Chi-square, non-parametric Wilcoxon or Student's t-test dependent on the distribution of the data.

RESULTS

Our results showed both a significant higher number of patients per nurse (1.1 versus 1.0, p<0.001) and a significant higher Nursing Activities Score per Intensive Care nurse (76.5 versus 50.0, p<0.001) in the COVID-19 period compared to the non-COVID period. The Nursing Activities Score was significantly higher in COVID-19 patients compared to both the pneumonia patients (55.2 versus 50.0, p<0.001) and the non-COVID patients (55.2 versus 42.6, p<0.001), mainly due to more intense hygienic procedures, mobilization and positioning, support and care for relatives and respiratory care.

CONCLUSION

With this study we showed the impact of COVID-19 patients on the planning of nursing care on the Intensive Care. The COVID-19 patients caused a high nursing workload, both in number of patients per nurse and in Nursing Activities Score per nurse.

Comparison of nursing workload in a Pediatric Intensive Care Unit estimated by three instruments

OBJECTIVE

To compare the nursing workload using the Nursing Activities Score (NAS), Therapeutic Intervention Scoring System-28 (TISS-28) and Nine Equivalents of Nursing Manpower Use Score (NEMS) instruments in children admitted to a Pediatric Intensive Care Unit in a university hospital.

METHOD

A prospective cohort study performed in a Pediatric Intensive Care Unit, with a sample formed of all children hospitalized during the study period. Nursing workload was evaluated using the TISS-28, NEMS and NAS instruments, and further divided into two groups: Group 1 forming a category of basic activities items and Group 2 forming a category of other support and intervention activities.

RESULTS

The sample consisted of 490 Pediatric Intensive Care Unit admissions, totaling 4617 observations. NAS presented the best estimate of total working hours. TISS-28 and NEMS showed better agreement and the results showed strong correlations between NAS and TISS-28 and between NEMS and TISS-28. In Group 1 (basic activities), NAS(1) and TISS-28(1) showed moderate correlation, in Group 2 (specialized activities) the three instruments showed strong correlations.

CONCLUSION

NAS stood out in the evaluation of nursing workload and showed good correlation and agreement with the TISS-28.

Nursing physical workload and mental workload in intensive care units: Are they related?

AIM

In order to ensure patient safety and quality of care, it is important to consider factors which may impact on nursing workloads. This study aimed to investigate the simultaneous physical and mental workload and any relationships between these concepts on nurses working in intensive care units.

DESIGN

A cross-sectional design was undertaken.

METHOD

Participants were nurses (N = 105) recruited from six adult intensive care units which met the inclusion criteria. Nursing Activities Score (NAS) to measure physical workload and NASA Task Load Index (NASA-TLX) to measure mental workload were used. Data were collected for each participating nurse in three shifts (morning, evening and night). Data were analysed using bivariate correlation and multivariable linear regression analysis.

RESULTS

The mean (SD) of nurses' physical and mental workload was 72.84% (22.07%) and 70.21 (12.36), respectively. A significant relationship between physical and mental workload (p <.001) was identified.

Assessment of Nursing Workload as a Mortality Predictor in Intensive Care Units (ICU) Using the Nursing Activities Score (NAS) Scale

Introduction: Nursing activities score scales are valuable instruments for assessing the quality of nursing care provided in critically ill patients and easy to use in validating nurse staffing. The aim of this study was the assessment of nursing workload (NW) as a predictive factor of mortality by using the nursing activities score (NAS) scale. Materials and Methods: In this cross-sectional study of 91 days during 2019, convenience sampling was employed to recruit 82 registered nurses (RN) from three intensive care units (ICUs) of two public hospitals with 41 beds in total. Data were collected using the NAS scale, the researcher’s observation, the information given by the staff, and the nursing care reports. Descriptive and inductive statistics were used with significance level α = 0.05. The Statistical Package for Social Sciences (SPSS 25.0) was used for analyzing the data. Results: Females were the majority of the sample (84.1%), with a mean age of 38.9 (7.7) years, 87.8% had a nursing degree from a technological educational institute (T.E.I), the average working experience was 14 (8.1) years and the ICU experience was 12.9 (8.5) years. There were 3764 daily records of NAS with an average of 54.81 (2.34) and total NAS of 756.51 (150.27). The NW of the first day’s admission in the ICU was 65.15 (13.05), NW was 13.15 h/day and the NW of patients who died was 57.37 (4.06). The optimal nurse/patient ratio (NPR) was 1:1.82, while the existing NPR was 1:2.86. The mortality rate was 28.7%. Conclusion: Although the study results did not demonstrate a significant correlation between NW and mortality, the NW in ICU appeared to be relatively higher for patients who died than for those who survived. This result may serve as an indication for a positive correlation between these two variables. In addition, NW was found to be moderate, while one ICU nurse can take care of more than one patient.

Impact of COVID-19 on nursing time in intensive care units in Belgium

INTRODUCTION

The COVID-19 pandemic has had a significant impact on nursing practice in intensive care unit and consequently, on workload.

OBJECTIVE

To assess the nurse-patient ratio required by COVID-19 patients and to identify the factors that influence nursing in this context.

DESIGN

This study was a retrospective observational study that evaluated the ratio using the Nursing Activities Score (NAS).

SETTING

Three Belgian French-speaking hospitals, including five ICUs. Patients included COVID-19 and non-COVID-19 patients.

MEASUREMENTS AND MAIN RESULTS

The study included 95 COVID-19 patients and 1604 non-COVID-19 patients (control group) resulting in 905 and 5453 NAS measures, respectively. The NAS was significantly higher among the COVID-19 patients than in the control group (p = <0.0001). In the COVID-19 group, these higher scores were also observed per shift and uniformly across the three hospitals. COVID-19 patients required more time in the activities of monitoring and titration (χ2 = 457.60, p = <0.0001), mobilisation (χ2 = 161.21, p = <0.0001), and hygiene (χ2 = 557.77, p = <0.0001). Factors influencing nursing time measured by NAS in the COVID-19 patients were age <65 years old (p = 0.23), the use of continuous venovenous hemofiltration (p = 0.002), a high APACHE II score (p = 0.006) and patient death (p = 0.002). A COVID-19 diagnosis was independently associated with an increase in nursing time (OR = 4.8, 95% CI:3.6-6.4).

CONCLUSIONS

Patients hospitalised in the ICU due to COVID-19 require significantly more nursing time and need an average ratio of almost 1:1.

Nursing workload in intensive care units and the influence of patient and nurse characteristics

BACKGROUND

Understanding factors that can potentially influence patient care and nursing workload in intensive care units is important. Previous studies have shown contradictory outcomes about the relationships between nursing workload and patient and nurse characteristics.

AIMS AND OBJECTIVES

This study aimed to investigate nursing workload in intensive care units and examine the association between this in relation to patient and nurse characteristics.

DESIGN

A cross-sectional design was conducted.

METHODS

All nurses who were working in the intensive care units of five hospitals and met the study criteria were enrolled in the study. Two demographic questionnaires collected nurse and patient demographic information. The Nursing Activities Score was applied to determine nursing workload in three shifts (morning, evening, night) for each nurse. Data were analysed using the independent sample t-test, one-way analysis of variance, and multivariable linear regression analysis.

RESULTS

The Nursing Activities Score was calculated for 509 patients who were under the care of 105 intensive care unit nurses. The mean (SD) Nursing Activities Score was 72.84% (22.07%). Morning shifts, male patients, medical treatments, and referred patients from the emergency ward and other intensive care units imposed a higher workload for nurses. Specifically, female nurses, increased number of patients receiving care, and increased patient length of intensive care unit stay were directly associated with increased Nursing Activities Scores. Work in surgical and burn intensive care units were inversely associated with the Nursing Activities Score.

CONCLUSION

This study suggests that the workload of nurses in intensive care units can be affected by both nurse and patient characteristics.

RELEVANCE TO CLINICAL PRACTICE

The findings can be used to ensure appropriate staffing of intensive care units by nurses. However, nurse and patient characteristics should not be considered the only factors that influence nursing workload in intensive care units.

The Medical Emergency Team in Italy: an overview of in-hospital emergencies response

BACKGROUND AND AIM

Medical Emergency Team (MET), implemented in many hospitals worldwide, aims to improve the safety of in-hospital patients whose condition is deteriorating. This study describes MET presence and organization in the Italian National Healthcare System Hospitals.

METHODS

A national survey with an online questionnaire was performed. The questionnaire, created ad hoc, was sent by e-mail to the nursing coordinators and MET referents of the Hospitals affiliated to the Italian National Healthcare System with an Anesthesia and Intensive Care service.

RESULTS

One hundred-ninety-seven hospitals were interviewed (36.2% of the whole national network). A dedicated MET, composed at least by an intensivist and a nurse, was present only in 118 cases (59.9%). The team was composed by a non-dedicated staff (67.8% of doctors, 69.5% of nurses) and a minimum shared standard of education for the nurse component was absent. One third of the estimated hospitals did not use a warning score for emergency call activation.

DISCUSSION AND CONCLUSION

This survey showed a heterogenous and often lacking organization of in-hospital emergency management in Italy. MET system needs to be implemented in terms of presence in the Italian hospitals, and standardized for personnel structure and training, and equipment availability. A broader study is necessary to compare our data with those of other European Countries to better identify the specific areas which need to be improved more promptly.

Cross-validation of the Care Dependency Scale in intensive care unit (ICU-CDS)

OBJECTIVES

The Care Dependency Scale is a theory-based, comprehensive tool widely used in low-intensity care settings to evaluate patients' dependency. This study aimed to test the psychometric properties of the Care Dependency Scale in intensive care units.

RESEARCH METHODOLOGY/DESIGN

A multicentre cross-sectional validation study was conducted. Exploratory factor analysis and confirmatory factor analysis were performed using a Maximum Likelihood robust estimator with Geomin oblique rotation.

SETTING

Adult patients admitted to intensive care units of four Italian hospitals.

RESULTS

The sample included 453 patients (mean age = 68 years, 62% male). The exploratory factor analysis, conducted on a subsample of 227 patients, revealed a two-factor structure (Physical care dependency and Psychosocial care dependency) with good fit indexes. The confirmatory factor analysis was conducted on another subsample of 226 patients and a second-order factor was specified. The model tested yielded adequate fit indexes. Concurrent and known-groups validity, and reliability, were also adequate.

CONCLUSION

The Care Dependency Scale is a multidimensional, valid and reliable tool able to assess the care dependency of critically ill patients. It can help to distinguish between physical and psychosocial needs and to create a base for patient-customised and holistic care.

Type of admission and nursing workload of critical patients: a cross-sectional study

BACKGROUND

According to the perception of nurses in the intensive care unit (ICU), surgical patients need more nursing care, thus requiring higher nursing workloads for these patients than those admitted as clinical patients. However, some study results on the relationship between the type of admission and the nursing workload are considered contradictory.

AIMS AND OBJECTIVES

To identify if the type of admission (clinical, emergency surgery or elective surgery) is a predictive factor of the nursing workload required by patients on the first day or throughout their stay in the ICU.

DESIGN

This was a quantitative cross-sectional study comprised of a retrospective analysis of clinical records of critical patients.

METHODS

Data were collected from 1 May 2015 to 30 September 2015 in a hospital located in São Paulo, Brazil. Nursing workload was measured using the Nursing Activities Score. The type of admission and the demographic and clinical variables of the patients were investigated. Multiple linear regression was used to identify nursing workload predictive factors, with 5% significance level.

RESULTS

In the analysed sample (n = 211; mean age of 60·3 ± 18·7 years), there was a prevalence of male gender (56·9%). A statistically significant difference (p = 0·025) was found between the type of admission and the nursing workload required for patients on the first ICU day. The Simplified Acute Physiologic Score (p = 0·009) was a predictor of nursing workload on the first day in the ICU, and the Logistic Organ Dysfunction System (p = 0·026) and mortality (p < 0·001) were predictors throughout the ICU stay.

CONCLUSIONS

The type of admission was not a predictive factor of the nursing workload required by critical patients.

RELEVANCE TO CLINICAL PRACTICE

Identifying the predictive factors of nursing workload favours the appropriate staffing of the critical unit by nurses. However, nurses should not consider the type of admission in predicting the nursing workload required by patients in the ICU.

Intermediate care units : Recommendations on facilities and structure

A growing number of patients with increasingly complex or specialized diseases are being treated in hospitals worldwide. The treatment requirements of some of these patients are exceeding the capacity of standard nursing units. However, the severity of these diseases or the treatment requirements for these specific clinical pictures do not always justify admission to an intensive care unit. For this reason, an increasing number of special units (intermediate care units) are being set up to offer highly specialized treatment and close monitoring, in order to fulfil an intermediate role between the standard care unit and the intensive care unit. The recommendations of the German Interdisciplinary Association for Intensive Care and Emergency Medicine (DIVI) on the personnel, capacity, equipment and structure of these units are intended to provide the framework for the setting up and operation of intermediate care units in collaboration with experts on both an evidence-based and an expert-based basis (where scientific evidence is not available). Where only minimal or indirect evidence is available, patient safety is paramount in the formulation of the recommendation.

Oral Care Protocols With Specialty Training Lead to Safe Oral Care Practices and Reduce Iatrogenic Bleeding in Extracorporeal Membrane Oxygenation Patients

INTRODUCTION

Oral care, using either a mouth rinse, gel, toothbrush, or combination of them, together with aspiration of secretions, may reduce the risk of ventilator-acquired pneumonia in intubated patents. Oral care procedure in patients on venovenous extracorporeal membrane oxygenation (VV-ECMO) may cause bleeding due to the systemic anticoagulation required.

PURPOSE

The aim of this study was to investigate the rate of bleeding episodes during oral care in patients supported by VV-ECMO.

METHODS

A retrospective observational study was performed. All patients admitted to an Italian ECMO center during 2014 were included in the study.

RESULTS

Data from 14 patients were analyzed. The median intensive care unit length of stay was 39.0 days (interquartile range, 27.3-83.3 days), and median days on VV-ECMO was 19.5 (10.3-46.0). There were 440 ECMO days, with 1320 oral care maneuvers. In 7 patients, bleeding episodes occurred: 2 with orotracheal intubation and 5 initially managed with orotracheal intubation, thereafter via Translaryngeal tracheostomy tube (according to Fantoni's technique). In 61 oral care procedures (4.6%), bleeding was detected during or after the maneuver, whereas the total numbers of days with at least 1 bleeding episode were 35 (8%).The presence or absence of bleeding during ECMO days was statistically significant for international normalized ratio (1.01 [0.95-1.11] vs 1.13 [1.03-1.25], P < .0001), platelets (163 000 [93 500-229 000] vs 61 000 [91 00-100 000], P < .0001), and mouth care score (6 [5-7] vs 8 [7-9], P < .001).

CONCLUSION

Oral care can cause bleeding in patients on VV-ECMO. Implementation of protocols for daily oral care in patients on ECMO may reduce risks. As recommended by the literature, this category of patients should be treated in selected centers distinguished by a regular volume of ECMO activity and the presence of dedicated ECMO specialist nurses.

The influence of delayed admission to intensive care unit on mortality and nursing workload: a cohort study

BACKGROUND

The results of studies regarding the relationship between length of stay of patients in emergency departments (EDs) and mortality in intensive care units (ICUs) are contradictory, and nothing is known about the impact of delayed admission of patients to ICUs on nursing workload.

AIMS AND OBJECTIVES

To assess the influence of the time lapse between ED and ICU admissions on mortality and nursing workload in relation to intensive care patients.

DESIGN

This was a retrospective cohort study that examined the medical records of patients who were 15 years of age or older and admitted directly to the ICU from the ED.

METHODS

The data were collected between 2014 and 2016 in a hospital located in São Paulo, Brazil. Nursing workload was measured by the Nursing Activities Score. Multiple linear and logistic regressions were applied, with a significance level of 5%.

RESULTS

Of the 534 patients analysed, the majority were men (57·49%); the mean age was 55·37 ± 19·64 years. Length of stay in the ED was not associated with nursing workload at the time of admission of patients to the ICU or during their stay in the unit. For mortality, this variable was a risk factor along with cause of admission, length of stay in the ICU and the Simplified Acute Physiology Score 3 score. For every additional hour that patients remained in the ED, their chance of dying in the ICU increased by 1%.

CONCLUSION

Length of stay of patients in the ED was a risk factor for mortality in the ICU; however, this variable did not have any influence on nursing workload.

RELEVANCE TO CLINICAL PRACTICE

Strategies need to be implemented to optimize the availability of ICU beds and reduce the length of stay of critical patients in the ED as delays in admitting such patients to the ICU have an impact on mortality.

Validation of the nursing workload scoring systems "Nursing Activities Score" (NAS), and "Therapeutic Intervention Scoring System for Critically Ill Children" (TISS-C) in a Greek Paediatric Intensive Care Unit

OBJECTIVES

To assess the reliability and validity of the Greek version of Nursing Activities Score (NAS), and Therapeutic Intervention Scoring System for Critically Ill Children (TISS-C) in a Greek Paediatric Intensive Care Unit (PICU).

RESEARCH METHODOLOGY

A methodological study was performed in one PICU of the largest Paediatric Hospital in Athens-Greece. The culturally adapted and validated Greek NAS version, enriched according to the Norwegian paediatric one (P-NAS), was used. TISS-C and Norwegian paediatric interventions were translated to Greek language and backwards. Therapeutic Intervention Scoring System (TISS-28) was used as a gold standard. Two independent observers simultaneously recorded 30 daily P-NAS and TISS-C records. Totally, 188 daily P-NAS, TISS-C and TISS-28 reports in a sample of 29 patients have been obtained during five weeks. Descriptive statistics, reliability and validity measures were applied using SPSS (ver 22.0) (p ≤ 0.05).

RESULTS

Kappa was 0.963 for P-NAS and 0.9895 for TISS-C (p < 0.001) and Intraclass Correlation Coefficient for all scale items of TISS-C was 1.00 (p < 0.001). P-NAS, TISS-28 and TISS-C measurements were significantly correlated (0.680 ≤ rho ≤ 0.743, p < 0.001). The mean score(±SD) for TISS-28, P-NAS and TISS-C was 23.05(±5.72), 58.14(±13.98) and 20.21(±9.66) respectively.

CONCLUSION

These results support the validity of P-NAS and TISS-C scales to be used in greek PICUs.

COMPARAÇÃO ENTRE GRAVIDADE DO PACIENTE E CARGA DE TRABALHO DE ENFERMAGEM ANTES E APÓS A OCORRÊNCIA DE EVENTOS ADVERSOS EM IDOSOS EM CUIDADOS CRÍTICOS

RESUMO Objetivo: comparar a gravidade do paciente e a carga de trabalho de enfermagem antes e após a ocorrência de evento adverso moderado e grave em idosos internados em unidades de terapia intensiva. Método: estudo comparativo, realizado em nove unidades de terapia intensiva de um Hospital Universitário de São Paulo. Os eventos foram coletados dos prontuários dos pacientes e classificados em moderados e graves segundo a Organização Mundial de Saúde. A análise da gravidade foi realizada segundo o Symplified Acute Phsiologic Score II e a carga de trabalho segundo o Nursing Activities Score, 24 horas antes e depois do evento moderado e grave. O teste t, com significância de 5%, foi utilizado para a comparação das médias da gravidade clínica e da carga de trabalho, antes e após o evento. Resultados: a amostra foi composta por 315 idosos, sendo que 94 (29,8%) sofreram eventos moderados e graves nas unidades. Dos 94 eventos, predominou o tipo processo clínico e procedimento (40,0%). A instalação e manutenção de artefatos terapêuticos e cateteres foram as intervenções prevalentes que resultaram em danos fisiopatológicos (66,0%), de grau moderado (76,5%). A média de pontuação da carga de trabalho (75,19%) diminuiu 24 horas após a ocorrência do evento (71,97%, p=0,008) e, a gravidade, representada pela probabilidade de morte, aumentou de 22,0% para 29,0% depois do evento (p=0,045). Conclusão: no contexto da segurança do paciente, a identificação das alterações nas condições clínicas e na carga de trabalho de enfermagem em idosos que sofrem eventos subsidiam a prevenção dessas ocorrências.

Nursing Activities Score by assistance sites in Intensive Care Units

Abstract Objective: To compare the Nursing Activities Score (NAS) between the Assistance Sites in an Intensive Care Unit. Method: Descriptive, retrospective study, carried out in the Intensive Care Unit of a teaching hospital. The patients were organized in Assistance Sites according to their clinical characteristics and the nursing team's composition was organized in accordance with the Nursing Activities Score (NAS). The confidence interval was set at p < 0.05. Results: the majority were male surgical patients with a mean age of 56.8 years. The postoperative care Site presented the greatest patient turnover. The overall average NAS was 71.7%. There was a difference in the nursing workload between the different Assistance Sites. The shorter length of stay and the nonsurvivors contributed to increasing the workload in the ICU. Conclusion: Comparing the NAS in the different Sites made it possible to organize the work process of the nursing team according to each group, contributing to patient safety.

Adecuación de escalas para medir cargas de trabajo mediante metodología de calidad

RESUMEN Objetivo: Determinar cuál de las escalas evaluadas (NEMS y NAS), es más adecuada para Unidades de Cuidados Intensivos aplicando metodología de calidad. Método: Tras identificar como oportunidad de mejora la no adecuación de la escala NEMS para determinar cargas de trabajo de enfermería en UCI, se aplica metodología de los ciclos de mejora a dicha escala y a la NAS, como propuesta de mejora, evaluando los criterios: medición de cargas de trabajo al día y por turno, inclusión de todas las actividades enfermeras, y análisis por paciente y unidad. Resultados: Escala NEMS no muestra diferencias significativas en el cumplimiento (67%). Comparación NEMS-NAS, todos los criterios excepto el 1º, obtienen mejora significativa. NEMS sólo valora el criterio 1 (64,22%), y NAS todos con un cumplimiento para el 1º, 2º y 4º del 64,74%, y el 3º del 100%. Conclusión: La escala NAS es más adecuada para medir cargas de trabajo de enfermería en UCI.

Carga de trabalho de enfermagem relacionada ao índice de massa corporal de pacientes críticos

Resumo Objetivo Mensurar e comparar a carga de trabalho de enfermagem e a frequência dos itens pontuados no Nursing Activities Score (NAS), considerando os diferentes grupos de IMC de pacientes internados em Unidade de Terapia Intensiva (UTI). Métodos Estudo longitudinal realizado na UTI de hospital universitário em São Paulo, na qual o IMC do paciente foi calculado dividindo-se o peso pelo quadrado da altura e a carga de trabalho de enfermagem foi mensurada pelo NAS. Resultados A análise de 529 pacientes mostrou que o NAS não diferiu entre os grupos conforme o IMC. Os pacientes obesos demandaram mais tempo para o procedimento de higienização e maior número de pessoas para mobilização/posicionamento. Pacientes de baixo peso receberam mais frequentemente tratamento para melhora da função pulmonar. Conclusão Os resultados não apontaram diferença na carga de trabalho de enfermagem quando se considerou o IMC do paciente.

Validação do Nursing Activities Score em unidades de cuidados intensivos portuguesas

RESUMO Objetivo: descrever o processo de adaptação e validação do Nursing Activities Score para o contexto português. Método: trata-se de um estudo-piloto de adaptação e validação do Nursing Activities Score, com amostra de 67 doentes internados em unidades de cuidados intensivos de três hospitais portugueses. A validade de constructo avaliou-se mediante procedimentos de análise fatorial e a consistência interna dos itens através do coeficiente Alpha de Cronbach. Resultados: obteve-se um valor médio da carga de trabalho de 63,04% (DP = 14,25; Mediana = 61,30). Os dados psicométricos revelaram um Alpha de Cronbach de 0,71, na escala total, indicando uma fidelidade aceitável. A análise fatorial confirmatória sugeriu um ajustamento adequado entre o modelo e os dados (χ2(199) = 214,5, p = 0,214; CFI = 0,95; RMSA = 0,035). Conclusão: neste estudo, a versão portuguesa do Nursing Activities Score revelou-se um instrumento válido, permitindo avaliar a carga de trabalho dos enfermeiros com segurança.

Clinical Activity Monitoring System (CATS): An automatic system to quantify bedside clinical activities in the intensive care unit

Monitoring clinical activity at the bedside in the intensive care unit (ICU) can provide useful information to evaluate nursing care and patient recovery. However, it is labour intensive to quantify these activities and there is a need for an automated method to record and quantify these activities. This paper presents an automated system, Clinical Activity Tracking System (CATS), to monitor and evaluate clinical activity at the patient's bedside. The CATS uses four Microsoft Kinect infrared sensors to track bedside nursing interventions. The system was tested in a simulated environment where test candidates performed different motion paths in the detection area. Two metrics, 'Distance' and 'Dwell time', were developed to evaluate interventions or workload in the detection area. Results showed that the system can accurately track the intervention performed by individual or multiple subjects. The results of a 30-day, 24-hour preliminary study in an ICU bed space matched clinical expectations. It was found that the average 24-hour intervention is 22.0minutes/hour. The average intervention during the day time (7am-11pm) is 23.6minutes/hour, 1.4 times higher than 11pm-7am, 16.8minutes/hour. This system provides a unique approach to automatically collect and evaluate nursing interventions that can be used to evaluate patient acuity and workload demand.

Using Nursing Activities Score to Assess Nursing Workload on a Medium Care Unit

BACKGROUND

The medium care unit (MCU) or "stepdown" unit is an increasingly important, but understudied care environment. With an aging population and more patients with complex multiple diseases, many patients often require a higher level of inpatient care even when full intensive care is not indicated. However, the nurse-to-patient ratio required on a MCU is neither well defined nor clear whether this ratio should be adjusted per shift. The Nursing Activities Score (NAS) is an effective instrument for measuring nursing workload in the intensive care unit (ICU) but has not been used in an MCU. The aim of this study was to measure the nursing workload per 8-hour shift on an MCU using the NAS and compare it with the NAS from an ICU in the same hospital. We also compared the NAS between groups of patients with different admission sources.

METHODS

The NAS was prospectively measured per patient per shift for 2 months in a 9-bed tertiary referral university hospital MCU and during a similar period in an ICU in the same hospital.

RESULTS

The mean NAS per patient did not differ between day (7:30 AM to 4:00 PM) and evening (3:00 PM to 11:30 PM) shifts, but the NAS was significantly lower during the night shift (11:00 PM to 8:00 AM) than during the day (P < 0.0001) and evening (P < 0.0001) shifts. The mean NASs in the ICU for day and night shifts were significantly lower than the scores in the MCU (P = 0.0056 and P < 0.0001, respectively), but NAS during the evening shift did not differ between the ICU and the MCU. The mean NAS for patients admitted to the MCU from the accident and emergency department was significantly higher than for those admitted from the ICU (P = 0.002), recovery (P = 0.002), and general ward (P < 0.0001). Patients on the MCU had a NAS comparable with that of ICU patients.

CONCLUSIONS

In our university hospital, NAS was higher during the day and evening hours and lower at night. We also found that patients from accident and emergency had a higher NAS than those admitted to the MCU from other locations. NAS in the MCU was not lower than the NAS in the ICU. Because of its ability to discriminate between day and evening workloads and between patients from different sources, the NAS may assist MCU managers in assessing staffing needs.

Critical Patient Severity Classification System predicts outcomes in intensive care unit patients

BACKGROUND

The CPSCS was developed to assess the nursing care demands of patients in intensive care units (ICUs).

AIM

This study aimed to examine the Critical Patient Severity Classification System (CPSCS) score as an independent predictor of patient hospital outcomes.

DESIGN

This study was a secondary analysis.

METHODS

Data from 6380 cases were extracted from the electronic medical records in ICUs at a tertiary hospital in Korea during 2010-2012. To examine the association of the CPSCS score with 30-day ICU mortality, the Cox proportional hazards model and Kaplan-Meier survival curves were used, and generalized linear regression models of gamma distribution were developed for ICU length of stay (LOS).

RESULTS

More patients were admitted to surgical ICUs than medical ICUs (4664 versus 1716) during the study period. Medical ICU patients had longer ICU LOS, higher 30-day ICU mortality and a higher mean CPSCS score than surgical ICU patients. Cox analysis indicated that the mid and high CPSCS score groups had 1·687 and 2·913 times higher mortality risk, respectively, than the low CPSCS score group after adjusting for age, sex and primary diagnosis. The CPSCS score significantly predicted ICU mortality in both medical and surgical ICUs. Multivariate generalized linear regression indicated that CPSCS score was a significant predictor of ICU LOS after adjusting for other covariates.

CONCLUSIONS

The CPSCS score can be used to efficiently predict ICU mortality and LOS in patients admitted to the medical and surgical ICUs, although only the high CPSCS score group had significantly high mortality than the low CPSCS score group in the medical ICU.

RELEVANCE TO CLINICAL PRACTICE

The findings of this study contribute to valuable evidence that nursing-related factors have an impact on patient outcomes such as ICU mortality and LOS and that they have implications for hospital management, clinical practice and future research.

Nursing Activity Score for estimating nursing care need in intensive care units: findings from a face and content validity study

AIM

To re-evaluate the face and content validity of the Nursing Activity Score currently adopted in evaluating activities that best describe workloads in intensive care units and their weight in describing average nursing time consumption.

BACKGROUND

The Nursing Activity Score calculates the amount of nursing time that each patient will require over the next 24 hours. It has been widely used around the world since its first validation in 2003. However, no re-evaluation of its validity with regard to the advancements achieved in intensive care units nursing care has been documented to date.

METHOD

A research project was undertaken from 2012 to 2015, aimed at critically evaluating and validating this tool in the current context of Italian intensive care units nursing care. The 23 items were translated forward and backward into the Italian language, then a panel of 10 experts in critical care evaluated the face validity. Content validity was evaluated through focus groups involving seven critical care expert registered nurses.

FINDINGS

The Nursing Activity Score instrument has been considered as not fully adequate to measure current intensive care units nursing activities and their weightings have been considered not fully adequate to score average nursing time consumption. From the content validity process, lack of adequacy has emerged with respect to the concept of nursing care underpinning the tool, the interventions included, its capability to predict the nursing resources needed, advancements achieved in intensive care units nurses' roles and competences, and the contextual factors that may influence consumption of nursing time.

CONCLUSIONS

Development of the Nursing Activity Score tool both conceptually and in its structure, in view of the innovations that have occurred in the context of intensive care units, is necessary to continue to have a common tool to help clinicians and managers to capture accurately and compare nursing care required by patients in critical care settings.

IMPLICATIONS FOR NURSING MANAGEMENT

There is a need to revise the Nursing Activity Score tool, enabling its use in estimating nursing workloads in current Italian intensive care units practice. A taskforce of clinical nurses and nursing managers, capable of protecting the valuable original Nursing Activity Score project and to advance its further development is recommended.

Prone positioning improves oxygenation in spontaneously breathing nonintubated patients with hypoxemic acute respiratory failure: A retrospective study

PURPOSE

Prone positioning (PP) improves oxygenation and outcome of patients with acute respiratory distress syndrome undergoing invasive ventilation. We evaluated feasibility and efficacy of PP in awake, non-intubated, spontaneously breathing patients with hypoxemic acute respiratory failure (ARF).

MATERIAL AND METHODS

We retrospectively studied non-intubated subjects with hypoxemic ARF treated with PP from January 2009 to December 2014. Data were extracted from medical records. Arterial blood gas analyses, respiratory rate, and hemodynamics were retrieved 1 to 2 hours before pronation (step PRE), during PP (step PRONE), and 6 to 8 hours after resupination (step POST).

RESULTS

Fifteen non-intubated ARF patients underwent 43 PP procedures. Nine subjects were immunocompromised. Twelve subjects were discharged from hospital, while 3 died. Only 2 maneuvers were interrupted, owing to patient intolerance. No complications were documented. PP did not alter respiratory rate or hemodynamics. In the subset of procedures during which the same positive end expiratory pressure and Fio2 were utilized throughout the pronation cycle (n=18), PP improved oxygenation (Pao2/Fio2 124±50 mmHg, 187±72 mmHg, and 140±61 mmHg, during PRE, PRONE, and POST steps, respectively, P<.001), while pH and Paco2 were unchanged.

CONCLUSIONS

PP was feasible and improved oxygenation in non-intubated, spontaneously breathing patients with ARF.

Assessment of workload in the postoperative period of cardiac surgery according to the Nursing Activities Score

Objective Identify factors associated with the workload of nursing care for patients in the postoperative period of cardiac surgery. Method Prospective cohort study conducted with 187 patients in the surgical intensive care unit (ICU) of the Instituto do Coração(Heart Institute) in São Paulo-Brazil. Data were collected at 24 and 72 hours of the patients' admittance in the ICU. The dependent variable was workload as calculated by the Nursing Activities Score (NAS). The independent variables were demographic and clinical, as well as mortality scores. For data analysis, the Wilcoxon-Mann-Whitney test and Spearman correlation were used, and linear regression with mixed effects model. Results The majority of patients were male (59.4%), with a mean age of 61 years (±12.7), and 43.9% developed some kind of complication in the postoperative period. In the first 24 hours, the workload was 82.4% (±3.4), and 58.1% (±3.4) in 72 hours. Factors associated with increased NAS were: patient's length of stay in the ICU (p=0.036) and the presence of complications (p<0.001). Conclusion In contrast to numerous other studies, the severity of the patient's condition in the first 24 hours of the postoperative period did not increase workload, the increase was associated with length of stay in the ICU and complications.

The use of the Nursing Activities Score in clinical settings: an integrative review

Objective analyze how studies have approached the results obtained from the application of the Nursing Activities Score (NAS) based on Donabedian's model of healthcare organization and delivery. Method CINAHL and PubMed databases were searched for papers published between 2003 and March 2015. Results 36 articles that met the inclusion criteria were reviewed and double-coded by three independent coders and analyzed based on the three elements of Donabedian's health care quality framework: structure, process and outcome. The most frequently addressed, but not always tested, variables were those that fell into the structure category. Conclusion variables that fell into the process category were used less frequently. Beside NAS, the most frequently used variables in the outcome category were mortality and length of stay. However, no study used a quality framework for healthcare or NAS to evaluate costs, and it is recommended that further research should explore this approach.