Hospital safety climate surveys: measurement issues:

Patient safety climate research in primary care dentistry: A systematic scoping review

BACKGROUND

Patient safety climate constitutes an important element for quality improvement. Its current evidence base has been generated in hospital settings in developed countries. Studies in dentistry are limited.

OBJECTIVE

To systematically explore the evidence regarding assessing patient safety climate in dentistry.

METHODS

We developed a search strategy to explore MEDLINE, SCOPUS, and Web of Science databases from January 1st, 2002, to December 31st, 2022, to include observational studies on patient safety culture or patient safety climate assessment. Methodological features and item data concerning the dimensions employed for assessment were extracted and thematically analyzed. Reported scores were also collected.

RESULTS

Nine articles out of 5584 were included in this study. Most studies were generated from high-income economies. Our analysis revealed methodological variations. Non-randomized samples were employed (ranging from 139 to 656 participants), and response rates varied from 28% to 93.7%. Three types of measurement instruments have been adapted to assess patient safety climate. These mainly consisted of replacing words or rewording sentences. Only one study employed an instrument previously validated through psychometric methods. In general, patient safety climate levels were either low or neutral. Only one study reported scores equal to or greater than 75.

DISCUSSION

Despite diverse assessment tools, our two-decade analysis reveals a lag compared with medicine, resulting in methodological variations for assessing patient safety climate. Collaboration is vital to elevate standards, prioritize patient safety across oral healthcare services, and advocate for integrating safety climate into local and national quality and patient safety strategies.

Patient and Operational Factors Do Not Substantively Affect the Annual Departmental Quality of Anesthesiologists' Clinical Supervision and Nurse Anesthetists' Work Habits

INTRODUCTION

Although safety climate, teamwork, and other non-technical skills in operating rooms probably influence clinical outcomes, direct associations have not been shown, at least partially due to sample size considerations. We report data from a retrospective cohort of anesthesia evaluations that can simplify the design of prospective observational studies in this area. Associations between non-technical skills in anesthesia, specifically anesthesiologists' quality of clinical supervision and nurse anesthetists' work habits, and patient and operational factors were examined.

METHODS

Eight fiscal years of evaluations and surgical cases from one hospital were included. Clinical supervision by anesthesiologists was evaluated daily using a nine-item scale. Work habits of nurse anesthetists were evaluated daily using a six-item scale. The dependent variables for both groups of staff were binary, whether all items were given the maximum score or not. Associations were tested with patient and operational variables for the entire day.

RESULTS

There were 40,718 evaluations of faculty anesthesiologists by trainees, 53,772 evaluations of nurse anesthetists by anesthesiologists, and 296,449 cases that raters and ratees started together. Cohen's d values were small (≤0.10) for all independent variables, suggesting a lack of any clinically meaningful association between patient and operational factors and evaluations given the maximum scores. For supervision quality, the day's count of orthopedic cases was a significant predictor of scores (P = 0.0011). However, the resulting absolute marginal change in the percentage of supervision scores equal to the maximum was only 0.8% (99% confidence interval: 0.2% to 1.4%), i.e., too small to be of clinical or managerial importance. Neurosurgical cases may have been a significant predictor of work habits (P = 0.0054). However, the resulting marginal change in the percentage of work habits scores equal to the maximum, an increase of 0.8% (99% confidence interval: 0.1% to 1.6%), which was again too small to be important.

CONCLUSIONS

When evaluating the effect of assigning anesthesiologists and nurse anesthetists with different clinical performance quality on clinical outcomes, supervision quality and work habits scores may be included as independent variables without concern that their effects are confounded by association with the patient or case characteristics. Clinical supervision and work habits are measures of non-technical skills. Hence, these findings suggest that non-technical performance can be judged by observing the typical small sample size of cases. Then, associations can be tested with administrative data for a far greater number of patients because there is unlikely to be a confounding association between patient and case characteristics and the clinicians' non-technical performance.

Impact of job control on hospital workers' safety performance: A moderated mediation analysis of the influences of hospital safety climate and social support

AIM

To improve the level of hospital workers' safety performance in response to emergencies (e.g. COVID-19), this paper examines the relationship between hospital workers' job control on safety performance, and the mediating role of hospital safety climate and the moderating role of social support.

DESIGN

In this cross-sectional questionnaire survey, a convenience sampling of hospital workers from three hospitals that have COVID-19 cases from Beijing and Shandong Province in China.

METHODS

These questionnaires were used to obtain self-reported data on hospital workers' job control, hospital safety climate, social support and safety performance. Mplus software was used to calculate CFA. SPSS25.0 software was used to calculate mean values, standard deviations, correlations and regression analyses.

RESULTS

The participants were 241 hospital workers from three hospitals in China (male = 55.2%, female = 44.8%; age range <30 to >45; physician = 58%, nurse = 22%, other hospital worker = 20%). A moderated mediation model among job control, hospital safety climate, social support and safety performance was supported. Moderated mediation analysis indicates hospital workers' job control effectively improves the level of safety performance; hospital safety climate plays a partially mediating role in the process of job control affecting hospital workers' safety performance; social support moderates the effect of work control on medical workers' safety climate. Hence, it is important to increase job control and hospital safety climate. Further, social support for hospital workers should be encouraged, advocated and supported.

The Association Between Professional Burnout and Engagement With Patient Safety Culture and Outcomes: A Systematic Review

OBJECTIVES

In the last 20 years, there have been numerous successful efforts to improve patient safety, although recent research still shows a significant gap. Researchers have begun exploring the impact of individual level factors on patient safety culture and safety outcomes. This review examines the state of the science exploring the impact of professional burnout and engagement on patient safety culture and safety outcomes.

METHODS

A systematic search was conducted in CINAHL, PubMed, and Embase. Studies included reported on the relationships among burnout or engagement and safety culture or safety outcomes.

RESULTS

Twenty-two studies met inclusion criteria. Ten studies showed a relationship between both safety culture and clinical errors with burnout. Two of 3 studies reported an association between burnout and patient outcomes. Fewer studies focused on engagement. Most studies exploring engagement and safety culture found a moderately strong positive association. The limited evidence on the relationship between engagement and errors depicts inconsistent findings. Only one study explored engagement and patient outcomes, which failed to find a relationship.

CONCLUSIONS

The burnout/safety literature should be expanded to a multidisciplinary focus. Mixed results of the relationship between burnout and errors could be due to a disparate relationship with perceived versus observed errors. The engagement/safety literature is immature, although high engagement seems to be associated with high safety culture. Extending this science into safety outcomes would be meaningful, especially in light of the recent focus on an abundance-based approach to safety.

Improving the culture of safety among healthcare workers: Integration of different instruments to gain major insights and drive effective changes

The Safety Attitude Questionnaire (SAQ) and Manchester Patient Safety Framework (MaPSaF) are known as effective tools to assess patient safety culture and climate and develop targeted strategies. However, they are seldom applied in an integrated way. The aim of this study was to conduct an implementation project through a novel use of both instruments to gain unique insights. The Italian version of MaPSaF and SAQ were administered to 1,759 healthcare workers from three Italian hospitals (response rate: MaPSaF 70.5%, SAQ 61.6%). MaPSaF evaluation proved an overall bureaucratic level of patient safety culture. SAQ scores showed a predominance of neutral scores (75.99%). The dimension perception of management gained the lowest mean score (53.32), while Stress recognition obtained the highest (75.17). Safety climate perception differed significantly among groups: working in a small hospital, in a medical department, and being a physician were associated with the most positive results. The majority (67.1%) of responders to both MaPSaF and SAQ considered the two instruments as providing with different and complementary information. Overall, results showed that an integrated approach in the evaluation of an organisation's safety culture may result useful for an in-depth analysis of the criticalities and the adoption of appropriate improvement strategies.

Adaptation of the Agency for Healthcare Research and Quality's 'Hospital Survey on Patient Safety Culture' to the Bosnia and Herzegovina context

OBJECTIVES

Measuring staff perspectives on patient safety culture (PSC) can identify areas of concern that, if addressed, could lead to improvements in healthcare. To date, there is no validated measure to assess PSC that has been tested and adapted for use in Bosnia and Herzegovina (BiH). This research addresses the gap in the evidence through the psychometric assessment of the Agency for Healthcare Research and Quality's: 'Hospital Survey on Patient Safety Culture' (HSOPSC), to determine its suitability for the health system in BiH.

SETTING

Nine hospitals.

PARTICIPANTS

Healthcare professionals (n=1429); nurse (n=823), doctors (n=328), other clinical personnel (n=111), non-clinical personnel (n=60), other (n=64), no response (n=43).

PRIMARY AND SECONDARY OUTCOME MEASURES

A translated version of HSOPSC was used to conduct psychometric evaluation including exploratory factor analysis and confirmatory factor analysis (CFA). Comparison between the original HSOPSC and the newly adapted 'Hospital Survey on Patient Safety Culture for Bosnia and Herzegovina' (HSOPSC-BiH) was carried out.

RESULTS

Compared with the original survey, which has 12 factors (42 items), the adapted survey consisted of 9 factors (29 items). The following factors from the original survey were not included in their original form: Communication Openness, Feedback and Communications about error, Overall Perceptions of Patient Safety and Organisational learning-Continuous Improvement. The results of the CFA for HSOPSC-BiH showed a better model fit compared with the original HSOPSC. The absolute and relative fit indices showed excellent model adjustment.

CONCLUSIONS

The BiH version of Hospital Survey on Patient Safety Culture demonstrated satisfactory psychometric properties, with acceptable to good internal consistency and construct validity. Therefore, we recommend the HSOPSC-BiH as a basis for assessing PSC in BiH. This survey could provide insight into patient safety concerns in BiH so that strategies to overcome these issues could be formulated and implemented.

Psychometric properties of the Georgian version of the Safety Attitudes Questionnaire: a cross-sectional study

OBJECTIVE

To study the psychometric properties of the Georgian version of the Safety Attitudes Questionnaire short version.

DESIGN

Cross-sectional study.

SETTING

Three Georgian hospitals.

PARTICIPANTS

Personnel of participating hospitals (n=305 responses, estimated response rate 30%).

INTERVENTIONS

None.

PRIMARY AND SECONDARY OUTCOME MEASURES

Psychometric properties (model fit, internal consistency, construct validity, convergent and discriminant validity) of the instrument, factor structure derived from the data.

RESULTS

The Georgian version of Safety Attitudes Questionnaire demonstrated acceptable construct validity and internal consistency (Cronbach's alpha 0.61-0.91). Three factors, Teamwork Climate, Safety Climate and Working Conditions, had limited convergent and discriminant validity. Confirmatory factor analysis with the original six-factor model resulted in limited model fit (χ²/df=2.14, root mean square error of approximation (RMSEA)=0.06, goodness of fit index (GFI)=0.83, CFI=0.88, TLI=0.86). Exploratory factor analysis resulted in a modified four-factor model with satisfactory model fit (χ²/df=2.09, RMSEA=0.06, GFI=0.88, CFI=0.93, TLI=0.91).

CONCLUSIONS

The Georgian version of the Safety Attitudes Questionnaire (short version) demonstrated acceptable psychometric properties, with acceptable to good internal consistency and construct validity. While the whole model had limited fit to the data, a modified factor model resulted in good model fit. Our findings suggest the dimension Working Conditions has questionable psychometric properties and should be interpreted with caution. Other two correlated dimensions Teamwork Climate and Safety Climate share considerable variance and may be merged. Overall, the instrument can provide valuable information relevant for advancement of patient safety culture in Georgian hospitals.

Hospital Survey on Patient Safety Culture (HSPSC): a systematic review of the psychometric properties of 62 international studies

OBJECTIVE

To carry out a systematic review of the psychometric properties of international studies that have used the Hospital Survey on Patient Safety Culture (HSPSC).

DESIGN

Literature review and an analysis framework to review studies.

SETTING

Hospitals and other healthcare settings in North and South America, Europe, the Near East, the Middle East and the Far East.

DATA SOURCES

A total of 62 studies and 67 datasets made up of journal papers, book chapters and PhD theses were included in the review.

PRIMARY AND SECONDARY OUTCOME MEASURES

Psychometric properties (eg, internal consistency) and sample characteristics (eg, country of use, participant job roles and changes made to the original version of the HSPSC).

RESULTS

Just over half (52%) of the studies in our sample reported internal reliabilities lower than 0.7 for at least six HSPSC dimensions. The dimensions 'staffing', 'communication openness', 'non-punitive response to error', 'organisational learning' and 'overall perceptions of safety' resulted in low internal consistencies in a majority of studies. The outcomes from assessing construct validity were reported in 60% of the studies. Most studies took place in a hospital setting (84%); the majority of survey participants (62%) were drawn from nursing and technical staff. Forty-two per cent of the studies did not state what modifications, if any, were made to the original US version of the instrument.

CONCLUSIONS

While there is evidence of a growing worldwide trend in the use of the HSPSC, particularly within Europe and the Near/Middle East, our review underlines the need for caution in using the instrument. Future use of the HSPSC needs to be sensitive to the demands of care settings, the target population and other aspects of the national and local healthcare contexts. There is a need to develop guidelines covering procedures for using, adapting and translating the HSPSC, as well as reporting findings based on its use.

Hospital Survey on Patient Safety Culture: psychometric evaluation in Kuwaiti public healthcare settings

OBJECTIVE

As healthcare organisations endeavour to improve the quality and safety of their services, there is increasing recognition of the importance of building a culture of safety to promote patient safety and improve the outcomes of patient care. Surveys of safety culture/climate have not knowingly been conducted in Kuwait public hospitals, nor are valid or reliable survey instruments available for this context. This study aims to investigate the psychometric properties of the HSOPSC (Hospital Survey on Patient Safety Culture) tool in Kuwaiti public hospitals in addition to constructing an optimal model to assess the level of safety climate in this setting.

DESIGN

Cross-sectional study.

SETTING

Three public hospitals in Kuwait.

PARTICIPANTS

About 1317 healthcare professionals.

MAIN OUTCOME MEASURE

An adapted and contextualised version of HSOPSC was used to conduct psychometric evaluation including exploratory factor analysis, confirmatory factor analysis reliability and correlation analysis.

RESULTS

1317 questionnaires (87%) were returned. Psychometric evaluation, showed an optimal model of eight factors and 22 safety climate items. All items have strong factor loadings (0.42-0.86) and are theoretically related. Reliability analysis showed satisfactory results (α >0.60).

CONCLUSIONS

This is the first validation study of a standardised safety climate measure in a Kuwaiti healthcare setting. An optimal model for assessing patient safety climate was produced that mirrors other international studies and which can be used for measuring the prevailing safety climate. More importance should be attached to the psychometric fidelity of safety climate questionnaires before extending their use in other healthcare culture and contexts internationally.

Association Between Hospital Safety Culture and Surgical Outcomes in a Statewide Surgical Quality Improvement Collaborative

BACKGROUND

The "safety culture" within hospital systems is increasingly recognized as important to delivery of high-quality care. We examine the safety culture in a statewide hospital quality improvement collaborative and its associations with surgical outcomes.

STUDY DESIGN

A modified Safety Attitudes Questionnaire was sent to administrators, quality improvement teams, nurses, anesthesiologists, and surgeons in 49 hospitals participating in the Illinois Surgical Quality Improvement Collaborative in 2015. Associations between positive safety culture, as measured by percentage of positive responses on the Safety Attitudes Questionnaire, and the following NSQIP 30-day adverse outcomes: hospital-level risk-adjusted morbidity, mortality, death, or serious morbidity and readmission rates. Linear regression models with hospitals clustered by system were used to assess the relationship between safety culture and patient outcomes.

RESULTS

Operating room safety culture scores were highest (97.7% positive) compared with the other domains, and ratings of hospital management were lowest (75.9% positive). Hospital administrators consistently had the most positive perception of the safety culture (90.5% positive) and front-line providers were less positive: physicians (85.3%), advanced practice providers (88.1%), and nurses (80%). Teamwork was rated as a strength by patient care providers (physicians 88.3%, advanced practice providers 90.2%, and nurses 82.2%), but was perceived as weakest by administrators. Higher percentage of positive Safety Attitudes Questionnaire responses was significantly associated with lower risk of postoperative morbidity (p = 0.007) and death or serious morbidity (p = 0.04). No significant association between safety culture and the risk of mortality (p = 0.23) or readmissions (p = 0.52) was observed.

CONCLUSIONS

Hospital safety culture can influence certain surgical patient outcomes. Improving the safety culture within a hospital can represent a previously unrecognized approach that can be leveraged to strengthen surgical quality improvement efforts at the hospital level.

Safety culture in intensive care internationally and in Australia: A narrative review of the literature

OBJECTIVE

Assessment of safety culture in health care is of particular relevance in the complex intensive care setting, where the effects of human error can have catastrophic consequences. The aim of this review was to examine the literature on safety culture in intensive care units (ICUs) and specifically, to explore the state of knowledge regarding safety culture in the context of Australian ICUs.

METHODS

A search was conducted of key databases for studies published in English between January 2008 and December 2017 using terms 'safety culture', 'safety climate', 'safety attitude', 'intensive care', 'ICU' and 'critical care'. Studies were included if they presented original research, utilised the teamwork and safety climate factors of a quantitative survey tool to assess safety culture, the sample population included participants working in an adult intensive care, and the findings were reported in the context of intensive care.

RESULTS

Of the 36 studies identified, two were conducted in Australia. The studies demonstrate a rapid expansion in safety culture assessment globally. Three levels of safety culture application in intensive care were identified, including safety culture assessment, effect of an intervention on safety culture, and evaluation of the association between safety culture and structural, process and outcomes measures. The use of targeted safety culture domains is emerging. Common findings included variation in perceptions of safety culture between ICUs, unit and hospital management, and professional groups.

CONCLUSION

Though the assessment of safety culture in ICUs has been an area of prolific research internationally over the past ten years, the Australian context is limited and could be advanced through further research, including the effect on safety culture of interventions, and to establish the association between safety culture and patient safety outcomes. Longitudinal studies to demonstrate sustained intervention effects on safety culture should be considered.

Managing creativity and compliance in the pursuit of patient safety

Background

Are creativity and compliance mutually exclusive? In clinical settings, this question is increasingly relevant. Hospitals and clinics seek the creative input of their employees to help solve persistent patient safety issues, such as the prevention of bloodstream infections, while simultaneously striving for greater adherence to evidence-based guidelines and protocols. Extant research provides few answers about how creativity works in such contexts.

Methods

Cross-sectional survey data were collected from employees in 24 different U.S.-based outpatient hemodialysis clinics. Linear mixed-effects models were utilized to test study hypotheses. Professional status, clinic climate variables, and interaction terms were modeled as fixed effects, with a random effect for clinic included in all models.

Results

Our results show that high status employees contributed more creative patient safety improvement ideas compared to low status employees. However, when high status employees were part of clinics with a stronger safety climate of compliance, they contributed fewer creative ideas compared to their counterparts working in clinics with a reduced compliance orientation. We also predicted low status employees working in less punitive clinics would contribute more creative ideas, but this hypothesis was not fully supported.

Conclusions

This study suggests that in hospitals and clinics that rely on strict protocols and formal hierarchies to meet their goals, the factors that promote creativity may be distinctively context-dependent. Implications for theory, practice, as well as future directions for research examining creativity in healthcare and safety critical contexts are discussed.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3935-2) contains supplementary material, which is available to authorized users.

[Creation and validation of a new in-house synthetic scale to measure patient safety culture]

OBJECTIVE

Creation and validation of a new in-house synthetic scale to measure patient safety culture.

MATERIAL AND METHOD

Cross-sectional and descriptive study in which the results of the assessment of the level of safety culture in health and non-health professionals of a university hospital are collected using a new in-house synthetic scale as a measurement tool. It is called 'Questionnaire on patient safety culture in a Spanish speaking environment'. The construction process was carried out in six phases: Bibliographic search; Validation of the structure and content of the questionnaire by a group of experts in patient safety using a nominal group technique; Assumptions verification and exploratory factor analysis; Pilot test to ensure its compression by a convenience sample of expert professionals; Modification of version 1.1 after the relevant analyses and analysis of the reliability of the questionnaire.

RESULTS

The final version of the questionnaire had nine items, grouped into three factors a priori: Hospital Management support in patient safety, Perception of Safety, and Expectations and actions of the Managers/Supervisors that favour safety. The items were structured using a 5-point Likert scale. A general assessment item on patient safety at the Centre was also included, as well as five open questions to identify actions on patient safety undertaken by the Centre. Finally, the possibility of making observations in a section of free text was included. The comprehension analysis did not recommend, in any case, the revision of the wording or modification of the items. The Spearman and Pearson indices were similar, which allowed us to assume the linearity in the relationships proposed. The Kolmogorov-Smirnov test was satisfactory in all cases, which guaranteed the normal distribution of the variables. The sample was adequate to perform the factorial analysis. Both the Bartlett' sphericity test and the Kaiser-Meyer-Olkin (KMO) index showed sample quality to perform the analysis. The recommendation of the exploratory factor analysis that advised eliminating 1 item was followed. Specifically, item 9 was eliminated: 'It is only a matter of luck that in my Centre no more errors occur that affect patients'. The analysis of our scale has shown that all the factorial loads were greater than 0.5, which indicates good explanatory capacity of the item for the Dimension. In total, the scale manages to explain more than 60% of the perception by professionals in patient safety, considering an acceptable loss of information.

CONCLUSIONS

A new and validated in-house scale has been created to measure patient safety culture in the Spanish speaking healthcare environment.

Teamwork and Safety Climate in Homecare: A Mixed Method Study

A rapidly changing homecare service sector implies difficulties to control safety and health risks for staff and to guarantee standardised deliveries of services to recipients. This study aimed to describe staff perceptions of safety climate and practices in homecare service teams, and suggestions for improvements. A second aim was to identify if and how the appraisals of safety climate were related to individual perceptions of safety, mental strain and adverse events/injury. A convergent parallel mixed methods design was used. Nursing assistants and care aides (133 in total, representing 11 work teams) in the north of Sweden replied to a survey and participated in focus group interviews. Results were analysed with ANOVA (inter-team differences) and by qualitative content analysis. Significant diversity was identified between the teams in five of seven dimensions of safety climate. Important areas for improvement were: a need to define and agree on criteria for a safe working environment; leadership prioritising safety at work; and management able to provide trust, support and time. A prerequisite for these agreements was improved authority and communication between all parties involved. The safety climate dimensions were related to personal perceptions of safety and mental strain and, partly, to adverse events/injuries.

Differences in Safety Climate Perception by Health Care Worker, Work Schedule, and Workplace Characteristics

Safety climate has been associated with patient and health care worker safety and outcomes. However, few studies have examined how perceptions of workplace safety differ by worker, work schedule, and workplace characteristics. Data from 10 168 participants in the National Institute for Occupational Safety and Health's Health and Safety Practices Survey of Healthcare Workers were analyzed. Multivariable regression analyses examined associations among worker and workplace characteristics and items measuring 5 areas of workplace safety perception. Safety climate perception scores were higher (more positive) for dentists and for health care workers who were salaried, were self-employed, worked day shifts and shifts ⩽11 hours, and spent <76% of their time in patient care. A wide range of health care worker, work schedule, and workplace characteristics should be considered in analyses designed to evaluate safety climate and identify potential interventions to improve downstream safety outcomes.

Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools

BACKGROUND

The perceived importance of safety culture in improving patient safety and its impact on patient outcomes has led to a growing interest in the assessment of safety climate in healthcare organizations; however, the rigour with which safety climate tools were developed and psychometrically tested was shown to be variable. This paper aims to identify and review questionnaire studies designed to measure safety climate in acute hospital settings, in order to assess the adequacy of reported psychometric properties of identified tools.

METHODS

A systematic review of published empirical literature was undertaken to examine sample characteristics and instrument details including safety climate dimensions, origin and theoretical basis, and extent of psychometric evaluation (content validity, criterion validity, construct validity and internal reliability).

RESULTS

Five questionnaire tools, designed for general evaluation of safety climate in acute hospital settings, were included. Detailed inspection revealed ambiguity around concepts of safety culture and climate, safety climate dimensions and the methodological rigour associated with the design of these measures. Standard reporting of the psychometric properties of developed questionnaires was variable, although evidence of an improving trend in the quality of the reported psychometric properties of studies was noted. Evidence of the theoretical underpinnings of climate tools was limited, while a lack of clarity in the relationship between safety culture and patient outcome measures still exists.

CONCLUSIONS

Evidence of the adequacy of the psychometric development of safety climate questionnaire tools is still limited. Research is necessary to resolve the controversies in the definitions and dimensions of safety culture and climate in healthcare and identify related inconsistencies. More importance should be given to the appropriate validation of safety climate questionnaires before extending their usage in healthcare contexts different from those in which they were originally developed. Mixed methods research to understand why psychometric assessment and measurement reporting practices can be inadequate and lacking in a theoretical basis is also necessary.

Patient Safety Climate: A Study of Southern California Healthcare Organizations

EXECUTIVE SUMMARY

Human error remains the most important factor in unnecessary deaths and suffering in U.S. hospitals. Human error results from healthcare providers' attitudes and behaviors toward patients in different settings. Therefore, taking periodic snapshots of the attitudes and behaviors prevalent in an organization and manifested in its patient safety climate (PSC) is essential.We developed and tested a short survey instrument intended as an organization-level measure of PSC with good psychometric properties that can be used in hospitals, clinics, or other healthcare provider settings. Analysis of data from 61 Southern California healthcare organizations resulted in a PSC model with four distinct, reliable factors: (1) Assistance From Others and the Organization, (2) Leadership Messages of Support in Policy and Behavior, (3) Resources and Work Environment, and (4) Error Reporting Behavior. A PSC score, ranging from 0 to 100, was generated for each organization.For a subsample of hospitals in our study, preliminary results indicate a predictive quality of the model. The higher the PSC score, the lower the number of violations detected by the Centers for Medicare & Medicaid Services in complaint inspections, and the fewer the safety problems reported by The Leapfrog Group.Given the association between PSC and health outcomes, we urge healthcare leaders to use various means, such as our survey, to monitor the degree to which their organizations maintain a climate that fosters patient safety and use such data to pinpoint areas for improvement.

Measuring health care workers' perceptions of what constitutes a compassionate organisation culture and working environment: Findings from a quantitative feasibility survey

INTRODUCTION

Health care organisation cultures and working environments are highly complex, dynamic and constantly evolving settings. They significantly influence both the delivery and outcomes of care.

AIM

Phase 1 quantitative findings are presented from a larger three phase feasibility study designed to develop and test a Cultural Health Check toolkit to support health care workers, patients and organisations in the provision of safe, compassionate and dignified care.

METHODOLOGY

A mixed methods approach was applied. The Cultural Health Check Healthcare Workers Questionnaire was distributed across two National Health Service Hospitals in England, UK. Both hospitals allocated two wards comprising of older people and surgical specialities.

FINDINGS

The newly devised Cultural Health Check Staff Rating Scale Version 1 questionnaire was distributed to 223 health care workers. Ninety eight responses were returned giving a response rate of 44%. The Cultural Health Check Staff Rating Scale Version 1 has a significant Cronbach alpha of .775; this reliability scaling is reflected in all 16 items in the scale. Exploratory factor analysis identified two significant factors "Professional Practice and Support" and "Workforce and Service Delivery." These factors according to health care workers significantly impact on the organisation culture and quality of care delivered by staff.

CONCLUSION

The Cultural Health Check Staff Rating Scale Version 1 questionnaire is a newly validated measurement tool that could be used and applied to gauge health care workers perceptions of an organisations level of compassion. Historically we have focused on identifying how caring and compassionate nurses, doctors and related allied health professionals are. This turns the attention on employers of nurses and other related organisations.

IMPLICATIONS FOR NURSING MANAGEMENT

The questionnaire can be used to gauge the level of compassion with a health care organisation culture and working environment. Nurse managers and leaders should focus attention regarding how these two factors are supported and resourced in the future.

Development and testing of Baylor Scott & White Health's "Attitudes and Practices of Patient Safety Survey"

Improving the quality of patient care requires a culture attuned to safety. We describe the development, implementation, and psychometric evaluation of the Attitudes and Practices of Patient Safety Survey (APPSS) within the Baylor Scott & White Health system. The APPSS was designed to enable safety culture data to be collected and aggregated at the unit level to identify high-priority needs. The survey, with 27 Likert-scale core questions divided into 4 concept domains and 2 open-ended questions, was administered electronically to employees with direct patient care responsibilities (n = 16,950). The 2015 response rate was 50.4%. The Cronbach's α values for the four domains ranged from 0.78 to 0.90, indicating strong internal consistency. Confirmatory factor analysis results were mixed but were comparable to those of established safety culture surveys. Over the years, the adaptability of the APPSS has proven helpful to administrative and clinical leaders alike, and the survey responses have led to the creation of programs to improve the organization's patient safety culture. In conclusion, the APPSS provides a reliable measure of patient safety culture and may be useful to other health care organizations seeking to improve the quality and safety of the care they provide.

Impact of hydration and nutrition on personal performance in the clinical workplace

As clinicians we sometimes fail to look after ourselves at work. We often do not drink enough during the day or miss lunch breaks while caring for patients, and this can be particularly evident during an all-day operating list when procedures are long and complex. Some operating theatre staff do not even eat breakfast regularly. Inadequate intake of fluids or nutrition can impair performance, lead to tiredness and headaches, and may compromise both our own health and the care we provide to patients. Other high-risk organisations, including aviation, have recognised that employees must look after themselves if they are to optimise their performance. In this review, we discuss the importance of adequate hydration and nutrition at work to raise awareness that this is essential if we are to provide the best care for our patients.

Working conditions and workplace health and safety promotion in home care: A mixed-method study from Swedish managers' perspectives

Today, we can see a trend toward increased psychosocial strain at work among home-care managers and staff. The aim of this study is to describe home care managers' views on their own psychosocial working conditions and on how to promote workplace health and safety in a municipality in northern Sweden. A mixed-methods design was used, including questionnaire and qualitative focus group data. The qualitative data were analyzed by manifest content analysis. The results indicate that most managers perceived increased variety in work and opportunities for development at work, but at the same time increased demands. The managers suggested that workplace health and safety could be improved by risk assessment and improved communication, a clear communication chain by a real as well as a virtual platform for communication. In summary, workplace health and safety could be improved by risk assessments and by a physical as well as a virtual platform for communication.

The patient safety climate in healthcare organizations (PSCHO) survey: Short-form development

RATIONALE, AIMS, AND OBJECTIVES

Measures of safety climate are increasingly used to guide safety improvement initiatives. However, cost and respondent burden may limit the use of safety climate surveys. The purpose of this study was to develop a 15- to 20-item safety climate survey based on the Patient Safety Climate in Healthcare Organizations survey, a well-validated 38-item measure of safety climate.

METHODS

The Patient Safety Climate in Healthcare Organizations was administered to all senior managers, all physicians, and a 10% random sample of all other hospital personnel in 69 private sector hospitals and 30 Veterans Health Administration hospitals. Both samples were randomly divided into a derivation sample to identify a short-form subset and a confirmation sample to assess the psychometric properties of the proposed short form.

RESULTS

The short form consists of 15 items represented 3 overarching domains in the long-form scale-organization, work unit, and interpersonal.

CONCLUSION

The proposed short form efficiently captures 3 important sources of variance in safety climate: organizational, work-unit, and interpersonal. The short-form development process was a practical method that can be applied to other safety climate surveys. This safety climate short form may increase response rates in studies that involve busy clinicians or repeated measures.

Healthcare workers’ perceptions of organisational culture and the impact on the delivery of compassionate quality care

This paper explores the qualitative outcomes as part of a larger feasibility study which was developed to test a Cultural Health Check toolkit designed to assist healthcare workers and organisations in the provision of safe, dignified and compassionate quality care for older people. For the qualitative part of this project, 11 healthcare workers agreed to participate in a one-to-one semi-structured interview. The primary aim of the research was to identify the experiences of staff in relation to the different factors they feel contribute to the culture of the organisation. These data were analysed using Attride-Stirling thematic analysis. The data were coded and four global themes were evident: professional practice, support, workforce and service delivery. Professional practice included organisational themes of quality, communication and collaboration and how these impact on a health worker’s ability to carry out their role and the impact on the delivery of compassionate quality care. Support included organisation themes of personal and professional development, and facilitation by leaders and managers to access the available support. Workforce centred on the importance of having adequate levels of all staffing groups to be able to deliver safe, quality person-centred care and services. Service delivery identified the organisational themes of care, person-centred care and communication where staff have the desire, determination and enthusiasm to deliver safe, high quality compassionate person-centred care and services. These themes are key in the impact analysis relating to the delivery of compassionate quality care.

Reliability and validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study

The evaluation of the culture of patient safety in hospitals is nowadays considered as a management too, since it helps to identify problem areas and provide valuable information for planning improvements. This study explored the reliability and validity of the Brazilian version of the Hospital Survey on Patient Safety Culture, an instrument that evaluates characteristics of patient safety culture among hospital staff. The reliability of the instrument was evaluated by analyzing the internal consistency of each dimension. The validity of the tool was carried out by means of exploratory and confirmatory factor analysis. The sample was made up of 322 questionnaires that were collected in two Brazilian hospitals in 2012. Cronbach's alpha ranged from 0.52 to 0.91 for the different dimensions, with the exception of two, for which it was much lower. After excluding four items, the exploratory factor analysis presented adjusted indices that were appropriate for a 10 factor model.

Variability of patient safety culture in Belgian acute hospitals

OBJECTIVES

The aim of this study was to measure differences in safety culture perceptions within Belgian acute hospitals and to examine variability based on language, work area, staff position, and work experience.

METHODS

The Hospital Survey on Patient Safety Culture was distributed to hospitals participating in the national quality and safety program (2007-2009). Hospitals were invited to participate in a comparative study. Data of 47,136 respondents from 89 acute hospitals were used for quantitative analysis. Percentages of positive response were calculated on 12 dimensions. Generalized estimating equations models were fitted to explore differences in safety culture.

RESULTS

Handoffs and transitions, staffing, and management support for patient safety were considered as major problem areas. Dutch-speaking hospitals had higher odds of positive perceptions for most dimensions in comparison with French-speaking hospitals. Safety culture scores were more positive for respondents working in pediatrics, psychiatry, and rehabilitation compared with the emergency department, operating theater, and multiple hospital units. We found an important gap in safety culture perceptions between leaders and assistants within disciplines. Administration and middle management had lower perceptions toward patient safety. Respondents working less than 1 year in the current hospital had more positive safety culture perceptions in comparison with all other respondents.

CONCLUSIONS

Large comparative databases provide the opportunity to identify distinct high and low scoring groups. In our study, language, work area, and profession were identified as important safety culture predictors. Years of experience in the hospital had only a small effect on safety culture perceptions.

Are measurements of patient safety culture and adverse events valid and reliable? Results from a cross sectional study

BACKGROUND

The association between measurements of the patient safety culture and the "true" patient safety has been insufficiently documented, and the validity of the tools used for the measurements has been questioned. This study explored associations between the patient safety culture and adverse events, and evaluated the validity of the tools.

METHODS

In 2008/2009, a survey on patient safety culture was performed with Hospital Survey on Patient Safety Culture (HSOPSC) in two medical departments in two geographically separated hospitals of Innlandet Hospital Trust. Later, a retrospective analysis of adverse events during the same period was performed with the Global Trigger Tool (GTT). The safety culture and adverse events were compared between the departments.

RESULTS

185 employees participated in the study, and 272 patient records were analysed. The HSOPSC scores were lower and adverse events less prevalent in department 1 than in department 2. In departments 1 and 2 the mean HSOPSC scores (SD) were at the unit level 3.62 (0.42) and 3.90 (0.37) (p < 0.001), and at the hospital level 3.35 (1.53) and 3.67 (0.53) (ns, p = 0.19) respectively. The proportion of records with adverse events were 10/135 (7%) and 28/137 (20%) (p = 0.003) respectively.

CONCLUSIONS

There was an inverse association between the patient safety culture and adverse events. Until the criterion validity of the tools for measuring patient safety culture and tracking of adverse events have been further evaluated, measurement of patient safety culture could not be used as a proxy for the "true" safety.

Patient safety culture in China: a case study in an outpatient setting in Beijing

OBJECTIVES

To investigate the patient safety culture in an outpatient setting in Beijing and explore the meaning and implications of the safety culture from the perspective of health workers and patients.

METHODS

A mixed methods approach involving a questionnaire survey and in-depth interviews was adopted. Among the 410 invited staff members, 318 completed the Hospital Survey of Patient Safety Culture (HSOPC). Patient safety culture was described using 12 subscale scores. Inter-subscale correlation analysis, ANOVA and stepwise multivariate regression analyses were performed to identify the determinants of the patient safety culture scores. Interviewees included 22 patients selected through opportunity sampling and 27 staff members selected through purposive sampling. The interview data were analysed thematically.

RESULTS

The survey respondents perceived high levels of unsafe care but had personally reported few events. Lack of 'communication openness' was identified as a major safety culture problem, and a perception of 'penalty' was the greatest barrier to the encouragement of error reporting. Cohesive 'teamwork within units', while found to be an area of strength, conversely served as a protective and defensive mechanism for medical practice. Low levels of trust between providers and consumers and lack of management support constituted an obstacle to building a positive patient safety culture.

CONCLUSIONS

This study in China demonstrates that a punitive approach to error is still widespread despite increasing awareness of unsafe care, and managers have been slow in acknowledging the importance of building a positive patient safety culture. Strong 'teamwork within units', a common area of strength, could fuel the concealment of errors.

Cultura de segurança do paciente em terapia intensiva: recomendações da enfermagem

Estudo quantitativo, tipo survey, transversal e comparativo, que teve por objetivo sistematizar as recomendações dos profissionais de enfermagem acerca da segurança do paciente em duas Unidades de Terapia Intensiva adulto na Grande Florianópolis-SC, Brasil, em 2011. Resultou da resposta a uma pergunta qualitativa aplicada com o Hospital Survey on Patient Safety Culture a 97 profissionais de enfermagem, com uma taxa de resposta de 93,8%, correspondendo a 91 profissionais, sendo obtidas 267 recomendações, categorizadas conforme as dimensões do instrumento utilizado. Houve maior número de recomendações para as dimensões aprendizado organizacional e melhoria contínua, com sugestões envolvendo capacitação e treinamento; pessoal em relação ao quantitativo; e percepção geral de segurança do paciente, indicando melhoria dos procedimentos e processos e apoio da gestão hospitalar, com ênfase na melhoria dos recursos materiais e equipamentos. Destacadas por outros estudos, estas recomendações são essenciais para a promoção da segurança do paciente nas Unidades de Terapia Intensiva estudadas.

Psychometric properties of the Hospital Survey on Patient Safety Culture, HSOPSC, applied on a large Swedish health care sample

BACKGROUND

A Swedish version of the USA Agency for Healthcare Research and Quality "Hospital Survey on Patient Safety Culture" (S-HSOPSC) was developed to be used in both hospitals and primary care. Two new dimensions with two and four questions each were added as well as one outcome measure. This paper describes this Swedish version and an assessment of its psychometric properties which were tested on a large sample of responses from personnel in both hospital and primary care.

METHODS

The questionnaire was mainly administered in web form and 84215 forms were returned (response rate 60%) between 2009 and 2011. Eleven per cent of the responses came from primary care workers and 46% from hospital care workers. The psychometric properties were analyzed using both the total sample and the hospital and primary care subsamples by assessment of construct validity and internal consistency. Construct validity was assessed by confirmatory (CFA) and exploratory factor (EFA) analyses and internal consistency was established by Cronbachs's α.

RESULTS

CFA of the total, hospital and primary care samples generally showed a good fit while the EFA pointed towards a 9-factor model in all samples instead of the 14-dimension S-HSOPSC instrument. Internal consistency was acceptable with Cronbach's α values above 0.7 in a major part of the dimensions.

CONCLUSIONS

The S-HSOPSC, consisting of 14 dimensions, 48 items and 3 single-item outcome measures, is used both in hospitals and in primary care settings in Sweden for different purposes. This version of the original American instrument has acceptable construct validity and internal consistency when tested on large datasets of first-time responders from both hospitals and primary care centres. One common instrument for measurements of patient safety culture in both hospitals and primary care settings is an advantage since it enables comparisons between sectors and assessments of national patient safety improvement programs. Future research into this version of the instrument includes comparing results from patient safety culture measurements with other outcomes in relation to safety improvement strategies.

The Relationship Between Safety Culture and Patient Outcomes

Patient safety continues to be a serious health concern in acute-care hospitals. Safety culture has been a frequent target for patient safety improvement over the past decade, based on recommendations from the Institute of Medicine and its use in industry. However, the relationship between safety culture and patient safety in acute-care hospitals has yet to be systematically examined. Thus, a meta-analysis was devised to examine the relationship between patient safety outcomes and safety culture in that setting. Due to the limited empirical research reports available, five small pilot meta-analyses were conducted, examining the relationship between safety culture and each of the following: pressure ulcers, falls, medication errors, nurse-sensitive outcomes, and post-operative outcomes. No significant relationships of any size were identified. An assessment of the relevant literature is presented, offering potential explanations for this surprising finding and an agenda for future research.

Patient safety climate and worker safety behaviours in acute hospitals in Scotland

OBJECTIVES

To obtain a measure of hospital safety climate from a sample of National Health Service (NHS) acute hospitals in Scotland and to test whether these scores were associated with worker safety behaviors, and patient and worker injuries.

METHODS

Data were from 1,866 NHS clinical staff in six Scottish acute hospitals. A Scottish Hospital Safety Questionnaire measured hospital safety climate (Hospital Survey on Patient Safety Culture), worker safety behaviors, and worker and patient injuries. The associations between the hospital safety climate scores and the outcome measures (safety behaviors, worker and patient injury rates) were examined.

RESULTS

Hospital safety climate scores were significantly correlated with clinical workers' safety behavior and patient and worker injury measures, although the effect sizes were smaller for the latter. Regression analyses revealed that perceptions of staffing levels and managerial commitment were significant predictors for all the safety outcome measures. Both patient-specific and more generic safety climate items were found to have significant impacts on safety outcome measures.

CONCLUSION

This study demonstrated the influences of different aspects of hospital safety climate on both patient and worker safety outcomes. Moreover, it has been shown that in a hospital setting, a safety climate supporting safer patient care would also help to ensure worker safety.

IMPACT ON INDUSTRY

The Scottish Hospital Safety Questionnaire has proved to be a usable method of measuring both hospital safety climate as well as patient and worker safety outcomes.

Promoting a culture of safety as a patient safety strategy: a systematic review

Developing a culture of safety is a core element of many efforts to improve patient safety and care quality. This systematic review identifies and assesses interventions used to promote safety culture or climate in acute care settings. The authors searched MEDLINE, CINAHL, PsycINFO, Cochrane, and EMBASE to identify relevant English-language studies published from January 2000 to October 2012. They selected studies that targeted health care workers practicing in inpatient settings and included data about change in patient safety culture or climate after a targeted intervention. Two raters independently screened 3679 abstracts (which yielded 33 eligible studies in 35 articles), extracted study data, and rated study quality and strength of evidence. Eight studies included executive walk rounds or interdisciplinary rounds; 8 evaluated multicomponent, unit-based interventions; and 20 included team training or communication initiatives. Twenty-nine studies reported some improvement in safety culture or patient outcomes, but measured outcomes were highly heterogeneous. Strength of evidence was low, and most studies were pre-post evaluations of low to moderate quality. Within these limits, evidence suggests that interventions can improve perceptions of safety culture and potentially reduce patient harm.