A review of medical error reporting system design considerations and a proposed cross-level systems research framework

Exploring the Use of Persuasive System Design Principles to Enhance Medication Incident Reporting and Learning Systems: Scoping Reviews and Persuasive Design Assessment

BACKGROUND

Medication incidents (MIs) causing harm to patients have far-reaching consequences for patients, pharmacists, public health, business practice, and governance policy. Medication Incident Reporting and Learning Systems (MIRLS) have been implemented to mitigate such incidents and promote continuous quality improvement in community pharmacies in Canada. They aim to collect and analyze MIs for the implementation of incident preventive strategies to increase safety in community pharmacy practice. However, this goal remains inhibited owing to the persistent barriers that pharmacies face when using these systems.

OBJECTIVE

This study aims to investigate the harms caused by medication incidents and technological barriers to reporting and identify opportunities to incorporate persuasive design strategies in MIRLS to motivate reporting.

METHODS

We conducted 2 scoping reviews to provide insights on the relationship between medication errors and patient harm and the information system-based barriers militating against reporting. Seven databases were searched in each scoping review, including PubMed, Public Health Database, ProQuest, Scopus, ACM Library, Global Health, and Google Scholar. Next, we analyzed one of the most widely used MIRLS in Canada using the Persuasive System Design (PSD) taxonomy-a framework for analyzing, designing, and evaluating persuasive systems. This framework applies behavioral theories from social psychology in the design of technology-based systems to motivate behavior change. Independent assessors familiar with MIRLS reported the degree of persuasion built into the system using the 4 categories of PSD strategies: primary task, dialogue, social, and credibility support.

RESULTS

Overall, 17 articles were included in the first scoping review, and 1 article was included in the second scoping review. In the first review, significant or serious harm was the most frequent harm (11/17, 65%), followed by death or fatal harm (7/17, 41%). In the second review, the authors found that iterative design could improve the usability of an MIRLS; however, data security and validation of reports remained an issue to be addressed. Regarding the MIRLS that we assessed, participants considered most of the primary task, dialogue, and credibility support strategies in the PSD taxonomy as important and useful; however, they were not comfortable with some of the social strategies such as cooperation. We found that the assessed system supported a number of persuasive strategies from the PSD taxonomy; however, we identified additional strategies such as tunneling, simulation, suggestion, praise, reward, reminder, authority, and verifiability that could further enhance the perceived persuasiveness and value of the system.

CONCLUSIONS

MIRLS, equipped with persuasive features, can become powerful motivational tools to promote safer medication practices in community pharmacies. They have the potential to highlight the value of MI reporting and increase the readiness of pharmacists to report incidents. The proposed persuasive design guidelines can help system developers and community pharmacy managers realize more effective MIRLS.

Comparison between the WHO-CFICPS and the PRISMA classification of safety-related events in a radiation oncology department

INTRODUCTION

Describing Safety-Related Events (SREs) in a radiotherapy (RT) department and comparing WHO-CFICPS (World Health Organization's Conceptual Framework For The International Classification For Patient Safety) and PRISMA (Prevention and Recovery Information System for Monitoring and Analysis) methods for classifying SREs.

METHODS

From February 2017 to October 2020, two Quality Managers (QMs) randomly classified 1173 SREs using 13 incident types of WHO-CFICPS. The same two QMs, reclassified the same SREs according to 20 PRISMA incident codes. Statistical analysis was performed to assess the association between the 13 incident types of WHO-CFICPS and the 20 PRISMA codes. The chi-squared and post-hoc tests using adjusted standardized residuals were applied to detect the association between the two systems.

RESULTS

There was a significant association between WHO-CFICPS incident types and PRISMA codes (P < 0.001). Ninety-two percent of all SREs were categorized using 4 of 13 WHO-CFICPS incident types including Clinical Process/Procedure (n = 448, 38.2%), Clinical Administration (n = 248, 21.1%), Documentation (n = 226, 19.2%) and Resources/Organizational Management (n = 15,613.3%). According to PRISMA classification, 14 of the 20 codes were used to describe the same SREs. PRISMA captured 41 Humans Skill Slips from 226 not better defined WHO-CFICPS Documentation Incidents, 38 Human Rule-based behaviour Qualification from not better defined 447 Clinical Process/Procedure and 40 Organization Management priority events from 156 not better defined WHO-CFICPS Resources/Organizational Management events (P < 0.001).

CONCLUSION

Although there was a significant association between WHO-CFICPS and PRISMA, The PRISMA method provides a more detailed insight into SREs compared to WHO-CFICPS in a RT department.

Investigation of factors related to the behavior of reporting clinical errors in nurses working in educational and medical centers in Rasht city, Iran

BACKGROUND

Report of medical error is one of the effective components in the quality of healthcare services. A significant part of medical errors can be prevented by acting appropriately. The theory of planned behavior offers a framework in which the nurse intention to perform the behavior of error reporting is investigated. This study was conducted to determine the factors related to the behavior of reporting clinical errors in nurses working in educational and medical centers in Rasht based on the theory of planned behavior in 2020.

METHODS

In this descriptive-analytical study, 326 nurses in all medical centers in Rasht were selected by the multi-stage random sampling method. Data collection tool was a valid and reliable questionnaire based on the theory of planned behavior. Data analysis was conducted using the SPSS software, analysis of variance, correlation, and linear regression.

RESULTS

39% of nurses reported that they had reported a medical error, and the average number of error reports per nurse during the last 3 months was 1.42 errors. The predictive power of the theory of behavioral intention was 47%, and predictive constructs were attitude (B = .43), perceived behavioral control (B = .33), and subjective norm (B = .04) using linear regression. The predictive power of the theory for nurses' behavior was 3.1%. None of the demographic variables played a role in predicting the behavior of nurses' reporting clinical error, and no behavioral intention predicted the behavior of nurses' reporting clinical errors.

CONCLUSION

The theory of planned behavior expresses the factors affecting the behavior intention of nurses' reporting clinical errors satisfactorily. However, it was an inappropriate theory in behavior prediction. It appears that factors, such as fear of consequences of error reporting, social pressures by colleagues and officials, and lack of knowledge and skills required to identify medical errors, are the barriers to conversion of intention to the behavior of reporting clinical errors. It is necessary to provide the ground to increase nurses' report of clinical errors by acting appropriately.

Expert Recommendations for Designing Reporting Systems to Address Patient-Perpetrated Sexual Harassment in Healthcare Settings

BACKGROUND

Patient-perpetrated sexual harassment toward staff and patients is prevalent in Veterans Affairs and other healthcare settings. However, many healthcare facilities do not have adequate systems for reporting patient-perpetrated harassment, and there is limited evidence to guide administrators in developing them.

OBJECTIVE

To identify expert recommendations for designing effective systems for reporting patient-perpetrated sexual harassment of staff and patients in Veterans Affairs and other healthcare settings.

DESIGN

We conducted qualitative interviews with subject matter experts in sexual harassment prevention and intervention during 2019.

PARTICIPANTS

We used snowball sampling to recruit subject matter experts. Participants included researchers, clinicians, and administrators from Veterans Affairs/other healthcare, academic, military, and non-profit settings (n = 33).

APPROACH

We interviewed participants via telephone using a semi-structured guide and analyzed interview data using a constant comparative approach.

KEY RESULTS

Expert recommendations for designing reporting systems to address patient-perpetrated sexual harassment focused on fostering trust, encouraging reporting, and deterring harassment. Recommendations included the following: (1) promote a climate in which harassment is not tolerated; (2) take proportional, corrective actions in response to reports; (3) minimize adverse outcomes for reporting parties; (4) facilitate and simplify reporting processes; and (5) hold the reporting system accountable. Specific strategies related to each recommendation were also identified.

CONCLUSIONS

This qualitative study generated initial recommendations to guide healthcare administrators and policy makers in assessing, developing, and improving systems for reporting patient-perpetrated sexual harassment toward staff and other patients. Results indicate that proactive, careful design and ongoing evaluation are essential for ensuring that reporting systems have their intended effects and mitigating the risks of inadequate systems. Additional research is needed to evaluate strategies that effectively address patient-perpetrated harassment while balancing patients' clinical needs.

Type and impact of clinical incidents identified by a voluntary reporting system covering 130 small animal practices in mainland Europe

BACKGROUND

Veterinary healthcare can be a complex process and may lead to unwanted, potentially harmful patient safety incidents as a consequence, negatively impacting both the practice team and client satisfaction. The aim of this study was to identify how such incidents impact cats and dogs by analysing reports gathered in a large-scale voluntary incident reporting system.

METHODS

Descriptive statistical analysis was used to study a total of 2155 incident reports, submitted by 130 practices on mainland Europe.

RESULTS

Incidents caused harm in more than 40% of reports. Medication-related incidents were the most frequent type of incident recorded (40%). Treatment-related incidents were the most common type of incident causing patient harm (55%). Anaesthesia-related incidents were the most severe type of incident, resulting in patient death in 18% of these reports. Most incidents were reported from hospital wards, and a significantly higher proportion of cats were harmed by incidents compared to dogs.

CONCLUSION

This study demonstrates that patients are regularly harmed by incidents, with medication-related incidents being most common. In depth understanding of incident data can help develop interventions to reduce the risk of incident recurrence.

Remembering Ben-Tzion Karsh's scholarship, impact, and legacy

Dr. Ben-Tzion (Bentzi) Karsh was a mentor, collaborator, colleague, and friend who profoundly impacted the fields of human factors and ergonomics (HFE), medical informatics, patient safety, and primary care, among others. In this paper we honor his contributions by reflecting on his scholarship, impact, and legacy in three ways: first, through an updated simplified bibliometric analysis in 2020, highlighting the breadth of his scholarly impact from the perspective of the number and types of communities and collaborators with which and whom he engaged; second, through targeted reflections on the history and impact of Dr. Karsh's most cited works, commenting on the particular ways they impacted our academic community; and lastly, through quotes from collaborators and mentees, illustrating Dr. Karsh's long-lasting impact on his contemporaries and students.

Medical error reporting among doctors and nurses in a Nigerian hospital: A cross-sectional survey

AIM

To compare doctors' and nurses' perceptions of factors influencing medical error reporting.

BACKGROUND

In Nigeria, there is limited information on determinants of error reporting and systems.

METHODS

From the total workforce (N = 600), 140 nurses and 90 doctors were selected by random sampling and completed the questionnaire February to March 2017.

RESULTS

All 140 nurses and 90 doctors approached responded. Inter-professional differences in response to sentinel events showed that 55/140, 39.3% nurses and 48/90, 53.3% doctors would never report wrong medicines administered and 49/138, 35.5% nurses and 35/90, 38.9% doctors would never report a haemolytic transfusion error. Some respondents (72/140, 51.4% nurses vs. 29/90, 32.2% doctors) were unaware of reporting systems. Most (77/140, 55% nurses vs. 48/90, 53.3% doctors) considered these to be ineffective and confounded by a 'blame culture'. Perceived barriers included lack of confidentiality; facilitators included clear guidelines about protection from litigation.

CONCLUSIONS

Error reporting is suboptimal. Nurses and doctors have a minimal common understanding of barriers to error reporting and demonstrate inconsistent practice.

IMPLICATIONS FOR NURSING MANAGEMENT

Suboptimal reporting of serious adverse events has implications for patient safety. Managers need to prioritize education in adverse events, clarify reporting procedures and divest the organisation of a 'blame culture'.

Physicians' and Nurses' Perceptions of and Attitudes Toward Incident Reporting in Palestinian Hospitals

OBJECTIVES

Underreporting of incidents that happen in health care services undermines the ability of the systems to improve patient safety. This study assessed the attitudes of physicians and nurses toward incident reporting and the factors influencing reporting in Palestinian hospitals. It also examined clinicians' views about the preferred features of incident reporting system.

METHODS

Cross-sectional self-administered survey of 475 participants, 152 physicians and 323 nurses, from 11 public hospitals in the West Bank; response rate, 81.3%.

RESULTS

There was a low level of event reporting among participants in the past year (40.3%). Adjusted for sex and age, physicians were 2.1 times more likely to report incidents than nurses (95% confidence interval, 1.32-3.417; P = 0.002). Perceived main barriers for reporting were grouped under lack of proper structure for reporting, prevalence of blame, and punitive environment. The clinicians indicated fear of administrative sanctions, social and legal liability, and of their competence being questioned (P > 0.05). Getting help for patients, learning from mistakes, and ethical obligation were equally indicated motivators for reporting (P > 0.05). Meanwhile, clinicians prefer formal reporting (77.8%) of all type of errors (65.5%), disclosure of reporters (52.7%), using reports to improve patient safety (80.3%), and willingness to report to immediate supervisors (57.6%).

CONCLUSION

Clinicians acknowledge the importance of reporting incidents; however, prevalence of punitive culture and inadequate reporting systems are key barriers. Improving feedback about reported errors, simplifying procedures, providing clear guidelines on what and who should report, and avoiding blame are essential to enhance reporting. Moreover, health care organizations should consider the opinions of the clinicians in developing reporting systems.

Medical Error Reporting: Status Quo and Perceived Barriers in an Orthopedic Center in Iran

Background:

Medical error reporting is fundamental for improving patient safety. We surveyed healthcare professionals to evaluate their experience of adverse events witness and reporting, knowledge about adverse events, attitude toward own and colleagues' errors, and perceived barriers in reporting errors.

Methods:

This cross-sectional study was conducted on healthcare professionals from May to October 2017 at Chamran hospital, which is the largest referral orthopedic center in southern Iran. The self-administered questionnaire comprised 32 items covering five domains: (1) demographic and professional characteristics, (2) medical error witness and reporting, (3) actual and perceived knowledge regarding type of events and the status of completed training courses, (4) attitude toward reporting one's own and colleagues' errors, and (5) perceived barriers in error reporting. Questionnaire validity and reliability was proven in our previous study.

Results:

From a total of 210 participants, 164 returned completed questionnaires (response rate = 78.1%); 87 (53%) were physicians and 77 (47%) were nurses. Underreporting was common, particularly among physicians. Out of physicians and nurses, 57.1% and 49.4% had poor knowledge, respectively. Participants reported their own or colleagues' errors alike, but physicians tended to only provide verbal warning to their colleagues (36.8%), and nurses stated they would report the colleagues' errors, if it was serious (32.4%). Fear of blame and punishment and fear of legal ramification were the most important perceived barriers.

Conclusions:

Improvements in current medical error registry system, implementing effective educational courses, and modifying the curricula for students seem to be necessary to resolve the problem of underreporting and poor knowledge level.

Patient Safety Incident Reporting In Indonesia: An Analysis Using World Health Organization Characteristics For Successful Reporting

Background

Incident reporting is widely acknowledged as one of the ways of improving patient safety and has been implemented in Indonesia for more than ten years. However, there was no significant increase in the number of reported incidents nationally. The study described in this paper aimed at assessing the extent to which Indonesia’s patient safety incident reporting system has adhered to the World Health Organization (WHO) characteristics for successful reporting.

Methods

We interviewed officials from 16 organizations at national, provincial and district or city levels in Indonesia. We reviewed several policies, guidelines and regulations pertinent to incident reporting in Indonesia and examined whether the WHO characteristics were covered in these documents. We used NVivo version 9 to manage the interview data and applied thematic analysis to organize our findings.

Results

Our study found that there was an increased need for a non-punitive system, confidentiality, expert-analysis and timeliness of reporting, system-orientation and responsiveness. The existing guidelines, policies and regulations in Indonesia, to a large extent, have not satisfied all the required WHO characteristics of incident reporting. Furthermore, awareness and understanding of the reporting system amongst officials at almost all levels were lacking.

Conclusion

Despite being implemented for more than a decade, Indonesia’s patient safety incident reporting system has not fully adhered to the WHO guidelines. There is a pressing need for the Indonesian Government to improve the system, by putting specific regulations and by creating a robust infrastructure at all levels to support the incident reporting.

Factors influencing missed nursing care in public hospitals in Australia: An exploratory mixed methods study

BACKGROUND

Missed nursing care (MNC) is a significant health care issue that impacts on the quality of health care and patient safety. It refers to delayed or omitted aspects of nursing care (totally or partially). MNC is an under-researched area in the Australian health care context.

OBJECTIVE

This research sought to further explore the MNC phenomenon in the context of an acute care hospital and to identify its common elements and the factors influencing its occurrence.

DESIGN

A convergent parallel mixed methods design was employed involving secondary analysis of routinely collected hospital data and a survey of 44 nursing staff using the MISSCARE survey instrument. The two sources of data were converged to address the objective.

FINDINGS

The study found that the most common elements of missed nursing care include failure of patient ambulation, emotional support for patients and/or family, and the provision of full documentation. These elements are consistent with previous international studies conducted in acute care hospital settings. This study identified that local context impacting on MNC was also important and included interruptions to workflow, "perceived" lack of management support, poor handover, and communication breakdown between the nursing team and medical staff.

CONCLUSION

Consideration of the local health care context is foundational in understanding the MNC phenomenon. The findings of this research may help nursing managers mitigate the possible effects of MNC and therefore improve patient safety in their acute care environment. Additional multisite studies are required to further explore factors associated with MNC in both general and local contexts.

Performance-Shaping Factors Affecting Older Adults' Hospital-to-Home Transition Success: A Systems Approach

BACKGROUND AND OBJECTIVES

Facilitating older adults' successful hospital-to-home transitions remains a persistent challenge. To address this challenge, we applied a systems lens to identify and understand the performance-shaping factors (PSFs) related older adults' hospital-to-home transition success.

RESEARCH DESIGN AND METHODS

This study was a secondary analysis of semi-structured interviews from older adults (N = 31) recently discharged from a hospital and their informal caregivers (N = 13). We used a Human Factors Engineering approach to guide qualitative thematic analysis to develop four themes concerning the system conditions shaping hospital-to-home transition success.

RESULTS

The four themes concerning PSFs were: (a) the hospital-to-home transition was a complex multiphase process-the process unfolded over several months and required substantial, persistent investment/effort; (b) there were unmet needs for specialized tools-information and resources provided at hospital discharge were not aligned with requirements for transition success; (c) alignment of self-care routines with transition needs-pre-hospitalization routines could be supportive/disruptive and could deteriorate/be re-established; and (d) changing levels of work demand and capacity during the transition-demand often exceeded capacity leading to work overload.

DISCUSSION AND IMPLICATIONS

Our findings highlight that the transition is not an episodic event, but rather a longitudinal process extending beyond the days just after hospital discharge. Transition interventions to improve older adults' hospital-to-home transitions need to account for this complex multiphase process. Future interventions must be developed to support older adults and informal caregivers in navigating the establishment and re-establishment of routines and managing work demands and capacity during the transition process.

Transparency and Disclosure

Disclosure of medical errors and adverse outcomes is expected by regulatory agencies and society as a whole. Disclosure should occur in a systematic way that ensures honesty and transparency regarding the care that has been provided. It is often appropriate to seek professional help from Clinical Risk Management to assist with disclosure of any serious safety event that resulted in harm. Disclosure of medical errors facilitates efforts to prevent recurrence of safety events.

The attitudes of nursing students and clinical instructors towards reporting irregular incidents in the medical clinic

Despite efforts to increase patient safety, medical incidents and near misses occur daily. Much is still unknown about this phenomenon, especially due to underreporting. This study examined why nursing students and clinical instructors underreport medical events, and whether they believe that changes within their institutions could increase reporting. 103 third- and fourth-year nursing students and 55 clinical instructors completed a validated questionnaire. The results showed that about one-third of the instructors and one-half of the nursing students believed that circumstances and lack of awareness, and fear of consequences, lead to underreporting. Both nursing students and clinical instructors ranked "fear of consequences" as the main reason for not reporting, yet students ranked this higher than their instructors. Moreover, both groups believed that incident reporting could be increased following changes in the clinical field, mainly by increasing awareness and knowledge. A large percentage of participants also wrote that they do not report errors that are the result of circumstances and lack of awareness, mainly fear of consequences. Therefore, hospitals and academic institutions may need to create a more accepting organizational climate. Moreover, institutions that allow incident reports to be submitted anonymously and that take educational (not disciplinary) action, may increase incident reporting.

The intention to use an electronic health record and its antecedents among three different categories of clinical staff

Background

Like other sectors, the healthcare sector has to deal with the issue of users’ acceptance of IT. In healthcare, different factors affecting healthcare professionals’ acceptance of software applications have been investigated. Unfortunately, inconsistent results have been found, maybe because the different studies focused on different IT and occupational groups. Consequently, more studies are needed to investigate these implications for recent technology, such as Electronic Health Records (EHR).

Methods

Given these findings in the existing literature, we pose the following research question: “To what extent do the different categories of clinical staff (physicians, paraprofessionals and administrative personnel) influence the intention to use an EHR and its antecedents?” To answer this research question we develop a research model that we empirically tested via a survey, including the following variables: intention to use, ease of use, usefulness, anxiety, self-efficacy, trust, misfit and data security. Our purpose is to clarify the possible differences existing between different staff categories.

Results

For the entire personnel, all the hypotheses are confirmed: anxiety, self-efficacy, trust influence ease of use; ease of use, misfit, self-efficacy, data security impact usefulness; usefulness and ease of use contribute to intention to use the EHR. They are also all confirmed for physicians, residents, carers and nurses but not for secretaries and assistants. Secretaries’ and assistants’ perception of the ease of use of EHR does not influence their intention to use it and they could not be influenced by self-efficacy in the development of their perception of the ease of use of EHR.

Conclusions

These results may be explained by the fact that secretaries, unlike physicians and nurses, have to follow rules and procedures for their work, including working with EHR. They have less professional autonomy than healthcare professionals and no medical responsibility. This result is also in line with previous literature highlighting that administrators are more motivated by the use of IT in healthcare.

Health Services Research Evaluation Principles

Background: Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned.

Objective: Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks.

Method: A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR.

Results: The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged.

Conclusions: We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

Medication adherence: staying within the boundaries of safety

An important domain of patient safety is the management of medications in home and community settings by patients and their caregiving network. This study applied human factors/ergonomics theories and methods to data about medication adherence collected from 61 patients with heart failure accompanied by 31 informal caregivers living in the US. Seventy non-adherence events were identified, described, and analysed for performance shaping factors. Half were classified as errors and half as violations. Performance shaping factors included elements of the person or team (e.g. patient limitations), task (e.g. complexity), tools and technologies (e.g. tool quality) and organisational, physical, and social context (e.g. resources, support, social influence). Study findings resulted in a dynamic systems model of medication safety applicable to patient medication adherence and the medication management process. Findings and the resulting model offer implications for future research on medication adherence, medication safety interventions, and resilience in home and community settings. Practitioner Summary: We describe situational and habitual errors and violations in medication use among older patients and their family members. Multiple factors pushed performance towards risk and harm. These factors can be the target for redesign or various forms of support, such as education, changes to the plan of care, and technology design.

Enhancing Patient Safety Event Reporting. A Systematic Review of System Design Features

OBJECTIVES

Electronic patient safety event reporting (e-reporting) is an effective mechanism to learn from errors and enhance patient safety. Unfortunately, the value of e-reporting system (a software or web server based platform) in patient safety research is greatly overshadowed by low quality reporting. This paper aims at revealing the current status of system features, detecting potential gaps in system design, and accordingly proposing suggestions for future design and implementation of the system.

METHODS

Three literature databases were searched for publications that contain informative descriptions of e-reporting systems. In addition, both online publicly accessible reporting forms and systems were investigated.

RESULTS

48 systems were identified and reviewed. 11 system design features and their frequencies of occurrence (Top 5: widgets (41), anonymity or confidentiality (29), hierarchy (20), validator (17), review notification (15)) were identified and summarized into a system hierarchical model.

CONCLUSIONS

The model indicated the current e-reporting systems are at an immature stage in their development, and discussed their future development direction toward efficient and effective systems to improve patient safety.

Electronic approaches to making sense of the text in the adverse event reporting system

INTRODUCTION

Health care organizations working to eliminate preventable harm and to improve patient safety must have robust programs to collect and to analyze data on adverse events in order to use the information to affect improvement. Such adverse event reporting systems are based on frontline personnel reporting issues that arise in the course of their daily work. Limitations in how existing software systems handle these reports mean that use of this potentially rich information is resource intensive and prone to variable results.

AIM

The aim of this study was to develop an electronic approach to processing the text in medical event reports that would be reliable enough to be used to improve patient safety.

METHODS

At Connecticut Children's Medical Center, staff manually enter reports of adverse events into a web-based software tool. We evaluated the ability of 2 electronic methods-rule-based query and semi-supervised machine learning-to identify specific types of events ("use cases") versus a reference standard. Rule-based query was tested on 5 use cases and machine learning on a subset of 2 using 9164 events reported from February 2012-January 2014.

RESULTS

Machine learning found 93% of the weight-based errors and 92% of the errors in patient-identification. Rule-based query had accuracy of 99% or greater, high precision, and high recall for all use cases.

CONCLUSIONS

Electronic approaches to streamlining the use of adverse event reports are feasible to automate and valuable for categorizing this important data for use in improving patient safety.

Getting what they need when they need it. Identifying barriers to information needs of family caregivers to manage dementia-related behavioral symptoms

BACKGROUND

Consumer health informatics (CHI) such as web-based applications may provide the platform for enabling the over 15 million family caregivers of patients with Alzheimer's Disease or related dementias the information they need when they need it to support behavioral symptom management. However, for CHI to be successful, it is necessary that it be designed to meet the specific information needs of family caregivers in the context in which caregiving occurs. A sociotechnical systems approach to CHI design can help to understand the contextual complexities of family caregiving and account for those complexities in the design of CHI for family caregivers.

OBJECTIVES

This study used a sociotechnical systems approach to identify barriers to meeting caregivers' information needs related to the management of dementia-related behavioral symptoms, and to derive design implications that overcome barriers for caregiver-focused web-based platforms. We have subsequently used these design implications to inform the development of a web-based platform, WeCareAdvisor,TM which provides caregivers with information and an algorithm by which to identify and manage behavioral symptoms for which they seek management strategies.

METHODS

We conducted 4 focus groups with family caregivers (N=26) in a Midwestern state. Qualitative content analysis of the data was guided by a sociotechnical systems framework.

RESULTS

We identified nine categories of barriers that family caregivers confront in obtaining needed information about behavioral symptom management from which we extrapolated design implications for a web-based platform. Based on interactions within the sociotechnical system, three critical information needs were identified: 1) timely access to information, 2) access to information that is tailored or specific to caregiver's needs and contexts, and 3) usable information that can directly inform how caregivers' manage behaviors.

CONCLUSIONS

The sociotechnical system framework is a useful approach for identifying information needs of family caregivers to inform design of web-based platforms that are user-centered.

Human Factors in Financial Trading: An Analysis of Trading Incidents

OBJECTIVE

This study tests the reliability of a system (FINANS) to collect and analyze incident reports in the financial trading domain and is guided by a human factors taxonomy used to describe error in the trading domain.

BACKGROUND

Research indicates the utility of applying human factors theory to understand error in finance, yet empirical research is lacking. We report on the development of the first system for capturing and analyzing human factors-related issues in operational trading incidents.

METHOD

In the first study, 20 incidents are analyzed by an expert user group against a referent standard to establish the reliability of FINANS. In the second study, 750 incidents are analyzed using distribution, mean, pathway, and associative analysis to describe the data.

RESULTS

Kappa scores indicate that categories within FINANS can be reliably used to identify and extract data on human factors-related problems underlying trading incidents. Approximately 1% of trades (n = 750) lead to an incident. Slip/lapse (61%), situation awareness (51%), and teamwork (40%) were found to be the most common problems underlying incidents. For the most serious incidents, problems in situation awareness and teamwork were most common.

CONCLUSION

We show that (a) experts in the trading domain can reliably and accurately code human factors in incidents, (b) 1% of trades incur error, and (c) poor teamwork skills and situation awareness underpin the most critical incidents.

APPLICATION

This research provides data crucial for ameliorating risk within financial trading organizations, with implications for regulation and policy.

A first step toward understanding patient safety

Patient safety has become an important policy agenda in healthcare systems since publication of the 1999 report entitled "To Err Is Human." The paradigm has changed from blaming the individual for the error to identifying the weakness in the system that led to the adverse events. Anesthesia is one of the first healthcare specialties to adopt techniques and lessons from the aviation industry. The widespread use of simulation programs and the application of human factors engineering to clinical practice are the influences of the aviation industry. Despite holding relatively advanced medical technology and comparable safety records, the Korean health industry has little understanding of the systems approach to patient safety. Because implementation of the existing system and program requires time, dedication, and financial support, the Korean healthcare industry is in urgent need of developing patient safety policies and putting them into practice to improve patient safety before it is too late.

Leveraging user's performance in reporting patient safety events by utilizing text prediction in narrative data entry

BACKGROUND

Narrative data entry pervades computerized health information systems and serves as a key component in collecting patient-related information in electronic health records and patient safety event reporting systems. The quality and efficiency of clinical data entry are critical in arriving at an optimal diagnosis and treatment. The application of text prediction holds potential for enhancing human performance of data entry in reporting patient safety events.

OBJECTIVE

This study examined two functions of text prediction intended for increasing efficiency and data quality of text data entry reporting patient safety events.

METHODS

The study employed a two-group randomized design with 52 nurses. The nurses were randomly assigned into a treatment group or a control group with a task of reporting five patient fall cases in Chinese using a web-based test system, with or without the prediction functions. T-test, Chi-square and linear regression model were applied to evaluating the outcome differences in free-text data entry between the groups.

RESULTS

While both groups of participants exhibited a good capacity for accomplishing the assigned task of reporting patient falls, the results from the treatment group showed an overall increase of 70.5% in text generation rate, an increase of 34.1% in reporting comprehensiveness score and a reduction of 14.5% in the non-adherence of the comment fields. The treatment group also showed an increasing text generation rate over time, whereas no such an effect was observed in the control group.

CONCLUSION

As an attempt investigating the effectiveness of text prediction functions in reporting patient safety events, the study findings proved an effective strategy for assisting reporters in generating complementary free text when reporting a patient safety event. The application of the strategy may be effective in other clinical areas when free text entries are required.

Medication-related cognitive artifacts used by older adults with heart failure

OBJECTIVE

To use a human factors perspective to examine how older adult patients with heart failure use cognitive artifacts for medication management.

METHODS

We performed a secondary analysis of data collected from 30 patients and 14 informal caregivers enrolled in a larger study of heart failure self-care. Data included photographs, observation notes, interviews, video recordings, medical record data, and surveys. These data were analyzed using an iterative content analysis.

RESULTS

Findings revealed that medication management was complex, inseparable from other patient activities, distributed across people, time, and place, and complicated by knowledge gaps. We identified fifteen types of cognitive artifacts including medical devices, pillboxes, medication lists, and electronic personal health records used for: 1) measurement/evaluation; 2) tracking/communication; 3) organization/administration; and 4) information/sensemaking. These artifacts were characterized by fit and misfit with the patient's sociotechnical system and demonstrated both advantages and disadvantages. We found that patients often modified or "finished the design" of existing artifacts and relied on "assemblages" of artifacts, routines, and actors to accomplish their self-care goals.

CONCLUSIONS

Cognitive artifacts are useful but sometimes are poorly designed or are not used optimally. If appropriately designed for usability and acceptance, paper-based and computer-based information technologies can improve medication management for individuals living with chronic illness. These technologies can be designed for use by patients, caregivers, and clinicians; should support collaboration and communication between these individuals; can be coupled with home-based and wearable sensor technology; and must fit their users' needs, limitations, abilities, tasks, routines, and contexts of use.

Surgery and Medicine Residents' Perspectives of Morbidity and Mortality Conference: An Interdisciplinary Approach to Improve ACGME Core Competency Compliance

OBJECTIVE

Morbidity and mortality conferences (MMCs) are often used to fulfill the Accreditation Council for Graduate Medical Education practice-based learning and improvement (PBLI) competency, but there is variation among institutions and disciplines in their approach to MMCs. The objective of this study is to examine the trainees' perspective and experience with MMCs and adverse patient event (APE) reporting across disciplines to help guide the future implementation of an institution-wide, workflow-embedded, quality improvement (QI) program for PBLI.

DESIGN

Between April 1, 2013, and May 8, 2013, surgical and medical residents were given a confidential survey about APE reporting practices and experience with and attitudes toward MMCs and other QI/patient safety initiatives. Descriptive statistics and univariate analyses using the chi-square test for independence were calculated for all variables. Logistic regression and ordered logistic regression were used for nominal and ordinal categorical dependent variables, respectively, to calculate odds of reporting APEs. Qualitative content analysis was used to code free-text responses.

SETTING

A large, multihospital, tertiary academic training program in the Pacific Northwest.

PARTICIPANTS

Residents in all years of training from the Accreditation Council for Graduate Medical Education-accredited programs in surgery and internal medicine.

RESULTS

Survey response rate was 46.2% (126/273). Although most respondents agreed or strongly agreed that knowledge of and involvement in QI/patient safety activities was important to their training (88.1%) and future career (91.3%), only 10.3% regularly or frequently reported APEs to the institution's established electronic incident reporting system. Senior-level residents in both surgery and medicine were more likely to report APEs than more junior-level residents were (odds ratio = 4.8, 95% CI: 3.1-7.5). Surgery residents had a 4.9 (95% CI: 2.3-10.5) times higher odds than medicine residents had to have reported an APE to their MMC or service, and a 2.5 (95% CI: 1.0-6.2) times higher odds to have ever reported an APE through any mechanism. The most commonly cited reason for not reporting APEs was "finding the reporting process cumbersome." Overall, 87% of respondents agreed or strongly agreed that MMCs were valuable, educational, and contributed to improving patient outcomes, but many cited opportunities for improvement.

CONCLUSIONS

Although the perceived value of MMCs is high among both surgical and medicine trainees, there is significant variability across disciplines and level of training in APE reporting and experience with MMCs. This study presents a multidisciplinary resident perspective on optimizing APE reporting, MMCs, and PBLI compliance.

Identifying barriers and benefits of patient safety event reporting toward user-centered design

Background

To learn from errors, electronic patient safety event reporting systems (e-reporting systems) have been widely adopted to collect medical incidents from the frontline practitioners in US hospitals. However, two issues of underreporting and low-quality of reports pervade and thus the system effectiveness remains dubious.

Methods

This study employing semi-structured interviews of health professionals in the Texas Medical Center investigated the perceived benefits and barriers from users who have used e-reporting systems.

Results

As a result, the perceived benefits include the enhanced convenience in data processing and the assistant functions leading to patient safety enhancement. The perceived barriers to the acceptance and quality use of the system include the lack of instructions, lack of reporter-friendly classifications, lack of time, and lack of feedback The identified benefits and barriers help design a user-centered e-reporting system where learning and assistant features are discussed during the interviews.

Conclusions

As a response, the learning and assistant features aiming at enhancing benefits and removing barriers of e-reporting systems should be included for facilitating the acceptance and effective use of the systems.

Motivational mechanisms influencing error reporting among nurses

Purpose

– The purpose of this paper is to explore antecedents, namely reasons for/against error reporting, attitudes, subjective norms, and perceived control, of nurses’ intentions to report their errors at work.

Design/methodology/approach

– A structured equation model with cross-sectional data were estimated to test the hypotheses on a sample of 188 Italian nurses.

Findings

– Reasons for/against error reporting were associated with attitudes, subjective norms and perceived control. Further, reasons against were related to nurses’ intentions to report errors whereas reasons for error reporting were not. Lastly, perceived control was found to partially mediate the effects of reasons against error reporting on nurses’ intentions to act.

Research limitations/implications

– Self-report data were collected at one point in time.

Practical implications

– This study offers recommendations to healthcare managers on what factors may encourage nurses to report their errors.

Social implications

– Lack of error reporting prevents timely interventions. The study contributes to documenting motivations that can persuade or dissuade nurses in this important decision.

Originality/value

– This study extends prior research on error reporting that lacks a strong theoretical foundation by drawing on behavioral reasoning theory.

An analysis of electronic health record-related patient safety concerns

OBJECTIVE

A recent Institute of Medicine report called for attention to safety issues related to electronic health records (EHRs). We analyzed EHR-related safety concerns reported within a large, integrated healthcare system.

METHODS

The Informatics Patient Safety Office of the Veterans Health Administration (VA) maintains a non-punitive, voluntary reporting system to collect and investigate EHR-related safety concerns (ie, adverse events, potential events, and near misses). We analyzed completed investigations using an eight-dimension sociotechnical conceptual model that accounted for both technical and non-technical dimensions of safety. Using the framework analysis approach to qualitative data, we identified emergent and recurring safety concerns common to multiple reports.

RESULTS

We extracted 100 consecutive, unique, closed investigations between August 2009 and May 2013 from 344 reported incidents. Seventy-four involved unsafe technology and 25 involved unsafe use of technology. A majority (70%) involved two or more model dimensions. Most often, non-technical dimensions such as workflow, policies, and personnel interacted in a complex fashion with technical dimensions such as software/hardware, content, and user interface to produce safety concerns. Most (94%) safety concerns related to either unmet data-display needs in the EHR (ie, displayed information available to the end user failed to reduce uncertainty or led to increased potential for patient harm), software upgrades or modifications, data transmission between components of the EHR, or 'hidden dependencies' within the EHR.

DISCUSSION

EHR-related safety concerns involving both unsafe technology and unsafe use of technology persist long after 'go-live' and despite the sophisticated EHR infrastructure represented in our data source. Currently, few healthcare institutions have reporting and analysis capabilities similar to the VA.

CONCLUSIONS

Because EHR-related safety concerns have complex sociotechnical origins, institutions with long-standing as well as recent EHR implementations should build a robust infrastructure to monitor and learn from them.

Human factors and health information technology: current challenges and future directions

OBJECTIVES

Recent federal mandates and incentives have spurred the rapid growth, development and adoption of health information technology (HIT). While providing significant benefits for better data integration, organization, and availability, recent reports have raised questions regarding their potential to cause medication errors, decreased clinician performance, and lowered efficiency. The goal of this survey article is to (a) examine the theoretical and foundational models of human factors and ergonomics (HFE) that are being advocated for achieving patient safety and quality, and their use in the evaluation of healthcare systems; (b) and the potential for macroergonomic HFE approaches within the context of current research in biomedical informatics.

METHODS

We reviewed literature (2007-2013) on the use of HFE approaches in healthcare settings, from databases such as Pubmed, CINAHL, and Cochran.

RESULTS

Based on the review, we discuss the systems-oriented models, their use in the evaluation of HIT, and examples of their use in the evaluation of EHR systems, clinical workflow processes, and medication errors. We also discuss the opportunities for better integrating HFE methods within biomedical informatics research and its potential advantages.

CONCLUSIONS

The use of HFE methods is still in its infancy - better integration of HFE within the design lifecycle, and quality improvement efforts can further the ability of informatics researchers to address the key concerns regarding the complexity in clinical settings and develop HIT solutions that are designed within the social fabric of the considered setting.

Text prediction on structured data entry in healthcare: a two-group randomized usability study measuring the prediction impact on user performance

BACKGROUND

Structured data entry pervades computerized patient safety event reporting systems and serves as a key component in collecting patient-related information in electronic health records. Clinicians would spend more time being with patients and arrive at a high probability of proper diagnosis and treatment, if data entry can be completed efficiently and effectively. Historically it has been proven text prediction holds potential for human performance regarding data entry in a variety of research areas.

OBJECTIVE

This study aimed at examining a function of text prediction proposed for increasing efficiency and data quality in structured data entry.

METHODS

We employed a two-group randomized design with fifty-two nurses in this usability study. Each participant was assigned the task of reporting patient falls by answering multiple choice questions either with or without the text prediction function. t-test statistics and linear regression model were applied to analyzing the results of the two groups.

RESULTS

While both groups of participants exhibited a good capacity of accomplishing the assigned task, the results were an overall 13.0% time reduction and 3.9% increase of response accuracy for the group utilizing the prediction function.

CONCLUSION

As a primary attempt investigating the effectiveness of text prediction in healthcare, study findings validated the necessity of text prediction to structured date entry, and laid the ground for further research improving the effectiveness of text prediction in clinical settings.

We're not there yet

Patient injury due to medical error continues to plague health care delivery. Efforts to eliminate errors or mitigate their effects have largely been thwarted, despite enormous investments of human and financial resources. A survey published in this issue of Otolaryngology-Head and Neck Surgery on the status of medical error in otolaryngology finds that the specialty is not exempt. The authors report that relatively little has changed since the original report by the senior authors published a decade ago. Despite this lack of apparent progress, there is growing awareness that improvements in patient safety will be incremental rather than transformational. The author of this commentary identifies a number of fundamental cultural changes that will be required to achieve transformational change.

Crossing levels in systems ergonomics: a framework to support 'mesoergonomic' inquiry

In this paper we elaborate and articulate the need for what has been termed 'mesoergonomics'. In particular, we argue that the concept has the potential to bridge the gap between, and integrate, established work within the domains of micro- and macroergonomics. Mesoergonomics is defined as an open systems approach to human factors and ergonomics (HFE) theory and research whereby the relationship between variables in at least two different system levels or echelons is studied, and where the dependent variables are human factors and ergonomic constructs. We present a framework which can be used to structure a set of questions for future work and prompt further empirical and conceptual inquiry. The framework consists of four steps: (1) establishing the purpose of the mesoergonomic investigation; (2) selecting human factors and ergonomics variables; (3) selecting a specific type of mesoergonomic investigation; and (4) establishing relationships between system levels. In addition, we describe two case studies which illustrate the workings of the framework and the value of adopting a mesoergonomic perspective within HFE. The paper concludes with a set of issues which could form part of a future agenda for research within systems ergonomics.

Informal learning from error in hospitals: what do we learn, how do we learn and how can informal learning be enhanced? A narrative review

Learning from error is not just an individual endeavour. Organisations also learn from error. Hospitals provide many learning opportunities, which can be formal or informal. Informal learning from error in hospitals has not been researched in much depth so this narrative review focuses on five learning opportunities: morbidity and mortality conferences, incident reporting systems, patient claims and complaints, chart review and prospective risk analysis. For each of them we describe: (1) what can be learnt, categorised according to the seven CanMEDS competencies; (2) how it is possible to learn from them, analysed against a model of informal and incidental learning; and (3) how this learning can be enhanced. All CanMEDS competencies could be enhanced, but there was a particular focus on the roles of medical expert and manager. Informal learning occurred mostly through reflection and action and was often linked to the learning of others. Most important to enhance informal learning from these learning opportunities was the realisation of a climate of collaboration and trust. Possible new directions for future research on informal learning from error in hospitals might focus on ways to measure informal learning and the balance between formal and informal learning. Finally, 12 recommendations about how hospitals could enhance informal learning within their organisation are given.

Macroergonomics in Healthcare Quality and Patient Safety

The US Institute of Medicine and healthcare experts have called for new approaches to manage healthcare quality problems. In this chapter, we focus on macroergonomics, a branch of human factors and ergonomics that is based on the systems approach and considers the organizational and sociotechnical context of work activities and processes. Selected macroergonomic approaches to healthcare quality and patient safety are described such as the SEIPS model of work system and patient safety and the model of healthcare professional performance. Focused reviews on job stress and burnout, workload, interruptions, patient-centered care, health IT and medical devices, violations, and care coordination provide examples of macroergonomics contributions to healthcare quality and patient safety. Healthcare systems and processes clearly need to be systematically redesigned; examples of macroergonomic approaches, principles and methods for healthcare system redesign are described. Further research linking macroergonomics and care processes/patient outcomes is needed. Other needs for macroergonomics research are highlighted, including understanding the link between worker outcomes (e.g., safety and well-being) and patient outcomes (e.g., patient safety), and macroergonomics of patient-centered care and care coordination.

Can incident reporting improve safety? Healthcare practitioners' views of the effectiveness of incident reporting

OBJECTIVE

Recent critiques of incident reporting suggest that its role in managing safety has been over emphasized. The objective of this study was to examine the perceived effectiveness of incident reporting in improving safety in mental health and acute hospital settings by asking staff about their perceptions and experiences.

DESIGN

Qualitative research design using documentary analysis and semi-structured interviews.

SETTING

Two large teaching hospitals in London; one providing acute and the other mental healthcare.

PARTICIPANTS

Sixty-two healthcare practitioners with experience of reporting and analysing incidents.

RESULTS

Incident reporting was perceived as having a positive effect on safety, not only by leading to changes in care processes but also by changing staff attitudes and knowledge. Staff discussed examples of both instrumental and conceptual uses of the knowledge generated by incident reports. There are difficulties in using incident reports to improve safety in healthcare at all stages of the incident reporting process. Differences in the risks encountered and the organizational systems developed in the two hospitals to review reported incidents could be linked to the differences we found in attitudes to incident reporting between the two hospitals.

CONCLUSION

Incident reporting can be a powerful tool for developing and maintaining an awareness of risks in healthcare practice. Using incident reports to improve care is challenging and the study highlighted the complexities involved and the difficulties faced by staff in learning from incident data.

Effect of social influences on pharmacists' intention to report adverse drug events

OBJECTIVES

To identify the groups or individuals that influence pharmacists' decision making to report adverse drug events (ADEs), determine the differences in social influence or subjective norm between intenders and nonintenders, and determine the relationship between subjective norm toward reporting serious ADEs and practice and demographic characteristics.

DESIGN

Nonexperimental cross-sectional study.

SETTING

Texas during June and July 2009.

PARTICIPANTS

1,500 Texas pharmacists.

INTERVENTION

As part of a larger survey, 3 and 18 items were used to assess pharmacists' intentions and subjective norm, respectively, to report serious ADEs to the Food and Drug Administration (FDA).

MAIN OUTCOME MEASURE

Pharmacists' subjective norm toward reporting serious ADEs.

RESULTS

The survey had a response rate of 26.4% (n = 377). Most pharmacists intended to report serious ADEs that they would encounter (15.87 ± 4.22 [mean ± SD], possible range 3-21, neutral = 12). The mean subjective norm scores were moderately high and positive (28.75 ± 9.38, 1-49, 16), indicating that the referents had a moderate influence on pharmacists regarding reporting serious ADEs to FDA. FDA had the greatest (34.82 ± 12.16) and drug manufacturers the lowest (21.55 ± 13.83) social influence. The most important salient referents (important others) in pharmacists' decisions to report serious ADEs were FDA, patients, pharmacy associations, pharmacy managers/bosses, and hospitals and hospital groups. Gender (female equals higher), pharmacists' years of experience (negative correlation), and knowledge of ADE reporting (positive correlation) were associated with subjective norm.

CONCLUSION

Pharmacists had a moderately high subjective norm, suggesting that ADE reporting intentions is influenced by others and that the opinions of others are of great importance in pharmacists' intentions regarding ADE reporting. The main drivers of subjective norm were FDA, patients, pharmacy associations, and managers/bosses.

Improving Pediatric Adverse Drug Event Reporting through Clinical Pharmacy Services

OBJECTIVES

The purpose of this study was to summarize adverse drug event (ADE) reporting and to characterize the type of healthcare practitioners involved in reporting over a 10-year period at a 120-bed university-affiliated children's hospital.

METHODS

The University of Virginia Children's Hospital ADE database was analyzed for records involving pediatric patients. Data from patients <18 years of age who were admitted to the University of Virginia Children's Hospital between January 1, 2000, and December 31, 2009, were analyzed. Data collected included drug name and therapeutic class of the suspected causative agent, description of the event, severity, causality, outcome, and the type of healthcare practitioner reporting the event.

RESULTS

A total of 863 ADEs were reported over the 10-year period. The 5 most common types reported were extravasation injury (10%), rash (8%), hypotension (5%), pruritus (5%), and renal failure (3%). A total of 196 (21%) cases were categorized as mild, 436 (47%) cases as moderate, and 296 (32%) cases as severe. Further characterization of extravasations was performed to identify trends relating to potential causes. In 45 (57%) reports, parenteral nutrition was identified as the causative agent. Full recovery was documented in 21 (47%) extravasations. Of the total events reported, 83% were reported by pharmacists, 16% by nurses, and <1% by other healthcare practitioners.

CONCLUSIONS

Results of this study are consistent with those of previous studies involving ADE reporting in children's hospitals. This consistency is due in part to system design and use of unit-based pharmacists as the primary reporters.

Towards the creation of a flexible classification scheme for voluntarily reported transfusion and laboratory safety events

BACKGROUND

Transfusion and clinical laboratory services are high-volume activities involving complicated workflows across both ambulatory and inpatient environments. As a result, there are many opportunities for safety lapses, leading to patient harm and increased costs. Organizational techniques such as voluntary safety event reporting are commonly used to identify and prioritize risk areas across care settings. Creation of functional, standardized safety data structures that facilitate effective exploratory examination is therefore essential to drive quality improvement interventions. Unfortunately, voluntarily reported adverse event data can often be unstructured or ambiguously defined.

RESULTS

To address this problem, we sought to create a "best-of-breed" patient safety classification for data contained in the Duke University Health System Safety Reporting System (SRS). Our approach was to implement the internationally recognized World Health Organization International Classification for Patient Safety Framework, supplemented with additional data points relevant to our organization. Data selection and integration into the hierarchical framework is discussed, as well as placement of the classification into the SRS. We evaluated the impact of the new SRS classification on system usage through comparisons of monthly average report rates and completion times before and after implementation. Monthly average inpatient transfusion reports decreased from 102.1 ± 14.3 to 91.6 ± 11.2, with the proportion of transfusion reports in our system remaining consistent before and after implementation. Monthly average transfusion report rates in the outpatient and homecare environments were not significantly different. Significant increases in clinical lab report rates were present across inpatient and outpatient environments, with the proportion of lab reports increasing after implementation. Report completion times increased modestly but not significantly from a practical standpoint.

CONCLUSIONS

A common safety vocabulary can facilitate integration of information from disparate systems and processes to permit meaningful measurement and interpretation of data to improve safety within and across organizations. Formation of a "best-of-breed" classification for voluntary reporting necessitates an internal examination of localized data needs and workflow in order to design a product that enables comprehensive data capture. A team of clinical, safety, and information technology experts is necessary to integrate the data structures into the reporting system. We have found that a "best-of-breed" patient safety classification provides a solid, extensible model for adverse event analysis, healthcare leader communication, and intervention identification.

Why simulation-based team training has not been used effectively and what can be done about it

Advanced medical education simulators are broadly used today to train both technical/procedural and team-based skills. While there is convincing evidence of the benefits of training technical skills, this is not the case for team-based skills. Research on medical expertise could drive the creation of a new regime of simulation-based team training. The new regime includes first the understanding of complex systems such as the hospital and the operating room; then the performance of work-place assessment; thirdly, the deliberate training of weaknesses and team performance skills; and lastly the understanding of the underlying mechanisms of team competence. A new regime of deliberate training proposed by the author, which would need to be evaluated and validated, could elucidate the underlying mechanisms of team competence while providing evidence of the effect of simulation-based team training.

Physician reporting of clinically significant events through a computerized patient sign-out system

OBJECTIVES

: Although electronic reporting systems for near-misses and adverse events have been implemented nationwide, physician participation in such systems has typically been very limited. Previous efforts to improve such rates have met with some success but may be costly and time-consuming. To improve events reporting rates at our academic medical center, we incorporated a physician reporting module into the computer software that house officers already use for their daily sign-out routine.

METHODS

: During the period between January 1 and June 30, 2009, house staff were asked to report a set of 13 predefined "clinically significant events" such as cardiopulmonary arrests and unexpected transfers to the intensive care unit. Entries were maintained in an administrative data collection module and were reviewed daily by the residency program director and chief residents.

RESULTS

: House staff reported approximately 12 incidents per month. A survey of the intern class (the heaviest users of system) showed that the principal barriers to physician reporting at our facility were related to ease of use, time pressure, and fear of disciplinary actions. Information gleaned from the reports has been useful in modifying a number of patient care processes on the medicine service.

CONCLUSIONS

: Our experience suggests that if a training program makes it easy for the house officer to report events during routine work duties, by integrating the reporting system into the tools of daily patient care, physicians will become willing participants in the process. A handheld version of such a reporting system holds promise for even greater physician participation in the future.

That's nice, but what does IT do? Evaluating the impact of bar coded medication administration by measuring changes in the process of care

Health information technology (IT) is widely endorsed as a way to improve key health care outcomes, particularly patient safety. Applying a human factors approach, this paper models more explicitly how health IT might improve or worsen outcomes. The human factors model specifies that health IT transforms the work system, which transforms the process of care, which in turn transforms the outcome of care. This study reports on transformations of the medication administration process that resulted from the implementation of one type of IT: bar coded medication administration (BCMA). Registered nurses at two large pediatric hospitals in the US participated in a survey administered before and after one of the hospitals implemented BCMA. Nurses' perceptions of the administration process changed at the hospital that implemented BCMA, whereas perceptions of nurses at the control hospital did not. BCMA appeared to improve the safety of the processes of matching medications to the medication administration record and checking patient identification. The accuracy, usefulness, and consistency of checking patient identification improved as well. In contrast, nurses' perceptions of the usefulness, time efficiency, and ease of the documentation process decreased post-BCMA. Discussion of survey findings is supplemented by observations and interviews at the hospital that implemented BCMA. By considering the way that IT transforms the work system and the work process a practitioner can better predict the kind of outcomes that the IT might produce. More importantly, the practitioner can achieve or prevent outcomes of interest by using design and redesign aimed at controlling work system and process transformations.

Tailoring "best-of-breed" safety classification for patient fall voluntary reporting

OBJECTIVE

Voluntary safety event reporting often produces poorly defined data points, which complicate data analyses across health care settings. Such data should be restructured into a standard patient safety language translatable within and outside health care organizations. We designed and implemented a "best-of-breed" patient safety classification for data created by the Duke University Health System Safety Reporting System.

METHODS

We report our approach for patient fall classification. Our strategy was to deploy the International Classification for Patient Safety Framework of the World Health Organization augmented with additional data points of interest, thereby allowing for data translatability while maintaining local practices. System interface redesign using the "best-of-breed" fall classification was mindful of workflows and known reporting barriers. Custom aggregate reports were also developed.

RESULTS

We estimated the impact of the redesigned portal on Safety Reporting System usage before and after classification through comparisons of fall report volume and report completion time. When normalized as falls per day, the rate of falls only changed slightly, indicating that the enhancement had little effect on reporting desire. Report completion time increased modestly but not significantly from a practical standpoint. The presence of structured data eliminated substantial hours dedicated to manual data management and enabled evaluation of quality improvement interventions within and outside our organization.

CONCLUSIONS

Creation and implementation of a "best-of-breed" patient safety classification for voluntary reporting requires multidisciplinary collaboration between clinical experts, frontline clinicians, and functional and technical analysts. Formal usability evaluations of reporting systems are needed to ensure design facilitates effective data collection.

Barriers and motivating factors in reporting incidents of assault in mental health care

BACKGROUND

There is a high incidence of assault against nursing staff in mental health care. Efforts to reduce the incidence of assault are hindered by the complexity and nature of the problem and by the fact that incidents of assault are underreported.

OBJECTIVE

To identify factors influencing nurses to report staff assault by patients in an inpatient mental health care facility.

DESIGN

The study used a modified nominal group technique in which nurses worked together to identify themes in decisions about reporting incidents of assault. The participants were nurses at two sites of a mental health care organization.

RESULTS

Nurses used a complex decision-making process to decide whether an incident of assault was worth reporting. Safety culture, the design of the incident reporting system, and the effect on patients were important components of the decision-making process.

CONCLUSION

Strategies that consider all levels of the organization's system should be used to improve reporting of assault incidents.

Macroergonomics and patient safety: the impact of levels on theory, measurement, analysis and intervention in patient safety research

The study and practice of patient safety has seen a surge over the last 10 years. New resident training and staffing policies, health information technologies, error reporting systems, team models of care, training methods, patient involvement, information handoff strategies, just cultures, and many other interventions have been mandated or attempted to improve the safety of patient care. While some of these interventions focus on individual providers and others focus on organization-level changes, little, if any, patient safety research has purposefully sought to understand how variables at different levels, such as the provider level or organization level, interact to impact patient safety outcomes such as errors, adverse drug events, or patient harm. Looking at relationships across levels is important because adverse events might be related to variables at different levels; consider that adverse events may be nested within patients, patients nested within nurses and physicians, nurses and physicians nested within shifts, shifts nested within hospital units, and so forth. Because these nested levels exist, they may exert as yet untested influence on the levels below. In this paper the impact of levels on theory, measurement, analysis and intervention in patient safety research is discussed.

Medical error and decision making: Learning from the past and present in intensive care

BACKGROUND

Human error occurs in every occupation. Medical errors may result in a near miss or an actual injury to a patient that has nothing to do with the underlying medical condition. Intensive care has one of the highest incidences of medical error and patient injury in any specialty medical area; thought to be related to the rapidly changing patient status and complex diagnoses and treatments.

PURPOSE

The aims of this paper are to: (1) outline the definition, classifications and aetiology of medical error; (2) summarise key findings from the literature with a specific focus on errors arising from intensive care areas; and (3) conclude with an outline of approaches for analysing clinical information to determine adverse events and inform practice change in intensive care.

DATA SOURCE

Database searches of articles and textbooks using keywords: medical error, patient safety, decision making and intensive care. Sociology and psychology literature cited therein.

FINDINGS

Critically ill patients require numerous medications, multiple infusions and procedures. Although medical errors are often detected by clinicians at the bedside, organisational processes and systems may contribute to the problem. A systems approach is thought to provide greater insight into the contributory factors and potential solutions to avoid preventable adverse events.

CONCLUSION

It is recommended that a variety of clinical information and research techniques are used as a priority to prevent hospital acquired injuries and address patient safety concerns in intensive care.