Understanding Unintended Consequences and Health Information Technology:. Contribution from the IMIA Organizational and Social Issues Working Group

One Health: Insights from Organizational & Social, Technology Assessment and Human Factors Perspectives

OBJECTIVES

To offer diverse but complementary perspectives on how biomedical and health informatics can be informed by and help to achieve the vision of One Health.

METHODS

Overview of key considerations and critical discussion of common themes, barriers and opportunities, based on collaborative review by International Medical Informatics Association (IMIA) working group members active in related fields.

RESULTS

Health and care systems are complex sociotechnical systems that need explicit design and implementation strategies to align with the goals of One Health. The evidence-based health informatics paradigm and associated frameworks for evaluation of digital health technologies need to broaden their scope to take full account of the One Health approach. Informatics has specific contributions to make to One Health, for example by improved user experience reducing energy consumption and effective app design enhancing medication adherence.

CONCLUSIONS

One Health is inherently intertwined with ergonomic, sociotechnical and evaluation perspectives in biomedical and health informatics. Health is a planetary issue that requires interdisciplinary collaborative action. The theories and principles of biomedical and health informatics offer many opportunities to transform digital health technology to better serve the One Health agenda.

Implementation of Assistive Technologies and Robotics in Long-Term Care Facilities: A Three-Stage Assessment Based on Acceptance, Ethics, and Emotions

Assistive technologies including assistive robots (AT/AR) appear to be a promising response to the increasing prevalence of older adults in need of care. An increasing number of long-term care facilities (LTCFs) try to implement AT/AR in order to create a stimulating environment for aging well and to reduce workload for professional care staff. The implementation of new technologies in an organization may lead to noticeable cultural changes in terms of social interactions and care practices associated with positive or negative emotions for the employees. This applies especially for LTCFs with high rates of vulnerable residents affected by increasing care needs and specific ethics in nursing and cultural rules within the setting. Thus, systematic consideration in leadership management of emotions and ethical aspects is essential for stakeholders involved in the implementation process. In this article, we explicitly focus on the emotions of the employees and leaders within LTCFs. We relate to direct consequences for the organizational well-being and culture, which is of course (indirectly) affecting patients and residents. While aspects of technology acceptance such as safety and usefulness are frequently discussed in academic literature, the topic of emotion-management and ethical questions during the organizational implementation process in LTCFs received little attention. Emotional culture entails affective values, ethical norms and perceptions of employees and further investigation is needed to address the importance of transformational leadership during implementation process. For this purpose, we developed a three-staged assessment tool for implementation of AT/AR in long-term care institutions. Acceptance (A), ethical acceptability (A) and emotional consequences (E) are considered as comprehensive assessment, in which emotional consequences comprise management aspects of transformational leadership (T), emotion-management (E) and organizational culture (O). Based on AAE and TEO, this paper presents an integrated framework illustrated with a illustrative example and aims to combine established approaches with ethical insights in order to unfold potentials of AT/AR in LTCSs.

Classification of Electronic Health Record-Related Patient Safety Incidents: Development and Validation Study

Background

It is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and interpretation of technology-induced errors.

Objective

This study aims to develop a classification for patient safety incident reporting associated with the use of mature electronic health records (EHRs). It also aims to validate the classification by using a data set of incidents during a 6-month period immediately after the implementation of a new EHR system.

Methods

The starting point of the classification development was the Finnish Technology-Induced Error Risk Assessment Scale tool, based on research on commonly recognized error types. A multiprofessional research team used iterative tests on consensus building to develop a classification system. The final classification, with preliminary descriptions of classes, was validated by applying it to analyze EHR-related error incidents (n=428) during the implementation phase of a new EHR system and also to evaluate this classification’s characteristics and applicability for reporting incidents. Interrater agreement was applied.

Results

The number of EHR-related patient safety incidents during the implementation period (n=501) was five-fold when compared with the preimplementation period (n=82). The literature identified new error types that were added to the emerging classification. Error types were adapted iteratively after several test rounds to develop a classification for reporting patient safety incidents in the clinical use of a high-maturity EHR system. Of the 427 classified patient safety incidents, interface problems accounted for 96 (22.5%) incident reports, usability problems for 73 (17.1%), documentation problems for 60 (14.1%), and clinical workflow problems for 33 (7.7%). Altogether, 20.8% (89/427) of reports were related to medication section problems, and downtime problems were rare (n=8). During the classification work, 14.8% (74/501) of reports of the original sample were rejected because of insufficient information, even though the reports were deemed to be related to EHRs. The interrater agreement during the blinded review was 97.7%.

Conclusions

This study presents a new classification for EHR-related patient safety incidents applicable to mature EHRs. The number of EHR-related patient safety incidents during the implementation period may reflect patient safety challenges during the implementation of a new type of high-maturity EHR system. The results indicate that the types of errors previously identified in the literature change with the EHR development cycle.

Telehealth and the COVID-19 Pandemic: International Perspectives and a Health Systems Framework for Telehealth Implementation to Support Critical Response

OBJECTIVES

Telehealth implementation is a complex systems-based endeavour. This paper compares telehealth responses to (COrona VIrus Disease 2019) COVID-19 across ten countries to identify lessons learned about the complexity of telehealth during critical response such as in response to a global pandemic. Our overall objective is to develop a health systems-based framework for telehealth implementation to support critical response.

METHODS

We sought responses from the members of the International Medical Informatics Association (IMIA) Telehealth Working Group (WG) on their practices and perception of telehealth practices during the times of COVID-19 pandemic in their respective countries. We then analysed their responses to identify six emerging themes that we mapped to the World Health Organization (WHO) model of health systems.

RESULTS

Our analysis identified six emergent themes. (1) Government, legal or regulatory aspects of telehealth; (2) Increase in telehealth capacity and delivery; (3) Regulated and unregulated telehealth; (4) Changes in the uptake and perception of telemedicine; (5) Public engagement in telehealth responses to COVID-19; and (6) Implications for training and education. We discuss these themes and then use them to develop a systems framework for telehealth support in critical response.

CONCLUSION

COVID-19 has introduced new challenges for telehealth support in times of critical response. Our themes and systems framework extend the WHO systems model and highlight that telemedicine usage in response to the COVID-19 pandemic is complex and multidimensional. Our systems-based framework provides guidance for telehealth implementation as part of health systems response to a global pandemic such as COVID-19.

Ethics in Telehealth: Comparison between Guidelines and Practice-based Experience -the Case for Learning Health Systems

OBJECTIVES

To understand ethical issues within the tele-health domain, specifically how well established macro level telehealth guidelines map with micro level practitioner perspectives.

METHODS

We developed four overarching issues to use as a starting point for developing an ethical framework for telehealth. We then reviewed telemedicine ethics guidelines elaborated by the American Medical Association (AMA), the World Medical Association (WMA), and the telehealth component of the Health Professions council of South Africa (HPCSA). We then compared these guidelines with practitioner perspectives to identify the similarities and differences between them. Finally, we generated suggestions to bridge the gap between ethics guidelines and the micro level use of telehealth.

RESULTS

Clear differences emerged between the ethics guidelines and the practitioner perspectives. The main reason for the differences were the different contexts where telehealth was used, for example, variability in international practice and variations in the complexity of patient-provider interactions. Overall, published guidelines largely focus on macro level issues related to technology and maintaining data security in patient-provider interactions while practitioner concern is focused on applying the guidelines to specific micro level contexts.

CONCLUSIONS

Ethics guidelines on telehealth have a macro level focus in contrast to the micro level needs of practitioners. Work is needed to close this gap. We recommend that both telehealth practitioners and ethics guideline developers better understand healthcare systems and adopt a learning health system approach that draws upon different contexts of clinical practice, innovative models of care delivery, emergent data and evidence-based outcomes. This would help develop a clearer set of priorities and guidelines for the ethical conduct of telehealth.

Organizational diagnostics: a systematic approach to identifying technology and workflow issues in clinical settings

Objectives

Healthcare organizations need to rapidly adapt to new technology, policy changes, evolving payment strategies, and other environmental changes. We report on the development and application of a structured methodology to support technology and process improvement in healthcare organizations, Systematic Iterative Organizational Diagnostics (SIOD). SIOD was designed to evaluate clinical work practices, diagnose technology and workflow issues, and recommend potential solutions.

Materials and Methods

SIOD consists of five stages: (1) Background Scan, (2) Engagement Building, (3) Data Acquisition, (4) Data Analysis, and (5) Reporting and Debriefing. Our team applied the SIOD approach in two ambulatory clinics and an integrated ambulatory care center and used SIOD components during an evaluation of a large-scale health information technology transition.

Results

During the initial SIOD application in two ambulatory clinics, five major analysis themes were identified, grounded in the data: putting patients first, reducing the chaos, matching space to function, technology making work harder, and staffing is more than numbers. Additional themes were identified based on SIOD application to a multidisciplinary clinical center. The team also developed contextually grounded recommendations to address issues identified through applying SIOD.

Discussion

The SIOD methodology fills a problem identification gap in existing process improvement systems through an emphasis on issue discovery, holistic clinic functionality, and inclusion of diverse perspectives. SIOD can diagnose issues where approaches as Lean, Six Sigma, and other organizational interventions can be applied.

Conclusion

The complex structure of work and technology in healthcare requires specialized diagnostic strategies to identify and resolve issues, and SIOD fills this need.

Perceptions of allied health staff of the implementation of an integrated electronic medical record across regional and metropolitan settings

ObjectiveThe aim of this study was to investigate the perceptions of allied health professionals (AHPs) to implementation of an integrated electronic medical record (EMR) across both regional and metropolitan settings. MethodsThe study was conducted as a cross-sectional electronic survey. AHPs working at three hospital sites within Queensland Health were sent an electronic survey link. Participation was voluntary and recruitment via a snowball sampling technique was encouraged. Responses were analysed descriptively. ResultsIn all, 104 responders completed the survey. Responders were distributed across three sites within the selected health service, with most (75%; n=78) being at the largest site. Physiotherapy accounted for the largest number of responders (22%). Most responders were female (87%; n=90) and between 20 and 40 years of age (68%; n=71). On a scale from 0 (being anxious) to 100 (being excited), at the time EMR implementation was announced, there was a trend towards excitement (mean score 59). The most commonly reported factor hindering EMR implementation was the opportunity to practice with EMR (34%), whereas clinical ‘change champions’ were reported as the most common facilitators (61%). Overall, 60% of responders were very satisfied or satisfied with the EMR, but limited effects on efficiency and patient care were reported. ConclusionsThe results suggest an overall positive response to EMR implementation. Minimal staff reported effects such as stress or anxiety in the workplace related to EMR implementation, and a perception of ‘comfort’ was cited once EMR was part of usual practice. However, responders did not report a significant effect on speed, efficiency or quality of patient care following EMR implementation. What is known about the topic?A growing body of literature exists regarding the perceptions of staff (particularly medical officers) in moving towards EMRs, but there is limited evidence regarding the perceptions of AHPs, and the barriers and facilitators to this change. What does this paper add?This paper presents a novel perspective regarding the perceptions of AHPs regarding the implementation of an EMR and provides a perspective of the barriers and facilitators that supported a smooth transition at three sites. What are the implications for practitioners?Despite being a large-scale service change, the introduction of an EMR did not significantly increase AHPs’ subjective feelings of anxiety. Services considering EMR implementation should invest in the provision of timely information, ‘at-elbow’ support and opportunities to practice the new system.

Effects of eHealth on hospital practice: synthesis of the current literature

Objective The transition to digital hospitals is fast-moving. Although US hospitals are further ahead than some others in implementing eHealth technologies, their early experiences are not necessarily generalisable to contemporary healthcare because both the systems and technologies have been rapidly evolving. It is important to provide up-to-date assessments of the evidence available. The aim of this paper is to provide an assessment of the current literature on the effects to be expected from hospital implementations of eHealth technologies. Methods A narrative review was conducted of systematic reviews investigating the effects of eHealth technologies (clinical decision support systems (CDSS), computerised provider order entry (CPOE), ePrescribing, electronic medical records (EMRs)) published between November 2015 and August 2017 and compared the findings with those of a previous narrative review that examined studies published between January 2010 and October 2015. The same search strategy and selection criteria were used in both studies. Results Of the seven relevant articles, three (42.9%) examined the effects of more than one eHealth system: only two (28.6%) studies were high quality, three (42.9%) were of intermediate quality and two (28.6%) were of low quality. We identified that EMRs are largely associated with conflicting findings. Previous reviews suggested that CPOE are associated with significant positive results of cost savings, organisational efficiency gains, less resource utilisation and improved individual performance. However, these effects were not investigated in the more recent reviews, and only mixed findings for communication between clinicians were reported. Similarly, for ePrescribing, later reviews reported limited evidence of benefits, although when coupled with CDSS, more consistent positive findings were reported. Conclusion This overview can help inform other hospitals in Australia and elsewhere of the likely effects resulting from eHealth technologies. The findings suggest that the effects of these systems are largely mixed, but there are positive findings, which encourage ongoing digital transformation of hospital practice. What is known about the topic? Governments are increasingly devoting substantial resources towards implementing eHealth technologies in hospital practice with the goals of improving clinical and financial outcomes. Yet, these outcomes are yet to be fully realised in practice and conflicting findings are often reported in the literature. What does this paper add? This paper extends a previous narrative review of systematic reviews and categorises the effects of eHealth technologies into a typology of outcomes to enable overall findings to be reported and comparisons to be made. In doings so, we synthesise 7 years of eHealth effects. Mixed results are largely reported for EMRs, with many benefits being compromised by practices stemming from resistance to EMRs. Limited evidence of effectiveness exists for CPOE and ePrescribing. CDSS are associated with the most consistent positive findings for clinician- and hospital-level effects. We observed renewed interest in the literature for the effect of eHealth technologies on communication both between clinicians and with patients. Other new insights have emerged relating to effects on clinical judgement, changing practice and staff retention. What are the implications for practitioners? eHealth technologies have the potential to positively affect clinical and financial outcomes. However, these benefits are not guaranteed, and mixed results are often reported. This highlights the need for hospitals and decision makers to clearly identify and act on the drivers of successful implementations if eHealth technologies are to facilitate the creation of new, more effective models of patient care in an increasingly complex healthcare environment.

Role of Artificial Intelligence within the Telehealth Domain

Objectives : This paper provides a discussion about the potential scope of applicability of Artificial Intelligence methods within the telehealth domain. These methods are focussed on clinical needs and provide some insight to current directions, based on reports of recent advances.

Methods : Examples of telehealth innovations involving Artificial Intelligence to support or supplement remote health care delivery were identified from recent literature by the authors, on the basis of expert knowledge. Observations from the examples were synthesized to yield an overview of contemporary directions for the perceived role of Artificial Intelligence in telehealth.

Results : Two major focus areas for related contemporary directions were established. These were first, quality improvement for existing clinical practice and service delivery, and second, the development and support of new models of care. Case studies from each focus area have been chosen for illustration purposes.

Conclusion : Examples of the role of Artificial Intelligence in delivery of health care remotely include use of tele-assessment, tele-diagnosis, tele-interactions, and tele-monitoring. Further developments of underlying algorithms and validation of methods will be required for wider adoption. Certain key social and ethical considerations also need consideration more generally in the health system, as Artificial-Intelligence-enabled-telehealth becomes more commonplace.