Benchmarking health IT among OECD countries: better data for better policy

End-users' perspectives on factors affecting implementation and utilization of the Iranian electronic health record system: a qualitative study in a developing country

BACKGROUND

As one of the most important information technologies for storing, managing, and exchanging health information, the electronic health record (EHR) plays a major role in the health system. However, these systems in developing countries have been associated with multidimensional issues. The purpose of the present study was the assessment of nonclinical end-users' points of view on the implementation and utilization of the Iranian electronic health record system.

METHODS

This was a large qualitative study conducted in 2021 for 7 months from February to August. In this study, data were collected through in-depth semi-structured interviews with 70 non-clinical end-users in 22 public and six private hospitals of West Azerbaijan province in Iran. To analyze the data, the thematic analysis method was used.

RESULTS

The study results indicated that technical, human, cultural, managerial, and financial readiness are the most important factors affecting the implementation of EHRs in Iran. Among the mentioned factors, technical and human readiness were emphasized more by the users. Also, technical, organizational, human, and managerial factors were identified as factors influencing EHRs utilization, and technical and organizational factors had a stronger role in the system utilization.

CONCLUSIONS

According to the results, several factors influence EHR implementation and adequate utilization in Iran. To achieve the predetermined goals of this system, implementation issues and problems of using the system should be considered and solved.

Barriers and Facilitators to the Acceptance of eHealth Interventions by Dutch Pediatric Physical Therapists in Times of the COVID-19 Pandemic: A Mixed-Methods Approach

BACKGROUND

The COVID-19 pandemic created an urgent need for eHealth as the relevance of infection control and social distancing continues. Evidence describing the acceptability of implementing eHealth into pediatric physical therapy services is limited.

PURPOSE

To investigate the determinants of eHealth acceptance by Dutch pediatric physical therapists during the COVID-19 pandemic.

METHODS

A mixed-methods approach was used. It included a quantitative exploratory questionnaire of 154 pediatric physical therapists and qualitative in-depth interviews of 16 pediatric physical therapists.

RESULTS

The eHealth interventions were beneficial for collaboration between health care professionals and in addition to face-to-face therapy. eHealth interventions were, however, found to be unsuitable especially in the diagnostic phase. Barriers to more extensive application include costs, technical difficulties, and a perceived negative attitude of children.

CONCLUSION

Pediatric physical therapists used eHealth interventions extensively in times of the COVID-19 pandemic. However, the acceptance of eHealth interventions is dependent on the pediatric physical therapist's perception of usefulness in private practice, rehabilitation setting, or clinical hospital.

Evaluation of a Health Information Exchange System for Geriatric Health Care in Rural Areas: Development and Technical Acceptance Study

Background

Patients of geriatrics are often treated by several health care providers at the same time. The spatial, informational, and organizational separation of these health care providers can hinder the effective treatment of these patients.

Objective

This study aimed to develop a regional health information exchange (HIE) system to improve HIE in geriatric treatment. This study also evaluated the usability of the regional HIE system and sought to identify barriers to and facilitators of its implementation.

Methods

The development of the regional HIE system followed the community-based participatory research approach. The primary outcomes were the usability of the regional HIE system, expected implementation barriers and facilitators, and the quality of the developmental process. Data were collected and analyzed using a mixed methods approach.

Results

A total of 3 focus regions were identified, 22 geriatric health care providers participated in the development of the regional HIE system, and 11 workshops were conducted between October 2019 and September 2020. In total, 12 participants responded to a questionnaire. The main results were that the regional HIE system should support the exchange of assessments, diagnoses, medication, assistive device supply, and social information. The regional HIE system was expected to be able to improve the quality and continuity of care. In total, 5 adoption facilitators were identified. The main points were adaptability of the regional HIE system to local needs, availability to different patient groups and treatment documents, web-based design, trust among the users, and computer literacy. A total of 13 barriers to adoption were identified. The main expected barriers to implementation were lack of resources, interoperability issues, computer illiteracy, lack of trust, privacy concerns, and ease-of-use issues.

Conclusions

Participating health care professionals shared similar motivations for developing the regional HIE system, including improved quality of care, reduction of unnecessary examinations, and more effective health care provision. An overly complicated registration process for health care professionals and the patients’ free choice of their health care providers hinder the effectiveness of the regional HIE system, resulting in incomplete patient health information. However, the web-based design of the system bridges interoperability problems that exist owing to the different technical and organizational structures of the health care facilities involved. The regional HIE system is better accepted by health care professionals who are already engaged in an interdisciplinary, geriatric-focused network. This might indicate that pre-existing cross-organizational structures and processes are prerequisites for using HIE systems. The participatory design supports the development of technologies that are adaptable to regional needs. Health care providers are interested in participating in the development of an HIE system, but they often lack the required time, knowledge, and resources.

Transforming Health Data to Actionable Information: Recent Progress and Future Opportunities in Health Information Exchange

OBJECTIVES

Provide a systematic review of literature pertaining to health information exchange (HIE) since 2018. Summarize HIE-associated literature for most frequently occurring topics, as well as within the context of the COVID-19 pandemic and health equity. Finally, provide recommendations for how HIE can advance the vision of a digital healthcare ecosystem.

METHODS

A computer program was developed to mediate a literature search of primary literature indexed in MEDLINE that was: (1) indexed with "Health Information Exchange" MeSH descriptor as a major topic; and (2) published between January 2018 and December 2021. Frequency of MeSH descriptors was then used to identify and to rank topics associated with the retrieved literature. COVID-19 literature was identified using the general COVID-19 PubMed Clinical Query filter. Health equity literature was identified using additional MeSH descriptor-based searches. The retrieved literature was then reviewed and summarized.

RESULTS

A total of 256 articles were retrieved and reviewed for this survey. The major thematic areas summarized were: (1) Information Dissemination; (2) Delivery of Health Care; (3) Hospitals; (4) Hospital Emergency Service; (5) COVID-19; (6) Health Disparities; and (7) Computer Security and Confidentiality. A common theme across all areas examined for this survey was the maturity of HIE to support data-driven healthcare delivery. Recommendations were developed based on opportunities identified across the reviewed literature.

CONCLUSIONS

HIE is an essential advance in next generation healthcare delivery. The review of the recent literature (2018-2021) indicates that successful HIE improves healthcare delivery, often resulting in improved health outcomes. There remain major opportunities for expanded use of HIE, including the active engagement of clinical and patient stakeholders. The maturity of HIE reflects the maturity of the biomedical informatics and health data science fields.

Readiness for Health Information Technology is Associated to Information Security in Healthcare Institutions

BACKGROUND

Health information technologies (HITs) present numerous opportunities for the improvement and transformation of healthcare, which include reducing human errors, improving clinical outcomes, facilitating care coordination, improving efficiency of practice and tracking data over time. HITs involve various technologies that range from simple charting, to a more advanced decision support and integration with medical technology.

OBJECTIVE

The aims of this study were to examine the readiness for the implementation of health information technologies (HITs) among medical and administrative staff as well as to evaluate the effects of information security status on the readiness.

METHODS

In this cross-sectional study, 236 medical employees (F/M: 192/44; mean age: 34±7.43 years) and 139 administrative employees (F/M: 93/46, mean age: 36±7.64 years) from 15 public health institutions in Kocaeli, Marmara Region were included. The data were collected via a structured questionnaire regarding opinions about information security and privacy, use of information technologies and the Organizational Information Technology Innovation Readiness Scale (OITIRS). After an explanatory factor analysis was performed for the scale, two subgroups regarding Organizational Readiness and Technological Readiness were obtained. Binary logistic regression analyses were performed to evaluate related factors for these subgroups of OITIRS.

RESULTS

According to binary logistic regression analysis, establishing of a password management system was found to be a crucial factor for both organizational and technological readiness among medical and administrative employees in health institutions (p<0.05). The enhancement of collaboration among staff by implementing information technologies was a critical factor for the medical staff; whereas, the attitude of employees to ensure information security was an important factor for the administrative employees in both subgroups (p<0.05).

CONCLUSION

Both medical and administrative unit employees stated that establishing a password management system that determines the frequency of changing passwords in the organization would affect both organizational and technical readiness in healthcare institutions.

National monitoring and evaluation of eHealth: a scoping review

OBJECTIVE

There has been substantial growth in eHealth over the past decade, driven by expectations of improved healthcare system performance. Despite substantial eHealth investment, little is known about the monitoring and evaluation strategies for gauging progress in eHealth availability and use. This scoping review aims to map the existing literature and depict the predominant approaches and methodological recommendations to national and regional monitoring and evaluation of eHealth availability and use, to advance national strategies for monitoring and evaluating eHealth.

METHODS

Peer-reviewed and grey literature on monitoring and evaluation of eHealth availability and use published between January 1, 2009, and March 11, 2019, were eligible for inclusion. A total of 2354 publications were identified and 36 publications were included after full-text review. Data on publication type (eg, empirical research), country, level (national or regional), publication year, method (eg, survey), and domain (eg, provider-centric electronic record) were charted.

RESULTS

The majority of publications monitored availability alone or applied a combination of availability and use measures. Surveys were the most common data collection method (used in 86% of the publications). Organization for Economic Co-operation and Development (OECD), European Commission, Canada Health Infoway, and World Health Organization (WHO) have developed comprehensive eHealth monitoring and evaluation methodology recommendations.

DISCUSSION

Establishing continuous national eHealth monitoring and evaluation, based on international approaches and recommendations, could improve the ability for cross-country benchmarking and learning. This scoping review provides an overview of the predominant approaches to and recommendations for national and regional monitoring and evaluation of eHealth. It thereby provides a starting point for developing national eHealth monitoring strategies.

An International Perspective on Health Information Exchange: Adoption in OECD Countries With Different Health Care System Configurations

The sharing of information among various care providers is becoming an essential feature of health care systems, and many countries are now adopting policies to foster health information exchange, defined as the electronic transfer of data or information among health care organizations involved in the delivery of care. Given the increasing adoption of this type of policy in several Organization for Economic Cooperation and Development countries, it is important to compare experiences from different countries, because policy adoption in one country can be explained more comprehensively and coherently through comparison with similar policies adopted in other nations. To make a more meaningful cross-country comparison, this article identifies a taxonomy of health systems, and it analyzes institutional and resource-based factors related to health information exchange adoption and how they differ in three main types of health systems: the National Health Service, social health insurance, and private health insurance.

Developing the National Usability-Focused Health Information System Scale for Physicians: Validation Study

BACKGROUND

Problems in the usability of health information systems (HISs) are well acknowledged, but research still lacks a validated questionnaire for measuring and monitoring different dimensions of usability of HISs. Such questionnaires are needed not only for research but also for developing usability of HISs from the viewpoint of end-user experiences.

OBJECTIVE

This study aimed to develop and test the validity of the questionnaire measuring the National Usability-Focused HIS-Scale (NuHISS) among a nationally representative sample of Finnish physicians.

METHODS

We utilized 2 cross-sectional data collected from a random sample of Finnish physicians in 2014 (N=3781; of which 2340 [61.9%] were women) and 2017 (N=4018; of which 2604 [64.8%] were women). Exploratory and confirmatory factor analyses (structural equation modeling [SEM]) were applied to test the structural validity of the NuHISS. As the concurrent validity measure, we used the self-reported overall quality of the electronic health record system (school grade) provided by the participants using marginal structural models.

RESULTS

The exploratory factor analyses with Varimax rotation suggested that the 7-factor solution did offer a good fit to the data in both samples (C²=2136.14 in 2014 and C²=2109.83 in 2017, both P<.001). Moreover, structural equation modelling analyses, using comparative fit index (CFI), Tucker-Lewis Index (TLI), Normed Fit Index (NFI), root mean squared error of approximation (RMSEA), and Standardized Root Mean square Residual (SRMR), showed that the 7-factor solution provided an acceptable fit in both samples (CFI=0.92/0.91, TLI=0.92/0.91, NFI=0.92/0.91, RMSEA=0.048/0.049, and SRMR=0.040/0.039). In addition, concurrent validity of this solution was shown to be acceptable. Ease of use, but also all other dimensions, was especially associated with overall quality reports independent of measured confounders. The 7-factor solution included dimensions of technical quality, information quality, feedback, ease of use, benefits, internal collaboration, and cross-organizational collaboration.

CONCLUSIONS

NuHISS provides a useful tool for measuring usability of HISs among physicians and offers a valid measure for monitoring the long-term development of HISs on a large scale. The relative importance of items needs to be assessed against national electronic health policy goals and complemented with items that have remained outside the NuHISS from the questionnaire when appropriate.

Artificial Intelligence in Clinical Decision Support: Challenges for Evaluating AI and Practical Implications

OBJECTIVES

This paper draws attention to: i) key considerations for evaluating artificial intelligence (AI) enabled clinical decision support; and ii) challenges and practical implications of AI design, development, selection, use, and ongoing surveillance.

METHOD

A narrative review of existing research and evaluation approaches along with expert perspectives drawn from the International Medical Informatics Association (IMIA) Working Group on Technology Assessment and Quality Development in Health Informatics and the European Federation for Medical Informatics (EFMI) Working Group for Assessment of Health Information Systems.

RESULTS

There is a rich history and tradition of evaluating AI in healthcare. While evaluators can learn from past efforts, and build on best practice evaluation frameworks and methodologies, questions remain about how to evaluate the safety and effectiveness of AI that dynamically harness vast amounts of genomic, biomarker, phenotype, electronic record, and care delivery data from across health systems. This paper first provides a historical perspective about the evaluation of AI in healthcare. It then examines key challenges of evaluating AI-enabled clinical decision support during design, development, selection, use, and ongoing surveillance. Practical aspects of evaluating AI in healthcare, including approaches to evaluation and indicators to monitor AI are also discussed.

CONCLUSION

Commitment to rigorous initial and ongoing evaluation will be critical to ensuring the safe and effective integration of AI in complex sociotechnical settings. Specific enhancements that are required for the new generation of AI-enabled clinical decision support will emerge through practical application.

European Hospitals' Transition Toward Fully Electronic-Based Systems: Do Information Technology Security and Privacy Practices Follow?

BACKGROUND

Traditionally, health information has been mainly kept in paper-based records. This has deeply changed throughout approximately the last three decades with the widespread use of multiple health information technologies. The digitization of health care systems contributes to improving health care delivery. However, it also exposes health records to security and privacy breaches inherently related to information technology (IT). Thus, health care organizations willing to leverage IT for improved health care delivery need to put in place IT security and privacy measures consistent with their use of IT resources.

OBJECTIVE

In this study, 2 main objectives are pursued: (1) to assess the state of the implementation of IT security and privacy practices in European hospitals and (2) to assess to what extent these hospitals enhance their IT security and privacy practices as they move from paper-based systems toward fully electronic-based systems.

METHODS

Drawing on data from the European Commission electronic health survey, we performed a cluster analysis based on IT security and privacy practices implemented in 1723 European hospitals. We also developed an IT security index, a compounded measure of implemented IT security and privacy practices, and compared it with the hospitals' level in their transition from a paper-based system toward a fully electronic-based system.

RESULTS

A total of 3 clearly distinct patterns of health IT-related security and privacy practices were unveiled. These patterns, as well as the IT security index, indicate that most of the sampled hospitals (70.2%) failed to implement basic security and privacy measures consistent with their digitization level.

CONCLUSIONS

Even though, on average, the most electronically advanced hospitals display a higher IT security index than hospitals where the paper system still dominates, surprisingly, it appears that the enhancement of IT security and privacy practices as the health information digitization advances in European hospitals is neither systematic nor strong enough regarding the IT-security requirements. This study will contribute to raising awareness among hospitals' managers as to the importance of enhancing their IT security and privacy measures so that they can keep up with the security threats inherently related to the digitization of health care organizations.

Health information exchange in Finland: Usage of different access types and predictors of paper use

INTRODUCTION

Timely, complete and accurate patient data is needed in care decisions along the continuum of care. To access patient data from other organizations, there are three types of regional health information exchange systems (RHIS) in use In Finland. Some regions use multiple RHISs while others do not have a RHIS available. The recently introduced National Patient Data Repository (Kanta) is increasingly used for health information exchange (HIE).

OBJECTIVES

The purpose of this study was to assess usage of paper, RHISs and Kanta by context in 2017; evolution of paper use over the years; and predictors of paper use in 2017 among Finnish physicians for HIE system development.

METHODS

Data from national electronic health record (EHR) usage and user experience surveys were taken from 2010 (prior to ePrescription system implementation), 2014 (prior to implementation of Kanta) and 2017 (Kanta was in full use in the public sector and in large private organizations). The web-based surveys were targeted to all physicians engaged in clinical work in Finland.

RESULTS

Kanta was the most frequently used means of HIE in 2017. Paper use had reduced significantly from 2010 to 2014. The trend continued in 2017. Still, up to half of the physicians reported using paper daily or weekly in 2017. There were great variations in paper use by healthcare sector, available RHIS type and EHR system used. In multivariable analysis (with all other variables constant), predictors of more frequent use of paper than electronic means for HIE were: private sector or hospital, access to Master Patient Index RHIS (type 1), multiple RHIS (type 4) or no RHIS (type 5), two particular EHR systems, older age, less experience, operative, psychiatric or diagnostic specialties, and male gender.

CONCLUSIONS

Usability of HIE systems including EHRs as access points to HIE need to be improved to facilitate usage of electronic HIE. Usage ensures more timely and complete patient data for safe, coordinated care. Specialty-specific needs and requirements call for more user participation in HIE design. Especially older professionals need training to better exploit HIS for HIE.

Inter-group performance of oil producing countries: a meta and global frontier analysis

Purpose

The purpose of this study is to compare the production efficiencies and frontiers differences of oil-producing countries (OPCs) in four inter-governmental organizations (IGOs) in the international petroleum industry with the aim of providing such countries understanding of group characteristics that help maximize their supply interests.

Design/methodology/approach

The empirical analysis is based on 14 years of panel data covering the period from 2000 to 2013. In all 46 unique countries who are members of four IGOs relevant to the international petroleum industry are examined on individual and group bases. The authors use both metafrontier analysis and global frontier difference in examining the group average and group frontiers, respectively.

Findings

Groups with high inter and intra-group collaborations which ensure exchange of information, organizational learning and innovation tend to do better than groups with even higher hydro-carbon endowment. Additionally, hydro-carbon resource endowment may not be the solution to group inefficiency without higher endowment in human capital, economic stability, technology and infrastructure.

Practical implications

Choice of inter-governmental organizational membership should be based on the level of inter- and intra-group collaborations, human capital endowment among others and not mere historic links or even resource endowment.

Originality/value

This is among the few studies to compare and rank IGOs. Specifically, it is among the first studies to analyze the petroleum production efficiencies of IGOs involved in the international petroleum industry. This study assesses the performance differences among OPCs with the aim of identifying for OPCs the characteristics of inter-governmental groups that are beneficial to efficiency in upstream petroleum activities.

International health IT benchmarking: learning from cross-country comparisons

OBJECTIVE

To pilot benchmark measures of health information and communication technology (ICT) availability and use to facilitate cross-country learning.

MATERIALS AND METHODS

A prior Organization for Economic Cooperation and Development-led effort involving 30 countries selected and defined functionality-based measures for availability and use of electronic health records, health information exchange, personal health records, and telehealth. In this pilot, an Organization for Economic Cooperation and Development Working Group compiled results for 38 countries for a subset of measures with broad coverage using new and/or adapted country-specific or multinational surveys and other sources from 2012 to 2015. We also synthesized country learnings to inform future benchmarking.

RESULTS

While electronic records are widely used to store and manage patient information at the point of care-all but 2 pilot countries reported use by at least half of primary care physicians; many had rates above 75%-patient information exchange across organizations/settings is less common. Large variations in the availability and use of telehealth and personal health records also exist.

DISCUSSION

Pilot participation demonstrated interest in cross-national benchmarking. Using the most comparable measures available to date, it showed substantial diversity in health ICT availability and use in all domains. The project also identified methodological considerations (e.g., structural and health systems issues that can affect measurement) important for future comparisons.

CONCLUSION

While health policies and priorities differ, many nations aim to increase access, quality, and/or efficiency of care through effective ICT use. By identifying variations and describing key contextual factors, benchmarking offers the potential to facilitate cross-national learning and accelerate the progress of individual countries.

Innovative Power of Health Care Organisations Affects IT Adoption: A bi-National Health IT Benchmark Comparing Austria and Germany

Multinational health IT benchmarks foster cross-country learning and have been employed at various levels, e.g. OECD and Nordic countries. A bi-national benchmark study conducted in 2007 revealed a significantly higher adoption of health IT in Austria compared to Germany, two countries with comparable healthcare systems. We now investigated whether these differences still persisted. We further studied whether these differences were associated with hospital intrinsic factors, i.e. the innovative power of the organisation and hospital demographics. We thus performed a survey to measure the "perceived IT availability" and the "innovative power of the hospital" of 464 German and 70 Austrian hospitals. The survey was based on a questionnaire with 52 items and was given to the directors of nursing in 2013/2014. Our findings confirmed a significantly greater IT availability in Austria than in Germany. This was visible in the aggregated IT adoption composite score "IT function" as well as in the IT adoption for the individual functions "nursing documentation" (OR = 5.98), "intensive care unit (ICU) documentation" (OR = 2.49), "medication administration documentation" (OR = 2.48), "electronic archive" (OR = 2.27) and "medication" (OR = 2.16). "Innovative power" was the strongest factor to explain the variance of the composite score "IT function". It was effective in hospitals of both countries but significantly more effective in Austria than in Germany. "Hospital size" and "hospital system affiliation" were also significantly associated with the composite score "IT function", but they did not differ between the countries. These findings can be partly associated with the national characteristics. Indicators point to a more favourable financial situation in Austrian hospitals; we thus argue that Austrian hospitals may possess a larger degree of financial freedom to be innovative and to act accordingly. This study is the first to empirically demonstrate the effect of "innovative power" in hospitals on health IT adoption in a bi-national health IT benchmark. We recommend directly including the financial situation into future regression models. On a political level, measures to stimulate the "innovative power" of hospitals should be considered to increase the digitalisation of healthcare.

[Routine Data in Health Services Research: an Underused Resource]

Zusammenfassung. Routinedaten entstehen als Nebenprodukt des normalen Betriebsalltags. Diese ohne Zusatzaufwand massenhaft generierten Daten lassen sich mit ökonomischen oder im Falle der Medizin auch mit gesundheitlichen Fragestellungen auswerten. Durch die nicht-kontrollierte Art der Sammlung von Routinedaten sowie aufgrund der uneinheitlichen Handhabung von elektronischen Krankengeschichten ergeben sich aber je nach Fragestellung Grenzen der Aussagekraft von Resultaten. Dieser Artikel widmet sich den Fragen rund um Herkunft, Verarbeitung, Interpretation und Nutzen von Routinedaten. Dabei werden auch Machine Learning und Big Data kritisch in den Kontext gebracht, sowie die Aspekte Datenschutz und Ethik. Hinsichtlich des Schweizer Gesundheitssystems zeigt der Artikel die notwendigen Voraussetzungen, damit das Potential von Routinedaten auch hierzulande zugunsten einer besseren medizinischen Versorgung genutzt werden kann.

Usability problems do not heal by themselves: National survey on physicians' experiences with EHRs in Finland

PURPOSE

Survey studies of health information systems use tend to focus on availability of functionalities, adoption and intensity of use. Usability surveys have not been systematically conducted by any healthcare professional groups on a national scale on a repeated basis. This paper presents results from two cross-sectional surveys of physicians' experiences with the usability of currently used EHR systems in Finland. The research questions were: To what extent has the overall situation improved between 2010 and 2014? What differences are there between healthcare sectors?

METHODS

In the spring of 2014, a survey was conducted in Finland using a questionnaire that measures usability and respondents' user experiences with electronic health record (EHR) systems. The survey was targeted to physicians who were actively doing clinical work. Twenty-four usability-related statements, that were identical in 2010 and 2014, were analysed from the survey. The respondents were also asked to give an overall rating of the EHR system they used. The study data comprised responses from 3081 physicians from the year 2014 and from 3223 physicians in the year 2010, who were using the nine most commonly used EHR system brands in Finland.

RESULTS

Physicians' assessments of the usability of their EHR system remain as critical as they were in 2010. On a scale from 1 ('fail') to 7 ('excellent') the average of overall ratings of their principally used EHR systems varied from 3.2 to 4.4 in 2014 (and in 2010 from 2.5 to 4.3). The results show some improvements in the following EHR functionalities and characteristics: summary view of patient's health status, prevention of errors associated with medication ordering, patient's medication list as well as support for collaboration and information exchange between the physician and the nurses. Even so, support for cross-organizational collaboration between physicians and for physician-patient collaboration were still considered inadequate. Satisfaction with technical features had not improved in four years. The results show marked differences between the EHR system brands as well as between healthcare sectors (private sector, public hospitals, primary healthcare). Compared to responses from the public sector, physicians working in the private sector were more satisfied with their EHR systems with regards to statements about user interface characteristics and support for routine tasks. Overall, the study findings are similar to our previous study conducted in 2010.

CONCLUSIONS

Surveys about the usability of EHR systems are needed to monitor their development at regional and national levels. To our knowledge, this study is the first national eHealth observatory questionnaire that focuses on usability and is used to monitor the long-term development of EHRs. The results do not show notable improvements in physician's ratings for their EHRs between the years 2010 and 2014 in Finland. Instead, the results indicate the existence of serious problems and deficiencies which considerably hinder the efficiency of EHR use and physician's routine work. The survey results call for considerable amount of development work in order to achieve the expected benefits of EHR systems and to avoid technology-induced errors which may endanger patient safety. The findings of repeated surveys can be used to inform healthcare providers, decision makers and politicians about the current state of EHR usability and differences between brands as well as for improvements of EHR usability. This survey will be repeated in 2017 and there is a plan to include other healthcare professional groups in future surveys.

A comparison of how four countries use health IT to support care for people with chronic conditions

Countries around the globe are investing in health information and communications technologies (ICTs) as critical tools for improving care for chronically ill patients. We profiled four high-income nations with varied health ICT strategies--Australia, Canada, Denmark, and the United States--to describe their use of ICTs to improve chronic care. Our goal was to identify common challenges and opportunities for cross-national learning. We found four key themes. First, although all four countries have a national strategy for health ICT adoption, strategies are implemented and adapted to chronic care needs regionally, which creates the challenge of spreading successful efforts across regions. Second, each country struggles with how to ensure that clinical information follows patients seamlessly between care settings. Third, although each nation is pursuing telehealth solutions as a component of chronic care, the telehealth initiatives are usually stand-alone efforts that are not well integrated into other ICT solutions, such as electronic health records. Finally, countries have made progress in improving patients' access to their clinical data but have not fully succeeded in engaging patients to apply the data to improve care. These common themes suggest that although the four nations have different health care systems and ICT strategies, all of them face a similar set of challenges, creating an opportunity for cross-national learning.

The value of connected health information: perceptions of electronic health record users in Canada

BACKGROUND

As health care becomes more complex, it becomes more important for clinicians and patients to share information. Electronic health information exchange can help address this need. To this end, all provinces and territories (PTs) in Canada have created interoperable electronic health records (iEHRs). These secure systems offer authorized users an integrated view of a person's healthcare history across the continuum of care. They include information such as lab results, medications, diagnostic images, clinical reports and immunization profiles. This study explores user experiences and perceived outcomes of iEHR use.

METHODS

Surveys conducted between 2006 and 2014 asked iEHR users in six Canadian PTs about system, information and service quality; iEHR use and user satisfaction; and net quality and productivity benefits. The surveys had a core set of questions that used Likert-type scales. Results were synthesized across surveys for each evaluative dimension. Consensus among researchers and subject matter experts on whether to classify the outcomes as positive, mixed/neutral, or negative was established using a modified Delphi technique.

RESULTS

A total of 2316 iEHR users responded to the six surveys. Information quality was the most studied area. Results varied across PTs, but positive outcomes were more common than mixed/neutral or negative outcomes by a 19:1:1 ratio across this dimension. The next most frequently studied aspects were user satisfaction, the impact of iEHR use on quality of care, and the impact on productivity. In all three areas, there were more positive than mixed/neutral or /negative results (ratios of 13:1:1, 14:3:1, and 15:2:1respectively).

CONCLUSIONS

Overall, users of iEHRs that provide secure access to patient information collated from across the health system tend to report positive outcomes, including quality of care and productivity. This study is an important first step in understanding user perspectives on iEHRs and health information exchange more broadly.

Clinical Information Systems - From Yesterday to Tomorrow

OBJECTIVES

To review the history of clinical information systems over the past twenty-five years and project anticipated changes to those systems over the next twenty-five years.

METHODS

Over 250 Medline references about clinical information systems, quality of patient care, and patient safety were reviewed. Books, Web resources, and the author's personal experience with developing the HELP system were also used.

RESULTS

There have been dramatic improvements in the use and acceptance of clinical computing systems and Electronic Health Records (EHRs), especially in the United States. Although there are still challenges with the implementation of such systems, the rate of progress has been remarkable. Over the next twenty-five years, there will remain many important opportunities and challenges. These opportunities include understanding complex clinical computing issues that must be studied, understood and optimized. Dramatic improvements in quality of care and patient safety must be anticipated as a result of the use of clinical information systems. These improvements will result from a closer involvement of clinical informaticians in the optimization of patient care processes.

CONCLUSIONS

Clinical information systems and computerized clinical decision support have made contributions to medicine in the past. Therefore, by using better medical knowledge, optimized clinical information systems, and computerized clinical decision, we will enable dramatic improvements in both the quality and safety of patient care in the next twenty-five years.

Analysis of introducing e-services: a case study of Health Insurance Fund of Macedonia

Purpose - Information systems play a significant role in the improving of health and healthcare, as well as in the planning and financing of health services. Fund's Information System is an essential component of the information infrastructure that allows assessment of the impact of changes in health insurance and healthcare for the population. The purpose of this paper is to give a brief overview of the affection of e-services and electronic data exchange (between Fund's information systems and other IT systems) at the quality of service for insured people and savings funds. Design/methodology/approach - The authors opted for an exploratory study using the e-services implemented in Health Insurance Fund (HIF) of Macedonia and data which were complemented by documentary analysis, including brand documents and descriptions of internal processes. In this paper is presented an analysis of the financial aspects of some e-services in HIF of Macedonia by using computer-based information systems and calculating the financial implications on insured people, companies and healthcare providers. Findings - The analysis conducted in this paper shows that the HIF's e-services would have a positive impact for the insured people, healthcare providers and companies when fulfilling their administrative obligations and exercising their rights. Originality/value - The analysis presented in this paper can serve as a valuable input for the healthcare authorities in making decisions related to introducing e-services in healthcare. These enhanced e-services will improve the quality service of the HIF.

Privacy in practice: professional discourse about information control in health care

Purpose

– The purpose of this paper is to explore different health care professionals’ discourse about privacy – its definition and importance in health care, and its role in their day-to-day work. Professionals’ discourse about privacy reveals how new technologies and laws challenge existing practices of information control within and between professional groups in health care, with implications not only for patient privacy, but also for the role of information control in professions more generally.

Design/methodology/approach

– The authors conducted in-depth, semi-structured interviews with n=83 doctors, nurses, and health information professionals in two academic medical centers and one veteran’s administration hospital/clinic in the Northeastern USA. Interview responses were qualitatively coded for themes and patterns across groups were identified.

Findings

– The health care providers and the authors studied actively sought to uphold the protection (and control) of patient information through professional ethics and practices, as well as through the use of technologies and compliance with legal regulations. They used discourses of professionalism, as well as of law and technology, to sometimes accept and sometimes resist changes to practice required in the changing technological and legal context of health care. The authors found differences across professional groups; for some, protection of patient information is part of core professional ethics, while for others it is simply part of their occupational work, aligned with organizational interests.

Research limitations/implications

– This qualitative study of physicians, nurses, and health information professionals revealed some differences in views and practices for protecting patient information in the changing technological and legal context of health care that suggest some professional groups (doctors) may be more likely to resist such changes and others (health information professionals) will actively adopt them.

Practical implications

– New technologies and regulations are changing how information is used in health care delivery, challenging professional practices for the control of patient information that may change the value or meaning of medical records for different professional groups.

Originality/value

– Qualitative findings suggest that professional groups in health care vary in the extent of information control they have, as well in how they view such control. Some groups may be more likely to (be able to) resist changes in the professional control of information that stem from new technologies or regulatory policies. Some professionals recognize that new IT systems and regulations challenge existing social control of information in health care, with the potential to undermine (or possibly bolster) professional self-control for some but not necessarily all occupational groups.

Data Extraction and Management in Networks of Observational Health Care Databases for Scientific Research: A Comparison of EU-ADR, OMOP, Mini-Sentinel and MATRICE Strategies

Introduction:

We see increased use of existing observational data in order to achieve fast and transparent production of empirical evidence in health care research. Multiple databases are often used to increase power, to assess rare exposures or outcomes, or to study diverse populations. For privacy and sociological reasons, original data on individual subjects can’t be shared, requiring a distributed network approach where data processing is performed prior to data sharing.

Case Descriptions and Variation Among Sites:

We created a conceptual framework distinguishing three steps in local data processing: (1) data reorganization into a data structure common across the network; (2) derivation of study variables not present in original data; and (3) application of study design to transform longitudinal data into aggregated data sets for statistical analysis. We applied this framework to four case studies to identify similarities and differences in the United States and Europe: Exploring and Understanding Adverse Drug Reactions by Integrative Mining of Clinical Records and Biomedical Knowledge (EU-ADR), Observational Medical Outcomes Partnership (OMOP), the Food and Drug Administration’s (FDA’s) Mini-Sentinel, and the Italian network—the Integration of Content Management Information on the Territory of Patients with Complex Diseases or with Chronic Conditions (MATRICE).

Findings:

National networks (OMOP, Mini-Sentinel, MATRICE) all adopted shared procedures for local data reorganization. The multinational EU-ADR network needed locally defined procedures to reorganize its heterogeneous data into a common structure. Derivation of new data elements was centrally defined in all networks but the procedure was not shared in EU-ADR. Application of study design was a common and shared procedure in all the case studies. Computer procedures were embodied in different programming languages, including SAS, R, SQL, Java, and C++.

Conclusion:

Using our conceptual framework we found several areas that would benefit from research to identify optimal standards for production of empirical knowledge from existing databases.an opportunity to advance evidence-based care management. In addition, formalized CM outcomes assessment methodologies will enable us to compare CM effectiveness across health delivery settings.

Measuring interoperable EHR adoption and maturity: a Canadian example

Background

An interoperable electronic health record is a secure consolidated record of an individual’s health history and care, designed to facilitate authorized information sharing across the care continuum.  Each Canadian province and territory has implemented such a system and for all, measuring adoption is essential to understanding progress and optimizing use in order to realize intended benefits.

Results

About 250,000 health professionals—approximately half of Canada’s anticipated potential physician, nurse, pharmacist, and administrative users—indicated that they electronically access data, such as those found in provincial/territorial lab or drug information systems, in 2015.  Trends suggest further growth as maturity of use increases.

Conclusions

There is strong interest in health information exchange through the iEHR in Canada, and continued growth in adoption is expected. Central to managing the evolution of digital health is access to robust data about who is using solutions, how they are used, where and when.  Stakeholders such as government, program leads, and health system administrators must critically assess progress and achievement of benefits, to inform future strategic and operational decisions.

Feasibility of 30-day hospital readmission prediction modeling based on health information exchange data

INTRODUCTION

Unplanned 30-day hospital readmission account for roughly $17 billion in annual Medicare spending. Many factors contribute to unplanned hospital readmissions and multiple models have been developed over the years to predict them. Most researchers have used insurance claims or administrative data to train and operationalize their Readmission Risk Prediction Models (RRPMs). Some RRPM developers have also used electronic health records data; however, using health informatics exchange data has been uncommon among such predictive models and can be beneficial in its ability to provide real-time alerts to providers at the point of care.

METHODS

We conducted a semi-systematic review of readmission predictive factors published prior to March 2013. Then, we extracted and merged all significant variables listed in those articles for RRPMs. Finally, we matched these variables with common HL7 messages transmitted by a sample of health information exchange organizations (HIO).

RESULTS

The semi-systematic review resulted in identification of 32 articles and 297 predictive variables. The mapping of these variables with common HL7 segments resulted in an 89.2% total coverage, with the DG1 (diagnosis) segment having the highest coverage of 39.4%. The PID (patient identification) and OBX (observation results) segments cover 13.9% and 9.1% of the variables. Evaluating the same coverage in three sample HIOs showed data incompleteness.

DISCUSSION

HIOs can utilize HL7 messages to develop unique RRPMs for their stakeholders; however, data completeness of exchanged messages should meet certain thresholds. If data quality standards are met by stakeholders, HIOs would be able to provide real-time RRPMs that not only predict intra-hospital readmissions but also inter-hospital cases.

CONCLUSION

A RRPM derived using HIO data exchanged through may prove to be a useful method to prevent unplanned hospital readmissions. In order for the RRPM derived from HIO data to be effective, hospitals must actively exchange clinical information through the HIO and develop actionable methods that integrate into the workflow of providers to ensure that patients at high-risk for readmission receive the care they need.

Undirected health IT implementation in ambulatory care favors paper-based workarounds and limits health data exchange

BACKGROUND

The adoption and use of health information technology (IT) continues to grow around the globe. In Switzerland, the government nor professional associations have to this day provided incentives for health IT adoption.

OBJECTIVE

We aim to assess the proportion of physicians who are routinely working with electronic health data and describe to what extent physicians exchange electronic health data with peers and other health care providers. Additionally, we aim to estimate the effect of physicians' attitude towards health IT on the adoption of electronic workflows.

METHODS

Between May and July 2013, we conducted a cross-sectional survey of 1200 practice based physicians in Switzerland. Respondents were asked to report on their technical means and where applicable their paper-based workarounds to process laboratory data, examination results, referral letters and physician's letters. Physicians' view of barriers and facilitators towards health IT use was determined by a composite score.

RESULTS

A response rate of 57.1% (n=685) was reached. The sample was considered to be representative for physicians in Swiss ambulatory care. 35.2% of the respondents documented patients' health status with the help of a longitudinal semi-structured electronic text record generated by one or more encounters in the practice. Depending on the task within a workflow, around 11-46% of the respondents stated to rely on electronic workflow practices to process laboratory and examination data and dispatch referral notes and physician's letters. The permanent use of electronic workflow processes was infrequent. Instead, respondents reported paper-based workarounds affecting specific tasks within a workflow. Physicians' attitude towards health IT was significantly associated with the adoption of electronic workflows (OR 1.04-1.31, p<0.05), but the effect sizes of factors related to the working environment (e.g., regional factors, medical specialty, type of practice) were larger.

CONCLUSION

At present, only a few physicians in Swiss ambulatory care routinely work with electronic health data. Until more of their peers participate in electronic exchange of structured clinical information, most physicians will continue to stay in paper-based systems and workarounds. The survey found that physicians with a positive attitude towards health IT were more likely to adopt electronic workflows, but the impact is minor. It will likely be necessary to introduce financial incentives and develop national standards in order to promote the adoption by a critical mass of practicing clinicians.

Interoperability after deployment: persistent challenges and regional strategies in Denmark

QUALITY PROBLEM OR ISSUE

The European Union has identified Denmark as one of the countries who have the potential to provide leadership and inspiration for other countries in eHealth implementation and adoption. However, Denmark has historically struggled to facilitate data exchange between their public hospitals' electronic health records (EHRs). Furthermore, state-led projects failed to adequately address the challenges of interoperability after deployment.

CHOICE OF SOLUTION

Changes in the organizational setup and division of responsibilities concerning the future of eHealth implementations in hospitals took place, which granted the Danish regions the full responsibility for all hospital systems, specifically the consolidation of EHRs to one system per region.

IMPLEMENTATION

The regions reduced the number of different EHRs to six systems by 2014. Additionally, the first version of the National Health Record was launched to provide health care practitioners with an overview of a patient's data stored in all EHRs across the regions and within the various health sectors.

EVALUATION

The governance of national eHealth implementation plays a crucial role in the development and diffusion of interoperable technologies. Changes in the organizational setup and redistribution of responsibilities between the Danish regions and the state play a pivotal role in producing viable and coherent solutions in a timely manner.

LESSONS LEARNED

Interoperability initiatives are best managed on a regional level or by the authorities responsible for the provision of local health care services. Cross-regional communication is essential during the initial phases of planning in order to set a common goal for countrywide harmonization, coherence and collaboration.

What Are Complex eHealth Innovations and How Do You Measure Them? Position Paper

OBJECTIVES

eHealth and innovation are often regarded as synonyms - not least because eHealth technologies and applications are new to their users. This position paper challenges this view and aims at exploring the nature of eHealth innovation against the background of common definitions of innovation and facts from the biomedical and health informatics literature. A good understanding of what constitutes innovative eHealth developments allows the degree of innovation to be measured and interpreted.

METHODS

To this end, relevant biomedical and health informatics literature was searched mainly in Medline and ACM digital library. This paper presents seven facts about implementing and applying new eHealth developments hereby drawing on the experience published in the literature.

RESULTS

The facts are: 1. eHealth innovation is relative. 2. Advanced clinical practice is the yardstick. 3. Only used and usable eHealth technology can give birth to eHealth innovatio. 4. One new single eHealth function does not make a complex eHealth innovation. 5. eHealth innovation is more evolution than revolution. 6. eHealth innovation is often triggered behind the scenes; and 7. There is no eHealth innovation without sociocultural change.

CONCLUSIONS

The main conclusion of the seven facts is that eHealth innovations have many ingredients: newness, availability, advanced clinical practice with proven outcomes, use and usability, the supporting environment, other context factors and the stakeholder perspectives. Measuring eHealth innovation is thus a complex matter. To this end we propose the development of a composite score that expresses comprehensively the nature of eHealth innovation and that breaks down its complexity into the three dimensions: i) eHealth adoption, ii) partnership with advanced clinical practice, and iii) use and usability of eHealth. In order to better understand the momentum and mechanisms behind eHealth innovation the fourth dimension, iv) eHealth supporting services and means, needs to be studied. Conceptualising appropriate measurement instruments also requires eHealth innovation to be distinguished from eHealth sophistication, performance and quality, although innovation is intertwined with these concepts. The demanding effort for defining eHealth innovation and measuring it properly seem worthwhile and promise advances in creating better systems. This paper thus intends to stimulate the necessary discussion.