Feasibility and effectiveness of a multidimensional post-discharge disease management programme for heart failure patients in clinical practice: the HerzMobil Tirol programme

AIMS

It remains unclear whether transitional care management outside of a clinical trial setting provides benefits for patients with acute heart failure (AHF) after hospitalization. We evaluated the feasibility and effectiveness of a multidimensional post-discharge disease management programme using a telemedical monitoring system incorporated in a comprehensive network of heart failure nurses, resident physicians, and secondary and tertiary referral centres (HerzMobil Tirol, HMT), METHODS AND RESULTS: The non-randomized study included 508 AHF patients that were managed in HMT (n = 251) or contemporaneously in usual care (UC, n = 257) after discharge from hospital from 2016 to 2019. Groups were retrospectively matched for age and sex. The primary endpoint was time to HF readmission and all-cause mortality within 6 months. Multivariable Cox proportional hazard models were used to assess the effectiveness. The primary endpoint occurred in 48 patients (19.1%) in HMT and 89 (34.6%) in UC. Compared with UC, management by HMT was associated with a 46%-reduction in the primary endpoint (adjusted HR 0.54; 95% CI 0.37-0.77; P < 0.001). Subgroup analyses revealed consistent effectiveness. The composite of recurrent HF hospitalization and death within 6 months per 100 patient-years was 64.2 in HMT and 108.2 in UC (adjusted HR 0.41; 95% CI 0.29-0.55; P < 0.001 with death considered as a competing risk). After 1 year, 25 (10%) patients died in HMT compared with 66 (25.7%) in UC (HR 0.38; 95% CI 0.23-0.61, P < 0.001).

CONCLUSIONS

A multidimensional post-discharge disease management programme, comprising a telemedical monitoring system incorporated in a comprehensive network of specialized heart failure nurses and resident physicians, is feasible and effective in clinical practice.

Health Informatics 3.0 and other Increasingly Dispersed Technologies Require Even Greater Trust: Promoting Safe Evidence-based Health Informatics

Healthinformaticsisgenerallylesscommittedtoascientific evidence-basedapproach than any other area of health science, which is an unsound position. Introducing the new Web 3.0 paradigms into health IT applications can unleash a further great potential, able to integrate and distribute data from multiple sources. The counter sideisthatitmakestheuserandthepatientevermoredependentonthe

‘blackbox’ of the system, and the re-use of the data remote from the author and initial context. Thus anticipatory consideration of uses, and proactive analysis of evidenceof effects,are imperative,as only when a clinical technology can be proven to be trustworthy and safe should it be implementedwidely as is the case with other health technologies.

Toargueforpromotingevidence-basedhealthinformatics assystemsbecomemorepowerfulandpro-activeyetmoredispersed andremote;andevaluationasthemeansofgeneratingthenecessaryscientific evidencebase.TopresentongoingIMIAandEFMIinitiativesinthisfield.

Critical overview of recent developments in health informatics evaluation, alongside the precedents of other health technologies, summarising current initiatives and the new challenges presented by Health Informatics 3.0.

Web3.0should betaken asanopportunitytomovehealth informatics from being largely unaccountable to one of being an ethical andresponsiblescience-baseddomain.Recentandplannedactivities ofthe EFMIandIMIAworkinggroupshavesignificantlyprogressedkeyinitiatives.

Concurrent with the emergence of Web 3.0 as a means of new-generation diffuse health information systems comes an increasing need for an evidence-based culture in health informatics.

Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle

Objectives: To present the importance of Evidence-based Health Informatics (EBHI) and the ethical imperative of this approach; to highlight the work of the IMIA Working Group on Technology Assessment and Quality Improvement and the EFMI Working Group on Assessment of Health Information Systems; and to introduce the further important evaluation and evidence aspects being addressed.

Methods: Reviews of IMIA, EFMA and other initiatives, together with literature reviews on evaluation methods and on published systematic reviews.

Results: Presentation of the rationale for the health informatics domain to adopt a scientific approach by assessing impact, avoiding harm, and empirically demonstrating benefit and best use; reporting of the origins and rationale of the IMIA- and EQUATOR-endorsed Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI) and of the IMIA WG's Guideline for Good Evaluation Practice in Health Informatics (GEP-HI); presentation of other initiatives for objective evaluation; and outlining of further work in hand on usability and indicators; together with the case for development of relevant evaluation methods in newer applications such as telemedicine. The focus is on scientific evaluation as a reliable source of evidence, and on structured presentation of results to enable easy retrieval of evidence.

Conclusions: EBHI is feasible, necessary for efficiency and safety, and ethically essential. Given the significant impact of health informatics on health systems, care delivery and personal health, it is vital that cultures change to insist on evidence-based policies and investment, and that emergent global moves for this are supported.

eHealth in Europe – Status and Challenges

Objectives: To present European reflections on the concept of eHealth and emerging challenges related to further development of eHealth in Europe.

Methods: A survey with 10 questions was distributed to representatives of the national member associations of the European Federation of Medical Informatics (EFMI).

Results: The results document a shift from a constricting ICT-orientation to development of the entire health system where eHealth strategies, organizational change, and appropriate technological infrastructure are singled out as important aspects.

Conclusion: There are urgent needs to ensure that eHealth strategies and policies for further design and deployment of eHealth applications support sociable services and innovations in health care.

Medical Informatics and the Quality of Health: New Approaches to Support Patient Care

Objectives: The Yearbook of Medical Informatics is published annually by the International Medical Informatics Association (IMIA) and contains a selection of excellent papers on medical informatics research which have been recently published (www.yearbook.uni-hd.de). The 2003 Yearbook of Medical Informatics took as its theme the role of medical informatics for the quality of health care. In this paper, we will discuss challenges for health care, and the lessons learned from editing IMIA Yearbook 2003.

Results and Conclusions: Modern information processing methodology and information and communication technology have strongly influenced our societies and health care. As a consequence of this, medical informatics as a discipline has taken a leading role in the further development of health care. This involves developing information systems that enhance opportunities for global access to health services and medical knowledge. Informatics methodology and technology will facilitate high quality of care in aging societies, and will decrease the possibilities of health care errors. It will also enable the dissemination of the latest medical and health information on the web to consumers and health care providers alike. The selected papers of the IMIA Yearbook 2003 present clear examples and future challenges, and they highlight how various sub-disciplines of medical informatics can contribute to this.

Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages

Objective: To analyze the seemingly contradictory results of the Han study (Pediatrics 2005) and the Del Beccaro study (Pediatrics 2006), both analyzing the effect of CPOE systems on mortality rates in pediatric intensive care settings.

Methods: Seven CPOE system experts from the United States and Europe comment on these papers.

Results: The two studies are not contradictory, but almost non-comparable due to differences in design and implementation. They demonstrate the range of outcomes that can be obtained from introducing informatics applications in complex health care settings. Implementing informatics applications is a socio-technical activity, which often depends more on the organizational context than on a specific technology. As health informaticians, we must not only learn from failures, but also avoid both uncritical scepticism that may arise from drawing overly general conclusions from one negative trial, as much as uncritical optimism from limited successful ones.

Conclusion: The commentaries emphasize the need to promote systematic studies for assessing the socio-technical factors that influence the introduction of increasingly sophisticated informatics applications within complex organizations. The emergence of evidence-based health informatics will be based both on evaluation guidelines and implementation guidelines, both of which increase the chances of successful implementation. In addition, well-educated health informaticians are needed to manage and guide the implementation processes.

Digital Libraries and Recent Medical Informatics Research

The Yearbook of Medical Informatics is published annually by the International Medical Informatics Association (IMIA) and contains a selection of recent excellent papers on medical informatics research (http://www.med.uni-heidelberg.de/mi/yearbook/index.htm). The special topic of the just published Yearbook 2001 is “Digital Libraries and Medicine”. Digital libraries have changed dramatically and will continue to change the way we work with medical knowledge. The selected papers present recent research and new results on digital libraries. As usual, the Yearbook 2001 also contains a variety of papers on other subjects relevant to medical informatics, such as Electronic Patient Records, Health Information Systems, Health and Clinical Management, Decision Support Systems, Education, as well as Image and Signal Processing. This paper will briefly introduce the contributions covering digital libraries and will show how medical informatics research contributes to this important topic.

Systems Analysis in Health Care: Framework and Example

Objectives: Due to the high complexity of structures and processes in health care, thorough systems analyses in health care run the risk of becoming very complex and difficult to handle. Therefore, we aimed to support systematic systems analysis in health care by developing a comprehensive framework that presents and describes potential areas of analysis.

Methods: A framework for systems analysis in health care was developed and applied in a health care setting. To provide a clear structure, the framework describes the potential views and levels of systems analyses in a health care environment.

Results: The framework comprises five views (roles and responsibilities, information processing and tools, communication, business processes, teams structure and cooperation) and five levels of analysis (overall organization, organizational unit, staff member, role, task). The framework was successfully applied in an analysis of the structures and processes of the Department of Child and Adolescent Psychiatry of the University Medical Center Heidelberg.

Conclusions: The proposed comprehensive framework aims to structure the views and levels of systems analysis in the complex health care environment. Our first experiences support the usefulness of such a framework.

A Randomized Evaluation of a Computer-Based Nursing Documentation System

A two-month randomized, controlled trial based on 60 patients has been performed on a ward of the Department of Psychiatry at Heidelberg University Medical Center, Germany, to investigate the influence of computer-based nursing documentation on time investment for documentation, quality of documentation and user acceptance. Time measurements, questionnaires, documentation analysis and interviews were used to compare patients documented with the computer-based system (PIK group) with the control group (patients documented with the paper-based system). The results showed the advantages and disadvantages of computer-based nursing documentation. Time needed for nursing care planning was lower in the PIK group. Some formal aspects of quality were considerably better in the PIK group. On the other hand, time required for documentation of tasks and for report writing was greater in the PIK group. User acceptance increased significantly during the study. The interviews indicated a positive influence of PIK on the cooperation between nurses and physicians.

Medical Imaging Informatics and Medical Informatics: Opportunities and Constraints

Objectives: The Yearbook of Medical Informatics is published annually by the International Medical Informatics Association (IMIA) and contains a selection of recent excellent papers on medical informatics research (http://www.yearbook.uni-hd.de). The 2002 Yearbook of Medical Informatics took as its theme the topic of Medical Imaging Informatics. In this paper, we will summarize the contributions of medical informatics researchers to the development of medical imaging informatics, discuss challenges and opportunities of imaging informatics, and present the lessons learned from the IMIA Yearbook 2002.

Results and Conclusions: Medical informatics researchers have contributed to the development of medical imaging methods and systems since the inception of this field approximately 40 years ago. The Yearbook presents selected papers and reviews on this important topic.

In addition, as usual, the Yearbook 2002 also contains a variety of papers and reviews on other subjects relevant to medical informatics, such as Bioinformatics, Computer-supported education, Health and clinical management, Health information systems, Knowledge processing and decision support, Patient records, and Signal processing.

Process Potential Screening

Objectives: Hospitals are increasingly under pressure to optimize their processes. So far, an instrument to systematically identify the potentials for improvement of a given business process is missing. The aim of this project is to develop such an instrument.

Methods: Initially, central aspects of the quality of a hospital process were identified on the basis of a systematic literature review. Secondary to that, criteria to measure quality aspects were defined: More than 300 criteria from medical and business informatics, economics and quality management publications were gathered and systematically aggregated.

Results: As a result, the Process Potential Screening (PPS) instrument was developed. The PPS is a matrix containing two axes: Axis I comprises 30 quality aspects referring to results, execution and control of hospital processes. Axis II comprises 16 quality criteria (e.g., customer satisfaction, time). The PPS displays approximately 400 relevant combinations of those quality aspects and quality criteria that help to identify potentials for improvement of a given hospital process. It utilizes different methods for the measurement of the criteria and for application by way of individuals or groups.

Conclusions: In using the PPS, relevant potentials for improvement were identified in ten typical hospital processes. The instrument’s practicability must now be examined in further studies by the final target group (e.g., quality or project managers, and the staff responsible for processes).

A Requirements Index for Information Processing in Hospitals

Objectives: Reference models describing typical information processing requirements in hospitals do not currently exist. This leads to high hospital information system (HIS) management expenses, for example, during tender processes for the acquisition of software application programs. Our aim was, therefore, to develop a comprehensive, lasting, technology-independent, and sufficiently detailed index of requirements for information processing in hospitals in order to reduce respective expenses.

Methods: Two-dozen German experts established an index of requirements for information processing in university hospitals. This was done in a consensus-based, top-down, cyclic manner. Each functional requirement was derived from information processing functions and sub-functions of a hospital.

Results: The result is the first official German version of a requirements index, containing 233 functional requirements and 102 function-independent requirements, focusing on German needs. The functional requirements are structured according to the primary care process from admission to discharge and supplemented by requirements for handling patient records, work organization and resource planning, hospital management, research and education. Both the German version and its English translation are available in the Internet.

Conclusions: The index of requirements contains general information processing requirements in hospitals which are formulated independent of information processing tools, or of HIS architectures. It aims at supporting HIS management, especially HIS strategic planning, HIS evaluation, and tender processes. The index can be regarded as a draft, which must, however, be refined according to the specific aims of a particular project. Although focused on German needs, we expect that it can also be useful in other countries. The high amount of interest shown for the index supports its usefulness.

An Inventory of Evaluation Studies of Information Technology in Health Care

Objectives: During the last years the significance of evaluation studies as well as the interest in adequate methods and approaches for evaluation has grown in medical informatics. In order to put this discussion into historical perspective of evaluation research, we conducted a systematic review on trends in evaluation research of information technology in health care from 1982 to 2002.

Methods: The inventory is based on a systematic literature search in PubMed. Abstracts were included when they described an evaluation study of a computer-based component in health care. We identified 1035 papers from 1982 to 2002 and indexed them based on a multi-axial classification describing type of information system, study location, evaluation strategy, evaluation methods, evaluation setting, and evaluation focus.

Results and Conclusions: We found interesting developments in evaluation research in the last 20 years. For example, there has been a strong shift from medical journals to medical informatics journals. With regard to methods, explanatory research and quantitative methods have dominated evaluation studies in the last 20 years. Since 1982, the number of lab studies and technical evaluation studies has declined, while the number of studies focusing on the influence of information technology on quality of care processes or outcome of patient care has increased. We interpret this shift as a sign of maturation of evaluation research in medical informatics.

Bad Health Informatics Can Kill – Is Evaluation the Answer?

Objective: Health care is entering the age of information society. It is evident that the use of modern information and communication technology (ICT) offers tremendous opportunities to improve health care. However, there are also hazards associated with ICT in health care. We want to present an overview of typical hazards associated with ICT in health care, and to discuss how ICT evaluation can be a solution.

Methods: We analyze examples of failures and problems associated with ICT in health care. This collection is also made available on a website.

Results and Conclusion: Systematic, continuous evaluation of quality and effects of ICT during the whole life cycle of ICT components seems to be one important approach to detect and prevent possible ICT hazards and failures, supporting a higher quality of patient care. However, empirical studies proving this assumption are needed.

Medical Informatics Education Needs Information System Practicums in Health Care Settings

Objectives: To report about the themes and about experiences with practicums in the management of information systems in health care settings (health information management) for medical informatics students.

Methods: We first summarize the topics of the health information management practicums/projects that the authors organized between 1990 and 2003 for the medical informatics programs at Heidelberg/ Heilbronn, Germany, UMIT, Austria, as well as for the informatics program at the University of Leipzig, Germany. Experiences and lessons learned, obtained from the faculty that organized the practicums in the past 14 years, are reported.

Results: Thirty (of 32) health information management practicums focused on the analysis of health information systems. These took place inside university medical centers. Although the practicums were time-intensive and required intensively tutoring students with regard to health information management and project management, feedback from the students and graduates was mainly positive.

Discussion: It is clearly recommended that students specializing in medical informatics need to be confronted with real-world problems of health information systems during their studies.

The Challenge of Ubiquitous Computing in Health Care: Technology, Concepts and Solutions

Objectives: To review recent research efforts in the field of ubiquitous computing in health care. To identify current research trends and further challenges for medical informatics.

Methods: Analysis of the contents of the Yearbook on Medical Informatics 2005 of the International Medical Informatics Association (IMIA).

Results: The Yearbook of Medical Informatics 2005 includes 34 original papers selected from 22 peer-reviewed scientific journals related to several distinct research areas: health and clinical management, patient records, health information systems, medical signal processing and biomedical imaging, decision support, knowledge representation and management, education and consumer informatics as well as bioinformatics. A special section on ubiquitous health care systems is devoted to recent developments in the application of ubiquitous computing in health care. Besides additional synoptical reviews of each of the sections the Yearbook includes invited reviews concerning E-Health strategies, primary care informatics and wearable healthcare.

Conclusions: Several publications demonstrate the potential of ubiquitous computing to enhance effectiveness of health services delivery and organization.

But ubiquitous computing is also a societal challenge, caused by the surrounding but unobtrusive character of this technology. Contributions from nearly all of the established sub-disciplines of medical informatics are demanded to turn the visions of this promising new research field into reality.

Evaluation of the Electronic Transmission of Medical Findings from Hospitals to Practitioners by Triangulation

Objectives: The need for regional, cross-institutional electronic networks in health care is steadily growing to support seamless, cooperative health care. The aim of this study is to evaluate the impact of electronic transmission between hospitals and practitioners in a Tyrolean health care network, and to derive technical and organizational points for improvement.

Methods: Between March and August 2004 we carried out a triangulation-based cross-sectional study, combining a qualitative study based on semi-structured, problem-centric interviews with selected practitioners, with a quantitative study based on a standardized questionnaire survey of all the Tyrolean practitioners that receive electronic messages. The survey was designed to confirm the hypotheses which have been systematically derived from the interviews.

Results and Conclusions: The results show high satisfaction and positive impact of electronic communication. The triangulation of quantitative and qualitative methods was found to be useful in order to make the definition and confirmation of the hypotheses more transparent.

Factors Influencing Success and Failure of Health Informatics Systems

Objectives: The aim is to gain information on factors influencing success and failure for Health Informatics applications from a group of medical informaticians.

Methods: Based on the presentations at a special topic conference on success and failure in Health ICT and analysis of the proceedings, we conducted a Delphi study on success and failure aspects.

Results: A total of 110 success factors and 27 failure criteria were identified, distributed on categories like functional, organizational, behavioral, technical, managerial, political, cultural, legal, strategy, economy, education and user acceptance. These factors and criteria were rated for six different system types. Unanimously it was agreed that “collaboration and co-operation” and “setting goals and courses” are “essential for the success” of clinical systems, and “user acceptance” for educational systems. Similarly, the score “essential in order to avoid a failure” were given unanimously on clinical systems for “response rate and other performance measures” and on administrative systems for “not understanding the organizational context” with “not understanding or foreseeing the extent to which the new IT-system affects the organization, its structure and/or work procedures” as the highest scoring sub-item.

Conclusions: All success factors and failure criteria were considered relevant by the Delphi expert panel. There is no small set of relevant factors or indicators, but success or failure of a Health ICT depends on a large set of issues. Further, clinical systems and decision support systems depend on more factors than other systems.

Towards Clinical Bioinformatics: Advancing Genomic Medicine with Informatics Methods and Tools

Objectives: To summarize the challenges facing clinical applications in the light of growing research results in genomic medicine and bioinformatics.

Methods: Analysis of the contents of the Yearbook of Medical Informatics 2004 of the International Medical Informatics Association (IMIA).

Results: The Yearbook of Medical Informatics 2004 includes 32 articles selected from 22 peer-reviewed scientific journals. A special section on clinical bio-informatics highlights recent developments in this field. Several guest editors review the promises and limitations of available methods and resources from biomedical informatics that are relevant to clinical medicine. Integrated data and knowledge resources are generally regarded to be central and key issues for clinical bioinformatics. Further review papers deal with public health implications of bioinformatics, knowledge management and trends in health care education. The Yearbook includes for the first time a section on the history of medical informatics, where the significant impact of the Reisensburg protocol 1973 on international health and medical informatics education is examined.

Conclusions: Close collaboration between bio-informatics and medical informatics researchers can contribute to new insights in genomic medicine and contribute towards the more efficient and effective use of genomic data to advance clinical care.

Evidence-based Health Informatics: How Do We Know What We Know?

Background: Health IT is expected to have a positive impact on the quality and efficiency of health care. But reports on negative impact and patient harm continue to emerge. The obligation of health informatics is to make sure that health IT solutions provide as much benefit with as few negative side effects as possible. To achieve this, health informatics as a discipline must be able to learn, both from its successes as well as from its failures.

Objectives: To present motivation, vision, and history of evidence-based health informatics, and to discuss achievements, challenges, and needs for action.

Methods: Reflections on scientific literature and on own experiences.

Results: Eight challenges on the way towards evidence-based health informatics are identified and discussed: quality of studies; publication bias; reporting quality; availability of publications; systematic reviews and meta-analysis; training of health IT evaluation experts; translation of evidence into health practice; and post-market surveil-lance. Identified needs for action comprise: establish health IT study registers; increase the quality of publications; develop a taxonomy for health IT systems; improve indexing of published health IT evaluation papers; move from meta-analysis to meta-summaries; include health IT evaluation competencies in curricula; develop evidence-based implementation frameworks; and establish post-marketing surveillance for health IT.

Conclusions: There has been some progress, but evidence-based health informatics is still in its infancy. Building evidence in health informatics is our obligation if we consider medical informatics a scientific discipline.

Memorandum “Open Metadata”

At present, most documentation forms and item catalogs in healthcare are not accessible to the public. This applies to assessment forms of routine patient care as well as case report forms (CRFs) of clinical and epidemiological studies. On behalf of the German chairs for Medical Informatics, Biometry and Epidemiology six recommendations to developers and users of documentation forms in healthcare were developed. Open access to medical documentation forms could substantially improve information systems in health-care and medical research networks. Therefore these forms should be made available to the scientific community, their use should not be unduly restricted, they should be published in a sustainable way using international standards and sources of documentation forms should be referenced in scientific publications.

Attitude of Physicians Towards Automatic Alerting in Computerized Physician Order Entry Systems

Objectives: To analyze the attitude of physicians towards alerting in CPOE systems in different hospitals in different countries, addressing various organizational and technical settings and the view of physicians not currently using a CPOE.

Methods: A cross-sectional quantitative and qualitative questionnaire survey. We invited 2,600 physicians in eleven hospitals from nine countries to participate. Eight of the hospitals had different CPOE systems in use, and three of the participating hospitals were not using a CPOE system.

Results: 1,018 physicians participated. The general attitude of the physicians towards CPOE alerting is positive and is found to be mostly independent of the country, the specific organizational settings in the hospitals and their personal experience with CPOE systems. Both quantitative and qualitative results show that the majority of the physicians, both CPOE-users and non-users, appreciate the benefits of alerting in CPOE systems on medication safety. However, alerting should be better adapted to the clinical context and make use of more sophisticated ways to present alert information. The vast majority of physicians agree that additional information regarding interactions is useful on demand. Around half of the respondents see possible alert overload as a major problem; in this regard, physicians in hospitals with sophisticated alerting strategies show partly better attitude scores.

Conclusions: Our results indicate that the way alerting information is presented to the physicians may play a role in their general attitude towards alerting, and that hospitals with a sophisticated alerting strategy with less interruptive alerts tend towards more positive attitudes. This aspect needs to be further investigated in future studies.

Systematic Prioritization of the STARE-HI Reporting Items

Background: We previously devised and published a guideline for reporting health informatics evaluation studies named STARE-HI, which is formally endorsed by IMIA and EFMI.

Objective: To develop a prioritization framework of ranked reporting items to assist authors when reporting health informatics evaluation studies in space restricted conference papers and to apply this prioritization framework to measure the quality of recent health informatics conference papers on evaluation studies.

Method: We deconstructed the STARE-HI guideline to identify reporting items. We invited a total of 111 authors of health informatics evaluation studies, reviewers and editors of health Informatics conference proceedings to score those reporting items on a scale ranging from “0 – not necessary in a conference paper” through to “10 – essential in a conference paper” by a web-based survey. From the responses we derived a mean priority score. All evaluation papers published in proceedings of MIE2006, Medinfo2007, MIE2008 and AMIA2008 were rated on these items by two reviewers. From these ratings a priority adjusted completeness score was computed for each paper.

Results: We identified 104 reporting items from the STARE-HI guideline. The response rate for the survey was 59% (66 out of 111). The most important reporting items (mean score ≥ 9) were “Interpret the data and give an answer to the study question – (in Discussion)”, “Whether it is a laboratory, simulation or field study – (in Methods-study design)” and “Description of the outcome measure/evaluation criteria – (in Methods-study design)”. Per reporting area the statistically more significant important reporting items were distinguished from less important ones. Four reporting items had a mean score ≤ 6. The mean priority adjusted completeness of evaluation papers of recent health informatics conferences was 48% (range 14 –78%).

Conclusion: We produced a ranked list of reporting items from STARE-HI according to their prioritized relevance for inclusion in space-limited conference papers. The priority adjusted completeness scores demonstrated room for improvement for the analyzed conference papers. We believe that this prioritization framework is an aid to improving the quality and utility of conference papers on health informatics evaluation studies.

The Time Needed for Clinical Documentation versus Direct Patient Care

Objectives: Health care professionals seem to be confronted with an increasing need for high-quality, timely, patient-oriented documentation. However, a steady increase in documentation tasks has been shown to be associated with increased time pressure and low physician job satisfaction. Our objective was to examine the time physicians spend on clinical and administrative documentation tasks. We analyzed the time needed for clinical and administrative documentation, and compared it to other tasks, such as direct patient care.

Methods: During a 2-month period (December 2006 to January 2007) a trained investigator completed 40 hours of 2-minute work-sampling analysis from eight participating physicians on two internal medicine wards of a 200-bed hospital in Austria. A 37-item classifica tion system was applied to categorize tasks into five categories (direct patient care, communication, clinical documentation, administrative documentation, other).

Results: From the 5555 observation points, physicians spent 26.6% of their daily working time for documentation tasks, 27.5% for direct patient care, 36.2% for communication tasks, and 9.7% for other tasks. The documentation that is typically seen as administrative takes only approx. 16% of the total documentation time.

Conclusions: Nearly as much time is being spent for documentation as is spent on direct patient care. Computer-based tools and, in some areas, documentation assistants may help to reduce the clinical and administrative documentation efforts.

Evaluation Considerations for Secondary Uses of Clinical Data: Principles for an Evidence-based Approach to Policy and Implementation of Secondary Analysis

Objectives: To set the scientific context and then suggest principles for an evidence-based approach to secondary uses of clinical data, covering both evaluation of the secondary uses of data and evaluation of health systems and services based upon secondary uses of data. Method: Working Group review of selected literature and policy approaches. Results: We present important considerations in the evaluation of secondary uses of clinical data from the angles of governance and trust, theory, semantics, and policy. We make the case for a multi-level and multi-factorial approach to the evaluation of secondary uses of clinical data and describe a methodological framework for best practice. We emphasise the importance of evaluating the governance of secondary uses of health data in maintaining trust, which is essential for such uses. We also offer examples of the re-use of routine health data to demonstrate how it can support evaluation of clinical performance and optimize health IT system design. Conclusions: Great expectations are resting upon "Big Data" and innovative analytics. However, to build and maintain public trust, improve data reliability, and assure the validity of analytic inferences, there must be independent and transparent evaluation. A mature and evidence-based approach needs not merely data science, but must be guided by the broader concerns of applied health informatics.

Improving Evaluation to Address the Unintended Consequences of Health Information Technology:. a Position Paper from the Working Group on Technology Assessment & Quality Development

BACKGROUND AND OBJECTIVES

With growing use of IT by healthcare professionals and patients, the opportunity for any unintended effects of technology to disrupt care health processes and outcomes is intensified. The objectives of this position paper by the IMIA Working Group (WG) on Technology Assessment and Quality Development are to highlight how our ongoing initiatives to enhance evaluation are also addressing the unintended consequences of health IT.

METHODS

Review of WG initiatives Results: We argue that an evidence-based approach underpinned by rigorous evaluation is fundamental to the safe and effective use of IT, and for detecting and addressing its unintended consequences in a timely manner. We provide an overview of our ongoing initiatives to strengthen study design, execution and reporting by using evaluation frameworks and guidelines which can enable better characterization and monitoring of unintended consequences, including the Good Evaluation Practice Guideline in Health Informatics (GEP-HI) and the Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI). Indicators to benchmark the adoption and impact of IT can similarly be used to monitor unintended effects on healthcare structures, processes and outcome. We have also developed EvalDB, a web-based database of evaluation studies to promulgate evidence about unintended effects and are developing the content for courses to improve training in health IT evaluation.

CONCLUSION

Evaluation is an essential ingredient for the effective use of IT to improve healthcare quality and patient safety. WG resources and skills development initiatives can facilitate a proactive and evidence-based approach to detecting and addressing the unintended effects of health IT.

SPIRIT: Systematic Planning of Intelligent Reuse of Integrated Clinical Routine Data. A Conceptual Best-practice Framework and Procedure Model

BACKGROUND

Secondary use of clinical routine data is receiving an increasing amount of attention in biomedicine and healthcare. However, building and analysing integrated clinical routine data repositories are nontrivial, challenging tasks. As in most evolving fields, recognized standards, well-proven methodological frameworks, or accurately described best-practice approaches for the systematic planning of solutions for secondary use of routine medical record data are missing.

OBJECTIVE

We propose a conceptual best-practice framework and procedure model for the systematic planning of intelligent reuse of integrated clinical routine data (SPIRIT).

METHODS

SPIRIT was developed based on a broad literature overview and further refined in two case studies with different kinds of clinical routine data, including process-oriented nursing data from a large hospital group and high-volume multimodal clinical data from a neurologic intensive care unit.

RESULTS

SPIRIT aims at tailoring secondary use solutions to specific needs of single departments without losing sight of the institution as a whole. It provides a general conceptual best-practice framework consisting of three parts: First, a secondary use strategy for the whole organization is determined. Second, comprehensive analyses are conducted from two different viewpoints to define the requirements regarding a clinical routine data reuse solution at the system level from the data perspective (BOTTOM UP) and at the strategic level from the future users perspective (TOP DOWN). An obligatory clinical context analysis (IN BETWEEN) facilitates refinement, combination, and integration of the different requirements. The third part of SPIRIT is dedicated to implementation, which comprises design and realization of clinical data integration and management as well as data analysis solutions.

CONCLUSIONS

The SPIRIT framework is intended to be used to systematically plan the intelligent reuse of clinical routine data for multiple purposes, which often was not intended when the primary clinical documentation systems were implemented. SPIRIT helps to overcome this gap. It can be applied in healthcare institutions of any size or specialization and allows a stepwise setup and evolution of holistic clinical routine data reuse solutions.

Evaluation of an Integrated Telemonitoring Surveillance System in Patients with Coronary Heart Disease

OBJECTIVES

Cardiovascular diseases are the most frequent cause of death in industrialized countries. Non-adherence with prescribed medication and recommended lifestyle changes significantly increases the risk of major cardiovascular events. The telemonitoring programme MyCor (Myokardinfarkt und Koronarstent Programm in Tirol) is a multi-modal intervention programme to improve lifestyle and medication management of patients with coronary heart disease (CHD). It includes patient education, self-monitoring with goal-setting and feedback, and regular clinical visits. We evaluated the MyCor telemonitoring programme regarding technical feasibility, user acceptance, patient adherence, change in health status, and change in quality of life.

METHODS

A 4½-month study was conducted with two telemonitoring phases and one interim phase. The study comprised patient surveys, standardized assessment of quality of life using the MacNew questionnaire at study entry and after 4 and 18 weeks, analysis of adherence to medication and physical activity during the two telemonitoring phases, and analysis of reached goals regarding health conditions during the telemonitoring phases.

RESULTS

Twenty-five patients (mean age: 63 years) participated in the study. Patients showed a high acceptance of the MyCor telemonitoring programme. Patients reported feelings of self-control, motivation for lifestyle changes, and improved quality of life. Adherence to daily measurements was high with 86% and 77% in the two telemonitoring phases. Adherence to medication was also high with up to 87% and 80%. Pre-defined goals for physical activity were reached in up to 86% and 73% of days, respectively. Quality of life improved from 5.5 at study entry to 6.3 at the end (p< 0.01; MacNew questionnaire). Reductions in blood pressure and heart rate or an improvement in reaching defined goals could not be observed.

CONCLUSIONS

The MyCor telemonitoring programme Tirol for CHD patients has a high rate of acceptance among included patients. Critical evaluation revealed subjective benefits regarding quality of life and health status as well as high adherence rates to medication and lifestyle changes. Achieving long-term adherence and verifying clinical outcomes, however, remains an open issue. Our findings will promote further studies, addressing different strategies for an optimal mix of patient education, telemonitoring, feedback, and clinical follow-ups.

Patient Portals as a Means of Information and Communication Technology Support to Patient- Centric Care Coordination - the Missing Evidence and the Challenges of Evaluation. A joint contribution of IMIA WG EVAL and EFMI WG EVAL

OBJECTIVES

To review the potential contribution of Information and Communication Technology (ICT) to enable patient-centric and coordinated care, and in particular to explore the role of patient portals as a developing ICT tool, to assess the available evidence, and to describe the evaluation challenges.

METHODS

Reviews of IMIA, EFMI, and other initiatives, together with literature reviews.

RESULTS

We present the progression from care coordination to care integration, and from patient-centric to person-centric approaches. We describe the different roles of ICT as an enabler of the effective presentation of information as and when needed. We focus on the patient's role as a co-producer of health as well as the focus and purpose of care. We discuss the need for changing organisational processes as well as the current mixed evidence regarding patient portals as a logical tool, and the reasons for this dichotomy, together with the evaluation principles supported by theoretical frameworks so as to yield robust evidence.

CONCLUSIONS

There is expressed commitment to coordinated care and to putting the patient in the centre. However to achieve this, new interactive patient portals will be needed to enable peer communication by all stakeholders including patients and professionals. Few portals capable of this exist to date. The evaluation of these portals as enablers of system change, rather than as simple windows into electronic records, is at an early stage and novel evaluation approaches are needed.

Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System

OBJECTIVES

Previous research has shown that medication alerting systems face usability issues. There has been no previous attempt to systematically explore the consequences of usability flaws in such systems on users (i.e. usage problems) and work systems (i.e. negative outcomes). This paper aims at exploring and synthesizing the consequences of usability flaws in terms of usage problems and negative outcomes on the work system.

METHODS

A secondary analysis of 26 papers included in a prior systematic review of the usability flaws in medication alerting was performed. Usage problems and negative outcomes were extracted and sorted. Links between usability flaws, usage problems, and negative outcomes were also analyzed.

RESULTS

Poor usability generates a large variety of consequences. It impacts the user from a cognitive, behavioral, emotional, and attitudinal perspective. Ultimately, usability flaws have negative consequences on the workflow, the effectiveness of the technology, the medication management process, and, more importantly, patient safety. Only few complete pathways leading from usability flaws to negative outcomes were identified.

CONCLUSION

Usability flaws in medication alerting systems impede users, and ultimately their work system, and negatively impact patient safety. Therefore, the usability dimension may act as a hidden explanatory variable that could explain, at least partly, the (absence of) intended outcomes of new technology.

A Nursing Intelligence System to Support Secondary Use of Nursing Routine Data

BACKGROUND

Nursing care is facing exponential growth of information from nursing documentation. This amount of electronically available data collected routinely opens up new opportunities for secondary use.

OBJECTIVES

To present a case study of a nursing intelligence system for reusing routinely collected nursing documentation data for multiple purposes, including quality management of nursing care.

METHODS

The SPIRIT framework for systematically planning the reuse of clinical routine data was leveraged to design a nursing intelligence system which then was implemented using open source tools in a large university hospital group following the spiral model of software engineering.

RESULTS

The nursing intelligence system is in routine use now and updated regularly, and includes over 40 million data sets. It allows the outcome and quality analysis of data related to the nursing process.

CONCLUSIONS

Following a systematic approach for planning and designing a solution for reusing routine care data appeared to be successful. The resulting nursing intelligence system is useful in practice now, but remains malleable for future changes.

Job Profiles of Biomedical Informatics Graduates. Results of a Graduate Survey

BACKGROUND

Biomedical informatics programs exist in many countries. Some analyses of the skills needed and of recommendations for curricular content for such programs have been published. However, not much is known of the job profiles and job careers of their graduates.

OBJECTIVES

To analyse the job profiles and job careers of 175 graduates of the biomedical informatics bachelor and master program of the Tyrolean university UMIT.

METHODS

Survey of all biomedical informatics students who graduated from UMIT between 2001 and 2013.

RESULTS

Information is available for 170 graduates. Eight percent of graduates are male. Of all bachelor graduates, 86% started a master program. Of all master graduates, 36% started a PhD. The job profiles are quite diverse: at the time of the survey, 35% of all master graduates worked in the health IT industry, 24% at research institutions, 9% in hospitals, 9% as medical doctors, 17% as informaticians outside the health care sector, and 6% in other areas. Overall, 68% of the graduates are working as biomedical informaticians. The results of the survey indicate a good job situation for the graduates.

CONCLUSIONS

The job opportunities for biomedical informaticians who graduated with a bachelor or master degree from UMIT seem to be quite good. The majority of graduates are working as biomedical informaticians. A larger number of comparable surveys of graduates from other biomedical informatics programs would help to enhance our knowledge about careers in biomedical informatics.

From adverse drug event detection to prevention. A novel clinical decision support framework for medication safety

BACKGROUND

Errors related to medication seriously affect patient safety and the quality of healthcare. It has been widely argued that various types of such errors may be prevented by introducing Clinical Decision Support Systems (CDSSs) at the point of care.

OBJECTIVES

Although significant research has been conducted in the field, still medication safety is a crucial issue, while few research outcomes are mature enough to be considered for use in actual clinical settings. In this paper, we present a clinical decision support framework targeting medication safety with major focus on adverse drug event (ADE) prevention.

METHODS

The novelty of the framework lies in its design that approaches the problem holistically, i.e., starting from knowledge discovery to provide reliable numbers about ADEs per hospital or medical unit to describe their consequences and probable causes, and next employing the acquired knowledge for decision support services development and deployment. Major design features of the framework's services are: a) their adaptation to the context of care (i.e. patient characteristics, place of care, and significance of ADEs), and b) their straightforward integration in the healthcare information technologies (IT) infrastructure thanks to the adoption of a service-oriented architecture (SOA) and relevant standards.

RESULTS

Our results illustrate the successful interoperability of the framework with two commercially available IT products, i.e., a Computerized Physician Order Entry (CPOE) and an Electronic Health Record (EHR) system, respectively, along with a Web prototype that is independent of existing healthcare IT products. The conducted clinical validation with domain experts and test cases illustrates that the impact of the framework is expected to be major, with respect to patient safety, and towards introducing the CDSS functionality in practical use.

CONCLUSIONS

This study illustrates an important potential for the applicability of the presented framework in delivering contextualized decision support services at the point of care and for making a substantial contribution towards ADE prevention. Nonetheless, further research is required in order to quantitatively and thoroughly assess its impact in medication safety.

Memorandum on the use of information technology to improve medication safety

BACKGROUND

Information technology in health care has a clear potential to improve the quality and efficiency of health care, especially in the area of medication processes. On the other hand, existing studies show possible adverse effects on patient safety when IT for medication-related processes is developed, introduced or used inappropriately.

OBJECTIVES

To summarize definitions and observations on IT usage in pharmacotherapy and to derive recommendations and future research priorities for decision makers and domain experts.

METHODS

This memorandum was developed in a consensus-based iterative process that included workshops and e-mail discussions among 21 experts coordinated by the Drug Information Systems Working Group of the German Society for Medical Informatics, Biometry and Epidemiology (GMDS).

RESULTS

The recommendations address, among other things, a stepwise and comprehensive strategy for IT usage in medication processes, the integration of contextual information for alert generation, the involvement of patients, the semantic integration of information resources, usability and adaptability of IT solutions, and the need for their continuous evaluation.

CONCLUSION

Information technology can help to improve medication safety. However, challenges remain regarding access to information, quality of information, and measurable benefits.

A proposal for an Austrian Nursing Minimum Data Set (NMDS): a Delphi study

OBJECTIVE

Nursing Minimum Data Sets can be used to compare nursing care across clinical populations, settings, geographical areas, and time. NMDS can support nursing research, nursing management, and nursing politics. However, in contrast to other countries, Austria does not have a unified NMDS. The objective of this study is to identify possible data elements for an Austrian NMDS.

METHODS

A two-round Delphi survey was conducted, based on a review of available NMDS, 22 expert interviews, and a focus group discussion.

RESULTS

After reaching consensus, the experts proposed the following 56 data elements for an NMDS: six data elements concerning patient demographics, four data elements concerning data of the healthcare institution, four data elements concerning patient's medical condition, 20 data elements concerning patient problems (nursing assessment, nursing diagnoses, risk assessment), eight data elements concerning nursing outcomes, 14 data elements concerning nursing interventions, and no additional data elements concerning nursing intensity.

CONCLUSION

The proposed NMDS focuses on the long-term and acute care setting. It must now be implemented and tested in the nursing practice.

Crucial factors for the acceptance of a computerized national medication list: insights into findings from the evaluation of the Austrian e-Medikation pilot

OBJECTIVE

The objective of this paper is to present crucial factors among registered doctors and pharmacists for acceptance of the Austrian 'e-Medikation' system which is aimed at providing, on a national level, complete and recent information on all the medication that were prescribed or dispensed to a patient.

METHODS

As the accompanying formative evaluation study of the pilot project showed different overall acceptance rates among participating physicians and pharmacists, a decision tree analysis of 30 standardized survey items was performed to identify crucial acceptance factors.

RESULTS

For the physicians' group, only two items (fear of improper data use and satisfaction with software support) were crucial for overall e-Medikation acceptance. The analysis of the pharmacists' data resulted in five crucial factors primarily focusing on functional aspects and the perceived benefits of e-Medikation.

CONCLUSION

The results indicate that the acceptance among physicians and pharmacists depends on quite different factors. This must be taken into account during the planned rollout of e-Medikation or of comparable products.

STARE-HI - Statement on Reporting of Evaluation Studies in Health Informatics: explanation and elaboration

BACKGROUND

Improving the quality of reporting of evaluation studies in health informatics is an important requirement towards the vision of evidence-based health informatics. The STARE-HI - Statement on Reporting of Evaluation Studies in health informatics, published in 2009, provides guidelines on the elements to be contained in an evaluation study report.

OBJECTIVES

To elaborate on and provide a rationale for the principles of STARE-HI and to guide authors and readers of evaluation studies in health informatics by providing explanatory examples of reporting.

METHODS

A group of methodologists, researchers and editors prepared the present elaboration of the STARE-HI statement and selected examples from the literature.

RESULTS

The 35 STARE-HI items to be addressed in evaluation papers describing health informatics interventions are discussed one by one and each is extended with examples and elaborations.

CONCLUSION

The STARE-HI statement and this elaboration document should be helpful resources to improve reporting of both quantitative and qualitative evaluation studies. Evaluation manuscripts adhering to the principles will enable readers of such papers to better place the studies in a proper context and judge their validity and generalizability, and thus in turn optimize the exploitation of the evidence contained therein.

LIMITATIONS

This paper is based on experiences of a group of editors, reviewers, authors of systematic reviews and readers of the scientific literature. The applicability of the details of these principles has to evolve as a function of their use in practice.

Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle. Joint Contribution of IMIA WG EVAL and EFMI WG EVAL

OBJECTIVES

To present the importance of Evidence-based Health Informatics (EBHI) and the ethical imperative of this approach; to highlight the work of the IMIA Working Group on Technology Assessment and Quality Improvement and the EFMI Working Group on Assessment of Health Information Systems; and to introduce the further important evaluation and evidence aspects being addressed.

METHODS

Reviews of IMIA, EFMA and other initiatives, together with literature reviews on evaluation methods and on published systematic reviews.

RESULTS

Presentation of the rationale for the health informatics domain to adopt a scientific approach by assessing impact, avoiding harm, and empirically demonstrating benefit and best use; reporting of the origins and rationale of the IMIA- and EQUATOR-endorsed Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI) and of the IMIA WG's Guideline for Good Evaluation Practice in Health Informatics (GEP-HI); presentation of other initiatives for objective evaluation; and outlining of further work in hand on usability and indicators; together with the case for development of relevant evaluation methods in newer applications such as telemedicine. The focus is on scientific evaluation as a reliable source of evidence, and on structured presentation of results to enable easy retrieval of evidence.

CONCLUSIONS

EBHI is feasible, necessary for efficiency and safety, and ethically essential. Given the significant impact of health informatics on health systems, care delivery and personal health, it is vital that cultures change to insist on evidence-based policies and investment, and that emergent global moves for this are supported.

eHealth in Europe - Status and Challenges

OBJECTIVES

To present European reflections on the concept of eHealth and emerging challenges related to further development of eHealth in Europe.

METHODS

A survey with 10 questions was distributed to representatives of the national member associations of the European Federation of Medical Informatics (EFMI).

RESULTS

The results document a shift from a constricting ICT-orientation to development of the entire health system where eHealth strategies, organizational change, and appropriate technological infrastructure are singled out as important aspects.

CONCLUSION

There are urgent needs to ensure that eHealth strategies and policies for further design and deployment of eHealth applications support sociable services and innovations in health care.

Biomedical informatics--a confluence of disciplines?

BACKGROUND

Biomedical informatics is a broad discipline that borrows many methods and techniques from other disciplines.

OBJECTIVE

To reflect a) on the character of biomedical informatics and to determine whether it is multi-disciplinary or inter-disciplinary; b) on the question whether biomedical informatics is more than the sum of its supporting disciplines and c) on the position of biomedical informatics with respect to related disciplines.

METHOD

Inviting an international group of experts in biomedical informatics and related disciplines on the occasion of the 50th anniversary of Methods of Information in Medicine to present their viewpoints.

RESULTS AND CONCLUSIONS

This paper contains the reflections of a number of the invited experts on the character of biomedical informatics. Most of the authors agree that biomedical informatics is an interdisciplinary field of study where researchers with different scientific backgrounds alone or in combination carry out research. Biomedical informatics is a very broad scientific field and still expanding, yet comprised of a constructive aspect (designing and building systems). One author expressed that the essence of biomedical informatics, as opposed to related disciplines, lies in the modelling of the biomedical content. Interdisciplinarity also has consequences for education. Maintaining rigid disciplinary structures does not allow for sufficient adaptability to capitalize on important trends nor to leverage the influences these trends may have on biomedical informatics. It is therefore important for students to become aware of research findings in related disciplines. In this respect, it was also noted that the fact that many scientific fields use different languages and that the research findings are stored in separate bibliographic databases makes it possible that potentially connected findings will never be linked, despite the fact that these findings were published. Bridges between the sciences are needed for the success of biomedical informatics.

Health Informatics 3.0 and other increasingly dispersed technologies require even greater trust: promoting safe evidence-based health informatics. Contribution of the IMIA Working Group on Technology Assessment & Quality Development in Health Informatics

BACKGROUND

Health informatics is generally less committed to a scientific evidence-based approach than any other area of health science, which is an unsound position. Introducing the new Web 3.0 paradigms into health IT applications can unleash a further great potential, able to integrate and distribute data from multiple sources. The counter side is that it makes the user and the patient evermore dependent on the 'black box' of the system, and the re-use of the data remote from the author and initial context. Thus anticipatory consideration of uses, and proactive analysis of evidence of effects, are imperative, as only when a clinical technology can be proven to be trustworthy and safe should it be implemented widely - as is the case with other health technologies.

OBJECTIVES

To argue for promoting evidence-based health informatics as systems become more powerful and pro-active yet more dispersed and remote; and evaluation as the means of generating the necessary scientific evidence base. To present ongoing IMIA and EFMI initiatives in this field.

METHODS

Critical overview of recent developments in health informatics evaluation, alongside the precedents of other health technologies, summarising current initiatives and the new challenges presented by Health Informatics 3.0.

RESULTS

Web 3.0 should be taken as an opportunity to move health informatics from being largely unaccountable to one of being an ethical and responsible science-based domain. Recent and planned activities of the EFMI and IMIA working groups have significantly progressed key initiatives.

CONCLUSIONS

Concurrent with the emergence of Web 3.0 as a means of new-generation diffuse health information systems comes an increasing need for an evidence-based culture in health informatics.

"Why the hell do we need electronic health records?". EHR acceptance among physicians in private practice in Austria: a qualitative study

BACKGROUND

Progress in the medical sciences, together with related technologies, in the past has led to higher specialization and has created a strong need to exchange health information across institutional borders. The concept of electronic health records (EHR) was introduced to fulfill these needs. Remarkably, many EHR introduction projects ran into trouble, not least because they lacked the acceptance of EHR among physicians. Negative emotions, such as anxiety and fear due to a lack of information, may cause change barriers and hamper physicians' acceptance of such projects.

OBJECTIVES

The goal of this study was to gain deeper insight into the negative emotions related to the intended implementation of a mandatory national electronic health record system (called ELGA) in Austria among physicians in private practice.

METHODS

Qualitative, problem-centered interviews were conducted with eight physicians in private practice in the capital region of Tyrol. The methods of qualitative content analysis were used to analyze the data.

RESULTS

Three hundred and twenty-eight passages in the interviews were selected, annotated, and paraphrased. These passages were assigned to 139 different primary categories. Finally, 18 main categories in the form of statements were derived. They were correlated and a theoretical model was formed to explain the genesis of the detected fears and anxiety related to the ELGA project. The results show that the physicians feel uninformed and snubbed. They fear unknown changes, increased costs, as well as workload and surveillance without obtaining any advantages from using electronic health records in their daily practice.

CONCLUSION

Impartial information campaigns that are tailored to the physicians' needs and questions as along with a comprehensive cost-benefit analysis could benefit the physicians' opinion of EHRs.

Electronic health records. A systematic review on quality requirements

OBJECTIVES

Since the first concepts for electronic health records (EHRs) in the 1990s, the content, structure, and technology of such records were frequently changed and adapted. The basic idea to support and enhance health care stayed the same over time. To reach these goals, it is crucial that EHRs themselves adhere to rigid quality requirements. The present review aims at describing the currently available, mainly non-functional, quality requirements with regard to electronic health records.

METHODS

A combined approach - systematic literature analysis and expert interviews - was used. The literature analysis as well as the expert interviews included sources/experts from different domains such as standards and norms, scientific literature and guidelines, and best practice. The expert interviews were performed by using problem-centric qualitative computer-assisted telephone interviews (CATIs) or face-to-face interviews. All of the data that was obtained was analyzed using qualitative content analysis techniques.

RESULTS

In total, more than 1200 requirements were identified of which 203 requirements were also mentioned during the expert interviews. The requirements are organized according to the ISO 9126 and the eEurope 2002 criteria. Categories with the highest number of requirements found include global requirements, (general) functional requirements and data security. The number of non-functional requirements found is by contrast lower.

CONCLUSION

The manuscript gives comprehensive insight into the currently available, primarily non-functional, EHR requirements. To our knowledge, there are no other publications that have holistically reported on this topic. The requirements identified can be used in different ways, e.g. the conceptual design, the development of EHR systems, as a starting point for further refinement or as a basis for the development of specific sets of requirements.

Quality and Certification of Electronic Health Records: An overview of current approaches from the US and Europe

BACKGROUND

Numerous projects, initiatives, and programs are dedicated to the development of Electronic Health Records (EHR) worldwide. Increasingly more of these plans have recently been brought from a scientific environment to real life applications. In this context, quality is a crucial factor with regard to the acceptance and utility of Electronic Health Records. However, the dissemination of the existing quality approaches is often rather limited.

OBJECTIVES

The present paper aims at the description and comparison of the current major quality certification approaches to EHRs.

METHODS

A literature analysis was carried out in order to identify the relevant publications with regard to EHR quality certification. PubMed, ACM Digital Library, IEEExplore, CiteSeer, and Google (Scholar) were used to collect relevant sources. The documents that were obtained were analyzed using techniques of qualitative content analysis.

RESULTS

The analysis discusses and compares the quality approaches of CCHIT, EuroRec, IHE, openEHR, and EN13606. These approaches differ with regard to their focus, support of service-oriented EHRs, process of (re-)certification and testing, number of systems certified and tested, supporting organizations, and regional relevance.

DISCUSSION

The analyzed approaches show differences with regard to their structure and processes. System vendors can exploit these approaches in order to improve and certify their information systems. Health care organizations can use these approaches to support selection processes or to assess the quality of their own information systems.