1
|
Ammenwerth E, Buchauer A, Bludau B, Haux R. Mobile information and communication tools in the hospital. Int J Med Inform 2000; 57:21-40. [PMID: 10708253 DOI: 10.1016/s1386-5056(99)00056-8] [Citation(s) in RCA: 105] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Mobile information and communication systems in clinical routine have the potential to greatly improve communication, facilitate information access, eliminate double documentation, and increase quality of patient care in the long run. Projects to date have focused, for the most part, on highly specialized applications of the mobile computer. In our research project, 'Cooperative Problem Solving in Health Care', we have, among other things, designed a multifunctional mobile information and communication assistant. A prototype version of this system was implemented. This article outlines the close-to-reality evaluation of our prototype in a 1-week simulation study in a Heidelberg University hospital. We describe methods, aims, design and results of the simulation study, as well as discuss our methodology and the results we have obtained. We argue that the diverse requirements of different professional groups cannot be fulfilled by a single multifunctional device and propose, therefore, a 'multi-device mobile computer architecture'. Finally, we present consequences for the future computing infrastructure.
Collapse
|
|
25 |
105 |
2
|
Spötl HP, Ammenwerth E. The Time Needed for Clinical Documentation versus Direct Patient Care. Methods Inf Med 2018. [DOI: 10.3414/me0569] [Citation(s) in RCA: 92] [Impact Index Per Article: 13.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Summary
Objectives: Health care professionals seem to be confronted with an increasing need for high-quality, timely, patient-oriented documentation. However, a steady increase in documentation tasks has been shown to be associated with increased time pressure and low physician job satisfaction. Our objective was to examine the time physicians spend on clinical and administrative documentation tasks. We analyzed the time needed for clinical and administrative documentation, and compared it to other tasks, such as direct patient care.
Methods: During a 2-month period (December 2006 to January 2007) a trained investigator completed 40 hours of 2-minute work-sampling analysis from eight participating physicians on two internal medicine wards of a 200-bed hospital in Austria. A 37-item classifica tion system was applied to categorize tasks into five categories (direct patient care, communication, clinical documentation, administrative documentation, other).
Results: From the 5555 observation points, physicians spent 26.6% of their daily working time for documentation tasks, 27.5% for direct patient care, 36.2% for communication tasks, and 9.7% for other tasks. The documentation that is typically seen as administrative takes only approx. 16% of the total documentation time.
Conclusions: Nearly as much time is being spent for documentation as is spent on direct patient care. Computer-based tools and, in some areas, documentation assistants may help to reduce the clinical and administrative documentation efforts.
Collapse
|
|
7 |
92 |
3
|
Hoerbst A, Ammenwerth E. Electronic health records. A systematic review on quality requirements. Methods Inf Med 2010; 49:320-36. [PMID: 20603687 DOI: 10.3414/me10-01-0038] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2010] [Accepted: 06/09/2010] [Indexed: 11/09/2022]
Abstract
OBJECTIVES Since the first concepts for electronic health records (EHRs) in the 1990s, the content, structure, and technology of such records were frequently changed and adapted. The basic idea to support and enhance health care stayed the same over time. To reach these goals, it is crucial that EHRs themselves adhere to rigid quality requirements. The present review aims at describing the currently available, mainly non-functional, quality requirements with regard to electronic health records. METHODS A combined approach - systematic literature analysis and expert interviews - was used. The literature analysis as well as the expert interviews included sources/experts from different domains such as standards and norms, scientific literature and guidelines, and best practice. The expert interviews were performed by using problem-centric qualitative computer-assisted telephone interviews (CATIs) or face-to-face interviews. All of the data that was obtained was analyzed using qualitative content analysis techniques. RESULTS In total, more than 1200 requirements were identified of which 203 requirements were also mentioned during the expert interviews. The requirements are organized according to the ISO 9126 and the eEurope 2002 criteria. Categories with the highest number of requirements found include global requirements, (general) functional requirements and data security. The number of non-functional requirements found is by contrast lower. CONCLUSION The manuscript gives comprehensive insight into the currently available, primarily non-functional, EHR requirements. To our knowledge, there are no other publications that have holistically reported on this topic. The requirements identified can be used in different ways, e.g. the conceptual design, the development of EHR systems, as a starting point for further refinement or as a basis for the development of specific sets of requirements.
Collapse
|
Systematic Review |
15 |
61 |
4
|
Eichstädter R, Haux R, Pohl U, Rebel S, Ziegler S, Ammenwerth E. A Randomized Evaluation of a Computer-Based Nursing Documentation System. Methods Inf Med 2018. [DOI: 10.1055/s-0038-1634465] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
AbstractA two-month randomized, controlled trial based on 60 patients has been performed on a ward of the Department of Psychiatry at Heidelberg University Medical Center, Germany, to investigate the influence of computer-based nursing documentation on time investment for documentation, quality of documentation and user acceptance. Time measurements, questionnaires, documentation analysis and interviews were used to compare patients documented with the computer-based system (PIK group) with the control group (patients documented with the paper-based system). The results showed the advantages and disadvantages of computer-based nursing documentation. Time needed for nursing care planning was lower in the PIK group. Some formal aspects of quality were considerably better in the PIK group. On the other hand, time required for documentation of tasks and for report writing was greater in the PIK group. User acceptance increased significantly during the study. The interviews indicated a positive influence of PIK on the cooperation between nurses and physicians.
Collapse
|
|
7 |
48 |
5
|
Bürkle T, Ammenwerth E, Prokosch HU, Dudeck J. Evaluation of clinical information systems. What can be evaluated and what cannot? J Eval Clin Pract 2001; 7:373-85. [PMID: 11737529 DOI: 10.1046/j.1365-2753.2001.00291.x] [Citation(s) in RCA: 42] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
The evaluation of clinical information systems is essential as they are increasingly used in clinical routine and may even influence patient outcome on the basis of reminder functions and decision support. Therefore we try to answer three questions in this paper: what to evaluate; how to evaluate; how to interpret the results. Those key questions lead to the discussion of goals, methods and results of evaluation studies in a common context. We will compare the objectivist and the subjectivist evaluation approach and illustrate the evaluation process itself in some detail, discussing different phases of software development and potential evaluation techniques in each phase. We use four different practical examples of evaluation studies that were conducted in various settings to demonstrate how defined evaluation goals may be achieved with a limited amount of resources. This also illustrates advantages, limitations and costs of the different evaluation methods and techniques that may be used when evaluating clinical information systems.
Collapse
|
|
24 |
42 |
6
|
Brender J, Talmon J, de Keizer N, Nykänen P, Rigby M, Ammenwerth E. STARE-HI - Statement on Reporting of Evaluation Studies in Health Informatics: explanation and elaboration. Appl Clin Inform 2013; 4:331-58. [PMID: 24155788 PMCID: PMC3799207 DOI: 10.4338/aci-2013-04-ra-0024] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2013] [Accepted: 06/29/2013] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Improving the quality of reporting of evaluation studies in health informatics is an important requirement towards the vision of evidence-based health informatics. The STARE-HI - Statement on Reporting of Evaluation Studies in health informatics, published in 2009, provides guidelines on the elements to be contained in an evaluation study report. OBJECTIVES To elaborate on and provide a rationale for the principles of STARE-HI and to guide authors and readers of evaluation studies in health informatics by providing explanatory examples of reporting. METHODS A group of methodologists, researchers and editors prepared the present elaboration of the STARE-HI statement and selected examples from the literature. RESULTS The 35 STARE-HI items to be addressed in evaluation papers describing health informatics interventions are discussed one by one and each is extended with examples and elaborations. CONCLUSION The STARE-HI statement and this elaboration document should be helpful resources to improve reporting of both quantitative and qualitative evaluation studies. Evaluation manuscripts adhering to the principles will enable readers of such papers to better place the studies in a proper context and judge their validity and generalizability, and thus in turn optimize the exploitation of the evidence contained therein. LIMITATIONS This paper is based on experiences of a group of editors, reviewers, authors of systematic reviews and readers of the scientific literature. The applicability of the details of these principles has to evolve as a function of their use in practice.
Collapse
|
Guideline |
12 |
42 |
7
|
Jung M, Hackl WO, Kirrane F, Borbolla D, Jaspers MW, Oertle M, Koutkias V, Ferret L, Massari P, Lawton K, Riedmann D, Darmoni S, Maglaveras N, Lovis C, Ammenwerth E, Hoerbst A. Attitude of Physicians Towards Automatic Alerting in Computerized Physician Order Entry Systems. Methods Inf Med 2018. [DOI: 10.3414/me12-02-0007] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
SummaryObjectives: To analyze the attitude of physicians towards alerting in CPOE systems in different hospitals in different countries, addressing various organizational and technical settings and the view of physicians not currently using a CPOE.Methods: A cross-sectional quantitative and qualitative questionnaire survey. We invited 2,600 physicians in eleven hospitals from nine countries to participate. Eight of the hospitals had different CPOE systems in use, and three of the participating hospitals were not using a CPOE system.Results: 1,018 physicians participated. The general attitude of the physicians towards CPOE alerting is positive and is found to be mostly independent of the country, the specific organizational settings in the hospitals and their personal experience with CPOE systems. Both quantitative and qualitative results show that the majority of the physicians, both CPOE-users and non-users, appreciate the benefits of alerting in CPOE systems on medication safety. However, alerting should be better adapted to the clinical context and make use of more sophisticated ways to present alert information. The vast majority of physicians agree that additional information regarding interactions is useful on demand. Around half of the respondents see possible alert overload as a major problem; in this regard, physicians in hospitals with sophisticated alerting strategies show partly better attitude scores.Conclusions: Our results indicate that the way alerting information is presented to the physicians may play a role in their general attitude towards alerting, and that hospitals with a sophisticated alerting strategy with less interruptive alerts tend towards more positive attitudes. This aspect needs to be further investigated in future studies.
Collapse
|
|
7 |
40 |
8
|
Winter AF, Ammenwerth E, Bott OJ, Brigl B, Buchauer A, Gräber S, Grant A, Häber A, Hasselbring W, Haux R, Heinrich A, Janssen H, Kock I, Penger OS, Prokosch HU, Terstappen A, Winter A. Strategic information management plans: the basis for systematic information management in hospitals. Int J Med Inform 2001; 64:99-109. [PMID: 11734379 DOI: 10.1016/s1386-5056(01)00219-2] [Citation(s) in RCA: 37] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Information management in hospitals is a complex task. In order to reduce complexity, we distinguish strategic, tactical, and operational information management. This is essential, because each of these information management levels views hospital information systems from different perspectives, and therefore uses other methods and tools. Since all these management activities deal only in part with computers, but mainly with human beings and their social behavior, we define a hospital information system as a sociotechnical subsystem of a hospital. Without proper strategic planning it would be a matter of chance, if a hospital information system would fulfil the information strategies goals. In order to support strategic planning and to reduce efforts for creating strategic plans, we propose a practicable structure.
Collapse
|
|
24 |
37 |
9
|
Rigby M, Georgiou A, Hyppönen H, Ammenwerth E, de Keizer N, Magrabi F, Scott P. Patient Portals as a Means of Information and Communication Technology Support to Patient- Centric Care Coordination - the Missing Evidence and the Challenges of Evaluation. A joint contribution of IMIA WG EVAL and EFMI WG EVAL. Yearb Med Inform 2015; 10:148-59. [PMID: 26123909 PMCID: PMC4587055 DOI: 10.15265/iy-2015-007] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
OBJECTIVES To review the potential contribution of Information and Communication Technology (ICT) to enable patient-centric and coordinated care, and in particular to explore the role of patient portals as a developing ICT tool, to assess the available evidence, and to describe the evaluation challenges. METHODS Reviews of IMIA, EFMI, and other initiatives, together with literature reviews. RESULTS We present the progression from care coordination to care integration, and from patient-centric to person-centric approaches. We describe the different roles of ICT as an enabler of the effective presentation of information as and when needed. We focus on the patient's role as a co-producer of health as well as the focus and purpose of care. We discuss the need for changing organisational processes as well as the current mixed evidence regarding patient portals as a logical tool, and the reasons for this dichotomy, together with the evaluation principles supported by theoretical frameworks so as to yield robust evidence. CONCLUSIONS There is expressed commitment to coordinated care and to putting the patient in the centre. However to achieve this, new interactive patient portals will be needed to enable peer communication by all stakeholders including patients and professionals. Few portals capable of this exist to date. The evaluation of these portals as enablers of system change, rather than as simple windows into electronic records, is at an early stage and novel evaluation approaches are needed.
Collapse
|
Review |
10 |
36 |
10
|
Abstract
SummaryBackground: Health IT is expected to have a positive impact on the quality and efficiency of health care. But reports on negative impact and patient harm continue to emerge. The obligation of health informatics is to make sure that health IT solutions provide as much benefit with as few negative side effects as possible. To achieve this, health informatics as a discipline must be able to learn, both from its successes as well as from its failures.Objectives: To present motivation, vision, and history of evidence-based health informatics, and to discuss achievements, challenges, and needs for action.Methods: Reflections on scientific literature and on own experiences.Results: Eight challenges on the way towards evidence-based health informatics are identified and discussed: quality of studies; publication bias; reporting quality; availability of publications; systematic reviews and meta-analysis; training of health IT evaluation experts; translation of evidence into health practice; and post-market surveil-lance. Identified needs for action comprise: establish health IT study registers; increase the quality of publications; develop a taxonomy for health IT systems; improve indexing of published health IT evaluation papers; move from meta-analysis to meta-summaries; include health IT evaluation competencies in curricula; develop evidence-based implementation frameworks; and establish post-marketing surveillance for health IT.Conclusions: There has been some progress, but evidence-based health informatics is still in its infancy. Building evidence in health informatics is our obligation if we consider medical informatics a scientific discipline.
Collapse
|
|
7 |
33 |
11
|
Hackl WO, Hoerbst A, Ammenwerth E. "Why the hell do we need electronic health records?". EHR acceptance among physicians in private practice in Austria: a qualitative study. Methods Inf Med 2010; 50:53-61. [PMID: 21057716 DOI: 10.3414/me10-02-0020] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2010] [Accepted: 08/26/2010] [Indexed: 11/09/2022]
Abstract
BACKGROUND Progress in the medical sciences, together with related technologies, in the past has led to higher specialization and has created a strong need to exchange health information across institutional borders. The concept of electronic health records (EHR) was introduced to fulfill these needs. Remarkably, many EHR introduction projects ran into trouble, not least because they lacked the acceptance of EHR among physicians. Negative emotions, such as anxiety and fear due to a lack of information, may cause change barriers and hamper physicians' acceptance of such projects. OBJECTIVES The goal of this study was to gain deeper insight into the negative emotions related to the intended implementation of a mandatory national electronic health record system (called ELGA) in Austria among physicians in private practice. METHODS Qualitative, problem-centered interviews were conducted with eight physicians in private practice in the capital region of Tyrol. The methods of qualitative content analysis were used to analyze the data. RESULTS Three hundred and twenty-eight passages in the interviews were selected, annotated, and paraphrased. These passages were assigned to 139 different primary categories. Finally, 18 main categories in the form of statements were derived. They were correlated and a theoretical model was formed to explain the genesis of the detected fears and anxiety related to the ELGA project. The results show that the physicians feel uninformed and snubbed. They fear unknown changes, increased costs, as well as workload and surveillance without obtaining any advantages from using electronic health records in their daily practice. CONCLUSION Impartial information campaigns that are tailored to the physicians' needs and questions as along with a comprehensive cost-benefit analysis could benefit the physicians' opinion of EHRs.
Collapse
|
Journal Article |
15 |
32 |
12
|
Hübner-Bloder G, Ammenwerth E. Key performance indicators to benchmark hospital information systems - a delphi study. Methods Inf Med 2009; 48:508-18. [PMID: 19893854 DOI: 10.3414/me09-01-0044] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2009] [Accepted: 07/29/2009] [Indexed: 11/09/2022]
Abstract
OBJECTIVES To identify the key performance indicators for hospital information systems (HIS) that can be used for HIS benchmarking. METHODS A Delphi survey with one qualitative and two quantitative rounds. Forty-four HIS experts from health care IT practice and academia participated in all three rounds. RESULTS Seventy-seven performance indicators were identified and organized into eight categories: technical quality, software quality, architecture and interface quality, IT vendor quality, IT support and IT department quality, workflow support quality, IT outcome quality, and IT costs. The highest ranked indicators are related to clinical workflow support and user satisfaction. Isolated technical indicators or cost indicators were not seen as useful. The experts favored an interdisciplinary group of all the stakeholders, led by hospital management, to conduct the HIS benchmarking. They proposed benchmarking activities both in regular (annual) intervals as well as at defined events (for example after IT introduction). Most of the experts stated that in their institutions no HIS benchmarking activities are being performed at the moment. CONCLUSION In the context of IT governance, IT benchmarking is gaining importance in the healthcare area. The found indicators reflect the view of health care IT professionals and researchers. Research is needed to further validate and operationalize key performance indicators, to provide an IT benchmarking framework, and to provide open repositories for a comparison of the HIS benchmarks of different hospitals.
Collapse
|
Journal Article |
16 |
29 |
13
|
Ammenwerth E, Kutscha U, Kutscha A, Mahler C, Eichstädter R, Haux R. Nursing process documentation systems in clinical routine--prerequisites and experiences. Int J Med Inform 2001; 64:187-200. [PMID: 11734385 DOI: 10.1016/s1386-5056(01)00216-7] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Documentation of the nursing process is an important, but often neglected part of clinical documentation. Paper-based systems have been introduced to support nursing process documentation. Frequently, however, problems, such as low quality and high writing efforts, are reported. However, it is still unclear if computer-based documentation systems can reduce these problems. At the Heidelberg University Medical Center, computer-based nursing process documentation projects began in 1998. A computer-based nursing documentation system has now been successfully introduced on four wards of three different departments, supporting all six phases of the nursing process. The introduction of the new documentation system was accompanied by systematic evaluations of prerequisites and consequences. In this paper, we present preliminary results of this evaluation, focusing on prerequisites of computer-based nursing process documentation. We will discuss in detail the creation and use of predefined nursing care plans as one important prerequisite for computer-based nursing documentation. We will also focus on acceptance issues and on organizational and technical issues.
Collapse
|
Evaluation Study |
24 |
28 |
14
|
Ammenwerth E, Woess S, Baumgartner C, Fetz B, van der Heidt A, Kastner P, Modre-Osprian R, Welte S, Poelzl G. Evaluation of an Integrated Telemonitoring Surveillance System in Patients with Coronary Heart Disease. Methods Inf Med 2015; 54:388-97. [PMID: 26395147 DOI: 10.3414/me15-02-0002] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2015] [Accepted: 07/06/2015] [Indexed: 11/09/2022]
Abstract
OBJECTIVES Cardiovascular diseases are the most frequent cause of death in industrialized countries. Non-adherence with prescribed medication and recommended lifestyle changes significantly increases the risk of major cardiovascular events. The telemonitoring programme MyCor (Myokardinfarkt und Koronarstent Programm in Tirol) is a multi-modal intervention programme to improve lifestyle and medication management of patients with coronary heart disease (CHD). It includes patient education, self-monitoring with goal-setting and feedback, and regular clinical visits. We evaluated the MyCor telemonitoring programme regarding technical feasibility, user acceptance, patient adherence, change in health status, and change in quality of life. METHODS A 4½-month study was conducted with two telemonitoring phases and one interim phase. The study comprised patient surveys, standardized assessment of quality of life using the MacNew questionnaire at study entry and after 4 and 18 weeks, analysis of adherence to medication and physical activity during the two telemonitoring phases, and analysis of reached goals regarding health conditions during the telemonitoring phases. RESULTS Twenty-five patients (mean age: 63 years) participated in the study. Patients showed a high acceptance of the MyCor telemonitoring programme. Patients reported feelings of self-control, motivation for lifestyle changes, and improved quality of life. Adherence to daily measurements was high with 86% and 77% in the two telemonitoring phases. Adherence to medication was also high with up to 87% and 80%. Pre-defined goals for physical activity were reached in up to 86% and 73% of days, respectively. Quality of life improved from 5.5 at study entry to 6.3 at the end (p< 0.01; MacNew questionnaire). Reductions in blood pressure and heart rate or an improvement in reaching defined goals could not be observed. CONCLUSIONS The MyCor telemonitoring programme Tirol for CHD patients has a high rate of acceptance among included patients. Critical evaluation revealed subjective benefits regarding quality of life and health status as well as high adherence rates to medication and lifestyle changes. Achieving long-term adherence and verifying clinical outcomes, however, remains an open issue. Our findings will promote further studies, addressing different strategies for an optimal mix of patient education, telemonitoring, feedback, and clinical follow-ups.
Collapse
|
Research Support, Non-U.S. Gov't |
10 |
27 |
15
|
Talmon J, Ash JS, Bates DW, Beuscart-Zéphir MC, Duhamel A, Elkin PL, Gardner RM, Geissbuhler A, Ammenwerth E. Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages. Methods Inf Med 2018. [DOI: 10.1055/s-0038-1634123] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
Summary
Objective:
To analyze the seemingly contradictory results of the Han study (Pediatrics 2005) and the Del Beccaro study (Pediatrics 2006), both analyzing the effect of CPOE systems on mortality rates in pediatric intensive care settings.
Methods:
Seven CPOE system experts from the United States and Europe comment on these papers.
Results:
The two studies are not contradictory, but almost non-comparable due to differences in design and implementation. They demonstrate the range of outcomes that can be obtained from introducing informatics applications in complex health care settings. Implementing informatics applications is a socio-technical activity, which often depends more on the organizational context than on a specific technology. As health informaticians, we must not only learn from failures, but also avoid both uncritical scepticism that may arise from drawing overly general conclusions from one negative trial, as much as uncritical optimism from limited successful ones.
Conclusion:
The commentaries emphasize the need to promote systematic studies for assessing the socio-technical factors that influence the introduction of increasingly sophisticated informatics applications within complex organizations. The emergence of evidence-based health informatics will be based both on evaluation guidelines and implementation guidelines, both of which increase the chances of successful implementation. In addition, well-educated health informaticians are needed to manage and guide the implementation processes.
Collapse
|
|
7 |
27 |
16
|
de Keizer NF, Ammenwerth E. The quality of evidence in health informatics: how did the quality of healthcare IT evaluation publications develop from 1982 to 2005? Int J Med Inform 2007; 77:41-9. [PMID: 17208040 DOI: 10.1016/j.ijmedinf.2006.11.009] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2006] [Revised: 11/28/2006] [Accepted: 11/28/2006] [Indexed: 11/28/2022]
Abstract
OBJECTIVE To obtain an overview of study designs and study methods used in research evaluating IT in health care, to present a list of quality criteria by which all kinds of reported evaluation studies on IT systems in health care can be assessed, and to assess the quality of reported evaluation studies on IT in health care and its development over time (1982-2005). METHODS A generic 10-item list of quality indicators was developed based on existing literature on quality of medical and medical informatics publications. It is applicable to all kind of IT evaluation papers and not restricted to randomized controlled trials. One hundred and twenty explanatory papers evaluating the effects of an IT system in health care published between 1982 and 2005 were randomly selected from PubMed, the study designs and study methods were extracted, and the quality indicators were used to assess the quality of each paper by two independent raters. RESULTS The inter-rater variability of scoring the 10 quality indicators as assessed by a pre-test with nine papers was good (K=0.87). There was a trend towards more multi-centre studies and authors coming more frequently from various departments. About 70% of the studies used a design other than a randomized controlled trial (RCT). Forty percent of the studies combined at least two different data acquisition methods. The quality of IT evaluation papers, as defined by the quality indicators, was only slightly improving in time (Spearman correlation coefficient [rs]=0.19). The quality of RCTs publications was significantly higher than the quality of non-RCT studies (p<0.001). CONCLUSION The continuous and dominant number of non-RCT studies reflects the various approaches applicable to evaluate IT systems in health care. Despite the increasing discussion on evidence-based health informatics, the quality of published evaluation studies on IT interventions in health care is still insufficient in some aspects. Journal editors and referees should take care that reports of evaluation on IT systems contain all aspects needed for a sufficient understanding and reproducibility of a paper. Publication guidelines should be developed to support more complete and better publications of IT evaluation papers.
Collapse
|
Review |
18 |
25 |
17
|
Brigl B, Ammenwerth E, Dujat C, Gräber S, Grosse A, Häber A, Jostes C, Winter A. Preparing strategic information management plans for hospitals: a practical guideline. Int J Med Inform 2005; 74:51-65. [PMID: 15626636 DOI: 10.1016/j.ijmedinf.2004.09.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2003] [Revised: 09/15/2004] [Accepted: 09/20/2004] [Indexed: 11/18/2022]
Abstract
OBJECTIVES Systematic information management in hospitals demands for a strategic information management plan (SIM plan). As preparing a SIM plan is a considerable challenge we provide a practical guideline that is directly applicable when a SIM plan is going to be prepared. METHODS The guideline recommends a detailed structure of a SIM plan and gives advice about its content and the preparation process. It may be used as template, which can be adapted to the individual demands of any hospital. RESULTS The guideline was used in several hospitals preparing a SIM plan. Experiences showed that the SIM plans could be prepared very efficiently and timely using the guideline, that the proposed SIM plan structure suited well, that the guideline offers enough flexibility to meet the requirements of the individual hospitals and that the specific recommendations of the guideline were very helpful. CONCLUSIONS Nevertheless, we must strive for a more comprehensive theory of strategic information management planning which -- in the sense of enterprise architecture planning -- represents the intrinsic correlations of the different parts of a SIM plan to a greater extent.
Collapse
|
|
20 |
22 |
18
|
Ammenwerth E, Nykänen P, Talmon J, Brender J. Factors Influencing Success and Failure of Health Informatics Systems. Methods Inf Med 2018. [DOI: 10.1055/s-0038-1634049] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
Summary
Objectives:
The aim is to gain information on factors influencing success and failure for Health Informatics applications from a group of medical informaticians.
Methods:
Based on the presentations at a special topic conference on success and failure in Health ICT and analysis of the proceedings, we conducted a Delphi study on success and failure aspects.
Results:
A total of 110 success factors and 27 failure criteria were identified, distributed on categories like functional, organizational, behavioral, technical, managerial, political, cultural, legal, strategy, economy, education and user acceptance. These factors and criteria were rated for six different system types. Unanimously it was agreed that “collaboration and co-operation” and “setting goals and courses” are “essential for the success” of clinical systems, and “user acceptance” for educational systems. Similarly, the score “essential in order to avoid a failure” were given unanimously on clinical systems for “response rate and other performance measures” and on administrative systems for “not understanding the organizational context” with “not understanding or foreseeing the extent to which the new IT-system affects the organization, its structure and/or work procedures” as the highest scoring sub-item.
Conclusions:
All success factors and failure criteria were considered relevant by the Delphi expert panel. There is no small set of relevant factors or indicators, but success or failure of a Health ICT depends on a large set of issues. Further, clinical systems and decision support systems depend on more factors than other systems.
Collapse
|
|
7 |
20 |
19
|
Marcilly R, Ammenwerth E, Roehrer E, Pelayo S, Vasseur F, Beuscart-Zéphir MC. Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System. Yearb Med Inform 2015; 10:55-67. [PMID: 26123906 DOI: 10.15265/iy-2015-006] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES Previous research has shown that medication alerting systems face usability issues. There has been no previous attempt to systematically explore the consequences of usability flaws in such systems on users (i.e. usage problems) and work systems (i.e. negative outcomes). This paper aims at exploring and synthesizing the consequences of usability flaws in terms of usage problems and negative outcomes on the work system. METHODS A secondary analysis of 26 papers included in a prior systematic review of the usability flaws in medication alerting was performed. Usage problems and negative outcomes were extracted and sorted. Links between usability flaws, usage problems, and negative outcomes were also analyzed. RESULTS Poor usability generates a large variety of consequences. It impacts the user from a cognitive, behavioral, emotional, and attitudinal perspective. Ultimately, usability flaws have negative consequences on the workflow, the effectiveness of the technology, the medication management process, and, more importantly, patient safety. Only few complete pathways leading from usability flaws to negative outcomes were identified. CONCLUSION Usability flaws in medication alerting systems impede users, and ultimately their work system, and negatively impact patient safety. Therefore, the usability dimension may act as a hidden explanatory variable that could explain, at least partly, the (absence of) intended outcomes of new technology.
Collapse
|
Systematic Review |
10 |
17 |
20
|
Ammenwerth E, Aly AF, Bürkle T, Christ P, Dormann H, Friesdorf W, Haas C, Haefeli WE, Jeske M, Kaltschmidt J, Menges K, Möller H, Neubert A, Rascher W, Reichert H, Schuler J, Schreier G, Schulz S, Seidling HM, Stühlinger W, Criegee-Rieck M. Memorandum on the use of information technology to improve medication safety. Methods Inf Med 2014; 53:336-43. [PMID: 24902537 DOI: 10.3414/me14-01-0040] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2014] [Accepted: 05/01/2014] [Indexed: 12/12/2022]
Abstract
BACKGROUND Information technology in health care has a clear potential to improve the quality and efficiency of health care, especially in the area of medication processes. On the other hand, existing studies show possible adverse effects on patient safety when IT for medication-related processes is developed, introduced or used inappropriately. OBJECTIVES To summarize definitions and observations on IT usage in pharmacotherapy and to derive recommendations and future research priorities for decision makers and domain experts. METHODS This memorandum was developed in a consensus-based iterative process that included workshops and e-mail discussions among 21 experts coordinated by the Drug Information Systems Working Group of the German Society for Medical Informatics, Biometry and Epidemiology (GMDS). RESULTS The recommendations address, among other things, a stepwise and comprehensive strategy for IT usage in medication processes, the integration of contextual information for alert generation, the involvement of patients, the semantic integration of information resources, usability and adaptability of IT solutions, and the need for their continuous evaluation. CONCLUSION Information technology can help to improve medication safety. However, challenges remain regarding access to information, quality of information, and measurable benefits.
Collapse
|
Journal Article |
11 |
16 |
21
|
Hackl WO, Hoerbst A, Duftschmid G, Gall W, Janzek-Hawlat S, Jung M, Woertz K, Dorda W, Ammenwerth E. Crucial factors for the acceptance of a computerized national medication list: insights into findings from the evaluation of the Austrian e-Medikation pilot. Appl Clin Inform 2014; 5:527-37. [PMID: 25024766 DOI: 10.4338/aci-2014-04-ra-0032] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2014] [Accepted: 04/30/2014] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVE The objective of this paper is to present crucial factors among registered doctors and pharmacists for acceptance of the Austrian 'e-Medikation' system which is aimed at providing, on a national level, complete and recent information on all the medication that were prescribed or dispensed to a patient. METHODS As the accompanying formative evaluation study of the pilot project showed different overall acceptance rates among participating physicians and pharmacists, a decision tree analysis of 30 standardized survey items was performed to identify crucial acceptance factors. RESULTS For the physicians' group, only two items (fear of improper data use and satisfaction with software support) were crucial for overall e-Medikation acceptance. The analysis of the pharmacists' data resulted in five crucial factors primarily focusing on functional aspects and the perceived benefits of e-Medikation. CONCLUSION The results indicate that the acceptance among physicians and pharmacists depends on quite different factors. This must be taken into account during the planned rollout of e-Medikation or of comparable products.
Collapse
|
Journal Article |
11 |
16 |
22
|
Abstract
Summary
Objective:
Health care is entering the age of information society. It is evident that the use of modern information and communication technology (ICT) offers tremendous opportunities to improve health care. However, there are also hazards associated with ICT in health care. We want to present an overview of typical hazards associated with ICT in health care, and to discuss how ICT evaluation can be a solution.
Methods:
We analyze examples of failures and problems associated with ICT in health care. This collection is also made available on a website.
Results and Conclusion:
Systematic, continuous evaluation of quality and effects of ICT during the whole life cycle of ICT components seems to be one important approach to detect and prevent possible ICT hazards and failures, supporting a higher quality of patient care. However, empirical studies proving this assumption are needed.
Collapse
|
|
7 |
15 |
23
|
Dugas M, Jöckel KH, Friede T, Gefeller O, Kieser M, Marschollek M, Ammenwerth E, Röhrig R, Knaup-Gregori P, Prokosch HU. Memorandum “Open Metadata”. Methods Inf Med 2018; 54:376-8. [DOI: 10.3414/me15-05-0007] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2015] [Accepted: 06/19/2015] [Indexed: 11/09/2022]
Abstract
SummaryAt present, most documentation forms and item catalogs in healthcare are not accessible to the public. This applies to assessment forms of routine patient care as well as case report forms (CRFs) of clinical and epidemiological studies. On behalf of the German chairs for Medical Informatics, Biometry and Epidemiology six recommendations to developers and users of documentation forms in healthcare were developed. Open access to medical documentation forms could substantially improve information systems in health-care and medical research networks. Therefore these forms should be made available to the scientific community, their use should not be unduly restricted, they should be published in a sustainable way using international standards and sources of documentation forms should be referenced in scientific publications.
Collapse
|
|
7 |
15 |
24
|
Ianosi B, Gaasch M, Rass V, Huber L, Hackl W, Kofler M, Schiefecker AJ, Addis A, Beer R, Rhomberg P, Pfausler B, Thomé C, Ammenwerth E, Helbok R. Early thrombosis prophylaxis with enoxaparin is not associated with hematoma expansion in patients with spontaneous intracerebral hemorrhage. Eur J Neurol 2018; 26:333-341. [DOI: 10.1111/ene.13830] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2018] [Accepted: 10/08/2018] [Indexed: 11/28/2022]
|
|
7 |
13 |
25
|
Koutkias VG, McNair P, Kilintzis V, Skovhus Andersen K, Niès J, Sarfati JC, Ammenwerth E, Chazard E, Jensen S, Beuscart R, Maglaveras N. From adverse drug event detection to prevention. A novel clinical decision support framework for medication safety. Methods Inf Med 2014; 53:482-92. [PMID: 25377477 DOI: 10.3414/me14-01-0027] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2014] [Accepted: 07/28/2014] [Indexed: 11/09/2022]
Abstract
BACKGROUND Errors related to medication seriously affect patient safety and the quality of healthcare. It has been widely argued that various types of such errors may be prevented by introducing Clinical Decision Support Systems (CDSSs) at the point of care. OBJECTIVES Although significant research has been conducted in the field, still medication safety is a crucial issue, while few research outcomes are mature enough to be considered for use in actual clinical settings. In this paper, we present a clinical decision support framework targeting medication safety with major focus on adverse drug event (ADE) prevention. METHODS The novelty of the framework lies in its design that approaches the problem holistically, i.e., starting from knowledge discovery to provide reliable numbers about ADEs per hospital or medical unit to describe their consequences and probable causes, and next employing the acquired knowledge for decision support services development and deployment. Major design features of the framework's services are: a) their adaptation to the context of care (i.e. patient characteristics, place of care, and significance of ADEs), and b) their straightforward integration in the healthcare information technologies (IT) infrastructure thanks to the adoption of a service-oriented architecture (SOA) and relevant standards. RESULTS Our results illustrate the successful interoperability of the framework with two commercially available IT products, i.e., a Computerized Physician Order Entry (CPOE) and an Electronic Health Record (EHR) system, respectively, along with a Web prototype that is independent of existing healthcare IT products. The conducted clinical validation with domain experts and test cases illustrates that the impact of the framework is expected to be major, with respect to patient safety, and towards introducing the CDSS functionality in practical use. CONCLUSIONS This study illustrates an important potential for the applicability of the presented framework in delivering contextualized decision support services at the point of care and for making a substantial contribution towards ADE prevention. Nonetheless, further research is required in order to quantitatively and thoroughly assess its impact in medication safety.
Collapse
|
Research Support, Non-U.S. Gov't |
11 |
12 |