1
|
Goodwin AJ, Eytan D, Dixon W, Goodfellow SD, Doherty Z, Greer RW, McEwan A, Tracy M, Laussen PC, Assadi A, Mazwi M. Timing errors and temporal uncertainty in clinical databases-A narrative review. Front Digit Health 2022; 4:932599. [PMID: 36060541 PMCID: PMC9433547 DOI: 10.3389/fdgth.2022.932599] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Accepted: 07/11/2022] [Indexed: 11/28/2022] Open
Abstract
A firm concept of time is essential for establishing causality in a clinical setting. Review of critical incidents and generation of study hypotheses require a robust understanding of the sequence of events but conducting such work can be problematic when timestamps are recorded by independent and unsynchronized clocks. Most clinical models implicitly assume that timestamps have been measured accurately and precisely, but this custom will need to be re-evaluated if our algorithms and models are to make meaningful use of higher frequency physiological data sources. In this narrative review we explore factors that can result in timestamps being erroneously recorded in a clinical setting, with particular focus on systems that may be present in a critical care unit. We discuss how clocks, medical devices, data storage systems, algorithmic effects, human factors, and other external systems may affect the accuracy and precision of recorded timestamps. The concept of temporal uncertainty is introduced, and a holistic approach to timing accuracy, precision, and uncertainty is proposed. This quantitative approach to modeling temporal uncertainty provides a basis to achieve enhanced model generalizability and improved analytical outcomes.
Collapse
Affiliation(s)
- Andrew J. Goodwin
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
- School of Biomedical Engineering, University of Sydney, Sydney, NSW, Australia
| | - Danny Eytan
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
- Department of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - William Dixon
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
| | - Sebastian D. Goodfellow
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
- Department of Civil and Mineral Engineering, University of Toronto, Toronto, ON, Canada
| | - Zakary Doherty
- Research Fellow, School of Rural Health, Monash University, Melbourne, VIC, Australia
| | - Robert W. Greer
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
| | - Alistair McEwan
- School of Biomedical Engineering, University of Sydney, Sydney, NSW, Australia
| | - Mark Tracy
- Neonatal Intensive Care Unit, Westmead Hospital, Sydney, NSW, Australia
- Department of Paediatrics and Child Health, The University of Sydney, Sydney, NSW, Australia
| | - Peter C. Laussen
- Department of Anesthesia, Boston Children's Hospital, Boston, MA, United States
| | - Azadeh Assadi
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
- Department of Engineering and Applied Sciences, Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Mjaye Mazwi
- Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada
- Department of Paediatrics, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Dittmar MS, Zimmermann S, Creutzenberg M, Bele S, Bitzinger D, Lunz D, Graf BM, Kieninger M. Evaluation of comprehensiveness and reliability of electronic health records concerning resuscitation efforts within academic intensive care units: a retrospective chart analysis. BMC Emerg Med 2021; 21:69. [PMID: 34112106 PMCID: PMC8194046 DOI: 10.1186/s12873-021-00462-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Accepted: 05/19/2021] [Indexed: 11/25/2022] Open
Abstract
Background According to the literature, the validity and reliability of medical documentation concerning episodes of cardiopulmonary resuscitation (CPR) is suboptimal. However, little is known about documentation quality of CPR efforts during intensive care unit (ICU) stays in electronic patient data management systems (PDMS). This study analyses the reliability of CPR-related medical documentation within the ICU PDMS. Methods In a retrospective chart analysis, PDMS records of three ICUs of a single university hospital were searched over 5 y for CPR check marks. Respective datasets were analyzed concerning data completeness and data consistency by comparing the content of three documentation forms (physicians’ log, nurses’ log, and CPR incident form), as well as physiological and therapeutic information of individual cases, for missing data and plausibility of CPR starting time and duration. To compare data reliability and completeness, a quantitative measure, the Consentaneity Index (CI), is proposed. Results One hundred sixty-five datasets were included into the study. In 9% (n = 15) of cases, there was neither information on the time points of CPR initiation nor on CPR duration available in any data source. Data on CPR starting time and duration were available from at least two data sources in individual cases in 54% (n = 90) and 45% (n = 74), respectively. In these cases, the specifications of CPR starting time did differ by a median ± interquartile range of 10.0 ± 18.5 min, CPR duration by 5.0 ± 17.3 min. The CI as a marker of data reliability revealed a low consistency of CPR documentation in most cases, with more favorable results, if the time interval between the CPR episode and the time of documentation was short. Conclusions This study reveals relevant proportions of missing and inconsistent data in electronic CPR documentation in the ICU setting. The CI is suggested as a tool for documentation quality analysis and monitoring of improvements.
Collapse
Affiliation(s)
- Michael S Dittmar
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany.
| | - Sabrina Zimmermann
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany.,Department of Forensic Psychiatry, Bezirksklinikum Regensburg, Universitätsstraße 84, 93053, Regensburg, Germany
| | - Marcus Creutzenberg
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Sylvia Bele
- Department of Neurosurgery, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Diane Bitzinger
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Dirk Lunz
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Bernhard M Graf
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Martin Kieninger
- Department of Anesthesiology, Regensburg University Medical Center, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| |
Collapse
|
3
|
Reinhardt D, Kraft AK, Albert M, Grundgeiger T, Happel O, Steinisch A, Wurmb T. A Tablet-Based Documentation Tool for In-Hospital Resuscitations. ACTA ACUST UNITED AC 2016. [DOI: 10.1177/1541931215591114] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The exact documentation of cardiopulmonary resuscitations—in particular the exact time of intervention delivery—is important for checking and improving quality. However, due to time-critical, stressful treatment and mostly retrospective documentation, data quality is often poor. This paper describes the development of a tablet-based application for documentation of in-hospital cardiopulmonary resuscitations that enables real-time documentation by a member of the resuscitation team. The application was developed following a comprehensive user-centered design process. Due to an efficient context-related information architecture, the application has the potential to enable real-time documentation of certain interventions and to accelerate time-consuming documentation after the resuscitation ended. Furthermore, the use of the application may contribute to the optimization of resuscitation processes and resuscitation training by providing more accurate and reliable data.
Collapse
Affiliation(s)
- D. Reinhardt
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Germany, Würzburg
| | - A-K. Kraft
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Germany, Würzburg
| | - M. Albert
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Germany, Würzburg
| | - T. Grundgeiger
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Germany, Würzburg
| | - O. Happel
- Department of Anesthesia and Critical Care, University Hospital Würzburg, Germany
| | - A. Steinisch
- Department of Anesthesia and Critical Care, University Hospital Würzburg, Germany
| | - T. Wurmb
- Department of Anesthesia and Critical Care, University Hospital Würzburg, Germany
| |
Collapse
|
4
|
Grundgeiger T, Albert M, Reinhardt D, Happel O, Steinisch A, Wurmb T. Real-time tablet-based resuscitation documentation by the team leader: evaluating documentation quality and clinical performance. Scand J Trauma Resusc Emerg Med 2016; 24:51. [PMID: 27084746 PMCID: PMC4833944 DOI: 10.1186/s13049-016-0242-3] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2015] [Accepted: 04/08/2016] [Indexed: 11/11/2022] Open
Abstract
Background Precise and complete documentation of in-hospital cardiopulmonary resuscitations is important but data quality can be poor. In the present study, we investigated the effect of a tablet-based application for real-time resuscitation documentation used by the emergency team leader on documentation quality and clinical performance of the emergency team. Methods Senior anaesthesiologists either used the tablet-based application during the simulated resuscitation for documentation and also used the application for the final documentation or conducted the full documentation at the end of the scenario using the local hospital information system. The latter procedure represents the current local documentation method. All scenarios were video recorded. To assess the documentation, we compared the precision of intervention delivery times, documentation completeness, and final documentation time. To assess clinical performance, we compared adherence to guidelines for defibrillation and adrenaline administration, the no-flow fraction, and the time to first defibrillation. Results The results showed significant benefits for the tablet-based application compared to the hospital information system for precision of the intervention delivery times, the final documentation time, and the no-flow fraction. We observed no differences between the groups for documentation completeness, adherence to guidelines for defibrillation and adrenaline administration, and the time to first defibrillation. Discussion In the presented study, we observed that a tablet-based application can improve documentation data quality. Furthermore, we demonstrated that a well-designed application can be used in real-time by a member of the emergency team with possible beneficial effects on clinical performance. Conclusion The present evaluation confirms the advantage of tablet-based documentation tools and also shows that the application can be used by an active member of an emergency team without compromising clinical performance.
Collapse
Affiliation(s)
- T Grundgeiger
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Oswald-Külpe-Weg 82, 97074, Würzburg, Germany
| | - M Albert
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Oswald-Külpe-Weg 82, 97074, Würzburg, Germany
| | - D Reinhardt
- Institute Human-Computer-Media, Julius-Maximilians-Universität Würzburg, Oswald-Külpe-Weg 82, 97074, Würzburg, Germany
| | - O Happel
- Department of Anaesthesia and Critical Care/Section Emergency Medicine, University Hospital of Würzburg, Oberdürrbacher Strasse 6, 97080, Würzburg, Germany
| | - A Steinisch
- Department of Anaesthesia and Critical Care/Section Emergency Medicine, University Hospital of Würzburg, Oberdürrbacher Strasse 6, 97080, Würzburg, Germany
| | - T Wurmb
- Department of Anaesthesia and Critical Care/Section Emergency Medicine, University Hospital of Würzburg, Oberdürrbacher Strasse 6, 97080, Würzburg, Germany.
| |
Collapse
|
5
|
Electronic documentation of cardiac arrests. Resuscitation 2014; 85:e141. [DOI: 10.1016/j.resuscitation.2013.12.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2013] [Revised: 11/23/2013] [Accepted: 12/01/2013] [Indexed: 11/18/2022]
|
6
|
Abstract
Resuscitation documentation assists health care professionals in trending patient status, determining what treatments may be most effective, and determining where opportunities for improvement may exist. An overview of what is known about resuscitation documentation is provided in this article, as are implications for future research related to documentation of resuscitation events. Use of the Utstein guidelines in determining essential elements of resuscitation documentation is also presented.
Collapse
Affiliation(s)
- Patricia Kunz Howard
- Cardiovascular Nursing, College of Nursing, University of Kentucky, Lexington, KY 40536-0232, USA.
| |
Collapse
|
7
|
|
8
|
Gröschel J, Philipp F, Skonetzki S, Genzwürker H, Wetter T, Ellinger K. Automated speech recognition for time recording in out-of-hospital emergency medicine-an experimental approach. Resuscitation 2004; 60:205-12. [PMID: 15036739 DOI: 10.1016/j.resuscitation.2003.10.006] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2002] [Revised: 07/23/2003] [Accepted: 10/22/2003] [Indexed: 11/25/2022]
Abstract
Precise documentation of medical treatment in emergency medical missions and for resuscitation is essential from a medical, legal and quality assurance point of view [Anästhesiologie und Intensivmedizin, 41 (2000) 737]. All conventional methods of time recording are either too inaccurate or elaborate for routine application. Automated speech recognition may offer a solution. A special erase programme for the documentation of all time events was developed. Standard speech recognition software (IBM ViaVoice 7.0) was adapted and installed on two different computer systems. One was a stationary PC (500MHz Pentium III, 128MB RAM, Soundblaster PCI 128 Soundcard, Win NT 4.0), the other was a mobile pen-PC that had already proven its value during emergency missions [Der Notarzt 16, p. 177] (Fujitsu Stylistic 2300, 230Mhz MMX Processor, 160MB RAM, embedded soundcard ESS 1879 chipset, Win98 2nd ed.). On both computers two different microphones were tested. One was a standard headset that came with the recognition software, the other was a small microphone (Lavalier-Kondensatormikrofon EM 116 from Vivanco), that could be attached to the operators collar. Seven women and 15 men spoke a text with 29 phrases to be recognised. Two emergency physicians tested the system in a simulated emergency setting using the collar microphone and the pen-PC with an analogue wireless connection. Overall recognition was best for the PC with a headset (89%) followed by the pen-PC with a headset (85%), the PC with a microphone (84%) and the pen-PC with a microphone (80%). Nevertheless, the difference was not statistically significant. Recognition became significantly worse (89.5% versus 82.3%, P<0.0001 ) when numbers had to be recognised. The gender of speaker and the number of words in a sentence had no influence. Average recognition in the simulated emergency setting was 75%. At no time did false recognition appear. Time recording with automated speech recognition seems to be possible in emergency medical missions. Although results show an average recognition of only 75%, it is possible that missing elements may be reconstructed more precisely. Future technology should integrate a secure wireless connection between microphone and mobile computer. The system could then prove its value for real out-of-hospital emergencies.
Collapse
Affiliation(s)
- J Gröschel
- Institut für Anästhesiologie und Operative Intensivmedizin, Universitätsklinikum Mannheim, Fakultät für Klinische Medizin Mannheim, Universität Heidelberg, 68135 Mannheim, Germany.
| | | | | | | | | | | |
Collapse
|
9
|
Abstract
OBJECTIVE To examine the quality and comprehensiveness of documentation in Paediatric 'cardiac arrests'. DESIGN Retrospective chart review. SETTING Tertiary care hospital wards, Paediatric Intensive Care and Accident and Emergency department. SUBJECTS 41 children experiencing acute life-threatening events in hospital. RESULTS Overall documentation of details related to time, place and personnel was highly variable but generally present in over half of the cases reviewed. Data relating to specific drug-related and interventional therapies was insufficient, as was documentation of time intervals and consequent therapeutic decisions. CONCLUSIONS Documentation of critical resuscitation episodes in children is below recognised standards and this has potential quality of care and medicolegal implications. Current teaching needs to emphasise this essential aspect of clinical care from the earliest level of training.
Collapse
|