1
|
Lees AF, Beni C, Lee A, Wedgeworth P, Dzara K, Joyner B, Tarczy-Hornoch P, Leu M. Uses of Electronic Health Record Data to Measure the Clinical Learning Environment of Graduate Medical Education Trainees: A Systematic Review. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:1326-1336. [PMID: 37267042 PMCID: PMC10615720 DOI: 10.1097/acm.0000000000005288] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
PURPOSE This study systematically reviews the uses of electronic health record (EHR) data to measure graduate medical education (GME) trainee competencies. METHOD In January 2022, the authors conducted a systematic review of original research in MEDLINE from database start to December 31, 2021. The authors searched for articles that used the EHR as their data source and in which the individual GME trainee was the unit of observation and/or unit of analysis. The database query was intentionally broad because an initial survey of pertinent articles identified no unifying Medical Subject Heading terms. Articles were coded and clustered by theme and Accreditation Council for Graduate Medical Education (ACGME) core competency. RESULTS The database search yielded 3,540 articles, of which 86 met the study inclusion criteria. Articles clustered into 16 themes, the largest of which were trainee condition experience (17 articles), work patterns (16 articles), and continuity of care (12 articles). Five of the ACGME core competencies were represented (patient care and procedural skills, practice-based learning and improvement, systems-based practice, medical knowledge, and professionalism). In addition, 25 articles assessed the clinical learning environment. CONCLUSIONS This review identified 86 articles that used EHR data to measure individual GME trainee competencies, spanning 16 themes and 6 competencies and revealing marked between-trainee variation. The authors propose a digital learning cycle framework that arranges sequentially the uses of EHR data within the cycle of clinical experiential learning central to GME. Three technical components necessary to unlock the potential of EHR data to improve GME are described: measures, attribution, and visualization. Partnerships between GME programs and informatics departments will be pivotal in realizing this opportunity.
Collapse
Affiliation(s)
- A Fischer Lees
- A. Fischer Lees is a clinical informatics fellow, Department of Biomedical Informatics and Medical Education, University of Washington School of Medicine, Seattle, Washington
| | - Catherine Beni
- C. Beni is a general surgery resident, Department of Surgery, University of Washington School of Medicine, Seattle, Washington
| | - Albert Lee
- A. Lee is a clinical informatics fellow, Department of Biomedical Informatics and Medical Education, University of Washington School of Medicine, Seattle, Washington
| | - Patrick Wedgeworth
- P. Wedgeworth is a clinical informatics fellow, Department of Biomedical Informatics and Medical Education, University of Washington School of Medicine, Seattle, Washington
| | - Kristina Dzara
- K. Dzara is assistant dean for educator development, director, Center for Learning and Innovation in Medical Education, and associate professor of medical education, Department of Biomedical Informatics and Medical Education, University of Washington School of Medicine, Seattle, Washington
| | - Byron Joyner
- B. Joyner is vice dean for graduate medical education and a designated institutional official, Graduate Medical Education, University of Washington School of Medicine, Seattle, Washington
| | - Peter Tarczy-Hornoch
- P. Tarczy-Hornoch is professor and chair, Department of Biomedical Informatics and Medical Education, and professor, Department of Pediatrics (Neonatology), University of Washington School of Medicine, and adjunct professor, Allen School of Computer Science and Engineering, University of Washington, Seattle, Washington
| | - Michael Leu
- M. Leu is professor and director, Clinical Informatics Fellowship, Department of Biomedical Informatics and Medical Education, and professor, Department of Pediatrics, University of Washington School of Medicine, Seattle, Washington
| |
Collapse
|
2
|
Zhou Y, Krishna S, Sharplin PK. Management and outcomes of flexor tendon repairs at a peripheral hospital: a New Zealand case series study. ANZ J Surg 2021; 92:1668-1674. [PMID: 34854200 DOI: 10.1111/ans.17398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 11/08/2021] [Accepted: 11/13/2021] [Indexed: 11/28/2022]
Abstract
BACKGROUND Current evidence for flexor tendon repair management and outcomes performed at peripheral centres is unclear. Most studies are based on evidence from specialist hand centres. This study evaluated a peripheral hospital in New Zealand; where all flexor tendon repairs were performed by a generalist Orthopaedic service. The purpose of the study was to benchmark management and outcomes from a peripheral hospital in comparison to international standards. METHODS A retrospective single-centre consecutive case series of Zones I and II flexor tendon repairs was extracted between 1 January 2014 and 1 January 2018. Medical records were used to evaluate management and outcomes of repairs. Hand therapy notes were used to evaluate rehabilitation protocols provided. The primary objective was to measure re-rupture and re-operation rates. Secondary objectives included auditing operative management and hand therapy compliance. RESULTS Forty-six patients (76 tendon repairs) were included in our final analysis. Mean follow up time to last clinical appointment was 11.8 weeks, and to last patient episode was 4.9 years. Most patients received timely surgery with a four-core repair using 3-0 or larger suture. All hand therapy followed a controlled active motion protocol. The re-operation rate was 19.6% (P = <0.05) and the re-rupture rate was 8.7% (P = 0.28). CONCLUSIONS Most flexor tendon injuries at this peripheral centre were managed according to international standards. However, high complication rates including re-operation and re-rupture occurred. Due to a lack of local comparison studies, confounding factors cannot be excluded as a contributor for these results.
Collapse
Affiliation(s)
- Yuxuan Zhou
- Department of Orthopaedic Surgery, Whangarei Hospital, Northland District Health Board, Whangarei, New Zealand
| | - Sanjeev Krishna
- Department of Surgery, Faculty of Medical and Health Sciences, The University of Auckland, Auckland, New Zealand
| | - Paul Kenneth Sharplin
- Department of Orthopaedic Surgery, Whangarei Hospital, Northland District Health Board, Whangarei, New Zealand
| |
Collapse
|
3
|
Apfeld JC, Deans KJ. Learning health systems and the future of clinical research. J Pediatr Surg 2020; 55S:51-53. [PMID: 31662193 DOI: 10.1016/j.jpedsurg.2019.09.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Accepted: 09/19/2019] [Indexed: 12/13/2022]
Abstract
Pediatric surgeons are collectively passionate about prioritizing the healthcare needs of children. We contend that this passion is deeply ingrained in how we drive clinical care and influence scientific discovery. Thus, the future of clinical research in our field will be deeply embedded in our history as a "patient-centric" profession. Service to pediatric patients requires an understanding of their needs and expectations, and designing research that acknowledges both. In this article we detail how future pragmatic clinical research will look in the evolving and learning health system.
Collapse
Affiliation(s)
- Jordan C Apfeld
- Center for Surgical Outcomes Research, Nationwide Children's Hospital, Columbus, OH; Center for Innovation in Pediatric Practice, Nationwide Children's Hospital, Columbus, OH; Department of Surgery, Division of Pediatric Surgery, The Ohio State University College of Medicine, Nationwide Children's Hospital, Columbus, OH
| | - Katherine J Deans
- Center for Surgical Outcomes Research, Nationwide Children's Hospital, Columbus, OH; Center for Innovation in Pediatric Practice, Nationwide Children's Hospital, Columbus, OH; Department of Surgery, Division of Pediatric Surgery, The Ohio State University College of Medicine, Nationwide Children's Hospital, Columbus, OH.
| |
Collapse
|
4
|
Powers EM, Shiffman RN, Melnick ER, Hickner A, Sharifi M. Efficacy and unintended consequences of hard-stop alerts in electronic health record systems: a systematic review. J Am Med Inform Assoc 2019; 25:1556-1566. [PMID: 30239810 DOI: 10.1093/jamia/ocy112] [Citation(s) in RCA: 71] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2018] [Accepted: 07/26/2018] [Indexed: 11/13/2022] Open
Abstract
Objective Clinical decision support (CDS) hard-stop alerts-those in which the user is either prevented from taking an action altogether or allowed to proceed only with the external override of a third party-are increasingly common but can be problematic. To understand their appropriate application, we asked 3 key questions: (1) To what extent are hard-stop alerts effective in improving patient health and healthcare delivery outcomes? (2) What are the adverse events and unintended consequences of hard-stop alerts? (3) How do hard-stop alerts compare to soft-stop alerts? Methods and Materials Studies evaluating computerized hard-stop alerts in healthcare settings were identified from biomedical and computer science databases, gray literature sites, reference lists, and reviews. Articles were extracted for process outcomes, health outcomes, unintended consequences, user experience, and technical details. Results Of 32 studies, 15 evaluated health outcomes, 16 process outcomes only, 10 user experience, and 4 compared hard and soft stops. Seventy-nine percent showed improvement in health outcomes and 88% in process outcomes. Studies reporting good user experience cited heavy user involvement and iterative design. Eleven studies reported on unintended consequences including avoidance of hard-stopped workflow, increased alert frequency, and delay to care. Hard stops were superior to soft stops in 3 of 4 studies. Conclusions Hard stops can be effective and powerful tools in the CDS armamentarium, but they must be implemented judiciously with continuous user feedback informing rapid, iterative design. Investigators must report on associated health outcomes and unintended consequences when implementing IT solutions to clinical problems.
Collapse
Affiliation(s)
- Emily M Powers
- Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, Connecticut, USA.,Department of Pediatrics, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Richard N Shiffman
- Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, Connecticut, USA.,Department of Pediatrics, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Edward R Melnick
- Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, Connecticut, USA.,Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Andrew Hickner
- Cushing/Whitney Medical Library, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Mona Sharifi
- Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, Connecticut, USA.,Department of Pediatrics, Yale University School of Medicine, New Haven, Connecticut, USA
| |
Collapse
|
5
|
Kennell TI, Willig JH, Cimino JJ. Clinical Informatics Researcher's Desiderata for the Data Content of the Next Generation Electronic Health Record. Appl Clin Inform 2017; 8:1159-1172. [PMID: 29270955 DOI: 10.4338/aci-2017-06-r-0101] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
OBJECTIVE Clinical informatics researchers depend on the availability of high-quality data from the electronic health record (EHR) to design and implement new methods and systems for clinical practice and research. However, these data are frequently unavailable or present in a format that requires substantial revision. This article reports the results of a review of informatics literature published from 2010 to 2016 that addresses these issues by identifying categories of data content that might be included or revised in the EHR. MATERIALS AND METHODS We used an iterative review process on 1,215 biomedical informatics research articles. We placed them into generic categories, reviewed and refined the categories, and then assigned additional articles, for a total of three iterations. RESULTS Our process identified eight categories of data content issues: Adverse Events, Clinician Cognitive Processes, Data Standards Creation and Data Communication, Genomics, Medication List Data Capture, Patient Preferences, Patient-reported Data, and Phenotyping. DISCUSSION These categories summarize discussions in biomedical informatics literature that concern data content issues restricting clinical informatics research. These barriers to research result from data that are either absent from the EHR or are inadequate (e.g., in narrative text form) for the downstream applications of the data. In light of these categories, we discuss changes to EHR data storage that should be considered in the redesign of EHRs, to promote continued innovation in clinical informatics. CONCLUSION Based on published literature of clinical informaticians' reuse of EHR data, we characterize eight types of data content that, if included in the next generation of EHRs, would find immediate application in advanced informatics tools and techniques.
Collapse
Affiliation(s)
- Timothy I Kennell
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| | - James H Willig
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States.,Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| | - James J Cimino
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States.,Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| |
Collapse
|