1
|
George SC, Tolakanahalli R, Aguirre S, Kim TP, Samuel EJJ, Mishra V. A single-institution experience with 177Lu RPT workflow improvements and qualifying the SPECT/CT imaging for dosimetry. Front Oncol 2024; 14:1331266. [PMID: 38469241 PMCID: PMC10925616 DOI: 10.3389/fonc.2024.1331266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/22/2024] [Indexed: 03/13/2024] Open
Abstract
Background and purpose Implementing any radiopharmaceutical therapy (RPT) program requires a comprehensive review of system readiness, appropriate workflows, and training to ensure safe and efficient treatment delivery. A quantitative assessment of the dose delivered to targets and organs at risk (OAR) using RPT is possible by correlating the absorbed doses with the delivered radioactivity. Integrating dosimetry into an established RPT program demands a thorough analysis of the necessary components and system fine-tuning. This study aims to report an optimized workflow for molecular radiation therapy using 177Lu with a primary focus on integrating patient-specific dosimetry into an established radiopharmaceutical program in a radiation oncology setting. Materials and methods We comprehensively reviewed using the Plan-Do-Check-Act (PDCA) cycle, including efficacy and accuracy of delivery and all aspects of radiation safety of the RPT program. The GE Discovery SPECT/CT 670DR™ system was calibrated per MIM protocol for dose calculation on MIM SurePlan™ MRT software. Jaszcak Phantom with 15-20 mCi of 177Lu DOTATATE with 2.5 µM EDTA solution was used, with the main energy window defined as 208 keV ±10% (187.6 to 229.2 keV); the upper scatter energy window was set to 240 keV ±5% (228 to 252 keV), while the lower scatter energy window was 177.8 keV ±5% (168.9 to 186.7 keV). Volumetric quality control tests and adjustments were performed to ensure the correct alignment of the table, NM, and CT gantry on SPECT/CT. A comprehensive end-to-end (E2E) test was performed to ensure workflow, functionality, and quantitative dose accuracy. Results Workflow improvements and checklists are presented after systematically analyzing over 400 administrations of 177Lu-based RPT. Injected activity to each sphere in the NEMA Phantom scan was quantified, and the MIM Sureplan MRT reconstruction images calculated activities within ±12% of the injected activity. Image alignment tests on the SPECT/CT showed a discrepancy of more than the maximum tolerance of 2.2 mm on any individual axis. As a result of servicing the machine and updating the VQC and COR corrections, the hybrid imaging system was adjusted to achieve an accuracy of <1 mm in all directions. Conclusion Workflows and checklists, after analysis of system readiness and adequate training for staff and patients, are presented. Hardware and software components for patient-specific dosimetry are presented with a focus on hybrid image registration and correcting any errors that affect dosimetric quantification calculation. Moreover, this manuscript briefly overviews the necessary quality assurance requirements for converting diagnostic images into dosimetry measurement tools and integrating dosimetry for RPT based on 177Lu.
Collapse
Affiliation(s)
- Siju C. George
- Department of Radiation Oncology, Miami Cancer Institute, Baptist Health, Miami, FL, United States
- Department of Physics, School of Advanced Sciences, Vellore Institute of Technology, Vellore, India
| | - Ranjini Tolakanahalli
- Department of Radiation Oncology, Miami Cancer Institute, Baptist Health, Miami, FL, United States
| | - Santiago Aguirre
- Department of Radiation Oncology, Miami Cancer Institute, Baptist Health, Miami, FL, United States
| | - Taehyung Peter Kim
- Department of Radiation Oncology, Miami Cancer Institute, Baptist Health, Miami, FL, United States
| | | | - Vivek Mishra
- Department of Radiation Oncology, Miami Cancer Institute, Baptist Health, Miami, FL, United States
| |
Collapse
|
2
|
Yakob N, Laliberté S, Doyon-Poulin P, Jouvet P, Noumeir R. Data Representation Structure to Support Clinical Decision-Making in the Pediatric Intensive Care Unit: Interview Study and Preliminary Decision Support Interface Design. JMIR Form Res 2024; 8:e49497. [PMID: 38300695 PMCID: PMC10870206 DOI: 10.2196/49497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 11/11/2023] [Accepted: 11/22/2023] [Indexed: 02/02/2024] Open
Abstract
BACKGROUND Clinical decision-making is a complex cognitive process that relies on the interpretation of a large variety of data from different sources and involves the use of knowledge bases and scientific recommendations. The representation of clinical data plays a key role in the speed and efficiency of its interpretation. In addition, the increasing use of clinical decision support systems (CDSSs) provides assistance to clinicians in their practice, allowing them to improve patient outcomes. In the pediatric intensive care unit (PICU), clinicians must process high volumes of data and deal with ever-growing workloads. As they use multiple systems daily to assess patients' status and to adjust the health care plan, including electronic health records (EHR), clinical systems (eg, laboratory, imaging and pharmacy), and connected devices (eg, bedside monitors, mechanical ventilators, intravenous pumps, and syringes), clinicians rely mostly on their judgment and ability to trace relevant data for decision-making. In these circumstances, the lack of optimal data structure and adapted visual representation hinder clinician's cognitive processes and clinical decision-making skills. OBJECTIVE In this study, we designed a prototype to optimize the representation of clinical data collected from existing sources (eg, EHR, clinical systems, and devices) via a structure that supports the integration of a home-developed CDSS in the PICU. This study was based on analyzing end user needs and their clinical workflow. METHODS First, we observed clinical activities in a PICU to secure a better understanding of the workflow in terms of staff tasks and their use of EHR on a typical work shift. Second, we conducted interviews with 11 clinicians from different staff categories (eg, intensivists, fellows, nurses, and nurse practitioners) to compile their needs for decision support. Third, we structured the data to design a prototype that illustrates the proposed representation. We used a brain injury care scenario to validate the relevance of integrated data and the utility of main functionalities in a clinical context. Fourth, we held design meetings with 5 clinicians to present, revise, and adapt the prototype to meet their needs. RESULTS We created a structure with 3 levels of abstraction-unit level, patient level, and system level-to optimize clinical data representation and display for efficient patient assessment and to provide a flexible platform to host the internally developed CDSS. Subsequently, we designed a preliminary prototype based on this structure. CONCLUSIONS The data representation structure allows prioritizing patients via criticality indicators, assessing their conditions using a personalized dashboard, and monitoring their courses based on the evolution of clinical values. Further research is required to define and model the concepts of criticality, problem recognition, and evolution. Furthermore, feasibility tests will be conducted to ensure user satisfaction.
Collapse
Affiliation(s)
- Najia Yakob
- École de technologie supérieure, Montreal, QC, Canada
| | | | | | - Philippe Jouvet
- Pediatric Intensive Care Unit, CHU Sainte-Justine, Montreal, QC, Canada
| | - Rita Noumeir
- École de technologie supérieure, Montreal, QC, Canada
| |
Collapse
|
3
|
Tripathi S, Sukumaran R, Cook TS. Efficient healthcare with large language models: optimizing clinical workflow and enhancing patient care. J Am Med Inform Assoc 2024:ocad258. [PMID: 38273739 DOI: 10.1093/jamia/ocad258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 12/01/2023] [Accepted: 12/29/2023] [Indexed: 01/27/2024] Open
Abstract
PURPOSE This article explores the potential of large language models (LLMs) to automate administrative tasks in healthcare, alleviating the burden on clinicians caused by electronic medical records. POTENTIAL LLMs offer opportunities in clinical documentation, prior authorization, patient education, and access to care. They can personalize patient scheduling, improve documentation accuracy, streamline insurance prior authorization, increase patient engagement, and address barriers to healthcare access. CAUTION However, integrating LLMs requires careful attention to security and privacy concerns, protecting patient data, and complying with regulations like the Health Insurance Portability and Accountability Act (HIPAA). It is crucial to acknowledge that LLMs should supplement, not replace, the human connection and care provided by healthcare professionals. CONCLUSION By prudently utilizing LLMs alongside human expertise, healthcare organizations can improve patient care and outcomes. Implementation should be approached with caution and consideration to ensure the safe and effective use of LLMs in the clinical setting.
Collapse
Affiliation(s)
- Satvik Tripathi
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Rithvik Sukumaran
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Tessa S Cook
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| |
Collapse
|
4
|
Simonson JK, Anderson M, Polacek C, Klump E, Haque SN. Characterizing Real-World Implementation of Consumer Wearables for the Detection of Undiagnosed Atrial Fibrillation in Clinical Practice: Targeted Literature Review. JMIR Cardio 2023; 7:e47292. [PMID: 37921865 PMCID: PMC10656655 DOI: 10.2196/47292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 09/25/2023] [Accepted: 09/27/2023] [Indexed: 11/04/2023] Open
Abstract
BACKGROUND Atrial fibrillation (AF), the most common cardiac arrhythmia, is often undiagnosed because of lack of awareness and frequent asymptomatic presentation. As AF is associated with increased risk of stroke, early detection is clinically relevant. Several consumer wearable devices (CWDs) have been cleared by the US Food and Drug Administration for irregular heart rhythm detection suggestive of AF. However, recommendations for the use of CWDs for AF detection in clinical practice, especially with regard to pathways for workflows and clinical decisions, remain lacking. OBJECTIVE We conducted a targeted literature review to identify articles on CWDs characterizing the current state of wearable technology for AF detection, identifying approaches to implementing CWDs into the clinical workflow, and characterizing provider and patient perspectives on CWDs for patients at risk of AF. METHODS PubMed, ClinicalTrials.gov, UpToDate Clinical Reference, and DynaMed were searched for articles in English published between January 2016 and July 2023. The searches used predefined Medical Subject Headings (MeSH) terms, keywords, and search strings. Articles of interest were specifically on CWDs; articles on ambulatory monitoring tools, tools available by prescription, or handheld devices were excluded. Search results were reviewed for relevancy and discussed among the authors for inclusion. A qualitative analysis was conducted and themes relevant to our study objectives were identified. RESULTS A total of 31 articles met inclusion criteria: 7 (23%) medical society reports or guidelines, 4 (13%) general reviews, 5 (16%) systematic reviews, 5 (16%) health care provider surveys, 7 (23%) consumer or patient surveys or interviews, and 3 (10%) analytical reports. Despite recognition of CWDs by medical societies, detailed guidelines regarding CWDs for AF detection were limited, as was the availability of clinical tools. A main theme was the lack of pragmatic studies assessing real-world implementation of CWDs for AF detection. Clinicians expressed concerns about data overload; potential for false positives; reimbursement issues; and the need for clinical tools such as care pathways and guidelines, preferably developed or endorsed by professional organizations. Patient-facing challenges included device costs and variability in digital literacy or technology acceptance. CONCLUSIONS This targeted literature review highlights the lack of a comprehensive body of literature guiding real-world implementation of CWDs for AF detection and provides insights for informing additional research and developing appropriate tools and resources for incorporating these devices into clinical practice. The results should also provide an impetus for the active involvement of medical societies and other health care stakeholders in developing appropriate tools and resources for guiding the real-world use of CWDs for AF detection. These resources should target clinicians, patients, and health care systems with the goal of facilitating clinician or patient engagement and using an evidence-based approach for establishing guidelines or frameworks for administrative workflows and patient care pathways.
Collapse
|
5
|
Albanowski K, Burdick KJ, Bonafide CP, Kleinpell R, Schlesinger JJ. Ten Years Later, Alarm Fatigue Is Still a Safety Concern. AACN Adv Crit Care 2023; 34:189-197. [PMID: 37644627 DOI: 10.4037/aacnacc2023662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Ten years after the publication of a landmark article in AACN Advanced Critical Care, alarm fatigue continues to be an issue that researchers, clinicians, and organizations aim to remediate. Alarm fatigue contributes to missed alarms and medical errors that result in patient death, increased clinical workload and burnout, and interference with patient recovery. Led by the American Association of Critical-Care Nurses, national patient safety organizations continue to prioritize efforts to battle alarm fatigue and have proposed alarm management strategies to mitigate the effects of alarm fatigue. Similarly, clinical efforts now use simulation studies, individualized alarm thresholds, and interdisciplinary teams to optimize alarm use. Finally, engineering research efforts have innovated the standard alarm to convey information more effectively for medical users. By focusing on patient and provider safety, clinical workflow, and alarm technology, efforts to reduce alarm fatigue over the past 10 years have been grounded in an evidence-based and personnel-focused approach.
Collapse
Affiliation(s)
- Kimberly Albanowski
- Kimberly Albanowski is Clinical Research Coordinator II, Section of Hospital Medicine, Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Kendall J Burdick
- Kendall J. Burdick is Pediatric Resident, Boston Children's Hospital, 300 Longwood Ave, Boston, MA 02215
| | - Christopher P Bonafide
- Christopher P. Bonafide is Academic Pediatric Hospitalist, Section of Hospital Medicine, Department of Pediatrics, Children's Hospital of Philadelphia; Director of Pediatric Implementation Research, Penn Implementation Science Center at the Leonard Davis Institute for Health Economics (PISCE@LDI); and Associate Professor, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Ruth Kleinpell
- Ruth Kleinpell is Associate Dean for Clinical Scholarship, Independence Foundation Chair in Nursing Education, and Professor, Vanderbilt University School of Nursing, Nashville, Tennessee
| | - Joseph J Schlesinger
- Joseph J. Schlesinger is Associate Professor, Department of Anesthesiology, Division of Critical Care Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, and Adjunct Professor of Electrical and Computer Engineering, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
6
|
Shao CY, Li H, Liu XL, Li C, Yang LQ, Zhang YJ, Luo J, Zhao J. Appropriateness and Comprehensiveness of Using ChatGPT for Perioperative Patient Education in Thoracic Surgery in Different Language Contexts: Survey Study. Interact J Med Res 2023; 12:e46900. [PMID: 37578819 PMCID: PMC10463083 DOI: 10.2196/46900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 07/22/2023] [Accepted: 07/27/2023] [Indexed: 08/15/2023] Open
Abstract
BACKGROUND ChatGPT, a dialogue-based artificial intelligence language model, has shown promise in assisting clinical workflows and patient-clinician communication. However, there is a lack of feasibility assessments regarding its use for perioperative patient education in thoracic surgery. OBJECTIVE This study aimed to assess the appropriateness and comprehensiveness of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. METHODS This pilot study was conducted in February 2023. A total of 37 questions focused on perioperative patient education in thoracic surgery were created based on guidelines and clinical experience. Two sets of inquiries were made to ChatGPT for each question, one in English and the other in Chinese. The responses generated by ChatGPT were evaluated separately by experienced thoracic surgical clinicians for appropriateness and comprehensiveness based on a hypothetical draft response to a patient's question on the electronic information platform. For a response to be qualified, it required at least 80% of reviewers to deem it appropriate and 50% to deem it comprehensive. Statistical analyses were performed using the unpaired chi-square test or Fisher exact test, with a significance level set at P<.05. RESULTS The set of 37 commonly asked questions covered topics such as disease information, diagnostic procedures, perioperative complications, treatment measures, disease prevention, and perioperative care considerations. In both the English and Chinese contexts, 34 (92%) out of 37 responses were qualified in terms of both appropriateness and comprehensiveness. The remaining 3 (8%) responses were unqualified in these 2 contexts. The unqualified responses primarily involved the diagnosis of disease symptoms and surgical-related complications symptoms. The reasons for determining the responses as unqualified were similar in both contexts. There was no statistically significant difference (34/37, 92% vs 34/37, 92%; P=.99) in the qualification rate between the 2 language sets. CONCLUSIONS This pilot study demonstrates the potential feasibility of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. ChatGPT is expected to enhance patient satisfaction, reduce anxiety, and improve compliance during the perioperative period. In the future, there will be remarkable potential application for using artificial intelligence, in conjunction with human review, for patient education and health consultation after patients have provided their informed consent.
Collapse
Affiliation(s)
- Chen-Ye Shao
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Hui Li
- Department of Obstetrics and Gynecology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Xiao-Long Liu
- Department of Cardiothoracic Surgery, Jinling Hospital, Medical School of Nanjing University, Nanjing, China
| | - Chang Li
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Li-Qin Yang
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Yue-Juan Zhang
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Jing Luo
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Jun Zhao
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| |
Collapse
|
7
|
Goldstein J, Weitzman D, Lemerond M, Jones A. Determinants for scalable adoption of autonomous AI in the detection of diabetic eye disease in diverse practice types: key best practices learned through collection of real-world data. Front Digit Health 2023; 5:1004130. [PMID: 37274764 PMCID: PMC10232822 DOI: 10.3389/fdgth.2023.1004130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 04/25/2023] [Indexed: 06/06/2023] Open
Abstract
Autonomous Artificial Intelligence (AI) has the potential to reduce disparities, improve quality of care, and reduce cost by improving access to specialty diagnoses at the point-of-care. Diabetes and related complications represent a significant source of health disparities. Vision loss is a complication of diabetes, and there is extensive evidence supporting annual eye exams for prevention. Prior to the use of autonomous AI, store-and-forward imaging approaches using remote reading centers (asynchronous telemedicine) attempted to increase diabetes related eye exams with limited success. In 2018, after rigorous clinical validation, the first fully autonomous AI system [LumineticsCore™ (formerly IDx-DR), Digital Diagnostics Inc., Coralville, IA, United States] received U.S. Food and Drug Administration (FDA) De Novo authorization. The system diagnoses diabetic retinopathy (including macular edema) without specialist physician overread at the point-of-care. In addition to regulatory clearance, reimbursement, and quality measure updates, successful adoption requires local optimization of the clinical workflow. The general challenges of frontline care clinical workflow have been well documented in the literature. Because healthcare AI is so new, there remains a gap in the literature about challenges and opportunities to embed diagnostic AI into the clinical workflow. The goal of this review is to identify common workflow themes leading to successful adoption, measured as attainment number of exams per month using the autonomous AI system against targets set for each health center. We characterized the workflow in four different US health centers over a 12-month period. Health centers were geographically dispersed across the Midwest, Southwest, Northeast, and West Coast and varied distinctly in terms of size, staffing, resources, financing and demographics of patient populations. After 1 year, the aggregated number of diabetes-related exams per month increased from 89 after the first month of initial deployment to 174 across all sites. Across the diverse practice types, three primary determinants underscored sustainable adoption: (1) Inclusion of Executive and Clinical Champions; (2) Underlining Health Center Resources; and (3) Clinical workflows that contemplate patient identification (pre-visit), LumineticsCore Exam Capture and Provider Consult (patient visit), and Timely Referral Triage (post-visit). In addition to regulatory clearance, reimbursement and quality measures, our review shows that addressing the core determinants for workflow optimization is an essential part of large-scale adoption of innovation. These best practices can be generalizable to other autonomous AI systems in front-line care settings, thereby increasing patient access, improving quality of care, and addressing health disparities.
Collapse
|
8
|
Baeßler B, Götz M, Antoniades C, Heidenreich JF, Leiner T, Beer M. Artificial intelligence in coronary computed tomography angiography: Demands and solutions from a clinical perspective. Front Cardiovasc Med 2023; 10:1120361. [PMID: 36873406 PMCID: PMC9978503 DOI: 10.3389/fcvm.2023.1120361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 01/25/2023] [Indexed: 02/18/2023] Open
Abstract
Coronary computed tomography angiography (CCTA) is increasingly the cornerstone in the management of patients with chronic coronary syndromes. This fact is reflected by current guidelines, which show a fundamental shift towards non-invasive imaging - especially CCTA. The guidelines for acute and stable coronary artery disease (CAD) of the European Society of Cardiology from 2019 and 2020 emphasize this shift. However, to fulfill this new role, a broader availability in adjunct with increased robustness of data acquisition and speed of data reporting of CCTA is needed. Artificial intelligence (AI) has made enormous progress for all imaging methodologies concerning (semi)-automatic tools for data acquisition and data post-processing, with outreach toward decision support systems. Besides onco- and neuroimaging, cardiac imaging is one of the main areas of application. Most current AI developments in the scenario of cardiac imaging are related to data postprocessing. However, AI applications (including radiomics) for CCTA also should enclose data acquisition (especially the fact of dose reduction) and data interpretation (presence and extent of CAD). The main effort will be to integrate these AI-driven processes into the clinical workflow, and to combine imaging data/results with further clinical data, thus - beyond the diagnosis of CAD- enabling prediction and forecast of morbidity and mortality. Furthermore, data fusing for therapy planning (e.g., invasive angiography/TAVI planning) will be warranted. The aim of this review is to present a holistic overview of AI applications in CCTA (including radiomics) under the umbrella of clinical workflows and clinical decision-making. The review first summarizes and analyzes applications for the main role of CCTA, i.e., to non-invasively rule out stable coronary artery disease. In the second step, AI applications for additional diagnostic purposes, i.e., to improve diagnostic power (CAC = coronary artery classifications), improve differential diagnosis (CT-FFR and CT perfusion), and finally improve prognosis (again CAC plus epi- and pericardial fat analysis) are reviewed.
Collapse
Affiliation(s)
- Bettina Baeßler
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Würzburg, Germany
| | - Michael Götz
- Division of Experimental Radiology, Department for Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
| | - Charalambos Antoniades
- British Heart Foundation Chair of Cardiovascular Medicine, Cardiovascular Medicine, University of Oxford, Oxford, United Kingdom
| | - Julius F. Heidenreich
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Würzburg, Germany
| | - Tim Leiner
- Department of Radiology, Mayo Clinic, Rochester, MN, United States
- Department of Radiology, University Medical Center Utrecht, Utrecht, Netherlands
| | - Meinrad Beer
- Department for Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
| |
Collapse
|
9
|
Locke D, Hoyt CC. Companion diagnostic requirements for spatial biology using multiplex immunofluorescence and multispectral imaging. Front Mol Biosci 2023; 10:1051491. [PMID: 36845550 PMCID: PMC9948403 DOI: 10.3389/fmolb.2023.1051491] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 01/16/2023] [Indexed: 02/11/2023] Open
Abstract
Immunohistochemistry has long been held as the gold standard for understanding the expression patterns of therapeutically relevant proteins to identify prognostic and predictive biomarkers. Patient selection for targeted therapy in oncology has successfully relied upon standard microscopy-based methodologies, such as single-marker brightfield chromogenic immunohistochemistry. As promising as these results are, the analysis of one protein, with few exceptions, no longer provides enough information to draw effective conclusions about the probability of treatment response. More multifaceted scientific queries have driven the development of high-throughput and high-order technologies to interrogate biomarker expression patterns and spatial interactions between cell phenotypes in the tumor microenvironment. Such multi-parameter data analysis has been historically reserved for technologies that lack the spatial context that is provided by immunohistochemistry. Over the past decade, technical developments in multiplex fluorescence immunohistochemistry and discoveries made with improving image data analysis platforms have highlighted the importance of spatial relationships between certain biomarkers in understanding a patient's likelihood to respond to, typically, immune checkpoint inhibitors. At the same time, personalized medicine has instigated changes in both clinical trial design and its conduct in a push to make drug development and cancer treatment more efficient, precise, and economical. Precision medicine in immuno-oncology is being steered by data-driven approaches to gain insight into the tumor and its dynamic interaction with the immune system. This is particularly necessary given the rapid growth in the number of trials involving more than one immune checkpoint drug, and/or using those in combination with conventional cancer treatments. As multiplex methods, like immunofluorescence, push the boundaries of immunohistochemistry, it becomes critical to understand the foundation of this technology and how it can be deployed for use as a regulated test to identify the prospect of response from mono- and combination therapies. To that end, this work will focus on: 1) the scientific, clinical, and economic requirements for developing clinical multiplex immunofluorescence assays; 2) the attributes of the Akoya Phenoptics workflow to support predictive tests, including design principles, verification, and validation needs; 3) regulatory, safety and quality considerations; 4) application of multiplex immunohistochemistry through lab-developed-tests and regulated in vitro diagnostic devices.
Collapse
Affiliation(s)
- Darren Locke
- Clinical Assay Development, Akoya Biosciences, Marlborough, MA, United States,*Correspondence: Darren Locke,
| | - Clifford C. Hoyt
- Translational and Scientific Affairs, Akoya Biosciences, Marlborough, MA, United States
| |
Collapse
|
10
|
Seitz PK, Karger CP, Bendl R, Schwahofer A. Strategy for automatic ultrasound (US) probe positioning in robot-assisted ultrasound guided radiation therapy. Phys Med Biol 2023; 68. [PMID: 36584398 DOI: 10.1088/1361-6560/acaf46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 12/30/2022] [Indexed: 12/31/2022]
Abstract
Objective. As part of image-guided radiotherapy, ultrasound-guided radiotherapy is currently already in use and under investigation for robot assisted systems Ipsen 2021. It promises a real-time tumor localization during irradiation (intrafractional) without extra dose. The ultrasound probe is held and guided by a robot. However, there is a lack of basic safety mechanisms and interaction strategies to enable a safe clinical procedure. In this study we investigate potential positioning strategies with safety mechanisms for a safe robot-human-interaction.Approach. A compact setup of ultrasound device, lightweight robot, tracking camera, force sensor and control computer were integrated in a software application to represent a potential USgRT setup. For the realization of a clinical procedure, positioning strategies for the ultrasound head with the help of the robot were developed, implemented, and tested. In addition, basic safety mechanisms for the robot have been implemented, using the integrated force sensor, and have been tested by intentional collisions.Main results. Various positioning methods from manual guidance to completely automated procedures were tested. Robot-guided methods achieved higher positioning accuracy and were faster in execution compared to conventional hand-guided methods. The developed safety mechanisms worked as intended and the detected collision force were below 20 N.Significance. The study demonstrates the feasibility of a new approach for safe robotic ultrasound imaging, with a focus on abdominal usage (liver, prostate, kidney). The safety measures applied here can be extended to other human-robot interactions and present the basic for further studies in medical applications.
Collapse
Affiliation(s)
- Peter Karl Seitz
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany.,University of Heidelberg, Faculty of Medicine Heidelberg, Heidelberg, Germany.,Medical Informatics, Heilbronn University, Heilbronn, Germany
| | - Christian P Karger
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany
| | - Rolf Bendl
- Medical Informatics, Heilbronn University, Heilbronn, Germany
| | - Andrea Schwahofer
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany.,Therapanacea, Paris, France
| |
Collapse
|
11
|
Lou SS, Liu H, Harford D, Lu C, Kannampallil T. Characterizing the macrostructure of electronic health record work using raw audit logs: an unsupervised action embeddings approach. J Am Med Inform Assoc 2022; 30:539-544. [PMID: 36478460 PMCID: PMC9933072 DOI: 10.1093/jamia/ocac239] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 10/26/2022] [Accepted: 11/29/2022] [Indexed: 12/13/2022] Open
Abstract
Raw audit logs provide a comprehensive record of clinicians' activities on an electronic health record (EHR) and have considerable potential for studying clinician behaviors. However, research using raw audit logs is limited because they lack context for clinical tasks, leading to difficulties in interpretation. We describe a novel unsupervised approach using the comparison and visualization of EHR action embeddings to learn context and structure from raw audit log activities. Using a dataset of 15 767 634 raw audit log actions performed by 88 intern physicians over 6 months of EHR use across inpatient and outpatient settings, we demonstrated that embeddings can be used to learn the situated context for EHR-based work activities, identify discrete clinical workflows, and discern activities typically performed across diverse contexts. Our approach represents an important methodological advance in raw audit log research, facilitating the future development of metrics and predictive models to measure clinician behaviors at the macroscale.
Collapse
Affiliation(s)
- Sunny S Lou
- Department of Anesthesiology, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA,Institute for Informatics, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA
| | - Hanyang Liu
- Department of Computer Science and Engineering, McKelvey School of Engineering, Washington University in St Louis, St Louis, Missouri, USA
| | - Derek Harford
- Department of Anesthesiology, School of Medicine, Washington University in St Louis, St Louis, Missouri, USA
| | - Chenyang Lu
- Department of Computer Science and Engineering, McKelvey School of Engineering, Washington University in St Louis, St Louis, Missouri, USA
| | - Thomas Kannampallil
- Corresponding Author: Thomas Kannampallil, PhD, Institute for Informatics, School of Medicine, Washington University in St Louis, 660 S. Euclid Avenue, Campus Box 8054, St Louis, MO 63110, USA;
| |
Collapse
|
12
|
Drukker L, Sharma H, Karim JN, Droste R, Noble JA, Papageorghiou AT. Clinical workflow of sonographers performing fetal anomaly ultrasound scans: deep-learning-based analysis. Ultrasound Obstet Gynecol 2022; 60:759-765. [PMID: 35726505 PMCID: PMC10107110 DOI: 10.1002/uog.24975] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 06/04/2022] [Accepted: 06/10/2022] [Indexed: 05/31/2023]
Abstract
OBJECTIVE Despite decades of obstetric scanning, the field of sonographer workflow remains largely unexplored. In the second trimester, sonographers use scan guidelines to guide their acquisition of standard planes and structures; however, the scan-acquisition order is not prescribed. Using deep-learning-based video analysis, the aim of this study was to develop a deeper understanding of the clinical workflow undertaken by sonographers during second-trimester anomaly scans. METHODS We collected prospectively full-length video recordings of routine second-trimester anomaly scans. Important scan events in the videos were identified by detecting automatically image freeze and image/clip save. The video immediately preceding and following the important event was extracted and labeled as one of 11 commonly acquired anatomical structures. We developed and used a purposely trained and tested deep-learning annotation model to label automatically the large number of scan events. Thus, anomaly scans were partitioned as a sequence of anatomical planes or fetal structures obtained over time. RESULTS A total of 496 anomaly scans performed by 14 sonographers were available for analysis. UK guidelines specify that an image or videoclip of five different anatomical regions must be stored and these were detected in the majority of scans: head/brain was detected in 97.2% of scans, coronal face view (nose/lips) in 86.1%, abdomen in 93.1%, spine in 95.0% and femur in 92.3%. Analyzing the clinical workflow, we observed that sonographers were most likely to begin their scan by capturing the head/brain (in 24.4% of scans), spine (in 23.2%) or thorax/heart (in 22.8%). The most commonly identified two-structure transitions were: placenta/amniotic fluid to maternal anatomy, occurring in 44.5% of scans; head/brain to coronal face (nose/lips) in 42.7%; abdomen to thorax/heart in 26.1%; and three-dimensional/four-dimensional face to sagittal face (profile) in 23.7%. Transitions between three or more consecutive structures in sequence were uncommon (up to 13% of scans). None of the captured anomaly scans shared an entirely identical sequence. CONCLUSIONS We present a novel evaluation of the anomaly scan acquisition process using a deep-learning-based analysis of ultrasound video. We note wide variation in the number and sequence of structures obtained during routine second-trimester anomaly scans. Overall, each anomaly scan was found to be unique in its scanning sequence, suggesting that sonographers take advantage of the fetal position and acquire the standard planes according to their visibility rather than following a strict acquisition order. © 2022 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.
Collapse
Affiliation(s)
- L. Drukker
- Nuffield Department of Women's and Reproductive HealthJohn Radcliffe Hospital, University of OxfordOxfordUK
- Women's Ultrasound, Department of Obstetrics and GynecologyBeilinson Medical Center, Sackler Faculty of Medicine, Tel Aviv UniversityTel AvivIsrael
| | - H. Sharma
- Institute of Biomedical EngineeringUniversity of OxfordOxfordUK
| | - J. N. Karim
- Nuffield Department of Women's and Reproductive HealthJohn Radcliffe Hospital, University of OxfordOxfordUK
| | - R. Droste
- Institute of Biomedical EngineeringUniversity of OxfordOxfordUK
| | - J. A. Noble
- Institute of Biomedical EngineeringUniversity of OxfordOxfordUK
| | - A. T. Papageorghiou
- Nuffield Department of Women's and Reproductive HealthJohn Radcliffe Hospital, University of OxfordOxfordUK
| |
Collapse
|
13
|
Dobritoiu F, Baltan A, Chefani A, Billingham K, Chenard MP, Vaziri R, Lacroix-Triki M, Waydelich A, Erb G, Andersson E, Cañamero M, Toro P, Wedden S, D’Arrigo C. Tissue Selection for PD-L1 Testing in Triple Negative Breast Cancer (TNBC). Appl Immunohistochem Mol Morphol 2022; 30:549-556. [PMID: 36036647 PMCID: PMC9444286 DOI: 10.1097/pai.0000000000001053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Accepted: 06/13/2022] [Indexed: 11/26/2022]
Abstract
Atezolizumab in combination with nab-paclitaxel has been introduced for the treatment of locally advanced or recurrent triple negative breast cancer (TNBC). Patient selection relies on the use of immunohistochemistry using a specific monoclonal PD-L1 antibody (clone SP142) in a tightly controlled companion diagnostic test (CDx) with a defined interpretative algorithm. Currently there are no standardized recommendations for selecting the optimal tissue to be tested and there is limited data to support decision making, raising the possibility that tissue selection may bias test results. We compared PD-L1 SP142 assessment in a collection of 73 TNBC cases with matched core biopsies and excision samples. There was good correlation between PD-L1-positive core biopsy and subsequent excision, but we found considerable discrepancy between PD-L1 negative core biopsy and matched excision, with a third of cases found negative on core biopsies converting to positive upon examination of the excision tissue. In view of these findings, we developed a workflow for the clinical testing of TNBC for PD-L1 and implemented it in a central referral laboratory. We present audit data from the clinical PD-L1 testing relating to 2 years of activities, indicating that implementation of this workflow results in positivity rates in our population of TNBC similar to those of IMpassion130 clinical trial. We also developed an online atlas with a precise numerical annotation to aid pathologists in the interpretation of PD-L1 scoring in TNBC.
Collapse
Affiliation(s)
- Florin Dobritoiu
- Poundbury Cancer Institute
- Department of Pathology, University Emergency Hospital, Bucharest, Romania
| | | | | | - Kim Billingham
- Department of Pathology, Great Western Hospital, Swindon, UK
| | | | - Reza Vaziri
- Department of Pathology, Worcestershire Acute Hospitals, Worcester, UK
| | | | - Anne Waydelich
- Oncology Medical and Government Affairs Roche Diagnostics EMEA-LATAM Region, Rotkreuz, Switzerland
| | - Gilles Erb
- Global Medical Affairs/PDMA, Roche Basel, Switzerland
| | - Emilia Andersson
- Oncology Medical and Government Affairs Roche Diagnostics EMEA-LATAM Region, Rotkreuz, Switzerland
| | - Marta Cañamero
- Oncology Medical and Government Affairs Roche Diagnostics EMEA-LATAM Region, Rotkreuz, Switzerland
| | - Paula Toro
- Clinical Development & Medical Affairs, Roche Diagnostics Solutions, Tucson
| | | | | |
Collapse
|
14
|
Fraiche AM, Strom JB. Impact of ultrasound enhancing agents on clinical management. Curr Opin Cardiol 2022; 37:389-393. [PMID: 35913366 PMCID: PMC9378600 DOI: 10.1097/hco.0000000000000973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE OF REVIEW Ultrasound enhancing agents (UEAs), microbubbles which are composed of lipid or albumin shells containing high molecular weight gases with nonlinear acoustic properties in the ultrasound field, are important components of the diagnostic armamentarium in echocardiography. This review highlights the substantial value of UEAs in delineating endocardial border definition and influencing downstream decision-making in cardiovascular ultrasound. RECENT FINDINGS In this article, we review recent updates to the clinical applications of UEAs, special circumstances regarding use, the impact of use on downstream testing and cost-effectiveness, and recommended approaches for optimizing workflow in the echocardiography laboratory with UEAs. SUMMARY In multiple studies, UEAs have been identified as a useful tool in echocardiography, improving study accuracy and reader confidence, while reducing downstream testing and procedures and resulting in significant changes in clinical management. Despite their proven efficacy and cost-effectiveness, recent studies have suggested utilization remains low, in part due to perceived concerns and workflow issues that impair uptake. With an increasingly broader list of indications for echocardiography, UEAs will continue to play an important role in the diagnosis and management of patients with cardiovascular and noncardiovascular diseases.
Collapse
Affiliation(s)
- Ariane M. Fraiche
- Department of Medicine, Cardiovascular Division, Beth Israel Deaconess Medical Center, Boston, MA
- Harvard Medical School
| | - Jordan B. Strom
- Department of Medicine, Cardiovascular Division, Beth Israel Deaconess Medical Center, Boston, MA
- Harvard Medical School
- Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Beth Israel Deaconess Medical Center, Boston, MA
| |
Collapse
|
15
|
Venkateswaran M, Nazzal Z, Ghanem B, Khraiwesh R, Abbas E, Abu Khader K, Awwad T, Hijaz T, Isbeih M, Mørkrid K, Rose CJ, Frøen JF. eRegTime-Time Spent on Health Information Management in Primary Health Care Clinics Using a Digital Health Registry Versus Paper-Based Documentation: Cluster-Randomized Controlled Trial. JMIR Form Res 2022; 6:e34021. [PMID: 35559792 PMCID: PMC9143771 DOI: 10.2196/34021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 03/03/2022] [Accepted: 03/07/2022] [Indexed: 11/17/2022] Open
Abstract
Background Digital health interventions have been shown to improve data quality and health services in low- and middle-income countries (LMICs). Nonetheless, in LMICs, systematic assessments of time saved with the use of digital tools are rare. We ran a set of cluster-randomized controlled trials as part of the implementation of a digital maternal and child health registry (eRegistry) in the West Bank, Palestine. Objective In the eRegTime study, we compared time spent on health information management in clinics that use the eRegistry versus the existing paper-based documentation system. Methods Intervention (eRegistry) and control (paper documentation) arms were defined by a stratified random subsample of primary health care clinics from the concurrent eRegQual trial. We used time-motion methodology to collect data on antenatal care service provision. Four observers used handheld tablets to record time-use data during one working day per clinic. We estimated relative time spent on health information management for booking and follow-up visits and on client care using mixed-effects linear regression. Results In total, 22 of the 24 included clinics (12 intervention, 10 control) contributed data; no antenatal care visits occurred in the other two clinics during the study period. A total of 123 and 118 consultations of new pregnancy registrations and follow-up antenatal care visits were observed in the intervention and control groups, respectively. Average time spent on health information management for follow-up antenatal care visits in eRegistry clinics was 5.72 minutes versus 8.10 minutes in control clinics (adjusted relative time 0.69, 95% CI 0.60-0.79; P<.001), and 15.26 minutes versus 18.91 minutes (adjusted relative time 0.96, 95% CI 0.61-1.50; P=.85) for booking visits. The average time spent on documentation, a subcategory of health information management, was 5.50 minutes in eRegistry clinics versus 8.48 minutes in control clinics (adjusted relative time 0.68, 95% CI 0.56-0.83; P<.001). While the average time spent on client care was 5.01 minutes in eRegistry clinics versus 4.91 minutes in control clinics, some uncertainty remains, and the CI was consistent with eRegistry clinics using less, the same, or more time on client care compared to those that use paper (adjusted relative time 0.85, 95% CI 0.64-1.13; P=.27). Conclusions The eRegistry captures digital data at point of care during client consultations and generates automated routine reports based on the clinical data entered. Markedly less time (plausibly a saving of at least 18%) was spent on health information management in eRegistry clinics compared to those that use paper-based documentation. This is likely explained by the fact that the eRegistry requires lesser repetitive documentation work than paper-based systems. Adoption of eRegistry-like systems in comparable settings may save valuable and scarce health care resources. Trial Registration ISRCTN registry ISRCTN18008445; https://doi.org/10.1186/ISRCTN18008445 International Registered Report Identifier (IRRID) RR2-10.2196/13653
Collapse
Affiliation(s)
- Mahima Venkateswaran
- Centre for Intervention Science in Maternal and Child Health, University of Bergen, Bergen, Norway.,Global Health Cluster, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway
| | - Zaher Nazzal
- Faculty of Medicine and Health Sciences, An-Najah National University, Nablus, Occupied Palestinian Territory
| | - Buthaina Ghanem
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Reham Khraiwesh
- Faculty of Medicine and Health Sciences, An-Najah National University, Nablus, Occupied Palestinian Territory
| | - Eatimad Abbas
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Khadija Abu Khader
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Tamara Awwad
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Taghreed Hijaz
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Mervett Isbeih
- Palestinian National Institute of Public Health, Al-Bireh, Occupied Palestinian Territory
| | - Kjersti Mørkrid
- Global Health Cluster, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway
| | - Christopher James Rose
- Global Health Cluster, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway
| | - J Frederik Frøen
- Centre for Intervention Science in Maternal and Child Health, University of Bergen, Bergen, Norway.,Global Health Cluster, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway
| |
Collapse
|
16
|
Grando MA, Vellore V, Duncan BJ, Kaufman DR, Furniss SK, Doebbeling BN, Poterack KA, Miksch T, Helmers RA. Study of EHR-mediated workflows using ethnography and process mining methods. Health Informatics J 2021; 27:14604582211008210. [PMID: 33853396 DOI: 10.1177/14604582211008210] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Rapid ethnography and data mining approaches have been used individually to study clinical workflows, but have seldom been used together to overcome the limitations inherent in either type of method. For rapid ethnography, how reliable are the findings drawn from small samples? For data mining, how accurate are the discoveries drawn from automatic analysis of big data, when compared with observable data? This paper explores the combined use of rapid ethnography and process mining, aka ethno-mining, to study and compare metrics of a typical clinical documentation task, vital signs charting. The task was performed with different electronic health records (EHRs) used in three different hospital sites. The individual methods revealed substantial discrepancies in task duration between sites. Specifically, means of 159.6(78.55), 38.2(34.9), and 431.3(283.04) seconds were captured with rapid ethnography. When process mining was used, means of 518.6(3,808), 345.5(660.6), and 119.74(210.3) seconds were found. When ethno-mining was applied instead, outliers could be identified, explained and removed. Without outliers, mean task duration was similar between sites (78.1(66.7), 72.5(78.5), and 71.7(75) seconds). Results from this work suggest that integrating rapid ethnography and data mining into a single process may provide more meaningful results than a siloed approach when studying of workflow.
Collapse
|
17
|
Olakotan OO, Mohd Yusof M. The appropriateness of clinical decision support systems alerts in supporting clinical workflows: A systematic review. Health Informatics J 2021; 27:14604582211007536. [PMID: 33853395 DOI: 10.1177/14604582211007536] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
A CDSS generates a high number of inappropriate alerts that interrupt the clinical workflow. As a result, clinicians silence, disable, or ignore alerts, thereby undermining patient safety. Therefore, the effectiveness and appropriateness of CDSS alerts need to be evaluated. A systematic review was carried out to identify the factors that affect CDSS alert appropriateness in supporting clinical workflow. Seven electronic databases (PubMed, Scopus, ACM, Science Direct, IEEE, Ovid Medline, and Ebscohost) were searched for English language articles published between 1997 and 2018. Seventy six papers met the inclusion criteria, of which 26, 24, 15, and 11 papers are retrospective cohort, qualitative, quantitative, and mixed-method studies, respectively. The review highlights various factors influencing the appropriateness and efficiencies of CDSS alerts. These factors are categorized into technology, human, organization, and process aspects using a combination of approaches, including socio-technical framework, five rights of CDSS, and Lean. Most CDSS alerts were not properly designed based on human factor methods and principles, explaining high alert overrides in clinical practices. The identified factors and recommendations from the review may offer valuable insights into how CDSS alerts can be designed appropriately to support clinical workflow.
Collapse
|
18
|
Shin GW, Lee Y, Park T, Cho I, Yun MH, Bahn S, Lee JH. Investigation of usability problems of electronic medical record systems in the emergency department. Work 2021; 72:221-238. [PMID: 34120924 DOI: 10.3233/wor-205262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND Despite the benefits of using electronic medical record (EMR) systems, existing studies show that many healthcare providers are uncertain regarding their usability. The usability issues of these systems decrease their efficiency, discourage clinicians, and cause dissatisfaction among patients, which may result in safety risks and harm. OBJECTIVE The aim of this study was to collect and analyze EMR system usability problems from actual users. Practical user interface guidelines were presented based on the medical practices of these users. METHODS Employing an online questionnaire with a seven-point Likert scale, usability issues of EMR systems were collected from 200 emergency department healthcare providers (103 physicians (medical doctors) and 97 nurses) from South Korea. RESULTS The most common usability problem among the physicians and nurses was generating in-patient selection. This pertained to the difficulty in finding the required information on-screen because of poor visibility and a lack of distinctiveness. CONCLUSIONS The major problems of EMR systems and their causes were identified. It is recommended that intensive visual enhancement of EMR system interfaces should be implemented to support user tasks. By providing a better understanding of the current usability problems among medical practitioners, the results of this study can be useful for developing EMR systems with increased effectiveness and efficiency.
Collapse
Affiliation(s)
- Gee Won Shin
- Department of Industrial Engineering, Seoul National University, Seoul
| | - Yura Lee
- Department of Information Medicine, Asan Medical Center, Seoul
| | - Taezoon Park
- Department of Industrial & Information Systems Engineering, Soongsil University, Seoul
| | - Insook Cho
- Nursing Department, Inha University, Incheon
| | - Myung Hwan Yun
- Department of Industrial Engineering, Seoul National University, Seoul
| | - Sangwoo Bahn
- Department of Industrial and Management Systems Engineering, Kyung Hee University, Yongin
| | - Jae-Ho Lee
- Department of Information Medicine, Asan Medical Center, Seoul.,Department of Emergency Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
19
|
Hoyt CC. Multiplex Immunofluorescence and Multispectral Imaging: Forming the Basis of a Clinical Test Platform for Immuno-Oncology. Front Mol Biosci 2021; 8:674747. [PMID: 34150850 PMCID: PMC8208831 DOI: 10.3389/fmolb.2021.674747] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 05/04/2021] [Indexed: 11/13/2022] Open
Abstract
As immuno-oncology (I/O) emerges as an effective approach in the fight against cancer, multispectral imaging of multiplex immunofluorescence (mIF) is maturing as an analytical platform. The timing is fortuitous. Due to health economic considerations surrounding the use of I/O, there is an urgent need for tests that accurately predict response to the growing list of available therapies. Multispectral mIF provides several advantages over other biomarker modalities by enabling deeper interrogation of the intricate biology within the tumor microenvironment, including detection of cell-to-cell spatial interactions that correlate with clinical outcomes. It also provides a practical path for generating reliable and reproducible results in a clinically suitable, high-throughput workflow. In this article, we (1) describe the principles behind multispectral mIF; (2) provide advice and recommendations on assay development and optimization and highlight characteristics of a well-performing assay; and (3) discuss the requirements for translating this approach into clinical practice.
Collapse
|
20
|
Lee Y, Bahn S, Shin GW, Jung MY, Park T, Cho I, Lee JH. Development of safety and usability guideline for clinical information system. Medicine (Baltimore) 2021; 100:e25276. [PMID: 33787612 PMCID: PMC8021279 DOI: 10.1097/md.0000000000025276] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Accepted: 03/03/2021] [Indexed: 01/04/2023] Open
Abstract
Clinical information systems (CISs) that do not consider usability and safety could lead to harmful events. Therefore, we aimed to develop a safety and usability guideline of CISs that is comprehensive for both users and developers. And the guideline was categorized to apply actual clinical workflow and work environment.The guideline components were extracted through a systematic review of the articles published between 2000 and 2015, and existing CIS safety and/or usability design guidelines. The guideline components were categorized according to clinical workflow and types of user interface (UI). The contents of the guideline were evaluated and validated by experts with 3 specialties: medical informatics, patient safety, and human engineering.Total 1276 guideline components were extracted through article and guideline review. Of these, 464 guideline components were categorized according to 5 divisions of the clinical workflow: "Data identification and selection," "Document entry," "Order entry," "Clinical decision support and alert," and "Management". While 521 guideline components were categorized according to 4 divisions of UI: UIs related to information process steps, "Perception," "Recognition," "Control," and "Feedback". We developed a guideline draft with 219 detailed guidance for clinical task and 70 for UI. Overall appropriateness and comprehensiveness were proven to achieve more than 90% in experts' survey. However, there were significant differences among the groups of specialties in the judgment of appropriateness (P < .001) and comprehensiveness (P = .038).We developed and verified a safety and usability guideline for CIS that qualifies the requirements of both clinical workflows and usability issues. The developed guideline can be a practical tool to enhance the usability and safety of CISs. Further validation is required by applying the guideline for designing the actual CIS.
Collapse
Affiliation(s)
- Yura Lee
- Department of Information Medicine, Asan Medical Center, Seoul
| | - Sangwoo Bahn
- Industrial and Management System Engineering, Kyung Hee University, Yongin
| | - Gee Won Shin
- Department of Industrial Engineering & Institute for Industrial Systems Innovation, Seoul National University
| | - Min-Young Jung
- Department of Information Medicine, Asan Medical Center, Seoul
| | - Taezoon Park
- Department of Industrial & Information Systems Engineering, Soongsil University, Seoul
| | - Insook Cho
- Nursing Department, Inha University, Incheon
| | - Jae-Ho Lee
- Department of Information Medicine, Asan Medical Center, Seoul
- Department of Emergency Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
21
|
Tao S, Lhatoo S, Hampson J, Cui L, Zhang GQ. A Bespoke Electronic Health Record for Epilepsy Care (EpiToMe): Development and Qualitative Evaluation. J Med Internet Res 2021; 23:e22939. [PMID: 33576745 PMCID: PMC7910122 DOI: 10.2196/22939] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 09/21/2020] [Accepted: 12/17/2020] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND While electronic health records (EHR) bring various benefits to health care, EHR systems are often criticized as cumbersome to use, failing to fulfill the promise of improved health care delivery with little more than a means of meeting regulatory and billing requirements. EHR has also been recognized as one of the contributing factors for physician burnout. OBJECTIVE Specialty-specific EHR systems have been suggested as an alternative approach that can potentially address challenges associated with general-purpose EHRs. We introduce the Epilepsy Tracking and optimized Management engine (EpiToMe), an exemplar bespoke EHR system for epilepsy care. EpiToMe uses an agile, physician-centered development strategy to optimize clinical workflow and patient care documentation. We present the design and implementation of EpiToMe and report the initial feedback on its utility for physician burnout. METHODS Using collaborative, asynchronous data capturing interfaces anchored to a domain ontology, EpiToMe distributes reporting and documentation workload among technicians, clinical fellows, and attending physicians. Results of documentation are transmitted to the parent EHR to meet patient care requirements with a push of a button. An HL7 (version 2.3) messaging engine exchanges information between EpiToMe and the parent EHR to optimize clinical workflow tasks without redundant data entry. EpiToMe also provides live, interactive patient tracking interfaces to ease the burden of care management. RESULTS Since February 2019, 15,417 electroencephalogram reports, 2635 Epilepsy Monitoring Unit daily reports, and 1369 Epilepsy Monitoring Unit phase reports have been completed in EpiToMe for 6593 unique patients. A 10-question survey was completed by 11 (among 16 invited) senior clinical attending physicians. Consensus was found that EpiToMe eased the burden of care documentation for patient management, a contributing factor to physician burnout. CONCLUSIONS EpiToMe offers an exemplar bespoke EHR system developed using a physician-centered design and latest advancements in information technology. The bespoke approach has the potential to ease the burden of care management in epilepsy. This approach is applicable to other clinical specialties.
Collapse
Affiliation(s)
- Shiqiang Tao
- Department of Neurology, The University of Texas Health Science Center at Houston, Houston, TX, United States.,Texas Institute for Restorative Neurotechnologies, The University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Samden Lhatoo
- Department of Neurology, The University of Texas Health Science Center at Houston, Houston, TX, United States.,Texas Institute for Restorative Neurotechnologies, The University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Johnson Hampson
- Department of Neurology, The University of Texas Health Science Center at Houston, Houston, TX, United States.,Texas Institute for Restorative Neurotechnologies, The University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Licong Cui
- Texas Institute for Restorative Neurotechnologies, The University of Texas Health Science Center at Houston, Houston, TX, United States.,School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Guo-Qiang Zhang
- Department of Neurology, The University of Texas Health Science Center at Houston, Houston, TX, United States.,Texas Institute for Restorative Neurotechnologies, The University of Texas Health Science Center at Houston, Houston, TX, United States.,School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States
| |
Collapse
|
22
|
Challen R, Tsaneva-Atanasova K, Edwards T, Gompels L, Dayer M, Pitt M, Danon L. Factors influencing digital review of pathology test results in an inpatient setting: a cross-sectional study. JAMIA Open 2020; 3:290-298. [PMID: 32734170 PMCID: PMC7382616 DOI: 10.1093/jamiaopen/ooaa003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Revised: 11/27/2019] [Accepted: 02/05/2020] [Indexed: 12/04/2022] Open
Abstract
BACKGROUND Delay or failure to view test results in a hospital setting can lead to delayed diagnosis, risk of patient harm, and represents inefficiency. Factors influencing this were investigated to identify how timeliness and completeness of test review could be improved through an evidence-based redesign of the use of clinical test review software. METHODS A cross-section of all abnormal hematology and biochemistry results which were published on a digital test review platform over a 3-year period were investigated. The time it took for clinicians to view these results, and the results that were not viewed within 30 days, were analyzed relative to time of the week, the detailed type of test, and an indicator of patient record data quality. RESULTS The majority of results were viewed within 90 min, and 93.9% of these results viewed on the digital platform within 30 days. There was significant variation in results review throughout the week, shown to be due to an interplay between technical and clinical workflow factors. Routine results were less likely to be reviewed, as were those with patient record data quality issues. CONCLUSION The evidence suggests that test result review would be improved by stream-lining access to the result platform, differentiating between urgent and routine results, improving handover of responsibility for result review, and improving search for temporary patient records. Altering the timing of phlebotomy rounds and a review of the appropriateness of routine test requests at the weekend may also improve result review rates.
Collapse
Affiliation(s)
- Robert Challen
- EPSRC Centre for Predictive Modelling in Healthcare, University of Exeter, Exeter, Devon, UK
- Taunton and Somerset NHS Foundation Trust, Taunton, Somerset, UK
| | - Krasimira Tsaneva-Atanasova
- EPSRC Centre for Predictive Modelling in Healthcare, University of Exeter, Exeter, Devon, UK
- The Alan Turing Institute, British Library, London, UK
| | - Tom Edwards
- Taunton and Somerset NHS Foundation Trust, Taunton, Somerset, UK
| | - Luke Gompels
- Taunton and Somerset NHS Foundation Trust, Taunton, Somerset, UK
| | - Mark Dayer
- Taunton and Somerset NHS Foundation Trust, Taunton, Somerset, UK
| | - Martin Pitt
- NIHR CLAHRC for the South West Peninsula, St Luke’s Campus, University of Exeter Medical School, Exeter, UK
| | - Leon Danon
- The Alan Turing Institute, British Library, London, UK
- Data Science Institute, College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter, UK
| |
Collapse
|
23
|
Humphries MP, Bingham V, Abdullahi Sidi F, Craig SG, McQuaid S, James J, Salto-Tellez M. Improving the Diagnostic Accuracy of the PD-L1 Test with Image Analysis and Multiplex Hybridization. Cancers (Basel) 2020; 12:E1114. [PMID: 32365629 PMCID: PMC7281311 DOI: 10.3390/cancers12051114] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 04/21/2020] [Accepted: 04/26/2020] [Indexed: 11/16/2022] Open
Abstract
Targeting of the programmed cell death protein (PD-1)/programmed death-ligand 1 (PD-L1) axis with checkpoint inhibitors has changed clinical practice in non-small cell lung cancer (NSCLC). However, clinical assessment remains complex and ambiguous. We aim to assess whether digital image analysis (DIA) and multiplex immunofluorescence can improve the accuracy of PD-L1 diagnostic testing. A clinical cohort of routine NSCLC patients reflex tested for PD-L1 (SP263) immunohistochemistry (IHC), was assessed using DIA. Samples of varying assessment difficulty were assessed by multiplex immunofluorescence. Sensitivity, specificity, and concordance was evaluated between manual diagnostic evaluation and DIA for chromogenic and multiplex IHC. PD-L1 expression by DIA showed significant concordance (R² = 0.8248) to manual assessment. Sensitivity and specificity was 86.8% and 91.4%, respectively. Evaluation of DIA scores revealed 96.8% concordance to manual assessment. Multiplexing enabled PD-L1+/CD68+ macrophages to be readily identified within PD-L1+/cytokeratin+ or PD-L1-/cytokeratin+ tumor nests. Assessment of multiplex vs. chromogenic IHC had a sensitivity and specificity of 97.8% and 91.8%, respectively. Deployment of DIA for PD-L1 diagnostic assessment is an accurate process of case triage. Multiplex immunofluorescence provided higher confidence in PD-L1 assessment and could be offered for challenging cases by centers with appropriate expertise and specialist equipment.
Collapse
Affiliation(s)
- Matthew P. Humphries
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
| | - Victoria Bingham
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
| | - Fatima Abdullahi Sidi
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
| | - Stephanie G. Craig
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
| | - Stephen McQuaid
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
- Cellular Pathology, Belfast Health and Social Care Trust, Belfast City Hospital, Lisburn Road, Belfast BT9 7BL, UK
- Northern Ireland Biobank, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK
| | - Jacqueline James
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
- Cellular Pathology, Belfast Health and Social Care Trust, Belfast City Hospital, Lisburn Road, Belfast BT9 7BL, UK
- Northern Ireland Biobank, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK
| | - Manuel Salto-Tellez
- Precision Medicine Centre of Excellence, The Patrick G Johnston Centre for Cancer Research, Queen’s University, Belfast BT9 7BL, UK; (M.P.H.); (V.B.); (F.A.S.); (S.G.C.); (S.M.); (J.J.)
- Cellular Pathology, Belfast Health and Social Care Trust, Belfast City Hospital, Lisburn Road, Belfast BT9 7BL, UK
| |
Collapse
|
24
|
Abstract
Background: The patient's history of present illness provides an important part of the data with which clinicians diagnose and treat. Once surgical patients are discharged, the ability to incorporate direct observation requires coordinating patient and provider for a clinical visit. Mobile technologies offer the ability to gather and organize the patient's history, supplement that history with photographs and other clinical observations, and convey those data accurately and rapidly to the entire clinical team. Methods: We review our experience with patient-generated health data in surgical site infection, draw parallels with similar work in other domains, and identify principles we have found useful. Results: Health information system implementations require substantial changes in provider workflow. Shared expectations between the patient and the surgical team, an incremental approach to change in clinical processes, and an emphasis on clinical utility all support successful implementation. Conclusions: The data collection and rapid information exchange afforded by monitoring post-operative, post-discharge patients using mobile technologies can support the expectations of both patients and providers and may provide a novel data source for public health surveillance of surgical site infection. Both uses of these data require careful attention to introducing changes in clinical workflow.
Collapse
Affiliation(s)
- William B Lober
- Department of Biobehavioral Nursing and Health Informatics, University of Washington, Seattle, Washington
| | - Heather L Evans
- Department of Surgery, Medical University of South Carolina, Charleston, South Carolina
| |
Collapse
|
25
|
Sharma H, Droste R, Chatelain P, Drukker L, Papageorghiou AT, Noble JA. Spatio-Temporal Partitioning and Description of Full-Length Routine Fetal Anomaly Ultrasound Scans. Proc IEEE Int Symp Biomed Imaging 2019; 16:987-990. [PMID: 31993109 PMCID: PMC6986911 DOI: 10.1109/isbi.2019.8759149] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper considers automatic clinical workflow description of full-length routine fetal anomaly ultrasound scans using deep learning approaches for spatio-temporal video analysis. Multiple architectures consisting of 2D and 2D + t CNN, LSTM, and convolutional LSTM are investigated and compared. The contributions of short-term and long-term temporal changes are studied, and a multi-stream framework analysis is found to achieve the best top-1 accuracy=0.77 and top-3 accuracy=0.94. Automated partitioning and characterisation on unlabelled full-length video scans show high correlation (ρ=0.95, p=0.0004) with workflow statistics of manually labelled videos, suggesting practicality of proposed methods.
Collapse
Affiliation(s)
- H Sharma
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK
| | - R Droste
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK
| | - P Chatelain
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK
| | - L Drukker
- Nuffield Department of Women's and Reproductive Health, University of Oxford, UK
| | - A T Papageorghiou
- Nuffield Department of Women's and Reproductive Health, University of Oxford, UK
| | - J A Noble
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK
| |
Collapse
|
26
|
Zhang R, Burgess ER, Reddy MC, Rothrock NE, Bhatt S, Rasmussen LV, Butt Z, Starren JB. Provider perspectives on the integration of patient-reported outcomes in an electronic health record. JAMIA Open 2019; 2:73-80. [PMID: 30976756 PMCID: PMC6447042 DOI: 10.1093/jamiaopen/ooz001] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2018] [Revised: 12/06/2018] [Accepted: 01/16/2019] [Indexed: 11/13/2022] Open
Abstract
Objective Integrating patient-reported outcomes (PROs) into electronic health records (EHRs) can improve patient-provider communication and delivery of care. However, new system implementation in health-care institutions is often accompanied by a change in clinical workflow and organizational culture. This study examines how well an EHR-integrated PRO system fits clinical workflows and individual needs of different provider groups within 2 clinics. Materials and Methods Northwestern Medicine developed and implemented an EHR-integrated PRO system within the orthopedics and oncology departments. We conducted interviews with 11 providers who had interacted with the system. Through thematic analysis, we synthesized themes regarding provider perspectives on clinical workflow, individual needs, and system features. Results Our findings show that EHR-integrated PROs facilitate targeted conversation with patients and automated triage for psychosocial care. However, physicians, psychosocial providers, and medical assistants faced different challenges in their use of the PRO system. Barriers mainly stemmed from a lack of actionable data, workflow disruption, technical issues, and a lack of incentives. Discussion This study sheds light on the ecosystem around EHR-integrated PRO systems (such as user needs and organizational factors). We present recommendations to address challenges facing PRO implementation, such as optimizing data collection and auto-referral processes, improving data visualizations, designing effective educational materials, and prioritizing the primary user group. Conclusion PRO integration into routine care can be beneficial but also require effective technology design and workflow configuration to reach full potential use. This study provides insights into how patient-generated health data can be better integrated into clinical practice and care delivery processes.
Collapse
Affiliation(s)
- Renwen Zhang
- Department of Communication Studies, Northwestern University, Evanston, Illinois, USA
| | - Eleanor R Burgess
- Department of Communication Studies, Northwestern University, Evanston, Illinois, USA
| | - Madhu C Reddy
- Department of Communication Studies, Northwestern University, Evanston, Illinois, USA
| | - Nan E Rothrock
- Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| | - Surabhi Bhatt
- Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| | - Luke V Rasmussen
- Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| | - Zeeshan Butt
- Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| | - Justin B Starren
- Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| |
Collapse
|
27
|
Shah VP, Lakshminarayanan P, Moore J, Tran PT, Quon H, Deville C, McNutt TR. Data integrity systems for organ contours in radiation therapy planning. J Appl Clin Med Phys 2018; 19:58-67. [PMID: 29893465 PMCID: PMC6036377 DOI: 10.1002/acm2.12353] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2017] [Revised: 01/31/2018] [Accepted: 03/27/2018] [Indexed: 11/30/2022] Open
Abstract
The purpose of this research is to develop effective data integrity models for contoured anatomy in a radiotherapy workflow for both real-time and retrospective analysis. Within this study, two classes of contour integrity models were developed: data driven models and contiguousness models. The data driven models aim to highlight contours which deviate from a gross set of contours from similar disease sites and encompass the following regions of interest (ROI): bladder, femoral heads, spinal cord, and rectum. The contiguousness models, which individually analyze the geometry of contours to detect possible errors, are applied across many different ROI's and are divided into two metrics: Extent and Region Growing over volume. After analysis, we found that 70% of detected bladder contours were verified as suspicious. The spinal cord and rectum models verified that 73% and 80% of contours were suspicious respectively. The contiguousness models were the most accurate models and the Region Growing model was the most accurate submodel. 100% of the detected noncontiguous contours were verified as suspicious, but in the cases of spinal cord, femoral heads, bladder, and rectum, the Region Growing model detected additional two to five suspicious contours that the Extent model failed to detect. When conducting a blind review to detect false negatives, it was found that all the data driven models failed to detect all suspicious contours. The Region Growing contiguousness model produced zero false negatives in all regions of interest other than prostate. With regards to runtime, the contiguousness via extent model took an average of 0.2 s per contour. On the other hand, the region growing method had a longer runtime which was dependent on the number of voxels in the contour. Both contiguousness models have potential for real-time use in clinical radiotherapy while the data driven models are better suited for retrospective use.
Collapse
Affiliation(s)
- Veeraj P Shah
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | | - Joseph Moore
- Department of Medical Oncology and Urology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Phuoc T Tran
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Medical Oncology and Urology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Harry Quon
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Curtiland Deville
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Todd R McNutt
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
28
|
Byrne MD, Fong H, Danks JK. A Survey of Perianesthesia Nursing Electronic Documentation. J Perianesth Nurs 2018; 33:172-176. [PMID: 29580596 DOI: 10.1016/j.jopan.2016.02.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2015] [Revised: 02/01/2016] [Accepted: 02/13/2016] [Indexed: 11/19/2022]
Abstract
PURPOSE Electronic health records have become a common part of the perianesthesia care workflow, particularly for data gathering and documentation. The purpose of this survey of perianesthesia nurses was to examine patterns of adoption of electronic health records and their effect on clinical documentation and patient care. DESIGN A survey was sent to nurses who are members of the American Society of Perianesthesia Nursing (ASPAN). METHODS The electronic documentation survey was sent to the e-mail addresses of 13,339 ASPAN members representing various practice environments across the United States. Results were examined through descriptive statistics. FINDINGS About two thirds (66.02%) of the respondents indicated that they could capture 80% of their clinical interactions with the patient. Few nurses indicated that adoption of the EHR was done using a standardized terminology. Respondents (63.99%) overwhelmingly indicated that they spent less time interacting with patients and families because of electronic documentation demands. CONCLUSIONS The results pertaining to the impact of the EHR on their practice were fairly mixed with some indication that there was greater access to important patient data, but with a trade-off of less satisfaction and efficiency. Improvements and evaluation of clinical documentation are being done, but ongoing optimization and improvements to the EHR based on the knowledge needs of nurses will help realize the promise of greater quality, safety, and access to data.
Collapse
|
29
|
Roy S, Brown MS, Shih GL. Visual Interpretation with Three-Dimensional Annotations (VITA): three-dimensional image interpretation tool for radiological reporting. J Digit Imaging 2014; 27:49-57. [PMID: 23979113 PMCID: PMC3903964 DOI: 10.1007/s10278-013-9624-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022] Open
Abstract
This paper introduces a software framework called Visual Interpretation with Three-Dimensional Annotations (VITA) that is able to automatically generate three-dimensional (3D) visual summaries based on radiological annotations made during routine exam reporting. VITA summaries are in the form of rotating 3D volumes where radiological annotations are highlighted to place important clinical observations into a 3D context. The rendered volume is produced as a Digital Imaging and Communications in Medicine (DICOM) object and is automatically added to the study for archival in Picture Archiving and Communication System (PACS). In addition, a video summary (e.g., MPEG4) can be generated for sharing with patients and for situations where DICOM viewers are not readily available to referring physicians. The current version of VITA is compatible with ClearCanvas; however, VITA can work with any PACS workstation that has a structured annotation implementation (e.g., Extendible Markup Language, Health Level 7, Annotation and Image Markup) and is able to seamlessly integrate into the existing reporting workflow. In a survey with referring physicians, the vast majority strongly agreed that 3D visual summaries improve the communication of the radiologists' reports and aid communication with patients.
Collapse
Affiliation(s)
- Sharmili Roy
- Department of Computer Science, School of Computing, National University of Singapore, Computing 1, 13 Computing Drive, Singapore, 117417, Singapore,
| | | | | |
Collapse
|
30
|
Gooch P, Roudsari A. Computerization of workflows, guidelines, and care pathways: a review of implementation challenges for process-oriented health information systems. J Am Med Inform Assoc 2011; 18:738-48. [PMID: 21724740 PMCID: PMC3197986 DOI: 10.1136/amiajnl-2010-000033] [Citation(s) in RCA: 63] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2010] [Accepted: 05/27/2011] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVE There is a need to integrate the various theoretical frameworks and formalisms for modeling clinical guidelines, workflows, and pathways, in order to move beyond providing support for individual clinical decisions and toward the provision of process-oriented, patient-centered, health information systems (HIS). In this review, we analyze the challenges in developing process-oriented HIS that formally model guidelines, workflows, and care pathways. METHODS A qualitative meta-synthesis was performed on studies published in English between 1995 and 2010 that addressed the modeling process and reported the exposition of a new methodology, model, system implementation, or system architecture. Thematic analysis, principal component analysis (PCA) and data visualisation techniques were used to identify and cluster the underlying implementation 'challenge' themes. RESULTS One hundred and eight relevant studies were selected for review. Twenty-five underlying 'challenge' themes were identified. These were clustered into 10 distinct groups, from which a conceptual model of the implementation process was developed. DISCUSSION AND CONCLUSION We found that the development of systems supporting individual clinical decisions is evolving toward the implementation of adaptable care pathways on the semantic web, incorporating formal, clinical, and organizational ontologies, and the use of workflow management systems. These architectures now need to be implemented and evaluated on a wider scale within clinical settings.
Collapse
Affiliation(s)
- Phil Gooch
- Centre for Health Informatics, School of Informatics, City University London, London, UK.
| | | |
Collapse
|
31
|
Bowens FM, Frye PA, Jones WA. Health information technology: integration of clinical workflow into meaningful use of electronic health records. Perspect Health Inf Manag 2010; 7:1d. [PMID: 21063545 PMCID: PMC2966355] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
This article examines the role that clinical workflow plays in successful implementation and meaningful use of electronic health record (EHR) technology in ambulatory care. The benefits and barriers of implementing EHRs in ambulatory care settings are discussed. The researchers conclude that widespread adoption and meaningful use of EHR technology rely on the successful integration of health information technology (HIT) into clinical workflow. Without successful integration of HIT into clinical workflow, clinicians in today's ambulatory care settings will continue to resist adoption and implementation of EHR technology.
Collapse
Affiliation(s)
- Felicia M Bowens
- University of Mississippi Medical Center's Institute for Improvement of Minority Health and Health Disparities in the Delta Region in Jackson, Mississippi, USA
| | | | | |
Collapse
|
32
|
Patel VL, Zhang J, Yoskowitz NA, Green R, Sayan OR. Translational cognition for decision support in critical care environments: a review. J Biomed Inform 2008; 41:413-31. [PMID: 18343731 PMCID: PMC2459228 DOI: 10.1016/j.jbi.2008.01.013] [Citation(s) in RCA: 70] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2007] [Revised: 01/05/2008] [Accepted: 01/25/2008] [Indexed: 10/22/2022]
Abstract
The dynamic and distributed work environment in critical care requires a high level of collaboration among clinical team members and a sophisticated task coordination system to deliver safe, timely and effective care. A complex cognitive system underlies the decision-making process in such cooperative workplaces. This methodological review paper addresses the issues of translating cognitive research to clinical practice with a specific focus on decision-making in critical care, and the role of information and communication technology to aid in such decisions. Examples are drawn from studies of critical care in our own research laboratories. Critical care, in this paper, includes both intensive (inpatient) and emergency (outpatient) care. We define translational cognition as the research on basic and applied cognitive issues that contribute to our understanding of how information is stored, retrieved and used for problem-solving and decision-making. The methods and findings are discussed in the context of constraints on decision-making in real-world complex environments and implications for supporting the design and evaluation of decision support tools for critical care health providers.
Collapse
Affiliation(s)
- Vimla L Patel
- Center for Decision Making and Cognition, Department of Biomedical Informatics, Arizona State University, Phoenix, AZ 85004, USA.
| | | | | | | | | |
Collapse
|