1
|
Davies A, Ahmed H, Thomas-Wood T, Wood F. Primary healthcare professionals' approach to clinical coding: a qualitative interview study in Wales. Br J Gen Pract 2024:BJGP.2024.0036. [PMID: 39084873 PMCID: PMC11539926 DOI: 10.3399/bjgp.2024.0036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 05/13/2024] [Indexed: 08/02/2024] Open
Abstract
BACKGROUND Clinical coding allows for structured and standardised recording of patients' electronic healthcare records. How clinical and non-clinical staff in general practice approach clinical coding is poorly understood. AIM To explore primary care staff's experiences and views on clinical coding. DESIGN AND SETTING Qualitative, semi-structured interview study among primary care staff across Wales. METHOD All general practices within Wales were invited to participate via NHS health boards. Semi-structured questions guided interviews, conducted between February 2023 and June 2023. Audio-recorded data were transcribed and analysed using reflexive thematic analysis. RESULTS A total of 19 participants were interviewed and six themes were identified: coding challenges, motivation to code, making coding easier, daily task of coding, what and when to code, and coding through COVID. CONCLUSION This study demonstrates the complexity of clinical coding in primary care. Clinical and non-clinical staff spoke of systems that lacked intuitiveness, and the challenges of multimorbidity and time pressures when coding in clinical situations. These challenges are likely to be exacerbated in socioeconomically deprived areas, leading to underreporting of disease in these areas. Challenges of clinical coding may lead to implications for data quality, particularly the validity of research findings generated from studies reliant on clinical coding from primary care. There are also consequences for patient care. Participants cared about coding quality and wanted a better way of using coding. There is a need to explore technological and non-technological solutions, such as artificial intelligence, training, and education to unburden people using clinical coding in primary care.
Collapse
Affiliation(s)
- Aled Davies
- PRIME Centre Wales, Cardiff University, Cardiff
| | - Haroon Ahmed
- Division of Population Medicine, Cardiff University, Cardiff
| | - Tracey Thomas-Wood
- Cwm Taf Morgannwg University Health Board, Royal Glamorgan Hospital, Llantrisant
| | - Fiona Wood
- Division of Population Medicine, Cardiff University, Cardiff
| |
Collapse
|
2
|
Rinne ST, Brunner J, Hogan TP, Ferguson JM, Helmer DA, Hysong SJ, McKee G, Midboe A, Shepherd-Banigan ME, Elwy AR. A use case of ChatGPT: summary of an expert panel discussion on electronic health records and implementation science. Front Digit Health 2024; 6:1426057. [PMID: 39512857 PMCID: PMC11540825 DOI: 10.3389/fdgth.2024.1426057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 09/30/2024] [Indexed: 11/15/2024] Open
Abstract
Objective Artificial intelligence (AI) is revolutionizing healthcare, but less is known about how it may facilitate methodological innovations in research settings. In this manuscript, we describe a novel use of AI in summarizing and reporting qualitative data generated from an expert panel discussion about the role of electronic health records (EHRs) in implementation science. Materials and methods 15 implementation scientists participated in an hour-long expert panel discussion addressing how EHRs can support implementation strategies, measure implementation outcomes, and influence implementation science. Notes from the discussion were synthesized by ChatGPT (a large language model-LLM) to generate a manuscript summarizing the discussion, which was later revised by participants. We also surveyed participants on their experience with the process. Results Panelists identified implementation strategies and outcome measures that can be readily supported by EHRs and noted that implementation science will need to evolve to assess future EHR advancements. The ChatGPT-generated summary of the panel discussion was generally regarded as an efficient means to offer a high-level overview of the discussion, although participants felt it lacked nuance and context. Extensive editing was required to contextualize the LLM-generated text and situate it in relevant literature. Discussion and conclusions Our qualitative findings highlight the central role EHRs can play in supporting implementation science, which may require additional informatics and implementation expertise and a different way to think about the combined fields. Our experience using ChatGPT as a research methods innovation was mixed and underscores the need for close supervision and attentive human involvement.
Collapse
Affiliation(s)
- Seppo T. Rinne
- Center for Healthcare Organization & Implementation Research, VA Bedford Healthcare System, Bedford, MA, United States
- Pulmonary and Critical Care Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH, United States
| | - Julian Brunner
- Center for the Study of Healthcare Innovation, Implementation, and Policy, VA Greater Los Angeles Healthcare System, Los Angeles, CA, United States
| | - Timothy P. Hogan
- Center for Healthcare Organization & Implementation Research, VA Bedford Healthcare System, Bedford, MA, United States
| | - Jacqueline M. Ferguson
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, Menlo Park, CA, United States
| | - Drew A. Helmer
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center, Houston, TX, United States
- Department of Medicine, Baylor College of Medicine, Houston, TX, United States
| | - Sylvia J. Hysong
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center, Houston, TX, United States
| | - Grace McKee
- Measurement Science QUERI, San Francisco VA Medical Center, San Francisco, CA, United States
- Department of Medicine, University of California San Francisco, San Francisco, VA, United States
| | - Amanda Midboe
- VA HSR&D Center for Innovation to Implementation (Ci2i), VA Palo Alto Health Care System, Menlo Park, CA, United States
- Department of Public Health Sciences, School of Medicine, University of California, Davis, CA, United States
| | - Megan E. Shepherd-Banigan
- Department of Population Health Sciences, Durham VA Health Care System, Durham, NC, United States
- Department of Population Health Sciences, Duke University, Durham, NC, United States
| | - A. Rani Elwy
- Center for Healthcare Organization & Implementation Research, VA Bedford Healthcare System, Bedford, MA, United States
| |
Collapse
|
3
|
Seth P, Carretas R, Rudzicz F. The Utility and Implications of Ambient Scribes in Primary Care. JMIR AI 2024; 3:e57673. [PMID: 39365655 PMCID: PMC11489790 DOI: 10.2196/57673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 08/18/2024] [Accepted: 09/08/2024] [Indexed: 10/05/2024]
Abstract
Ambient scribe technology, utilizing large language models, represents an opportunity for addressing several current pain points in the delivery of primary care. We explore the evolution of ambient scribes and their current use in primary care. We discuss the suitability of primary care for ambient scribe integration, considering the varied nature of patient presentations and the emphasis on comprehensive care. We also propose the stages of maturation in the use of ambient scribes in primary care and their impact on care delivery. Finally, we call for focused research on safety, bias, patient impact, and privacy in ambient scribe technology, emphasizing the need for early training and education of health care providers in artificial intelligence and digital health tools.
Collapse
Affiliation(s)
- Puneet Seth
- Department of Family Medicine, McMaster University, Hamilton, ON, Canada
| | - Romina Carretas
- School of Public Health, University of Alberta, Edmonton, AB, Canada
| | - Frank Rudzicz
- Faculty of Computer Science, Dalhousie University, Halifax, NS, Canada
- Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| |
Collapse
|
4
|
van Buchem MM, Kant IMJ, King L, Kazmaier J, Steyerberg EW, Bauer MP. Impact of a Digital Scribe System on Clinical Documentation Time and Quality: Usability Study. JMIR AI 2024; 3:e60020. [PMID: 39312397 PMCID: PMC11459111 DOI: 10.2196/60020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/12/2024] [Accepted: 07/19/2024] [Indexed: 09/25/2024]
Abstract
BACKGROUND Physicians spend approximately half of their time on administrative tasks, which is one of the leading causes of physician burnout and decreased work satisfaction. The implementation of natural language processing-assisted clinical documentation tools may provide a solution. OBJECTIVE This study investigates the impact of a commercially available Dutch digital scribe system on clinical documentation efficiency and quality. METHODS Medical students with experience in clinical practice and documentation (n=22) created a total of 430 summaries of mock consultations and recorded the time they spent on this task. The consultations were summarized using 3 methods: manual summaries, fully automated summaries, and automated summaries with manual editing. We then randomly reassigned the summaries and evaluated their quality using a modified version of the Physician Documentation Quality Instrument (PDQI-9). We compared the differences between the 3 methods in descriptive statistics, quantitative text metrics (word count and lexical diversity), the PDQI-9, Recall-Oriented Understudy for Gisting Evaluation scores, and BERTScore. RESULTS The median time for manual summarization was 202 seconds against 186 seconds for editing an automatic summary. Without editing, the automatic summaries attained a poorer PDQI-9 score than manual summaries (median PDQI-9 score 25 vs 31, P<.001, ANOVA test). Automatic summaries were found to have higher word counts but lower lexical diversity than manual summaries (P<.001, independent t test). The study revealed variable impacts on PDQI-9 scores and summarization time across individuals. Generally, students viewed the digital scribe system as a potentially useful tool, noting its ease of use and time-saving potential, though some criticized the summaries for their greater length and rigid structure. CONCLUSIONS This study highlights the potential of digital scribes in improving clinical documentation processes by offering a first summary draft for physicians to edit, thereby reducing documentation time without compromising the quality of patient records. Furthermore, digital scribes may be more beneficial to some physicians than to others and could play a role in improving the reusability of clinical documentation. Future studies should focus on the impact and quality of such a system when used by physicians in clinical practice.
Collapse
Affiliation(s)
- Marieke Meija van Buchem
- CAIRELab (Clinical AI Implementation and Research Lab), Leiden University Medical Center, Leiden, Netherlands
| | - Ilse M J Kant
- Department of Digital Health, University Medical Center Utrecht, Utrecht, Netherlands
| | - Liza King
- Autoscriber B.V., Eindhoven, Netherlands
| | | | - Ewout W Steyerberg
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Netherlands
| | - Martijn P Bauer
- Department of Internal Medicine, Leiden University Medical Center, Leiden, Netherlands
| |
Collapse
|
5
|
Agarwal P, Lall R, Girdhari R. Artificial intelligence scribes in primary care. CMAJ 2024; 196:E1042. [PMID: 39284604 PMCID: PMC11412733 DOI: 10.1503/cmaj.240363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/21/2024] Open
Affiliation(s)
- Payal Agarwal
- Department of Family and Community Medicine (Agarwal, Lall), University of Toronto; Women's College Hospital (Agarwal), Toronto, Ont.; Scarborough Health Network (Lall), Scarborough, Ont.; Unity Health Toronto (Girdhari), Toronto, Ont.
| | - Rosemarie Lall
- Department of Family and Community Medicine (Agarwal, Lall), University of Toronto; Women's College Hospital (Agarwal), Toronto, Ont.; Scarborough Health Network (Lall), Scarborough, Ont.; Unity Health Toronto (Girdhari), Toronto, Ont
| | - Rajesh Girdhari
- Department of Family and Community Medicine (Agarwal, Lall), University of Toronto; Women's College Hospital (Agarwal), Toronto, Ont.; Scarborough Health Network (Lall), Scarborough, Ont.; Unity Health Toronto (Girdhari), Toronto, Ont
| |
Collapse
|
6
|
Sezgin E, Sirrianni JW, Kranz K. Evaluation of a Digital Scribe: Conversation Summarization for Emergency Department Consultation Calls. Appl Clin Inform 2024; 15:600-611. [PMID: 38749477 PMCID: PMC11268986 DOI: 10.1055/a-2327-4121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 05/14/2024] [Indexed: 07/26/2024] Open
Abstract
OBJECTIVE We present a proof-of-concept digital scribe system as an Emergency Department (ED) consultation call-based clinical conversation summarization pipeline to support clinical documentation, and report its performance. MATERIALS AND METHODS We use four pre-trained large language models to establish the digital scribe system: T5-small, T5-base, PEGASUS-PubMed, and BART-Large-CNN via zero-shot and fine-tuning approaches. Our dataset includes 100 referral conversations among ED clinicians and medical records. We report the ROUGE-1, ROUGE-2, and ROUGE-L to compare model performance. In addition, we annotated transcriptions to assess the quality of generated summaries. RESULTS The fine-tuned BART-Large-CNN model demonstrates greater performance in summarization tasks with the highest ROUGE scores (F1ROUGE-1=0.49, F1ROUGE-2=0.23, F1ROUGE-L=0.35) scores. In contrast, PEGASUS-PubMed lags notably (F1ROUGE-1=0.28, F1ROUGE-2=0.11, F1ROUGE-L=0.22). BART-Large-CNN's performance decreases by more than 50% with the zero-shot approach. Annotations show that BART-Large-CNN performs 71.4% recall in identifying key information and a 67.7% accuracy rate. DISCUSSION The BART-Large-CNN model demonstrates a high level of understanding of clinical dialogue structure, indicated by its performance with and without fine-tuning. Despite some instances of high recall, there is variability in the model's performance, particularly in achieving consistent correctness, suggesting room for refinement. The model's recall ability varies across different information categories. CONCLUSION The study provides evidence towards the potential of AI-assisted tools in assisting clinical documentation. Future work is suggested on expanding the research scope with additional language models and hybrid approaches, and comparative analysis to measure documentation burden and human factors.
Collapse
Affiliation(s)
- Emre Sezgin
- Center for Biobehavioral Health, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, United States
- The Ohio State University College of Medicine, Columbus, Ohio, United States
| | - Joseph W. Sirrianni
- IT Research and Innovation, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, United States
| | - Kelly Kranz
- Physician Consult and Transfer Center, Nationwide Children's Hospital, Columbus, Ohio, United States
| |
Collapse
|
7
|
Fogleman BM, Goldman M, Holland AB, Dyess G, Patel A. Charting Tomorrow's Healthcare: A Traditional Literature Review for an Artificial Intelligence-Driven Future. Cureus 2024; 16:e58032. [PMID: 38738104 PMCID: PMC11088287 DOI: 10.7759/cureus.58032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/11/2024] [Indexed: 05/14/2024] Open
Abstract
Electronic health record (EHR) systems have developed over time in parallel with general advancements in mainstream technology. As artificially intelligent (AI) systems rapidly impact multiple societal sectors, it has become apparent that medicine is not immune from the influences of this powerful technology. Particularly appealing is how AI may aid in improving healthcare efficiency with note-writing automation. This literature review explores the current state of EHR technologies in healthcare, specifically focusing on possibilities for addressing EHR challenges through the automation of dictation and note-writing processes with AI integration. This review offers a broad understanding of existing capabilities and potential advancements, emphasizing innovations such as voice-to-text dictation, wearable devices, and AI-assisted procedure note dictation. The primary objective is to provide researchers with valuable insights, enabling them to generate new technologies and advancements within the healthcare landscape. By exploring the benefits, challenges, and future of AI integration, this review encourages the development of innovative solutions, with the goal of enhancing patient care and healthcare delivery efficiency.
Collapse
Affiliation(s)
- Brody M Fogleman
- Internal Medicine, Edward Via College of Osteopathic Medicine - Carolinas, Spartanburg, USA
| | - Matthew Goldman
- Neurological Surgery, Houston Methodist Hospital, Houston, USA
| | - Alexander B Holland
- General Surgery, Edward Via College of Osteopathic Medicine - Carolinas, Spartanburg, USA
| | - Garrett Dyess
- Medicine, University of South Alabama College of Medicine, Mobile, USA
| | - Aashay Patel
- Neurological Surgery, University of Florida College of Medicine, Gainesville, USA
| |
Collapse
|
8
|
Kim MK, Durkin S, Rouphael C. Optimizing Electronic Health Record Use in the Busy Gastroenterology Practice. Clin Gastroenterol Hepatol 2024; 22:452-454. [PMID: 38072286 DOI: 10.1016/j.cgh.2023.12.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Affiliation(s)
- Michelle Kang Kim
- Department of Gastroenterology, Hepatology, and Nutrition, Digestive Disease Institute, Cleveland Clinic, Cleveland, Ohio.
| | - Shannon Durkin
- Clinical Research Unit, Digestive Disease Institute, Cleveland Clinic, Cleveland, Ohio
| | - Carol Rouphael
- Department of Gastroenterology, Hepatology, and Nutrition, Digestive Disease Institute, Cleveland Clinic, Cleveland, Ohio
| |
Collapse
|
9
|
Tran BD, Latif K, Reynolds TL, Park J, Elston Lafata J, Tai-Seale M, Zheng K. "Mm-hm," "Uh-uh": are non-lexical conversational sounds deal breakers for the ambient clinical documentation technology? J Am Med Inform Assoc 2023; 30:703-711. [PMID: 36688526 PMCID: PMC10018260 DOI: 10.1093/jamia/ocad001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 12/13/2022] [Accepted: 01/12/2023] [Indexed: 01/24/2023] Open
Abstract
OBJECTIVES Ambient clinical documentation technology uses automatic speech recognition (ASR) and natural language processing (NLP) to turn patient-clinician conversations into clinical documentation. It is a promising approach to reducing clinician burden and improving documentation quality. However, the performance of current-generation ASR remains inadequately validated. In this study, we investigated the impact of non-lexical conversational sounds (NLCS) on ASR performance. NLCS, such as Mm-hm and Uh-uh, are commonly used to convey important information in clinical conversations, for example, Mm-hm as a "yes" response from the patient to the clinician question "are you allergic to antibiotics?" MATERIALS AND METHODS In this study, we evaluated 2 contemporary ASR engines, Google Speech-to-Text Clinical Conversation ("Google ASR"), and Amazon Transcribe Medical ("Amazon ASR"), both of which have their language models specifically tailored to clinical conversations. The empirical data used were from 36 primary care encounters. We conducted a series of quantitative and qualitative analyses to examine the word error rate (WER) and the potential impact of misrecognized NLCS on the quality of clinical documentation. RESULTS Out of a total of 135 647 spoken words contained in the evaluation data, 3284 (2.4%) were NLCS. Among these NLCS, 76 (0.06% of total words, 2.3% of all NLCS) were used to convey clinically relevant information. The overall WER, of all spoken words, was 11.8% for Google ASR and 12.8% for Amazon ASR. However, both ASR engines demonstrated poor performance in recognizing NLCS: the WERs across frequently used NLCS were 40.8% (Google) and 57.2% (Amazon), respectively; and among the NLCS that conveyed clinically relevant information, 94.7% and 98.7%, respectively. DISCUSSION AND CONCLUSION Current ASR solutions are not capable of properly recognizing NLCS, particularly those that convey clinically relevant information. Although the volume of NLCS in our evaluation data was very small (2.4% of the total corpus; and for NLCS that conveyed clinically relevant information: 0.06%), incorrect recognition of them could result in inaccuracies in clinical documentation and introduce new patient safety risks.
Collapse
Affiliation(s)
- Brian D Tran
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
- School of Medicine, University of California, Irvine, Irvine, California, USA
| | - Kareem Latif
- School of Medicine, California University of Science and Medicine, Colton, California, USA
| | - Tera L Reynolds
- Department of Information Systems, University of Maryland, Baltimore County, Baltimore, Maryland, USA
| | - Jihyun Park
- Department of Computer Science, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
| | - Jennifer Elston Lafata
- Division of Pharmaceutical Outcomes and Policy, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
- Center for Health Policy and Health Services Research, Henry Ford Health System, Detroit, Michigan, USA
| | - Ming Tai-Seale
- Department of Family Medicine and Public Health, School of Medicine, University of California, San Diego, La Jolla, California, USA
| | - Kai Zheng
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
| |
Collapse
|
10
|
Lam M, Sabharwal S. The Role of Scribes in Orthopaedics. JBJS Rev 2023; 11:01874474-202303000-00005. [PMID: 36947638 DOI: 10.2106/jbjs.rvw.22.00247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2023]
Abstract
» The rapid increase in the use of electronic medical records (EMRs) has led to some unintended consequences that negatively affect physicians and their patients. » The use of medical scribes may serve as a possible solution to some of the EMR-related concerns. » Research has demonstrated an overall positive impact of having scribes on both physician and patient well-being, safety, and satisfaction. » Adaptation of advances in technology, including remote and asynchronous scribing, use of face-mounted devices, voice recognition software, and applications of artificial intelligence may address some of the barriers to more traditional in-person scribes.
Collapse
Affiliation(s)
- Michelle Lam
- Department of Orthopaedic Surgery, UCSF Benioff Children's Hospital Oakland, Oakland, California
| | | |
Collapse
|
11
|
Nguyen OT, Turner K, Charles D, Sprow O, Perkins R, Hong YR, Islam JY, Khanna N, Alishahi Tabriz A, Hallanger-Johnson J, Bickel Young J, Moore CE. Implementing Digital Scribes to Reduce Electronic Health Record Documentation Burden Among Cancer Care Clinicians: A Mixed-Methods Pilot Study. JCO Clin Cancer Inform 2023; 7:e2200166. [PMID: 36972488 DOI: 10.1200/cci.22.00166] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023] Open
Abstract
PURPOSE To address shortcomings of human scribes (eg, turnover), clinicians are considering digital scribes (DSs). To our knowledge, to date, no study has assessed DS implementation or clinician user experience in cancer centers. We assessed the DS's feasibility, acceptability, appropriateness, usability and its preliminary association on clinician well-being in a cancer center. We also identified implementation facilitators and barriers to DS use. METHODS Using a mixed-methods longitudinal pilot study design, we implemented a DS at a cancer center. Data collection included surveys at baseline and 1 month after DS use and a semistructured interview with clinicians. The survey assessed demographics, Mini Z (workplace stress and burnout), sleep quality, and implementation outcomes (feasibility, acceptability, appropriateness, and usability). The interview assessed how the DS was used and its impacts on workflows and recommendations for future implementations of the DS. We used paired t tests to assess differences in Mini Z and sleep quality measures over time. RESULTS Across nine survey responses and eight interviews, we found that although feasibility scores were slightly lower than our cutoff point (15.2 v 16.0), clinicians rated the DS as marginally acceptable (16.0) and appropriate (16.3). Usability was considered marginally usable (68.6 v 68.0). Although the DS did not significantly improve burnout (3.6 v 3.9, P = .081), it improved perceptions of having sufficient documentation time (2.1 v 3.6, P = .005). Clinicians identified suggestions for future implementations, including training needs and usability improvements. CONCLUSION Our preliminary findings suggest that DS implementation is marginally acceptable, appropriate, and usable among cancer care clinicians. Individualized training and on-site support may improve implementation.
Collapse
Affiliation(s)
- Oliver T Nguyen
- Department of Health Outcomes and Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Kea Turner
- Department of Health Outcomes and Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
- Department of Oncologic Science, University of South Florida, Tampa, FL
- Department of Gastrointestinal Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Dannelle Charles
- Participant, Research, Interventions, and Measurement Core, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Olivia Sprow
- Department of Epidemiology, University of Florida, Gainesville, FL
| | - Randa Perkins
- Department of Internal Medicine, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Young-Rock Hong
- Department of Health Services Research, Management, and Policy, Gainesville, FL
| | - Jessica Y Islam
- Department of Health Outcomes and Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
- Department of Cancer Epidemiology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Neel Khanna
- Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, NC
| | - Amir Alishahi Tabriz
- Department of Health Outcomes and Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
- Department of Oncologic Science, University of South Florida, Tampa, FL
- Department of Gastrointestinal Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | | | - Jennifer Bickel Young
- Department of Oncologic Science, University of South Florida, Tampa, FL
- Department of Neuro-Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
- Wellness Office, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| | - Colin E Moore
- Department of Individualized Cancer Management, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
| |
Collapse
|
12
|
Leung T, Janssen DM, van der Steen MC, Delvaux EJLG, Hendriks JGE, Janssen RPA. Digital Health Applications to Establish a Remote Diagnosis of Orthopedic Knee Disorders: Scoping Review. J Med Internet Res 2023; 25:e40504. [PMID: 36566450 PMCID: PMC9951077 DOI: 10.2196/40504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 10/04/2022] [Accepted: 12/23/2022] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND Knee pain is highly prevalent worldwide, and this number is expected to rise in the future. The COVID-19 outbreak, in combination with the aging population, rising health care costs, and the need to make health care more accessible worldwide, has led to an increasing demand for digital health care applications to deliver care for patients with musculoskeletal conditions. Digital health and other forms of telemedicine can add value in optimizing health care for patients and health care providers. This might reduce health care costs and make health care more accessible while maintaining a high level of quality. Although expectations are high, there is currently no overview comparing digital health applications with face-to-face contact in clinical trials to establish a primary knee diagnosis in orthopedic surgery. OBJECTIVE This study aimed to investigate the currently available digital health and telemedicine applications to establish a primary knee diagnosis in orthopedic surgery in the general population in comparison with imaging or face-to-face contact between patients and physicians. METHODS A scoping review was conducted using the PubMed and Embase databases according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) statement. The inclusion criteria were studies reporting methods to determine a primary knee diagnosis in orthopedic surgery using digital health or telemedicine. On April 28 and 29, 2021, searches were conducted in PubMed (MEDLINE) and Embase. Data charting was conducted using a predefined form and included details on general study information, study population, type of application, comparator, analyses, and key findings. A risk-of-bias analysis was not deemed relevant considering the scoping review design of the study. RESULTS After screening 5639 articles, 7 (0.12%) were included. In total, 2 categories to determine a primary diagnosis were identified: screening studies (4/7, 57%) and decision support studies (3/7, 43%). There was great heterogeneity in the included studies in algorithms used, disorders, input parameters, and outcome measurements. No more than 25 knee disorders were included in the studies. The included studies showed a relatively high sensitivity (67%-91%). The accuracy of the different studies was generally lower, with a specificity of 27% to 48% for decision support studies and 73% to 96% for screening studies. CONCLUSIONS This scoping review shows that there are a limited number of available applications to establish a remote diagnosis of knee disorders in orthopedic surgery. To date, there is limited evidence that digital health applications can assist patients or orthopedic surgeons in establishing the primary diagnosis of knee disorders. Future research should aim to integrate multiple sources of information and a standardized study design with close collaboration among clinicians, data scientists, data managers, lawyers, and service users to create reliable and secure databases.
Collapse
Affiliation(s)
| | - Daan M Janssen
- Department of Orthopedic Surgery & Trauma, Máxima Medical Center, Veldhoven, Netherlands
| | - Maria C van der Steen
- Department of Orthopedic Surgery & Trauma, Máxima Medical Center, Veldhoven, Netherlands.,Department of Orthopedic Surgery & Trauma, Catharina Hospital, Eindhoven, Netherlands
| | | | - Johannes G E Hendriks
- Department of Orthopedic Surgery & Trauma, Máxima Medical Center, Veldhoven, Netherlands
| | - Rob P A Janssen
- Department of Orthopedic Surgery & Trauma, Máxima Medical Center, Veldhoven, Netherlands.,Orthopedic Biomechanics, Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands.,Value-Based Health Care, Department of Paramedical Sciences, Fontys University of Applied Sciences, Eindhoven, Netherlands
| |
Collapse
|
13
|
Aylward BS, Abbas H, Taraman S, Salomon C, Gal-Szabo D, Kraft C, Ehwerhemuepha L, Chang A, Wall DP. An Introduction to Artificial Intelligence in Developmental and Behavioral Pediatrics. J Dev Behav Pediatr 2023; 44:e126-e134. [PMID: 36730317 PMCID: PMC9907689 DOI: 10.1097/dbp.0000000000001149] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 09/12/2022] [Indexed: 02/03/2023]
Abstract
ABSTRACT Technological breakthroughs, together with the rapid growth of medical information and improved data connectivity, are creating dramatic shifts in the health care landscape, including the field of developmental and behavioral pediatrics. While medical information took an estimated 50 years to double in 1950, by 2020, it was projected to double every 73 days. Artificial intelligence (AI)-powered health technologies, once considered theoretical or research-exclusive concepts, are increasingly being granted regulatory approval and integrated into clinical care. In the United States, the Food and Drug Administration has cleared or approved over 160 health-related AI-based devices to date. These trends are only likely to accelerate as economic investment in AI health care outstrips investment in other sectors. The exponential increase in peer-reviewed AI-focused health care publications year over year highlights the speed of growth in this sector. As health care moves toward an era of intelligent technology powered by rich medical information, pediatricians will increasingly be asked to engage with tools and systems underpinned by AI. However, medical students and practicing clinicians receive insufficient training and lack preparedness for transitioning into a more AI-informed future. This article provides a brief primer on AI in health care. Underlying AI principles and key performance metrics are described, and the clinical potential of AI-driven technology together with potential pitfalls is explored within the developmental and behavioral pediatric health context.
Collapse
Affiliation(s)
| | | | - Sharief Taraman
- Cognoa, Inc, Palo Alto, CA
- CHOC (Children's Health of Orange County), Orange, CA
- University of California Irvine, Irvine, CA
- Chapman University, Orange, CA
- Medical Intelligence and Innovation Institute (M13), CHOC, Orange, CA
| | | | | | - Colleen Kraft
- Cognoa, Inc, Palo Alto, CA
- University of Southern California, Los Angeles, CA
- Children's Hospital of Los Angeles, Los Angeles, CA; and
| | - Louis Ehwerhemuepha
- CHOC (Children's Health of Orange County), Orange, CA
- Chapman University, Orange, CA
- Medical Intelligence and Innovation Institute (M13), CHOC, Orange, CA
| | - Anthony Chang
- CHOC (Children's Health of Orange County), Orange, CA
- University of California Irvine, Irvine, CA
- Medical Intelligence and Innovation Institute (M13), CHOC, Orange, CA
| | - Dennis P. Wall
- Cognoa, Inc, Palo Alto, CA
- Stanford Medical School, Palo Alto, CA
| |
Collapse
|
14
|
Li T, Yu L, Zhou L, Wang P. Using less keystrokes to achieve high top-1 accuracy in Chinese clinical text entry. Digit Health 2023; 9:20552076231179027. [PMID: 37256013 PMCID: PMC10226174 DOI: 10.1177/20552076231179027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 05/12/2023] [Indexed: 06/01/2023] Open
Abstract
Background As a routine task, physicians spend substantial time and keystrokes on text entry. Documentation burden is increasingly associated with physician burnout. Predicting at top-1 with less keystrokes (TLKs) is a hot topic for smart text entry. In Western countries, contextual autocomplete is deployed to alleviate the burden. Chinese text entry is intercepted by input method engines (IMEs), which cut off suggestions from electronic health records (EHRs). Objective To explore a user-friendly approach to make text entry easier and faster for Chinese physicians. Methods Physicians were shadowed to uncover the real-word input behaviors. System logs were collected for behavior validation and then used for context-based learning. An in-line web-based popup layer was proposed to hold the best suggestion from EHRs. Keystrokes per character and TLK rate were evaluated quantitatively. Questionnaires were used for qualitative assessment. Nine hundred fifty-two physicians were enrolled in a field testing. Results 14 facilitators and 17 barriers related to IMEs were identified after shadowing. With system logs, physicians tended to split long words into short units, which were 1-4 in length. 81.7% of these units were disyllables. Compared to the control group, the intervention group improved TLK rate by 40.3% (p < .0001), and reduced keystrokes per character by 48.3% (p < .0001). Survey results also promised positive feedback from physicians. Conclusions Keystroke burden and frequent choice reaction time challenge Chinese physicians for text entry. The proposed system demonstrates an approach to alleviate the burden. Contextual information is easily retrieved and it further helps improve the top-1 accuracy, with a smaller number of keystrokes. While positive feedback is received, it promises a benefit to protect patient privacy.
Collapse
Affiliation(s)
- Tao Li
- Information Technology Department,
Shanghai Sixth People's Hospital, Shanghai, China
| | - Lei Yu
- Information Technology Department,
Shanghai Sixth People's Hospital, Shanghai, China
| | - Liang Zhou
- Information Technology Department,
Shanghai Sixth People's Hospital, Shanghai, China
| | - Panzhang Wang
- Information Technology Department,
Shanghai Sixth People's Hospital, Shanghai, China
| |
Collapse
|
15
|
Coiera E, Liu S. Evidence synthesis, digital scribes, and translational challenges for artificial intelligence in healthcare. Cell Rep Med 2022; 3:100860. [PMID: 36513071 PMCID: PMC9798027 DOI: 10.1016/j.xcrm.2022.100860] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 10/15/2022] [Accepted: 11/18/2022] [Indexed: 12/14/2022]
Abstract
Healthcare has well-known challenges with safety, quality, and effectiveness, and many see artificial intelligence (AI) as essential to any solution. Emerging applications include the automated synthesis of best-practice research evidence including systematic reviews, which would ultimately see all clinical trial data published in a computational form for immediate synthesis. Digital scribes embed themselves in the process of care to detect, record, and summarize events and conversations for the electronic record. However, three persistent translational challenges must be addressed before AI is widely deployed. First, little effort is spent replicating AI trials, exposing patients to risks of methodological error and biases. Next, there is little reporting of patient harms from trials. Finally, AI built using machine learning may perform less effectively in different clinical settings.
Collapse
Affiliation(s)
- Enrico Coiera
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Level 6, 75 Talavera Road, North Ryde, Sydney, NSW 2109, Australia.
| | - Sidong Liu
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Level 6, 75 Talavera Road, North Ryde, Sydney, NSW 2109, Australia
| |
Collapse
|
16
|
Aramaki E, Wakamiya S, Yada S, Nakamura Y. Natural Language Processing: from Bedside to Everywhere. Yearb Med Inform 2022; 31:243-253. [PMID: 35654422 PMCID: PMC9719781 DOI: 10.1055/s-0042-1742510] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
Abstract
OBJECTIVES Owing to the rapid progress of natural language processing (NLP), the role of NLP in the medical field has radically gained considerable attention from both NLP and medical informatics. Although numerous medical NLP papers are published annually, there is still a gap between basic NLP research and practical product development. This gap raises questions, such as what has medical NLP achieved in each medical field, and what is the burden for the practical use of NLP? This paper aims to clarify the above questions. METHODS We explore the literature on potential NLP products/services applied to various medical/clinical/healthcare areas. RESULTS This paper introduces clinical applications (bedside applications), in which we introduce the use of NLP for each clinical department, internal medicine, pre-surgery, post-surgery, oncology, radiology, pathology, psychiatry, rehabilitation, obstetrics, and gynecology. Also, we clarify technical problems to be addressed for encouraging bedside applications based on NLP. CONCLUSIONS These results contribute to discussions regarding potentially feasible NLP applications and highlight research gaps for future studies.
Collapse
Affiliation(s)
- Eiji Aramaki
- Nara Institute of Science and Technology (NAIST), Nara, Japan
| | - Shoko Wakamiya
- Nara Institute of Science and Technology (NAIST), Nara, Japan
| | - Shuntaro Yada
- Nara Institute of Science and Technology (NAIST), Nara, Japan
| | - Yuta Nakamura
- Division of Radiology and Biomedical Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
17
|
Avendano JP, Gallagher DO, Hawes JD, Boyle J, Glasser L, Aryee J, Katt BM. Interfacing With the Electronic Health Record (EHR): A Comparative Review of Modes of Documentation. Cureus 2022; 14:e26330. [PMID: 35911305 PMCID: PMC9311494 DOI: 10.7759/cureus.26330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/25/2022] [Indexed: 11/30/2022] Open
Abstract
Electronic health records (EHRs) have provided physicians with a systematic framework for collecting patient data, organizing notes from the healthcare team, and managing the daily workflow in the modern era of healthcare. Despite these advantages, EHRs have proven to be problematic for clinicians. The burdensome regulations requiring increased documentation with the EHR paradigm have led to inefficiencies from data-entry requirements forcing physicians to spend an inordinate amount of time on it, affecting the time available for direct patient care as well as leading to professional burnout. As a result, new modalities such as speech recognition, medical scribes, pre-made EHR templates, and digital scribes [a form of artificial intelligence (AI) based on ambient speech recognition] are increasingly being used to reduce charting time and increase the time available for patient care. The purpose of our review is to provide an up-to-date review of the literature on these modalities including their benefits and shortcomings, to help physicians and other medical professionals choose the best methods to document their patient-care encounters efficiently and effectively.
Collapse
|
18
|
A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions. SENSORS 2022; 22:s22072625. [PMID: 35408238 PMCID: PMC9003264 DOI: 10.3390/s22072625] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/12/2022] [Accepted: 03/24/2022] [Indexed: 02/06/2023]
Abstract
This paper reviews different types of conversational agents used in health care for chronic conditions, examining their underlying communication technology, evaluation measures, and AI methods. A systematic search was performed in February 2021 on PubMed Medline, EMBASE, PsycINFO, CINAHL, Web of Science, and ACM Digital Library. Studies were included if they focused on consumers, caregivers, or healthcare professionals in the prevention, treatment, or rehabilitation of chronic diseases, involved conversational agents, and tested the system with human users. The search retrieved 1087 articles. Twenty-six studies met the inclusion criteria. Out of 26 conversational agents (CAs), 16 were chatbots, seven were embodied conversational agents (ECA), one was a conversational agent in a robot, and another was a relational agent. One agent was not specified. Based on this review, the overall acceptance of CAs by users for the self-management of their chronic conditions is promising. Users’ feedback shows helpfulness, satisfaction, and ease of use in more than half of included studies. Although many users in the studies appear to feel more comfortable with CAs, there is still a lack of reliable and comparable evidence to determine the efficacy of AI-enabled CAs for chronic health conditions due to the insufficient reporting of technical implementation details.
Collapse
|
19
|
Symbolic and Statistical Learning Approaches to Speech Summarization: A Scoping Review. COMPUT SPEECH LANG 2022. [DOI: 10.1016/j.csl.2021.101305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
20
|
Bunting J, de Klerk M. Strategies to Improve Compliance with Clinical Nursing Documentation Guidelines in the Acute Hospital Setting: A Systematic Review and Analysis. SAGE Open Nurs 2022; 8:23779608221075165. [PMID: 35620302 PMCID: PMC9127672 DOI: 10.1177/23779608221075165] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 12/24/2021] [Indexed: 11/17/2022] Open
Abstract
Introduction This systematic review attempts to answer the following question - which strategies to improve clinical nursing documentation have been most effective in the acute hospital setting? Methods A keyword search for relevant studies was conducted in CINAHL and Medline in May 2019 and October 2020.Studies were appraised using the Joanna Briggs Institute (JBI) critical appraisal for quasi-experimental studies. The studies were graded for level of evidence according to GRADE principles.The data collected in each study were added to a Summary of Data (SOD) spreadsheet. Pre intervention and a post intervention percentage compliance scores were calculated for each study where possible i.e. (mean score/possible total score) × (100/1). A percentage change in compliance for each study was calculated by subtracting the pre intervention score from the post intervention score. The change in compliance score and the post intervention compliance score were both added to the SOD and used as a basis for comparison between the studies. Each study was analyzed thematically in terms of the intervention strategies used. Compliance rates and the interventions used were compared to determine if any strategies were effective in achieving a meaningful improvement in compliance. Results Seventy six full text articles were reviewed for this systematic review. Fifty seven of the studies were before and after studies and 66 were conducted in western countries. Publishing dates for the studies ranged from 1991 to 2020.Eleven studies included documentation audits with personal feedback as one of the strategies used to improve nursing documentation. Ten of these studies achieved a post intervention compliance rate ≥ 70%. Conclusion Notwithstanding the limitations of this study, it may be that documentation audit with personal feedback, when combined with other context specific strategies, is a reliable method for gaining meaningful improvements in clinical nursing documentation. The level of evidence is very low and further research is required.
Collapse
Affiliation(s)
- Jeanette Bunting
- Joondalup Health Campus Librarian, Joondalup, Western Australia,
Australia
| | - Melissa de Klerk
- Joondalup Health Campus Library
Technician, Joondalup, Western Australia, Australia
| |
Collapse
|
21
|
Tran BD, Rosenbaum K, Zheng K. An interview study with medical scribes on how their work may alleviate clinician burnout through delegated health IT tasks. J Am Med Inform Assoc 2021; 28:907-914. [PMID: 33576391 DOI: 10.1093/jamia/ocaa345] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 11/16/2020] [Accepted: 02/01/2021] [Indexed: 12/15/2022] Open
Abstract
OBJECTIVES To understand how medical scribes' work may contribute to alleviating clinician burnout attributable directly or indirectly to the use of health IT. MATERIALS AND METHODS Qualitative analysis of semistructured interviews with 32 participants who had scribing experience in a variety of clinical settings. RESULTS We identified 7 categories of clinical tasks that clinicians commonly choose to offload to medical scribes, many of which involve delegated use of health IT. These range from notes-taking and computerized data entry to foraging, assembling, and tracking information scattered across multiple clinical information systems. Some common characteristics shared among these tasks include: (1) time-consuming to perform; (2) difficult to remember or keep track of; (3) disruptive to clinical workflow, clinicians' cognitive processes, or patient-provider interactions; (4) perceived to be low-skill "clerical" work; and (5) deemed as adding no value to direct patient care. DISCUSSION The fact that clinicians opt to "outsource" certain clinical tasks to medical scribes is a strong indication that performing these tasks is not perceived to be the best use of their time. Given that a vast majority of healthcare practices in the US do not have the luxury of affording medical scribes, the burden would inevitably fall onto clinicians' shoulders, which could be a major source for clinician burnout. CONCLUSIONS Medical scribes help to offload a substantial amount of burden from clinicians-particularly with tasks that involve onerous interactions with health IT. Developing a better understanding of medical scribes' work provides useful insights into the sources of clinician burnout and potential solutions to it.
Collapse
Affiliation(s)
- Brian D Tran
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, California, USA.,School of Medicine, University of California, Irvine, California, USA
| | - Kathryn Rosenbaum
- School of Medicine, University of California, Irvine, California, USA
| | - Kai Zheng
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, California, USA.,Department of Emergency Medicine, School of Medicine, University of California, Irvine, California, USA
| |
Collapse
|
22
|
Kataria S, Ravindran V. Electronic health records: a critical appraisal of strengths and limitations. J R Coll Physicians Edinb 2021; 50:262-268. [PMID: 32936099 DOI: 10.4997/jrcpe.2020.309] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
Electronic health record (EHR) was hailed as a major step towards making healthcare more transparent and accountable. All the developed nations digitised their health records which were meant to be safe, secure and could be accessed on demand. This was intended to benefit all stakeholders. However, the jury is still out if the EHR has been worth it. There have been incidences of data breaches despite cybersecurity checks and of manipulation compromising clinicians' integrity and patients' safety. EHRs have also been blamed for doctor burnout in overloading them with a largely avoidable administrative burden. The lack of interoperability amongst various EHR software systems is creating obstacles in seamless workflow. Artificial intelligence is now being used to overcome deficiencies of the EHR. Emerging data from real-world usage of EHR is providing useful inputs which would be helpful in making it a better system. This review critically appraises the current status and issues with the EHR and provides an overview of the key innovations which are being implemented to make the system more efficient for health care providers leading to a reduction in their administrative burden.
Collapse
|
23
|
Digital scribe utility and barriers to implementation in clinical practice: a scoping review. HEALTH AND TECHNOLOGY 2021; 11:803-809. [PMID: 34094806 PMCID: PMC8169416 DOI: 10.1007/s12553-021-00568-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 05/27/2021] [Indexed: 10/25/2022]
Abstract
Electronic health records (EHRs) allow for meaningful usage of healthcare data. Their adoption provides clinicians with a central location to access and share data, write notes, order labs and prescriptions, and bill for patient visits. However, as non-clinical requirements have increased, time spent using EHRs eclipsed time spent on direct patient care. Several solutions have been proposed to minimize the time spent using EHRs, though each have limitations. Digital scribe technology uses voice-to-text software to convert ambient listening to meaningful medical notes and may eliminate the physical task of documentation, allowing physicians to spend less time on EHR engagement and more time with patients. However, adoption of digital scribe technology poses many barriers for physicians. In this study, we perform a scoping review of the literature to identify barriers to digital scribe implementation and provide solutions to address these barriers. We performed a literature review of digital scribe technology and voice-to-text conversion and information extraction as a scope for future research. Fifteen articles met inclusion criteria. Of the articles included, four were comparative studies, three were reviews, three were original investigations, two were perspective pieces, one was a cost-effectiveness study, one was a keynote address, and one was an observational study. The published articles on digital scribe technology and voice-to-text conversion highlight digital scribe technology as a solution to the inefficient interaction with EHRs. Benefits of digital scribe technologies included enhancing clinician ability to navigate charts, write notes, use decision support tools, and improve the quality of time spent with patients. Digital scribe technologies can improve clinic efficiency and increase patient access to care while simultaneously reducing physician burnout. Implementation barriers include upfront costs, integration with existing technology, and time-intensive training. Technological barriers include adaptability to linguistic differences, compatibility across different clinical encounters, and integration of medical jargon into the note. Broader risks include automation bias and risks to data privacy. Overcoming significant barriers to implementation will facilitate more widespread adoption. Supplementary information The online version contains supplementary material available at 10.1007/s12553-021-00568-0.
Collapse
|
24
|
Maassen O, Fritsch S, Palm J, Deffge S, Kunze J, Marx G, Riedel M, Schuppert A, Bickenbach J. Future Medical Artificial Intelligence Application Requirements and Expectations of Physicians in German University Hospitals: Web-Based Survey. J Med Internet Res 2021; 23:e26646. [PMID: 33666563 PMCID: PMC7980122 DOI: 10.2196/26646] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 01/29/2021] [Accepted: 02/15/2021] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND The increasing development of artificial intelligence (AI) systems in medicine driven by researchers and entrepreneurs goes along with enormous expectations for medical care advancement. AI might change the clinical practice of physicians from almost all medical disciplines and in most areas of health care. While expectations for AI in medicine are high, practical implementations of AI for clinical practice are still scarce in Germany. Moreover, physicians' requirements and expectations of AI in medicine and their opinion on the usage of anonymized patient data for clinical and biomedical research have not been investigated widely in German university hospitals. OBJECTIVE This study aimed to evaluate physicians' requirements and expectations of AI in medicine and their opinion on the secondary usage of patient data for (bio)medical research (eg, for the development of machine learning algorithms) in university hospitals in Germany. METHODS A web-based survey was conducted addressing physicians of all medical disciplines in 8 German university hospitals. Answers were given using Likert scales and general demographic responses. Physicians were asked to participate locally via email in the respective hospitals. RESULTS The online survey was completed by 303 physicians (female: 121/303, 39.9%; male: 173/303, 57.1%; no response: 9/303, 3.0%) from a wide range of medical disciplines and work experience levels. Most respondents either had a positive (130/303, 42.9%) or a very positive attitude (82/303, 27.1%) towards AI in medicine. There was a significant association between the personal rating of AI in medicine and the self-reported technical affinity level (H4=48.3, P<.001). A vast majority of physicians expected the future of medicine to be a mix of human and artificial intelligence (273/303, 90.1%) but also requested a scientific evaluation before the routine implementation of AI-based systems (276/303, 91.1%). Physicians were most optimistic that AI applications would identify drug interactions (280/303, 92.4%) to improve patient care substantially but were quite reserved regarding AI-supported diagnosis of psychiatric diseases (62/303, 20.5%). Of the respondents, 82.5% (250/303) agreed that there should be open access to anonymized patient databases for medical and biomedical research. CONCLUSIONS Physicians in stationary patient care in German university hospitals show a generally positive attitude towards using most AI applications in medicine. Along with this optimism comes several expectations and hopes that AI will assist physicians in clinical decision making. Especially in fields of medicine where huge amounts of data are processed (eg, imaging procedures in radiology and pathology) or data are collected continuously (eg, cardiology and intensive care medicine), physicians' expectations of AI to substantially improve future patient care are high. In the study, the greatest potential was seen in the application of AI for the identification of drug interactions, assumedly due to the rising complexity of drug administration to polymorbid, polypharmacy patients. However, for the practical usage of AI in health care, regulatory and organizational challenges still have to be mastered.
Collapse
Affiliation(s)
- Oliver Maassen
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Sebastian Fritsch
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
| | - Julia Palm
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, Jena, Germany
| | - Saskia Deffge
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Julian Kunze
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Gernot Marx
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Morris Riedel
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
- School of Natural Sciences and Engineering, University of Iceland, Reykjavik, Iceland
| | - Andreas Schuppert
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Institute for Computational Biomedicine II, University Hospital RWTH Aachen, Aachen, Germany
| | - Johannes Bickenbach
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| |
Collapse
|
25
|
Sutton RA, Sharma P. Overcoming barriers to implementation of artificial intelligence in gastroenterology. Best Pract Res Clin Gastroenterol 2021; 52-53:101732. [PMID: 34172254 DOI: 10.1016/j.bpg.2021.101732] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Accepted: 02/08/2021] [Indexed: 01/31/2023]
Abstract
Artificial intelligence is poised to revolutionize the field of medicine, however significant questions must be answered prior to its implementation on a regular basis. Many artificial intelligence algorithms remain limited by isolated datasets which may cause selection bias and truncated learning for the program. While a central database may solve this issue, several barriers such as security, patient consent, and management structure prevent this from being implemented. An additional barrier to daily use is device approval by the Food and Drug Administration. In order for this to occur, clinical studies must address new endpoints, including and beyond the traditional bio- and medical statistics. These must showcase artificial intelligence's benefit and answer key questions, including challenges posed in the field of medical ethics.
Collapse
Affiliation(s)
- Richard A Sutton
- University of Kansas Medical Center 3901 Rainbow Blvd, Kansas City, KS, USA; Kansas City Veteran's Affairs Medical Center 4801 Linwood Blvd, Kansas City, MO, USA.
| | - Prateek Sharma
- University of Kansas Medical Center 3901 Rainbow Blvd, Kansas City, KS, USA; Kansas City Veteran's Affairs Medical Center 4801 Linwood Blvd, Kansas City, MO, USA.
| |
Collapse
|
26
|
Kocaballi AB, Coiera E, Tong HL, White SJ, Quiroz JC, Rezazadegan F, Willcock S, Laranjo L. A network model of activities in primary care consultations. J Am Med Inform Assoc 2021; 26:1074-1082. [PMID: 31329875 PMCID: PMC6748800 DOI: 10.1093/jamia/ocz046] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2018] [Revised: 03/01/2019] [Accepted: 03/24/2019] [Indexed: 11/26/2022] Open
Abstract
Objective The objective of this study is to characterize the dynamic structure of primary care consultations by identifying typical activities and their inter-relationships to inform the design of automated approaches to clinical documentation using natural language processing and summarization methods. Materials and Methods This is an observational study in Australian general practice involving 31 consultations with 4 primary care physicians. Consultations were audio-recorded, and computer interactions were recorded using screen capture. Physical interactions in consultation rooms were noted by observers. Brief interviews were conducted after consultations. Conversational transcripts were analyzed to identify different activities and their speech content as well as verbal cues signaling activity transitions. An activity transition analysis was then undertaken to generate a network of activities and transitions. Results Observed activity classes followed those described in well-known primary care consultation models. Activities were often fragmented across consultations, did not flow necessarily in a defined order, and the flow between activities was nonlinear. Modeling activities as a network revealed that discussing a patient’s present complaint was the most central activity and was highly connected to medical history taking, physical examination, and assessment, forming a highly interrelated bundle. Family history, allergy, and investigation discussions were less connected suggesting less dependency on other activities. Clear verbal signs were often identifiable at transitions between activities. Discussion Primary care consultations do not appear to follow a classic linear model of defined information seeking activities; rather, they are fragmented, highly interdependent, and can be reactively triggered. Conclusion The nonlinearity of activities has significant implications for the design of automated information capture. Whereas dictation systems generate literal translation of speech into text, speech-based clinical summary systems will need to link disparate information fragments, merge their content, and abstract coherent information summaries.
Collapse
Affiliation(s)
- Ahmet Baki Kocaballi
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Enrico Coiera
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Huong Ly Tong
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Sarah J White
- Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia
| | - Juan C Quiroz
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Fahimeh Rezazadegan
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Simon Willcock
- Health Sciences Centre, Macquarie University, Sydney, Australia
| | - Liliana Laranjo
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| |
Collapse
|
27
|
Latif S, Qadir J, Qayyum A, Usama M, Younis S. Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art. IEEE Rev Biomed Eng 2021; 14:342-356. [PMID: 32746367 DOI: 10.1109/rbme.2020.3006860] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Speech technology is not appropriately explored even though modern advances in speech technology-especially those driven by deep learning (DL) technology-offer unprecedented opportunities for transforming the healthcare industry. In this paper, we have focused on the enormous potential of speech technology for revolutionising the healthcare domain. More specifically, we review the state-of-the-art approaches in automatic speech recognition (ASR), speech synthesis or text to speech (TTS), and health detection and monitoring using speech signals. We also present a comprehensive overview of various challenges hindering the growth of speech-based services in healthcare. To make speech-based healthcare solutions more prevalent, we discuss open issues and suggest some possible research directions aimed at fully leveraging the advantages of other technologies for making speech-based healthcare solutions more effective.
Collapse
|
28
|
Fagherazzi G, Fischer A, Ismael M, Despotovic V. Voice for Health: The Use of Vocal Biomarkers from Research to Clinical Practice. Digit Biomark 2021; 5:78-88. [PMID: 34056518 PMCID: PMC8138221 DOI: 10.1159/000515346] [Citation(s) in RCA: 50] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 02/18/2021] [Indexed: 12/17/2022] Open
Abstract
Diseases can affect organs such as the heart, lungs, brain, muscles, or vocal folds, which can then alter an individual's voice. Therefore, voice analysis using artificial intelligence opens new opportunities for healthcare. From using vocal biomarkers for diagnosis, risk prediction, and remote monitoring of various clinical outcomes and symptoms, we offer in this review an overview of the various applications of voice for health-related purposes. We discuss the potential of this rapidly evolving environment from a research, patient, and clinical perspective. We also discuss the key challenges to overcome in the near future for a substantial and efficient use of voice in healthcare.
Collapse
Affiliation(s)
- Guy Fagherazzi
- Deep Digital Phenotyping Research Unit, Department of Population Health, Luxembourg Institute of Health, Strassen, Luxembourg
| | - Aurélie Fischer
- Deep Digital Phenotyping Research Unit, Department of Population Health, Luxembourg Institute of Health, Strassen, Luxembourg
| | - Muhannad Ismael
- IT for Innovation in Services Department (ITIS), Luxembourg Institute of Science and Technology (LIST), Esch-sur-Alzette, Luxembourg
| | - Vladimir Despotovic
- Department of Computer Science, Faculty of Science, Technology and Medicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| |
Collapse
|
29
|
Kocaballi AB, Ijaz K, Laranjo L, Quiroz JC, Rezazadegan D, Tong HL, Willcock S, Berkovsky S, Coiera E. Envisioning an artificial intelligence documentation assistant for future primary care consultations: A co-design study with general practitioners. J Am Med Inform Assoc 2020; 27:1695-1704. [PMID: 32845984 PMCID: PMC7671614 DOI: 10.1093/jamia/ocaa131] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 05/29/2020] [Accepted: 06/08/2020] [Indexed: 01/16/2023] Open
Abstract
OBJECTIVE The study sought to understand the potential roles of a future artificial intelligence (AI) documentation assistant in primary care consultations and to identify implications for doctors, patients, healthcare system, and technology design from the perspective of general practitioners. MATERIALS AND METHODS Co-design workshops with general practitioners were conducted. The workshops focused on (1) understanding the current consultation context and identifying existing problems, (2) ideating future solutions to these problems, and (3) discussing future roles for AI in primary care. The workshop activities included affinity diagramming, brainwriting, and video prototyping methods. The workshops were audio-recorded and transcribed verbatim. Inductive thematic analysis of the transcripts of conversations was performed. RESULTS Two researchers facilitated 3 co-design workshops with 16 general practitioners. Three main themes emerged: professional autonomy, human-AI collaboration, and new models of care. Major implications identified within these themes included (1) concerns with medico-legal aspects arising from constant recording and accessibility of full consultation records, (2) future consultations taking place out of the exam rooms in a distributed system involving empowered patients, (3) human conversation and empathy remaining the core tasks of doctors in any future AI-enabled consultations, and (4) questioning the current focus of AI initiatives on improved efficiency as opposed to patient care. CONCLUSIONS AI documentation assistants will likely to be integral to the future primary care consultations. However, these technologies will still need to be supervised by a human until strong evidence for reliable autonomous performance is available. Therefore, different human-AI collaboration models will need to be designed and evaluated to ensure patient safety, quality of care, doctor safety, and doctor autonomy.
Collapse
Affiliation(s)
- A Baki Kocaballi
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
- Faculty of Engineering & IT, University of Technology Sydney, Sydney, Australia
| | - Kiran Ijaz
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Liliana Laranjo
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
- Westmead Applied Research Centre, Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Juan C Quiroz
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Dana Rezazadegan
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
- Faculty of Science, Engineering and Technology, Swinburne University of Technology, Victoria, Australia
| | - Huong Ly Tong
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Simon Willcock
- Health Sciences Centre, Macquarie University, Sydney, Australia
| | - Shlomo Berkovsky
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Enrico Coiera
- Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| |
Collapse
|
30
|
Position statement on priorities for artificial intelligence in GI endoscopy: a report by the ASGE Task Force. Gastrointest Endosc 2020; 92:951-959. [PMID: 32565188 DOI: 10.1016/j.gie.2020.06.035] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Accepted: 06/14/2020] [Indexed: 12/11/2022]
Abstract
Artificial intelligence (AI) in GI endoscopy holds tremendous promise to augment clinical performance, establish better treatment plans, and improve patient outcomes. Although there are promising initial applications and preliminary clinical data for AI in gastroenterology, the field is still in a very early phase, with limited clinical use. The American Society for Gastrointestinal Endoscopy has convened an AI Task Force to develop guidance around clinical implementation, testing/validating algorithms, and building pathways for successful implementation of AI in GI endoscopy. This White Paper focuses on 3 areas: (1) priority use cases for development of AI algorithms in GI, both for specific clinical scenarios and for streamlining clinical workflows, quality reporting, and practice management; (2) data science priorities, including development of image libraries, and standardization of methods for storing, sharing, and annotating endoscopic images/video; and (3) research priorities, focusing on the importance of high-quality, prospective trials measuring clinically meaningful patient outcomes.
Collapse
|
31
|
Quiroz JC, Laranjo L, Kocaballi AB, Briatore A, Berkovsky S, Rezazadegan D, Coiera E. Identifying relevant information in medical conversations to summarize a clinician-patient encounter. Health Informatics J 2020; 26:2906-2914. [PMID: 32865113 DOI: 10.1177/1460458220951719] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
To inform the development of automated summarization of clinical conversations, this study sought to estimate the proportion of doctor-patient communication in general practice (GP) consultations used for generating a consultation summary. Two researchers with a medical degree read the transcripts of 44 GP consultations and highlighted the phrases to be used for generating a summary of the consultation. For all consultations, less than 20% of all words in the transcripts were needed for inclusion in the summary. On average, 9.1% of all words in the transcripts, 26.6% of all medical terms, and 27.3% of all speaker turns were highlighted. The results indicate that communication content used for generating a consultation summary makes up a small portion of GP consultations, and automated summarization solutions-such as digital scribes-must focus on identifying the 20% relevant information for automatically generating consultation summaries.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Enrico Coiera
- Australian Institute of Health Innovation, Macquarie University, Australia
| |
Collapse
|
32
|
Shah T, Kitts AB, Gold JA, Horvath K, Ommaya A, Frank O, Sato L, Schwarze G, Upton M, Sandy L. Electronic Health Record Optimization and Clinician Well-Being: A Potential Roadmap Toward Action. NAM Perspect 2020; 2020:202008a. [PMID: 35291737 PMCID: PMC8916811 DOI: 10.31478/202008a] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
|
33
|
Tran BD, Chen Y, Liu S, Zheng K. How does medical scribes' work inform development of speech-based clinical documentation technologies? A systematic review. J Am Med Inform Assoc 2020; 27:808-817. [PMID: 32181812 PMCID: PMC7309239 DOI: 10.1093/jamia/ocaa020] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2019] [Revised: 02/11/2020] [Accepted: 02/15/2020] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE Use of medical scribes reduces clinician burnout by sharing the burden of clinical documentation. However, medical scribes are cost-prohibitive for most settings, prompting a growing interest in developing ambient, speech-based technologies capable of automatically generating clinical documentation based on patient-provider conversation. Through a systematic review, we aimed to develop a thorough understanding of the work performed by medical scribes in order to inform the design of such technologies. MATERIALS AND METHODS Relevant articles retrieved by searching in multiple literature databases. We conducted the screening process following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) in guidelines, and then analyzed the data using qualitative methods to identify recurring themes. RESULTS The literature search returned 854 results, 65 of which met the inclusion criteria. We found that there is significant variation in scribe expectations and responsibilities across healthcare organizations; scribes also frequently adapt their work based on the provider's style and preferences. Further, scribes' job extends far beyond capturing conversation in the exam room; they also actively interact with patients and the care team and integrate data from other sources such as prior charts and lab test results. DISCUSSION The results of this study provide several implications for designing technologies that can generate clinical documentation based on naturalistic conversations taking place in the exam room. First, a one-size-fits-all solution will be unlikely to work because of the significant variation in scribe work. Second, technology designers need to be aware of the limited role that their solution can fulfill. Third, to produce comprehensive clinical documentation, such technologies will likely have to incorporate information beyond the exam room conversation. Finally, issues of patient consent and privacy have yet to be adequately addressed, which could become paramount barriers to implementing such technologies in realistic clinical settings. CONCLUSIONS Medical scribes perform complex and delicate work. Further research is needed to better understand their roles in a clinical setting in order to inform the development of speech-based clinical documentation technologies.
Collapse
Affiliation(s)
- Brian D Tran
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
- Medical Scientist Training Program, School of Medicine, University of California, Irvine, Irvine, California, USA
| | - Yunan Chen
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
| | - Songzi Liu
- The School of Information and Library Science, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Kai Zheng
- Department of Informatics, Donald Bren School of Informatics and Computer Science, University of California, Irvine, Irvine, California, USA
- Department of Emergency Medicine, School of Medicine, University of California, Irvine, Irvine, California, USA
| |
Collapse
|
34
|
Chan L, Vaid A, Nadkarni GN. Applications of machine learning methods in kidney disease: hope or hype? Curr Opin Nephrol Hypertens 2020; 29:319-326. [PMID: 32235273 PMCID: PMC7770625 DOI: 10.1097/mnh.0000000000000604] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
PURPOSE OF REVIEW The universal adoption of electronic health records, improvement in technology, and the availability of continuous monitoring has generated large quantities of healthcare data. Machine learning is increasingly adopted by nephrology researchers to analyze this data in order to improve the care of their patients. RECENT FINDINGS In this review, we provide a broad overview of the different types of machine learning algorithms currently available and how researchers have applied these methods in nephrology research. Current applications have included prediction of acute kidney injury and chronic kidney disease along with progression of kidney disease. Researchers have demonstrated the ability of machine learning to read kidney biopsy samples, identify patient outcomes from unstructured data, and identify subtypes in complex diseases. We end with a discussion on the ethics and potential pitfalls of machine learning. SUMMARY Machine learning provides researchers with the ability to analyze data that were previously inaccessible. While still burgeoning, several studies show promising results, which will enable researchers to perform larger scale studies and clinicians the ability to provide more personalized care. However, we must ensure that implementation aids providers and does not lead to harm to patients.
Collapse
Affiliation(s)
- Lili Chan
- Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
- The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY
- The BioMe Phenomics Center, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Akhil Vaid
- The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Girish N. Nadkarni
- Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
- The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY
- The BioMe Phenomics Center, Icahn School of Medicine at Mount Sinai, New York, NY
| |
Collapse
|
35
|
Reick-Mitrisin V, MacDonald M, Lin S, Hong S. Scribe impacts on US health care: Benefits may go beyond cost efficiency. J Allergy Clin Immunol 2020; 145:479-480. [DOI: 10.1016/j.jaci.2019.12.900] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 12/18/2019] [Accepted: 12/19/2019] [Indexed: 11/28/2022]
|
36
|
Rasouli P, Dooghaie Moghadam A, Eslami P, Aghajanpoor Pasha M, Asadzadeh Aghdaei H, Mehrvar A, Nezami-Asl A, Iravani S, Sadeghi A, Zali MR. The role of artificial intelligence in colon polyps detection. GASTROENTEROLOGY AND HEPATOLOGY FROM BED TO BENCH 2020; 13:191-199. [PMID: 32821348 PMCID: PMC7417492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Over the past few decades, artificial intelligence (AI) has evolved dramatically and is believed to have a significant impact on all aspects of technology and daily life. The use of AI in the healthcare system has been rapidly growing, owing to the large amount of data. Various methods of AI including machine learning, deep learning and convolutional neural network (CNN) have been used in diagnostic imaging, which have helped physicians in the accurate diagnosis of diseases and determination of appropriate treatment for them. Using and collecting a huge number of digital images and medical records has led to the creation of big data over a time period. Currently, considerations regarding the diagnosis of various presentations in all endoscopic procedures and imaging findings are solely handled by endoscopists. Moreover, AI has shown to be highly effective in the field of gastroenterology in terms of diagnosis, prognosis, and image processing. Herein, this review aimed to discuss different aspects of AI use for early detection and treatment of gastroenterology diseases.
Collapse
Affiliation(s)
- Pezhman Rasouli
- Department of Computer, West Tehran Branch, Islamic Azad University, Tehran, Iran
| | - Arash Dooghaie Moghadam
- Gastroenterology and Liver Diseases Research Center, Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Pegah Eslami
- Gastroenterology and Liver Diseases Research Center, Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Morteza Aghajanpoor Pasha
- Gastroenterology and Hepatobiliary Research Center, AJA University of Medical Sciences, Tehran, Iran
| | - Hamid Asadzadeh Aghdaei
- Basic and Molecular Epidemiology of Gastrointestinal Disorders Research Center, Research institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Azim Mehrvar
- Basic and Molecular Epidemiology of Gastrointestinal Disorders Research Center, Research institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Amir Nezami-Asl
- Research Center for Cancer Screening and Epidemiology, AJA University of Medical Sciences, Tehran, Iran
| | - Shahrokh Iravani
- Research Center for Cancer Screening and Epidemiology, AJA University of Medical Sciences, Tehran, Iran
| | - Amir Sadeghi
- Gastroenterology and Liver Diseases Research Center, Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran ,Reprint or Correspondence: Amir Sadeghi, MD & Shahrokh Iravani, MD. Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, & Gastroenterology and Hepatobiliary Research Center, Imam Reza (501) Hospital, AJA University of Medical Sciences, Tehran, Iran. E-mail: &
| | - Mohammad Reza Zali
- Gastroenterology and Liver Diseases Research Center, Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
37
|
Challenges of developing a digital scribe to reduce clinical documentation burden. NPJ Digit Med 2019; 2:114. [PMID: 31799422 PMCID: PMC6874666 DOI: 10.1038/s41746-019-0190-1] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 10/29/2019] [Indexed: 12/13/2022] Open
Abstract
Clinicians spend a large amount of time on clinical documentation of patient encounters, often impacting quality of care and clinician satisfaction, and causing physician burnout. Advances in artificial intelligence (AI) and machine learning (ML) open the possibility of automating clinical documentation with digital scribes, using speech recognition to eliminate manual documentation by clinicians or medical scribes. However, developing a digital scribe is fraught with problems due to the complex nature of clinical environments and clinical conversations. This paper identifies and discusses major challenges associated with developing automated speech-based documentation in clinical settings: recording high-quality audio, converting audio to transcripts using speech recognition, inducing topic structure from conversation data, extracting medical concepts, generating clinically meaningful summaries of conversations, and obtaining clinical data for AI and ML algorithms.
Collapse
|
38
|
NØHR C, KUZIEMSKY CE, ELKIN PL, MARCILLY R, PELAYO S. Sustainable Health Informatics: Health Informaticians as Alchemists. Stud Health Technol Inform 2019; 265:3-11. [PMID: 31431570 PMCID: PMC7323624 DOI: 10.3233/shti190129] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
The digital transformation of health care delivery remains an elusive work in progress. Contextual variation continues to be a significant barrier to the development of sustainable health information systems. In this paper we characterize health informaticians as modern alchemists and use this characterization to describe informatics progress in addressing four key healthcare challenges. We highlight the need for informaticians to be diligent and loyal to basic methodological principles while also appreciating the role that contextual variation plays in informatics research. We also emphasize that meaningful health systems transformation takes time. The insight presented in this paper helps informaticians in our quest to develop sustainable health information systems.
Collapse
Affiliation(s)
- Christian NØHR
- Maersk Mc-Kinney Moller Institute, University of Southern Denmark
| | | | - Peter L. ELKIN
- Department of Biomedical Informatics, Jacobs School of Medicine, University at Buffalo, The State University of New York
| | - Romaric MARCILLY
- Univ. Lille, INSERM, CHU Lille, CIC-IT/Evalab 1403 - Centre d’Investigation clinique, EA 2694, F-59000 Lille, France
| | - Sylvia PELAYO
- Univ. Lille, INSERM, CHU Lille, CIC-IT/Evalab 1403 - Centre d’Investigation clinique, EA 2694, F-59000 Lille, France
| |
Collapse
|
39
|
Dewey M, Wilkens U. The Bionic Radiologist: avoiding blurry pictures and providing greater insights. NPJ Digit Med 2019; 2:65. [PMID: 31388567 PMCID: PMC6616477 DOI: 10.1038/s41746-019-0142-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2019] [Accepted: 05/28/2019] [Indexed: 12/11/2022] Open
Abstract
Radiology images and reports have long been digitalized. However, the potential of the more than 3.6 billion radiology examinations performed annually worldwide has largely gone unused in the effort to digitally transform health care. The Bionic Radiologist is a concept that combines humanity and digitalization for better health care integration of radiology. At a practical level, this concept will achieve critical goals: (1) testing decisions being made scientifically on the basis of disease probabilities and patient preferences; (2) image analysis done consistently at any time and at any site; and (3) treatment suggestions that are closely linked to imaging results and are seamlessly integrated with other information. The Bionic Radiologist will thus help avoiding missed care opportunities, will provide continuous learning in the work process, and will also allow more time for radiologists' primary roles: interacting with patients and referring physicians. To achieve that potential, one has to cope with many implementation barriers at both the individual and institutional levels. These include: reluctance to delegate decision making, a possible decrease in image interpretation knowledge and the perception that patient safety and trust are at stake. To facilitate implementation of the Bionic Radiologist the following will be helpful: uncertainty quantifications for suggestions, shared decision making, changes in organizational culture and leadership style, maintained expertise through continuous learning systems for training, and role development of the involved experts. With the support of the Bionic Radiologist, disparities are reduced and the delivery of care is provided in a humane and personalized fashion.
Collapse
Affiliation(s)
- Marc Dewey
- Charité—Universitätsmedizin Berlin and Berlin Institute of Health, Berlin, Germany
| | - Uta Wilkens
- Ruhr-University Bochum, Institute of Work Science, Bochum, Germany
| |
Collapse
|
40
|
Abstract
Say hello to molly, Florence, and Ada-they're just a few of the helpful, smart algorithm powered chatbots taking their place in health care. Chatbots are computer programs designed to carry on a dialogue with people, assisting them via text messages, applications, or instant messaging. Essentially, instead of having a conversation with a person, the user talks with a bot that's powered by basic rules or artificial intelligence. Chatbots are already widely used to support, expedite, and improve processes in other industries, such as retail, and now, the technology is gaining traction in health care, where it is helping patients and providers perform myriad tasks.
Collapse
|
41
|
Abstract
Introduction
: Whilst general artificial intelligence (AI) is yet to appear, today’s narrow AI is already good enough to transform much of healthcare over the next two decades.
Objective
: There is much discussion of the potential benefits of AI in healthcare and this paper reviews the cost that may need to be paid for these benefits, including changes in the way healthcare is practiced, patients are engaged, medical records are created, and work is reimbursed.
Results
: Whilst AI will be applied to classic pattern recognition tasks like diagnosis or treatment recommendation, it is likely to be as disruptive to clinical work as it is to care delivery. Digital scribe systems that use AI to automatically create electronic health records promise great efficiency for clinicians but may lead to potentially very different types of clinical records and workflows. In disciplines like radiology, AI is likely to see image interpretation become an automated process with diminishing human engagement. Primary care is also being disrupted by AI-enabled services that automate triage, along with services such as telemedical consultations. This altered future may necessarily see an economic change where clinicians are increasingly reimbursed for value, and AI is reimbursed at a much lower cost for volume.
Conclusion
: AI is likely to be associated with some of the biggest changes we will see in healthcare in our lifetime. To fully engage with this change brings promise of the greatest reward. To not engage is to pay the highest price.
Collapse
Affiliation(s)
- Enrico Coiera
- Australian Institute of Health Innovation, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|