The digital scribe

Charting Tomorrow's Healthcare: A Traditional Literature Review for an Artificial Intelligence-Driven Future

Electronic health record (EHR) systems have developed over time in parallel with general advancements in mainstream technology. As artificially intelligent (AI) systems rapidly impact multiple societal sectors, it has become apparent that medicine is not immune from the influences of this powerful technology. Particularly appealing is how AI may aid in improving healthcare efficiency with note-writing automation. This literature review explores the current state of EHR technologies in healthcare, specifically focusing on possibilities for addressing EHR challenges through the automation of dictation and note-writing processes with AI integration. This review offers a broad understanding of existing capabilities and potential advancements, emphasizing innovations such as voice-to-text dictation, wearable devices, and AI-assisted procedure note dictation. The primary objective is to provide researchers with valuable insights, enabling them to generate new technologies and advancements within the healthcare landscape. By exploring the benefits, challenges, and future of AI integration, this review encourages the development of innovative solutions, with the goal of enhancing patient care and healthcare delivery efficiency.

"Mm-hm," "Uh-uh": are non-lexical conversational sounds deal breakers for the ambient clinical documentation technology?

OBJECTIVES

Ambient clinical documentation technology uses automatic speech recognition (ASR) and natural language processing (NLP) to turn patient-clinician conversations into clinical documentation. It is a promising approach to reducing clinician burden and improving documentation quality. However, the performance of current-generation ASR remains inadequately validated. In this study, we investigated the impact of non-lexical conversational sounds (NLCS) on ASR performance. NLCS, such as Mm-hm and Uh-uh, are commonly used to convey important information in clinical conversations, for example, Mm-hm as a "yes" response from the patient to the clinician question "are you allergic to antibiotics?"

MATERIALS AND METHODS

In this study, we evaluated 2 contemporary ASR engines, Google Speech-to-Text Clinical Conversation ("Google ASR"), and Amazon Transcribe Medical ("Amazon ASR"), both of which have their language models specifically tailored to clinical conversations. The empirical data used were from 36 primary care encounters. We conducted a series of quantitative and qualitative analyses to examine the word error rate (WER) and the potential impact of misrecognized NLCS on the quality of clinical documentation.

RESULTS

Out of a total of 135 647 spoken words contained in the evaluation data, 3284 (2.4%) were NLCS. Among these NLCS, 76 (0.06% of total words, 2.3% of all NLCS) were used to convey clinically relevant information. The overall WER, of all spoken words, was 11.8% for Google ASR and 12.8% for Amazon ASR. However, both ASR engines demonstrated poor performance in recognizing NLCS: the WERs across frequently used NLCS were 40.8% (Google) and 57.2% (Amazon), respectively; and among the NLCS that conveyed clinically relevant information, 94.7% and 98.7%, respectively.

DISCUSSION AND CONCLUSION

Current ASR solutions are not capable of properly recognizing NLCS, particularly those that convey clinically relevant information. Although the volume of NLCS in our evaluation data was very small (2.4% of the total corpus; and for NLCS that conveyed clinically relevant information: 0.06%), incorrect recognition of them could result in inaccuracies in clinical documentation and introduce new patient safety risks.

The Role of Scribes in Orthopaedics

»

The rapid increase in the use of electronic medical records (EMRs) has led to some unintended consequences that negatively affect physicians and their patients.

»

The use of medical scribes may serve as a possible solution to some of the EMR-related concerns.

»

Research has demonstrated an overall positive impact of having scribes on both physician and patient well-being, safety, and satisfaction.

»

Adaptation of advances in technology, including remote and asynchronous scribing, use of face-mounted devices, voice recognition software, and applications of artificial intelligence may address some of the barriers to more traditional in-person scribes.

Implementing Digital Scribes to Reduce Electronic Health Record Documentation Burden Among Cancer Care Clinicians: A Mixed-Methods Pilot Study

PURPOSE

To address shortcomings of human scribes (eg, turnover), clinicians are considering digital scribes (DSs). To our knowledge, to date, no study has assessed DS implementation or clinician user experience in cancer centers. We assessed the DS's feasibility, acceptability, appropriateness, usability and its preliminary association on clinician well-being in a cancer center. We also identified implementation facilitators and barriers to DS use.

METHODS

Using a mixed-methods longitudinal pilot study design, we implemented a DS at a cancer center. Data collection included surveys at baseline and 1 month after DS use and a semistructured interview with clinicians. The survey assessed demographics, Mini Z (workplace stress and burnout), sleep quality, and implementation outcomes (feasibility, acceptability, appropriateness, and usability). The interview assessed how the DS was used and its impacts on workflows and recommendations for future implementations of the DS. We used paired t tests to assess differences in Mini Z and sleep quality measures over time.

RESULTS

Across nine survey responses and eight interviews, we found that although feasibility scores were slightly lower than our cutoff point (15.2 v 16.0), clinicians rated the DS as marginally acceptable (16.0) and appropriate (16.3). Usability was considered marginally usable (68.6 v 68.0). Although the DS did not significantly improve burnout (3.6 v 3.9, P = .081), it improved perceptions of having sufficient documentation time (2.1 v 3.6, P = .005). Clinicians identified suggestions for future implementations, including training needs and usability improvements.

CONCLUSION

Our preliminary findings suggest that DS implementation is marginally acceptable, appropriate, and usable among cancer care clinicians. Individualized training and on-site support may improve implementation.

Digital Health Applications to Establish a Remote Diagnosis of Orthopedic Knee Disorders: Scoping Review

BACKGROUND

Knee pain is highly prevalent worldwide, and this number is expected to rise in the future. The COVID-19 outbreak, in combination with the aging population, rising health care costs, and the need to make health care more accessible worldwide, has led to an increasing demand for digital health care applications to deliver care for patients with musculoskeletal conditions. Digital health and other forms of telemedicine can add value in optimizing health care for patients and health care providers. This might reduce health care costs and make health care more accessible while maintaining a high level of quality. Although expectations are high, there is currently no overview comparing digital health applications with face-to-face contact in clinical trials to establish a primary knee diagnosis in orthopedic surgery.

OBJECTIVE

This study aimed to investigate the currently available digital health and telemedicine applications to establish a primary knee diagnosis in orthopedic surgery in the general population in comparison with imaging or face-to-face contact between patients and physicians.

METHODS

A scoping review was conducted using the PubMed and Embase databases according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) statement. The inclusion criteria were studies reporting methods to determine a primary knee diagnosis in orthopedic surgery using digital health or telemedicine. On April 28 and 29, 2021, searches were conducted in PubMed (MEDLINE) and Embase. Data charting was conducted using a predefined form and included details on general study information, study population, type of application, comparator, analyses, and key findings. A risk-of-bias analysis was not deemed relevant considering the scoping review design of the study.

RESULTS

After screening 5639 articles, 7 (0.12%) were included. In total, 2 categories to determine a primary diagnosis were identified: screening studies (4/7, 57%) and decision support studies (3/7, 43%). There was great heterogeneity in the included studies in algorithms used, disorders, input parameters, and outcome measurements. No more than 25 knee disorders were included in the studies. The included studies showed a relatively high sensitivity (67%-91%). The accuracy of the different studies was generally lower, with a specificity of 27% to 48% for decision support studies and 73% to 96% for screening studies.

CONCLUSIONS

This scoping review shows that there are a limited number of available applications to establish a remote diagnosis of knee disorders in orthopedic surgery. To date, there is limited evidence that digital health applications can assist patients or orthopedic surgeons in establishing the primary diagnosis of knee disorders. Future research should aim to integrate multiple sources of information and a standardized study design with close collaboration among clinicians, data scientists, data managers, lawyers, and service users to create reliable and secure databases.

An Introduction to Artificial Intelligence in Developmental and Behavioral Pediatrics

ABSTRACT

Technological breakthroughs, together with the rapid growth of medical information and improved data connectivity, are creating dramatic shifts in the health care landscape, including the field of developmental and behavioral pediatrics. While medical information took an estimated 50 years to double in 1950, by 2020, it was projected to double every 73 days. Artificial intelligence (AI)-powered health technologies, once considered theoretical or research-exclusive concepts, are increasingly being granted regulatory approval and integrated into clinical care. In the United States, the Food and Drug Administration has cleared or approved over 160 health-related AI-based devices to date. These trends are only likely to accelerate as economic investment in AI health care outstrips investment in other sectors. The exponential increase in peer-reviewed AI-focused health care publications year over year highlights the speed of growth in this sector. As health care moves toward an era of intelligent technology powered by rich medical information, pediatricians will increasingly be asked to engage with tools and systems underpinned by AI. However, medical students and practicing clinicians receive insufficient training and lack preparedness for transitioning into a more AI-informed future. This article provides a brief primer on AI in health care. Underlying AI principles and key performance metrics are described, and the clinical potential of AI-driven technology together with potential pitfalls is explored within the developmental and behavioral pediatric health context.

Using less keystrokes to achieve high top-1 accuracy in Chinese clinical text entry

Background

As a routine task, physicians spend substantial time and keystrokes on text entry. Documentation burden is increasingly associated with physician burnout. Predicting at top-1 with less keystrokes (TLKs) is a hot topic for smart text entry. In Western countries, contextual autocomplete is deployed to alleviate the burden. Chinese text entry is intercepted by input method engines (IMEs), which cut off suggestions from electronic health records (EHRs).

Objective

To explore a user-friendly approach to make text entry easier and faster for Chinese physicians.

Methods

Physicians were shadowed to uncover the real-word input behaviors. System logs were collected for behavior validation and then used for context-based learning. An in-line web-based popup layer was proposed to hold the best suggestion from EHRs. Keystrokes per character and TLK rate were evaluated quantitatively. Questionnaires were used for qualitative assessment. Nine hundred fifty-two physicians were enrolled in a field testing.

Results

14 facilitators and 17 barriers related to IMEs were identified after shadowing. With system logs, physicians tended to split long words into short units, which were 1-4 in length. 81.7% of these units were disyllables. Compared to the control group, the intervention group improved TLK rate by 40.3% (p < .0001), and reduced keystrokes per character by 48.3% (p < .0001). Survey results also promised positive feedback from physicians.

Conclusions

Keystroke burden and frequent choice reaction time challenge Chinese physicians for text entry. The proposed system demonstrates an approach to alleviate the burden. Contextual information is easily retrieved and it further helps improve the top-1 accuracy, with a smaller number of keystrokes. While positive feedback is received, it promises a benefit to protect patient privacy.

Evidence synthesis, digital scribes, and translational challenges for artificial intelligence in healthcare

Healthcare has well-known challenges with safety, quality, and effectiveness, and many see artificial intelligence (AI) as essential to any solution. Emerging applications include the automated synthesis of best-practice research evidence including systematic reviews, which would ultimately see all clinical trial data published in a computational form for immediate synthesis. Digital scribes embed themselves in the process of care to detect, record, and summarize events and conversations for the electronic record. However, three persistent translational challenges must be addressed before AI is widely deployed. First, little effort is spent replicating AI trials, exposing patients to risks of methodological error and biases. Next, there is little reporting of patient harms from trials. Finally, AI built using machine learning may perform less effectively in different clinical settings.

Interfacing With the Electronic Health Record (EHR): A Comparative Review of Modes of Documentation

Electronic health records (EHRs) have provided physicians with a systematic framework for collecting patient data, organizing notes from the healthcare team, and managing the daily workflow in the modern era of healthcare. Despite these advantages, EHRs have proven to be problematic for clinicians. The burdensome regulations requiring increased documentation with the EHR paradigm have led to inefficiencies from data-entry requirements forcing physicians to spend an inordinate amount of time on it, affecting the time available for direct patient care as well as leading to professional burnout. As a result, new modalities such as speech recognition, medical scribes, pre-made EHR templates, and digital scribes [a form of artificial intelligence (AI) based on ambient speech recognition] are increasingly being used to reduce charting time and increase the time available for patient care. The purpose of our review is to provide an up-to-date review of the literature on these modalities including their benefits and shortcomings, to help physicians and other medical professionals choose the best methods to document their patient-care encounters efficiently and effectively.

A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions

This paper reviews different types of conversational agents used in health care for chronic conditions, examining their underlying communication technology, evaluation measures, and AI methods. A systematic search was performed in February 2021 on PubMed Medline, EMBASE, PsycINFO, CINAHL, Web of Science, and ACM Digital Library. Studies were included if they focused on consumers, caregivers, or healthcare professionals in the prevention, treatment, or rehabilitation of chronic diseases, involved conversational agents, and tested the system with human users. The search retrieved 1087 articles. Twenty-six studies met the inclusion criteria. Out of 26 conversational agents (CAs), 16 were chatbots, seven were embodied conversational agents (ECA), one was a conversational agent in a robot, and another was a relational agent. One agent was not specified. Based on this review, the overall acceptance of CAs by users for the self-management of their chronic conditions is promising. Users’ feedback shows helpfulness, satisfaction, and ease of use in more than half of included studies. Although many users in the studies appear to feel more comfortable with CAs, there is still a lack of reliable and comparable evidence to determine the efficacy of AI-enabled CAs for chronic health conditions due to the insufficient reporting of technical implementation details.

Strategies to Improve Compliance with Clinical Nursing Documentation Guidelines in the Acute Hospital Setting: A Systematic Review and Analysis

Introduction

This systematic review attempts to answer the following question - which strategies to improve clinical nursing documentation have been most effective in the acute hospital setting?

Methods

A keyword search for relevant studies was conducted in CINAHL and Medline in May 2019 and October 2020.Studies were appraised using the Joanna Briggs Institute (JBI) critical appraisal for quasi-experimental studies. The studies were graded for level of evidence according to GRADE principles.The data collected in each study were added to a Summary of Data (SOD) spreadsheet. Pre intervention and a post intervention percentage compliance scores were calculated for each study where possible i.e. (mean score/possible total score) × (100/1). A percentage change in compliance for each study was calculated by subtracting the pre intervention score from the post intervention score. The change in compliance score and the post intervention compliance score were both added to the SOD and used as a basis for comparison between the studies. Each study was analyzed thematically in terms of the intervention strategies used. Compliance rates and the interventions used were compared to determine if any strategies were effective in achieving a meaningful improvement in compliance.

Results

Seventy six full text articles were reviewed for this systematic review. Fifty seven of the studies were before and after studies and 66 were conducted in western countries. Publishing dates for the studies ranged from 1991 to 2020.Eleven studies included documentation audits with personal feedback as one of the strategies used to improve nursing documentation. Ten of these studies achieved a post intervention compliance rate ≥ 70%.

Conclusion

Notwithstanding the limitations of this study, it may be that documentation audit with personal feedback, when combined with other context specific strategies, is a reliable method for gaining meaningful improvements in clinical nursing documentation. The level of evidence is very low and further research is required.

An interview study with medical scribes on how their work may alleviate clinician burnout through delegated health IT tasks

OBJECTIVES

To understand how medical scribes' work may contribute to alleviating clinician burnout attributable directly or indirectly to the use of health IT.

MATERIALS AND METHODS

Qualitative analysis of semistructured interviews with 32 participants who had scribing experience in a variety of clinical settings.

RESULTS

We identified 7 categories of clinical tasks that clinicians commonly choose to offload to medical scribes, many of which involve delegated use of health IT. These range from notes-taking and computerized data entry to foraging, assembling, and tracking information scattered across multiple clinical information systems. Some common characteristics shared among these tasks include: (1) time-consuming to perform; (2) difficult to remember or keep track of; (3) disruptive to clinical workflow, clinicians' cognitive processes, or patient-provider interactions; (4) perceived to be low-skill "clerical" work; and (5) deemed as adding no value to direct patient care.

DISCUSSION

The fact that clinicians opt to "outsource" certain clinical tasks to medical scribes is a strong indication that performing these tasks is not perceived to be the best use of their time. Given that a vast majority of healthcare practices in the US do not have the luxury of affording medical scribes, the burden would inevitably fall onto clinicians' shoulders, which could be a major source for clinician burnout.

CONCLUSIONS

Medical scribes help to offload a substantial amount of burden from clinicians-particularly with tasks that involve onerous interactions with health IT. Developing a better understanding of medical scribes' work provides useful insights into the sources of clinician burnout and potential solutions to it.

Electronic health records: a critical appraisal of strengths and limitations

Electronic health record (EHR) was hailed as a major step towards making healthcare more transparent and accountable. All the developed nations digitised their health records which were meant to be safe, secure and could be accessed on demand. This was intended to benefit all stakeholders. However, the jury is still out if the EHR has been worth it. There have been incidences of data breaches despite cybersecurity checks and of manipulation compromising clinicians' integrity and patients' safety. EHRs have also been blamed for doctor burnout in overloading them with a largely avoidable administrative burden. The lack of interoperability amongst various EHR software systems is creating obstacles in seamless workflow. Artificial intelligence is now being used to overcome deficiencies of the EHR. Emerging data from real-world usage of EHR is providing useful inputs which would be helpful in making it a better system. This review critically appraises the current status and issues with the EHR and provides an overview of the key innovations which are being implemented to make the system more efficient for health care providers leading to a reduction in their administrative burden.

Digital scribe utility and barriers to implementation in clinical practice: a scoping review

Electronic health records (EHRs) allow for meaningful usage of healthcare data. Their adoption provides clinicians with a central location to access and share data, write notes, order labs and prescriptions, and bill for patient visits. However, as non-clinical requirements have increased, time spent using EHRs eclipsed time spent on direct patient care. Several solutions have been proposed to minimize the time spent using EHRs, though each have limitations. Digital scribe technology uses voice-to-text software to convert ambient listening to meaningful medical notes and may eliminate the physical task of documentation, allowing physicians to spend less time on EHR engagement and more time with patients. However, adoption of digital scribe technology poses many barriers for physicians. In this study, we perform a scoping review of the literature to identify barriers to digital scribe implementation and provide solutions to address these barriers. We performed a literature review of digital scribe technology and voice-to-text conversion and information extraction as a scope for future research. Fifteen articles met inclusion criteria. Of the articles included, four were comparative studies, three were reviews, three were original investigations, two were perspective pieces, one was a cost-effectiveness study, one was a keynote address, and one was an observational study. The published articles on digital scribe technology and voice-to-text conversion highlight digital scribe technology as a solution to the inefficient interaction with EHRs. Benefits of digital scribe technologies included enhancing clinician ability to navigate charts, write notes, use decision support tools, and improve the quality of time spent with patients. Digital scribe technologies can improve clinic efficiency and increase patient access to care while simultaneously reducing physician burnout. Implementation barriers include upfront costs, integration with existing technology, and time-intensive training. Technological barriers include adaptability to linguistic differences, compatibility across different clinical encounters, and integration of medical jargon into the note. Broader risks include automation bias and risks to data privacy. Overcoming significant barriers to implementation will facilitate more widespread adoption.

Supplementary information

The online version contains supplementary material available at 10.1007/s12553-021-00568-0.

Future Medical Artificial Intelligence Application Requirements and Expectations of Physicians in German University Hospitals: Web-Based Survey

BACKGROUND

The increasing development of artificial intelligence (AI) systems in medicine driven by researchers and entrepreneurs goes along with enormous expectations for medical care advancement. AI might change the clinical practice of physicians from almost all medical disciplines and in most areas of health care. While expectations for AI in medicine are high, practical implementations of AI for clinical practice are still scarce in Germany. Moreover, physicians' requirements and expectations of AI in medicine and their opinion on the usage of anonymized patient data for clinical and biomedical research have not been investigated widely in German university hospitals.

OBJECTIVE

This study aimed to evaluate physicians' requirements and expectations of AI in medicine and their opinion on the secondary usage of patient data for (bio)medical research (eg, for the development of machine learning algorithms) in university hospitals in Germany.

METHODS

A web-based survey was conducted addressing physicians of all medical disciplines in 8 German university hospitals. Answers were given using Likert scales and general demographic responses. Physicians were asked to participate locally via email in the respective hospitals.

RESULTS

The online survey was completed by 303 physicians (female: 121/303, 39.9%; male: 173/303, 57.1%; no response: 9/303, 3.0%) from a wide range of medical disciplines and work experience levels. Most respondents either had a positive (130/303, 42.9%) or a very positive attitude (82/303, 27.1%) towards AI in medicine. There was a significant association between the personal rating of AI in medicine and the self-reported technical affinity level (H4=48.3, P<.001). A vast majority of physicians expected the future of medicine to be a mix of human and artificial intelligence (273/303, 90.1%) but also requested a scientific evaluation before the routine implementation of AI-based systems (276/303, 91.1%). Physicians were most optimistic that AI applications would identify drug interactions (280/303, 92.4%) to improve patient care substantially but were quite reserved regarding AI-supported diagnosis of psychiatric diseases (62/303, 20.5%). Of the respondents, 82.5% (250/303) agreed that there should be open access to anonymized patient databases for medical and biomedical research.

CONCLUSIONS

Physicians in stationary patient care in German university hospitals show a generally positive attitude towards using most AI applications in medicine. Along with this optimism comes several expectations and hopes that AI will assist physicians in clinical decision making. Especially in fields of medicine where huge amounts of data are processed (eg, imaging procedures in radiology and pathology) or data are collected continuously (eg, cardiology and intensive care medicine), physicians' expectations of AI to substantially improve future patient care are high. In the study, the greatest potential was seen in the application of AI for the identification of drug interactions, assumedly due to the rising complexity of drug administration to polymorbid, polypharmacy patients. However, for the practical usage of AI in health care, regulatory and organizational challenges still have to be mastered.

Overcoming barriers to implementation of artificial intelligence in gastroenterology

Artificial intelligence is poised to revolutionize the field of medicine, however significant questions must be answered prior to its implementation on a regular basis. Many artificial intelligence algorithms remain limited by isolated datasets which may cause selection bias and truncated learning for the program. While a central database may solve this issue, several barriers such as security, patient consent, and management structure prevent this from being implemented. An additional barrier to daily use is device approval by the Food and Drug Administration. In order for this to occur, clinical studies must address new endpoints, including and beyond the traditional bio- and medical statistics. These must showcase artificial intelligence's benefit and answer key questions, including challenges posed in the field of medical ethics.

A network model of activities in primary care consultations

Objective

The objective of this study is to characterize the dynamic structure of primary care consultations by identifying typical activities and their inter-relationships to inform the design of automated approaches to clinical documentation using natural language processing and summarization methods.

Materials and Methods

This is an observational study in Australian general practice involving 31 consultations with 4 primary care physicians. Consultations were audio-recorded, and computer interactions were recorded using screen capture. Physical interactions in consultation rooms were noted by observers. Brief interviews were conducted after consultations. Conversational transcripts were analyzed to identify different activities and their speech content as well as verbal cues signaling activity transitions. An activity transition analysis was then undertaken to generate a network of activities and transitions.

Results

Observed activity classes followed those described in well-known primary care consultation models. Activities were often fragmented across consultations, did not flow necessarily in a defined order, and the flow between activities was nonlinear. Modeling activities as a network revealed that discussing a patient’s present complaint was the most central activity and was highly connected to medical history taking, physical examination, and assessment, forming a highly interrelated bundle. Family history, allergy, and investigation discussions were less connected suggesting less dependency on other activities. Clear verbal signs were often identifiable at transitions between activities.

Discussion

Primary care consultations do not appear to follow a classic linear model of defined information seeking activities; rather, they are fragmented, highly interdependent, and can be reactively triggered.

Conclusion

The nonlinearity of activities has significant implications for the design of automated information capture. Whereas dictation systems generate literal translation of speech into text, speech-based clinical summary systems will need to link disparate information fragments, merge their content, and abstract coherent information summaries.

Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art

Speech technology is not appropriately explored even though modern advances in speech technology-especially those driven by deep learning (DL) technology-offer unprecedented opportunities for transforming the healthcare industry. In this paper, we have focused on the enormous potential of speech technology for revolutionising the healthcare domain. More specifically, we review the state-of-the-art approaches in automatic speech recognition (ASR), speech synthesis or text to speech (TTS), and health detection and monitoring using speech signals. We also present a comprehensive overview of various challenges hindering the growth of speech-based services in healthcare. To make speech-based healthcare solutions more prevalent, we discuss open issues and suggest some possible research directions aimed at fully leveraging the advantages of other technologies for making speech-based healthcare solutions more effective.

Voice for Health: The Use of Vocal Biomarkers from Research to Clinical Practice

Diseases can affect organs such as the heart, lungs, brain, muscles, or vocal folds, which can then alter an individual's voice. Therefore, voice analysis using artificial intelligence opens new opportunities for healthcare. From using vocal biomarkers for diagnosis, risk prediction, and remote monitoring of various clinical outcomes and symptoms, we offer in this review an overview of the various applications of voice for health-related purposes. We discuss the potential of this rapidly evolving environment from a research, patient, and clinical perspective. We also discuss the key challenges to overcome in the near future for a substantial and efficient use of voice in healthcare.

Envisioning an artificial intelligence documentation assistant for future primary care consultations: A co-design study with general practitioners

OBJECTIVE

The study sought to understand the potential roles of a future artificial intelligence (AI) documentation assistant in primary care consultations and to identify implications for doctors, patients, healthcare system, and technology design from the perspective of general practitioners.

MATERIALS AND METHODS

Co-design workshops with general practitioners were conducted. The workshops focused on (1) understanding the current consultation context and identifying existing problems, (2) ideating future solutions to these problems, and (3) discussing future roles for AI in primary care. The workshop activities included affinity diagramming, brainwriting, and video prototyping methods. The workshops were audio-recorded and transcribed verbatim. Inductive thematic analysis of the transcripts of conversations was performed.

RESULTS

Two researchers facilitated 3 co-design workshops with 16 general practitioners. Three main themes emerged: professional autonomy, human-AI collaboration, and new models of care. Major implications identified within these themes included (1) concerns with medico-legal aspects arising from constant recording and accessibility of full consultation records, (2) future consultations taking place out of the exam rooms in a distributed system involving empowered patients, (3) human conversation and empathy remaining the core tasks of doctors in any future AI-enabled consultations, and (4) questioning the current focus of AI initiatives on improved efficiency as opposed to patient care.

CONCLUSIONS

AI documentation assistants will likely to be integral to the future primary care consultations. However, these technologies will still need to be supervised by a human until strong evidence for reliable autonomous performance is available. Therefore, different human-AI collaboration models will need to be designed and evaluated to ensure patient safety, quality of care, doctor safety, and doctor autonomy.

Position statement on priorities for artificial intelligence in GI endoscopy: a report by the ASGE Task Force

Artificial intelligence (AI) in GI endoscopy holds tremendous promise to augment clinical performance, establish better treatment plans, and improve patient outcomes. Although there are promising initial applications and preliminary clinical data for AI in gastroenterology, the field is still in a very early phase, with limited clinical use. The American Society for Gastrointestinal Endoscopy has convened an AI Task Force to develop guidance around clinical implementation, testing/validating algorithms, and building pathways for successful implementation of AI in GI endoscopy. This White Paper focuses on 3 areas: (1) priority use cases for development of AI algorithms in GI, both for specific clinical scenarios and for streamlining clinical workflows, quality reporting, and practice management; (2) data science priorities, including development of image libraries, and standardization of methods for storing, sharing, and annotating endoscopic images/video; and (3) research priorities, focusing on the importance of high-quality, prospective trials measuring clinically meaningful patient outcomes.

Identifying relevant information in medical conversations to summarize a clinician-patient encounter

To inform the development of automated summarization of clinical conversations, this study sought to estimate the proportion of doctor-patient communication in general practice (GP) consultations used for generating a consultation summary. Two researchers with a medical degree read the transcripts of 44 GP consultations and highlighted the phrases to be used for generating a summary of the consultation. For all consultations, less than 20% of all words in the transcripts were needed for inclusion in the summary. On average, 9.1% of all words in the transcripts, 26.6% of all medical terms, and 27.3% of all speaker turns were highlighted. The results indicate that communication content used for generating a consultation summary makes up a small portion of GP consultations, and automated summarization solutions-such as digital scribes-must focus on identifying the 20% relevant information for automatically generating consultation summaries.

How does medical scribes' work inform development of speech-based clinical documentation technologies? A systematic review

OBJECTIVE

Use of medical scribes reduces clinician burnout by sharing the burden of clinical documentation. However, medical scribes are cost-prohibitive for most settings, prompting a growing interest in developing ambient, speech-based technologies capable of automatically generating clinical documentation based on patient-provider conversation. Through a systematic review, we aimed to develop a thorough understanding of the work performed by medical scribes in order to inform the design of such technologies.

MATERIALS AND METHODS

Relevant articles retrieved by searching in multiple literature databases. We conducted the screening process following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) in guidelines, and then analyzed the data using qualitative methods to identify recurring themes.

RESULTS

The literature search returned 854 results, 65 of which met the inclusion criteria. We found that there is significant variation in scribe expectations and responsibilities across healthcare organizations; scribes also frequently adapt their work based on the provider's style and preferences. Further, scribes' job extends far beyond capturing conversation in the exam room; they also actively interact with patients and the care team and integrate data from other sources such as prior charts and lab test results.

DISCUSSION

The results of this study provide several implications for designing technologies that can generate clinical documentation based on naturalistic conversations taking place in the exam room. First, a one-size-fits-all solution will be unlikely to work because of the significant variation in scribe work. Second, technology designers need to be aware of the limited role that their solution can fulfill. Third, to produce comprehensive clinical documentation, such technologies will likely have to incorporate information beyond the exam room conversation. Finally, issues of patient consent and privacy have yet to be adequately addressed, which could become paramount barriers to implementing such technologies in realistic clinical settings.

CONCLUSIONS

Medical scribes perform complex and delicate work. Further research is needed to better understand their roles in a clinical setting in order to inform the development of speech-based clinical documentation technologies.

Applications of machine learning methods in kidney disease: hope or hype?

PURPOSE OF REVIEW

The universal adoption of electronic health records, improvement in technology, and the availability of continuous monitoring has generated large quantities of healthcare data. Machine learning is increasingly adopted by nephrology researchers to analyze this data in order to improve the care of their patients.

RECENT FINDINGS

In this review, we provide a broad overview of the different types of machine learning algorithms currently available and how researchers have applied these methods in nephrology research. Current applications have included prediction of acute kidney injury and chronic kidney disease along with progression of kidney disease. Researchers have demonstrated the ability of machine learning to read kidney biopsy samples, identify patient outcomes from unstructured data, and identify subtypes in complex diseases. We end with a discussion on the ethics and potential pitfalls of machine learning.

SUMMARY

Machine learning provides researchers with the ability to analyze data that were previously inaccessible. While still burgeoning, several studies show promising results, which will enable researchers to perform larger scale studies and clinicians the ability to provide more personalized care. However, we must ensure that implementation aids providers and does not lead to harm to patients.

The role of artificial intelligence in colon polyps detection

Over the past few decades, artificial intelligence (AI) has evolved dramatically and is believed to have a significant impact on all aspects of technology and daily life. The use of AI in the healthcare system has been rapidly growing, owing to the large amount of data. Various methods of AI including machine learning, deep learning and convolutional neural network (CNN) have been used in diagnostic imaging, which have helped physicians in the accurate diagnosis of diseases and determination of appropriate treatment for them. Using and collecting a huge number of digital images and medical records has led to the creation of big data over a time period. Currently, considerations regarding the diagnosis of various presentations in all endoscopic procedures and imaging findings are solely handled by endoscopists. Moreover, AI has shown to be highly effective in the field of gastroenterology in terms of diagnosis, prognosis, and image processing. Herein, this review aimed to discuss different aspects of AI use for early detection and treatment of gastroenterology diseases.

Challenges of developing a digital scribe to reduce clinical documentation burden

Clinicians spend a large amount of time on clinical documentation of patient encounters, often impacting quality of care and clinician satisfaction, and causing physician burnout. Advances in artificial intelligence (AI) and machine learning (ML) open the possibility of automating clinical documentation with digital scribes, using speech recognition to eliminate manual documentation by clinicians or medical scribes. However, developing a digital scribe is fraught with problems due to the complex nature of clinical environments and clinical conversations. This paper identifies and discusses major challenges associated with developing automated speech-based documentation in clinical settings: recording high-quality audio, converting audio to transcripts using speech recognition, inducing topic structure from conversation data, extracting medical concepts, generating clinically meaningful summaries of conversations, and obtaining clinical data for AI and ML algorithms.

Sustainable Health Informatics: Health Informaticians as Alchemists

The digital transformation of health care delivery remains an elusive work in progress. Contextual variation continues to be a significant barrier to the development of sustainable health information systems. In this paper we characterize health informaticians as modern alchemists and use this characterization to describe informatics progress in addressing four key healthcare challenges. We highlight the need for informaticians to be diligent and loyal to basic methodological principles while also appreciating the role that contextual variation plays in informatics research. We also emphasize that meaningful health systems transformation takes time. The insight presented in this paper helps informaticians in our quest to develop sustainable health information systems.

The Bionic Radiologist: avoiding blurry pictures and providing greater insights

Radiology images and reports have long been digitalized. However, the potential of the more than 3.6 billion radiology examinations performed annually worldwide has largely gone unused in the effort to digitally transform health care. The Bionic Radiologist is a concept that combines humanity and digitalization for better health care integration of radiology. At a practical level, this concept will achieve critical goals: (1) testing decisions being made scientifically on the basis of disease probabilities and patient preferences; (2) image analysis done consistently at any time and at any site; and (3) treatment suggestions that are closely linked to imaging results and are seamlessly integrated with other information. The Bionic Radiologist will thus help avoiding missed care opportunities, will provide continuous learning in the work process, and will also allow more time for radiologists' primary roles: interacting with patients and referring physicians. To achieve that potential, one has to cope with many implementation barriers at both the individual and institutional levels. These include: reluctance to delegate decision making, a possible decrease in image interpretation knowledge and the perception that patient safety and trust are at stake. To facilitate implementation of the Bionic Radiologist the following will be helpful: uncertainty quantifications for suggestions, shared decision making, changes in organizational culture and leadership style, maintained expertise through continuous learning systems for training, and role development of the involved experts. With the support of the Bionic Radiologist, disparities are reduced and the delivery of care is provided in a humane and personalized fashion.

Health Care Chatbots Are Here to Help

Say hello to molly, Florence, and Ada-they're just a few of the helpful, smart algorithm powered chatbots taking their place in health care. Chatbots are computer programs designed to carry on a dialogue with people, assisting them via text messages, applications, or instant messaging. Essentially, instead of having a conversation with a person, the user talks with a bot that's powered by basic rules or artificial intelligence. Chatbots are already widely used to support, expedite, and improve processes in other industries, such as retail, and now, the technology is gaining traction in health care, where it is helping patients and providers perform myriad tasks.

The Price of Artificial Intelligence

Introduction : Whilst general artificial intelligence (AI) is yet to appear, today’s narrow AI is already good enough to transform much of healthcare over the next two decades.

Objective : There is much discussion of the potential benefits of AI in healthcare and this paper reviews the cost that may need to be paid for these benefits, including changes in the way healthcare is practiced, patients are engaged, medical records are created, and work is reimbursed.

Results : Whilst AI will be applied to classic pattern recognition tasks like diagnosis or treatment recommendation, it is likely to be as disruptive to clinical work as it is to care delivery. Digital scribe systems that use AI to automatically create electronic health records promise great efficiency for clinicians but may lead to potentially very different types of clinical records and workflows. In disciplines like radiology, AI is likely to see image interpretation become an automated process with diminishing human engagement. Primary care is also being disrupted by AI-enabled services that automate triage, along with services such as telemedical consultations. This altered future may necessarily see an economic change where clinicians are increasingly reimbursed for value, and AI is reimbursed at a much lower cost for volume.

Conclusion : AI is likely to be associated with some of the biggest changes we will see in healthcare in our lifetime. To fully engage with this change brings promise of the greatest reward. To not engage is to pay the highest price.