Using Artificial Intelligence With Natural Language Processing to Combine Electronic Health Record's Structured and Free Text Data to Identify Nonvalvular Atrial Fibrillation to Decrease Strokes and Death: Evaluation and Case-Control Study

Application of artificial intelligence in the diagnosis and treatment of cardiac arrhythmia

The rapid growth in computational power, sensor technology, and wearable devices has provided a solid foundation for all aspects of cardiac arrhythmia care. Artificial intelligence (AI) has been instrumental in bringing about significant changes in the prevention, risk assessment, diagnosis, and treatment of arrhythmia. This review examines the current state of AI in the diagnosis and treatment of atrial fibrillation, supraventricular arrhythmia, ventricular arrhythmia, hereditary channelopathies, and cardiac pacing. Furthermore, ChatGPT, which has gained attention recently, is addressed in this paper along with its potential applications in the field of arrhythmia. Additionally, the accuracy of arrhythmia diagnosis can be improved by identifying electrode misplacement or erroneous swapping of electrode position using AI. Remote monitoring has expanded greatly due to the emergence of contactless monitoring technology as wearable devices continue to develop and flourish. Parallel advances in AI computing power, ChatGPT, availability of large data sets, and more have greatly expanded applications in arrhythmia diagnosis, risk assessment, and treatment. More precise algorithms based on big data, personalized risk assessment, telemedicine and mobile health, smart hardware and wearables, and the exploration of rare or complex types of arrhythmia are the future direction.

AI Quality Standards in Health Care: Rapid Umbrella Review

BACKGROUND

In recent years, there has been an upwelling of artificial intelligence (AI) studies in the health care literature. During this period, there has been an increasing number of proposed standards to evaluate the quality of health care AI studies.

OBJECTIVE

This rapid umbrella review examines the use of AI quality standards in a sample of health care AI systematic review articles published over a 36-month period.

METHODS

We used a modified version of the Joanna Briggs Institute umbrella review method. Our rapid approach was informed by the practical guide by Tricco and colleagues for conducting rapid reviews. Our search was focused on the MEDLINE database supplemented with Google Scholar. The inclusion criteria were English-language systematic reviews regardless of review type, with mention of AI and health in the abstract, published during a 36-month period. For the synthesis, we summarized the AI quality standards used and issues noted in these reviews drawing on a set of published health care AI standards, harmonized the terms used, and offered guidance to improve the quality of future health care AI studies.

RESULTS

We selected 33 review articles published between 2020 and 2022 in our synthesis. The reviews covered a wide range of objectives, topics, settings, designs, and results. Over 60 AI approaches across different domains were identified with varying levels of detail spanning different AI life cycle stages, making comparisons difficult. Health care AI quality standards were applied in only 39% (13/33) of the reviews and in 14% (25/178) of the original studies from the reviews examined, mostly to appraise their methodological or reporting quality. Only a handful mentioned the transparency, explainability, trustworthiness, ethics, and privacy aspects. A total of 23 AI quality standard-related issues were identified in the reviews. There was a recognized need to standardize the planning, conduct, and reporting of health care AI studies and address their broader societal, ethical, and regulatory implications.

CONCLUSIONS

Despite the growing number of AI standards to assess the quality of health care AI studies, they are seldom applied in practice. With increasing desire to adopt AI in different health topics, domains, and settings, practitioners and researchers must stay abreast of and adapt to the evolving landscape of health care AI quality standards and apply these standards to improve the quality of their AI studies.

The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective

Artificial intelligence models represented in machine learning algorithms are promising tools for risk assessment used to guide clinical and other health care decisions. Machine learning algorithms, however, may house biases that propagate stereotypes, inequities, and discrimination that contribute to socioeconomic health care disparities. The biases include those related to some sociodemographic characteristics such as race, ethnicity, gender, age, insurance, and socioeconomic status from the use of erroneous electronic health record data. Additionally, there is concern that training data and algorithmic biases in large language models pose potential drawbacks. These biases affect the lives and livelihoods of a significant percentage of the population in the United States and globally. The social and economic consequences of the associated backlash cannot be underestimated. Here, we outline some of the sociodemographic, training data, and algorithmic biases that undermine sound health care risk assessment and medical decision-making that should be addressed in the health care system. We present a perspective and overview of these biases by gender, race, ethnicity, age, historically marginalized communities, algorithmic bias, biased evaluations, implicit bias, selection/sampling bias, socioeconomic status biases, biased data distributions, cultural biases and insurance status bias, conformation bias, information bias and anchoring biases and make recommendations to improve large language model training data, including de-biasing techniques such as counterfactual role-reversed sentences during knowledge distillation, fine-tuning, prefix attachment at training time, the use of toxicity classifiers, retrieval augmented generation and algorithmic modification to mitigate the biases moving forward.

[Artificial intelligence in wearable electrocardiogram monitoring]

Electrocardiogram (ECG) monitoring owns important clinical value in diagnosis, prevention and rehabilitation of cardiovascular disease (CVD). With the rapid development of Internet of Things (IoT), big data, cloud computing, artificial intelligence (AI) and other advanced technologies, wearable ECG is playing an increasingly important role. With the aging process of the population, it is more and more urgent to upgrade the diagnostic mode of CVD. Using AI technology to assist the clinical analysis of long-term ECGs, and thus to improve the ability of early detection and prediction of CVD has become an important direction. Intelligent wearable ECG monitoring needs the collaboration between edge and cloud computing. Meanwhile, the clarity of medical scene is conducive for the precise implementation of wearable ECG monitoring. This paper first summarized the progress of AI-related ECG studies and the current technical orientation. Then three cases were depicted to illustrate how the AI in wearable ECG cooperate with the clinic. Finally, we demonstrated the two core issues-the reliability and worth of AI-related ECG technology and prospected the future opportunities and challenges.

Applications of the Natural Language Processing Tool ChatGPT in Clinical Practice: Comparative Study and Augmented Systematic Review

BACKGROUND

This research integrates a comparative analysis of the performance of human researchers and OpenAI's ChatGPT in systematic review tasks and describes an assessment of the application of natural language processing (NLP) models in clinical practice through a review of 5 studies.

OBJECTIVE

This study aimed to evaluate the reliability between ChatGPT and human researchers in extracting key information from clinical articles, and to investigate the practical use of NLP in clinical settings as evidenced by selected studies.

METHODS

The study design comprised a systematic review of clinical articles executed independently by human researchers and ChatGPT. The level of agreement between and within raters for parameter extraction was assessed using the Fleiss and Cohen κ statistics.

RESULTS

The comparative analysis revealed a high degree of concordance between ChatGPT and human researchers for most parameters, with less agreement for study design, clinical task, and clinical implementation. The review identified 5 significant studies that demonstrated the diverse applications of NLP in clinical settings. These studies' findings highlight the potential of NLP to improve clinical efficiency and patient outcomes in various contexts, from enhancing allergy detection and classification to improving quality metrics in psychotherapy treatments for veterans with posttraumatic stress disorder.

CONCLUSIONS

Our findings underscore the potential of NLP models, including ChatGPT, in performing systematic reviews and other clinical tasks. Despite certain limitations, NLP models present a promising avenue for enhancing health care efficiency and accuracy. Future studies must focus on broadening the range of clinical applications and exploring the ethical considerations of implementing NLP applications in health care settings.

Mining electronic health records using artificial intelligence: Bibliometric and content analyses for current research status and product conversion

BACKGROUND

The use of Electronic Health Records is the most important milestone in the digitization and intelligence of the entire medical industry. AI can effectively mine the immense medical information contained in EHRs, potentially assist doctors in reducing many medical errors.

OBJECTIVE

This article aims to summarize the research status and trends in using AI to mine medical information from EHRs for the past thirteen years and investigate its information application.

METHODS

A systematic search was carried out in 5 databases, including Web of Science Core Collection and PubMed, to identify research using AI to mine medical information from EHRs for the past thirteen years. Furthermore, bibliometric and content analysis were used to explore the research hotspots and trends, and systematically analyze the conversion rate of research resources in this field.

RESULTS

A total of 631 articles were included and analyzed. The number of published articles has increased rapidly after 2017, with an average annual growth rate of 55.73%. The US (41.68%) and China (19.65%) publish the most articles, but there is a lack of international cooperation. The extraction of disease lesions is a hot topic at present, and the research topic is gradually shifting from disease risk grading to disease risk prediction. Classification (66%), and regress (15%) are the main implemented AI tasks. For AI algorithms, deep learning (31.70%), decision tree algorithms family (26.47%), and regression algorithms family (17.43%) are used most frequently. The funding rate for publications is 69.26%, and the input-output conversion rate is 21.05%.

CONCLUSIONS

Over the past decade, the use of AI to mine medical information from EHRs has been developing rapidly. However, it is necessary to strengthen international cooperation, improve EHRs data availability, focus on interpretable AI algorithms, and improve the resource conversion rate in future research.

Applications of Natural Language Processing for the Management of Stroke Disorders: Scoping Review

BACKGROUND

Recent advances in natural language processing (NLP) have heightened the interest of the medical community in its application to health care in general, in particular to stroke, a medical emergency of great impact. In this rapidly evolving context, it is necessary to learn and understand the experience already accumulated by the medical and scientific community.

OBJECTIVE

The aim of this scoping review was to explore the studies conducted in the last 10 years using NLP to assist the management of stroke emergencies so as to gain insight on the state of the art, its main contexts of application, and the software tools that are used.

METHODS

Data were extracted from Scopus and Medline through PubMed, using the keywords "natural language processing" and "stroke." Primary research questions were related to the phases, contexts, and types of textual data used in the studies. Secondary research questions were related to the numerical and statistical methods and the software used to process the data. The extracted data were structured in tables and their relative frequencies were calculated. The relationships between categories were analyzed through multiple correspondence analysis.

RESULTS

Twenty-nine papers were included in the review, with the majority being cohort studies of ischemic stroke published in the last 2 years. The majority of papers focused on the use of NLP to assist in the diagnostic phase, followed by the outcome prognosis, using text data from diagnostic reports and in many cases annotations on medical images. The most frequent approach was based on general machine learning techniques applied to the results of relatively simple NLP methods with the support of ontologies and standard vocabularies. Although smaller in number, there has been an increasing body of studies using deep learning techniques on numerical and vectorized representations of the texts obtained with more sophisticated NLP tools.

CONCLUSIONS

Studies focused on NLP applied to stroke show specific trends that can be compared to the more general application of artificial intelligence to stroke. The purpose of using NLP is often to improve processes in a clinical context rather than to assist in the rehabilitation process. The state of the art in NLP is represented by deep learning architectures, among which Bidirectional Encoder Representations from Transformers has been found to be especially widely used in the medical field in general, and for stroke in particular, with an increasing focus on the processing of annotations on medical images.

An AI-Enhanced Electronic Health Record Could Boost Primary Care Productivity

This Viewpoint discusses ways that artificial intelligence (AI) may improve the productivity of primary care physicians with easier and more accurate use of AI-enhanced electronic health records.

Doctors Identify Hemorrhage Better during Chart Review when Assisted by Artificial Intelligence

OBJECTIVES

This study evaluated if medical doctors could identify more hemorrhage events during chart review in a clinical setting when assisted by an artificial intelligence (AI) model and medical doctors' perception of using the AI model.

METHODS

To develop the AI model, sentences from 900 electronic health records were labeled as positive or negative for hemorrhage and categorized into one of 12 anatomical locations. The AI model was evaluated on a test cohort consisting of 566 admissions. Using eye-tracking technology, we investigated medical doctors' reading workflow during manual chart review. Moreover, we performed a clinical use study where medical doctors read two admissions with and without AI assistance to evaluate performance when using and perception of using the AI model.

RESULTS

The AI model had a sensitivity of 93.7% and a specificity of 98.1% on the test cohort. In the use studies, we found that medical doctors missed more than 33% of relevant sentences when doing chart review without AI assistance. Hemorrhage events described in paragraphs were more often overlooked compared with bullet-pointed hemorrhage mentions. With AI-assisted chart review, medical doctors identified 48 and 49 percentage points more hemorrhage events than without assistance in two admissions, and they were generally positive toward using the AI model as a supporting tool.

CONCLUSION

Medical doctors identified more hemorrhage events with AI-assisted chart review and they were generally positive toward using the AI model.

Effectiveness of Using the FreeStyle Libre® System for Monitoring Blood Glucose during the COVID-19 Pandemic in Diabetic Individuals: Systematic Review

BACKGROUND

Artificial Intelligence (AI) is an area of computer science/engineering that is aiming to spread technological systems. The COVID-19 pandemic caused economic and public health turbulence around the world. Among the many possibilities for using AI in the medical field is FreeStyle Libre^® (FSL), which uses a disposable sensor inserted into the user's arm, and a touchscreen device/reader is used to scan and retrieve other continuous monitoring of glucose (CMG) readings. The aim of this systematic review is to summarize the effectiveness of FSL blood glucose monitoring during the COVID-19 pandemic.

METHODS

This systematic review was carried out in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) and was registered in the international prospective register of systematic reviews (PROSPERO: CRD42022340562). The inclusion criteria considered studies involving the use of the FSL device during the COVID-19 pandemic and published in English. No publication date restrictions were set. The exclusion criteria were abstracts, systematic reviews, studies with patients with other diseases, monitoring with other equipment, patients with COVID-19, and bariatrics patients. Seven databases were searched (PubMed, Scopus, Embase, Web of Science, Scielo, PEDro and Cochrane Library). The ACROBAT-NRSI tool (A Cochrane Risk of Bias Assessment Tool for Non-Randomized Studies) was used to evaluate the risk of bias in the selected articles.

RESULTS

A total of 113 articles were found. Sixty-four were excluded because they were duplicates, 39 were excluded after reading the titles and abstracts, and twenty articles were considered for full reading. Of the 10 articles analyzed, four articles were excluded because they did not meet the inclusion criteria. Thus, six articles were included in the current systematic review. It was observed that among the selected articles, only two were classified as having serious risk of bias. It was shown that FSL had a positive impact on glycemic control and on reducing the number of individuals with hypoglycemia.

CONCLUSION

The findings suggest that the implementation of FSL during COVID-19 confinement in this population can be confidently stated to have been effective in diabetes mellitus patients.

Medical record data-enabled machine learning can enhance prediction of left atrial appendage thrombosis in nonvalvular atrial fibrillation

BACKGROUND

As a major complication of non-valvular atrial fibrillation (NVAF), left atrial appendage (LAA) thrombosis is associated with cerebral ischemic strokes, as well as high morbidity. Due to insufficient incorporation of risk factors, most current scoring methods are limited to the analysis of relationships between clinical characteristics and LAA thrombosis rather than detecting potential risk. Therefore, this study proposes a clinical data-driven machine learning method to predict LAA thrombosis of NVAF.

METHODS

Patients with NVAF from January 2014 to June 2022 were enrolled from Southwest Hospital. We selected 40 variables for analysis, including demographic data, medical history records, laboratory results, and the structure of LAA. Three machine learning algorithms were adopted to construct classifiers for the prediction of LAA thrombosis risk. The most important variables related to LAA thrombosis and their influences were recognized by SHapley Addictive exPlanations method. In addition, we compared our model with CHADS2 and CHADS2-VASc scoring methods.

RESULTS

A total of 713 participants were recruited, including 127 patients with LAA thrombosis and 586 patients with no obvious thrombosis. The consensus models based on Random Forest and eXtreme Gradient Boosting LAA thrombosis prediction (RXTP) achieved the best accuracy of 0.865, significantly outperforming CHADS2 score and CHA2DS2-VASc score (0.757 and 0.754, respectively). The SHAP results showed that B-type natriuretic peptide, left atrial appendage width, C-reactive protein, Fibrinogen and estimated glomerular filtration rate are closely related to the risk of LAA thrombosis in nonvalvular atrial fibrillation.

CONCLUSIONS

The RXTP-NVAF model is the most effective model with the greatest ROC value and recall rate. The summarized risk factors obtained from SHAP enable the optimization of the treatment strategy, thereby preventing thromboembolism events and the occurrence of cardiogenic ischemic stroke.

Deep Phenotyping on Chinese Electronic Health Records by Recognizing Linguistic Patterns of Phenotypic Narratives with a Sequence Motif Discovery Tool: Algorithm Development and Validation (Preprint)

Background

Phenotype information in electronic health records (EHRs) is mainly recorded in unstructured free text, which cannot be directly used for clinical research. EHR-based deep-phenotyping methods can structure phenotype information in EHRs with high fidelity, making it the focus of medical informatics. However, developing a deep-phenotyping method for non-English EHRs (ie, Chinese EHRs) is challenging. Although numerous EHR resources exist in China, fine-grained annotation data that are suitable for developing deep-phenotyping methods are limited. It is challenging to develop a deep-phenotyping method for Chinese EHRs in such a low-resource scenario.

Objective

In this study, we aimed to develop a deep-phenotyping method with good generalization ability for Chinese EHRs based on limited fine-grained annotation data.

Methods

The core of the methodology was to identify linguistic patterns of phenotype descriptions in Chinese EHRs with a sequence motif discovery tool and perform deep phenotyping of Chinese EHRs by recognizing linguistic patterns in free text. Specifically, 1000 Chinese EHRs were manually annotated based on a fine-grained information model, PhenoSSU (Semantic Structured Unit of Phenotypes). The annotation data set was randomly divided into a training set (n=700, 70%) and a testing set (n=300, 30%). The process for mining linguistic patterns was divided into three steps. First, free text in the training set was encoded as single-letter sequences (P: phenotype, A: attribute). Second, a biological sequence analysis tool—MEME (Multiple Expectation Maximums for Motif Elicitation)—was used to identify motifs in the single-letter sequences. Finally, the identified motifs were reduced to a series of regular expressions representing linguistic patterns of PhenoSSU instances in Chinese EHRs. Based on the discovered linguistic patterns, we developed a deep-phenotyping method for Chinese EHRs, including a deep learning–based method for named entity recognition and a pattern recognition–based method for attribute prediction.

Results

In total, 51 sequence motifs with statistical significance were mined from 700 Chinese EHRs in the training set and were combined into six regular expressions. It was found that these six regular expressions could be learned from a mean of 134 (SD 9.7) annotated EHRs in the training set. The deep-phenotyping algorithm for Chinese EHRs could recognize PhenoSSU instances with an overall accuracy of 0.844 on the test set. For the subtask of entity recognition, the algorithm achieved an F1 score of 0.898 with the Bidirectional Encoder Representations from Transformers–bidirectional long short-term memory and conditional random field model; for the subtask of attribute prediction, the algorithm achieved a weighted accuracy of 0.940 with the linguistic pattern–based method.

Conclusions

We developed a simple but effective strategy to perform deep phenotyping of Chinese EHRs with limited fine-grained annotation data. Our work will promote the second use of Chinese EHRs and give inspiration to other non–English-speaking countries.