1
|
Le KDR, Tay SBP, Choy KT, Verjans J, Sasanelli N, Kong JCH. Applications of natural language processing tools in the surgical journey. Front Surg 2024; 11:1403540. [PMID: 38826809 PMCID: PMC11140056 DOI: 10.3389/fsurg.2024.1403540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Accepted: 05/07/2024] [Indexed: 06/04/2024] Open
Abstract
Background Natural language processing tools are becoming increasingly adopted in multiple industries worldwide. They have shown promising results however their use in the field of surgery is under-recognised. Many trials have assessed these benefits in small settings with promising results before large scale adoption can be considered in surgery. This study aims to review the current research and insights into the potential for implementation of natural language processing tools into surgery. Methods A narrative review was conducted following a computer-assisted literature search on Medline, EMBASE and Google Scholar databases. Papers related to natural language processing tools and consideration into their use for surgery were considered. Results Current applications of natural language processing tools within surgery are limited. From the literature, there is evidence of potential improvement in surgical capability and service delivery, such as through the use of these technologies to streamline processes including surgical triaging, data collection and auditing, surgical communication and documentation. Additionally, there is potential to extend these capabilities to surgical academia to improve processes in surgical research and allow innovation in the development of educational resources. Despite these outcomes, the evidence to support these findings are challenged by small sample sizes with limited applicability to broader settings. Conclusion With the increasing adoption of natural language processing technology, such as in popular forms like ChatGPT, there has been increasing research in the use of these tools within surgery to improve surgical workflow and efficiency. This review highlights multifaceted applications of natural language processing within surgery, albeit with clear limitations due to the infancy of the infrastructure available to leverage these technologies. There remains room for more rigorous research into broader capability of natural language processing technology within the field of surgery and the need for cross-sectoral collaboration to understand the ways in which these algorithms can best be integrated.
Collapse
Affiliation(s)
- Khang Duy Ricky Le
- Department of General Surgical Specialties, The Royal Melbourne Hospital, Melbourne, VIC, Australia
- Department of Surgical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia
- Geelong Clinical School, Deakin University, Geelong, VIC, Australia
- Department of Medical Education, The University of Melbourne, Melbourne, VIC, Australia
| | - Samuel Boon Ping Tay
- Department of Anaesthesia and Pain Medicine, Eastern Health, Box Hill, VIC, Australia
| | - Kay Tai Choy
- Department of Surgery, Austin Health, Melbourne, VIC, Australia
| | - Johan Verjans
- Australian Institute for Machine Learning (AIML), University of Adelaide, Adelaide, SA, Australia
- Lifelong Health Theme (Platform AI), South Australian Health and Medical Research Institute, Adelaide, SA, Australia
| | - Nicola Sasanelli
- Division of Information Technology, Engineering and the Environment, University of South Australia, Adelaide, SA, Australia
- Department of Operations (Strategic and International Partnerships), SmartSAT Cooperative Research Centre, Adelaide, SA, Australia
- Agora High Tech, Adelaide, SA, Australia
| | - Joseph C. H. Kong
- Department of Surgical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia
- Monash University Department of Surgery, Alfred Hospital, Melbourne, VIC, Australia
- Department of Colorectal Surgery, Alfred Hospital, Melbourne, VIC, Australia
- Sir Peter MacCallum Department of Oncology, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
2
|
Burns JL, Gichoya JW, Kohli MD, Jones J, Purkayastha S. Theory of radiologist interaction with instant messaging decision support tools: A sequential-explanatory study. PLOS DIGITAL HEALTH 2024; 3:e0000297. [PMID: 38408043 PMCID: PMC10896537 DOI: 10.1371/journal.pdig.0000297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 01/17/2024] [Indexed: 02/28/2024]
Abstract
Radiology specific clinical decision support systems (CDSS) and artificial intelligence are poorly integrated into the radiologist workflow. Current research and development efforts of radiology CDSS focus on 4 main interventions, based around exam centric time points-after image acquisition, intra-report support, post-report analysis, and radiology workflow adjacent. We review the literature surrounding CDSS tools in these time points, requirements for CDSS workflow augmentation, and technologies that support clinician to computer workflow augmentation. We develop a theory of radiologist-decision tool interaction using a sequential explanatory study design. The study consists of 2 phases, the first a quantitative survey and the second a qualitative interview study. The phase 1 survey identifies differences between average users and radiologist users in software interventions using the User Acceptance of Information Technology: Toward a Unified View (UTAUT) framework. Phase 2 semi-structured interviews provide narratives on why these differences are found. To build this theory, we propose a novel solution called Radibot-a conversational agent capable of engaging clinicians with CDSS as an assistant using existing instant messaging systems supporting hospital communications. This work contributes an understanding of how radiologist-users differ from the average user and can be utilized by software developers to increase satisfaction of CDSS tools within radiology.
Collapse
Affiliation(s)
- John Lee Burns
- Department of Radiology & Imaging Sciences, Indiana University School of Medicine, Indianapolis, Indiana, United States of America
- Department of BioHealth Informatics, Indiana University Luddy School of Informatics, Computing, and Engineering, Indianapolis, Indiana, United States of America
| | - Judy Wawira Gichoya
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia, United States of America
| | - Marc D Kohli
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, California, United States of America
| | - Josette Jones
- Department of BioHealth Informatics, Indiana University Luddy School of Informatics, Computing, and Engineering, Indianapolis, Indiana, United States of America
| | - Saptarshi Purkayastha
- Department of BioHealth Informatics, Indiana University Luddy School of Informatics, Computing, and Engineering, Indianapolis, Indiana, United States of America
| |
Collapse
|
3
|
Bazoge A, Morin E, Daille B, Gourraud PA. Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review. JMIR Med Inform 2023; 11:e42477. [PMID: 38100200 PMCID: PMC10757232 DOI: 10.2196/42477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 01/16/2023] [Accepted: 09/07/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND In recent years, health data collected during the clinical care process have been often repurposed for secondary use through clinical data warehouses (CDWs), which interconnect disparate data from different sources. A large amount of information of high clinical value is stored in unstructured text format. Natural language processing (NLP), which implements algorithms that can operate on massive unstructured textual data, has the potential to structure the data and make clinical information more accessible. OBJECTIVE The aim of this review was to provide an overview of studies applying NLP to textual data from CDWs. It focuses on identifying the (1) NLP tasks applied to data from CDWs and (2) NLP methods used to tackle these tasks. METHODS This review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We searched for relevant articles in 3 bibliographic databases: PubMed, Google Scholar, and ACL Anthology. We reviewed the titles and abstracts and included articles according to the following inclusion criteria: (1) focus on NLP applied to textual data from CDWs, (2) articles published between 1995 and 2021, and (3) written in English. RESULTS We identified 1353 articles, of which 194 (14.34%) met the inclusion criteria. Among all identified NLP tasks in the included papers, information extraction from clinical text (112/194, 57.7%) and the identification of patients (51/194, 26.3%) were the most frequent tasks. To address the various tasks, symbolic methods were the most common NLP methods (124/232, 53.4%), showing that some tasks can be partially achieved with classical NLP techniques, such as regular expressions or pattern matching that exploit specialized lexica, such as drug lists and terminologies. Machine learning (70/232, 30.2%) and deep learning (38/232, 16.4%) have been increasingly used in recent years, including the most recent approaches based on transformers. NLP methods were mostly applied to English language data (153/194, 78.9%). CONCLUSIONS CDWs are central to the secondary use of clinical texts for research purposes. Although the use of NLP on data from CDWs is growing, there remain challenges in this field, especially with regard to languages other than English. Clinical NLP is an effective strategy for accessing, extracting, and transforming data from CDWs. Information retrieved with NLP can assist in clinical research and have an impact on clinical practice.
Collapse
Affiliation(s)
- Adrien Bazoge
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
| | - Emmanuel Morin
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Béatrice Daille
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Pierre-Antoine Gourraud
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
- Nantes Université, INSERM, CHU de Nantes, École Centrale Nantes, Centre de Recherche Translationnelle en Transplantation et Immunologie, CR2TI, F-44000 Nantes, France
| |
Collapse
|
4
|
Karway GK, Koyner JL, Caskey J, Spicer AB, Carey KA, Gilbert ER, Dligach D, Mayampurath A, Afshar M, Churpek MM. Development and external validation of multimodal postoperative acute kidney injury risk machine learning models. JAMIA Open 2023; 6:ooad109. [PMID: 38144168 PMCID: PMC10746378 DOI: 10.1093/jamiaopen/ooad109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 11/18/2023] [Accepted: 12/11/2023] [Indexed: 12/26/2023] Open
Abstract
Objectives To develop and externally validate machine learning models using structured and unstructured electronic health record data to predict postoperative acute kidney injury (AKI) across inpatient settings. Materials and Methods Data for adult postoperative admissions to the Loyola University Medical Center (2009-2017) were used for model development and admissions to the University of Wisconsin-Madison (2009-2020) were used for validation. Structured features included demographics, vital signs, laboratory results, and nurse-documented scores. Unstructured text from clinical notes were converted into concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. The primary outcome was the development of Kidney Disease Improvement Global Outcomes stage 2 AKI within 7 days after leaving the operating room. We derived unimodal extreme gradient boosting machines (XGBoost) and elastic net logistic regression (GLMNET) models using structured-only data and multimodal models combining structured data with CUI features. Model comparison was performed using the receiver operating characteristic curve (AUROC), with Delong's test for statistical differences. Results The study cohort included 138 389 adult patient admissions (mean [SD] age 58 [16] years; 11 506 [8%] African-American; and 70 826 [51%] female) across the 2 sites. Of those, 2959 (2.1%) developed stage 2 AKI or higher. Across all data types, XGBoost outperformed GLMNET (mean AUROC 0.81 [95% confidence interval (CI), 0.80-0.82] vs 0.78 [95% CI, 0.77-0.79]). The multimodal XGBoost model incorporating CUIs parameterized as term frequency-inverse document frequency (TF-IDF) showed the highest discrimination performance (AUROC 0.82 [95% CI, 0.81-0.83]) over unimodal models (AUROC 0.79 [95% CI, 0.78-0.80]). Discussion A multimodality approach with structured data and TF-IDF weighting of CUIs increased model performance over structured data-only models. Conclusion These findings highlight the predictive power of CUIs when merged with structured data for clinical prediction models, which may improve the detection of postoperative AKI.
Collapse
Affiliation(s)
- George K Karway
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
| | - Jay L Koyner
- Section of Nephrology, Department of Medicine, University of Chicago, Chicago, IL 60637, United States
| | - John Caskey
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
| | - Alexandra B Spicer
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
| | - Kyle A Carey
- Section of Nephrology, Department of Medicine, University of Chicago, Chicago, IL 60637, United States
| | - Emily R Gilbert
- Department of Medicine, Loyola University Chicago, Chicago, IL 60153, United States
| | - Dmitriy Dligach
- Department of Computer Science, Loyola University Chicago, Chicago, IL 60626, United States
| | - Anoop Mayampurath
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
- Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI 53726, United States
| | - Majid Afshar
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
- Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI 53726, United States
| | - Matthew M Churpek
- Department of Medicine, University of Wisconsin-Madison, Madison, WI 53792, United States
- Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI 53726, United States
| |
Collapse
|
5
|
Hanna MG, Brogi E. Future Practices of Breast Pathology Using Digital and Computational Pathology. Adv Anat Pathol 2023; 30:421-433. [PMID: 37737690 DOI: 10.1097/pap.0000000000000414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/23/2023]
Abstract
Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.
Collapse
Affiliation(s)
- Matthew G Hanna
- Department of Pathology and Laboratory Medicine, Memorial Sloan Kettering Cancer Center, New York, NY
| | | |
Collapse
|
6
|
Jantscher M, Gunzer F, Kern R, Hassler E, Tschauner S, Reishofer G. Information extraction from German radiological reports for general clinical text and language understanding. Sci Rep 2023; 13:2353. [PMID: 36759679 PMCID: PMC9911592 DOI: 10.1038/s41598-023-29323-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 02/02/2023] [Indexed: 02/11/2023] Open
Abstract
Recent advances in deep learning and natural language processing (NLP) have opened many new opportunities for automatic text understanding and text processing in the medical field. This is of great benefit as many clinical downstream tasks rely on information from unstructured clinical documents. However, for low-resource languages like German, the use of modern text processing applications that require a large amount of training data proves to be difficult, as only few data sets are available mainly due to legal restrictions. In this study, we present an information extraction framework that was initially pre-trained on real-world computed tomographic (CT) reports of head examinations, followed by domain adaptive fine-tuning on reports from different imaging examinations. We show that in the pre-training phase, the semantic and contextual meaning of one clinical reporting domain can be captured and effectively transferred to foreign clinical imaging examinations. Moreover, we introduce an active learning approach with an intrinsic strategic sampling method to generate highly informative training data with low human annotation cost. We see that the model performance can be significantly improved by an appropriate selection of the data to be annotated, without the need to train the model on a specific downstream task. With a general annotation scheme that can be used not only in the radiology field but also in a broader clinical setting, we contribute to a more consistent labeling and annotation process that also facilitates the verification and evaluation of language models in the German clinical setting.
Collapse
Affiliation(s)
| | - Felix Gunzer
- Division of Neuroradiology, Vascular and Interventional Radiology, Department of Radiology, Medical University Graz, 8036, Graz, Austria
| | | | - Eva Hassler
- Division of Neuroradiology, Vascular and Interventional Radiology, Department of Radiology, Medical University Graz, 8036, Graz, Austria
| | - Sebastian Tschauner
- Division of Pediatric Radiology, Department of Radiology, Medical University Graz, 8036, Graz, Austria
| | - Gernot Reishofer
- Department of Radiology, Medical University Graz, 8036, Graz, Austria. .,BioTechMed-Graz, 8010, Graz, Austria.
| |
Collapse
|
7
|
Wang L, Fu S, Wen A, Ruan X, He H, Liu S, Moon S, Mai M, Riaz IB, Wang N, Yang P, Xu H, Warner JL, Liu H. Assessment of Electronic Health Record for Cancer Research and Patient Care Through a Scoping Review of Cancer Natural Language Processing. JCO Clin Cancer Inform 2022; 6:e2200006. [PMID: 35917480 PMCID: PMC9470142 DOI: 10.1200/cci.22.00006] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 03/18/2022] [Accepted: 06/15/2022] [Indexed: 11/20/2022] Open
Abstract
PURPOSE The advancement of natural language processing (NLP) has promoted the use of detailed textual data in electronic health records (EHRs) to support cancer research and to facilitate patient care. In this review, we aim to assess EHR for cancer research and patient care by using the Minimal Common Oncology Data Elements (mCODE), which is a community-driven effort to define a minimal set of data elements for cancer research and practice. Specifically, we aim to assess the alignment of NLP-extracted data elements with mCODE and review existing NLP methodologies for extracting said data elements. METHODS Published literature studies were searched to retrieve cancer-related NLP articles that were written in English and published between January 2010 and September 2020 from main literature databases. After the retrieval, articles with EHRs as the data source were manually identified. A charting form was developed for relevant study analysis and used to categorize data including four main topics: metadata, EHR data and targeted cancer types, NLP methodology, and oncology data elements and standards. RESULTS A total of 123 publications were selected finally and included in our analysis. We found that cancer research and patient care require some data elements beyond mCODE as expected. Transparency and reproductivity are not sufficient in NLP methods, and inconsistency in NLP evaluation exists. CONCLUSION We conducted a comprehensive review of cancer NLP for research and patient care using EHRs data. Issues and barriers for wide adoption of cancer NLP were identified and discussed.
Collapse
Affiliation(s)
- Liwei Wang
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Sunyang Fu
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Andrew Wen
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Xiaoyang Ruan
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Huan He
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Sijia Liu
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Sungrim Moon
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Michelle Mai
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| | - Irbaz B. Riaz
- Department of Hematology/Oncology, Mayo Clinic, Scottsdale, AZ
| | - Nan Wang
- Department of Computer Science and Engineering, College of Science and Engineering, University of Minnesota, Minneapolis, MN
| | - Ping Yang
- Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ
| | - Hua Xu
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX
| | - Jeremy L. Warner
- Departments of Medicine (Hematology/Oncology), Vanderbilt University, Nashville, TN
- Department Biomedical Informatics, Vanderbilt University, Nashville, TN
| | - Hongfang Liu
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN
| |
Collapse
|
8
|
Linna N, Kahn CE. Applications of Natural Language Processing in Radiology: A Systematic Review. Int J Med Inform 2022; 163:104779. [DOI: 10.1016/j.ijmedinf.2022.104779] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 03/28/2022] [Accepted: 04/21/2022] [Indexed: 12/27/2022]
|
9
|
Väänänen A, Haataja K, Vehviläinen-Julkunen K, Toivanen P. Proposal of a novel Artificial Intelligence Distribution Service platform for healthcare. F1000Res 2021; 10:245. [PMID: 34804493 PMCID: PMC8577055 DOI: 10.12688/f1000research.36775.1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/10/2021] [Indexed: 11/20/2022] Open
Abstract
In this paper, we focus on presenting a novel AI-based service platform proposal called AIDI (Artificial Intelligence Distribution Interface for healthcare). AIDI proposal is based on our earlier research work in which we evaluated AI-based healthcare services which have been used successfully in practice among healthcare service providers. We have also used our systematic review about AI-based healthcare services benefits in various healthcare sectors. This novel AIDI proposal contains services for health assessment, healthcare evaluation, and cognitive assistant which can be used by researchers, healthcare service provides, clinicians, and consumers. AIDI integrates multiple health databases and data lakes with AI service providers and open access AI algorithms. It also gives healthcare service providers open access to state-of-the-art AI-based diagnosis and analysis services. This paper provides a description of AIDI platform, how it could be developed, what can become obstacles in the development, and how the platform can provide benefits to healthcare when it will be operational in the future.
Collapse
Affiliation(s)
- Antti Väänänen
- School of Computing, University of Eastern Finland, Kuopio, Pohjois-Savo, FI-70211, Finland
| | - Keijo Haataja
- School of Computing, University of Eastern Finland, Kuopio, Pohjois-Savo, FI-70211, Finland
| | | | - Pekka Toivanen
- School of Computing, University of Eastern Finland, Kuopio, Pohjois-Savo, FI-70211, Finland
| |
Collapse
|
10
|
Nie Z, Wang J, Ji XC. Retracted: Microcalcification-associated breast cancer: HER2-enriched molecular subtype is associated with mammographic features. Br J Radiol 2021:20170942. [PMID: 29927639 DOI: 10.1259/bjr.20170942] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVE To investigate whether the mammographic features were different between breast cancer HER2-enriched molecular subtype and non-HER2-enriched molecular subtype. METHODS 283 microcalcification-associated breast cancers were identified (HER2-enriched: n = 57; non-HER2-enriched: n = 226). Mammographic tumor mass and calcification features in relation to HER2 molecular subtype were analyzed. RESULTS On univariate analysis, HER2-enriched molecular subtype rates were significantly higher (a) in tumor size ≤2 cm [33 of 57 (57.9%)] than in tumor size >2 cm lesions [22 of 226 (9.7%)] (p = 0.007), (b) in non-spiculated mass [39 of 57 (68.4%)] than in spiculated mass lesions [18 of 226 (7.9%)] (p = 0.034),(c) in calcifications extent >2 cm [41 of 57 (71.9%)] lesions than in calcifications extent ≤2 cm lesions [16 of 226 (7.1%)] (p < 0.001) and (d) in calcification density >20 cm-2 [44 of 57 (71.2%)] lesions than in calcification density ≤20 cm-2 lesions [13 of 226 (5.8%)] (p = 0.034).On multivariate analysis, three mammographic features [tumor size >2 cm vs size ≤2 cm odds ratio (OR): 0.415 95% confidence interval (CI) (0.215 to 0.802), p = 0.009, spiculated mass vs non-spiculated mass OR: 0.226 95% CI (0.114 to 0.446), p < 0.001 and calcifications extent >2 cm vs calcifications extent ≤2 cm OR: 7.754, 95% CI (3.100 to 19.339) p< 0.001] were independent predictors. Our results indicated that small tumor size, non-spiculated mass and calcification extent >2 cm are more likely to be HER2 molecular subtype. The discrimination of this model, as quantified by the area under the curve, was 0.751 [95% CI (0.701 to 0.854)]. CONCLUSION Our study presents a prediction model that incorporates the mammographic features of tumor size, non-spiculated mass and calcification extent, which can potentially be used to preoperative predict breast cancer HER2-enriched subtype. ADVANCES IN KNOWLEDGE Mammographic features can noninvasively visualize breast tumor phenotype characteristics.
Collapse
Affiliation(s)
- Zhong Nie
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China
| | - Jian Wang
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China
| | - Xiao-Chun Ji
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China
| |
Collapse
|
11
|
Abstract
In this paper, we focus on providing a narrative review of healthcare services in which artificial intelligence (AI) based services are used as part of the operations and analyze key elements to create successful AI-based services for healthcare. The benefits of AI in healthcare are measured by how AI is improving the healthcare outcomes, help caregivers in work, and reducing healthcare costs. AI market in healthcare sector have also a high market potential with 28% global compound annual growth rate. This paper will collect outcomes from multiple perspectives of healthcare sector including financial, health improvement, and care outcome as well as provide proposals and key factors for successful implementation of AI methods in healthcare. It is shown in this paper that AI implementation in healthcare can provide cost reduction and same time provide better health outcome for all.
Collapse
|
12
|
Sudhir R, Sannapareddy K, Potlapalli A, Penmetsa V. Clinico-radio-pathological Features and Biological Behavior of Breast Cancer in Young Indian Women: A Prospective Study. Indian J Radiol Imaging 2021; 31:323-332. [PMID: 34556915 PMCID: PMC8448222 DOI: 10.1055/s-0041-1734342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Aims The aim of the study is to evaluate the characteristic imaging features of breast cancer on mammogram, ultrasound, and magnetic resonance imaging (MRI) in women less than 40 years of age and to assess the degree of correlation between clinico-radio-pathological features and biological behavior. Methods and Materials A prospective observational study on consecutive women under 40 years of age evaluated with ultrasound of breast, digital mammogram, or contrast-enhanced breast MRI, diagnosed with breast cancer on histopathology and molecular analysis done at our center between January and December 2019 were included. Patient demographics, clinical presentation, family history, BRCA mutation status, imaging, pathological findings, and molecular status were determined. Results Out of 2,470 women diagnosed with breast cancer, 354 (14.3%) were less than 40 years of age who were included in this study. Mammography showed positive findings in 85%, ultrasonography in 94.3%, and MRI in 96.4% of women. Majority of the women (69.6%) presented in the late stage (Stage III and IV) with high-grade carcinoma in 39.5% and triple-negative breast cancer (TNBC) in 45.7%. Tumors with human epidermal growth factor-2neu expression were associated with the presence of microcalcifications ( p -value = 0.006), and TNBC with circumscribed margins or BI-RADS 3/4a category on imaging ( p -value = 0.007) and high-grade invasive carcinoma compared with others ( p -value <0.0001). Conclusion The incidence of breast cancer in Indian women less than 40 years of age is relatively high as compared with the West. The detection of breast cancer in young women remains challenging due to dense breast tissue, lower incidence rate, and lack of regular breast screening. While ultrasound is the recommended imaging method for evaluation of breast under the age of 40 years, we found a better characterization of lesions and higher cancer detection rates when they were also evaluated with mammography and MRI.
Collapse
Affiliation(s)
- Rashmi Sudhir
- Department of Radio-Diagnosis, Basavatarkam Indo-American Cancer Hospital and Research Centre, Hyderabad, Telangana, India
| | - Kamala Sannapareddy
- Department of Radio-Diagnosis, Basavatarkam Indo-American Cancer Hospital and Research Centre, Hyderabad, Telangana, India
| | - Alekya Potlapalli
- Department of Radio-Diagnosis, Basavatarkam Indo-American Cancer Hospital and Research Centre, Hyderabad, Telangana, India
| | - Vidhatri Penmetsa
- Department of Radio-Diagnosis, Basavatarkam Indo-American Cancer Hospital and Research Centre, Hyderabad, Telangana, India
| |
Collapse
|
13
|
Deshmukh PR, Phalnikar R. Prognostic elements extraction from documents to detect prognostic stage. Comput Methods Biomech Biomed Engin 2021; 25:371-386. [PMID: 34319178 DOI: 10.1080/10255842.2021.1955359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
For cancer prediction, the prognostic stage is the main factor that helps medical experts to decide the optimal treatment for a patient. The main objective of this study is to predict prognostic stage from the medical records of various health institutions. Total 465 pathological and clinical reports of people living with breast cancer has been collected from India's reputed treatment institutions. Different anatomic and biologic factors are extracted from unstructured medical records using a novel combination of natural language processing (NLP) and fuzzy decision tree (FDT) for prognostic stage detection. This study has extracted the anatomic and biologic factors from medical reports with high accuracy. The average accuracy of the prognostic stage prediction found 93% and 83% in rural and urban regions, respectively. A generalized method for cancer staging with great accuracy in a different medical institution from dissimilar regional areas suggest that the proposed research improves the prognosis of breast cancer.
Collapse
Affiliation(s)
- Pratiksha R Deshmukh
- School of Computer Engineering and Technology, MIT World Peace University, Pune, India.,Department of Computer Science and Information Technology, College of Engineering Pune, Pune, India
| | - Rashmi Phalnikar
- School of Computer Engineering and Technology, MIT World Peace University, Pune, India
| |
Collapse
|
14
|
Casey A, Davidson E, Poon M, Dong H, Duma D, Grivas A, Grover C, Suárez-Paniagua V, Tobin R, Whiteley W, Wu H, Alex B. A systematic review of natural language processing applied to radiology reports. BMC Med Inform Decis Mak 2021; 21:179. [PMID: 34082729 PMCID: PMC8176715 DOI: 10.1186/s12911-021-01533-7] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 05/17/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Natural language processing (NLP) has a significant role in advancing healthcare and has been found to be key in extracting structured information from radiology reports. Understanding recent developments in NLP application to radiology is of significance but recent reviews on this are limited. This study systematically assesses and quantifies recent literature in NLP applied to radiology reports. METHODS We conduct an automated literature search yielding 4836 results using automated filtering, metadata enriching steps and citation search combined with manual review. Our analysis is based on 21 variables including radiology characteristics, NLP methodology, performance, study, and clinical application characteristics. RESULTS We present a comprehensive analysis of the 164 publications retrieved with publications in 2019 almost triple those in 2015. Each publication is categorised into one of 6 clinical application categories. Deep learning use increases in the period but conventional machine learning approaches are still prevalent. Deep learning remains challenged when data is scarce and there is little evidence of adoption into clinical practice. Despite 17% of studies reporting greater than 0.85 F1 scores, it is hard to comparatively evaluate these approaches given that most of them use different datasets. Only 14 studies made their data and 15 their code available with 10 externally validating results. CONCLUSIONS Automated understanding of clinical narratives of the radiology reports has the potential to enhance the healthcare process and we show that research in this field continues to grow. Reproducibility and explainability of models are important if the domain is to move applications into clinical use. More could be done to share code enabling validation of methods on different institutional data and to reduce heterogeneity in reporting of study properties allowing inter-study comparisons. Our results have significance for researchers in the field providing a systematic synthesis of existing work to build on, identify gaps, opportunities for collaboration and avoid duplication.
Collapse
Affiliation(s)
- Arlene Casey
- School of Literatures, Languages and Cultures (LLC), University of Edinburgh, Edinburgh, Scotland
| | - Emma Davidson
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, Scotland
| | - Michael Poon
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, Scotland
| | - Hang Dong
- Centre for Medical Informatics, Usher Institute of Population Health Sciences and Informatics, University of Edinburgh, Edinburgh, Scotland
- Health Data Research UK, London, UK
| | - Daniel Duma
- School of Literatures, Languages and Cultures (LLC), University of Edinburgh, Edinburgh, Scotland
| | - Andreas Grivas
- Institute for Language, Cognition and Computation, School of informatics, University of Edinburgh, Edinburgh, Scotland
| | - Claire Grover
- Institute for Language, Cognition and Computation, School of informatics, University of Edinburgh, Edinburgh, Scotland
| | - Víctor Suárez-Paniagua
- Centre for Medical Informatics, Usher Institute of Population Health Sciences and Informatics, University of Edinburgh, Edinburgh, Scotland
- Health Data Research UK, London, UK
| | - Richard Tobin
- Institute for Language, Cognition and Computation, School of informatics, University of Edinburgh, Edinburgh, Scotland
| | - William Whiteley
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, Scotland
- Nuffield Department of Population Health, University of Oxford, Oxford, UK
| | - Honghan Wu
- Health Data Research UK, London, UK
- Institute of Health Informatics, University College London, London, UK
| | - Beatrice Alex
- School of Literatures, Languages and Cultures (LLC), University of Edinburgh, Edinburgh, Scotland
- Edinburgh Futures Institute, University of Edinburgh, Edinburgh, Scotland
| |
Collapse
|
15
|
He T, Fong JN, Moore LW, Ezeana CF, Victor D, Divatia M, Vasquez M, Ghobrial RM, Wong STC. An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer. Comput Med Imaging Graph 2021; 89:101894. [PMID: 33725579 PMCID: PMC8054468 DOI: 10.1016/j.compmedimag.2021.101894] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 03/04/2021] [Accepted: 03/08/2021] [Indexed: 01/27/2023]
Abstract
INTRODUCTION Liver transplantation (LT) is an effective treatment for hepatocellular carcinoma (HCC), the most common type of primary liver cancer. Patients with small HCC (<5 cm) are given priority over others for transplantation due to clinical allocation policies based on tumor size. Attempting to shift from the prevalent paradigm that successful transplantation and longer disease-free survival can only be achieved in patients with small HCC to expanding the transplantation option to patients with HCC of the highest tumor burden (>5 cm), we developed a convergent artificial intelligence (AI) model that combines transient clinical data with quantitative histologic and radiomic features for more objective risk assessment of liver transplantation for HCC patients. METHODS Patients who received a LT for HCC between 2008-2019 were eligible for inclusion in the analysis. All patients with post-LT recurrence were included, and those without recurrence were randomly selected for inclusion in the deep learning model. Pre- and post-transplant magnetic resonance imaging (MRI) scans and reports were compressed using CapsNet networks and natural language processing, respectively, as input for a multiple feature radial basis function network. We applied a histological image analysis algorithm to detect pathologic areas of interest from explant tissue of patients who recurred. The multilayer perceptron was designed as a feed-forward, supervised neural network topology, with the final assessment of recurrence risk. We used area under the curve (AUC) and F-1 score to assess the predictability of different network combinations. RESULTS A total of 109 patients were included (87 in the training group, 22 in the testing group), of which 20 were positive for cancer recurrence. Seven models (AUC; F-1 score) were generated, including clinical features only (0.55; 0.52), magnetic resonance imaging (MRI) only (0.64; 0.61), pathological images only (0.64; 0.61), MRI plus pathology (0.68; 0.65), MRI plus clinical (0.78, 0.75), pathology plus clinical (0.77; 0.73), and a combination of clinical, MRI, and pathology features (0.87; 0.84). The final combined model showed 80 % recall and 89 % precision. The total accuracy of the implemented model was 82 %. CONCLUSION We validated that the deep learning model combining clinical features and multi-scale histopathologic and radiomic image features can be used to discover risk factors for recurrence beyond tumor size and biomarker analysis. Such a predictive, convergent AI model has the potential to alter the LT allocation system for HCC patients and expand the transplantation treatment option to patients with HCC of the highest tumor burden.
Collapse
Affiliation(s)
- Tiancheng He
- Systems Medicine and Bioengineering Department, Houston Methodist Cancer Center and Departments of Radiology and Pathology, Houston Methodist Hospital, Weill Cornell Medicine, Houston, TX, 77030, United States
| | - Joy Nolte Fong
- Department of Surgery, Houston Methodist Hospital, Houston, TX, 77030, United States
| | - Linda W Moore
- Department of Surgery, Houston Methodist Hospital, Houston, TX, 77030, United States; Center for Outcomes Research, Houston Methodist Research Institute, Houston, TX, 77030, United States
| | - Chika F Ezeana
- Systems Medicine and Bioengineering Department, Houston Methodist Cancer Center and Departments of Radiology and Pathology, Houston Methodist Hospital, Weill Cornell Medicine, Houston, TX, 77030, United States
| | - David Victor
- JC Walter Jr Transplant Center, Houston Methodist Hospital, Houston, TX, 77030, United States; Department of Medicine, Houston Methodist Hospital, Houston, TX, 77030, United States
| | - Mukul Divatia
- Department of Clinical Pathology and Genomic Medicine, Houston Methodist Hospital, Houston, TX, 77030, United States
| | - Matthew Vasquez
- Systems Medicine and Bioengineering Department, Houston Methodist Cancer Center and Departments of Radiology and Pathology, Houston Methodist Hospital, Weill Cornell Medicine, Houston, TX, 77030, United States
| | - R Mark Ghobrial
- Department of Surgery, Houston Methodist Hospital, Houston, TX, 77030, United States; JC Walter Jr Transplant Center, Houston Methodist Hospital, Houston, TX, 77030, United States.
| | - Stephen T C Wong
- Systems Medicine and Bioengineering Department, Houston Methodist Cancer Center and Departments of Radiology and Pathology, Houston Methodist Hospital, Weill Cornell Medicine, Houston, TX, 77030, United States.
| |
Collapse
|
16
|
Senders JT, Cho LD, Calvachi P, McNulty JJ, Ashby JL, Schulte IS, Almekkawi AK, Mehrtash A, Gormley WB, Smith TR, Broekman MLD, Arnaout O. Automating Clinical Chart Review: An Open-Source Natural Language Processing Pipeline Developed on Free-Text Radiology Reports From Patients With Glioblastoma. JCO Clin Cancer Inform 2021; 4:25-34. [PMID: 31977252 DOI: 10.1200/cci.19.00060] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
PURPOSE The aim of this study was to develop an open-source natural language processing (NLP) pipeline for text mining of medical information from clinical reports. We also aimed to provide insight into why certain variables or reports are more suitable for clinical text mining than others. MATERIALS AND METHODS Various NLP models were developed to extract 15 radiologic characteristics from free-text radiology reports for patients with glioblastoma. Ten-fold cross-validation was used to optimize the hyperparameter settings and estimate model performance. We examined how model performance was associated with quantitative attributes of the radiologic characteristics and reports. RESULTS In total, 562 unique brain magnetic resonance imaging reports were retrieved. NLP extracted 15 radiologic characteristics with high to excellent discrimination (area under the curve, 0.82 to 0.98) and accuracy (78.6% to 96.6%). Model performance was correlated with the inter-rater agreement of the manually provided labels (ρ = 0.904; P < .001) but not with the frequency distribution of the variables of interest (ρ = 0.179; P = .52). All variables labeled with a near perfect inter-rater agreement were classified with excellent performance (area under the curve > 0.95). Excellent performance could be achieved for variables with only 50 to 100 observations in the minority group and class imbalances up to a 9:1 ratio. Report-level classification accuracy was not associated with the number of words or the vocabulary size in the distinct text documents. CONCLUSION This study provides an open-source NLP pipeline that allows for text mining of narratively written clinical reports. Small sample sizes and class imbalance should not be considered as absolute contraindications for text mining in clinical research. However, future studies should report measures of inter-rater agreement whenever ground truth is based on a consensus label and use this measure to identify clinical variables eligible for text mining.
Collapse
Affiliation(s)
- Joeky T Senders
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.,Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
| | - Logan D Cho
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.,Department of Neuroscience, Brown University, Providence, RI
| | - Paola Calvachi
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - John J McNulty
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.,Vagelos College of Physicians and Surgeons, Columbia University, New York, NY
| | - Joanna L Ashby
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Isabelle S Schulte
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Ahmad Kareem Almekkawi
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Alireza Mehrtash
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - William B Gormley
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Timothy R Smith
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Marike L D Broekman
- Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands.,Department of Neurosurgery, Haaglanden Medical Center, The Hague, the Netherlands
| | - Omar Arnaout
- Computational Neuroscience Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
17
|
Kulshrestha S, Dligach D, Joyce C, Baker MS, Gonzalez R, O’Rourke AP, Glazer JM, Stey A, Kruser JM, Churpek MM, Afshar M. Prediction of severe chest injury using natural language processing from the electronic health record. Injury 2021; 52:205-212. [PMID: 33131794 PMCID: PMC7856032 DOI: 10.1016/j.injury.2020.10.094] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2020] [Revised: 10/02/2020] [Accepted: 10/23/2020] [Indexed: 02/02/2023]
Abstract
INTRODUCTION Trauma injury severity scores are currently calculated retrospectively from the electronic health record (EHR) using manual annotation by certified trauma coders. Natural language processing (NLP) of clinical documents in the EHR may enable automated injury scoring. We hypothesize that NLP with machine learning can discriminate between cases of severe and non-severe injury to the thorax after trauma. METHODS Clinical documents from a trauma center were examined between 2014 and 2018. Severe chest injury was defined as a thorax abbreviated injury score (AIS) >2 and served as the reference standard for supervised learning. Free text unigrams and concept unique identifiers (CUIs) from the Unified Medical Language Systems (UMLS) were extracted from clinical documents collected at one hour, four hours, and eight hours after patient arrival to the emergency department. Logistic regression models with elastic net regularization were tuned to maximize area under the receiver operating characteristic curve (AUROC) using 10-fold cross-validation on the training dataset (80%) and tested on a hold-out 20% dataset. RESULTS There were 6,891 traumas that met inclusion criteria. The complete data corpus consisted of 473,694 documents. Models trained using the first hour of data had a mean AUROC of 0.88 (95%CI [0.86, 0.89]); model discrimination and reclassification from the first hour significantly improved after eight hours with a mean AUROC of 0.94 (95%CI [0.93, 0.95]). Performance of models using CUIs were similar to unigrams (p>0.05). Models demonstrated excellent clinical face validity. CONCLUSIONS Both CUIs and unigrams demonstrated excellent discrimination in predicting severity of chest injury using the first eight hours of clinical documents. Our model demonstrates that automated anatomical injury scoring is feasible and may be used for aggregation of data for trauma research and quality programs.
Collapse
Affiliation(s)
- Sujay Kulshrestha
- Burn and Shock Trauma Research Institute, Loyola University Chicago, CTRE Building 115, Room 315, 2160 South 1st Avenue, Maywood, IL, USA,Department of Surgery, Loyola University Medical Center, EMS Building 110, Room 3210, 2160 South 1st Avenue, Maywood, IL, USA
| | - Dmitriy Dligach
- Center for Health Outcomes and Informatics Research, Health Sciences Division, Loyola University Chicago, CTRE Building 115, Room 126, 2160 South 1st Avenue, Maywood, IL, USA,Department of Public Health Sciences, Stritch School of Medicine, Loyola University Chicago, 2160 South 1st Avenue, Maywood, IL, USA,Department of Computer Science, Loyola University Chicago, 1052 West Loyola Avenue, Chicago, IL, USA
| | - Cara Joyce
- Center for Health Outcomes and Informatics Research, Health Sciences Division, Loyola University Chicago, CTRE Building 115, Room 126, 2160 South 1st Avenue, Maywood, IL, USA,Department of Public Health Sciences, Stritch School of Medicine, Loyola University Chicago, 2160 South 1st Avenue, Maywood, IL, USA
| | - Marshall S. Baker
- Department of Surgery, Loyola University Medical Center, EMS Building 110, Room 3210, 2160 South 1st Avenue, Maywood, IL, USA,Edward Hines Jr. Veterans Affairs Hospital, 5000 South Fifth Avenue, Hines, IL, USA
| | - Richard Gonzalez
- Burn and Shock Trauma Research Institute, Loyola University Chicago, CTRE Building 115, Room 315, 2160 South 1st Avenue, Maywood, IL, USA,Department of Surgery, Loyola University Medical Center, EMS Building 110, Room 3210, 2160 South 1st Avenue, Maywood, IL, USA
| | - Ann P. O’Rourke
- Department of Surgery, University of Wisconsin, 600 Highland Avenue, MC 3236, Madison, WI, USA
| | - Joshua M. Glazer
- Department of Emergency Medicine, University of Wisconsin, 800 University Bay Drive, Suite 310, MC 9123, Madison, WI, USA
| | - Anne Stey
- Division of Trauma and Surgical Critical Care, Department of Surgery, Northwestern University, 76 North St. Clair Street, Suite 650, Chicago, IL, USA
| | - Jacqueline M. Kruser
- Division of Pulmonary and Critical Care, Department of Medicine, Northwestern University, 633 North St. Clair Street, 20th Floor, McGaw M-335, Chicago, IL, USA,Department of Medical Social Sciences, Northwestern University, 633 North St. Clair Street, 19th Floor, Chicago, IL, USA
| | - Matthew M. Churpek
- Department of Medicine, University of Wisconsin, 8007 Excelsior Drive, Madison, WI, USA
| | - Majid Afshar
- Center for Health Outcomes and Informatics Research, Health Sciences Division, Loyola University Chicago, CTRE Building 115, Room 126, 2160 South 1st Avenue, Maywood, IL, USA,Department of Health Informatics and Data Science, Loyola University Chicago, 2160 South First Avenue, Maywood, IL, USA
| |
Collapse
|
18
|
Esmaeili M, Ayyoubzadeh SM, Ahmadinejad N, Ghazisaeedi M, Nahvijou A, Maghooli K. A decision support system for mammography reports interpretation. Health Inf Sci Syst 2020; 8:17. [PMID: 32257128 PMCID: PMC7113352 DOI: 10.1007/s13755-020-00109-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Accepted: 03/30/2020] [Indexed: 02/06/2023] Open
Abstract
PURPOSE Mammography plays a key role in the diagnosis of breast cancer; however, decision-making based on mammography reports is still challenging. This paper aims to addresses the challenges regarding decision-making based on mammography reports and propose a Clinical Decision Support System (CDSS) using data mining methods to help clinicians to interpret mammography reports. METHODS For this purpose, 2441 mammography reports were collected from Imam Khomeini Hospital from March 21, 2018, to March 20, 2019. In the first step, these mammography reports are analyzed and program code is developed to transform the reports into a dataset. Then, the weight of every feature of the dataset is calculated. Random Forest, Naïve Bayes, K-nearest neighbor (K-NN), Deep Learning classifiers are applied to the dataset to build a model capable of predicting the need for referral to biopsy. Afterward, the models are evaluated using cross-validation with measuring Area Under Curve (AUC), accuracy, sensitivity, specificity indices. RESULTS The mammography type (diagnostic or screening), mass and calcification features mentioned in the reports are the most important features for decision-making. Results reveal that the K-NN model is the most accurate and specific classifier with the accuracy and specificity values of 84.06% and 84.72% respectively. The Random Forest classifier has the best sensitivity and AUC with the sensitivity and AUC values of 87.74% and 0.905 respectively. CONCLUSIONS Accordingly, data mining approaches are proved to be a helpful tool to make the final decision as to whether patients should be referred to biopsy or not based on mammography reports. The developed CDSS may also be helpful especially for less experienced radiologists.
Collapse
Affiliation(s)
- Marzieh Esmaeili
- Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, 3rd Floor, No #17, Farredanesh Alley, Ghods St, Enghelab Ave, Tehran, Iran
- Scientific Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Mohammad Ayyoubzadeh
- Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, 3rd Floor, No #17, Farredanesh Alley, Ghods St, Enghelab Ave, Tehran, Iran
- Scientific Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Nasrin Ahmadinejad
- Medical Imaging Cancer, Imam Khomeini Hospital, Cancer Research Institute, Tehran, Iran
- Advanced Diagnostic and Interventional Radiology Research Cancer (ADIR), Tehran University of Medical Sciences, Tehran, Iran
| | - Marjan Ghazisaeedi
- Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, 3rd Floor, No #17, Farredanesh Alley, Ghods St, Enghelab Ave, Tehran, Iran
| | - Azin Nahvijou
- Cancer Research Center, Cancer Institute of Iran, Tehran University of Medical Sciences, Tehran, Iran
| | - Keivan Maghooli
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
19
|
Deng Z, Yin K, Bao Y, Armengol VD, Wang C, Tiwari A, Barzilay R, Parmigiani G, Braun D, Hughes KS. Validation of a Semiautomated Natural Language Processing-Based Procedure for Meta-Analysis of Cancer Susceptibility Gene Penetrance. JCO Clin Cancer Inform 2020; 3:1-9. [PMID: 31419182 DOI: 10.1200/cci.19.00043] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Quantifying the risk of cancer associated with pathogenic mutations in germline cancer susceptibility genes-that is, penetrance-enables the personalization of preventive management strategies. Conducting a meta-analysis is the best way to obtain robust risk estimates. We have previously developed a natural language processing (NLP) -based abstract classifier which classifies abstracts as relevant to penetrance, prevalence of mutations, both, or neither. In this work, we evaluate the performance of this NLP-based procedure. MATERIALS AND METHODS We compared the semiautomated NLP-based procedure, which involves automated abstract classification and text mining, followed by human review of identified studies, with the traditional procedure that requires human review of all studies. Ten high-quality gene-cancer penetrance meta-analyses spanning 16 gene-cancer associations were used as the gold standard by which to evaluate the performance of our procedure. For each meta-analysis, we evaluated the number of abstracts that required human review (workload) and the ability to identify the studies that were included by the authors in their quantitative analysis (coverage). RESULTS Compared with the traditional procedure, the semiautomated NLP-based procedure led to a lower workload across all 10 meta-analyses, with an overall 84% reduction (2,774 abstracts v 16,941 abstracts) in the amount of human review required. Overall coverage was 93%-we are able to identify 132 of 142 studies-before reviewing references of identified studies. Reasons for the 10 missed studies included blank and poorly written abstracts. After reviewing references, nine of the previously missed studies were identified and coverage improved to 99% (141 of 142 studies). CONCLUSION We demonstrated that an NLP-based procedure can significantly reduce the review workload without compromising the ability to identify relevant studies. NLP algorithms have promising potential for reducing human efforts in the literature review process.
Collapse
Affiliation(s)
| | - Kanhua Yin
- Massachusetts General Hospital, Boston, MA
| | - Yujia Bao
- Massachusetts Institute of Technology, Boston, MA
| | | | - Cathy Wang
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | | | | | - Giovanni Parmigiani
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | - Danielle Braun
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | - Kevin S Hughes
- Massachusetts General Hospital, Boston, MA.,Harvard Medical School, Boston, MA
| |
Collapse
|
20
|
Kawamoto K, McDonald CJ. Designing, Conducting, and Reporting Clinical Decision Support Studies: Recommendations and Call to Action. Ann Intern Med 2020; 172:S101-S109. [PMID: 32479177 DOI: 10.7326/m19-0875] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
By enabling more efficient and effective medical decision making, computer-based clinical decision support (CDS) could unlock widespread benefits from the significant investment in electronic health record (EHR) systems in the United States. Evidence from high-quality CDS studies is needed to enable and support this vision of CDS-facilitated care optimization, but limited guidance is available in the literature for designing and reporting CDS studies. To address this research gap, this article provides recommendations for designing, conducting, and reporting CDS studies to: 1) ensure that EHR data to inform the CDS are available; 2) choose decision rules that are consistent with local care processes; 3) target the right users and workflows; 4) make the CDS easy to access and use; 5) minimize the burden placed on users; 6) incorporate CDS success factors identified in the literature, in particular the automatic provision of CDS as a part of clinician workflow; 7) ensure that the CDS rules are adequately tested; 8) select meaningful evaluation measures; 9) use as rigorous a study design as is feasible; 10) think about how to deploy the CDS beyond the original host organization; 11) report the study in context; 12) help the audience understand why the intervention succeeded or failed; and 13) consider the financial implications. If adopted, these recommendations should help advance the vision of more efficient, effective care facilitated by useful and widely available CDS.
Collapse
Affiliation(s)
| | - Clement J McDonald
- Lister Hill National Center for Biomedical Communications, National Library of Medicine, Bethesda, Maryland (C.J.M.)
| |
Collapse
|
21
|
Trivedi HM, Panahiazar M, Liang A, Lituiev D, Chang P, Sohn JH, Chen YY, Franc BL, Joe B, Hadley D. Large Scale Semi-Automated Labeling of Routine Free-Text Clinical Records for Deep Learning. J Digit Imaging 2020; 32:30-37. [PMID: 30128778 DOI: 10.1007/s10278-018-0105-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
Breast cancer is a leading cause of cancer death among women in the USA. Screening mammography is effective in reducing mortality, but has a high rate of unnecessary recalls and biopsies. While deep learning can be applied to mammography, large-scale labeled datasets, which are difficult to obtain, are required. We aim to remove many barriers of dataset development by automatically harvesting data from existing clinical records using a hybrid framework combining traditional NLP and IBM Watson. An expert reviewer manually annotated 3521 breast pathology reports with one of four outcomes: left positive, right positive, bilateral positive, negative. Traditional NLP techniques using seven different machine learning classifiers were compared to IBM Watson's automated natural language classifier. Techniques were evaluated using precision, recall, and F-measure. Logistic regression outperformed all other traditional machine learning classifiers and was used for subsequent comparisons. Both traditional NLP and Watson's NLC performed well for cases under 1024 characters with weighted average F-measures above 0.96 across all classes. Performance of traditional NLP was lower for cases over 1024 characters with an F-measure of 0.83. We demonstrate a hybrid framework using traditional NLP techniques combined with IBM Watson to annotate over 10,000 breast pathology reports for development of a large-scale database to be used for deep learning in mammography. Our work shows that traditional NLP and IBM Watson perform extremely well for cases under 1024 characters and can accelerate the rate of data annotation.
Collapse
Affiliation(s)
- Hari M Trivedi
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA.
| | - Maryam Panahiazar
- Institute for Computational Health Sciences, University of California, San Francisco, CA, USA
| | - April Liang
- University of California School of Medicine, San Francisco, CA, USA
| | - Dmytro Lituiev
- Institute for Computational Health Sciences, University of California, San Francisco, CA, USA
| | - Peter Chang
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Jae Ho Sohn
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Yunn-Yi Chen
- Department of Pathology, University of California, San Francisco, CA, USA
| | - Benjamin L Franc
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Bonnie Joe
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Dexter Hadley
- Institute for Computational Health Sciences, University of California, San Francisco, CA, USA
| |
Collapse
|
22
|
Pfaff ER, Crosskey M, Morton K, Krishnamurthy A. Clinical Annotation Research Kit (CLARK): Computable Phenotyping Using Machine Learning. JMIR Med Inform 2020; 8:e16042. [PMID: 32012059 PMCID: PMC7007592 DOI: 10.2196/16042] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Revised: 10/30/2019] [Accepted: 12/16/2019] [Indexed: 01/02/2023] Open
Abstract
Computable phenotypes are algorithms that translate clinical features into code that can be run against electronic health record (EHR) data to define patient cohorts. However, computable phenotypes that only make use of structured EHR data do not capture the full richness of a patient’s medical record. While natural language processing (NLP) methods have shown success in extracting clinical features from text, the use of such tools has generally been limited to research groups with substantial NLP expertise. Our goal was to develop an open-source phenotyping software, Clinical Annotation Research Kit (CLARK), that would enable clinical and translational researchers to use machine learning–based NLP for computable phenotyping without requiring deep informatics expertise. CLARK enables nonexpert users to mine text using machine learning classifiers by specifying features for the software to match in clinical notes. Once the features are defined, the user-friendly CLARK interface allows the user to choose from a variety of standard machine learning algorithms (linear support vector machine, Gaussian Naïve Bayes, decision tree, and random forest), cross-validation methods, and the number of folds (cross-validation splits) to be used in evaluation of the classifier. Example phenotypes where CLARK has been applied include pediatric diabetes (sensitivity=0.91; specificity=0.98), symptomatic uterine fibroids (positive predictive value=0.81; negative predictive value=0.54), nonalcoholic fatty liver disease (sensitivity=0.90; specificity=0.94), and primary ciliary dyskinesia (sensitivity=0.88; specificity=1.0). In each of these use cases, CLARK allowed investigators to incorporate variables into their phenotype algorithm that would not be available as structured data. Moreover, the fact that nonexpert users can get started with machine learning–based NLP with limited informatics involvement is a significant improvement over the status quo. We hope to disseminate CLARK to other organizations that may not have NLP or machine learning specialists available, enabling wider use of these methods.
Collapse
Affiliation(s)
- Emily R Pfaff
- North Carolina Translational and Clinical Sciences Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | | | | | - Ashok Krishnamurthy
- Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| |
Collapse
|
23
|
Hughes KS, Zhou J, Bao Y, Singh P, Wang J, Yin K. Natural language processing to facilitate breast cancer research and management. Breast J 2019; 26:92-99. [PMID: 31854067 DOI: 10.1111/tbj.13718] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Accepted: 10/02/2019] [Indexed: 12/23/2022]
Abstract
The medical literature has been growing exponentially, and its size has become a barrier for physicians to locate and extract clinically useful information. As a promising solution, natural language processing (NLP), especially machine learning (ML)-based NLP is a technology that potentially provides a promising solution. ML-based NLP is based on training a computational algorithm with a large number of annotated examples to allow the computer to "learn" and "predict" the meaning of human language. Although NLP has been widely applied in industry and business, most physicians still are not aware of the huge potential of this technology in medicine, and the implementation of NLP in breast cancer research and management is fairly limited. With a real-world successful project of identifying penetrance papers for breast and other cancer susceptibility genes, this review illustrates how to train and evaluate an NLP-based medical abstract classifier, incorporate it into a semiautomatic meta-analysis procedure, and validate the effectiveness of this procedure. Other implementations of NLP technology in breast cancer research, such as parsing pathology reports and mining electronic healthcare records, are also discussed. We hope this review will help breast cancer physicians and researchers to recognize, understand, and apply this technology to meet their own clinical or research needs.
Collapse
Affiliation(s)
- Kevin S Hughes
- Division of Surgical Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
| | - Jingan Zhou
- Division of Surgical Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, MA.,Department of General Surgery, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Yujia Bao
- Computer Science & Artificial Intelligence, Massachusetts Institute of Technology, Boston, MA
| | - Preeti Singh
- Division of Surgical Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
| | - Jin Wang
- Division of Surgical Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, MA.,Department of Breast Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center of Cancer Medicine, Guangzhou, China
| | - Kanhua Yin
- Division of Surgical Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
| |
Collapse
|
24
|
Horgan D, Romao M, Morré S, Kalra D. Artificial Intelligence: Power for Civilisation – and for Better Healthcare. Public Health Genomics 2019; 22:145-161. [DOI: 10.1159/000504785] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Accepted: 11/14/2019] [Indexed: 11/19/2022] Open
|
25
|
Zhou J, Tan H, Bai Y, Li J, Lu Q, Chen R, Zhang M, Feng Q, Wang M. Evaluating the HER-2 status of breast cancer using mammography radiomics features. Eur J Radiol 2019; 121:108718. [PMID: 31711023 DOI: 10.1016/j.ejrad.2019.108718] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2019] [Revised: 09/06/2019] [Accepted: 10/18/2019] [Indexed: 11/30/2022]
Abstract
PURPOSE The aim of our study was to evaluate the HER-2 status in breast cancer patients using mammography (MG) radiomics features. METHODS A total of 306 Chinese female patients with invasive ductal carcinoma of no special type (IDC-NST) enrolled from January 2013 to July 2018 were divided into a training set (n = 244) and a testing set (n = 62). One hundred and eighty-six radiomics features were extracted from digital MG images based on the training set. The least absolute shrinkage and selection operator (LASSO) method was used to select the optimal predictive features for HER-2 status from the training set. Both support vector machine (SVM) and logistic regression models were employed based on the selected features. The area under the receiver operating characteristic (ROC) curves (AUCs) of the training set and testing set were used to evaluate the predictive performance of the models. RESULTS Compared with the SVM model, the performance of the logistic regression model using a combination of cranial caudal (CC) and mediolateral oblique (MLO) MG views was optimal. In the training set, the sensitivity, specificity, accuracy and area under the curve (AUC) values of the logistic regression model for evaluating HER-2 status based on quantitative radiomics features were 87.29%, 58.73%, 80.00% and 0.846 (95% confidence interval (CI), 0.800-0.887), respectively, and in the testing set, the values were 73.91%, 68.75%, 77.00% and 0.787 (95% CI, 0.673-0.885), respectively. CONCLUSIONS Radiomics features could be an efficient tool for the preoperative evaluation of HER-2 status in patients with breast cancer.
Collapse
Affiliation(s)
- Jing Zhou
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China; Medical Imaging School, Mudanjiang Medical University, Mudanjiang, Heilongjiang Province, 157011, China
| | - Hongna Tan
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Yan Bai
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Jie Li
- Huiying Medical Technology Inc., Beijing, China
| | - Qing Lu
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Rushi Chen
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Menghuan Zhang
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Qin Feng
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China
| | - Meiyun Wang
- Department of Radiology, Henan Provincial People's Hospital, Henan, 450003, China; Imaging Diagnosis of Neurological Diseases and Research Laboratory of Henan Province, China.
| |
Collapse
|
26
|
Zhang X, Zhang Y, Zhang Q, Ren Y, Qiu T, Ma J, Sun Q. Extracting comprehensive clinical information for breast cancer using deep learning methods. Int J Med Inform 2019; 132:103985. [PMID: 31627032 DOI: 10.1016/j.ijmedinf.2019.103985] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Accepted: 09/29/2019] [Indexed: 12/29/2022]
Abstract
OBJECTIVE Breast cancer is the most common malignant tumor among women. The diagnosis and treatment information of breast cancer patients is abundant in multiple types of clinical fields, including clinicopathological data, genotype and phenotype information, treatment information, and prognosis information. However, current studies are mainly focused on extracting information from one specific type of clinical field. This study defines a comprehensive information model to represent the whole-course clinical information of patients. Furthermore, deep learning approaches are used to extract the concepts and their attributes from clinical breast cancer documents by fine-tuning pretrained Bidirectional Encoder Representations from Transformers (BERT) language models. MATERIALS AND METHODS The clinical corpus that was used in this study was from one 3A cancer hospital in China, consisting of the encounter notes, operation records, pathology notes, radiology notes, progress notes and discharge summaries of 100 breast cancer patients. Our system consists of two components: a named entity recognition (NER) component and a relation recognition component. For each component, we implemented deep learning-based approaches by fine-tuning BERT, which outperformed other state-of-the-art methods on multiple natural language processing (NLP) tasks. A clinical language model is first pretrained using BERT on a large-scale unlabeled corpus of Chinese clinical text. For NER, the context embeddings that were pretrained using BERT were used as the input features of the Bi-LSTM-CRF (Bidirectional long-short-memory-conditional random fields) model and were fine-tuned using the annotated breast cancer notes. Furthermore, we proposed an approach to fine-tune BERT for relation extraction. It was considered to be a classification problem in which the two entities that were mentioned in the input sentence were replaced with their semantic types. RESULTS Our best-performing system achieved F1 scores of 93.53% for the NER and 96.73% for the relation extraction. Additional evaluations showed that the deep learning-based approaches that fine-tuned BERT did outperform the traditional Bi-LSTM-CRF and CRF machine learning algorithms in NER and the attention-Bi-LSTM and SVM (support vector machines) algorithms in relation recognition. CONCLUSION In this study, we developed a deep learning approach that fine-tuned BERT to extract the breast cancer concepts and their attributes. It demonstrated its superior performance compared to traditional machine learning algorithms, thus supporting its uses in broader NER and relation extraction tasks in the medical domain.
Collapse
Affiliation(s)
- Xiaohui Zhang
- Peking Union Medical College Hospital, Peking Union Medical College & Chinese Academy of Medical Sciences, Beijing, China
| | - Yaoyun Zhang
- Digital China Health Technologies Co. Ltd., Beijing, China
| | - Qin Zhang
- Digital China Health Technologies Co. Ltd., Beijing, China
| | - Yuankai Ren
- Digital China Health Technologies Co. Ltd., Beijing, China
| | - Tinglin Qiu
- National Cancer Center/Cancer Hospital, Peking Union Medical College & Chinese Academy of Medical Sciences, Beijing, China
| | - Jianhui Ma
- National Cancer Center/Cancer Hospital, Peking Union Medical College & Chinese Academy of Medical Sciences, Beijing, China.
| | - Qiang Sun
- Peking Union Medical College Hospital, Peking Union Medical College & Chinese Academy of Medical Sciences, Beijing, China.
| |
Collapse
|
27
|
Abstract
OBJECTIVES This survey analyses the latest literature contributions to clinical decision support systems (DSSs) on a two-year period (2017-2018), focusing on the approaches that adopt Artificial Intelligence (AI) techniques in a broad sense. The goal is to analyse the distribution of data-driven AI approaches with respect to "classical" knowledge-based ones, and to consider the issues raised and their possible solutions. METHODS We included PubMed and Web of ScienceTM publications, focusing on contributions describing clinical DSSs that adopted one or more AI methodologies. RESULTS We selected 75 papers, 49 of which describe approaches in the data-driven AI area, 20 present purely knowledge-based DSSs, and 6 adopt hybrid approaches relying on both formalized knowledge and data. CONCLUSIONS Recent studies in the clinical DSS area demonstrate a prevalence of data-driven AI, which can be adopted autonomously in purely data-driven systems, or in cooperation with domain knowledge in hybrid systems. Such hybrid approaches, able to conjugate all available knowledge sources through proper knowledge integration steps, represent an interesting example of synergy between the two AI categories. This synergy can lead to the resolution of some existing issues, such as the need for transparency and explainability, nowadays recognized as central themes to be addressed by both AI and medical informatics research.
Collapse
Affiliation(s)
- Stefania Montani
- DISIT, Computer Science Institute, University of Piemonte Orientale, Alessandria, Italy
| | - Manuel Striani
- DISIT, Computer Science Institute, University of Piemonte Orientale, Alessandria, Italy
| |
Collapse
|
28
|
Jain NM, Culley A, Knoop T, Micheel C, Osterman T, Levy M. Conceptual Framework to Support Clinical Trial Optimization and End-to-End Enrollment Workflow. JCO Clin Cancer Inform 2019; 3:1-10. [PMID: 31225983 PMCID: PMC6873934 DOI: 10.1200/cci.19.00033] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/02/2019] [Indexed: 12/19/2022] Open
Abstract
In this work, we present a conceptual framework to support clinical trial optimization and enrollment workflows and review the current state, limitations, and future trends in this space. This framework includes knowledge representation of clinical trials, clinical trial optimization, clinical trial design, enrollment workflows for prospective clinical trial matching, waitlist management, and, finally, evaluation strategies for assessing improvement.
Collapse
Affiliation(s)
- Neha M. Jain
- Vanderbilt University Medical Center, Nashville, TN
| | | | - Teresa Knoop
- Vanderbilt University Medical Center, Nashville, TN
| | | | | | - Mia Levy
- Vanderbilt University Medical Center, Nashville, TN
- Rush University Medical Center, Chicago, IL
| |
Collapse
|
29
|
Rattan R, Kataria T, Banerjee S, Goyal S, Gupta D, Pandita A, Bisht S, Narang K, Mishra SR. Artificial intelligence in oncology, its scope and future prospects with specific reference to radiation oncology. BJR Open 2019; 1:20180031. [PMID: 33178922 PMCID: PMC7592433 DOI: 10.1259/bjro.20180031] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Revised: 04/01/2019] [Accepted: 04/12/2019] [Indexed: 01/02/2023] Open
Abstract
OBJECTIVE Artificial intelligence (AI) seems to be bridging the gap between the acquisition of data and its meaningful interpretation. These approaches, have shown outstanding capabilities, outperforming most classification and regression methods to date and the ability to automatically learn the most suitable data representation for the task at hand and present it for better correlation. This article tries to sensitize the practising radiation oncologists to understand where the potential role of AI lies and what further can be achieved with it. METHODS AND MATERIALS Contemporary literature was searched and the available literature was sorted and an attempt at writing a comprehensive non-systematic review was made. RESULTS The article addresses various areas in oncology, especially in the field of radiation oncology, where the work based on AI has been done. Whether it's the screening modalities, or diagnosis or the prognostic assays, AI has come with more accurately defining results and survival of patients. Various steps and protocols in radiation oncology are now using AI-based methods, like in the steps of planning, segmentation and delivery of radiation. Benefit of AI across all the platforms of health sector may lead to a more refined and personalized medicine in near future. CONCLUSION AI with the use of machine learning and artificial neural networks has come up with faster and more accurate solutions for the problems faced by oncologist. The uses of AI,are likely to get increased exponentially . However, concerns regarding demographic discrepancies in relation to patients, disease and their natural history and reports of manipulation of AI, the ultimate responsibility will rest on the treating physicians.
Collapse
Affiliation(s)
- Rajit Rattan
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Tejinder Kataria
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Susovan Banerjee
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Shikha Goyal
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Deepak Gupta
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Akshi Pandita
- Department of Dermatology, P. N. Behl Skin Institute, New Delhi, India
| | - Shyam Bisht
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
- Department of Dermatology, P. N. Behl Skin Institute, New Delhi, India
| | - Kushal Narang
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | | |
Collapse
|
30
|
He T, Puppala M, Ezeana CF, Huang YS, Chou PH, Yu X, Chen S, Wang L, Yin Z, Danforth RL, Ensor J, Chang J, Patel T, Wong ST. A Deep Learning-Based Decision Support Tool for Precision Risk Assessment of Breast Cancer. JCO Clin Cancer Inform 2019; 3:1-12. [PMID: 31141423 PMCID: PMC10445790 DOI: 10.1200/cci.18.00121] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/27/2019] [Indexed: 08/25/2023] Open
Abstract
PURPOSE The Breast Imaging Reporting and Data System (BI-RADS) lexicon was developed to standardize mammographic reporting to assess cancer risk and facilitate the decision to biopsy. Because of substantial interobserver variability in the application of the BI-RADS lexicon, the decision to biopsy varies greatly and results in overdiagnosis and excessive biopsies. The false-positive rate from mammograms is estimated to be 7% to approximately 10% overall, but within the BI-RADS 4 category, it is greater than 70%. Therefore, we developed the Breast Cancer Risk Calculator (BRISK) to target a well-characterized and specific patient subgroup (BI-RADS 4) rather than a broad heterogeneous group in assessing breast cancer risk. METHODS BRISK provides a novel precise risk assessment model to reduce overdiagnosis and unnecessary biopsies. It was developed by applying natural language processing and deep learning methods on 5,147 patient records archived in the Houston Methodist systemwide data warehouse from 2006 to May 2015, including imaging and pathology reports, mammographic images, and patient demographics. Key characteristics for BI-RADS 4 patients were collected and computed to output an index measure for biopsy recommendation that is clinically relevant and informative and improves upon the traditional BI-RADS 4 scores. RESULTS For the validation set, we assessed data from 1,247 BI-RADS 4 patients, including mammographic images and medical reports. The BRISK model sensitivity to predict malignancy was 100%, whereas the specificity was 74%. The total accuracy of our implemented model in BRISK was 81%. Overall area under the curve was 0.93. CONCLUSION BRISK for abnormal mammogram uses integrative artificial intelligence technology and has demonstrated high sensitivity in the prediction of malignancy. Prospective evaluation is under way and can lead to improvement in patient-physician engagement in making informed decisions with regard to biopsy.
Collapse
Affiliation(s)
| | | | | | - Yan-siang Huang
- Houston Methodist, Houston, TX
- Far-Eastern Memorial Hospital, Taiwan,
Republic of China
| | - Ping-hsuan Chou
- Houston Methodist, Houston, TX
- Far-Eastern Memorial Hospital, Taiwan,
Republic of China
| | | | | | | | | | | | | | | | | | | |
Collapse
|
31
|
Zhang Z, Sejdić E. Radiological images and machine learning: Trends, perspectives, and prospects. Comput Biol Med 2019; 108:354-370. [PMID: 31054502 PMCID: PMC6531364 DOI: 10.1016/j.compbiomed.2019.02.017] [Citation(s) in RCA: 63] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 02/19/2019] [Accepted: 02/19/2019] [Indexed: 01/18/2023]
Abstract
The application of machine learning to radiological images is an increasingly active research area that is expected to grow in the next five to ten years. Recent advances in machine learning have the potential to recognize and classify complex patterns from different radiological imaging modalities such as x-rays, computed tomography, magnetic resonance imaging and positron emission tomography imaging. In many applications, machine learning based systems have shown comparable performance to human decision-making. The applications of machine learning are the key ingredients of future clinical decision making and monitoring systems. This review covers the fundamental concepts behind various machine learning techniques and their applications in several radiological imaging areas, such as medical image segmentation, brain function studies and neurological disease diagnosis, as well as computer-aided systems, image registration, and content-based image retrieval systems. Synchronistically, we will briefly discuss current challenges and future directions regarding the application of machine learning in radiological imaging. By giving insight on how take advantage of machine learning powered applications, we expect that clinicians can prevent and diagnose diseases more accurately and efficiently.
Collapse
Affiliation(s)
- Zhenwei Zhang
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Ervin Sejdić
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
| |
Collapse
|
32
|
Miao S, Xu T, Wu Y, Xie H, Wang J, Jing S, Zhang Y, Zhang X, Yang Y, Zhang X, Shan T, Wang L, Xu H, Wang S, Liu Y. Extraction of BI-RADS findings from breast ultrasound reports in Chinese using deep learning approaches. Int J Med Inform 2018; 119:17-21. [DOI: 10.1016/j.ijmedinf.2018.08.009] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 08/14/2018] [Accepted: 08/16/2018] [Indexed: 01/10/2023]
|
33
|
Rashmi S, Kamala S, Murthy SS, Kotha S, Rao YS, Chaudhary KV. Predicting the molecular subtype of breast cancer based on mammography and ultrasound findings. Indian J Radiol Imaging 2018; 28:354-361. [PMID: 30319215 PMCID: PMC6176670 DOI: 10.4103/ijri.ijri_78_18] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
AIM To determine the correlation between mammography and ultrasound features of breast cancer with molecular subtypes and to calculate the predictive value of these features. MATERIALS AND METHOD This is a prospective study of consecutive patients with breast cancer presenting between January 2016 and July 2017, who underwent mammography and/or ultrasound of breast and excision of the breast mass. Patients with contralateral breast mass, metastases, h/o prior cancer treatment, and other malignancies were excluded. On mammography, the presence or absence of microcalcification was noted. On ultrasound examination size, margins, microcalcification, posterior acoustic features, vascularity, and axillary nodes were assessed. Margins were categorized into circumscribed and non-circumscribed. Posterior acoustic features were classified into four categories: shadowing, enhancement, mixed, and no changes. Vascularity was assessed based on Adler's index into grades 0, 1, 2, and 3. Grades 0 and 1 were considered low and 2 and 3 were high. RESULTS Tumors with non-circumscribed margins and posterior acoustic shadowing were likely to be luminal A or B subtype of breast cancer [odds ratio (OR) 5.78; 95% confidence interval (CI) 3.68-9.80; P < 0.0001]. Tumors with non-circumscribed margins, posterior acoustic shadowing, and high vascularity were more likely to be luminal B subtype (OR 2.88; 95% CI 2-4.14; P- <0.0001). Tumors with microcalcification and posterior mixed acoustic pattern were strongly associated to be HER2-positive (OR 5.48; 95% CI 3.06-9.80; P < 0.0001). Tumors with circumscribed margins and posterior acoustic enhancement were highly suggestive of triple-negative breast cancer (OR 7.06; 95% CI 4.64-10.73; P < 0.0001). CONCLUSION Microcalcification detected on mammography and certain ultrasound features such as circumscribed or non-circumscribed margins, posterior acoustic features, and vascularity are strongly correlated in predicting the molecular subtypes of breast cancer, and thus may further expand the role of conventional breast imaging.
Collapse
Affiliation(s)
- S. Rashmi
- Department of Radiodiagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| | - S. Kamala
- Department of Radiodiagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| | - S. Sudha Murthy
- Department of Pathology and Lab Diagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| | - Swapna Kotha
- Department of Radiodiagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| | - Y. Suhas Rao
- Department of Radiodiagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| | - K. Veeraiah Chaudhary
- Department of Radiodiagnosis, Basavatarakam Indo American Cancer Hospital and Research Institute, Hyderabad, Telangana, India
| |
Collapse
|
34
|
Cen D, Xu L, Li N, Chen Z, Wang L, Zhou S, Xu B, Liu CL, Liu Z, Luo T. BI-RADS 3-5 microcalcifications can preoperatively predict breast cancer HER2 and Luminal a molecular subtype. Oncotarget 2017; 8:13855-13862. [PMID: 28099938 PMCID: PMC5355144 DOI: 10.18632/oncotarget.14655] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2016] [Accepted: 01/07/2017] [Indexed: 12/31/2022] Open
Abstract
Purpose To investigate associations between breast cancer molecular subtype and the patterns of mammographically detected calcifications. Results Identified were 93 (19.1%) Luminal A, 242 (49.9%) Luminal B, 108 (22.2%) HER2 and 42 (8.7%) basal subtypes. In univariate analysis, the clinicopathological parameters and BI-RADS 3–5 microcalcifications, which consisted 9 selected features was significantly associated with breast cancer molecular subtype (all P < 0.05). Among subtypes, multivariate analysis showed that calcification >2 cm in range (OR: 1.878, 95% CI: 1.150 to 3.067) and calcification > 0.5 mm in diameter (OR:2.206, 95% CI: 1.235 to 3.323) was independently predictive of HER2 subtype. The model showed good discrimination for predicting HER2 subtype, with a C-index of 0.704. In addition, multivariate analysis showed that calcification morphology (amorphour or coarse heterogenous calcifications OR: 2.847, 95% CI: 1.526 to 5.312) was independently predictive of Luminal A subtype. The model showed good discrimination for predicting Luminal A subtype, with a C-index of 0.74. And we demonstrated that amorphour or coarse heterogenous calcifications were associated with a higher incidence of Luminal A subtype than pleomorphic or fine linear or branching calcifications. There was no significant difference between breast cancer subtypes (Luminal B vs. other; Basal vs. other) and the patterns of mammographically detected calcifications. Materials and Methods Mammographic images of 485 female patients were included. The correlation between mammographic imaging features and breast cancer subtype was analyzed using Chi-square test, univariate and binary logistic regression analysis. Conclusions This study shows that BI-RADS 3–5 microcalcifications can be conveniently used to facilitate the preoperative prediction of HER2 and Luminal A molecular subtype in patients with infiltrating ductal carcinoma.
Collapse
Affiliation(s)
- DongZhi Cen
- Department of Radiation Oncology and Department of Nuclear Medicine, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510150, Guangdong Province, People's Republic of China
| | - Li Xu
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Ningna Li
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Zhiguang Chen
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Lu Wang
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Shuqin Zhou
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Biao Xu
- Guangdong Provincial Traditional Chinese Medicine Hospital, Guangzhou, Guangdong Province 510120, P.R. China
| | - Chun Ling Liu
- Department of Radiology, Guangdong General Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong Province 510080, People's Republic of China
| | - Zaiyi Liu
- Department of Radiology, Guangdong General Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong Province 510080, People's Republic of China
| | - Tingting Luo
- Department of Ultrasound, The Third People's Hospital of Shenzhen, Guangdong Shenzhen 518112, China
| |
Collapse
|
35
|
Dang D, Prasad H, Rao R. Secretory pathway Ca 2+ -ATPases promote in vitro microcalcifications in breast cancer cells. Mol Carcinog 2017; 56:2474-2485. [PMID: 28618103 DOI: 10.1002/mc.22695] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2016] [Revised: 05/19/2017] [Accepted: 06/13/2017] [Indexed: 02/01/2023]
Abstract
Calcification of the breast is often an outward manifestation of underlying molecular changes that drive carcinogenesis. Up to 50% of all non-palpable breast tumors and 90% of ductal carcinoma in situ present with radiographically dense mineralization in mammographic scans. However, surprisingly little is known about the molecular pathways that lead to microcalcifications in the breast. Here, we report on a rapid and quantitative in vitro assay to monitor microcalcifications in breast cancer cell lines, including MCF7, MDA-MB-231, and Hs578T. We show that the Secretory Pathway Ca2+ -ATPases SPCA1 and SPCA2 are strongly induced under osteogenic conditions that elicit microcalcifications. SPCA gene expression is significantly elevated in breast cancer subtypes that are associated with microcalcifications. Ectopic expression of SPCA genes drives microcalcifications and is dependent on pumping activity. Conversely, knockdown of SPCA expression significantly attenuates formation of microcalcifications. We propose that high levels of SPCA pumps may initiate mineralization in the secretory pathway by elevating luminal Ca2+ . Our new findings offer mechanistic insight and functional implications on a widely observed, yet poorly understood radiographic signature of breast cancer.
Collapse
Affiliation(s)
- Donna Dang
- Department of Physiology, The Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Hari Prasad
- Department of Physiology, The Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Rajini Rao
- Department of Physiology, The Johns Hopkins University School of Medicine, Baltimore, Maryland
| |
Collapse
|
36
|
Velaga R, Sugimoto M. Future Paradigm of Breast Cancer Resistance and Treatment. RESISTANCE TO TARGETED ANTI-CANCER THERAPEUTICS 2017. [DOI: 10.1007/978-3-319-70142-4_7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|