1
|
García-Barragán Á, Sakor A, Vidal ME, Menasalvas E, Gonzalez JCS, Provencio M, Robles V. NSSC: a neuro-symbolic AI system for enhancing accuracy of named entity recognition and linking from oncologic clinical notes. Med Biol Eng Comput 2024:10.1007/s11517-024-03227-4. [PMID: 39485651 DOI: 10.1007/s11517-024-03227-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Accepted: 10/12/2024] [Indexed: 11/03/2024]
Abstract
Accurate recognition and linking of oncologic entities in clinical notes is essential for extracting insights across cancer research, patient care, clinical decision-making, and treatment optimization. We present the Neuro-Symbolic System for Cancer (NSSC), a hybrid AI framework that integrates neurosymbolic methods with named entity recognition (NER) and entity linking (EL) to transform unstructured clinical notes into structured terms using medical vocabularies, with the Unified Medical Language System (UMLS) as a case study. NSSC was evaluated on a dataset of clinical notes from breast cancer patients, demonstrating significant improvements in the accuracy of both entity recognition and linking compared to state-of-the-art models. Specifically, NSSC achieved a 33% improvement over BioFalcon and a 58% improvement over scispaCy. By combining large language models (LLMs) with symbolic reasoning, NSSC improves the recognition and interoperability of oncologic entities, enabling seamless integration with existing biomedical knowledge. This approach marks a significant advancement in extracting meaningful information from clinical narratives, offering promising applications in cancer research and personalized patient care.
Collapse
Affiliation(s)
- Álvaro García-Barragán
- Center of Biomedical Technology, Universidad Politécnica de Madrid, Campus Montegancedo, Pozuelo de Alarcón, 28223, Madrid, Spain.
| | - Ahmad Sakor
- Data Science Institute, Leibniz University of Hannover, Welfengarten 1, Hannover, 30060, Lower Saxony, Germany.
- Scientific Data Management Group, TIB-Leibniz Information Centre for Science and Technology, Welfengarten 1B, Hannover, 30167, Lower Saxony, Germany.
| | - Maria-Esther Vidal
- Data Science Institute, Leibniz University of Hannover, Welfengarten 1, Hannover, 30060, Lower Saxony, Germany.
- Scientific Data Management Group, TIB-Leibniz Information Centre for Science and Technology, Welfengarten 1B, Hannover, 30167, Lower Saxony, Germany.
| | - Ernestina Menasalvas
- Center of Biomedical Technology, Universidad Politécnica de Madrid, Campus Montegancedo, Pozuelo de Alarcón, 28223, Madrid, Spain.
| | | | | | - Víctor Robles
- Center of Biomedical Technology, Universidad Politécnica de Madrid, Campus Montegancedo, Pozuelo de Alarcón, 28223, Madrid, Spain.
| |
Collapse
|
2
|
Zhao Y, Li X, Zhou C, Peng H, Zheng Z, Chen J, Ding W. A review of cancer data fusion methods based on deep learning. INFORMATION FUSION 2024; 108:102361. [DOI: 10.1016/j.inffus.2024.102361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
3
|
Boas PMV, Vieira LJEDS, da Silva GB, Lira GV, de Oliveira JGR. Implementation and use of electronic patient records in the Brazilian Air Force: a cross-sectional study1. REVISTA DA ASSOCIACAO MEDICA BRASILEIRA (1992) 2024; 70:e20231136. [PMID: 38716938 PMCID: PMC11068379 DOI: 10.1590/1806-9282.20231136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 12/05/2023] [Indexed: 05/12/2024]
Abstract
OBJECTIVE The objective was to analyze the implementation and use of the electronic patient record in the health services of the Brazilian Air Force. METHODS This is a cross-sectional study carried out with 234 physicians, between March and May 2021. The data collection instrument was sent by email. The electronic patient record was implemented in the Air Force approximately 3 years ago (64.5%), and about 81% of the physicians received training to operate it. RESULTS The most common records involve data related to consultations (90.1%) and interviews with physical examination (67.1%). Physicians cited that information storage (75.6%), agility, and feasibility of recording (55.1%) were the main advantages of the electronic patient record. As disadvantages, problems in electronic equipment (69.7%) and system errors (65%) were reported. Most participants considered that the implementation had a positive impact on work dynamics (75.6%) and productivity (66.7%), mainly regarding the components "Work processes" (57.3%) and "Amount of carried out activities" (21.4%). Keeping records was significantly associated with the job position (p<0.001), type of unit (p=0.008), time of implementation (p<0.001), and participation in training (p=0.028). CONCLUSION The implementation of the electronic patient record in the Air Force was recently done, and just over half of the physicians were trained prior to the implementation. The tool is considered compatible with work processes and has a positive effect on productivity.
Collapse
|
4
|
Moulson R, Law J, Sacher A, Liu G, Shepherd FA, Bradbury P, Eng L, Iczkovitz S, Abbie E, Elia-Pacitti J, Ewara EM, Mokriak V, Weiss J, Pettengell C, Leighl NB. Real-World Outcomes of Patients with Advanced Epidermal Growth Factor Receptor-Mutated Non-Small Cell Lung Cancer in Canada Using Data Extracted by Large Language Model-Based Artificial Intelligence. Curr Oncol 2024; 31:1947-1960. [PMID: 38668049 PMCID: PMC11049467 DOI: 10.3390/curroncol31040146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 02/09/2024] [Accepted: 03/25/2024] [Indexed: 04/28/2024] Open
Abstract
Real-world evidence for patients with advanced EGFR-mutated non-small cell lung cancer (NSCLC) in Canada is limited. This study's objective was to use previously validated DARWENTM artificial intelligence (AI) to extract data from electronic heath records of patients with non-squamous NSCLC at University Health Network (UHN) to describe EGFR mutation prevalence, treatment patterns, and outcomes. Of 2154 patients with NSCLC, 613 had advanced disease. Of these, 136 (22%) had common sensitizing EGFR mutations (cEGFRm; ex19del, L858R), 8 (1%) had exon 20 insertions (ex20ins), and 338 (55%) had EGFR wild type. One-year overall survival (OS) (95% CI) for patients with cEGFRm, ex20ins, and EGFR wild type tumours was 88% (83, 94), 100% (100, 100), and 59% (53, 65), respectively. In total, 38% patients with ex20ins received experimental ex20ins targeting treatment as their first-line therapy. A total of 57 patients (36%) with cEGFRm received osimertinib as their first-line treatment, and 61 (39%) received it as their second-line treatment. One-year OS (95% CI) following the discontinuation of osimertinib was 35% (17, 75) post-first-line and 20% (9, 44) post-second-line. In this real-world AI-generated dataset, survival post-osimertinib was poor in patients with cEGFR mutations. Patients with ex20ins in this cohort had improved outcomes, possibly due to ex20ins targeting treatment, highlighting the need for more effective treatments for patients with advanced EGFRm NSCLC.
Collapse
Affiliation(s)
- Ruth Moulson
- Pentavere, 460 College Street, Toronto, ON M6G 1A1, Canada; (R.M.)
| | - Jennifer Law
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | - Adrian Sacher
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | - Geoffrey Liu
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | - Frances A. Shepherd
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | - Penelope Bradbury
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | - Lawson Eng
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| | | | | | | | | | | | - Jessica Weiss
- Pentavere, 460 College Street, Toronto, ON M6G 1A1, Canada; (R.M.)
| | | | - Natasha B. Leighl
- Department of Medical Oncology, Princess Margaret Cancer Centre, University Health Network, Toronto, ON M5G 2C1, Canada
| |
Collapse
|
5
|
Solarte-Pabón O, Montenegro O, García-Barragán A, Torrente M, Provencio M, Menasalvas E, Robles V. Transformers for extracting breast cancer information from Spanish clinical narratives. Artif Intell Med 2023; 143:102625. [PMID: 37673566 DOI: 10.1016/j.artmed.2023.102625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 05/11/2023] [Accepted: 07/08/2023] [Indexed: 09/08/2023]
Abstract
The wide adoption of electronic health records (EHRs) offers immense potential as a source of support for clinical research. However, previous studies focused on extracting only a limited set of medical concepts to support information extraction in the cancer domain for the Spanish language. Building on the success of deep learning for processing natural language texts, this paper proposes a transformer-based approach to extract named entities from breast cancer clinical notes written in Spanish and compares several language models. To facilitate this approach, a schema for annotating clinical notes with breast cancer concepts is presented, and a corpus for breast cancer is developed. Results indicate that both BERT-based and RoBERTa-based language models demonstrate competitive performance in clinical Named Entity Recognition (NER). Specifically, BETO and multilingual BERT achieve F-scores of 93.71% and 94.63%, respectively. Additionally, RoBERTa Biomedical attains an F-score of 95.01%, while RoBERTa BNE achieves an F-score of 94.54%. The findings suggest that transformers can feasibly extract information in the clinical domain in the Spanish language, with the use of models trained on biomedical texts contributing to enhanced results. The proposed approach takes advantage of transfer learning techniques by fine-tuning language models to automatically represent text features and avoiding the time-consuming feature engineering process.
Collapse
Affiliation(s)
- Oswaldo Solarte-Pabón
- Centro de Tecnología Biomédica, Universidad Politécnica de Madrid, Madrid, Spain; Escuela de Ingeniería de Sistemas, Universidad del Valle, Cali, Colombia.
| | - Orlando Montenegro
- Escuela de Ingeniería de Sistemas, Universidad del Valle, Cali, Colombia
| | | | - Maria Torrente
- Hospital Universitario Puerta de Hierro de Madrid, Madrid, Spain
| | | | - Ernestina Menasalvas
- Centro de Tecnología Biomédica, Universidad Politécnica de Madrid, Madrid, Spain
| | - Víctor Robles
- Centro de Tecnología Biomédica, Universidad Politécnica de Madrid, Madrid, Spain
| |
Collapse
|
6
|
Mishra PK, Kaur P. Future-ready technologies for sensing the stemness of circulating tumor cells. Nanomedicine (Lond) 2023; 18:1327-1330. [PMID: 37585672 DOI: 10.2217/nnm-2023-0066] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/18/2023] Open
Affiliation(s)
- Pradyumna Kumar Mishra
- Division of Environmental Biotechnology, Genetics and Molecular Biology, ICMR-National Institute for Research in Environmental Health, Bhopal, 462030, India
| | - Prasan Kaur
- Division of Environmental Biotechnology, Genetics and Molecular Biology, ICMR-National Institute for Research in Environmental Health, Bhopal, 462030, India
| |
Collapse
|
7
|
Tricco AC, Hezam A, Parker A, Nincic V, Harris C, Fennelly O, Thomas SM, Ghassemi M, McGowan J, Paprica PA, Straus SE. Implemented machine learning tools to inform decision-making for patient care in hospital settings: a scoping review. BMJ Open 2023; 13:e065845. [PMID: 36750280 PMCID: PMC9906263 DOI: 10.1136/bmjopen-2022-065845] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2023] Open
Abstract
OBJECTIVES To identify ML tools in hospital settings and how they were implemented to inform decision-making for patient care through a scoping review. We investigated the following research questions: What ML interventions have been used to inform decision-making for patient care in hospital settings? What strategies have been used to implement these ML interventions? DESIGN A scoping review was undertaken. MEDLINE, Embase, Cochrane Central Register of Controlled Trials (CENTRAL) and the Cochrane Database of Systematic Reviews (CDSR) were searched from 2009 until June 2021. Two reviewers screened titles and abstracts, full-text articles, and charted data independently. Conflicts were resolved by another reviewer. Data were summarised descriptively using simple content analysis. SETTING Hospital setting. PARTICIPANT Any type of clinician caring for any type of patient. INTERVENTION Machine learning tools used by clinicians to inform decision-making for patient care, such as AI-based computerised decision support systems or "'model-based'" decision support systems. PRIMARY AND SECONDARY OUTCOME MEASURES Patient and study characteristics, as well as intervention characteristics including the type of machine learning tool, implementation strategies, target population. Equity issues were examined with PROGRESS-PLUS criteria. RESULTS After screening 17 386 citations and 3474 full-text articles, 20 unique studies and 1 companion report were included. The included articles totalled 82 656 patients and 915 clinicians. Seven studies reported gender and four studies reported PROGRESS-PLUS criteria (race, health insurance, rural/urban). Common implementation strategies for the tools were clinician reminders that integrated ML predictions (44.4%), facilitated relay of clinical information (17.8%) and staff education (15.6%). Common barriers to successful implementation of ML tools were time (11.1%) and reliability (11.1%), and common facilitators were time/efficiency (13.6%) and perceived usefulness (13.6%). CONCLUSIONS We found limited evidence related to the implementation of ML tools to assist clinicians with patient healthcare decisions in hospital settings. Future research should examine other approaches to integrating ML into hospital clinician decisions related to patient care, and report on PROGRESS-PLUS items. FUNDING Canadian Institutes of Health Research (CIHR) Foundation grant awarded to SES and the CIHR Strategy for Patient Oriented-Research Initiative (GSR-154442). SCOPING REVIEW REGISTRATION: https://osf.io/e2mna.
Collapse
Affiliation(s)
- Andrea C Tricco
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
- Epidemiology Division and Institute of Health Policy, Management and Evaluation, University of Toronto Dalla Lana School of Public Health, Toronto, Ontario, Canada
| | - Areej Hezam
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Amanda Parker
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Vera Nincic
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Charmalee Harris
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Orna Fennelly
- Irish Centre for High End Computing (ICHEC), National University of Ireland Galway, Galway, Ireland
| | - Sonia M Thomas
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Marco Ghassemi
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
| | - Jessie McGowan
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - P Alison Paprica
- Institute for Health Policy, Management and Evaluation, University of Toronto Dalla Lana School of Public Health, Toronto, Ontario, Canada
| | - Sharon E Straus
- Knowledge Translation Program, St Michael's Hospital Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada
- Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
8
|
Goh CL. Will digitization, big data and artificial intelligence- and deep learning-based algorithm govern the practice of medicine? J Eur Acad Dermatol Venereol 2022; 36:947. [PMID: 35712908 DOI: 10.1111/jdv.18223] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Accepted: 05/13/2022] [Indexed: 12/13/2022]
Affiliation(s)
- C L Goh
- National Skin Centre, Singapore City, Singapore
| |
Collapse
|