1
|
Bryant AK, Zamora‐Resendiz R, Dai X, Morrow D, Lin Y, Jungles KM, Rae JM, Tate A, Pearson AN, Jiang R, Fritsche L, Lawrence TS, Zou W, Schipper M, Ramnath N, Yoo S, Crivelli S, Green MD. Artificial intelligence to unlock real-world evidence in clinical oncology: A primer on recent advances. Cancer Med 2024; 13:e7253. [PMID: 38899720 PMCID: PMC11187737 DOI: 10.1002/cam4.7253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 02/05/2024] [Accepted: 04/28/2024] [Indexed: 06/21/2024] Open
Abstract
PURPOSE Real world evidence is crucial to understanding the diffusion of new oncologic therapies, monitoring cancer outcomes, and detecting unexpected toxicities. In practice, real world evidence is challenging to collect rapidly and comprehensively, often requiring expensive and time-consuming manual case-finding and annotation of clinical text. In this Review, we summarise recent developments in the use of artificial intelligence to collect and analyze real world evidence in oncology. METHODS We performed a narrative review of the major current trends and recent literature in artificial intelligence applications in oncology. RESULTS Artificial intelligence (AI) approaches are increasingly used to efficiently phenotype patients and tumors at large scale. These tools also may provide novel biological insights and improve risk prediction through multimodal integration of radiographic, pathological, and genomic datasets. Custom language processing pipelines and large language models hold great promise for clinical prediction and phenotyping. CONCLUSIONS Despite rapid advances, continued progress in computation, generalizability, interpretability, and reliability as well as prospective validation are needed to integrate AI approaches into routine clinical care and real-time monitoring of novel therapies.
Collapse
Affiliation(s)
- Alex K. Bryant
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Department of Radiation Oncology, Veterans Affairs Ann Arbor Healthcare SystemAnn ArborMichiganUSA
| | - Rafael Zamora‐Resendiz
- Applied Mathematics and Computational Research Division, Lawrence Berkeley National LaboratoryBerkeleyCaliforniaUSA
| | - Xin Dai
- Computational Science Initiative, Brookhaven National LaboratoryUptonNew YorkUSA
| | - Destinee Morrow
- Applied Mathematics and Computational Research Division, Lawrence Berkeley National LaboratoryBerkeleyCaliforniaUSA
| | - Yuewei Lin
- Computational Science Initiative, Brookhaven National LaboratoryUptonNew YorkUSA
| | - Kassidy M. Jungles
- Department of PharmacologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - James M. Rae
- Department of PharmacologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Department of Internal MedicineUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - Akshay Tate
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - Ashley N. Pearson
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - Ralph Jiang
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Department of StatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Lars Fritsche
- Department of StatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Theodore S. Lawrence
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - Weiping Zou
- Department of StatisticsUniversity of MichiganAnn ArborMichiganUSA
- Center of Excellence for Cancer Immunology and ImmunotherapyUniversity of Michigan Rogel Cancer CenterAnn ArborMichiganUSA
- Department of PathologyUniversity of MichiganAnn ArborMichiganUSA
- Graduate Program in ImmunologyUniversity of MichiganAnn ArborMichiganUSA
| | - Matthew Schipper
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Department of PharmacologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| | - Nithya Ramnath
- Division of Hematology Oncology, Department of MedicineUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Division of Hematology Oncology, Department of MedicineVeterans Affairs Ann Arbor Healthcare SystemAnn ArborMichiganUSA
| | - Shinjae Yoo
- Computational Science Initiative, Brookhaven National LaboratoryUptonNew YorkUSA
| | - Silvia Crivelli
- Applied Mathematics and Computational Research Division, Lawrence Berkeley National LaboratoryBerkeleyCaliforniaUSA
| | - Michael D. Green
- Department of Radiation OncologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
- Department of Radiation Oncology, Veterans Affairs Ann Arbor Healthcare SystemAnn ArborMichiganUSA
- Graduate Program in ImmunologyUniversity of MichiganAnn ArborMichiganUSA
- Graduate Program in Cancer BiologyUniversity of MichiganAnn ArborMichiganUSA
- Department of Microbiology and ImmunologyUniversity of Michigan School of MedicineAnn ArborMichiganUSA
| |
Collapse
|
2
|
Kalankesh LR, Monaghesh E. Utilization of EHRs for clinical trials: a systematic review. BMC Med Res Methodol 2024; 24:70. [PMID: 38494497 PMCID: PMC10946197 DOI: 10.1186/s12874-024-02177-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Accepted: 02/08/2024] [Indexed: 03/19/2024] Open
Abstract
BACKGROUND AND OBJECTIVE Clinical trials are of high importance for medical progress. This study conducted a systematic review to identify the applications of EHRs in supporting and enhancing clinical trials. MATERIALS AND METHODS A systematic search of PubMed was conducted on 12/3/2023 to identify relevant studies on the use of EHRs in clinical trials. Studies were included if they (1) were full-text journal articles, (2) were written in English, (3) examined applications of EHR data to support clinical trial processes (e.g. recruitment, screening, data collection). A standardized form was used by two reviewers to extract data on: study design, EHR-enabled process(es), related outcomes, and limitations. RESULTS Following full-text review, 19 studies met the predefined eligibility criteria and were included. Overall, included studies consistently demonstrated that EHR data integration improves clinical trial feasibility and efficiency in recruitment, screening, data collection, and trial design. CONCLUSIONS According to the results of the present study, the use of Electronic Health Records in conducting clinical trials is very helpful. Therefore, it is better for researchers to use EHR in their studies for easy access to more accurate and comprehensive data. EHRs collects all individual data, including demographic, clinical, diagnostic, and therapeutic data. Moreover, all data is available seamlessly in EHR. In future studies, it is better to consider the cost-effectiveness of using EHR in clinical trials.
Collapse
Affiliation(s)
- Leila R Kalankesh
- Tabriz Health Services Management Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
- Department of Health Information Technology, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Elham Monaghesh
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran.
- Department of Health Information Technology, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran.
| |
Collapse
|
3
|
van Leeuwen JR, Penne EL, Rabelink T, Knevel R, Teng YKO. Using an artificial intelligence tool incorporating natural language processing to identify patients with a diagnosis of ANCA-associated vasculitis in electronic health records. Comput Biol Med 2024; 168:107757. [PMID: 38039893 DOI: 10.1016/j.compbiomed.2023.107757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 11/14/2023] [Accepted: 11/21/2023] [Indexed: 12/03/2023]
Abstract
BACKGROUND Because anti-neutrophil cytoplasmatic antibody (ANCA)-associated vasculitis (AAV) is a rare, life-threatening, auto-immune disease, conducting research is difficult but essential. A long-lasting challenge is to identify rare AAV patients within the electronic-health-record (EHR)-system to facilitate real-world research. Artificial intelligence (AI)-search tools using natural language processing (NLP) for text-mining are increasingly postulated as a solution. METHODS We employed an AI-tool that combined text-mining with NLP-based exclusion, to accurately identify rare AAV patients within large EHR-systems (>2.000.000 records). We developed an identification method in an academic center with an established AAV-training set (n = 203) and validated the method in a non-academic center with an AAV-validation set (n = 84). To assess accuracy anonymized patient records were manually reviewed. RESULTS Based on an iterative process, a text-mining search was developed on disease description, laboratory measurements, medication and specialisms. In the training center, 608 patients were identified with a sensitivity of 97.0 % (95%CI [93.7, 98.9]) and positive predictive value (PPV) of 56.9 % (95%CI [52.9, 60.1]). NLP-based exclusion resulted in 444 patients increasing PPV to 77.9 % (95%CI [73.7, 81.7]) while sensitivity remained 96.3 % (95%CI [93.8, 98.0]). In the validation center, text-mining identified 333 patients (sensitivity 97.6 % (95%CI [91.6, 99.7]), PPV 58.2 % (95%CI [52.8, 63.6])) and NLP-based exclusion resulted in 223 patients, increasing PPV to 86.1 % (95%CI [80.9, 90.4]) with 98.0 % (95%CI [94.9, 99.4]) sensitivity. Our identification method outperformed ICD-10-coding predominantly in identifying MPO+ and organ-limited AAV patients. CONCLUSIONS Our study highlights the advantages of implementing AI, notably NLP, to accurately identify rare AAV patients within large EHR-systems and demonstrates the applicability and transportability. Therefore, this method can reduce efforts to identify AAV patients and accelerate real-world research, while avoiding bias by ICD-10-coding.
Collapse
Affiliation(s)
- Jolijn R van Leeuwen
- Center of Expertise for Lupus-, Vasculitis- and Complement-mediated Systemic diseases (LuVaCs), Department of Internal Medicine - Nephrology Section, Leiden University Medical Center, Leiden, the Netherlands
| | - Erik L Penne
- Department of Internal Medicine - Nephrology Section, Northwest Clinics, Alkmaar, the Netherlands
| | - Ton Rabelink
- Center of Expertise for Lupus-, Vasculitis- and Complement-mediated Systemic diseases (LuVaCs), Department of Internal Medicine - Nephrology Section, Leiden University Medical Center, Leiden, the Netherlands
| | - Rachel Knevel
- Department of Rheumatology, Leiden University Medical Center, Leiden, the Netherlands
| | - Y K Onno Teng
- Center of Expertise for Lupus-, Vasculitis- and Complement-mediated Systemic diseases (LuVaCs), Department of Internal Medicine - Nephrology Section, Leiden University Medical Center, Leiden, the Netherlands.
| |
Collapse
|
4
|
Lyu HG, Kantor O, Laws AD, McDonald J, Pham L, Dominici LS, Vincuilla J, Raut CP, Danilchuk B, Novak L, Parker T, King TA, Mittendorf EA. Development of an Electronic Health Record Registry to Facilitate Collection of Commission on Cancer Metrics for Patients Undergoing Surgery for Breast Cancer. JCO Clin Cancer Inform 2022; 6:e2200012. [DOI: 10.1200/cci.22.00012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
PURPOSE Accurate and efficient data collection is a challenge for quality improvement initiatives and clinical research. We describe the development of a custom electronic health record (EHR)–based registry to automatically extract structured Commission on Cancer axillary surgery-specific metrics from a custom synoptic note template included in the operative reports for patients with breast cancer undergoing surgery. METHODS The smart functionality of our enterprise-based EHR system was leveraged to create a custom smart phrase to capture axillary surgery-specific variables. A multidisciplinary team developed structured data elements correlating to each axillary surgery-specific variable. These data elements were then included in a note template for the operative report. Each variable could be aggregated and converted into a single flat database through the EHR's reporting workbench and serve as a live, prospective registry for all users within the EHR. RESULTS The final axillary surgery-specific note template in a synoptic format allowed for efficient and easy entry and automatic collection of breast cancer–specific metrics. From initial adoption in February 2021-December 2021, there were 1,254 patients who underwent breast surgery with axillary surgery. The operative notes allowed for automatic capture of metrics from 60.5% (n = 759) of patients. Data capture improved from 37.6% in the initial adoption period of 6 months to 86.2% in the last 5 months. CONCLUSION We were able to demonstrate successful implementation of provider-driven structured data entry into EHR systems that permits automatic data capture. The end result is a custom synoptic note template and a real-time, prospective registry of breast cancer–specific Commission on Cancer metrics that are robust enough to use for quality improvement initiatives and clinical research.
Collapse
Affiliation(s)
- Heather G. Lyu
- Department of Surgical Oncology, MD Anderson Cancer Center, Houston, TX
| | - Olga Kantor
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Alison D. Laws
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | | | - Lisa Pham
- Mass General Brigham, Somerville, MA
| | - Laura S. Dominici
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Julie Vincuilla
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Chandrajit P. Raut
- Division of Surgical Oncology, Brigham and Women's Hospital, Boston, MA
- Sarcoma Center, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Bryan Danilchuk
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Lara Novak
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Tonia Parker
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Tari A. King
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| | - Elizabeth A. Mittendorf
- Division of Breast Surgery, Brigham and Women's Hospital, Boston, MA
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA
| |
Collapse
|
5
|
Haynes RM, Sirintrapun SJ, Gao J, McKenzie AJ. Using Technology to Enhance Cancer Clinical Trial Participation. Am Soc Clin Oncol Educ Book 2022; 42:1-7. [PMID: 35486887 DOI: 10.1200/edbk_349671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
The COVID-19 pandemic presented many challenges to health care systems, including oncology clinical research programs. There were substantial negative effects on oncology clinical trial screening, enrollment, and study activities that forced institutions and regulatory bodies to develop innovative solutions to maintain robust and equitable participation in these trials. Digital pathology innovations at Memorial Sloan Kettering Cancer Center have streamlined the diagnostic life cycle for patients with cancer, and the seamless integration of digital pathology services with next-generation sequencing and other molecular pathology services have accelerated the time to diagnosis and receipt of molecular results. Timely access to these results, coupled with Memorial Sloan Kettering Cancer Center's knowledge engine OncoKB, enhances patient clinical trial coordination precisely and efficiently. At the Sarah Cannon Research Institute, centralized remote clinical trial matching and screening, virtual molecular tumor boards, and centralized molecular interpretation support services have empowered clinic staff to identify more efficiently potential participants in clinical research, despite the COVID-19 pandemic. In addition, the U.S. Food and Drug Administration Oncology Center of Excellence has been involved in several efforts to address challenges for patients with cancer during the COVID-19 pandemic, including writing guidance documents and participating in efforts to modernize clinical trials. The enclosed personal experience of a patient with cancer currently participating in an oncology clinical trial emphasizes the need for continued decreasing of barriers to study participation. Clinical trial advances that were accelerated by the pandemic will ultimately help patients with cancer and the greater oncology health care community.
Collapse
Affiliation(s)
- Rudene Mercer Haynes
- Breast cancer survivor, clinical trial participant, and partner at Hunton Andrews Kurth LLP, Richmond, VA
| | | | - Jennifer Gao
- U.S. Food and Drug Administration, Oncology Center of Excellence, Silver Springs, MD
| | | |
Collapse
|