Automated data abstraction for quality surveillance and outcome assessment in radiation oncology

Perceptions on and roadblocks to implementation of standardized nomenclature in radiation oncology: A survey from TG-263U1

PURPOSE

AAPM Task Group No. 263U1 (Update to Report No. 263 - Standardizing Nomenclatures in Radiation Oncology) disseminated a survey to receive feedback on utilization, gaps, and means to facilitate further adoption.

METHODS

The survey was created by TG-263U1 members to solicit feedback from physicists, dosimetrists, and physicians working in radiation oncology. Questions on the adoption of the TG-263 standard were coupled with demographic information, such as clinical role, place of primary employment (e.g., private hospital, academic center), and size of institution. The survey was emailed to all AAPM, AAMD, and ASTRO members.

RESULTS

The survey received 463 responses with 310 completed survey responses used for analysis, of whom most had the clinical role of medical physicist (73%) and the majority were from the United States (83%). There were 83% of respondents who indicated that they believe that having a nomenclature standard is important or very important and 61% had adopted all or portions of TG-263 in their clinics. For those yet to adopt TG-263, the staffing and implementation efforts were the main cause for delaying adoption. Fewer respondents had trouble adopting TG-263 for organs at risk (29%) versus target (44%) nomenclature. Common themes in written feedback were lack of physician support and available resources, especially in vendor systems, to facilitate adoption.

CONCLUSIONS

While there is strong support and belief in the benefit of standardized nomenclature, the widespread adoption of TG-263 has been hindered by the effort needed by staff for implementation.  Feedback from the survey is being utilized to drive the focus of the update efforts and create tools to facilitate easier adoption of TG-263.

Operational Ontology for Oncology (O3): A Professional Society-Based, Multistakeholder, Consensus-Driven Informatics Standard Supporting Clinical and Research Use of Real-World Data From Patients Treated for Cancer

PURPOSE

The ongoing lack of data standardization severely undermines the potential for automated learning from the vast amount of information routinely archived in electronic health records (EHRs), radiation oncology information systems, treatment planning systems, and other cancer care and outcomes databases. We sought to create a standardized ontology for clinical data, social determinants of health, and other radiation oncology concepts and interrelationships.

METHODS AND MATERIALS

The American Association of Physicists in Medicine's Big Data Science Committee was initiated in July 2019 to explore common ground from the stakeholders' collective experience of issues that typically compromise the formation of large inter- and intra-institutional databases from EHRs. The Big Data Science Committee adopted an iterative, cyclical approach to engaging stakeholders beyond its membership to optimize the integration of diverse perspectives from the community.

RESULTS

We developed the Operational Ontology for Oncology (O3), which identified 42 key elements, 359 attributes, 144 value sets, and 155 relationships ranked in relative importance of clinical significance, likelihood of availability in EHRs, and the ability to modify routine clinical processes to permit aggregation. Recommendations are provided for best use and development of the O3 to 4 constituencies: device manufacturers, centers of clinical care, researchers, and professional societies.

CONCLUSIONS

O3 is designed to extend and interoperate with existing global infrastructure and data science standards. The implementation of these recommendations will lower the barriers for aggregation of information that could be used to create large, representative, findable, accessible, interoperable, and reusable data sets to support the scientific objectives of grant programs. The construction of comprehensive "real-world" data sets and application of advanced analytical techniques, including artificial intelligence, holds the potential to revolutionize patient management and improve outcomes by leveraging increased access to information derived from larger, more representative data sets.

Infrastructure tools to support an effective Radiation Oncology Learning Health System

PURPOSE

Radiation Oncology Learning Health System (RO-LHS) is a promising approach to improve the quality of care by integrating clinical, dosimetry, treatment delivery, research data in real-time. This paper describes a novel set of tools to support the development of a RO-LHS and the current challenges they can address.

METHODS

We present a knowledge graph-based approach to map radiotherapy data from clinical databases to an ontology-based data repository using FAIR concepts. This strategy ensures that the data are easily discoverable, accessible, and can be used by other clinical decision support systems. It allows for visualization, presentation, and data analyses of valuable information to identify trends and patterns in patient outcomes. We designed a search engine that utilizes ontology-based keyword searching, synonym-based term matching that leverages the hierarchical nature of ontologies to retrieve patient records based on parent and children classes, connects to the Bioportal database for relevant clinical attributes retrieval. To identify similar patients, a method involving text corpus creation and vector embedding models (Word2Vec, Doc2Vec, GloVe, and FastText) are employed, using cosine similarity and distance metrics.

RESULTS

The data pipeline and tool were tested with 1660 patient clinical and dosimetry records resulting in 504 180 RDF (Resource Description Framework) tuples and visualized data relationships using graph-based representations. Patient similarity analysis using embedding models showed that the Word2Vec model had the highest mean cosine similarity, while the GloVe model exhibited more compact embeddings with lower Euclidean and Manhattan distances.

CONCLUSIONS

The framework and tools described support the development of a RO-LHS. By integrating diverse data sources and facilitating data discovery and analysis, they contribute to continuous learning and improvement in patient care. The tools enhance the quality of care by enabling the identification of cohorts, clinical decision support, and the development of clinical studies and machine learning programs in radiation oncology.

Consensus Quality Measures and Dose Constraints for Lung Cancer From the Veterans Affairs Radiation Oncology Quality Surveillance Program and ASTRO Expert Panel

PURPOSE

For patients with lung cancer, it is critical to provide evidence-based radiation therapy to ensure high-quality care. The US Department of Veterans Affairs (VA) National Radiation Oncology Program partnered with the American Society for Radiation Oncology (ASTRO) as part of the VA Radiation Oncology Quality Surveillance to develop lung cancer quality metrics and assess quality of care as a pilot program in 2016. This article presents recently updated consensus quality measures and dose-volume histogram (DVH) constraints.

METHODS AND MATERIALS

A series of measures and performance standards were reviewed and developed by a Blue-Ribbon Panel of lung cancer experts in conjunction with ASTRO in 2022. As part of this initiative, quality, surveillance, and aspirational metrics were developed for (1) initial consultation and workup; (2) simulation, treatment planning, and treatment delivery; and (3) follow-up. The DVH metrics for target and organ-at-risk treatment planning dose constraints were also reviewed and defined.

RESULTS

Altogether, a total of 19 lung cancer quality metrics were developed. There were 121 DVH constraints developed for various fractionation regimens, including ultrahypofractionated (1, 3, 4, or 5 fractions), hypofractionated (10 and 15 fractionations), and conventional fractionation (30-35 fractions).

CONCLUSIONS

The devised measures will be implemented for quality surveillance for veterans both inside and outside of the VA system and will provide a resource for lung cancer-specific quality metrics. The recommended DVH constraints serve as a unique, comprehensive resource for evidence- and expert consensus-based constraints across multiple fractionation schemas.

A Survey on Recent Named Entity Recognition and Relationship Extraction Techniques on Clinical Texts

Significant growth in Electronic Health Records (EHR) over the last decade has provided an abundance of clinical text that is mostly unstructured and untapped. This huge amount of clinical text data has motivated the development of new information extraction and text mining techniques. Named Entity Recognition (NER) and Relationship Extraction (RE) are key components of information extraction tasks in the clinical domain. In this paper, we highlight the present status of clinical NER and RE techniques in detail by discussing the existing proposed NLP models for the two tasks and their performances and discuss the current challenges. Our comprehensive survey on clinical NER and RE encompass current challenges, state-of-the-art practices, and future directions in information extraction from clinical text. This is the first attempt to discuss both of these interrelated topics together in the clinical context. We identified many research articles published based on different approaches and looked at applications of these tasks. We also discuss the evaluation metrics that are used in the literature to measure the effectiveness of the two these NLP methods and future research directions.