Concordance Rate between Clinicians and Watson for Oncology among Patients with Advanced Gastric Cancer: Early, Real-World Experience in Korea

GC-CDSS: Personalized gastric cancer treatment recommendations system based on knowledge graph

BACKGROUND

Gastric cancer (GC) is one of the most common malignant tumors in the world, posing a serious threat to human health. Currently, gastric cancer treatment strategies emphasize a multidisciplinary team (MDT) consultation approach. However, there are numerous treatment guidelines and insights from clinical trials. The application of AI-based Clinical Decision Support System (CDSS) in tumor diagnosis and screening is increasing rapidly.

OBJECTIVE

The purpose of this study is to (1) summarize the treatment decision process for GC according to the treatment guidelines in China, and then create a knowledge graph (KG) for GC, (2) based on aforementioned KG, built a CDSS and conducted an initial feasibility evaluation for the current system.

METHODS

Firstly, we summarized the decision-making process for treatment of GC. Then, we extracted relevant decision nodes and relationships and utilized Neo4j to create the KG. After obtaining the initial node features for building the graph embedding model, graph embedding algorithm, such as Node2Vec and GraphSAGE, were used to construct the GC-CDSS. At last, a retrospective cohort study was used to compare the consistency between GC-CDSS and MDT in treatment decision making.

RESULTS

In current study, we introduce a GC-CDSS, which is constructed based on Chinese GC treatment guidelines knowledge graph (KG). In the KG, we define four types of nodes and four types of relationships, and it comprise a total of 207 nodes and 300 relationships. Regarding GC-CDSS, the system is capable of providing dynamic and personalized diagnostic and treatment recommendations based on the patient's condition. Furthermore, a retrospective cohort study is conducted to compare GC-CDSS recommendations with those of the MDT group, the overall consistency rate of treatment recommendations between the auxiliary decision system and MDT team is 92.96%.

CONCLUSIONS

We construct a GC treatment support system, GC-CDSS, based on KG. The GC-CDSS may help oncologists make treatment decisions more efficient and promote standardization in primary healthcare settings.

Digital decision support for structural improvement of melanoma tumor boards: using standard cases to optimize workflow

PURPOSE

Choosing optimal cancer treatment is challenging, and certified cancer centers must present all patients in multidisciplinary tumor boards (MDT). Our aim was to develop a decision support system (DSS) to provide treatment recommendations for apparently simple cases already at conference registration and to classify these as "standard cases". According to certification requirements, discussion of standard cases is optional and would thus allow more time for complex cases.

METHODS

We created a smartphone query that simulated a tumor conference registration and requested all information needed to provide a recommendation. In total, 111 out of 705 malignant melanoma cases discussed at a skin cancer center from 2017 to 2020 were identified as potential standard cases, for which a digital twin recommendation was then generated by DSS.

RESULTS

The system provided reliable advice in all 111 cases and showed 97% concordance of MDT and DSS for therapeutic recommendations, regardless of tumor stage. Discrepancies included two cases (2%) where DSS advised discussions at MDT and one case (1%) with deviating recommendation due to advanced patient age.

CONCLUSIONS

Our work aimed not to replace clinical expertise but to alleviate MDT workload and enhance focus on complex cases. Overall, our DSS proved to be a suitable tool for identifying standard cases as such, providing correct treatment recommendations, and thus reducing the time burden of tumor conferences in favor for the comprehensive discussion of complex cases. The aim is to implement the DSS in routine tumor board software for further qualitative assessment of its impact on oncological care.

Clinical decision support systems for multidisciplinary team decision-making in patients with solid cancer: Composition of an implementation model based on a scoping review

Generating guideline-based recommendations during multidisciplinary team (MDT) meetings in solid cancers is getting more complex due to increasing amount of information needed to follow the guidelines. Usage of clinical decision support systems (CDSSs) can simplify and optimize decision-making. However, CDSS implementation is lagging behind. Therefore, we aim to compose a CDSS implementation model. By performing a scoping review of the currently reported CDSSs for MDT decision-making we determined 102 barriers and 86 facilitators for CDSS implementation out of 44 papers describing 20 different CDSSs. The most frequently reported barriers and facilitators for CDSS implementation supporting MDT decision-making concerned CDSS maintenance (e.g. incorporating guideline updates), validity of recommendations and interoperability with electronic health records. Based on the identified barriers and facilitators, we composed a CDSS implementation model describing clinical utility, analytic validity and clinical validity to guide CDSS integration more successfully in the clinical workflow to support MDTs in the future.

Use and accuracy of decision support systems using artificial intelligence for tumor diseases: a systematic review and meta-analysis

Background

For therapy planning in cancer patients multidisciplinary team meetings (MDM) are mandatory. Due to the high number of cases being discussed and significant workload of clinicians, Clinical Decision Support System (CDSS) may improve the clinical workflow.

Methods

This review and meta-analysis aims to provide an overview of the systems utilized and evaluate the correlation between a CDSS and MDM.

Results

A total of 31 studies were identified for final analysis. Analysis of different cancers shows a concordance rate (CR) of 72.7% for stage I-II and 73.4% for III-IV. For breast carcinoma, CR for stage I-II was 72.8% and for III-IV 84.1%, P≤ 0.00001. CR for colorectal carcinoma is 63% for stage I-II and 67% for III-IV, for gastric carcinoma 55% and 45%, and for lung carcinoma 85% and 83% respectively, all P>0.05. Analysis of SCLC and NSCLC yields a CR of 94,3% and 82,7%, P=0.004 and for adenocarcinoma and squamous cell carcinoma in lung cancer a CR of 90% and 86%, P=0.02.

Conclusion

CDSS has already been implemented in clinical practice, and while the findings suggest that its use is feasible for some cancers, further research is needed to fully evaluate its effectiveness.

Watson for oncology decision system for treatment consistency study in breast cancer

The Watson for Oncology (WFO) decision system has been rolled out in many cancers. However, the consistency of treatment for breast cancer is still unclear in relatively economically disadvantaged areas. Patients with postoperative adjuvant stage (January 2017 to December 2017) and advanced-stage breast cancer (January 2014 to December 2018) in northwest of China were included in this study. Patient information was imported to make treatment decisions using Watson version 19.20 analysis and subsequently compared with clinician decisions and analyzed for influencing factors. A total of 263 patients with postoperative adjuvant breast cancer and 200 with advanced breast cancer were included in this study. The overall treatment modality for WFO was in 80.2% and 50.5% agreement with clinicians in the adjuvant and advanced-stage population, respectively. In adjuvant treatment after breast cancer surgery, menopausal status (odds ratio (OR) = 2.89, P = 0.012, 95% CI, 1.260-6.630), histological grade (OR = 0.22, P = 0.019, 95% CI, 0.061-0.781) and tumor stage (OR = 0.22, P = 0.042, 95% CI, 0.050-0.943) were independent factors affecting the concordance between the two stages. In the first-line treatment of advanced breast cancer, hormone receptor status was a factor influencing the consistency of treatment (χ2 = 14.728, P < 0.001). There was good agreement between the WFOs and clinicians' treatment decisions in postoperative adjuvant breast cancer, but poor agreement was observed in patients with advanced breast cancer.

Identifying cancer-associated leukocyte profiles using high-resolution flow cytometry screening and machine learning

Background

Machine learning (ML) is a valuable tool with the potential to aid clinical decision making. Adoption of ML to this end requires data that reliably correlates with the clinical outcome of interest; the advantage of ML is that it can model these correlations from complex multiparameter data sets that can be difficult to interpret conventionally. While currently available clinical data can be used in ML for this purpose, there exists the potential to discover new "biomarkers" that will enhance the effectiveness of ML in clinical decision making. Since the interaction of the immune system and cancer is a hallmark of tumor establishment and progression, one potential area for cancer biomarker discovery is through the investigation of cancer-related immune cell signatures. Hence, we hypothesize that blood immune cell signatures can act as a biomarker for cancer progression.

Methods

To probe this, we have developed and tested a multiparameter cell-surface marker screening pipeline, using flow cytometry to obtain high-resolution systemic leukocyte population profiles that correlate with detection and characterization of several cancers in murine syngeneic tumor models.

Results

We discovered a signature of several blood leukocyte subsets, the most notable of which were monocyte subsets, that could be used to train CATboost ML models to predict the presence and type of cancer present in the animals.

Conclusions

Our findings highlight the potential utility of a screening approach to identify robust leukocyte biomarkers for cancer detection and characterization. This pipeline can easily be adapted to screen for cancer specific leukocyte markers from the blood of cancer patient.

Artificial intelligence in clinical decision support systems for oncology

Artificial intelligence (AI) has been widely used in various medical fields, such as image diagnosis, pathological classification, selection of treatment schemes, and prognosis analysis. Especially in the image-aided diagnosis of tumors, the cooperation of human-computer interactions has become mature. However, the ethics of the application of AI as an emerging technology in clinical decision-making have not been fully supported, so the clinical decision support system (CDSS) based on AI technology has not fully realized human-computer interactions in clinical practice as the image-aided diagnosis system. The CDSS was currently used and promoted worldwide including Watson for Oncology, Chinese society of clinical oncology-artificial intelligence (CSCO AI) and so on. This paper summarized the applications and clarified the principle of AI in CDSS, analyzed the difficulties of AI in oncology decisions, and provided a reference scheme for the application of AI in oncology decisions in the future.

Evaluation of Prognostic and Predictive Models in the Oncology Clinic

Predictive and prognostic models hold great potential to support clinical decision making in oncology and could ultimately facilitate a paradigm shift to a more personalised form of treatment. While a large number of models relevant to the field of oncology have been developed, few have been translated into clinical use and assessment of clinical utility is not currently considered a routine part of model development. In this narrative review of the clinical evaluation of prediction models in oncology, we propose a high-level process diagram for the life cycle of a clinical model, encompassing model commissioning, clinical implementation and ongoing quality assurance, which aims to bridge the gap between model development and clinical implementation.

Clinical Natural Language Processing for Radiation Oncology: A Review and Practical Primer

Natural language processing (NLP), which aims to convert human language into expressions that can be analyzed by computers, is one of the most rapidly developing and widely used technologies in the field of artificial intelligence. Natural language processing algorithms convert unstructured free text data into structured data that can be extracted and analyzed at scale. In medicine, this unlocking of the rich, expressive data within clinical free text in electronic medical records will help untap the full potential of big data for research and clinical purposes. Recent major NLP algorithmic advances have significantly improved the performance of these algorithms, leading to a surge in academic and industry interest in developing tools to automate information extraction and phenotyping from clinical texts. Thus, these technologies are poised to transform medical research and alter clinical practices in the future. Radiation oncology stands to benefit from NLP algorithms if they are appropriately developed and deployed, as they may enable advances such as automated inclusion of radiation therapy details into cancer registries, discovery of novel insights about cancer care, and improved patient data curation and presentation at the point of care. However, challenges remain before the full value of NLP is realized, such as the plethora of jargon specific to radiation oncology, nonstandard nomenclature, a lack of publicly available labeled data for model development, and interoperability limitations between radiation oncology data silos. Successful development and implementation of high quality and high value NLP models for radiation oncology will require close collaboration between computer scientists and the radiation oncology community. Here, we present a primer on artificial intelligence algorithms in general and NLP algorithms in particular; provide guidance on how to assess the performance of such algorithms; review prior research on NLP algorithms for oncology; and describe future avenues for NLP in radiation oncology research and clinics.

Physician Perception and Satisfaction with Artificial Intelligence in Cancer Treatment: The Watson for Oncology Experience and Implications for Low-Middle Income Countries (Preprint)

As technology continues to improve, health care systems have the opportunity to use a variety of innovative tools for decision-making, including artificial intelligence (AI) applications. However, there has been little research on the feasibility and efficacy of integrating AI systems into real-world clinical practice, especially from the perspectives of clinicians who use such tools. In this paper, we review physicians’ perceptions of and satisfaction with an AI tool, Watson for Oncology, which is used for the treatment of cancer. Watson for Oncology has been implemented in several different settings, including Brazil, China, India, South Korea, and Mexico. By focusing on the implementation of an AI-based clinical decision support system for oncology, we aim to demonstrate how AI can be both beneficial and challenging for cancer management globally and particularly for low-middle–income countries. By doing so, we hope to highlight the need for additional research on user experience and the unique social, cultural, and political barriers to the successful implementation of AI in low-middle–income countries for cancer care.

Can artificial intelligence overtake human intelligence on the bumpy road towards glioma therapy?

Gliomas are one of the most devastating primary brain tumors which impose significant management challenges to the clinicians. The aggressive behaviour of gliomas is mainly attributed to their rapid proliferation, unravelled genomics and the blood-brain barrier which protects the tumor cells from chemotherapeutic regimens. Suspects of brain tumors are usually assessed by magnetic resonance imaging and computed tomography. These images allow surgeons to decide on the tumor grading, intra-operative pathology, feasibility of surgery, and treatment planning. All these data are compiled manually by physicians, wherein it takes time for the validation of results and concluding the treatment modality. In this context, the arrival of artificial intelligence in this era of personalized medicine, has proven promising performance in the diagnosis and management of gliomas. Starting from grading prediction till outcome evaluation, artificial intelligence-based forefronts have revolutionized oncological research. Interestingly, this approach has also been able to precisely differentiate tumor lesion from healthy tissues. However, till date, their utility in neuro-oncological field remains limited due to the issues pertaining to their reliability and transparency. Hence, to shed novel insights on the "clinical utility of this novel approach on glioma management" and to reveal "the black-boxes that have to be solved for fruitful application of artificial intelligence in neuro-oncology research", we provide in this review, a succinct description of the potential gear of artificial intelligence-based avenues in glioma treatment and the barriers that impede their rapid implementation in neuro-oncology.

Who is afraid of black box algorithms? On the epistemological and ethical basis of trust in medical AI

The use of black box algorithms in medicine has raised scholarly concerns due to their opaqueness and lack of trustworthiness. Concerns about potential bias, accountability and responsibility, patient autonomy and compromised trust transpire with black box algorithms. These worries connect epistemic concerns with normative issues. In this paper, we outline that black box algorithms are less problematic for epistemic reasons than many scholars seem to believe. By outlining that more transparency in algorithms is not always necessary, and by explaining that computational processes are indeed methodologically opaque to humans, we argue that the reliability of algorithms provides reasons for trusting the outcomes of medical artificial intelligence (AI). To this end, we explain how computational reliabilism, which does not require transparency and supports the reliability of algorithms, justifies the belief that results of medical AI are to be trusted. We also argue that several ethical concerns remain with black box algorithms, even when the results are trustworthy. Having justified knowledge from reliable indicators is, therefore, necessary but not sufficient for normatively justifying physicians to act. This means that deliberation about the results of reliable algorithms is required to find out what is a desirable action. Thus understood, we argue that such challenges should not dismiss the use of black box algorithms altogether but should inform the way in which these algorithms are designed and implemented. When physicians are trained to acquire the necessary skills and expertise, and collaborate with medical informatics and data scientists, black box algorithms can contribute to improving medical care.

A meta-analysis of Watson for Oncology in clinical application

Using the method of meta-analysis to systematically evaluate the consistency of treatment schemes between Watson for Oncology (WFO) and Multidisciplinary Team (MDT), and to provide references for the practical application of artificial intelligence clinical decision-support system in cancer treatment. We systematically searched articles about the clinical applications of Watson for Oncology in the databases and conducted meta-analysis using RevMan 5.3 software. A total of 9 studies were identified, including 2463 patients. When the MDT is consistent with WFO at the ‘Recommended’ or the ‘For consideration’ level, the overall concordance rate is 81.52%. Among them, breast cancer was the highest and gastric cancer was the lowest. The concordance rate in stage I–III cancer is higher than that in stage IV, but the result of lung cancer is opposite (P < 0.05).Similar results were obtained when MDT was only consistent with WFO at the "recommended" level. Moreover, the consistency of estrogen and progesterone receptor negative breast cancer patients, colorectal cancer patients under 70 years old or ECOG 0, and small cell lung cancer patients is higher than that of estrogen and progesterone positive breast cancer patients, colorectal cancer patients over 70 years old or ECOG 1–2, and non-small cell lung cancer patients, with statistical significance (P < 0.05). Treatment recommendations made by WFO and MDT were highly concordant for cancer cases examined, but this system still needs further improvement. Owing to relatively small sample size of the included studies, more well-designed, and large sample size studies are still needed.

Concordance Between Watson for Oncology and Multidisciplinary Teams in Colorectal Cancer: Prognostic Implications and Predicting Concordance

Background

Watson for Oncology (WFO) is a cognitive computing system that provides clinical decision support. This study examined the concordance between the treatment recommendations for colorectal cancer (CRC) proposed by WFO and those recommended by the multidisciplinary teams (MDTs), and evaluated the influence of concordance on the prognosis.

Methods

We retrospectively collected 175 patients with colorectal cancer who received treatment recommended by MDTs at a hospital in China, and evaluated them using WFO. Concordance between the two recommendations was analyzed. The overall survival was analyzed between concordant and non-concordant groups. Logistic regression analyses were performed and a concordance-predicting model was developed.

Results

Concordance between WFO’ and MDTs’ recommendations occurred in 66.9% (117/175) of cases. The overall survival (OS) was significantly better in concordant group and non-concordance was found to be an independent prognostic factor [hazard ratio (HR)=2.784 (95% CI 1.264–6.315)]. Logistic regression analyses determined that tumor type [odds ratio (OR)= 2.195 for left colon cancer and OR=2.502 for rectum cancer], and TNM stage (OR=0.545 for stage II, OR=0.187 for stage III, OR=0.127 for stage IV) were independently related with concordance, which were used to develop a concordance-predictive-nomogram.

Conclusions

Treatment recommendations for patients with colorectal cancer determined by WFO and MDTs were mostly concordant. However, the survival was better among concordant patients and non-concordance was found to be an independent prognostic factor. This study presents a nomogram that can be conveniently used for predicting individualized concordance. However, our findings should be prospectively validated in multi-center trials.

Artificial Intelligence in Hematology: Current Challenges and Opportunities

PURPOSE OF REVIEW

Artificial intelligence (AI), and in particular its subcategory machine learning, is finding an increasing number of applications in medicine, driven in large part by an abundance of data and powerful, accessible tools that have made AI accessible to a larger circle of investigators.

RECENT FINDINGS

AI has been employed in the analysis of hematopathological, radiographic, laboratory, genomic, pharmacological, and chemical data to better inform diagnosis, prognosis, treatment planning, and foundational knowledge related to benign and malignant hematology. As more widespread implementation of clinical AI nears, attention has also turned to the effects this will have on other areas in medicine. AI offers many promising tools to clinicians broadly, and specifically in the practice of hematology. Ongoing research into its various applications will likely result in an increasing utilization of AI by a broader swath of clinicians.

Clinical Decision Support for High-Risk Stage II Colon Cancer: A Real-World Study of Treatment Concordance and Survival

BACKGROUND

Prognostic and pathologic risk factors typically guide clinicians and patients in their choice of surveillance or adjuvant chemotherapy when managing high-risk stage II colon cancer. However, variations in treatment and outcomes in patients with stage II colon cancer remain.

OBJECTIVE

This study aimed to assess the survival benefits of treatments concordant with suggested therapeutic options from Watson for Oncology, a clinical decision support system.

DESIGN

This is a retrospective observational study of concordance between actual treatment and Watson for Oncology therapeutic options.

SETTING

This study was conducted at a top-tier cancer center in China.

PATIENTS

Postoperative treatment data were retrieved from the electronic health records of 306 patients with high-risk stage II colon adenocarcinoma.

MAIN OUTCOME MEASURES

The primary outcomes measured were the treatment patterns plus 3- and 5-year overall and disease-free survival for concordant and nonconcordant cases.

RESULTS

Overall concordance was 90%. Most nonconcordant care resulted from adjuvant chemotherapy use (rather than surveillance) in patients with high-level microsatellite instability and ≥70 years old. No difference in overall survival (p = 0.56) or disease-free survival (p = 0.19) was observed between concordance groups. Patients receiving adjuvant chemotherapy had significantly higher 5-year overall survival than those undergoing surveillance (94% vs 84%, p = 0.01).

LIMITATIONS

This study was limited by the use of retrospective cases drawn from patients presenting for surgery, the lack of complete follow-up data for 58% of patients who could not be included in the analysis, and a survival analysis that assumes no unmeasured correlation between survival and censoring.

CONCLUSIONS

Watson for Oncology produced therapeutic options highly concordant with human decisions at a top-tier cancer center in China. Treatment patterns suggest that Watson for Oncology may be able to guide clinicians to minimize overtreatment of patients with high-risk stage II colon cancer with chemotherapy. Survival analyses suggest the need for further investigation to specifically assess the association between surveillance, single-agent and multiagent chemotherapy, and survival outcomes in this population. See Video Abstract at http://links.lww.com/DCR/B291. APOYO A LA DECISIÓN CLÍNICA DEL CÁNCER DE COLON EN ESTADIO II DE ALTO RIESGO: UN ESTUDIO DEL MUNDO REAL SOBRE LA CONCORDANCIA DEL TRATAMIENTO Y LA SUPERVIVENCIA: Los factores de riesgo pronósticos y patológicos generalmente guían a los médicos y pacientes en su elección de vigilancia o quimioterapia adyuvante cuando se trata el cáncer de colon en estadio II de alto riesgo. Sin embargo, las variaciones en el tratamiento y los resultados en pacientes con cáncer de colon en estadio II permanecen.Evaluar los beneficios de supervivencia de los tratamientos concordantes con las opciones terapéuticas sugeridas por "Watson for Oncology" (Watson para la oncología), un sistema de apoyo a la decisión clínica.Estudio observacional retrospectivo de concordancia entre el tratamiento real y las opciones terapéuticas de Watson para oncología.Un centro oncológico de primer nivel en China.Datos de tratamiento postoperatorio de registros de salud electrónicos de 306 pacientes con adenocarcinoma de colon en estadio II de alto riesgo.Patrones de tratamiento más supervivencia global y libre de enfermedad a 3 y 5 años para casos concordantes y no concordantes.La concordancia general fue del 90%. La mayoría de la atención no concordante resultó del uso de quimioterapia adyuvante (en lugar de vigilancia) en pacientes de alto nivel con inestabilidad de microsatélites y pacientes ≥70 años. No se observaron diferencias en la supervivencia global (p = 0,56) o la supervivencia libre de enfermedad (p = 0,19) entre los grupos de concordancia. Los pacientes que recibieron quimioterapia adyuvante tuvieron una supervivencia global a los 5 años significativamente más alta que los que fueron sometidos a vigilancia (94% frente a 84%, p = 0,01).Uso de casos retrospectivos extraídos de pacientes que se presentan para cirugía, falta de datos de seguimiento completos para el 58% de los pacientes que no pudieron ser incluidos en el análisis, y análisis de supervivencia que asume que no exite una correlación no medida entre supervivencia y censura.Watson para Oncología produjo opciones terapéuticas altamente concordantes con las decisiones humanas en un centro oncológico de primer nivel en China. Los patrones de tratamiento sugieren que Watson para Oncología puede guiar a los médicos para minimizar el sobretratamiento de pacientes con cáncer de colon en estadio II de alto riesgo con quimioterapia. Los análisis de supervivencia sugieren la necesidad de realizar mas investigaciónes para evaluar específicamente la asociación entre la vigilancia, la quimioterapia con uno solo o múltiples agentes y los resultados de supervivencia en esta población. Consulte Video Resumen en http://links.lww.com/DCR/B291. (Traducción-Dr. Gonzalo Hagerman).

Artificial Intelligence-Driven Oncology Clinical Decision Support System for Multidisciplinary Teams

Watson for Oncology (WfO) is a clinical decision support system driven by artificial intelligence. In Korea, WfO is used by multidisciplinary teams (MDTs) caring for cancer patients. This study aimed to investigate the effect of WfO use on hospital satisfaction and perception among patients cared for by MDTs. This was a descriptive study that used a written survey to gather information from cancer patients at a hospital in Korea. The rate of positive change in patient perception after treatment was 86.8% in the MDT-WfO group and 71.2% in the MDT group. In terms of easily understandable explanations, the MDT-WfO (9.53 points) group reported higher satisfaction than the MDT group (9.24 points). Younger patients in the MDT-WfO group showed high levels of satisfaction and reliability of treatment. When WfO was used, the probability of positive change in patient perception of the hospital was 2.53 times higher than when WfO was not used. With a one-point increase in overall satisfaction, the probability of positive change in patient perception of the hospital increased 1.97 times. Therefore, if WfO is used appropriately in the medical field, it may enhance patient satisfaction and change patient perception positively.

Machine learning in haematological malignancies

Machine learning is a branch of computer science and statistics that generates predictive or descriptive models by learning from training data rather than by being rigidly programmed. It has attracted substantial attention for its many applications in medicine, both as a catalyst for research and as a means of improving clinical care across the cycle of diagnosis, prognosis, and treatment of disease. These applications include the management of haematological malignancy, in which machine learning has created inroads in pathology, radiology, genomics, and the analysis of electronic health record data. As computational power becomes cheaper and the tools for implementing machine learning become increasingly democratised, it is likely to become increasingly integrated into the research and practice landscape of haematology. As such, machine learning merits understanding and attention from researchers and clinicians alike. This narrative Review describes important concepts in machine learning for unfamiliar readers, details machine learning's current applications in haematological malignancy, and summarises important concepts for clinicians to be aware of when appraising research that uses machine learning.

Early experience with Watson for Oncology: a clinical decision-support system for prostate cancer treatment recommendations

PURPOSE

Urological oncologists have difficulty providing optimal personalized care due to rapid alterations in scientific research results, medical advancements, and treatment guidelines. IBM's Watson for Oncology (WFO) is an artificial intelligence clinical decision-support system that assists oncologists with evidence-based treatment recommendations. In the present study, we examined the level of concordance between the treatment recommendations for prostate cancer according to WFO and the actual treatments that the patients received in the department of urology.

METHODS

We enrolled 201 patients who received prostate cancer treatment between January 2018 and June 2018. WFO provided treatment recommendations using clinical data in three categories: recommended, for consideration, and not recommended. These were compared with the actual treatments received by patients. Prostate cancer treatments were considered concordant if the received treatments were included in the "recommended" or "for consideration" categories by WFO.

RESULTS

The patients' mean age was 71.2 years. There were 60 (29.9%) and 114 (56.7%) patients with an Eastern Cooperative Oncology Group (ECOG) performance score ≥ 1 and non-organ confined disease (stage III/IV), respectively. The overall prostate cancer treatment concordance rate was 73.6% ("recommended": 53.2%; "for consideration": 20.4%). An ECOG performance score ≥ 1 and older age (≥ 75 years) were significantly associated with discordance (p = 0.001 and p = 0.026, respectively) on multivariate analysis.

CONCLUSION

In the present study, the treatment recommendations by WFO and the actual received treatments in the department of urology showed a relatively high concordance rate in prostate cancer patients.

Concordance Between Watson for Oncology and a Multidisciplinary Clinical Decision-Making Team for Gastric Cancer and the Prognostic Implications: Retrospective Study

Background

With the increasing number of cancer treatments, the emergence of multidisciplinary teams (MDTs) provides patients with personalized treatment options. In recent years, artificial intelligence (AI) has developed rapidly in the medical field. There has been a gradual tendency to replace traditional diagnosis and treatment with AI. IBM Watson for Oncology (WFO) has been proven to be useful for decision-making in breast cancer and lung cancer, but to date, research on gastric cancer is limited.

Objective

This study compared the concordance of WFO with MDT and investigated the impact on patient prognosis.

Methods

This study retrospectively analyzed eligible patients (N=235) with gastric cancer who were evaluated by an MDT, received corresponding recommended treatment, and underwent follow-up. Thereafter, physicians inputted the information of all patients into WFO manually, and the results were compared with the treatment programs recommended by the MDT. If the MDT treatment program was classified as “recommended” or “considered” by WFO, we considered the results concordant. All patients were divided into a concordant group and a nonconcordant group according to whether the WFO and MDT treatment programs were concordant. The prognoses of the two groups were analyzed.

Results

The overall concordance of WFO and the MDT was 54.5% (128/235) in this study. The subgroup analysis found that concordance was less likely in patients with human epidermal growth factor receptor 2 (HER2)-positive tumors than in patients with HER2-negative tumors (P=.02). Age, Eastern Cooperative Oncology Group performance status, differentiation type, and clinical stage were not found to affect concordance. Among all patients, the survival time was significantly better in concordant patients than in nonconcordant patients (P<.001). Multivariate analysis revealed that concordance was an independent prognostic factor of overall survival in patients with gastric cancer (hazard ratio 0.312 [95% CI 0.187-0.521]).

Conclusions

The treatment recommendations made by WFO and the MDT were mostly concordant in gastric cancer patients. If the WFO options are updated to include local treatment programs, the concordance will greatly improve. The HER2 status of patients with gastric cancer had a strong effect on the likelihood of concordance. Generally, survival was better in concordant patients than in nonconcordant patients.

Concordance as evidence in the Watson for Oncology decision-support system

Machine learning platforms have emerged as a new promissory technology that some argue will revolutionize work practices across a broad range of professions, including medical care. During the past few years, IBM has been testing its Watson for Oncology platform at several oncology departments around the world. Published reports, news stories, as well as our own empirical research show that in some cases, the levels of concordance over recommended treatment protocols between the platform and human oncologists have been quite low. Other studies supported by IBM claim concordance rates as high as 96%. We use the Watson for Oncology case to examine the practice of using concordance levels between tumor boards and a machine learning decision-support system as a form of evidence. We address a challenge related to the epistemic authority between oncologists on tumor boards and the Watson Oncology platform by arguing that the use of concordance levels as a form of evidence of quality or trustworthiness is problematic. Although the platform provides links to the literature from which it draws its conclusion, it obfuscates the scoring criteria that it uses to value some studies over others. In other words, the platform “black boxes” the values that are coded into its scoring system.

Artificial Intelligence and Machine Learning: A New Disruptive Force in Orthopaedics

Orthopaedics as a surgical discipline requires a combination of good clinical acumen, good surgical skill, a reasonable physical strength and most of all, good understanding of technology. The last few decades have seen rapid adoption of new technologies into orthopaedic practice, power tools, new implants, CAD-CAM design, 3-D printing, additive manufacturing just to name a few. The new disruption in orthopaedics in the current time and era is undoubtedly the advent of artificial intelligence and robotics. As these technologies take root and innovative applications continue to be incorporated into the main-stream orthopedics, as we know it today, it is imperative to look at and understand the basics of artificial intelligence and what work is being done in the field today. This article takes the form of a loosely structured narrative review and will introduce the reader to key concepts in the field of artificial intelligence as well as some of the directions in application of the same in orthopaedics. Some of the recent work has been summarised and we present our viewpoint at the conclusion as to why we must consider artificial intelligence as a disrupting positive influence on orthopaedic surgery.

Use of Natural Language Processing to Extract Clinical Cancer Phenotypes from Electronic Medical Records

Current models for correlating electronic medical records with -omics data largely ignore clinical text, which is an important source of phenotype information for patients with cancer. This data convergence has the potential to reveal new insights about cancer initiation, progression, metastasis, and response to treatment. Insights from this real-world data will catalyze clinical care, research, and regulatory activities. Natural language processing (NLP) methods are needed to extract these rich cancer phenotypes from clinical text. Here, we review the advances of NLP and information extraction methods relevant to oncology based on publications from PubMed as well as NLP and machine learning conference proceedings in the last 3 years. Given the interdisciplinary nature of the fields of oncology and information extraction, this analysis serves as a critical trail marker on the path to higher fidelity oncology phenotypes from real-world data.

Artificial Intelligence in the Management of Glioma: Era of Personalized Medicine

Purpose: Artificial intelligence (AI) has accelerated novel discoveries across multiple disciplines including medicine. Clinical medicine suffers from a lack of AI-based applications, potentially due to lack of awareness of AI methodology. Future collaboration between computer scientists and clinicians is critical to maximize the benefits of transformative technology in this field for patients. To illustrate, we describe AI-based advances in the diagnosis and management of gliomas, the most common primary central nervous system (CNS) malignancy.

Methods: Presented is a succinct description of foundational concepts of AI approaches and their relevance to clinical medicine, geared toward clinicians without computer science backgrounds. We also review novel AI approaches in the diagnosis and management of glioma.

Results: Novel AI approaches in gliomas have been developed to predict the grading and genomics from imaging, automate the diagnosis from histopathology, and provide insight into prognosis.

Conclusion: Novel AI approaches offer acceptable performance in gliomas. Further investigation is necessary to improve the methodology and determine the full clinical utility of these novel approaches.