Open-Source Clinical Machine Learning Models: Critical Appraisal of Feasibility, Advantages, and Challenges

The AI Future of Emergency Medicine

In the coming years, artificial intelligence (AI) and machine learning will likely give rise to profound changes in the field of emergency medicine, and medicine more broadly. This article discusses these anticipated changes in terms of 3 overlapping yet distinct stages of AI development. It reviews some fundamental concepts in AI and explores their relation to clinical practice, with a focus on emergency medicine. In addition, it describes some of the applications of AI in disease diagnosis, prognosis, and treatment, as well as some of the practical issues that they raise, the barriers to their implementation, and some of the legal and regulatory challenges they create.

Artificial intelligence-enhanced patient evaluation: bridging art and science

The advent of digital health and artificial intelligence (AI) has promised to revolutionize clinical care, but real-world patient evaluation has yet to witness transformative changes. As history taking and physical examination continue to rely on long-established practices, a growing pipeline of AI-enhanced digital tools may soon augment the traditional clinical encounter into a data-driven process. This article presents an evidence-backed vision of how promising AI applications may enhance traditional practices, streamlining tedious tasks while elevating diverse data sources, including AI-enabled stethoscopes, cameras, and wearable sensors, to platforms for personalized medicine and efficient care delivery. Through the lens of traditional patient evaluation, we illustrate how digital technologies may soon be interwoven into routine clinical workflows, introducing a novel paradigm of longitudinal monitoring. Finally, we provide a skeptic's view on the practical, ethical, and regulatory challenges that limit the uptake of such technologies.

A Systematic Review and Meta-Analysis of Applying Deep Learning in the Prediction of the Risk of Cardiovascular Diseases From Retinal Images

Purpose

The purpose of this study was to perform a systematic review and meta-analysis to synthesize evidence from studies using deep learning (DL) to predict cardiovascular disease (CVD) risk from retinal images.

Methods

A systematic literature search was performed in MEDLINE, Scopus, and Web of Science up to June 2022. We extracted data pertaining to predicted outcomes, model development, and validation and model performance metrics. Included studies were graded using the Quality Assessment of Diagnostic Accuracies Studies 2 tool. Model performance was pooled across eligible studies using a random-effects meta-analysis model.

Results

A total of 26 studies were included in the analysis. There were 42 CVD risk-related outcomes predicted from retinal images were identified, including 33 CVD risk factors, 4 cardiac imaging biomarkers, 2 CVD risk scores, the presence of CVD, and incident CVD. Three studies that aimed to predict the development of future CVD events reported an area under the receiver operating curve (AUROC) between 0.68 and 0.81. Models that used retinal images as input data had a pooled mean absolute error of 3.19 years (95% confidence interval [CI] = 2.95-3.43) for age prediction; a pooled AUROC of 0.96 (95% CI = 0.95-0.97) for gender classification; a pooled AUROC of 0.80 (95% CI = 0.73-0.86) for diabetes detection; and a pooled AUROC of 0.86 (95% CI = 0.81-0.92) for the detection of chronic kidney disease. We observed a high level of heterogeneity and variation in study designs.

Conclusions

Although DL models appear to have reasonably good performance when it comes to predicting CVD risk, further work is necessary to evaluate the real-world applicability and predictive accuracy.

Translational Relevance

DL-based CVD risk assessment from retinal images holds great promise to be translated to clinical practice as a novel approach for CVD risk assessment, given its simple, quick, and noninvasive nature.

MarrowQuant 2.0: A Digital Pathology Workflow Assisting Bone Marrow Evaluation in Experimental and Clinical Hematology

Bone marrow (BM) cellularity assessment is a crucial step in the evaluation of BM trephine biopsies for hematologic and nonhematologic disorders. Clinical assessment is based on a semiquantitative visual estimation of the hematopoietic and adipocytic components by hematopathologists, which does not provide quantitative information on other stromal compartments. In this study, we developed and validated MarrowQuant 2.0, an efficient, user-friendly digital hematopathology workflow integrated within QuPath software, which serves as BM quantifier for 5 mutually exclusive compartments (bone, hematopoietic, adipocytic, and interstitial/microvasculature areas and other) and derives the cellularity of human BM trephine biopsies. Instance segmentation of individual adipocytes is realized through the adaptation of the machine-learning-based algorithm StarDist. We calculated BM compartments and adipocyte size distributions of hematoxylin and eosin images obtained from 250 bone specimens, from control subjects and patients with acute myeloid leukemia or myelodysplastic syndrome, at diagnosis and follow-up, and measured the agreement of cellularity estimates by MarrowQuant 2.0 against visual scores from 4 hematopathologists. The algorithm was capable of robust BM compartment segmentation with an average mask accuracy of 86%, maximal for bone (99%), hematopoietic (92%), and adipocyte (98%) areas. MarrowQuant 2.0 cellularity score and hematopathologist estimations were highly correlated (R² = 0.92-0.98, intraclass correlation coefficient [ICC] = 0.98; interobserver ICC = 0.96). BM compartment segmentation quantitatively confirmed the reciprocity of the hematopoietic and adipocytic compartments. MarrowQuant 2.0 performance was additionally tested for cellularity assessment of specimens prospectively collected from clinical routine diagnosis. After special consideration for the choice of the cellularity equation in specimens with expanded stroma, performance was similar in this setting (R² = 0.86, n = 42). Thus, we conclude that these validation experiments establish MarrowQuant 2.0 as a reliable tool for BM cellularity assessment. We expect this workflow will serve as a clinical research tool to explore novel biomarkers related to BM stromal components and may contribute to further validation of future digitalized diagnostic hematopathology workstreams.

Online calculator for predicting the risk of malignancy in patients with pancreatic cystic neoplasms: A multicenter, retrospective study

BACKGROUND

Efficient and practical methods for predicting the risk of malignancy in patients with pancreatic cystic neoplasms (PCNs) are lacking.

AIM

To establish a nomogram-based online calculator for predicting the risk of malignancy in patients with PCNs.

METHODS

In this study, the clinicopathological data of target patients in three medical centers were analyzed. The independent sample t-test, Mann–Whitney U test or chi-squared test were used as appropriate for statistical analysis. After univariable and multivariable logistic regression analysis, five independent factors were screened and incorporated to develop a calculator for predicting the risk of malignancy. Finally, the concordance index (C-index), calibration, area under the curve, decision curve analysis and clinical impact curves were used to evaluate the performance of the calculator.

RESULTS

Enhanced mural nodules [odds ratio (OR): 4.314; 95% confidence interval (CI): 1.618–11.503, P = 0.003], tumor diameter ≥ 40 mm (OR: 3.514; 95%CI: 1.138–10.849, P = 0.029), main pancreatic duct dilatation (OR: 3.267; 95%CI: 1.230–8.678, P = 0.018), preoperative neutrophil-to-lymphocyte ratio ≥ 2.288 (OR: 2.702; 95%CI: 1.008–7.244, P = 0.048], and preoperative serum CA19-9 concentration ≥ 34 U/mL (OR: 3.267; 95%CI: 1.274–13.007, P = 0.018) were independent risk factors for a high risk of malignancy in patients with PCNs. In the training cohort, the nomogram achieved a C-index of 0.824 for predicting the risk of malignancy. The predictive ability of the model was then validated in an external cohort (C-index: 0.893). Compared with the risk factors identified in the relevant guidelines, the current model showed better predictive performance and clinical utility.

CONCLUSION

The calculator demonstrates optimal predictive performance for identifying the risk of malignancy, potentially yielding a personalized method for patient selection and decision-making in clinical practice.