Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning

Radiomics for the identification of extraprostatic extension with prostate MRI: a systematic review and meta-analysis

OBJECTIVES

Extraprostatic extension (EPE) of prostate cancer (PCa) is predicted using clinical nomograms. Incorporating MRI could represent a leap forward, although poor sensitivity and standardization represent unsolved issues. MRI radiomics has been proposed for EPE prediction. The aim of the study was to systematically review the literature and perform a meta-analysis of MRI-based radiomics approaches for EPE prediction.

MATERIALS AND METHODS

Multiple databases were systematically searched for radiomics studies on EPE detection up to June 2022. Methodological quality was appraised according to Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS). The area under the receiver operating characteristic curves (AUC) was pooled to estimate predictive accuracy. A random-effects model estimated overall effect size. Statistical heterogeneity was assessed with I2 value. Publication bias was evaluated with a funnel plot. Subgroup analyses were performed to explore heterogeneity.

RESULTS

Thirteen studies were included, showing limitations in study design and methodological quality (median RQS 10/36), with high statistical heterogeneity. Pooled AUC for EPE identification was 0.80. In subgroup analysis, test-set and cross-validation-based studies had pooled AUC of 0.85 and 0.89 respectively. Pooled AUC was 0.72 for deep learning (DL)-based and 0.82 for handcrafted radiomics studies and 0.79 and 0.83 for studies with multiple and single scanner data, respectively. Finally, models with the best predictive performance obtained using radiomics features showed pooled AUC of 0.82, while those including clinical data of 0.76.

CONCLUSION

MRI radiomics-powered models to identify EPE in PCa showed a promising predictive performance overall. However, methodologically robust, clinically driven research evaluating their diagnostic and therapeutic impact is still needed.

CLINICAL RELEVANCE STATEMENT

Radiomics might improve the management of prostate cancer patients increasing the value of MRI in the assessment of extraprostatic extension. However, it is imperative that forthcoming research prioritizes confirmation studies and a stronger clinical orientation to solidify these advancements.

KEY POINTS

• MRI radiomics deserves attention as a tool to overcome the limitations of MRI in prostate cancer local staging. • Pooled AUC was 0.80 for the 13 included studies, with high heterogeneity (84.7%, p < .001), methodological issues, and poor clinical orientation. • Methodologically robust radiomics research needs to focus on increasing MRI sensitivity and bringing added value to clinical nomograms at patient level.

Predicting Microwave Ablation Early Efficacy in Pulmonary Malignancies via Δ Radiomics Models

OBJECTIVE

This study aimed to explore the value of preoperative and postoperative computed tomography (CT)-based radiomic signatures and Δ radiomic signatures for evaluating the early efficacy of microwave ablation (MWA) for pulmonary malignancies.

METHODS

In total, 115 patients with pulmonary malignancies who underwent MWA treatment were categorized into response and nonresponse groups according to relevant guidelines and consensus. Quantitative image features of the largest pulmonary malignancies were extracted from CT noncontrast scan images preoperatively (time point 0, TP0) and immediately postoperatively (time point 1, TP1). Critical features were selected from TP0 and TP1 and as Δ radiomics signatures for building radiomics models. In addition, a combined radiomics model (C-RO) was developed by integrating radiomics parameters with clinical risk factors. Prediction performance was assessed using the area under the receiver operating characteristic curve (AUC) and decision curve analysis (DCA).

RESULTS

The radiomics model using Δ features outperformed the radiomics model using TP0 and TP1 features, with training and validation AUCs of 0.892, 0.808, and 0.787, and 0.705, 0.825, and 0.778, respectively. By combining the TP0, TP1, and Δ features, the logistic regression model exhibited the best performance, with training and validation AUCs of 0.945 and 0.744, respectively. The DCA confirmed the clinical utility of the Δ radiomics model.

CONCLUSIONS

A combined prediction model, including TP0, TP1, and Δ radiometric features, can be used to evaluate the early efficacy of MWA in pulmonary malignancies.

Healthcare Systems and Artificial Intelligence: Focus on Challenges and the International Regulatory Framework

BACKGROUND

Nowadays, healthcare systems are coping with the challenge of countering the exponential growth of healthcare costs worldwide, to support sustainability and to guarantee access to treatment for all patients.

METHODS

Artificial Intelligence (AI) is the technology able to perform human cognitive functions through the creation of algorithms. The value of AI in healthcare and its ability to address healthcare delivery issues has been a subject of discussion within the scientific community for several years.

RESULTS

The aim of this work is to provide an overview of the primary uses of AI in the healthcare system, to discuss its desirable future uses while shedding light on the major issues related to implications within international regulatory processes. In this manuscript, it will be described the main applications of AI in various aspects of health care, from clinical studies to ethical implications, focusing on the international regulatory framework in countries in which AI is used, to discuss and compare strengthens and weaknesses.

CONCLUSIONS

The challenges in regulatory processes to facilitate the integration of AI in healthcare are significant. However, overcoming them is essential to ensure that AI-based technologies are adopted safely and effectively.

Estimating Ejection Fraction from the 12 Lead ECG among Patients with Acute Heart Failure

Background

Identifying patients with low left ventricular ejection fraction (LVEF) in the emergency department using an electrocardiogram (ECG) may optimize acute heart failure (AHF) management. We aimed to assess the efficacy of 527 automated 12-lead ECG features for estimating LVEF among patients with AHF.

Method

Medical records of patients >18 years old and AHF-related ICD codes, demographics, LVEF %, comorbidities, and medication were analyzed. Least Absolute Shrinkage and Selection Operator (LASSO) identified important ECG features and evaluated performance.

Results

Among 851 patients, the mean age was 74 years (IQR:11), male 56% (n=478), and the median body mass index was 29 kg/m2 (IQR:1.8). A total of 914 echocardiograms and ECGs were matched; the time between ECG-Echocardiogram was 9 hours (IQR of 9 hours); ≤30% LVEF (16.45%, n=140). Lasso demonstrated 42 ECG features important for estimating LVEF ≤30%. The predictive model of LVEF ≤30% demonstrated an area under the curve (AUC) of 0.86, a 95% confidence interval (CI) of 0.83 to 0.89, a specificity of 54% (50% to 57%), and a sensitivity of 91 (95% CI: 88% to 96%), accuracy 60% (95% CI:60 % to 63%) and, negative predictive value of 95%.

Conclusions

An explainable machine learning model with physiologically feasible predictors may be useful in screening patients with low LVEF in AHF.

Exploring the matrix: knowledge, perceptions and prospects of artificial intelligence and machine learning in Nigerian healthcare

Background

Artificial intelligence technology can be applied in several aspects of healthcare delivery and its integration into the Nigerian healthcare value chain is expected to bring about new opportunities. This study aimed at assessing the knowledge and perception of healthcare professionals in Nigeria regarding the application of artificial intelligence and machine learning in the health sector.

Methods

A cross-sectional study was undertaken amongst healthcare professionals in Nigeria with the use of a questionnaire. Data were collected across the six geopolitical zones in the Country using a stratified multistage sampling method. Descriptive and inferential statistical analyses were undertaken for the data obtained.

Results

Female participants (55.7%) were slightly higher in proportion compared to the male respondents (44.3%). Pharmacists accounted for 27.7% of the participants, and this was closely followed by medical doctors (24.5%) and nurses (19.3%). The majority of the respondents (57.2%) reported good knowledge regarding artificial intelligence and machine learning, about a third of the participants (32.2%) were of average knowledge, and 10.6% of the sample had poor knowledge. More than half of the respondents (57.8%) disagreed with the notion that the adoption of artificial intelligence in the Nigerian healthcare sector could result in job losses. Two-thirds of the participants (66.7%) were of the view that the integration of artificial intelligence in healthcare will augment human intelligence. Three-quarters (77%) of the respondents agreed that the use of machine learning in Nigerian healthcare could facilitate efficient service delivery.

Conclusion

This study provides novel insights regarding healthcare professionals' knowledge and perception with respect to the application of artificial intelligence and machine learning in healthcare. The emergent findings from this study can guide government and policymakers in decision-making as regards deployment of artificial intelligence and machine learning for healthcare delivery.

Artificial Intelligence and Radiomics for Endometrial Cancer MRI: Exploring the Whats, Whys and Hows

Endometrial cancer (EC) is intricately linked to obesity and diabetes, which are widespread risk factors. Medical imaging, especially magnetic resonance imaging (MRI), plays a major role in EC assessment, particularly for disease staging. However, the diagnostic performance of MRI exhibits variability in the detection of clinically relevant prognostic factors (e.g., deep myometrial invasion and metastatic lymph nodes assessment). To address these challenges and enhance the value of MRI, radiomics and artificial intelligence (AI) algorithms emerge as promising tools with a potential to impact EC risk assessment, treatment planning, and prognosis prediction. These advanced post-processing techniques allow us to quantitatively analyse medical images, providing novel insights into cancer characteristics beyond conventional qualitative image evaluation. However, despite the growing interest and research efforts, the integration of radiomics and AI to EC management is still far from clinical practice and represents a possible perspective rather than an actual reality. This review focuses on the state of radiomics and AI in EC MRI, emphasizing risk stratification and prognostic factor prediction, aiming to illuminate potential advancements and address existing challenges in the field.

Delta-radiomics in cancer immunotherapy response prediction: A systematic review

Background

The new immunotherapies have not only changed the oncological therapeutic approach but have also made it necessary to develop new imaging methods for assessing the response to treatment. Delta radiomics consists of the analysis of radiomic features variation between different medical images, usually before and after therapy.

Purpose

This review aims to evaluate the role of delta radiomics in the immunotherapy response assessment.

Methods

A systematic search was performed in PubMed, Scopus, and Web Of Science using "delta radiomics AND immunotherapy" as search terms. The included articles' methodological quality was measured using the Radiomics Quality Score (RQS) tool.

Results

Thirteen articles were finally included in the systematic review. Overall, the RQS of the included studies ranged from 4 to 17, with a mean RQS total of 11,15 ± 4,18 with a corresponding percentage of 30.98 ± 11.61 %. Eleven articles out of 13 performed imaging at multiple time points. All the included articles performed feature reduction. No study carried out prospective validation, decision curve analysis, or cost-effectiveness analysis.

Conclusions

Delta radiomics has been demonstrated useful in evaluating the response in oncologic patients undergoing immunotherapy. The overall quality was found law, due to the lack of prospective design and external validation. Thus, further efforts are needed to bring delta radiomics a step closer to clinical implementation.

Imbalanced class distribution and performance evaluation metrics: A systematic review of prediction accuracy for determining model performance in healthcare systems

Focus on predictive algorithm and its performance evaluation is extensively covered in most research studies to determine best or appropriate predictive model with Optimum prediction solution indicated by prediction accuracy score, precision, recall, f1score etc. Prediction accuracy score from performance evaluation has been used extensively as the main determining metric for performance recommendation. It is one of the most widely used metric for identifying optimal prediction solution irrespective of dataset class distribution context or nature of dataset and output class distribution between the minority and majority variables. The key research question however is the impact of class inequality on prediction accuracy score in such datasets with output class distribution imbalance as compared to balanced accuracy score in the determination of model performance in healthcare and other real-world application systems. Answering this question requires an appraisal of current state of knowledge in both prediction accuracy score and balanced accuracy score use in real-world applications where there is unequal class distribution. Review of related works that highlight the use of imbalanced class distribution datasets with evaluation metrics will assist in contextualizing this systematic review.

Regenerative bioelectronics: A strategic roadmap for precision medicine

In the past few decades, stem cell-based regenerative engineering has demonstrated its significant potential to repair damaged tissues and to restore their functionalities. Despite such advancement in regenerative engineering, the clinical translation remains a major challenge. In the stance of personalized treatment, the recent progress in bioelectronic medicine likewise evolved as another important research domain of larger significance for human healthcare. Over the last several years, our research group has adopted biomaterials-based regenerative engineering strategies using innovative bioelectronic stimulation protocols based on either electric or magnetic stimuli to direct cellular differentiation on engineered biomaterials with a range of elastic stiffness or functional properties (electroactivity/magnetoactivity). In this article, the role of bioelectronics in stem cell-based regenerative engineering has been critically analyzed to stimulate futuristic research in the treatment of degenerative diseases as well as to address some fundamental questions in stem cell biology. Built on the concepts from two independent biomedical research domains (regenerative engineering and bioelectronic medicine), we propose a converging research theme, 'Regenerative Bioelectronics'. Further, a series of recommendations have been put forward to address the current challenges in bridging the gap in stem cell therapy and bioelectronic medicine. Enacting the strategic blueprint of bioelectronic-based regenerative engineering can potentially deliver the unmet clinical needs for treating incurable degenerative diseases.

Radiomics Applications in Spleen Imaging: A Systematic Review and Methodological Quality Assessment

The spleen, often referred to as the "forgotten organ", plays numerous important roles in various diseases. Recently, there has been an increased interest in the application of radiomics in different areas of medical imaging. This systematic review aims to assess the current state of the art and evaluate the methodological quality of radiomics applications in spleen imaging. A systematic search was conducted on PubMed, Scopus, and Web of Science. All the studies were analyzed, and several characteristics, such as year of publication, research objectives, and number of patients, were collected. The methodological quality was evaluated using the radiomics quality score (RQS). Fourteen articles were ultimately included in this review. The majority of these articles were published in non-radiological journals (78%), utilized computed tomography (CT) for extracting radiomic features (71%), and involved not only the spleen but also other organs for feature extraction (71%). Overall, the included papers achieved an average RQS total score of 9.71 ± 6.37, corresponding to an RQS percentage of 27.77 ± 16.04. In conclusion, radiomics applications in spleen imaging demonstrate promising results in various clinical scenarios. However, despite all the included papers reporting positive outcomes, there is a lack of consistency in the methodological approaches employed.

A first look into radiomics application in testicular imaging: A systematic review

The aim of this systematic review was to evaluate the state of the art of radiomics in testicular imaging by assessing the quality of radiomic workflow using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). A systematic literature search was performed to find potentially relevant articles on the applications of radiomics in testicular imaging, and 6 final articles were extracted. The mean RQS was 11,33 ± 3,88 resulting in a percentage of 31,48% ± 10,78%. Regarding QUADAS-2 criteria, no relevant biases were found in the included papers in the patient selection, index test, reference standard criteria and flow-and-timing domain. In conclusion, despite the publication of promising studies, radiomic research on testicular imaging is in its very beginning and still hindered by methodological limitations, and the potential applications of radiomics for this field are still largely unexplored.

Imaging Diagnosis of Hepatocellular Carcinoma: A State-of-the-Art Review

Hepatocellular carcinoma (HCC) remains not only a cause of a considerable part of oncologic mortality, but also a diagnostic and therapeutic challenge for healthcare systems worldwide. Early detection of the disease and consequential adequate therapy are imperative to increase patients' quality of life and survival. Imaging plays, therefore, a crucial role in the surveillance of patients at risk, the detection and diagnosis of HCC nodules, as well as in the follow-up post-treatment. The unique imaging characteristics of HCC lesions, deriving mainly from the assessment of their vascularity on contrast-enhanced computed tomography (CT), magnetic resonance (MR) or contrast-enhanced ultrasound (CEUS), allow for a more accurate, noninvasive diagnosis and staging. The role of imaging in the management of HCC has further expanded beyond the plain confirmation of a suspected diagnosis due to the introduction of ultrasound and hepatobiliary MRI contrast agents, which allow for the detection of hepatocarcinogenesis even at an early stage. Moreover, the recent technological advancements in artificial intelligence (AI) in radiology contribute an important tool for the diagnostic prediction, prognosis and evaluation of treatment response in the clinical course of the disease. This review presents current imaging modalities and their central role in the management of patients at risk and with HCC.

The True Value of Quantitative Imaging for Adrenal Mass Characterization: Reality or Possibility?

The widespread use of cross-sectional imaging modalities, such as computed tomography (CT) and magnetic resonance imaging (MRI), in the evaluation of abdominal disorders has significantly increased the number of incidentally detected adrenal abnormalities, particularly adrenal masses [...].