Promises of artificial intelligence in neuroradiology: a systematic technographic review

Artificial intelligence for MRI stroke detection: a systematic review and meta-analysis

OBJECTIVES

This systematic review and meta-analysis aimed to assess the stroke detection performance of artificial intelligence (AI) in magnetic resonance imaging (MRI), and additionally to identify reporting insufficiencies.

METHODS

PRISMA guidelines were followed. MEDLINE, Embase, Cochrane Central, and IEEE Xplore were searched for studies utilising MRI and AI for stroke detection. The protocol was prospectively registered with PROSPERO (CRD42021289748). Sensitivity, specificity, accuracy, and area under the receiver operating characteristic (ROC) curve were the primary outcomes. Only studies using MRI in adults were included. The intervention was AI for stroke detection with ischaemic and haemorrhagic stroke in separate categories. Any manual labelling was used as a comparator. A modified QUADAS-2 tool was used for bias assessment. The minimum information about clinical artificial intelligence modelling (MI-CLAIM) checklist was used to assess reporting insufficiencies. Meta-analyses were performed for sensitivity, specificity, and hierarchical summary ROC (HSROC) on low risk of bias studies.

RESULTS

Thirty-three studies were eligible for inclusion. Fifteen studies had a low risk of bias. Low-risk studies were better for reporting MI-CLAIM items. Only one study examined a CE-approved AI algorithm. Forest plots revealed detection sensitivity and specificity of 93% and 93% with identical performance in the HSROC analysis and positive and negative likelihood ratios of 12.6 and 0.079.

CONCLUSION

Current AI technology can detect ischaemic stroke in MRI. There is a need for further validation of haemorrhagic detection. The clinical usability of AI stroke detection in MRI is yet to be investigated.

CRITICAL RELEVANCE STATEMENT

This first meta-analysis concludes that AI, utilising diffusion-weighted MRI sequences, can accurately aid the detection of ischaemic brain lesions and its clinical utility is ready to be uncovered in clinical trials.

KEY POINTS

There is a growing interest in AI solutions for detection aid. The performance is unknown for MRI stroke assessment. AI detection sensitivity and specificity were 93% and 93% for ischaemic lesions. There is limited evidence for the detection of patients with haemorrhagic lesions. AI can accurately detect patients with ischaemic stroke in MRI.

The new era of artificial intelligence in neuroradiology: current research and promising tools

Radiology has a number of characteristics that make it an especially suitable medical discipline for early artificial intelligence (AI) adoption. These include having a well-established digital workflow, standardized protocols for image storage, and numerous well-defined interpretive activities. The more than 200 commercial radiologic AI-based products recently approved by the Food and Drug Administration (FDA) to assist radiologists in a number of narrow image-analysis tasks such as image enhancement, workflow triage, and quantification, corroborate this observation. However, in order to leverage AI to boost efficacy and efficiency, and to overcome substantial obstacles to widespread successful clinical use of these products, radiologists should become familiarized with the emerging applications in their particular areas of expertise. In light of this, in this article we survey the existing literature on the application of AI-based techniques in neuroradiology, focusing on conditions such as vascular diseases, epilepsy, and demyelinating and neurodegenerative conditions. We also introduce some of the algorithms behind the applications, briefly discuss a few of the challenges of generalization in the use of AI models in neuroradiology, and skate over the most relevant commercially available solutions adopted in clinical practice. If well designed, AI algorithms have the potential to radically improve radiology, strengthening image analysis, enhancing the value of quantitative imaging techniques, and mitigating diagnostic errors.

Diagnostic test accuracy study of a commercially available deep learning algorithm for ischemic lesion detection on brain MRIs in suspected stroke patients from a non-comprehensive stroke center

PURPOSE

To estimate the ability of a commercially available artificial intelligence (AI) tool to detect acute brain ischemia on Magnetic Resonance Imaging (MRI), compared to an experienced neuroradiologist.

METHODS

We retrospectively included 1030 patients with brain MRI, suspected of stroke from January 6th, 2020 to 1st of April 2022, based on these criteria: Age ≥ 18 years, symptoms within four weeks before the scan. The neuroradiologist reinterpreted the MRI scans and subclassified ischemic lesions for reference. We excluded scans with interpretation difficulties due to artifacts or missing sequences. Four MRI scanner models from the same vendor were used. The first 800 patients were included consecutively, remaining enriched for less frequent lesions. The index test was a CE-approved AI tool (Apollo version 2.1.1 by Cerebriu).

RESULTS

The final analysis cohort comprised 995 patients (mean age 69 years, 53 % female). A case-based analysis for detecting acute ischemic lesions showed a sensitivity of 89 % (95 % CI: 85 %-91 %) and specificity of 90 % (95 % CI: 87 %-92 %). We found no significant difference in sensitivity or specificity based on sex, age, or comorbidities. Specificity was reduced in cases with DWI artifacts. Multivariate analysis showed that increasing ischemic lesion size and fragmented lesions were independently associated with higher sensitivity, while non-acute lesion ages lowered sensitivity.

CONCLUSIONS

The AI tool exhibits high sensitivity and specificity in detecting acute ischemic lesions on MRI compared to an experienced neuroradiologist. While sensitivity depends on the ischemic lesions' characteristics, specificity depends on the image quality.

The impact on clinical outcomes after 1 year of implementation of an artificial intelligence solution for the detection of intracranial hemorrhage

BACKGROUND

To assess the effect of a commercial artificial intelligence (AI) solution implementation in the emergency department on clinical outcomes in a single level 1 trauma center.

METHODS

A retrospective cohort study for two time periods-pre-AI (1.1.2017-1.1.2018) and post-AI (1.1.2019-1.1.2020)-in a level 1 trauma center was performed. The ICH algorithm was applied to 587 consecutive patients with a confirmed diagnosis of ICH on head CT upon admission to the emergency department. Study variables included demographics, patient outcomes, and imaging data. Participants admitted to the emergency department during the same time periods for other acute diagnoses (ischemic stroke (IS) and myocardial infarction (MI)) served as control groups. Primary outcomes were 30- and 120-day all-cause mortality. The secondary outcome was morbidity based on Modified Rankin Scale for Neurologic Disability (mRS) at discharge.

RESULTS

Five hundred eighty-seven participants (289 pre-AI-age 71 ± 1, 169 men; 298 post-AI-age 69 ± 1, 187 men) with ICH were eligible for the analyzed period. Demographics, comorbidities, Emergency Severity Score, type of ICH, and length of stay were not significantly different between the two time periods. The 30- and 120-day all-cause mortality were significantly reduced in the post-AI group when compared to the pre-AI group (27.7% vs 17.5%; p = 0.004 and 31.8% vs 21.7%; p = 0.017, respectively). Modified Rankin Scale (mRS) at discharge was significantly reduced post-AI implementation (3.2 vs 2.8; p = 0.044).

CONCLUSION

The added value of this study emphasizes the introduction of artificial intelligence (AI) computer-aided triage and prioritization software in an emergent care setting that demonstrated a significant reduction in a 30- and 120-day all-cause mortality and morbidity for patients diagnosed with intracranial hemorrhage (ICH). Along with mortality rates, the AI software was associated with a significant reduction in the Modified Ranking Scale (mRs).

Artificial intelligence in neuroradiology: a scoping review of some ethical challenges

Artificial intelligence (AI) has great potential to increase accuracy and efficiency in many aspects of neuroradiology. It provides substantial opportunities for insights into brain pathophysiology, developing models to determine treatment decisions, and improving current prognostication as well as diagnostic algorithms. Concurrently, the autonomous use of AI models introduces ethical challenges regarding the scope of informed consent, risks associated with data privacy and protection, potential database biases, as well as responsibility and liability that might potentially arise. In this manuscript, we will first provide a brief overview of AI methods used in neuroradiology and segue into key methodological and ethical challenges. Specifically, we discuss the ethical principles affected by AI approaches to human neuroscience and provisions that might be imposed in this domain to ensure that the benefits of AI frameworks remain in alignment with ethics in research and healthcare in the future.

A Nationwide Web-Based Survey of Neuroradiologists' Perceptions of Artificial Intelligence Software for Neuro-Applications in Korea

OBJECTIVE

We aimed to investigate current expectations and clinical adoption of artificial intelligence (AI) software among neuroradiologists in Korea.

MATERIALS AND METHODS

In April 2022, a 30-item online survey was conducted by neuroradiologists from the Korean Society of Neuroradiology (KSNR) to assess current user experiences, perceptions, attitudes, and future expectations regarding AI for neuro-applications. Respondents with experience in AI software were further investigated in terms of the number and type of software used, period of use, clinical usefulness, and future scope. Results were compared between respondents with and without experience with AI software through multivariable logistic regression and mediation analyses.

RESULTS

The survey was completed by 73 respondents, accounting for 21.9% (73/334) of the KSNR members; 72.6% (53/73) were familiar with AI and 58.9% (43/73) had used AI software, with approximately 86% (37/43) using 1-3 AI software programs and 51.2% (22/43) having up to one year of experience with AI software. Among AI software types, brain volumetry software was the most common (62.8% [27/43]). Although 52.1% (38/73) assumed that AI is currently useful in practice, 86.3% (63/73) expected it to be useful for clinical practice within 10 years. The main expected benefits were reducing the time spent on repetitive tasks (91.8% [67/73]) and improving reading accuracy and reducing errors (72.6% [53/73]). Those who experienced AI software were more familiar with AI (adjusted odds ratio, 7.1 [95% confidence interval, 1.81-27.81]; P = 0.005). More than half of the respondents with AI software experience (55.8% [24/43]) agreed that AI should be included in training curriculums, while almost all (95.3% [41/43]) believed that radiologists should coordinate to improve its performance.

CONCLUSION

A majority of respondents experienced AI software and showed a proactive attitude toward adopting AI in clinical practice, suggesting that AI should be incorporated into training and active participation in AI development should be encouraged.

Value assessment of artificial intelligence in medical imaging: a scoping review

BACKGROUND

Artificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, the assessment of the value of these new technologies is still unclear, and no agreed international health technology assessment-based guideline exists. This study provides an overview of the available literature in the value assessment of AI in the field of medical imaging.

METHODS

We performed a systematic scoping review of published studies between January 2016 and September 2020 using 10 databases (Medline, Scopus, ProQuest, Google Scholar, and six related databases of grey literature). Information about the context (country, clinical area, and type of study) and mentioned domains with specific outcomes and items were extracted. An existing domain classification, from a European assessment framework, was used as a point of departure, and extracted data were grouped into domains and content analysis of data was performed covering predetermined themes.

RESULTS

Seventy-nine studies were included out of 5890 identified articles. An additional seven studies were identified by searching reference lists, and the analysis was performed on 86 included studies. Eleven domains were identified: (1) health problem and current use of technology, (2) technology aspects, (3) safety assessment, (4) clinical effectiveness, (5) economics, (6) ethical analysis, (7) organisational aspects, (8) patients and social aspects, (9) legal aspects, (10) development of AI algorithm, performance metrics and validation, and (11) other aspects. The frequency of mentioning a domain varied from 20 to 78% within the included papers. Only 15/86 studies were actual assessments of AI technologies. The majority of data were statements from reviews or papers voicing future needs or challenges of AI research, i.e. not actual outcomes of evaluations.

CONCLUSIONS

This review regarding value assessment of AI in medical imaging yielded 86 studies including 11 identified domains. The domain classification based on European assessment framework proved useful and current analysis added one new domain. Included studies had a broad range of essential domains about addressing AI technologies highlighting the importance of domains related to legal and ethical aspects.

Automated Identification of Multiple Findings on Brain MRI for Improving Scan Acquisition and Interpretation Workflows: A Systematic Review

We conducted a systematic review of the current status of machine learning (ML) algorithms’ ability to identify multiple brain diseases, and we evaluated their applicability for improving existing scan acquisition and interpretation workflows. PubMed Medline, Ovid Embase, Scopus, Web of Science, and IEEE Xplore literature databases were searched for relevant studies published between January 2017 and February 2022. The quality of the included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. The applicability of ML algorithms for successful workflow improvement was qualitatively assessed based on the satisfaction of three clinical requirements. A total of 19 studies were included for qualitative synthesis. The included studies performed classification tasks (n = 12) and segmentation tasks (n = 7). For classification algorithms, the area under the receiver operating characteristic curve (AUC) ranged from 0.765 to 0.997, while accuracy, sensitivity, and specificity ranged from 80% to 100%, 72% to 100%, and 65% to 100%, respectively. For segmentation algorithms, the Dice coefficient ranged from 0.300 to 0.912. No studies satisfied all clinical requirements for successful workflow improvements due to key limitations pertaining to the study’s design, study data, reference standards, and performance reporting. Standardized reporting guidelines tailored for ML in radiology, prospective study designs, and multi-site testing could help alleviate this.

Use of artificial intelligence in emergency radiology: An overview of current applications, challenges, and opportunities

The value of artificial intelligence (AI) in healthcare has become evident, especially in the field of medical imaging. The accelerated pace and acuity of care in the Emergency Department (ED) has made it a popular target for artificial intelligence-driven solutions. Software that helps better detect, report, and appropriately guide management can ensure high quality patient care while enabling emergency radiologists to better meet the demands of quick turnaround times. Beyond diagnostic applications, AI-based algorithms also have the potential to optimize other important steps within the ED imaging workflow. This review will highlight the different types of AI-based applications currently available for use in the ED, as well as the challenges and opportunities associated with their implementation.

Clinical Artificial Intelligence Applications in Radiology: Neuro

Radiologists have been at the forefront of the digitization process in medicine. Artificial intelligence (AI) is a promising area of innovation, particularly in medical imaging. The number of applications of AI in neuroradiology has also grown. This article illustrates some of these applications. This article reviews machine learning challenges related to neuroradiology. The first approval of reimbursement for an AI algorithm by the Centers for Medicare and Medicaid Services, covering a stroke software for early detection of large vessel occlusion, is also discussed.

Current uses, emerging applications, and clinical integration of artificial intelligence in neuroradiology

Artificial intelligence (AI) is a branch of computer science with a variety of subfields and techniques, exploited to serve as a deductive tool that performs tasks originally requiring human cognition. AI tools and its subdomains are being incorporated into healthcare delivery for the improvement of medical data interpretation encompassing clinical management, diagnostics, and prognostic outcomes. In the field of neuroradiology, AI manifested through deep machine learning and connected neural networks (CNNs) has demonstrated incredible accuracy in identifying pathology and aiding in diagnosis and prognostication in several areas of neurology and neurosurgery. In this literature review, we survey the available clinical data highlighting the utilization of AI in the field of neuroradiology across multiple neurological and neurosurgical subspecialties. In addition, we discuss the emerging role of AI in neuroradiology, its strengths and limitations, as well as future needs in strengthening its role in clinical practice. Our review evaluated data across several subspecialties of neurology and neurosurgery including vascular neurology, spinal pathology, traumatic brain injury (TBI), neuro-oncology, multiple sclerosis, Alzheimer's disease, and epilepsy. AI has established a strong presence within the realm of neuroradiology as a successful and largely supportive technology aiding in the interpretation, diagnosis, and even prognostication of various pathologies. More research is warranted to establish its full scientific validity and determine its maximum potential to aid in optimizing and providing the most accurate imaging interpretation.

Technical and clinical validation of commercial automated volumetric MRI tools for dementia diagnosis-a systematic review

Developments in neuroradiological MRI analysis offer promise in enhancing objectivity and consistency in dementia diagnosis through the use of quantitative volumetric reporting tools (QReports). Translation into clinical settings should follow a structured framework of development, including technical and clinical validation steps. However, published technical and clinical validation of the available commercial/proprietary tools is not always easy to find and pathways for successful integration into the clinical workflow are varied. The quantitative neuroradiology initiative (QNI) framework highlights six necessary steps for the development, validation and integration of quantitative tools in the clinic. In this paper, we reviewed the published evidence regarding regulatory-approved QReports for use in the memory clinic and to what extent this evidence fulfils the steps of the QNI framework. We summarize unbiased technical details of available products in order to increase the transparency of evidence and present the range of reporting tools on the market. Our intention is to assist neuroradiologists in making informed decisions regarding the adoption of these methods in the clinic. For the 17 products identified, 11 companies have published some form of technical validation on their methods, but only 4 have published clinical validation of their QReports in a dementia population. Upon systematically reviewing the published evidence for regulatory-approved QReports in dementia, we concluded that there is a significant evidence gap in the literature regarding clinical validation, workflow integration and in-use evaluation of these tools in dementia MRI diagnosis.

Artificial intelligence applied to neuroimaging data in Parkinsonian syndromes: Actuality and expectations

Idiopathic Parkinson's Disease (iPD) is a common motor neurodegenerative disorder. It affects more frequently the elderly population, causing a significant emotional burden both for the patient and caregivers, due to the disease-related onset of motor and cognitive disabilities. iPD's clinical hallmark is the onset of cardinal motor symptoms such as bradykinesia, rest tremor, rigidity, and postural instability. However, these symptoms appear when the neurodegenerative process is already in an advanced stage. Furthermore, the greatest challenge is to distinguish iPD from other similar neurodegenerative disorders, "atypical parkinsonisms", such as Multisystem Atrophy, Progressive Supranuclear Palsy and Cortical Basal Degeneration, since they share many phenotypic manifestations, especially in the early stages. The diagnosis of these neurodegenerative motor disorders is essentially clinical. Consequently, the diagnostic accuracy mainly depends on the professional knowledge and experience of the physician. Recent advances in artificial intelligence have made it possible to analyze the large amount of clinical and instrumental information in the medical field. The application machine learning algorithms to the analysis of neuroimaging data appear to be a promising tool for identifying microstructural alterations related to the pathological process in order to explain the onset of symptoms and the spread of the neurodegenerative process. In this context, the search for quantitative biomarkers capable of identifying parkinsonian patients in the prodromal phases of the disease, of correctly distinguishing them from atypical parkinsonisms and of predicting clinical evolution and response to therapy represent the main goal of most current clinical research studies. Our aim was to review the recent literature and describe the current knowledge about the contribution given by machine learning applications to research and clinical management of parkinsonian syndromes.