1
|
Bernardi MS, Rodriguez A, Caruso P, Furlanis G, Ridolfi M, Prandin G, Naccarato M, Laio A, Amati D, Manganotti P. Improving acute stroke assessment in non-enhanced computed tomography: automated tool for early ischemic lesion volume detection. Neurol Sci 2024; 45:3245-3253. [PMID: 38285327 DOI: 10.1007/s10072-024-07339-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 01/20/2024] [Indexed: 01/30/2024]
Abstract
BACKGROUND AND OBJECTIVES ASPECTs is a widely used marker to identify early stroke signs on non-enhanced computed tomography (NECT), yet it presents interindividual variability and it may be hard to use for non-experts. We introduce an algorithm capable of automatically estimating the NECT volumetric extension of early acute ischemic changes in the 3D space. We compared the power of this marker with ASPECTs evaluated by experienced practitioner in predicting the clinical outcome. METHODS We analyzed and processed neuroimaging data of 153 patients admitted with acute ischemic stroke. All patients underwent a NECT at admission and on follow-up. The developed algorithm identifies the early ischemic hypodense region based on an automatic comparison of the gray level in the images of the two hemispheres, assumed to be an approximate mirror image of each other in healthy patients. RESULTS In the two standard axial slices used to estimate the ASPECTs, the regions identified by the algorithm overlap significantly with those identified by experienced practitioners. However, in many patients, the regions identified automatically extend significantly to other slices. In these cases, the volume marker provides supplementary and independent information. Indeed, the clinical outcome of patients with volume marker = 0 can be distinguished with higher statistical confidence than the outcome of patients with ASPECTs = 10. CONCLUSION The volumetric extension and the location of acute ischemic region in the 3D-space, automatically identified by our algorithm, provide data that are mostly in agreement with the ASPECTs value estimated by expert practitioners, and in some cases complementary and independent.
Collapse
Affiliation(s)
- Mara Sabina Bernardi
- Molecular and Statistical Biophysics Group, International School for Advanced Studies (SISSA), Via Bonomea 265, 34136, Trieste, Italy
| | - Alex Rodriguez
- Molecular and Statistical Biophysics Group, International School for Advanced Studies (SISSA), Via Bonomea 265, 34136, Trieste, Italy
- Dipartimento di Matematica, Informatica e Geoscienze, Università degli studi di Trieste, via Valerio 12/1, 34127, Trieste, Italy
| | - Paola Caruso
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy
| | - Giovanni Furlanis
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy
| | - Mariana Ridolfi
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy
| | - Gabriele Prandin
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy.
| | - Marcello Naccarato
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy
| | - Alessandro Laio
- Molecular and Statistical Biophysics Group, International School for Advanced Studies (SISSA), Via Bonomea 265, 34136, Trieste, Italy
| | - Daniele Amati
- Molecular and Statistical Biophysics Group, International School for Advanced Studies (SISSA), Via Bonomea 265, 34136, Trieste, Italy
| | - Paolo Manganotti
- Clinical Unit of Neurology, Department of Medicine, Surgery and Health Sciences, University Hospital and Health Services of Trieste-ASUGI, University of Trieste, Strada di Fiume 447, 34149, Trieste, Italy
| |
Collapse
|
2
|
El Naamani K, Musmar B, Gupta N, Ikhdour O, Abdelrazeq H, Ghanem M, Wali MH, El-Hajj J, Alhussein A, Alhussein R, Tjoumakaris SI, Gooch MR, Rosenwasser RH, Jabbour PM, Herial NA. The Artificial Intelligence Revolution in Stroke Care: A Decade of Scientific Evidence in Review. World Neurosurg 2024; 184:15-22. [PMID: 38185459 DOI: 10.1016/j.wneu.2024.01.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 01/01/2024] [Accepted: 01/02/2024] [Indexed: 01/09/2024]
Abstract
BACKGROUND The emergence of artificial intelligence (AI) has significantly influenced the diagnostic evaluation of stroke and has revolutionized acute stroke care delivery. The scientific evidence evaluating the role of AI, especially in areas of stroke treatment and rehabilitation is limited but continues to accumulate. We performed a systemic review of current scientific evidence evaluating the use of AI in stroke evaluation and care and examined the publication trends during the past decade. METHODS A systematic search of electronic databases was conducted to identify all studies published from 2012 to 2022 that incorporated AI in any aspect of stroke care. Studies not directly relevant to stroke care in the context of AI and duplicate studies were excluded. The level of evidence and publication trends were examined. RESULTS A total of 623 studies were examined, including 101 reviews (16.2%), 9 meta-analyses (1.4%), 140 original articles on AI methodology (22.5%), 2 case reports (0.3%), 2 case series (0.3%), 31 case-control studies (5%), 277 cohort studies (44.5%), 16 cross-sectional studies (2.6%), and 45 experimental studies (7.2%). The highest published area of AI in stroke was diagnosis (44.1%) and the lowest was rehabilitation (12%). A 10-year trend analysis revealed a significant increase in AI literature in stroke care. CONCLUSIONS Most research on AI is in the diagnostic area of stroke care, with a recent noteworthy trend of increased research focus on stroke treatment and rehabilitation.
Collapse
Affiliation(s)
- Kareem El Naamani
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Basel Musmar
- School of Medicine, An-Najah National University, Nablus, Palestine
| | - Nithin Gupta
- Jerry M. Wallace School of Osteopathic Medicine, Campbell University, Lillington, North Carolina, USA
| | - Osama Ikhdour
- School of Medicine, An-Najah National University, Nablus, Palestine
| | | | - Marc Ghanem
- Gilbert and Rose-Marie Chaghoury School of Medicine, Lebanese American University, Byblos, Lebanon
| | - Murad H Wali
- College of Public Health, Temple University, Philadelphia, Pennsylvania, USA
| | - Jad El-Hajj
- School of Medicine, St. George's University, St. George, Grenada
| | - Abdulaziz Alhussein
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Reyoof Alhussein
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Stavropoula I Tjoumakaris
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Michael R Gooch
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Robert H Rosenwasser
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Pascal M Jabbour
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA
| | - Nabeel A Herial
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA.
| |
Collapse
|
3
|
Westwood M, Ramaekers B, Grimm S, Armstrong N, Wijnen B, Ahmadu C, de Kock S, Noake C, Joore M. Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis. Health Technol Assess 2024; 28:1-204. [PMID: 38512017 PMCID: PMC11017149 DOI: 10.3310/rdpa1487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024] Open
Abstract
Background Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. Objectives To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Methods Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. Results A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration This study is registered as PROSPERO CRD42021269609. Funding This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.
Collapse
Affiliation(s)
| | - Bram Ramaekers
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre (MUMC), Maastricht, Netherlands
| | | | | | - Ben Wijnen
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | | | | | - Caro Noake
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | - Manuela Joore
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre (MUMC), Maastricht, Netherlands
| |
Collapse
|
4
|
Río Bártulos C, Pirl L, Lier D, Planert M, Hohmann J, El Mountassir A, El Anwar M, Wiggermann P. Performance evaluation of two different software programs for automated ASPECTS scoring in patients with suspected stroke. Clin Hemorheol Microcirc 2024; 86:109-119. [PMID: 37638425 DOI: 10.3233/ch-238105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
BACKGROUND The range of software available to radiologists has increased enormously with the advancement of AI. A good example of this is software to determine ASPECTS in the treatment of potential stroke patients. OBJECTIVE In this study, two software packages (eASPECTS from Brainomix and VIA_ASPECTS from Siemens) were tested and compared for their performance in the daily clinical routine of a maximum care provider with a 24/7 stroke unit. METHODS A total of 637 noncontrast CT images were obtained from consecutive patients with suspected stroke, of whom 73 were finally diagnosed with MCA infarction. Differences in agreement and quantification of agreement were analysed, as well as the correlation and sensitivity, specificity and accuracy compared to raters. RESULTS Compared to VIA_ASPECTS, eASPECTS shows good agreement and strong correlation with the raters. VIA_ASPECTS has lower accuracy and low specificity than eASPECTS but a higher sensitivity. CONCLUSION Both software products have the potential to be decision support tools for radiologists. There are, however, differences between the two software products in terms of their intended use.
Collapse
Affiliation(s)
- Carolina Río Bártulos
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Lukas Pirl
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Dennis Lier
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Mathis Planert
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Juliane Hohmann
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Abdelouahed El Mountassir
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Mohamed El Anwar
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| | - Philipp Wiggermann
- Insitut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig gGmbH, Braunschweig, Germany
| |
Collapse
|
5
|
Mallon D, Fallon M, Blana E, McNamara C, Menon A, Ip CL, Garnham J, Yousry T, Cowley P, Simister R, Doig D. Real-world evaluation of Brainomix e-Stroke software. Stroke Vasc Neurol 2023:svn-2023-002859. [PMID: 38164621 DOI: 10.1136/svn-2023-002859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/28/2023] [Indexed: 01/03/2024] Open
Abstract
BACKGROUND AND PURPOSE Brainomix e-Stroke is an artificial intelligence-based decision support tool that aids the interpretation of CT imaging in the context of acute stroke. While e-Stroke has the potential to improve the speed and accuracy of diagnosis, real-world validation is essential. The aim of this study was to prospectively evaluate the performance of Brainomix e-Stroke in an unselected cohort of patients with suspected acute ischaemic stroke. METHODS The study cohort included all patients admitted to the University College London Hospital Hyperacute Stroke Unit between October 2021 and April 2022. For e-ASPECTS and e-CTA, the ground truth was determined by a neuroradiologist with access to all clinical and imaging data. For e-CTP, the values of the core infarct and ischaemic penumbra were compared with those derived from syngo.via, an alternate software used at our institution. RESULTS 1163 studies were performed in 551 patients admitted during the study period. Of these, 1130 (97.2%) were successfully processed by e-Stroke in an average of 4 min. For identifying acute middle cerebral artery territory ischaemia, e-ASPECTS had an accuracy of 77.0% and was more specific (83.5%) than sensitive (58.6%). The accuracy for identifying hyperdense thrombus was lower (69.1%), which was mainly due to many false positives (positive predictive value of 22.9%). Identification of acute haemorrhage was highly accurate (97.8%) with a sensitivity of 100% and a specificity of 97.6%; false positives were typically caused by areas of calcification. The accuracy of e-CTA for large vessel occlusions was 91.5%. The core infarct and ischaemic penumbra volumes provided by e-CTP strongly correlated with those provided by syngo.via (ρ=0.804-0.979). CONCLUSION Brainomix e-Stroke software provides rapid and reliable analysis of CT imaging in the acute stroke setting although, in line with the manufacturer's guidance, it should be used as an adjunct to expert interpretation rather than a standalone decision-making tool.
Collapse
Affiliation(s)
- Dermot Mallon
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
- UCL Queen Square Institute of Neurology, London, UK
| | - Matthew Fallon
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Eirini Blana
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Cillian McNamara
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Arathi Menon
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Chak Lam Ip
- Comprehensive Stroke Centre, University College London Hospitals NHS Foundation Trust, London, UK
| | - Jack Garnham
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Tarek Yousry
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
- UCL Queen Square Institute of Neurology, London, UK
| | - Peter Cowley
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
| | - Robert Simister
- UCL Queen Square Institute of Neurology, London, UK
- Comprehensive Stroke Centre, University College London Hospitals NHS Foundation Trust, London, UK
| | - David Doig
- Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, University College London Hospitals NHS Foundation Trust, London, UK
- UCL Queen Square Institute of Neurology, London, UK
| |
Collapse
|
6
|
Lee SJ, Park G, Kim D, Jung S, Song S, Hong JM, Shin DH, Lee JS. Clinical evaluation of a deep-learning model for automatic scoring of the Alberta stroke program early CT score on non-contrast CT. J Neurointerv Surg 2023; 16:61-66. [PMID: 37015781 PMCID: PMC10804033 DOI: 10.1136/jnis-2022-019970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 03/01/2023] [Indexed: 04/06/2023]
Abstract
BACKGROUND Automated measurement of the Alberta Stroke Program Early Computed Tomography Score (ASPECTS) can support clinical decision making. Based on a deep learning algorithm, we developed an automated ASPECTS scoring system (Heuron ASPECTS) and validated its performance in a prespecified clinical trial. METHODS For model training, we used non-contrast computed tomography images of 487 patients with acute ischemic stroke (AIS). For the clinical trial, 326 patients (87 with AIS, 56 with other acute brain diseases, and 183 with no brain disease) were enrolled. The results of Heuron ASPECTS were compared with the consensus generated by two stroke experts using the Bland-Altman agreement. A mean difference of less than 0.35 and a maximum allowed difference of less than 3.8 were considered the primary outcome target. The sensitivity and specificity of the model for the 10 regions of interest and dichotomized ASPECTS were calculated. RESULTS The Bland-Altman agreement had a mean difference of 0.03 [95% confidence interval (CI): -0.08 to 0.14], and the upper and lower limits of agreement were 2.80 [95% CI: 2.62 to 2.99] and -2.74 [95% CI: -2.92 to -2.55], respectively. For ASPECTS calculation, sensitivity and specificity to detect the early ischemic change for 10 ASPECTS regions were 62.78% [95% CI: 58.50 to 67.07] and 96.63% [95% CI: 96.18 to 97.09], respectively. Furthermore, in a dichotomized analysis (ASPECTS >4 vs. ≤4), the sensitivity and specificity were 94.01% [95% CI: 91.26 to 96.77] and 61.90% [95% CI: 47.22 to 76.59], respectively. CONCLUSIONS The current trial results show that Heuron ASPECTS reliably measures the ASPECTS for use in clinical practice.
Collapse
Affiliation(s)
- Seong-Joon Lee
- Department of Neurology, Ajou University School of Medicine, Suwon, Gyeonggi-do, South Korea
| | - Gyuha Park
- Research Division, Heuron Co., Ltd, Incheon, South Korea
| | - Dohyun Kim
- Research Division, Heuron Co., Ltd, Incheon, South Korea
| | - Sumin Jung
- Research Division, Heuron Co., Ltd, Incheon, South Korea
| | - Soohwa Song
- Research Division, Heuron Co., Ltd, Incheon, South Korea
| | - Ji Man Hong
- Department of Neurology, Ajou University School of Medicine, Suwon, Gyeonggi-do, South Korea
| | - Dong Hoon Shin
- Research Division, Heuron Co., Ltd, Incheon, South Korea
- Department of Neurology, Gachon University College of Medicine, Incheon, South Korea
| | - Jin Soo Lee
- Department of Neurology, Ajou University School of Medicine, Suwon, Gyeonggi-do, South Korea
| |
Collapse
|
7
|
Mohapatra S, Lee TH, Sahoo PK, Wu CY. Localization of early infarction on non-contrast CT images in acute ischemic stroke with deep learning approach. Sci Rep 2023; 13:19442. [PMID: 37945734 PMCID: PMC10636036 DOI: 10.1038/s41598-023-45573-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Accepted: 10/21/2023] [Indexed: 11/12/2023] Open
Abstract
Localization of early infarction on first-line Non-contrast computed tomogram (NCCT) guides prompt treatment to improve stroke outcome. Our previous study has shown a good performance in the identification of ischemic injury on NCCT. In the present study, we developed a deep learning (DL) localization model to help localize the early infarction sign on NCCT. This retrospective study included consecutive 517 ischemic stroke (IS) patients who received NCCT within 12 h after stroke onset. A total of 21,436 infarction patches and 20,391 non-infarction patches were extracted from the slice pool of 1,634 NCCT according to brain symmetricity property. The generated patches were fed into different pretrained convolutional neural network (CNN) models such as Visual Geometry Group 16 (VGG16), GoogleNet, Residual Networks 50 (ResNet50), Inception-ResNet-v2 (IR-v2), Inception-v3 and Inception-v4. The selected VGG16 model could detect the early infarction in both supratentorial and infratentorial regions to achieve an average area under curve (AUC) 0.73 after extensive customization. The properly tuned-VGG16 model could identify the early infarction in the cortical, subcortical and cortical plus subcortical areas of supratentorial region with the mean AUC > 0.70. Further, the model could attain 95.6% of accuracy on recognizing infarction lesion in 494 out of 517 IS patients.
Collapse
Affiliation(s)
- Sulagna Mohapatra
- Department of Computer Science and Information Engineering, Chang Gung University, 259, Wen-Hwa 1st Road, Guishan, Taoyuan, 33302, Taiwan
| | - Tsong-Hai Lee
- Department of Neurology, Chang Gung Memorial Hospital, Linkou Medical Center, No. 5, Fu-Hsing street, Guishan, Taoyuan, 333, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Prasan Kumar Sahoo
- Department of Computer Science and Information Engineering, Chang Gung University, 259, Wen-Hwa 1st Road, Guishan, Taoyuan, 33302, Taiwan.
- Department of Neurology, Chang Gung Memorial Hospital, Linkou Medical Center, No. 5, Fu-Hsing street, Guishan, Taoyuan, 333, Taiwan.
| | - Ching-Yi Wu
- Department of Occupational Therapy and Graduate Institute of Behavioral Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| |
Collapse
|
8
|
Gilotra K, Swarna S, Mani R, Basem J, Dashti R. Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease. Front Hum Neurosci 2023; 17:1254417. [PMID: 37746051 PMCID: PMC10516608 DOI: 10.3389/fnhum.2023.1254417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 08/23/2023] [Indexed: 09/26/2023] Open
Abstract
Introduction Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms. Methods We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice. Results The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers. Conclusion The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.
Collapse
Affiliation(s)
| | | | | | | | - Reza Dashti
- Dashti Lab, Department of Neurological Surgery, Stony Brook University Hospital, Stony Brook, NY, United States
| |
Collapse
|
9
|
Wagner DT, Tilmans L, Peng K, Niedermeier M, Rohl M, Ryan S, Yadav D, Takacs N, Garcia-Fraley K, Koso M, Dikici E, Prevedello LM, Nguyen XV. Artificial Intelligence in Neuroradiology: A Review of Current Topics and Competition Challenges. Diagnostics (Basel) 2023; 13:2670. [PMID: 37627929 PMCID: PMC10453240 DOI: 10.3390/diagnostics13162670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 08/07/2023] [Accepted: 08/09/2023] [Indexed: 08/27/2023] Open
Abstract
There is an expanding body of literature that describes the application of deep learning and other machine learning and artificial intelligence methods with potential relevance to neuroradiology practice. In this article, we performed a literature review to identify recent developments on the topics of artificial intelligence in neuroradiology, with particular emphasis on large datasets and large-scale algorithm assessments, such as those used in imaging AI competition challenges. Numerous applications relevant to ischemic stroke, intracranial hemorrhage, brain tumors, demyelinating disease, and neurodegenerative/neurocognitive disorders were discussed. The potential applications of these methods to spinal fractures, scoliosis grading, head and neck oncology, and vascular imaging were also reviewed. The AI applications examined perform a variety of tasks, including localization, segmentation, longitudinal monitoring, diagnostic classification, and prognostication. While research on this topic is ongoing, several applications have been cleared for clinical use and have the potential to augment the accuracy or efficiency of neuroradiologists.
Collapse
Affiliation(s)
- Daniel T. Wagner
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Luke Tilmans
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Kevin Peng
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | | | - Matt Rohl
- College of Arts and Sciences, The Ohio State University, Columbus, OH 43210, USA
| | - Sean Ryan
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Divya Yadav
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Noah Takacs
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Krystle Garcia-Fraley
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Mensur Koso
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Engin Dikici
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Luciano M. Prevedello
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Xuan V. Nguyen
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| |
Collapse
|
10
|
Lambert J, Demeestere J, Dewachter B, Cockmartin L, Wouters A, Symons R, Boomgaert L, Vandewalle L, Scheldeman L, Demaerel P, Lemmens R. Performance of Automated ASPECTS Software and Value as a Computer-Aided Detection Tool. AJNR Am J Neuroradiol 2023; 44:894-900. [PMID: 37500286 PMCID: PMC10411841 DOI: 10.3174/ajnr.a7956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 06/14/2023] [Indexed: 07/29/2023]
Abstract
BACKGROUND AND PURPOSE ASPECTS quantifies early ischemic changes in anterior circulation stroke on NCCT but has interrater variability. We examined the agreement of conventional and automated ASPECTS and studied the value of computer-aided detection. MATERIALS AND METHODS We retrospectively collected imaging data from consecutive patients with acute ischemic stroke with large-vessel occlusion undergoing thrombectomy. Five raters scored conventional ASPECTS on baseline NCCTs, which were also processed by RAPID software. Conventional and automated ASPECTS were compared with a consensus criterion standard. We determined the agreement over the full ASPECTS range as well as dichotomized, reflecting thrombectomy eligibility according to the guidelines (ASPECTS 0-5 versus 6-10). Raters subsequently scored ASPECTS on the same NCCTs with assistance of the automated ASPECTS outputs, and agreement was obtained. RESULTS For the total of 175 cases, agreement among raters individually and the criterion standard varied from fair to good (weighted κ = between 0.38 and 0.76) and was moderate (weighted κ = 0.59) for the automated ASPECTS. The agreement of all raters individually versus the criterion standard improved with software assistance, as did the interrater agreement (overall Fleiss κ = 0.15-0.23; P < .001 and .39 to .55; P = .01 for the dichotomized ASPECTS). CONCLUSIONS Automated ASPECTS had agreement with the criterion standard similar to that of conventional ASPECTS. However, including automated ASPECTS during the evaluation of NCCT in acute stroke improved the agreement with the criterion standard and improved interrater agreement, which could, therefore, result in more uniform scoring in clinical practice.
Collapse
Affiliation(s)
- J Lambert
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
- Departments of Imaging and Pathology (J.L., B.D., P.D.)
- Neuroscience (J.D., A.W., L.V., L.S., R.L.)
| | - J Demeestere
- Neurology (J.D., L.V., L.S., R.S.), University Hospitals Leuven, Leuven, Belgium
- Experimental Neurology (J.D., A.W., L.V., L.S., R.L.), Laboratory of Neurobiology, Katholieke Universiteit Leuven, University of Leuven, Leuven, Belgium
| | - B Dewachter
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
- Departments of Imaging and Pathology (J.L., B.D., P.D.)
| | - L Cockmartin
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
| | - A Wouters
- Neuroscience (J.D., A.W., L.V., L.S., R.L.)
- Experimental Neurology (J.D., A.W., L.V., L.S., R.L.), Laboratory of Neurobiology, Katholieke Universiteit Leuven, University of Leuven, Leuven, Belgium
| | - R Symons
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
- Imelda Hospital (R.S.), Bonheiden, Belgium
| | - L Boomgaert
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
| | - L Vandewalle
- Neurology (J.D., L.V., L.S., R.S.), University Hospitals Leuven, Leuven, Belgium
- Neuroscience (J.D., A.W., L.V., L.S., R.L.)
- Experimental Neurology (J.D., A.W., L.V., L.S., R.L.), Laboratory of Neurobiology, Katholieke Universiteit Leuven, University of Leuven, Leuven, Belgium
| | - L Scheldeman
- Neurology (J.D., L.V., L.S., R.S.), University Hospitals Leuven, Leuven, Belgium
- Neuroscience (J.D., A.W., L.V., L.S., R.L.)
- Experimental Neurology (J.D., A.W., L.V., L.S., R.L.), Laboratory of Neurobiology, Katholieke Universiteit Leuven, University of Leuven, Leuven, Belgium
| | - P Demaerel
- From the Departments of Radiology (J.L., B.D., L.C., R.S., L. B., P.D.)
- Departments of Imaging and Pathology (J.L., B.D., P.D.)
| | - R Lemmens
- Neurology (J.D., L.V., L.S., R.S.), University Hospitals Leuven, Leuven, Belgium
- Neuroscience (J.D., A.W., L.V., L.S., R.L.)
- Experimental Neurology (J.D., A.W., L.V., L.S., R.L.), Laboratory of Neurobiology, Katholieke Universiteit Leuven, University of Leuven, Leuven, Belgium
| |
Collapse
|
11
|
Wu Y, Sun R, Xie Y, Nie S. Automatic Alberta Stroke Program Early Computed Tomographic Scoring in patients with acute ischemic stroke using diffusion-weighted imaging. Med Biol Eng Comput 2023:10.1007/s11517-023-02867-2. [PMID: 37347402 DOI: 10.1007/s11517-023-02867-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 06/08/2023] [Indexed: 06/23/2023]
Abstract
Alberta Stroke Program Early Computed Tomographic Scoring (ASPECTS) is a reliable method for assessing early ischemic changes in the blood supply area of the middle cerebral artery in patients with acute ischemic stroke. This study aims to propose a deep learning based automatic evaluation strategy for DWI-ASPECTS to serve as a reference for clinicians in urgent decision making for endovascular thrombectomy. Ten ASPECTS regions are extracted from the DWI series to train the independent classification network for each region, the accurate training labels of which are confirmed by neuroradiologists. Two classical convolutional neural networks (VGG-16 and ResNet-50) are validated. Subsequently, the innovative CBAM-VGG is designed to improve the accurate scoring of four small-volume DWI-ASPECTS regions, including caudate nucleus, lenticular nucleus, internal capsule, and insular lobe. Average F1-score of 0.929 and 0.840 and the average accuracy of 94.75% and 84.99% are obtained when scoring on six cortical regions M1-M6 and four small ASPECTS regions, respectively. In addition, the modified algorithm CBAM-VGG shows a significant improvement in the accuracy of estimating the four ASPECTS regions with smaller volumes. The experimental results demonstrate that the deep learning methods facilitate the efficiency and robustness of automatic DWI-ASPECTS scoring, which can provide a reference for clinical decision-making.
Collapse
Affiliation(s)
- Yan Wu
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China
| | - Rong Sun
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China
| | - Yuanzhong Xie
- Medical Imaging Center, Tai'an Central Hospital, Shandong, China
| | - Shengdong Nie
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China.
| |
Collapse
|
12
|
Ghozy S, Azzam AY, Kallmes KM, Matsoukas S, Fifi JT, Luijten SPR, van der Lugt A, Adusumilli G, Heit JJ, Kadirvel R, Kallmes DF. The diagnostic performance of artificial intelligence algorithms for identifying M2 segment middle cerebral artery occlusions: A systematic review and meta-analysis. J Neuroradiol 2023; 50:449-454. [PMID: 36773845 DOI: 10.1016/j.neurad.2023.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 01/30/2023] [Accepted: 02/01/2023] [Indexed: 02/11/2023]
Abstract
BACKGROUND Artificial intelligence (AI)-based algorithms have been developed to facilitate rapid and accurate computed tomography angiography (CTA) assessment in proximal large vessel occlusion (LVO) acute ischemic stroke, including internal carotid artery and M1 occlusions. In clinical practice, however, the detection of medium vessel occlusion (MeVO) represents an ongoing diagnostic challenge in which the added value of AI remains unclear. PURPOSE To assess the diagnostic performance of AI platforms for detecting M2 occlusions. METHODS Studies that report the diagnostic performance of AI-based detection of M2 occlusions were screened, and sensitivity and specificity data were extracted using the semi-automated AutoLit software (Nested Knowledge, MN) platform. STATA (version 16 IC; Stata Corporation, College Station, Texas, USA) was used to conduct all analyses. RESULTS Eight studies with a low risk of bias and significant heterogeneity were included in the quantitative and qualitative synthesis. The pooled estimates of sensitivity and specificity of AI platforms for M2 occlusion detection were 64% (95% CI, 53 to 74%) and 97% (95% CI, 84 to 100%), respectively. The area under the curve (AUC) in the SROC curve was 0.79 (95% CI, 0.74 to 0.83). CONCLUSION The current performance of the AI-based algorithm makes it more suitable as an adjunctive confirmatory tool rather than as an independent one for M2 occlusions. With the rapid development of such algorithms, it is anticipated that newer generations will likely perform much better.
Collapse
Affiliation(s)
- Sherief Ghozy
- Department of Radiology, Mayo Clinic, Rochester, MN, USA; Nuffield Department of Primary Care Health Sciences and Department for Continuing Education (EBHC program), Oxford University, Oxford, UK.
| | | | - Kevin M Kallmes
- Nested Knowledge, St. Paul MN, USA; Superior Medical Experts, St. Paul MN, USA
| | - Stavros Matsoukas
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Johanna T Fifi
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA; Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA; Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Sven P R Luijten
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Aad van der Lugt
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | | | - Jeremy J Heit
- Departments of Neuroradiology and Neurosurgery, Stanford University, Palo Alto, CA, USA
| | - Ramanathan Kadirvel
- Department of Radiology, Mayo Clinic, Rochester, MN, USA; Department of Neurologic Surgery, Mayo Clinic, Rochester, MN, USA
| | | |
Collapse
|
13
|
Miceli G, Basso MG, Rizzo G, Pintus C, Cocciola E, Pennacchio AR, Tuttolomondo A. Artificial Intelligence in Acute Ischemic Stroke Subtypes According to Toast Classification: A Comprehensive Narrative Review. Biomedicines 2023; 11:biomedicines11041138. [PMID: 37189756 DOI: 10.3390/biomedicines11041138] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 03/29/2023] [Accepted: 04/06/2023] [Indexed: 05/17/2023] Open
Abstract
The correct recognition of the etiology of ischemic stroke (IS) allows tempestive interventions in therapy with the aim of treating the cause and preventing a new cerebral ischemic event. Nevertheless, the identification of the cause is often challenging and is based on clinical features and data obtained by imaging techniques and other diagnostic exams. TOAST classification system describes the different etiologies of ischemic stroke and includes five subtypes: LAAS (large-artery atherosclerosis), CEI (cardio embolism), SVD (small vessel disease), ODE (stroke of other determined etiology), and UDE (stroke of undetermined etiology). AI models, providing computational methodologies for quantitative and objective evaluations, seem to increase the sensitivity of main IS causes, such as tomographic diagnosis of carotid stenosis, electrocardiographic recognition of atrial fibrillation, and identification of small vessel disease in magnetic resonance images. The aim of this review is to provide overall knowledge about the most effective AI models used in the differential diagnosis of ischemic stroke etiology according to the TOAST classification. According to our results, AI has proven to be a useful tool for identifying predictive factors capable of subtyping acute stroke patients in large heterogeneous populations and, in particular, clarifying the etiology of UDE IS especially detecting cardioembolic sources.
Collapse
Affiliation(s)
- Giuseppe Miceli
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Maria Grazia Basso
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Giuliana Rizzo
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Chiara Pintus
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Elena Cocciola
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Andrea Roberta Pennacchio
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| | - Antonino Tuttolomondo
- Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (ProMISE), Università Degli Studi di Palermo, Piazza Delle Cliniche 2, 90127 Palermo, Italy
- Internal Medicine and Stroke Care Ward, University Hospital, Policlinico "P. Giaccone", 90141 Palermo, Italy
| |
Collapse
|
14
|
Chen W, Wu J, Wei R, Wu S, Xia C, Wang D, Liu D, Zheng L, Zou T, Li R, Qi X, Zhang X. Improving the diagnosis of acute ischemic stroke on non-contrast CT using deep learning: a multicenter study. Insights Imaging 2022; 13:184. [PMID: 36471022 PMCID: PMC9723089 DOI: 10.1186/s13244-022-01331-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Accepted: 11/11/2022] [Indexed: 12/12/2022] Open
Abstract
OBJECTIVE This study aimed to develop a deep learning (DL) model to improve the diagnostic performance of EIC and ASPECTS in acute ischemic stroke (AIS). METHODS Acute ischemic stroke patients were retrospectively enrolled from 5 hospitals. We proposed a deep learning model to simultaneously segment the infarct and estimate ASPECTS automatically using baseline CT. The model performance of segmentation and ASPECTS scoring was evaluated using dice similarity coefficient (DSC) and ROC, respectively. Four raters participated in the multi-reader and multicenter (MRMC) experiment to fulfill the region-based ASPECTS reading under the assistance of the model or not. At last, sensitivity, specificity, interpretation time and interrater agreement were used to evaluate the raters' reading performance. RESULTS In total, 1391 patients were enrolled for model development and 85 patients for external validation with onset to CT scanning time of 176.4 ± 93.6 min and NIHSS of 5 (IQR 2-10). The model achieved a DSC of 0.600 and 0.762 and an AUC of 0.876 (CI 0.846-0.907) and 0.729 (CI 0.679-0.779), in the internal and external validation set, respectively. The assistance of the DL model improved the raters' average sensitivities and specificities from 0.254 (CI 0.22-0.26) and 0.896 (CI 0.884-0.907), to 0.333 (CI 0.301-0.345) and 0.915 (CI 0.904-0.926), respectively. The average interpretation time of the raters was reduced from 219.0 to 175.7 s (p = 0.035). Meanwhile, the interrater agreement increased from 0.741 to 0.980. CONCLUSIONS With the assistance of our proposed DL model, radiologists got better performance in the detection of AIS lesions on NCCT.
Collapse
Affiliation(s)
- Weidao Chen
- grid.13402.340000 0004 1759 700XInterdisciplinary Institute of Neuroscience and Technology, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, 310027 Zhejiang China ,Infervision Institute of Research, Beijing, 100025 China
| | - Jiangfen Wu
- grid.11135.370000 0001 2256 9319Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China ,Infervision Institute of Research, Beijing, 100025 China
| | - Ren Wei
- Infervision Institute of Research, Beijing, 100025 China
| | - Shuang Wu
- Infervision Institute of Research, Beijing, 100025 China
| | - Chen Xia
- Infervision Institute of Research, Beijing, 100025 China
| | - Dawei Wang
- Infervision Institute of Research, Beijing, 100025 China
| | - Daliang Liu
- grid.415912.a0000 0004 4903 149XLiaocheng People’s Hospital, Liaocheng, 252000 Shandong China
| | - Longmei Zheng
- Medical Imaging Center, Ankang Central Hospital, Ankang, 725000 Shanxi China
| | - Tianyu Zou
- grid.478119.20000 0004 1757 8159Weihai Municipal Hospital, Weihai, 264200 Shandong China
| | - Ruijiang Li
- grid.168010.e0000000419368956Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA 94304 USA
| | - Xianrong Qi
- grid.11135.370000 0001 2256 9319School of Pharmaceutical Sciences, Peking University, Beijing, 100191 China ,grid.11135.370000 0001 2256 9319Beijing Key Laboratory of Molecular Pharmaceutics and New Drug Delivery System, School of Pharmaceutical Sciences, Peking University, Beijing, 100191 China
| | - Xiaotong Zhang
- grid.13402.340000 0004 1759 700XInterdisciplinary Institute of Neuroscience and Technology, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, 310027 Zhejiang China ,grid.13402.340000 0004 1759 700XCollege of Electrical Engineering, Zhejiang University, Hangzhou, 310000 Zhejiang China ,grid.13402.340000 0004 1759 700XMOE Frontier Science Center for Brain Science & Brain-machine Integration, Zhejiang University, Hangzhou, 310000 Zhejiang China
| |
Collapse
|
15
|
Mair G, White P, Bath PM, Muir KW, Al‐Shahi Salman R, Martin C, Dye D, Chappell FM, Vacek A, von Kummer R, Macleod M, Sprigg N, Wardlaw JM. External Validation of e-ASPECTS Software for Interpreting Brain CT in Stroke. Ann Neurol 2022; 92:943-957. [PMID: 36053916 PMCID: PMC9826303 DOI: 10.1002/ana.26495] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 07/08/2022] [Accepted: 08/29/2022] [Indexed: 01/11/2023]
Abstract
OBJECTIVE The purpose of this study was to test e-ASPECTS software in patients with stroke. Marketed as a decision-support tool, e-ASPECTS may detect features of ischemia or hemorrhage on computed tomography (CT) imaging and quantify ischemic extent using Alberta Stroke Program Early CT Score (ASPECTS). METHODS Using CT from 9 stroke studies, we compared software with masked experts. As per indications for software use, we assessed e-ASPECTS results for patients with/without middle cerebral artery (MCA) ischemia but no other cause of stroke. In an analysis outside the intended use of the software, we enriched our dataset with non-MCA ischemia, hemorrhage, and mimics to simulate a representative "front door" hospital population. With final diagnosis as the reference standard, we tested the diagnostic accuracy of e-ASPECTS for identifying stroke features (ischemia, hyperattenuated arteries, and hemorrhage) in the representative population. RESULTS We included 4,100 patients (51% women, median age = 78 years, National Institutes of Health Stroke Scale [NIHSS] = 10, onset to scan = 2.5 hours). Final diagnosis was ischemia (78%), hemorrhage (14%), or mimic (8%). From 3,035 CTs with expert-rated ASPECTS, most (2084/3035, 69%) e-ASPECTS results were within one point of experts. In the representative population, the diagnostic accuracy of e-ASPECTS was 71% (95% confidence interval [CI] = 70-72%) for detecting ischemic features, 85% (83-86%) for hemorrhage. Software identified more false positive ischemia (12% vs 2%) and hemorrhage (14% vs <1%) than experts. INTERPRETATION On independent testing, e-ASPECTS provided moderate agreement with experts and overcalled stroke features. Therefore, future prospective trials testing impacts of artificial intelligence (AI) software on patient care and outcome are required before widespread implementation of stroke decision-support software. ANN NEUROL 2022;92:943-957.
Collapse
Affiliation(s)
- Grant Mair
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
| | - Philip White
- Translational and Clinical Research InstituteNewcastle University and Newcastle upon Tyne Hospitals NHS TrustNewcastle upon TyneUK
| | - Philip M. Bath
- Stroke Trials Unit, Mental Health & Clinical NeuroscienceUniversity of NottinghamNottinghamUK
| | - Keith W. Muir
- School of Psychology & NeuroscienceUniversity of GlasgowGlasgowUK
| | | | - Chloe Martin
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
| | - David Dye
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
| | | | - Adam Vacek
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
| | - Rüdiger von Kummer
- Department of NeuroradiologyUniversity Hospital, Technische Universität DresdenDresdenGermany
| | - Malcolm Macleod
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
| | - Nikola Sprigg
- Translational and Clinical Research InstituteNewcastle University and Newcastle upon Tyne Hospitals NHS TrustNewcastle upon TyneUK
| | - Joanna M. Wardlaw
- Centre for Clinical Brain SciencesUniversity of EdinburghEdinburghUK
- UK Dementia Research Institute Centre at the University of EdinburghEdinburghUK
| |
Collapse
|
16
|
The Utility of Automated ASPECTS in Acute Ischemic Stroke for Intravenous Recombinant Tissue Plasminogen Activator (IV-rtPA) Therapy. Neurol Int 2022; 14:981-990. [PMID: 36412699 PMCID: PMC9680239 DOI: 10.3390/neurolint14040077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 11/13/2022] [Accepted: 11/14/2022] [Indexed: 11/23/2022] Open
Abstract
PURPOSE This study aimed to investigate the accuracy and clinical significance of an artificial intelligence (AI)-based automated Alberta Stroke Program Early Computed Tomography (ASPECT) scoring software of head CT for the indication of intravenous recombinant tissue plasminogen activator (rt-PA) therapy. METHODS This study included two populations of acute ischemic stroke: one comprised patients who had undergone head CT within 48 h of presentation (Population #1, n = 448), while the other included patients within 4.5 h from onset (Population #2, n = 132). The primary endpoint was the concordance rate of ASPECTS of the neurologists and AI software against the benchmark score. The secondary endpoints were to validate the accuracy of the neurologist and AI software in assessing the ability to rule out extensive infarction (ASPECTS of 0-5) in population #2. RESULTS The reading accuracy of AI software was comparable to that of the board-certified vascular neurologists. The detection rate of cardiogenic cerebral embolism was better than that of atherothrombotic cerebral infarction. By excluding extensive infarction, AI-software showed a higher specificity and equivalent sensitivity compared to those of experts. CONCLUSIONS The AI software for ASPECTS showed convincing agreement with expert evaluation and would be supportive in determining the indications of intravenous rt-PA therapy.
Collapse
|
17
|
Cui L, Fan Z, Yang Y, Liu R, Wang D, Feng Y, Lu J, Fan Y. Deep Learning in Ischemic Stroke Imaging Analysis: A Comprehensive Review. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2456550. [PMID: 36420096 PMCID: PMC9678444 DOI: 10.1155/2022/2456550] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 09/27/2022] [Accepted: 10/20/2022] [Indexed: 09/15/2023]
Abstract
Ischemic stroke is a cerebrovascular disease with a high morbidity and mortality rate, which poses a serious challenge to human health and life. Meanwhile, the management of ischemic stroke remains highly dependent on manual visual analysis of noncontrast computed tomography (CT) or magnetic resonance imaging (MRI). However, artifacts and noise of the equipment as well as the radiologist experience play a significant role on diagnostic accuracy. To overcome these defects, the number of computer-aided diagnostic (CAD) methods for ischemic stroke is increasing substantially during the past decade. Particularly, deep learning models with massive data learning capabilities are recognized as powerful auxiliary tools for the acute intervention and guiding prognosis of ischemic stroke. To select appropriate interventions, facilitate clinical practice, and improve the clinical outcomes of patients, this review firstly surveys the current state-of-the-art deep learning technology. Then, we summarized the major applications in acute ischemic stroke imaging, particularly in exploring the potential function of stroke diagnosis and multimodal prognostication. Finally, we sketched out the current problems and prospects.
Collapse
Affiliation(s)
- Liyuan Cui
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Zhiyuan Fan
- Centre of Intelligent Medical Technology and Equipment, Binjiang Institute of Zhejiang University, Hangzhou, Zhejiang, China
| | - Yingjian Yang
- School of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Rui Liu
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Dajiang Wang
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Yingying Feng
- School of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Jiahui Lu
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Yifeng Fan
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| |
Collapse
|
18
|
Prognosis with non-contrast CT and CT Perfusion imaging in thrombolysis-treated acute ischemic stroke. Eur J Radiol 2022; 149:110217. [DOI: 10.1016/j.ejrad.2022.110217] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 01/13/2022] [Accepted: 02/10/2022] [Indexed: 11/21/2022]
|
19
|
Li X, Zhen Y, Liu H, Zeng W, Li Y, Liu L, Yang R. Automated ASPECTS in acute ischemic stroke: comparison of the overall scores and Hounsfield unit values of two software packages and radiologists with different levels of experience. Acta Radiol 2022; 64:328-335. [PMID: 35118879 DOI: 10.1177/02841851221075789] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND ASPECTS is a simple, rapid, and semi-quantitative method for detecting early ischemic changes (EIC). However, the agreement between software applications and neuroradiologists varies greatly. PURPOSE To compare ASPECTS calculated by using automated software tools to neuroradiologists evaluation in patients with acute ischemic stroke (AIS). MATERIAL AND METHODS Retrospectively, 61 patients with large vessel occlusion (LVO) who underwent multimodal stroke computed tomography (CT) were evaluated using two automated ASPECTS software tools (NSK and RAPID) and three neuroradiologists with different experiences (two senior neuroradiologists and one junior neuroradiologist). Four weeks later, the same three neuroradiologists re-evaluated the ASPECTS in consensus using the baseline CT and follow-up non-contrast CT (NCCT). Interclass correlation coefficients (ICCs) and Pearson correlation coefficients were applied for statistical analysis. RESULTS The HU value exhibited the greatest correlation in the insular lobe (r = 0.81; P < 0.001) and the lowest correlation in the internal capsule (r = 0.65; P < 0.001) between NSK and RAPID. Software analysis and human readers showed excellent agreement with the consensus reading. Compared with the consensus reading, the correlation of the two senior radiologists (ICC = 0.975 and 0.969, respectively) were higher than that of junior radiologist (ICC = 0.869), and the consistency values of the NSK and RAPID software tools after 6 h of onset to imaging (ICC = 0.894 and 0.874, respectively) were greater than those within 6 h of onset (ICC = 0.746 and 0.828, respectively). CONCLUSION For patients experiencing AIS due to LVO, the ASPECTS calculated with automated software agrees well with the predefined consensus score but is inferior to that of senior radiologists.
Collapse
Affiliation(s)
- Xiang Li
- Department of Radiology, Chongqing University Three Gorges Hospital, Chongqing, PR China
| | - Yanling Zhen
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Sichuan, PR China
| | - Huan Liu
- GE Healthcare, Shanghai, PR China
| | - Wenbing Zeng
- Department of Radiology, Chongqing University Three Gorges Hospital, Chongqing, PR China
| | - Yige Li
- GE Healthcare, Shanghai, PR China
| | - Ling Liu
- GE Healthcare, Shanghai, PR China
| | - Ran Yang
- Department of Radiology, Chongqing University Three Gorges Hospital, Chongqing, PR China
| |
Collapse
|
20
|
Impact of Encephalomalacia and White Matter Hyperintensities on ASPECTS in Patients With Acute Ischemic Stroke: Comparison of Automated- and Radiologist-Derived Scores. AJR Am J Roentgenol 2021; 218:878-887. [PMID: 34910537 DOI: 10.2214/ajr.21.26819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Background: Automated software-based Alberta Stroke Program Early CT Score (ASPECTS) on unenhanced CT is associated with clinical outcomes after acute stroke. However, encephalomalacia or white matter hyperintensities (WMHs) may result in a falsely low automated ASPECTS if such findings are interpreted as early ischemia. Objective: To assess the impact of encephalomalacia and WMH on automated ASPECTS in patients with acute stroke, in comparison with radiologist-derived ASPECTS and clinical outcomes. Methods: This retrospective three-center study included 459 patients (322 men, 137 women; median age, 65 years) with acute ischemic stroke treated by IV thrombolysis who underwent baseline unenhanced CT within 6 hours after symptom onset and MRI within 24 hours after treatment. ASPECTS was determined by automated software and by three radiologists in consensus. Presence of encephalomalacia and extent of WMHs [categorized using the modified Scheltens scale (mSS)] were also determined using MRI. Kappa coefficients were used to compare ASPECTS between automated and radiologist-consensus methods. Multivariable logistic regression analyses and ROC analyses were performed to explore the predictive utility of baseline ASPECTS for unfavorable clinical outcome (90-day modified Rankin Scale score of 3-6) after thrombolysis. Results: Median automated ASPECTS was 9, and median radiologist-consensus ASPECTS was 10. Agreement between automated and radiologist-consensus ASPECTS, expressed as kappa, was 0.68, though was 0.76 in patients without encephalomalacia and 0.08 in patients with encephalomalacia. In patients without encephalomalacia, agreement decreased as the mSS score increased (e.g., 0.78 in subgroup with mSS score <10 vs 0.19 in subgroup with mSS >20). By anatomic region, agreement was highest for M5 (κ=0.52) and lowest for internal capsule (κ=0.18). In multivariable analyses, both automated (odds ratio=0.69) and radiologist-consensus (odds ratio=0.57) ASPECTS independently predicted unfavorable clinical outcome. For unfavorable outcome, automated ASPECTS had AUC of 0.70, sensitivity of 60.4%, and specificity of 71.0%, while radiologist-consensus ASPECTS had AUC of 0.72, sensitivity of 60.4%, and specificity of 80.5%. Conclusion: Presence of encephalomalacia or extensive WMH results in lower automated ASPECTS than radiologist-consensus ASPECTS, which may impact predictive utility of automated ASPECTS. Clinical Impact: When using automated ASPECTS, radiologists should manually confirm the score in patients with encephalomalacia or extensive leukoencephalopathy.
Collapse
|
21
|
Automated detection and segmentation of intracranial hemorrhage suspect hyperdensities in non-contrast-enhanced CT scans of acute stroke patients. Eur Radiol 2021; 32:2246-2254. [PMID: 34773465 PMCID: PMC8921016 DOI: 10.1007/s00330-021-08352-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 09/03/2021] [Accepted: 09/22/2021] [Indexed: 01/01/2023]
Abstract
Objectives Artif
icial intelligence (AI)–based image analysis is increasingly applied in the acute stroke field. Its implementation for the detection and quantification of hemorrhage suspect hyperdensities in non-contrast-enhanced head CT (NCCT) scans may facilitate clinical decision-making and accelerate stroke management. Methods NCCTs of 160 patients with suspected acute stroke were analyzed regarding the presence or absence of acute intracranial hemorrhages (ICH) using a novel AI-based algorithm. Read was performed by two blinded neuroradiology residents (R1 and R2). Ground truth was established by an expert neuroradiologist. Specificity, sensitivity, and area under the curve were calculated for ICH and intraparenchymal hemorrhage (IPH) detection. IPH-volumes were segmented and quantified automatically by the algorithm and semi-automatically. Intraclass correlation coefficient (ICC) and Dice coefficient (DC) were calculated. Results In total, 79 of 160 patients showed acute ICH, while 47 had IPH. Sensitivity and specificity for ICH detection were 0.91 and 0.89 for the algorithm; 0.99 and 0.98 for R1; and 1.00 and 0.98 for R2. Sensitivity and specificity for IPH detection were 0.98 and 0.89 for the algorithm; 0.83 and 0.99 for R1; and 0.91 and 0.99 for R2. Interreader reliability for ICH and IPH detection showed strong agreements for the algorithm (0.80 and 0.84), R1 (0.96 and 0.84), and R2 (0.98 and 0.92), respectively. ICC indicated an excellent (0.98) agreement between the algorithm and the reference standard of the IPH-volumes. The mean DC was 0.82. Conclusion The AI-based algorithm reliably assessed the presence or absence of acute ICHs in this dataset and quantified IPH volumes precisely. Key Points • Artificial intelligence (AI) is able to detect hyperdense volumes on brain CTs reliably. • Sensitivity and specificity are highest for the detection of intraparenchymal hemorrhages. • Interreader reliability for hemorrhage detection shows strong agreement for AI and human readers. Supplementary Information The online version contains supplementary material available at 10.1007/s00330-021-08352-4.
Collapse
|
22
|
Dyer T, Chawda S, Alkilani R, Morgan TN, Hughes M, Rasalingham S. Validation of an artificial intelligence solution for acute triage and rule-out normal of non-contrast CT head scans. Neuroradiology 2021; 64:735-743. [PMID: 34623478 DOI: 10.1007/s00234-021-02826-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Accepted: 09/10/2021] [Indexed: 11/29/2022]
Abstract
PURPOSE Non-contrast CT head scans provide rapid and accurate diagnosis of acute head injury; however, increased utilisation of CT head scans makes it difficult to prioritise acutely unwell patients and places pressure on busy emergency departments (EDs). This study validates an AI algorithm to triage patients presenting with Intracranial Haemorrhage (ICH) or Acute Infarct whilst also identifying a subset of patients as Normal, with the potential to function as a rule-out test. METHODS In total, 390 CT head scans were collected from 3 institutions in the UK, US and India. Ground-truth labels were assigned by 3 FRCR consultant radiologists. AI performance, as well as the performance of 3 independent radiologists, was measured against ground-truth labels. RESULTS The algorithm showed AUC values of 0.988 (0.978-0.994), 0.933 (0.901-0.961) and 0.939 (0.919-0.958) for ICH, Acute Infarct and Normal, respectively. Sensitivity/specificity for ICH and Acute Infarct were 0.988/0.925 and 0.833/0.927, respectively, compared to 0.907/0.991 and 0.618/0.977 for radiologists. AI rule-out of Normal scans achieved 0.93% negative predictive value (NPV) for the removal of 54.3% of Normal cases, compared to 86.8% NPV for radiologists. CONCLUSION We show our algorithm can provide effective triage of ICH and Acute Infarct to prioritise acutely unwell patients. AI can also benefit clinical accuracy, with the algorithm identifying 91.3% of radiologist false negatives for ICH and 69.1% for Acute Infarct. Rule-out of Normal scans has huge potential for workload management in busy EDs, in this case removing 27.4% of all scans with no acute findings missed.
Collapse
Affiliation(s)
- Tom Dyer
- Behold.ai, 180 Borough high St, London, SE1 1LB, UK.
| | - Sanjiv Chawda
- Department of Radiology, Barking, Havering and Redbridge University Hospitals NHS Trust, Romford, RM7 0AG, UK
| | - Raed Alkilani
- Department of Radiology, Barking, Havering and Redbridge University Hospitals NHS Trust, Romford, RM7 0AG, UK
| | | | - Mike Hughes
- Behold.ai, 180 Borough high St, London, SE1 1LB, UK
| | | |
Collapse
|
23
|
Yeo M, Kok HK, Kutaiba N, Maingard J, Thijs V, Tahayori B, Russell J, Jhamb A, Chandra RV, Brooks M, Barras CD, Asadi H. Artificial intelligence in clinical decision support and outcome prediction - applications in stroke. J Med Imaging Radiat Oncol 2021; 65:518-528. [PMID: 34050596 DOI: 10.1111/1754-9485.13193] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 04/29/2021] [Indexed: 01/19/2023]
Abstract
Artificial intelligence (AI) is making a profound impact in healthcare, with the number of AI applications in medicine increasing substantially over the past five years. In acute stroke, it is playing an increasingly important role in clinical decision-making. Contemporary advances have increased the amount of information - both clinical and radiological - which clinicians must consider when managing patients. In the time-critical setting of acute stroke, AI offers the tools to rapidly evaluate and consolidate available information, extracting specific predictions from rich, noisy data. It has been applied to the automatic detection of stroke lesions on imaging and can guide treatment decisions through the prediction of tissue outcomes and long-term functional outcomes. This review examines the current state of AI applications in stroke, exploring their potential to reform stroke care through clinical decision support, as well as the challenges and limitations which must be addressed to facilitate their acceptance and adoption for clinical use.
Collapse
Affiliation(s)
- Melissa Yeo
- School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
| | - Hong Kuan Kok
- Interventional Radiology Service, Department of Radiology, Northern Health, Melbourne, Victoria, Australia
- School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
| | - Numan Kutaiba
- Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
| | - Julian Maingard
- School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
- Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
- Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
| | - Vincent Thijs
- Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
- Department of Neurology, Austin Health, Melbourne, Victoria, Australia
| | - Bahman Tahayori
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, Victoria, Australia
- IBM Research Australia, Melbourne, Victoria, Australia
| | - Jeremy Russell
- Department of Neurosurgery, Austin Hospital, Melbourne, Victoria, Australia
| | - Ashu Jhamb
- Department of Radiology, St Vincent's Hospital, Melbourne, Victoria, Australia
| | - Ronil V Chandra
- Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
- Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
| | - Mark Brooks
- School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
- School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
- Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
- Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
| | - Christen D Barras
- South Australian Institute of Health and Medical Research, Adelaide, South Australia, Australia
- School of Medicine, The University of Adelaide, Adelaide, South Australia, Australia
| | - Hamed Asadi
- School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
- Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
- Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
- Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
- Department of Radiology, St Vincent's Hospital, Melbourne, Victoria, Australia
- Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
| |
Collapse
|
24
|
Shafaat O, Bernstock JD, Shafaat A, Yedavalli VS, Elsayed G, Gupta S, Sotoudeh E, Sair HI, Yousem DM, Sotoudeh H. Leveraging artificial intelligence in ischemic stroke imaging. J Neuroradiol 2021; 49:343-351. [PMID: 33984377 DOI: 10.1016/j.neurad.2021.05.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 05/02/2021] [Accepted: 05/03/2021] [Indexed: 11/30/2022]
Abstract
Artificial intelligence (AI) is having a disruptive and transformative effect on clinical medicine. Prompt clinical diagnosis and imaging are critical for minimizing the morbidity and mortality associated with ischemic strokes. Clinicians must understand the current strengths and limitations of AI to provide optimal patient care. Ischemic stroke is one of the medical fields that have been extensively evaluated by artificial intelligence. Presented herein is a review of artificial intelligence applied to clinical management of stroke, geared toward clinicians. In this review, we explain the basic concept of AI and machine learning. This review is without coding and mathematical details and targets the clinicians involved in stroke management without any computer or mathematics' background. Here the AI application in ischemic stroke is summarized and classified into stroke imaging (automated diagnosis of brain infarction, automated ASPECT score calculation, infarction segmentation), prognosis prediction, and patients' selection for treatment.
Collapse
Affiliation(s)
- Omid Shafaat
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287, USA.
| | - Joshua D Bernstock
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Hale Building, 60 Fenwood Road, Boston, MA 02115, USA.
| | - Amir Shafaat
- Department of Mechanical Engineering, Arak University of Technology, Daneshgah St, 38181-41167 Arak, Iran.
| | - Vivek S Yedavalli
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287, USA.
| | - Galal Elsayed
- Department of Neurosurgery, University of Alabama at Birmingham, 1960 6th Ave. S., Birmingham, AL 35233, USA.
| | - Saksham Gupta
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Hale Building, 60 Fenwood Road, Boston, MA 02115, USA.
| | - Ehsan Sotoudeh
- Department of Surgery, Iranian Hospital in Dubai, P.O.BOX: 2330, Al-Wasl Road, Dubai 2330, UAE.
| | - Haris I Sair
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287, USA; Radiology Artificial Intelligence Lab (RAIL), Malone Center for Engineering in Healthcare, Johns Hopkins University Whiting School of Engineering, 600 North Wolfe Street, Baltimore, MD 21287, USA.
| | - David M Yousem
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287, USA.
| | - Houman Sotoudeh
- Department of Radiology, University of Alabama at Birmingham, 619 19th St S, Birmingham, AL 35294, USA.
| |
Collapse
|
25
|
Naganuma M, Tachibana A, Fuchigami T, Akahori S, Okumura S, Yi K, Matsuo Y, Ikeno K, Yonehara T. Alberta Stroke Program Early CT Score Calculation Using the Deep Learning-Based Brain Hemisphere Comparison Algorithm. J Stroke Cerebrovasc Dis 2021; 30:105791. [PMID: 33878549 DOI: 10.1016/j.jstrokecerebrovasdis.2021.105791] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 02/24/2021] [Accepted: 03/24/2021] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVES The Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is a promising tool for the evaluation of stroke expansion to determine suitability for reperfusion therapy. The aim of this study was to validate deep learning-based ASPECTS calculation software that utilizes a three-dimensional fully convolutional network-based brain hemisphere comparison algorithm (3D-BHCA). MATERIALS AND METHODS We retrospectively collected head non-contrast computed tomography (CT) data from 71 patients with acute ischemic stroke and 80 non-stroke patients. The results for ASPECTS on CT assessed by 5 stroke neurologists and by the 3D-BHCA model were compared with the ground truth by means of region-based and score-based analyses. RESULTS In total, 151 patients and 3020 (151 × 20) ASPECTS regions were investigated. Median time from onset to CT was 195 min in the stroke patients. In region-based analysis, the sensitivity (0.80), specificity (0.97), and accuracy (0.96) of the 3D-BHCA model were superior to those of stroke neurologists. The sensitivity (0.98), specificity (0.92), and accuracy (0.97) of dichotomized ASPECTS > 5 analysis and the intraclass correlation coefficient (0.90) in total score-based analysis of the 3D-BHCA model were superior to those of stroke neurologists overall. When patients with stroke were stratified by onset-to-CT time, the 3D-BHCA model exhibited the highest performance to calculate ASPECTS, even in the earliest time period. CONCLUSIONS The automated ASPECTS calculation software we developed using a deep learning-based algorithm was superior or equal to stroke neurologists in performing ASPECTS calculation in patients with acute stroke and non-stroke patients.
Collapse
Affiliation(s)
- Masaki Naganuma
- Department of Neurology, Saiseikai Kumamoto Hospital, Chikami 5-3-1, Minami-ku, Kumamoto, Japan.
| | | | | | | | - Shuichiro Okumura
- Department of Radiology, Saiseikai Kumamoto Hospital, Kumamoto, Japan.
| | - Kenichiro Yi
- Department of Neurology, Saiseikai Kumamoto Hospital, Chikami 5-3-1, Minami-ku, Kumamoto, Japan.
| | - Yoshimasa Matsuo
- Department of Neurology, Saiseikai Kumamoto Hospital, Chikami 5-3-1, Minami-ku, Kumamoto, Japan.
| | - Koichi Ikeno
- Department of Neurology, Saiseikai Kumamoto Hospital, Chikami 5-3-1, Minami-ku, Kumamoto, Japan.
| | - Toshiro Yonehara
- Department of Neurology, Saiseikai Kumamoto Hospital, Chikami 5-3-1, Minami-ku, Kumamoto, Japan.
| |
Collapse
|
26
|
Kuang H, Menon BK, Sohn SI, Qiu W. EIS-Net: Segmenting early infarct and scoring ASPECTS simultaneously on non-contrast CT of patients with acute ischemic stroke. Med Image Anal 2021; 70:101984. [PMID: 33676101 DOI: 10.1016/j.media.2021.101984] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 12/14/2020] [Accepted: 01/25/2021] [Indexed: 11/29/2022]
Abstract
Detecting early infarct (EI) plays an essential role in patient selection for reperfusion therapy in the management of acute ischemic stroke (AIS). EI volume at acute or hyper-acute stage can be measured using advanced pre-treatment imaging, such as MRI and CT perfusion. In this study, a novel multi-task learning approach, EIS-Net, is proposed to segment EI and score Alberta Stroke Program Early CT Score (ASPECTS) simultaneously on baseline non-contrast CT (NCCT) scans of AIS patients. The EIS-Net comprises of a 3D triplet convolutional neural network (T-CNN) for EI segmentation and a multi-region classification network for ASPECTS scoring. T-CNN has triple encoders with original NCCT, mirrored NCCT, and atlas as inputs, as well as one decoder. A comparison disparity block (CDB) is designed to extract and enhance image contexts. In the decoder, a multi-level attention gate module (MAGM) is developed to recalibrate the features of the decoder for both segmentation and classification tasks. Evaluations using a high-quality dataset comprising of baseline NCCT and concomitant diffusion weighted MRI (DWI) as reference standard of 260 patients with AIS show that the proposed EIS-Net can accurately segment EI. The EIS-Net segmented EI volume strongly correlates with EI volume on DWI (r=0.919), and the mean difference between the two volumes is 8.5 mL. For ASPECTS scoring, the proposed EIS-Net achieves an intraclass correlation coefficient of 0.78 for total 10-point ASPECTS and a kappa of 0.75 for dichotomized ASPECTS (≤ 4 vs. >4). Both EI segmentation and ASPECTS scoring tasks achieve state-of-the-art performances.
Collapse
Affiliation(s)
- Hulin Kuang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering, Central South University, Changsha, China; Department of Clinical Neuroscience, the University of Calgary, Calgary, Alberta, Canada
| | - Bijoy K Menon
- Department of Clinical Neuroscience, the University of Calgary, Calgary, Alberta, Canada; Department of Radiology, the University of Calgary, Calgary, Alberta, Canada
| | - Sung Il Sohn
- Department of Neurology, Keimyung University Dongsan Medical Center, Daegu, South Korea
| | - Wu Qiu
- Department of Clinical Neuroscience, the University of Calgary, Calgary, Alberta, Canada; Department of Radiology, the University of Calgary, Calgary, Alberta, Canada.
| |
Collapse
|
27
|
Li KHC, Jesuthasan A, Kui C, Davies R, Tse G, Lip GYH. Acute ischemic stroke management: concepts and controversies.A narrative review. Expert Rev Neurother 2020; 21:65-79. [PMID: 33047640 DOI: 10.1080/14737175.2021.1836963] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
INTRODUCTION Amongst the 25.7 million survivors and 6.5 million deaths from stroke between 1990 and 2013, ischemic strokes accounted for approximately 70% and 50% of the cases, respectively. With patients still suffering from complications and stroke recurrence, more questions have been raised as to how we can better improve patient management. AREAS COVERED The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and Newcastle-Ottawa Scale (NOS) were adopted to ensure a comprehensive inclusion of quality literature from various sources. PubMed and Embase were searched for evidence on thrombolysis, mechanical thrombectomy, artificial intelligence (AI), antiplatelet therapy, anticoagulation and hypertension management. EXPERT OPINION The directions of future research in these areas are dependent on the current level of validation. Endovascular therapy and applications of AI are relatively new compared to the other areas discussed in this review. As such, future studies need to focus on validating their efficacy. As for thrombolysis, antiplatelet and anticoagulation therapy, their efficacy has been well-established and future research efforts should be directed toward adjusting its use according to patient-specific factors, starting with factors with the most clinical relevance and prevalence.
Collapse
Affiliation(s)
- Ka Hou Christien Li
- Medicine, Newcastle University , Newcastle, UK.,Arrowe Park Acute Stroke Unit, Wirral University Teaching Hospital NHS Foundation Trust , Wirral, UK
| | | | | | - Ruth Davies
- Arrowe Park Acute Stroke Unit, Wirral University Teaching Hospital NHS Foundation Trust , Wirral, UK
| | - Gary Tse
- Tianjin Key Laboratory of Ionic-Molecular Function of Cardiovascular Disease, Department of Cardiology, Tianjin Institute of Cardiology, Second Hospital of Tianjin Medical University , Tianjin, China
| | - Gregory Y H Lip
- Liverpool Centre for Cardiovascular Science, University of Liverpool and Liverpool Heart & Chest Hospital , Liverpool, UK.,Department of Clinical Medicine, Aalborg University , Aalborg, Denmark
| |
Collapse
|
28
|
Kaka H, Zhang E, Khan N. Artificial Intelligence and Deep Learning in Neuroradiology: Exploring the New Frontier. Can Assoc Radiol J 2020; 72:35-44. [PMID: 32946272 DOI: 10.1177/0846537120954293] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
There have been many recently published studies exploring machine learning (ML) and deep learning applications within neuroradiology. The improvement in performance of these techniques has resulted in an ever-increasing number of commercially available tools for the neuroradiologist. In this narrative review, recent publications exploring ML in neuroradiology are assessed with a focus on several key clinical domains. In particular, major advances are reviewed in the context of: (1) intracranial hemorrhage detection, (2) stroke imaging, (3) intracranial aneurysm screening, (4) multiple sclerosis imaging, (5) neuro-oncology, (6) head and tumor imaging, and (7) spine imaging.
Collapse
Affiliation(s)
- Hussam Kaka
- Department of Radiology, 3710McMaster University, Hamilton, Ontario, Canada
| | - Euan Zhang
- Department of Radiology, 3710McMaster University, Hamilton General Hospital, Hamilton, Ontario, Canada
| | - Nazir Khan
- Department of Radiology, 3710McMaster University, Hamilton General Hospital, Hamilton, Ontario, Canada
| |
Collapse
|
29
|
Wolff L, Berkhemer OA, van Es ACGM, van Zwam WH, Dippel DWJ, Majoie CBLM, van Walsum T, van der Lugt A. Validation of automated Alberta Stroke Program Early CT Score (ASPECTS) software for detection of early ischemic changes on non-contrast brain CT scans. Neuroradiology 2020; 63:491-498. [PMID: 32857212 PMCID: PMC7966210 DOI: 10.1007/s00234-020-02533-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Accepted: 08/17/2020] [Indexed: 11/25/2022]
Abstract
Purpose In ASPECTS, 10 brain regions are scored visually for presence of acute ischemic stroke damage. We evaluated automated ASPECTS in comparison to expert readers. Methods Consecutive, baseline non-contrast CT-scans (5-mm slice thickness) from the prospective MR CLEAN trial (n = 459, MR CLEAN Netherlands Trial Registry number: NTR1804) were evaluated. A two-observer consensus for ASPECTS regions (normal/abnormal) was used as reference standard for training and testing (0.2/0.8 division). Two other observers provided individual ASPECTS-region scores. The Automated ASPECTS software was applied. A region score specificity of ≥ 90% was used to determine the software threshold for detection of an affected region based on relative density difference between affected and contralateral region. Sensitivity, specificity, and receiver-operating characteristic curves were calculated. Additionally, we assessed intraclass correlation coefficients (ICCs) for automated ASPECTS and observers in comparison to the reference standard in the test set. Results In the training set (n = 104), with software thresholds for a specificity of ≥ 90%, we found a sensitivity of 33–49% and an area under the curve (AUC) of 0.741–0.785 for detection of an affected ASPECTS region. In the test set (n = 355), the results for the found software thresholds were 89–89% (specificity), 41–57% (sensitivity), and 0.750–0.795 (AUC). Comparison of automated ASPECTS with the reference standard resulted in an ICC of 0.526. Comparison of observers with the reference standard resulted in an ICC of 0.383–0.464. Conclusion The performance of automated ASPECTS is comparable to expert readers and could support readers in the detection of early ischemic changes. Electronic supplementary material The online version of this article (10.1007/s00234-020-02533-6) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Lennard Wolff
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands.
| | - Olvert A Berkhemer
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands.,Department of Radiology & Nuclear Medicine, Amsterdam University Medical Centers, location AMC, Amsterdam, the Netherlands.,Department of Neurology, Erasmus MC, Rotterdam, the Netherlands
| | - Adriaan C G M van Es
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands
| | - Wim H van Zwam
- Department of Radiology, Maastricht UMC+, Maastricht, the Netherlands
| | - Diederik W J Dippel
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands.,Department of Neurology, Erasmus MC, Rotterdam, the Netherlands
| | - Charles B L M Majoie
- Department of Radiology & Nuclear Medicine, Amsterdam University Medical Centers, location AMC, Amsterdam, the Netherlands
| | - Theo van Walsum
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands.,Biomedical Imaging Group Rotterdam, Erasmus MC, Rotterdam, the Netherlands
| | - Aad van der Lugt
- Department of Radiology & Nuclear Medicine, Erasmus MC, P. van Andel & L. Wolff, room Ne-515, Postbus 2040, 3000, CA, Rotterdam, the Netherlands
| | | |
Collapse
|
30
|
Nagaratnam K, Harston G, Flossmann E, Canavan C, Geraldes RC, Edwards C. Innovative use of artificial intelligence and digital communication in acute stroke pathway in response to COVID-19. Future Healthc J 2020; 7:169-173. [PMID: 32550287 PMCID: PMC7296572 DOI: 10.7861/fhj.2020-0034] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Acute stroke care demands real-time, specialist-led treatment decisions, including thrombolysis and referral for mechanical thrombectomy. Pathways designed to deliver time-critical interventions for stroke patients are under intense pressure due to the impact of COVID-19 pandemic. In response to this unprecedented burden on acute care services, stroke clinicians are having to reconfigure existing clinical pathways both within and between hospitals. Incorporating artificial intelligence and digital communication support into clinical pathways offers an opportunity to mitigate the disruption to acute stroke care. In this case study we describe how Royal Berkshire Hospital, working collaboratively with Brainomix, a UK-based artificial intelligence software company, adopted technological innovation and integrated it into the hyperacute stroke pathway. A case is presented to demonstrate how this innovation can support patient care and deliver successful patient outcomes. We believe this model can be adopted in other hospitals and networks to deliver safe and efficient hyperacute stroke care.
Collapse
Affiliation(s)
| | - George Harston
- Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | | | | | | | | |
Collapse
|
31
|
Automated ASPECT scoring in acute ischemic stroke: comparison of three software tools. Neuroradiology 2020; 62:1231-1238. [DOI: 10.1007/s00234-020-02439-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 04/16/2020] [Indexed: 10/24/2022]
|
32
|
Computational Image Analysis of Nonenhanced Computed Tomography for Acute Ischaemic Stroke: A Systematic Review. J Stroke Cerebrovasc Dis 2020; 29:104715. [DOI: 10.1016/j.jstrokecerebrovasdis.2020.104715] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 01/16/2020] [Accepted: 01/28/2020] [Indexed: 11/23/2022] Open
|
33
|
Neuberger U, Nagel S, Pfaff J, Ringleb PA, Herweh C, Bendszus M, Möhlenbruch MA, Kickingereder P. Impact of slice thickness on clinical utility of automated Alberta Stroke Program Early Computed Tomography Scores. Eur Radiol 2020; 30:3137-3145. [DOI: 10.1007/s00330-019-06616-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2019] [Revised: 11/14/2019] [Accepted: 12/11/2019] [Indexed: 11/24/2022]
|
34
|
Comparison of the performance between Frontier ASPECTS software and different levels of radiologists on assessing CT examinations of acute ischaemic stroke patients. Clin Radiol 2020; 75:358-365. [PMID: 31973944 DOI: 10.1016/j.crad.2019.12.010] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 12/11/2019] [Indexed: 11/24/2022]
Abstract
AIM To compare the performance of Frontier Alberta Stroke Program Early CT Score (ASPECTS) software with different levels of radiologists in assessing computed tomography (CT) examinations of patients with early acute ischaemic stroke (AIS), and to evaluate whether this software can improve the performance of rating by less experienced radiologists. MATERIALS AND METHODS Unenhanced brain CT examinations of 55 patients with acute middle cerebral artery ischaemia were scored separately by Frontier, two senior radiologists, and two junior radiologists retrospectively and blinded to any clinical information. Two junior radiologists then scored again with the assist of Frontier. The reference standard was defined as the ASPECTS on Follow-up unenhanced CT scored by another two non-blinded independent experts on a consensus basis. Statistical analysis was performed using intraclass correlation coefficient (ICC) analysis and Bland-Altman plots. RESULTS Frontier and senior radiologists in ASPECTS reading have excellent agreement with the reference standard (r=0.842 and 0.803, respectively), while only a good agreement was found between junior radiologists and reference standard (r=0.680). Bland-Altman analysis revealed the mean ASPECTS difference and SD difference of junior radiologists were larger (mean difference=1.35; SD=1.42) than that of Frontier and senior radiologists with reference standard (mean difference=0.16, 0.22; SD=1.24, 1.13, respectively). However, with the assist of Frontier, the agreement between junior radiologists and reference standard was improved from good (r=0.680) to excellent (r =0.852), and the mean ASPECTS difference and SD difference were reduced. CONCLUSION High agreement in ASPECTS rating between senior radiologists, Frontier, and expert consensus reading was found. Moreover, Frontier can improve the performance of less experienced radiologists to assess the ASPECTS of patients with AIS.
Collapse
|
35
|
Ernst M, Bernhardt M, Bechstein M, Schön G, Fiehler J, Majoie CB, Marquering HA, van Zwam WH, Dippel DW, van Oostenbrugge RJ, Goebell E. Effect of CAD on performance in ASPECTS reading. INFORMATICS IN MEDICINE UNLOCKED 2020. [DOI: 10.1016/j.imu.2020.100295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
|
36
|
Kuang H, Qiu W, Najm M, Dowlatshahi D, Mikulik R, Poppe AY, Puig J, Castellanos M, Sohn SI, Ahn SH, Calleja A, Jin A, Asil T, Asdaghi N, Field TS, Coutts S, Hill MD, Demchuk AM, Goyal M, Menon BK. Validation of an automated ASPECTS method on non-contrast computed tomography scans of acute ischemic stroke patients. Int J Stroke 2019; 15:528-534. [DOI: 10.1177/1747493019895702] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Background The Alberta Stroke Program Early CT Score (ASPECTS) is a systematic method of assessing the extent of early ischemic change on non-contrast computed tomography in patients with acute ischemic stroke. Our objective was to validate an automated ASPECTS scoring method we recently developed on a large data set. Materials and methods We retrospectively collected 602 acute ischemic stroke patients’ non-contrast computed tomography scans. Expert ASPECTS readings on non-contrast computed tomography were compared to automated ASPECTS. Statistical analyses on the total ASPECTS, region level ASPECTS, and dichotomized ASPECTS (≤4 vs. >4) score were conducted. Results In total, 602 scans were evaluated and 6020 (602 × 10) ASPECTS regions were scored. Median time from stroke onset to computed tomography was 114 min (interquartile range: 73–183 min). Total ASPECTS for the 602 patients generated by the automated method agreed well with expert readings (intraclass correlation coefficient): 0.65 (95% confidence interval (CI): 0.60–0.69). Region level analysis showed that the automated method yielded accuracy of 81.25%, sensitivity of 61.13% (95% CI: 58.4%–63.8%), specificity of 86.56% (95% CI: 85.6%–87.5%), and area under curve of 0.74 (95% CI: 0.73–0.75). For dichotomized ASPECTS (≤4 vs. >4), the automated method demonstrated sensitivity 97.21% (95% CI: 95.4%–98.4%), specificity 57.81% (95% CI: 44.8%–70.1%), accuracy 93.02%, and area under the curve of 0.78 (95% CI: 0.74–0.81). For each individual region (M1–6, lentiform, insula, and caudate), the automated method demonstrated acceptable performance. Conclusion The automated system we developed approached the stroke expert in performance when scoring ASPECTS on non-contrast computed tomography scans of acute ischemic stroke patients.
Collapse
Affiliation(s)
- Hulin Kuang
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
| | - Wu Qiu
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
| | - Mohamed Najm
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
| | - Dar Dowlatshahi
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Robert Mikulik
- International Clinical Research Center, Department of Neurology, St Ann’s University Hospital, Masaryk University, Brno, Czech Republic
| | - Alex Y Poppe
- Department of Neurosciences, University of Montreal, Montreal, Québec, Canada
| | - Josep Puig
- IDI-IDIBGI, Dr Josep Trueta University Hospital, Girona, Spain
| | - Mar Castellanos
- IDI-IDIBGI, Dr Josep Trueta University Hospital, Girona, Spain
| | - Sung I Sohn
- Department of Neurology, Keimyung University, Daegu, South Korea
| | - Seong H Ahn
- Department of Neurology, Keimyung University, Daegu, South Korea
| | - Ana Calleja
- Department of Medicine, University of Valladolid, Valladolid, Spain
| | - Albert Jin
- Faculty of Health Sciences, Queen’s University, Kingston, Ontario, Canada
| | - Talip Asil
- Bezmialem Vakif Univesitesi Noroloji, Istanbul, Turkey
| | - Negar Asdaghi
- Department of Neurology, University of Miami, Miami, FL, USA
| | - Thalia S Field
- Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Shelagh Coutts
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
- Department of Radiology, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | - Michael D Hill
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
- Department of Radiology, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | - Andrew M Demchuk
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
- Department of Radiology, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | - Mayank Goyal
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
- Department of Radiology, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | - Bijoy K Menon
- Calgary Stroke Program, Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada
- Department of Radiology, University of Calgary, Calgary, Alberta, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | | |
Collapse
|
37
|
Murray NM, Unberath M, Hager GD, Hui FK. Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review. J Neurointerv Surg 2019; 12:156-164. [DOI: 10.1136/neurintsurg-2019-015135] [Citation(s) in RCA: 107] [Impact Index Per Article: 21.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Revised: 07/29/2019] [Accepted: 07/29/2019] [Indexed: 11/04/2022]
Abstract
Background and purposeAcute stroke caused by large vessel occlusions (LVOs) requires emergent detection and treatment by endovascular thrombectomy. However, radiologic LVO detection and treatment is subject to variable delays and human expertise, resulting in morbidity. Imaging software using artificial intelligence (AI) and machine learning (ML), a branch of AI, may improve rapid frontline detection of LVO strokes. This report is a systematic review of AI in acute LVO stroke identification and triage, and characterizes LVO detection software.MethodsA systematic review of acute stroke diagnostic-focused AI studies from January 2014 to February 2019 in PubMed, Medline, and Embase using terms: ‘artificial intelligence’ or ‘machine learning or deep learning’ and ‘ischemic stroke’ or ‘large vessel occlusion’ was performed.ResultsVariations of AI, including ML methods of random forest learning (RFL) and convolutional neural networks (CNNs), are used to detect LVO strokes. Twenty studies were identified that use ML. Alberta Stroke Program Early CT Score (ASPECTS) commonly used RFL, while LVO detection typically used CNNs. Image feature detection had greater sensitivity with CNN than with RFL, 85% versus 68%. However, AI algorithm performance metrics use different standards, precluding ideal objective comparison. Four current software platforms incorporate ML: Brainomix (greatest validation of AI for ASPECTS, uses CNNs to automatically detect LVOs), General Electric, iSchemaView (largest number of perfusion study validations for thrombectomy), and Viz.ai (uses CNNs to automatically detect LVOs, then automatically activates emergency stroke treatment systems).ConclusionsAI may improve LVO stroke detection and rapid triage necessary for expedited treatment. Standardization of performance assessment is needed in future studies.
Collapse
|
38
|
Mokli Y, Pfaff J, dos Santos DP, Herweh C, Nagel S. Computer-aided imaging analysis in acute ischemic stroke - background and clinical applications. Neurol Res Pract 2019; 1:23. [PMID: 33324889 PMCID: PMC7650084 DOI: 10.1186/s42466-019-0028-y] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Accepted: 05/29/2019] [Indexed: 12/22/2022] Open
Abstract
Tools for medical image analysis have been developed to reduce the time needed to detect abnormalities and to provide more accurate results. Particularly, tools based on artificial intelligence and machine learning techniques have led to significant improvements in medical imaging interpretation in the last decade. Automatic evaluation of acute ischemic stroke in medical imaging is one of the fields that witnessed a major development. Commercially available products so far aim to identify (and quantify) the ischemic core, the ischemic penumbra, the site of arterial occlusion and the collateral flow but they are not (yet) intended as standalone diagnostic tools. Their use can be complementary; they are intended to support physicians' interpretation of medical images and hence standardise selection of patients for acute treatment. This review provides an introduction into the field of computer-aided diagnosis and focuses on the automatic analysis of non-contrast-enhanced computed tomography, computed tomography angiography and perfusion imaging. Future studies are necessary that allow the evaluation and comparison of different imaging strategies and post-processing algorithms during the diagnosis process in patients with suspected acute ischemic stroke; which may further facilitate the standardisation of treatment and stroke management.
Collapse
Affiliation(s)
- Yahia Mokli
- Department of Neurology, University Hospital Heidelberg, INF 400, 69120 Heidelberg, Germany
| | - Johannes Pfaff
- Department of Neuroradiology, University Hospital Heidelberg, Heidelberg, Germany
| | | | - Christian Herweh
- Department of Neuroradiology, University Hospital Heidelberg, Heidelberg, Germany
| | - Simon Nagel
- Department of Neurology, University Hospital Heidelberg, INF 400, 69120 Heidelberg, Germany
| |
Collapse
|