1
|
Westwood M, Ramaekers B, Grimm S, Armstrong N, Wijnen B, Ahmadu C, de Kock S, Noake C, Joore M. Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis. Health Technol Assess 2024; 28:1-204. [PMID: 38512017 PMCID: PMC11017149 DOI: 10.3310/rdpa1487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024] Open
Abstract
Background Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. Objectives To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Methods Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. Results A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration This study is registered as PROSPERO CRD42021269609. Funding This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.
Collapse
Affiliation(s)
| | - Bram Ramaekers
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre (MUMC), Maastricht, Netherlands
| | | | | | - Ben Wijnen
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | | | | | - Caro Noake
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | - Manuela Joore
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre (MUMC), Maastricht, Netherlands
| |
Collapse
|
2
|
Yearley AG, Goedmakers CMW, Panahi A, Doucette J, Rana A, Ranganathan K, Smith TR. FDA-approved machine learning algorithms in neuroradiology: A systematic review of the current evidence for approval. Artif Intell Med 2023; 143:102607. [PMID: 37673576 DOI: 10.1016/j.artmed.2023.102607] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 05/30/2023] [Accepted: 06/05/2023] [Indexed: 09/08/2023]
Abstract
Over the past decade, machine learning (ML) and artificial intelligence (AI) have become increasingly prevalent in the medical field. In the United States, the Food and Drug Administration (FDA) is responsible for regulating AI algorithms as "medical devices" to ensure patient safety. However, recent work has shown that the FDA approval process may be deficient. In this study, we evaluate the evidence supporting FDA-approved neuroalgorithms, the subset of machine learning algorithms with applications in the central nervous system (CNS), through a systematic review of the primary literature. Articles covering the 53 FDA-approved algorithms with applications in the CNS published in PubMed, EMBASE, Google Scholar and Scopus between database inception and January 25, 2022 were queried. Initial searches identified 1505 studies, of which 92 articles met the criteria for extraction and inclusion. Studies were identified for 26 of the 53 neuroalgorithms, of which 10 algorithms had only a single peer-reviewed publication. Performance metrics were available for 15 algorithms, external validation studies were available for 24 algorithms, and studies exploring the use of algorithms in clinical practice were available for 7 algorithms. Papers studying the clinical utility of these algorithms focused on three domains: workflow efficiency, cost savings, and clinical outcomes. Our analysis suggests that there is a meaningful gap between the FDA approval of machine learning algorithms and their clinical utilization. There appears to be room for process improvement by implementation of the following recommendations: the provision of compelling evidence that algorithms perform as intended, mandating minimum sample sizes, reporting of a predefined set of performance metrics for all algorithms and clinical application of algorithms prior to widespread use. This work will serve as a baseline for future research into the ideal regulatory framework for AI applications worldwide.
Collapse
Affiliation(s)
- Alexander G Yearley
- Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA; Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA.
| | - Caroline M W Goedmakers
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; Department of Neurosurgery, Leiden University Medical Center, Albinusdreef 2, 2333 ZA Leiden, Netherlands
| | - Armon Panahi
- The George Washington University School of Medicine and Health Sciences, 2300 I St NW, Washington, DC 20052, USA
| | - Joanne Doucette
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; School of Pharmacy, MCPHS University, 179 Longwood Ave, Boston, MA 02115, USA
| | - Aakanksha Rana
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139, USA
| | - Kavitha Ranganathan
- Division of Plastic Surgery, Brigham and Women's Hospital, 75 Francis St, Boston, MA 02115, USA
| | - Timothy R Smith
- Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA; Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA
| |
Collapse
|
3
|
Brugnara G, Baumgartner M, Scholze ED, Deike-Hofmann K, Kades K, Scherer J, Denner S, Meredig H, Rastogi A, Mahmutoglu MA, Ulfert C, Neuberger U, Schönenberger S, Schlamp K, Bendella Z, Pinetz T, Schmeel C, Wick W, Ringleb PA, Floca R, Möhlenbruch M, Radbruch A, Bendszus M, Maier-Hein K, Vollmuth P. Deep-learning based detection of vessel occlusions on CT-angiography in patients with suspected acute ischemic stroke. Nat Commun 2023; 14:4938. [PMID: 37582829 PMCID: PMC10427649 DOI: 10.1038/s41467-023-40564-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 08/01/2023] [Indexed: 08/17/2023] Open
Abstract
Swift diagnosis and treatment play a decisive role in the clinical outcome of patients with acute ischemic stroke (AIS), and computer-aided diagnosis (CAD) systems can accelerate the underlying diagnostic processes. Here, we developed an artificial neural network (ANN) which allows automated detection of abnormal vessel findings without any a-priori restrictions and in <2 minutes. Pseudo-prospective external validation was performed in consecutive patients with suspected AIS from 4 different hospitals during a 6-month timeframe and demonstrated high sensitivity (≥87%) and negative predictive value (≥93%). Benchmarking against two CE- and FDA-approved software solutions showed significantly higher performance for our ANN with improvements of 25-45% for sensitivity and 4-11% for NPV (p ≤ 0.003 each). We provide an imaging platform ( https://stroke.neuroAI-HD.org ) for online processing of medical imaging data with the developed ANN, including provisions for data crowdsourcing, which will allow continuous refinements and serve as a blueprint to build robust and generalizable AI algorithms.
Collapse
Affiliation(s)
- Gianluca Brugnara
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Michael Baumgartner
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Helmholtz Imaging, Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - Edwin David Scholze
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Katerina Deike-Hofmann
- Department of Neuroradiology, Bonn University Hospital, Bonn, Germany
- Clinical Neuroimaging Group, German Center for Neurodegenerative Diseases, DZNE, Bonn, Germany
| | - Klaus Kades
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - Jonas Scherer
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Stefan Denner
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Medicine, University of Heidelberg, Heidelberg, Germany
| | - Hagen Meredig
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Aditya Rastogi
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Mustafa Ahmed Mahmutoglu
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Christian Ulfert
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Ulf Neuberger
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Kai Schlamp
- Department of Diagnostic and Interventional Radiology with Nuclear Medicine, Thoraxklinik at University of Heidelberg, Heidelberg, Germany
| | - Zeynep Bendella
- Department of Neuroradiology, Bonn University Hospital, Bonn, Germany
| | - Thomas Pinetz
- Institute for Applied Mathematics, University of Bonn, Bonn, Germany
| | - Carsten Schmeel
- Department of Neuroradiology, Bonn University Hospital, Bonn, Germany
- Clinical Neuroimaging Group, German Center for Neurodegenerative Diseases, DZNE, Bonn, Germany
| | - Wolfgang Wick
- Neurology Clinic, Heidelberg University Hospital, Heidelberg, Germany
| | - Peter A Ringleb
- Neurology Clinic, Heidelberg University Hospital, Heidelberg, Germany
| | - Ralf Floca
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Heidelberg Institute of Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
| | - Markus Möhlenbruch
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Alexander Radbruch
- Department of Neuroradiology, Bonn University Hospital, Bonn, Germany
- Clinical Neuroimaging Group, German Center for Neurodegenerative Diseases, DZNE, Bonn, Germany
| | - Martin Bendszus
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Klaus Maier-Hein
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Pattern Analysis and Learning Group, Heidelberg University Hospital, Heidelberg, Germany
| | - Philipp Vollmuth
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
- Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
| |
Collapse
|
4
|
Ghozy S, Azzam AY, Kallmes KM, Matsoukas S, Fifi JT, Luijten SPR, van der Lugt A, Adusumilli G, Heit JJ, Kadirvel R, Kallmes DF. The diagnostic performance of artificial intelligence algorithms for identifying M2 segment middle cerebral artery occlusions: A systematic review and meta-analysis. J Neuroradiol 2023; 50:449-454. [PMID: 36773845 DOI: 10.1016/j.neurad.2023.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 01/30/2023] [Accepted: 02/01/2023] [Indexed: 02/11/2023]
Abstract
BACKGROUND Artificial intelligence (AI)-based algorithms have been developed to facilitate rapid and accurate computed tomography angiography (CTA) assessment in proximal large vessel occlusion (LVO) acute ischemic stroke, including internal carotid artery and M1 occlusions. In clinical practice, however, the detection of medium vessel occlusion (MeVO) represents an ongoing diagnostic challenge in which the added value of AI remains unclear. PURPOSE To assess the diagnostic performance of AI platforms for detecting M2 occlusions. METHODS Studies that report the diagnostic performance of AI-based detection of M2 occlusions were screened, and sensitivity and specificity data were extracted using the semi-automated AutoLit software (Nested Knowledge, MN) platform. STATA (version 16 IC; Stata Corporation, College Station, Texas, USA) was used to conduct all analyses. RESULTS Eight studies with a low risk of bias and significant heterogeneity were included in the quantitative and qualitative synthesis. The pooled estimates of sensitivity and specificity of AI platforms for M2 occlusion detection were 64% (95% CI, 53 to 74%) and 97% (95% CI, 84 to 100%), respectively. The area under the curve (AUC) in the SROC curve was 0.79 (95% CI, 0.74 to 0.83). CONCLUSION The current performance of the AI-based algorithm makes it more suitable as an adjunctive confirmatory tool rather than as an independent one for M2 occlusions. With the rapid development of such algorithms, it is anticipated that newer generations will likely perform much better.
Collapse
Affiliation(s)
- Sherief Ghozy
- Department of Radiology, Mayo Clinic, Rochester, MN, USA; Nuffield Department of Primary Care Health Sciences and Department for Continuing Education (EBHC program), Oxford University, Oxford, UK.
| | | | - Kevin M Kallmes
- Nested Knowledge, St. Paul MN, USA; Superior Medical Experts, St. Paul MN, USA
| | - Stavros Matsoukas
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Johanna T Fifi
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA; Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA; Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Sven P R Luijten
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Aad van der Lugt
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | | | - Jeremy J Heit
- Departments of Neuroradiology and Neurosurgery, Stanford University, Palo Alto, CA, USA
| | - Ramanathan Kadirvel
- Department of Radiology, Mayo Clinic, Rochester, MN, USA; Department of Neurologic Surgery, Mayo Clinic, Rochester, MN, USA
| | | |
Collapse
|
5
|
Nicholls JK, Ince J, Minhas JS, Chung EML. Emerging Detection Techniques for Large Vessel Occlusion Stroke: A Scoping Review. Front Neurol 2022; 12:780324. [PMID: 35095726 PMCID: PMC8796731 DOI: 10.3389/fneur.2021.780324] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 12/13/2021] [Indexed: 12/13/2022] Open
Abstract
Background: Large vessel occlusion (LVO) is the obstruction of large, proximal cerebral arteries and can account for up to 46% of acute ischaemic stroke (AIS) when both the A2 and P2 segments are included (from the anterior and posterior cerebral arteries). It is of paramount importance that LVO is promptly recognised to provide timely and effective acute stroke management. This review aims to scope recent literature to identify new emerging detection techniques for LVO. As a good comparator throughout this review, the commonly used National Institutes of Health Stroke Scale (NIHSS), at a cut-off of ≥11, has been reported to have a sensitivity of 86% and a specificity of 60% for LVO. Methods: Four electronic databases (Medline via OVID, CINAHL, Scopus, and Web of Science), and grey literature using OpenGrey, were systematically searched for published literature investigating developments in detection methods for LVO, reported from 2015 to 2021. The protocol for the search was published with the Open Science Framework (10.17605/OSF.IO/A98KN). Two independent researchers screened the titles, abstracts, and full texts of the articles, assessing their eligibility for inclusion. Results: The search identified 5,082 articles, in which 2,265 articles were screened to assess their eligibility. Sixty-two studies remained following full-text screening. LVO detection techniques were categorised into 5 groups: stroke scales (n = 30), imaging and physiological methods (n = 15), algorithmic and machine learning approaches (n = 9), physical symptoms (n = 5), and biomarkers (n = 3). Conclusions: This scoping review has explored literature on novel and advancements in pre-existing detection methods for LVO. The results of this review highlight LVO detection techniques, such as stroke scales and biomarkers, with good sensitivity and specificity performance, whilst also showing advancements to support existing LVO confirmatory methods, such as neuroimaging.
Collapse
Affiliation(s)
- Jennifer K. Nicholls
- Department of Cardiovascular Sciences, University of Leicester, Leicester, United Kingdom
- Department of Medical Physics, University Hospitals of Leicester, NHS Trust, Leicester, United Kingdom
| | - Jonathan Ince
- Department of Cardiovascular Sciences, University of Leicester, Leicester, United Kingdom
| | - Jatinder S. Minhas
- Department of Cardiovascular Sciences, University of Leicester, Leicester, United Kingdom
- NIHR Leicester Biomedical Research Centre, University of Leicester, Leicester, United Kingdom
| | - Emma M. L. Chung
- Department of Cardiovascular Sciences, University of Leicester, Leicester, United Kingdom
- Department of Medical Physics, University Hospitals of Leicester, NHS Trust, Leicester, United Kingdom
- NIHR Leicester Biomedical Research Centre, University of Leicester, Leicester, United Kingdom
- School of Life Course Sciences, King's College London, London, United Kingdom
| |
Collapse
|
6
|
Czap AL, Bahr-Hosseini M, Singh N, Yamal JM, Nour M, Parker S, Kim Y, Restrepo L, Abdelkhaleq R, Salazar-Marioni S, Phan K, Bowry R, Rajan SS, Grotta JC, Saver JL, Giancardo L, Sheth SA. Machine Learning Automated Detection of Large Vessel Occlusion From Mobile Stroke Unit Computed Tomography Angiography. Stroke 2021; 53:1651-1656. [PMID: 34865511 PMCID: PMC9038611 DOI: 10.1161/strokeaha.121.036091] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND AND PURPOSE Prehospital automated large vessel occlusion (LVO) detection in Mobile Stroke Units (MSUs) could accelerate identification and treatment of patients with LVO acute ischemic stroke. Here, we evaluate the performance of a machine learning (ML) model on CT angiograms (CTAs) obtained from 2 MSUs to detect LVO. METHODS Patients evaluated on MSUs in Houston and Los Angeles with out-of-hospital CTAs were identified. Anterior circulation LVO was defined as an occlusion of the intracranial internal carotid artery, middle cerebral artery (M1 or M2), or anterior cerebral artery vessels and determined by an expert human reader. A ML model to detect LVO was trained and tested on independent data sets consisting of in-hospital CTAs and then tested on MSU CTA images. Model performance was determined using area under the receiver-operator curve statistics. RESULTS Among 68 patients with out-of-hospital MSU CTAs, 40% had an LVO. The most common occlusion location was the middle cerebral artery M1 segment (59%), followed by the internal carotid artery (30%), and middle cerebral artery M2 (11%). Median time from last known well to CTA imaging was 88.0 (interquartile range, 59.5-196.0) minutes. After training on 870 in-hospital CTAs, the ML model performed well in identifying LVO in a separate in-hospital data set of 441 images with area under receiver-operator curve of 0.84 (95% CI, 0.80-0.87). ML algorithm analysis time was under 1 minute. The performance of the ML model on the MSU CTA images was comparable with area under receiver-operator curve 0.80 (95% CI, 0.71-0.89). There was no significant difference in performance between the Houston and Los Angeles MSU CTA cohorts. CONCLUSIONS In this study of patients evaluated on MSUs in 2 cities, a ML algorithm was able to accurately and rapidly detect LVO using prehospital CTA acquisitions.
Collapse
Affiliation(s)
- Alexandra L Czap
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Mersedeh Bahr-Hosseini
- Department of Neurology and Comprehensive Stroke Center, UCLA, Los Angeles, CA (M.B.-H., M.N., L.R., J.L.S.)
| | - Noopur Singh
- Department of Biostatistics and Data Science, School of Public Health, University of Texas Health Sciences Center at Houston (N.S., J.-M.Y.)
| | - Jose-Miguel Yamal
- Department of Biostatistics and Data Science, School of Public Health, University of Texas Health Sciences Center at Houston (N.S., J.-M.Y.)
| | - May Nour
- Department of Neurology and Comprehensive Stroke Center, UCLA, Los Angeles, CA (M.B.-H., M.N., L.R., J.L.S.)
| | - Stephanie Parker
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Youngran Kim
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Lucas Restrepo
- Department of Neurology and Comprehensive Stroke Center, UCLA, Los Angeles, CA (M.B.-H., M.N., L.R., J.L.S.)
| | - Rania Abdelkhaleq
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Sergio Salazar-Marioni
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Kenny Phan
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Ritvij Bowry
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| | - Suja S Rajan
- Department of Management, Policy and Community Health, School of Public Health, University of Texas Health Sciences Center at Houston (S.S.R.)
| | - James C Grotta
- Clinical Innovation and Research Institute, Memorial Hermann Hospial Texas Medical Center, Houston (J.C.G.)
| | - Jeffrey L Saver
- Department of Neurology and Comprehensive Stroke Center, UCLA, Los Angeles, CA (M.B.-H., M.N., L.R., J.L.S.)
| | - Luca Giancardo
- Center for Precision Health, UTHealth School of Biomedical Informatics, UTHealth McGovern Medical School, Houston, TX (L.G.)
| | - Sunil A Sheth
- Department of Neurology, UTHealth McGovern Medical School, Houston TX (A.L.C., S.P., Y.K., R.A., S.S.-M., K.P., R.B., S.A.S.)
| |
Collapse
|