1
|
Moro F, Ciancia M, Zace D, Vagni M, Tran HE, Giudice MT, Zoccoli SG, Mascilini F, Ciccarone F, Boldrini L, D'Antonio F, Scambia G, Testa AC. Role of artificial intelligence applied to ultrasound in gynecology oncology: A systematic review. Int J Cancer 2024. [PMID: 38989809 DOI: 10.1002/ijc.35092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 06/03/2024] [Accepted: 06/27/2024] [Indexed: 07/12/2024]
Abstract
The aim of this paper was to explore the role of artificial intelligence (AI) applied to ultrasound imaging in gynecology oncology. Web of Science, PubMed, and Scopus databases were searched. All studies were imported to RAYYAN QCRI software. The overall quality of the included studies was assessed using QUADAS-AI tool. Fifty studies were included, of these 37/50 (74.0%) on ovarian masses or ovarian cancer, 5/50 (10.0%) on endometrial cancer, 5/50 (10.0%) on cervical cancer, and 3/50 (6.0%) on other malignancies. Most studies were at high risk of bias for subject selection (i.e., sample size, source, or scanner model were not specified; data were not derived from open-source datasets; imaging preprocessing was not performed) and index test (AI models was not externally validated) and at low risk of bias for reference standard (i.e., the reference standard correctly classified the target condition) and workflow (i.e., the time between index test and reference standard was reasonable). Most studies presented machine learning models (33/50, 66.0%) for the diagnosis and histopathological correlation of ovarian masses, while others focused on automatic segmentation, reproducibility of radiomics features, improvement of image quality, prediction of therapy resistance, progression-free survival, and genetic mutation. The current evidence supports the role of AI as a complementary clinical and research tool in diagnosis, patient stratification, and prediction of histopathological correlation in gynecological malignancies. For example, the high performance of AI models to discriminate between benign and malignant ovarian masses or to predict their specific histology can improve the diagnostic accuracy of imaging methods.
Collapse
Affiliation(s)
- Francesca Moro
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | - Marianna Ciancia
- Dipartimento Universitario Scienze della Vita e Sanità Pubblica, Università Cattolica del Sacro Cuore, Rome, Italy
- Dipartimento di Salute della Donna e del Bambino, Università degli studi di Padova, Padova, Italy
| | - Drieda Zace
- Infectious Disease Clinic, Department of Systems Medicine, Tor Vergata University, Rome, Italy
| | - Marica Vagni
- Istituto di Radiologia, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Huong Elena Tran
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | - Maria Teresa Giudice
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | - Sofia Gambigliani Zoccoli
- Dipartimento Universitario Scienze della Vita e Sanità Pubblica, Università Cattolica del Sacro Cuore, Rome, Italy
- Department of Medical and Surgical Sciences for Mother, Child and Adult, University of Modena and Reggio Emilia, Azienda Ospedaliero Universitaria Policlinico, Modena, Italy
| | - Floriana Mascilini
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | - Francesca Ciccarone
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | - Luca Boldrini
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
| | | | - Giovanni Scambia
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
- Dipartimento Universitario Scienze della Vita e Sanità Pubblica, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Antonia Carla Testa
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli, IRCCS, Rome, Italy
- Dipartimento Universitario Scienze della Vita e Sanità Pubblica, Università Cattolica del Sacro Cuore, Rome, Italy
| |
Collapse
|
2
|
Singh J, Khanna NN, Rout RK, Singh N, Laird JR, Singh IM, Kalra MK, Mantella LE, Johri AM, Isenovic ER, Fouda MM, Saba L, Fatemi M, Suri JS. GeneAI 3.0: powerful, novel, generalized hybrid and ensemble deep learning frameworks for miRNA species classification of stationary patterns from nucleotides. Sci Rep 2024; 14:7154. [PMID: 38531923 PMCID: PMC11344070 DOI: 10.1038/s41598-024-56786-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 03/11/2024] [Indexed: 03/28/2024] Open
Abstract
Due to the intricate relationship between the small non-coding ribonucleic acid (miRNA) sequences, the classification of miRNA species, namely Human, Gorilla, Rat, and Mouse is challenging. Previous methods are not robust and accurate. In this study, we present AtheroPoint's GeneAI 3.0, a powerful, novel, and generalized method for extracting features from the fixed patterns of purines and pyrimidines in each miRNA sequence in ensemble paradigms in machine learning (EML) and convolutional neural network (CNN)-based deep learning (EDL) frameworks. GeneAI 3.0 utilized five conventional (Entropy, Dissimilarity, Energy, Homogeneity, and Contrast), and three contemporary (Shannon entropy, Hurst exponent, Fractal dimension) features, to generate a composite feature set from given miRNA sequences which were then passed into our ML and DL classification framework. A set of 11 new classifiers was designed consisting of 5 EML and 6 EDL for binary/multiclass classification. It was benchmarked against 9 solo ML (SML), 6 solo DL (SDL), 12 hybrid DL (HDL) models, resulting in a total of 11 + 27 = 38 models were designed. Four hypotheses were formulated and validated using explainable AI (XAI) as well as reliability/statistical tests. The order of the mean performance using accuracy (ACC)/area-under-the-curve (AUC) of the 24 DL classifiers was: EDL > HDL > SDL. The mean performance of EDL models with CNN layers was superior to that without CNN layers by 0.73%/0.92%. Mean performance of EML models was superior to SML models with improvements of ACC/AUC by 6.24%/6.46%. EDL models performed significantly better than EML models, with a mean increase in ACC/AUC of 7.09%/6.96%. The GeneAI 3.0 tool produced expected XAI feature plots, and the statistical tests showed significant p-values. Ensemble models with composite features are highly effective and generalized models for effectively classifying miRNA sequences.
Collapse
Affiliation(s)
- Jaskaran Singh
- Department of Computer Science, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Ranjeet K Rout
- Department of Computer Science and Engineering, NIT Srinagar, Hazratbal, Srinagar, India
| | - Narpinder Singh
- Department of Food Science, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Inder M Singh
- Advanced Cardiac and Vascular Institute, Sacramento, CA, USA
| | - Mannudeep K Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02115, USA
| | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Amer M Johri
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Esma R Isenovic
- Laboratory for Molecular Genetics and Radiobiology, University of Belgrade, Belgrade, Serbia
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Luca Saba
- Department of Neurology, University of Cagliari, Cagliari, Italy
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, 55905, USA
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint LLC, Roseville, CA, 95661, USA.
| |
Collapse
|
3
|
Barcroft JF, Linton-Reid K, Landolfo C, Al-Memar M, Parker N, Kyriacou C, Munaretto M, Fantauzzi M, Cooper N, Yazbek J, Bharwani N, Lee SR, Kim JH, Timmerman D, Posma J, Savelli L, Saso S, Aboagye EO, Bourne T. Machine learning and radiomics for segmentation and classification of adnexal masses on ultrasound. NPJ Precis Oncol 2024; 8:41. [PMID: 38378773 PMCID: PMC10879532 DOI: 10.1038/s41698-024-00527-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 01/30/2024] [Indexed: 02/22/2024] Open
Abstract
Ultrasound-based models exist to support the classification of adnexal masses but are subjective and rely upon ultrasound expertise. We aimed to develop an end-to-end machine learning (ML) model capable of automating the classification of adnexal masses. In this retrospective study, transvaginal ultrasound scan images with linked diagnoses (ultrasound subjective assessment or histology) were extracted and segmented from Imperial College Healthcare, UK (ICH development dataset; n = 577 masses; 1444 images) and Morgagni-Pierantoni Hospital, Italy (MPH external dataset; n = 184 masses; 476 images). A segmentation and classification model was developed using convolutional neural networks and traditional radiomics features. Dice surface coefficient (DICE) was used to measure segmentation performance and area under the ROC curve (AUC), F1-score and recall for classification performance. The ICH and MPH datasets had a median age of 45 (IQR 35-60) and 48 (IQR 38-57) years old and consisted of 23.1% and 31.5% malignant cases, respectively. The best segmentation model achieved a DICE score of 0.85 ± 0.01, 0.88 ± 0.01 and 0.85 ± 0.01 in the ICH training, ICH validation and MPH test sets. The best classification model achieved a recall of 1.00 and F1-score of 0.88 (AUC:0.93), 0.94 (AUC:0.89) and 0.83 (AUC:0.90) in the ICH training, ICH validation and MPH test sets, respectively. We have developed an end-to-end radiomics-based model capable of adnexal mass segmentation and classification, with a comparable predictive performance (AUC 0.90) to the published performance of expert subjective assessment (gold standard), and current risk models. Further prospective evaluation of the classification performance of this ML model against existing methods is required.
Collapse
Affiliation(s)
- Jennifer F Barcroft
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | | | - Chiara Landolfo
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Maya Al-Memar
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Nina Parker
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Chris Kyriacou
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Maria Munaretto
- Department of Obstetrics and Gynaecology, Ospedale Morgagni-Pierantoni, Forli, Italy
| | - Martina Fantauzzi
- Department of Medicine and Surgery, University of Milan-Bicocca, Milan, Italy
| | - Nina Cooper
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Joseph Yazbek
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
| | - Nishat Bharwani
- Department of Radiology, Imperial College Healthcare NHS Trust, London, UK
| | - Sa Ra Lee
- Department of Obstetrics and Gynaecology, Asan Medical Center, Seoul, South Korea
| | - Ju Hee Kim
- Department of Obstetrics and Gynaecology, Asan Medical Center, Seoul, South Korea
| | - Dirk Timmerman
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynecology, University Hospitals Leuven, Leuven, Belgium
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
| | - Joram Posma
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
| | - Luca Savelli
- Department of Obstetrics and Gynaecology, Ospedale Morgagni-Pierantoni, Forli, Italy
| | - Srdjan Saso
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
- Department of Surgery and Cancer, Imperial College London, London, UK
| | - Eric O Aboagye
- Department of Surgery and Cancer, Imperial College London, London, UK.
| | - Tom Bourne
- Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
- Department of Obstetrics and Gynaecology, Imperial College Healthcare NHS Trust, London, UK
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
| |
Collapse
|
4
|
Brandão M, Mendes F, Martins M, Cardoso P, Macedo G, Mascarenhas T, Mascarenhas Saraiva M. Revolutionizing Women's Health: A Comprehensive Review of Artificial Intelligence Advancements in Gynecology. J Clin Med 2024; 13:1061. [PMID: 38398374 PMCID: PMC10889757 DOI: 10.3390/jcm13041061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 02/04/2024] [Accepted: 02/05/2024] [Indexed: 02/25/2024] Open
Abstract
Artificial intelligence has yielded remarkably promising results in several medical fields, namely those with a strong imaging component. Gynecology relies heavily on imaging since it offers useful visual data on the female reproductive system, leading to a deeper understanding of pathophysiological concepts. The applicability of artificial intelligence technologies has not been as noticeable in gynecologic imaging as in other medical fields so far. However, due to growing interest in this area, some studies have been performed with exciting results. From urogynecology to oncology, artificial intelligence algorithms, particularly machine learning and deep learning, have shown huge potential to revolutionize the overall healthcare experience for women's reproductive health. In this review, we aim to establish the current status of AI in gynecology, the upcoming developments in this area, and discuss the challenges facing its clinical implementation, namely the technological and ethical concerns for technology development, implementation, and accountability.
Collapse
Affiliation(s)
- Marta Brandão
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (M.B.); (P.C.); (G.M.); (T.M.)
| | - Francisco Mendes
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (F.M.); (M.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - Miguel Martins
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (F.M.); (M.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (M.B.); (P.C.); (G.M.); (T.M.)
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (F.M.); (M.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - Guilherme Macedo
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (M.B.); (P.C.); (G.M.); (T.M.)
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (F.M.); (M.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - Teresa Mascarenhas
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (M.B.); (P.C.); (G.M.); (T.M.)
- Department of Obstetrics and Gynecology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Miguel Mascarenhas Saraiva
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (M.B.); (P.C.); (G.M.); (T.M.)
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal; (F.M.); (M.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| |
Collapse
|
5
|
Mitchell S, Nikolopoulos M, El-Zarka A, Al-Karawi D, Al-Zaidi S, Ghai A, Gaughran JE, Sayasneh A. Artificial Intelligence in Ultrasound Diagnoses of Ovarian Cancer: A Systematic Review and Meta-Analysis. Cancers (Basel) 2024; 16:422. [PMID: 38275863 PMCID: PMC10813993 DOI: 10.3390/cancers16020422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 01/11/2024] [Accepted: 01/16/2024] [Indexed: 01/27/2024] Open
Abstract
Ovarian cancer is the sixth most common malignancy, with a 35% survival rate across all stages at 10 years. Ultrasound is widely used for ovarian tumour diagnosis, and accurate pre-operative diagnosis is essential for appropriate patient management. Artificial intelligence is an emerging field within gynaecology and has been shown to aid in the ultrasound diagnosis of ovarian cancers. For this study, Embase and MEDLINE databases were searched, and all original clinical studies that used artificial intelligence in ultrasound examinations for the diagnosis of ovarian malignancies were screened. Studies using histopathological findings as the standard were included. The diagnostic performance of each study was analysed, and all the diagnostic performances were pooled and assessed. The initial search identified 3726 papers, of which 63 were suitable for abstract screening. Fourteen studies that used artificial intelligence in ultrasound diagnoses of ovarian malignancies and had histopathological findings as a standard were included in the final analysis, each of which had different sample sizes and used different methods; these studies examined a combined total of 15,358 ultrasound images. The overall sensitivity was 81% (95% CI, 0.80-0.82), and specificity was 92% (95% CI, 0.92-0.93), indicating that artificial intelligence demonstrates good performance in ultrasound diagnoses of ovarian cancer. Further prospective work is required to further validate AI for its use in clinical practice.
Collapse
Affiliation(s)
- Sian Mitchell
- Department of Women’s Health, Guy’s and St Thomas’ Hospital NHS Foundation Trust, London SE1 7EH, UK
| | - Manolis Nikolopoulos
- Department of Women’s Health, Guy’s and St Thomas’ Hospital NHS Foundation Trust, London SE1 7EH, UK
| | - Alaa El-Zarka
- Department of Gynaecology, Alexandria Faculty of Medicine, Alexandria 21433, Egypt
| | | | | | - Avi Ghai
- School of Life Course Sciences, Faculty of Life Sciences and Medicine, King’s College London, Strand, London WC2R 2LS, UK
| | - Jonathan E. Gaughran
- Department of Women’s Health, Guy’s and St Thomas’ Hospital NHS Foundation Trust, London SE1 7EH, UK
| | - Ahmad Sayasneh
- Department of Gynaecological Oncology, Surgical Oncology Directorate, Cancer Centre, Guy’s Hospital, Great Maze Pond, London SE1 9RT, UK
- School of Life Course Sciences, Faculty of Life Sciences and Medicine, St Thomas Hospital, Westminster Bridge Road, London SE1 7EH, UK
| |
Collapse
|
6
|
Kumari V, Kumar N, Kumar K S, Kumar A, Skandha SS, Saxena S, Khanna NN, Laird JR, Singh N, Fouda MM, Saba L, Singh R, Suri JS. Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look. J Cardiovasc Dev Dis 2023; 10:485. [PMID: 38132653 PMCID: PMC10743870 DOI: 10.3390/jcdd10120485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/15/2023] [Accepted: 11/07/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND AND MOTIVATION Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias. METHODS Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework. FINDINGS AND CONCLUSIONS UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.
Collapse
Affiliation(s)
- Vandana Kumari
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Naresh Kumar
- Department of Applied Computational Science and Engineering, G L Bajaj Institute of Technology and Management, Greater Noida 201310, India
| | - Sampath Kumar K
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Ashish Kumar
- School of CSET, Bennett University, Greater Noida 201310, India;
| | - Sanagala S. Skandha
- Department of CSE, CMR College of Engineering and Technology, Hyderabad 501401, India;
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIT Bhubaneswar, Bhubaneswar 751003, India;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy;
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, India;
| | - Jasjit S. Suri
- Stroke Diagnostics and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Computer Science & Engineering, Graphic Era, Deemed to be University, Dehradun 248002, India
- Monitoring and Diagnosis Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
7
|
Prediction of O-6-methylguanine-DNA methyltransferase and overall survival of the patients suffering from glioblastoma using MRI-based hybrid radiomics signatures in machine and deep learning framework. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08405-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
8
|
Koch AH, Jeelof LS, Muntinga CLP, Gootzen TA, van de Kruis NMA, Nederend J, Boers T, van der Sommen F, Piek JMJ. Analysis of computer-aided diagnostics in the preoperative diagnosis of ovarian cancer: a systematic review. Insights Imaging 2023; 14:34. [PMID: 36790570 PMCID: PMC9931983 DOI: 10.1186/s13244-022-01345-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 12/05/2022] [Indexed: 02/16/2023] Open
Abstract
OBJECTIVES Different noninvasive imaging methods to predict the chance of malignancy of ovarian tumors are available. However, their predictive value is limited due to subjectivity of the reviewer. Therefore, more objective prediction models are needed. Computer-aided diagnostics (CAD) could be such a model, since it lacks bias that comes with currently used models. In this study, we evaluated the available data on CAD in predicting the chance of malignancy of ovarian tumors. METHODS We searched for all published studies investigating diagnostic accuracy of CAD based on ultrasound, CT and MRI in pre-surgical patients with an ovarian tumor compared to reference standards. RESULTS In thirty-one included studies, extracted features from three different imaging techniques were used in different mathematical models. All studies assessed CAD based on machine learning on ultrasound, CT scan and MRI scan images. Per imaging method, subsequently ultrasound, CT and MRI, sensitivities ranged from 40.3 to 100%; 84.6-100% and 66.7-100% and specificities ranged from 76.3-100%; 69-100% and 77.8-100%. Results could not be pooled, due to broad heterogeneity. Although the majority of studies report high performances, they are at considerable risk of overfitting due to the absence of an independent test set. CONCLUSION Based on this literature review, different CAD for ultrasound, CT scans and MRI scans seem promising to aid physicians in assessing ovarian tumors through their objective and potentially cost-effective character. However, performance should be evaluated per imaging technique. Prospective and larger datasets with external validation are desired to make their results generalizable.
Collapse
Affiliation(s)
- Anna H. Koch
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - Lara S. Jeelof
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - Caroline L. P. Muntinga
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - T. A. Gootzen
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - Nienke M. A. van de Kruis
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - Joost Nederend
- grid.413532.20000 0004 0398 8384Department of Radiology, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| | - Tim Boers
- grid.6852.90000 0004 0398 8763Department of Electrical Engineering, VCA Group, University of Technology Eindhoven, 5600 MB Eindhoven, Noord-Brabant The Netherlands
| | - Fons van der Sommen
- grid.6852.90000 0004 0398 8763Department of Electrical Engineering, VCA Group, University of Technology Eindhoven, 5600 MB Eindhoven, Noord-Brabant The Netherlands
| | - Jurgen M. J. Piek
- grid.413532.20000 0004 0398 8384Department of Gynaecology and Obstetrics and Catharina Cancer Institute, Catharina Hospital, 5623 EJ Eindhoven, Noord-Brabant, The Netherlands
| |
Collapse
|
9
|
Saxena S, Jena B, Mohapatra B, Gupta N, Kalra M, Scartozzi M, Saba L, Suri JS. Fused deep learning paradigm for the prediction of o6-methylguanine-DNA methyltransferase genotype in glioblastoma patients: A neuro-oncological investigation. Comput Biol Med 2023; 153:106492. [PMID: 36621191 DOI: 10.1016/j.compbiomed.2022.106492] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 11/29/2022] [Accepted: 12/27/2022] [Indexed: 01/06/2023]
Abstract
BACKGROUND The O6-methylguanine-DNA methyltransferase (MGMT) is a deoxyribonucleic acid (DNA) repairing enzyme that has been established as an essential clinical brain tumor biomarker for Glioblastoma Multiforme (GBM). Knowing the status of MGMT methylation biomarkers using multi-parametric MRI (mp-MRI) helps neuro-oncologists to analyze GBM and its treatment plan. METHOD The hand-crafted radiomics feature extraction of GBM's subregions, such as edema(ED), tumor core (TC), and enhancing tumor (ET) in the machine learning (ML) framework, was investigated using support vector machine(SVM), K-Nearest Neighbours (KNN), random forest (RF), LightGBM, and extreme gradient boosting (XGB). For tissue-level analysis of the promotor genes in GBM, we used the deep residual neural network (ResNet-18) with 3D architecture, followed by EfficientNet-based investigation for variants as B0 and B1. Lastly, we analyzed the fused deep learning (FDL) framework that combines ML and DL frameworks. RESULT Structural mp-MRI consisting of T1, T2, FLAIR, and T1GD having a size of 400 and 185 patients, respectively, for discovery and replication cohorts. Using the CV protocol in the ResNet-3D framework, MGMT methylation status prediction in mp-MRI gave the AUC of 0.753 (p < 0.0001) and 0.72 (p < 0.0001) for the discovery and replication cohort, respectively. We presented that the FDL is ∼7% superior to solo DL and ∼15% to solo ML. CONCLUSION The proposed study aims to provide solutions for building an efficient predictive model of MGMT for GBM patients using deep radiomics features obtained from mp-MRI with the end-to-end ResNet-18 3D and FDL imaging signatures.
Collapse
Affiliation(s)
- Sanjay Saxena
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Biswajit Jena
- Department of Computer Science & Engineering, Institute of Technical Education and Research, SOA Deemed to be University, Bhubaneswar, India
| | - Bibhabasu Mohapatra
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Neha Gupta
- Bharati Vidyapeeth's College of Engineering, Paschim Vihar, New Delhi, India
| | - Manudeep Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Mario Scartozzi
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Luca Saba
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™ LLC, Roseville, CA, USA; Knowledge Engineering Centre, Global Biomedical Technologies, Inc, Roseville, CA, USA.
| |
Collapse
|
10
|
Feasibility of using AI to auto-catch responsible frames in ultrasound screening for breast cancer diagnosis. iScience 2022; 26:105692. [PMID: 36570770 PMCID: PMC9771726 DOI: 10.1016/j.isci.2022.105692] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 10/31/2022] [Accepted: 11/26/2022] [Indexed: 12/12/2022] Open
Abstract
The research of AI-assisted breast diagnosis has primarily been based on static images. It is unclear whether it represents the best diagnosis image.To explore the method of capturing complementary responsible frames from breast ultrasound screening by using artificial intelligence. We used feature entropy breast network (FEBrNet) to select responsible frames from breast ultrasound screenings and compared the diagnostic performance of AI models based on FEBrNet-recommended frames, physician-selected frames, 5-frame interval-selected frames, all frames of video, as well as that of ultrasound and mammography specialists. The AUROC of AI model based on FEBrNet-recommended frames outperformed other frame set based AI models, as well as ultrasound and mammography physicians, indicating that FEBrNet can reach level of medical specialists in frame selection.FEBrNet model can extract video responsible frames for breast nodule diagnosis, whose performance is equivalent to the doctors selected responsible frames.
Collapse
|
11
|
Hsu ST, Su YJ, Hung CH, Chen MJ, Lu CH, Kuo CE. Automatic ovarian tumors recognition system based on ensemble convolutional neural network with ultrasound imaging. BMC Med Inform Decis Mak 2022; 22:298. [PMID: 36397100 PMCID: PMC9673368 DOI: 10.1186/s12911-022-02047-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2022] [Accepted: 11/14/2022] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Upon the discovery of ovarian cysts, obstetricians, gynecologists, and ultrasound examiners must address the common clinical challenge of distinguishing between benign and malignant ovarian tumors. Numerous types of ovarian tumors exist, many of which exhibit similar characteristics that increase the ambiguity in clinical diagnosis. Using deep learning technology, we aimed to develop a method that rapidly and accurately assists the different diagnosis of ovarian tumors in ultrasound images. METHODS Based on deep learning method, we used ten well-known convolutional neural network models (e.g., Alexnet, GoogleNet, and ResNet) for training of transfer learning. To ensure method stability and robustness, we repeated the random sampling of the training and validation data ten times. The mean of the ten test results was set as the final assessment data. After the training process was completed, the three models with the highest ratio of calculation accuracy to time required for classification were used for ensemble learning pertaining. Finally, the interpretation results of the ensemble classifier were used as the final results. We also applied ensemble gradient-weighted class activation mapping (Grad-CAM) technology to visualize the decision-making results of the models. RESULTS The highest mean accuracy, mean sensitivity, and mean specificity of ten single CNN models were 90.51 ± 4.36%, 89.77 ± 4.16%, and 92.00 ± 5.95%, respectively. The mean accuracy, mean sensitivity, and mean specificity of the ensemble classifier method were 92.15 ± 2.84%, 91.37 ± 3.60%, and 92.92 ± 4.00%, respectively. The performance of the ensemble classifier is better than that of a single classifier in three evaluation metrics. Moreover, the standard deviation is also better which means the ensemble classifier is more stable and robust. CONCLUSION From the comprehensive perspective of data quantity, data diversity, robustness of validation strategy, and overall accuracy, the proposed method outperformed the methods used in previous studies. In future studies, we will continue to increase the number of authenticated images and apply our proposed method in clinical settings to increase its robustness and reliability.
Collapse
Affiliation(s)
- Shih-Tien Hsu
- Department of Obstetrics, Gynecology and Women's Health, Taichung Veterans General Hospital, No. 1650 Sec. 4 Taiwan Blvd. Xitun Dist., Taichung, 407, Taiwan
| | - Yu-Jie Su
- Master's Program of Biomedical Infomatics and Biomedical Engineering, Feng Chia University, No. 100 Wenhua Rd. Xitun Dist., Taichung, 407, Taiwan
| | - Chian-Huei Hung
- Department of Obstetrics, Gynecology and Women's Health, Taichung Veterans General Hospital, No. 1650 Sec. 4 Taiwan Blvd. Xitun Dist., Taichung, 407, Taiwan
| | - Ming-Jer Chen
- Department of Obstetrics, Gynecology and Women's Health, Taichung Veterans General Hospital, No. 1650 Sec. 4 Taiwan Blvd. Xitun Dist., Taichung, 407, Taiwan
| | - Chien-Hsing Lu
- Department of Obstetrics, Gynecology and Women's Health, Taichung Veterans General Hospital, No. 1650 Sec. 4 Taiwan Blvd. Xitun Dist., Taichung, 407, Taiwan
| | - Chih-En Kuo
- Department of Applied Mathematics, National Chung Hsing University, No. 145, Xingda Rd., South Dist., Taichung, 402, Taiwan.
| |
Collapse
|
12
|
Xu HL, Gong TT, Liu FH, Chen HY, Xiao Q, Hou Y, Huang Y, Sun HZ, Shi Y, Gao S, Lou Y, Chang Q, Zhao YH, Gao QL, Wu QJ. Artificial intelligence performance in image-based ovarian cancer identification: A systematic review and meta-analysis. EClinicalMedicine 2022; 53:101662. [PMID: 36147628 PMCID: PMC9486055 DOI: 10.1016/j.eclinm.2022.101662] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/25/2022] [Accepted: 08/30/2022] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Accurate identification of ovarian cancer (OC) is of paramount importance in clinical treatment success. Artificial intelligence (AI) is a potentially reliable assistant for the medical imaging recognition. We systematically review articles on the diagnostic performance of AI in OC from medical imaging for the first time. METHODS The Medline, Embase, IEEE, PubMed, Web of Science, and the Cochrane library databases were searched for related studies published until August 1, 2022. Inclusion criteria were studies that developed or used AI algorithms in the diagnosis of OC from medical images. The binary diagnostic accuracy data were extracted to derive the outcomes of interest: sensitivity (SE), specificity (SP), and Area Under the Curve (AUC). The study was registered with the PROSPERO, CRD42022324611. FINDINGS Thirty-four eligible studies were identified, of which twenty-eight studies were included in the meta-analysis with a pooled SE of 88% (95%CI: 85-90%), SP of 85% (82-88%), and AUC of 0.93 (0.91-0.95). Analysis for different algorithms revealed a pooled SE of 89% (85-92%) and SP of 88% (82-92%) for machine learning; and a pooled SE of 88% (84-91%) and SP of 84% (80-87%) for deep learning. Acceptable diagnostic performance was demonstrated in subgroup analyses stratified by imaging modalities (Ultrasound, Magnetic Resonance Imaging, or Computed Tomography), sample size (≤300 or >300), AI algorithms versus clinicians, year of publication (before or after 2020), geographical distribution (Asia or non Asia), and the different risk of bias levels (≥3 domain low risk or < 3 domain low risk). INTERPRETATION AI algorithms exhibited favorable performance for the diagnosis of OC through medical imaging. More rigorous reporting standards that address specific challenges of AI research could improve future studies. FUNDING This work was supported by the Natural Science Foundation of China (No. 82073647 to Q-JW and No. 82103914 to T-TG), LiaoNing Revitalization Talents Program (No. XLYC1907102 to Q-JW), and 345 Talent Project of Shengjing Hospital of China Medical University (No. M0268 to Q-JW and No. M0952 to T-TG).
Collapse
Key Words
- AI, Artificial intelligence
- AUC, Area Under the Curve
- Artificial intelligence
- CT, Computed Tomography
- DL, Deep learning
- ML, Machine learning
- MRI, Magnetic Resonance Imaging
- Medical imaging
- Meta-analysis
- OC, Ovarian cancer
- Ovarian cancer
- SE, Sensitivity
- SP, Specificity
- US, Ultrasound
- XAI, Explainable artificial intelligence
Collapse
Affiliation(s)
- He-Li Xu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Ting-Ting Gong
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Fang-Hua Liu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Hong-Yu Chen
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Qian Xiao
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yang Hou
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Ying Huang
- Department of Ultrasound, Shengjing Hospital of China Medical University, Shenyang, China
| | - Hong-Zan Sun
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yu Shi
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Song Gao
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yan Lou
- Department of Intelligent Medicine, China Medical University, China
| | - Qing Chang
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yu-Hong Zhao
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Qing-Lei Gao
- National Clinical Research Center for Obstetrics and Gynecology, Cancer Biology Research Centre (Key Laboratory of the Ministry of Education) and Department of Gynecology and Obstetrics, Tongji Hospital, Wuhan, China
| | - Qi-Jun Wu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
- Corresponding author at: Department of Clinical Epidemiology, Department of Obstetrics and Gynecology, Clinical Research Center, Shengjing Hospital of China Medical University, Address: No. 36, San Hao Street, Shenyang, Liaoning 110004, PR China.
| |
Collapse
|
13
|
Johri AM, Singh KV, Mantella LE, Saba L, Sharma A, Laird JR, Utkarsh K, Singh IM, Gupta S, Kalra MS, Suri JS. Deep learning artificial intelligence framework for multiclass coronary artery disease prediction using combination of conventional risk factors, carotid ultrasound, and intraplaque neovascularization. Comput Biol Med 2022; 150:106018. [PMID: 36174330 DOI: 10.1016/j.compbiomed.2022.106018] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 08/06/2022] [Accepted: 08/20/2022] [Indexed: 11/23/2022]
Abstract
OBJECTIVE Cardiovascular disease (CVD) is a major healthcare challenge and therefore early risk assessment is vital. Previous assessment techniques use either "conventional CVD risk calculators (CCVRC)" or machine learning (ML) paradigms. These techniques are ad-hoc, unreliable, not fully automated, and have variabilities. We, therefore, introduce AtheroEdge-MCDLAI (AE3.0DL) windows-based platform using multiclass Deep Learning (DL) system. METHODS Data was collected on 500 patients having both carotid ultrasound and corresponding coronary angiography scores (CAS), measured as stenosis in coronary arteries and considered as the gold standard. A total of 39 covariates were used, clubbed into three clusters, namely (i) Office-based: age, gender, body mass index, smoker, hypertension, systolic blood pressure, and diastolic blood pressure; (ii) Laboratory-based: Hyperlipidemia, hemoglobin A1c, and estimated glomerular filtration rate; and (iii) Carotid ultrasound image phenotypes: maximum plaque height, total plaque area, and intra-plaque neovascularization. Baseline characteristics for four classes (target labels) having significant (p < 0.0001) values were calculated using Chi-square and ANOVA. For handling the cohort's imbalance in the risk classes, AE3.0DL used the synthetic minority over-sampling technique (SMOTE). AE3.0DL used Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) DL models and the performance (accuracy and area-under-the-curve) was computed using 10-fold cross-validation (90% training, 10% testing) frameworks. AE3.0DL was validated and benchmarked. RESULTS The AE3.0DL using RNN and LSTM showed an accuracy and AUC (p < 0.0001) pairs as (95.00% and 0.98), and (95.34% and 0.99), respectively, and showed an improvement of 32.93% and 9.94% against CCVRC and ML, respectively. AE3.0DL runs in <1 s. CONCLUSION DL algorithms are a powerful paradigm for coronary artery disease (CAD) risk prediction and CVD risk stratification.
Collapse
Affiliation(s)
- Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, ON, Canada
| | | | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | | | | | - Suneet Gupta
- Department of Computer Science, Bennett University, Gr. Noida, India
| | - Manudeep S Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, 02114, USA
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA; Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| |
Collapse
|
14
|
Munir K, Frezza F, Rizzi A. Deep Learning Hybrid Techniques for Brain Tumor Segmentation. SENSORS (BASEL, SWITZERLAND) 2022; 22:8201. [PMID: 36365900 PMCID: PMC9658353 DOI: 10.3390/s22218201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 10/17/2022] [Accepted: 10/19/2022] [Indexed: 06/16/2023]
Abstract
Medical images play an important role in medical diagnosis and treatment. Oncologists analyze images to determine the different characteristics of deadly diseases, plan the therapy, and observe the evolution of the disease. The objective of this paper is to propose a method for the detection of brain tumors. Brain tumors are identified from Magnetic Resonance (MR) images by performing suitable segmentation procedures. The latest technical literature concerning radiographic images of the brain shows that deep learning methods can be implemented to extract specific features of brain tumors, aiding clinical diagnosis. For this reason, most data scientists and AI researchers work on Machine Learning methods for designing automatic screening procedures. Indeed, an automated method would result in quicker segmentation findings, providing a robust output with respect to possible differences in data sources, mostly due to different procedures in data recording and storing, resulting in a more consistent identification of brain tumors. To improve the performance of the segmentation procedure, new architectures are proposed and tested in this paper. We propose deep neural networks for the detection of brain tumors, trained on the MRI scans of patients' brains. The proposed architectures are based on convolutional neural networks and inception modules for brain tumor segmentation. A comparison of these proposed architectures with the baseline reference ones shows very interesting results. MI-Unet showed a performance increase in comparison to baseline Unet architecture by 7.5% in dice score, 23.91% insensitivity, and 7.09% in specificity. Depth-wise separable MI-Unet showed a performance increase by 10.83% in dice score, 2.97% in sensitivity, and 12.72% in specificity as compared to the baseline Unet architecture. Hybrid Unet architecture achieved performance improvement of 9.71% in dice score, 3.56% in sensitivity, and 12.6% in specificity. Whereas the depth-wise separable hybrid Unet architecture outperformed the baseline architecture by 15.45% in dice score, 20.56% in sensitivity, and 12.22% in specificity.
Collapse
|
15
|
Jena B, Saxena S, Nayak GK, Balestrieri A, Gupta N, Khanna NN, Laird JR, Kalra MK, Fouda MM, Saba L, Suri JS. Brain Tumor Characterization Using Radiogenomics in Artificial Intelligence Framework. Cancers (Basel) 2022; 14:4052. [PMID: 36011048 PMCID: PMC9406706 DOI: 10.3390/cancers14164052] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 08/17/2022] [Accepted: 08/19/2022] [Indexed: 11/16/2022] Open
Abstract
Brain tumor characterization (BTC) is the process of knowing the underlying cause of brain tumors and their characteristics through various approaches such as tumor segmentation, classification, detection, and risk analysis. The substantial brain tumor characterization includes the identification of the molecular signature of various useful genomes whose alteration causes the brain tumor. The radiomics approach uses the radiological image for disease characterization by extracting quantitative radiomics features in the artificial intelligence (AI) environment. However, when considering a higher level of disease characteristics such as genetic information and mutation status, the combined study of "radiomics and genomics" has been considered under the umbrella of "radiogenomics". Furthermore, AI in a radiogenomics' environment offers benefits/advantages such as the finalized outcome of personalized treatment and individualized medicine. The proposed study summarizes the brain tumor's characterization in the prospect of an emerging field of research, i.e., radiomics and radiogenomics in an AI environment, with the help of statistical observation and risk-of-bias (RoB) analysis. The PRISMA search approach was used to find 121 relevant studies for the proposed review using IEEE, Google Scholar, PubMed, MDPI, and Scopus. Our findings indicate that both radiomics and radiogenomics have been successfully applied aggressively to several oncology applications with numerous advantages. Furthermore, under the AI paradigm, both the conventional and deep radiomics features have made an impact on the favorable outcomes of the radiogenomics approach of BTC. Furthermore, risk-of-bias (RoB) analysis offers a better understanding of the architectures with stronger benefits of AI by providing the bias involved in them.
Collapse
Affiliation(s)
- Biswajit Jena
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | - Gopal Krishna Nayak
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | | | - Neha Gupta
- Department of IT, Bharati Vidyapeeth’s College of Engineering, New Delhi 110056, India
| | - Narinder N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Radiology, AOU, University of Cagliari, 09124 Cagliari, Italy
| | - Jasjit S. Suri
- Stroke Diagnosis and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
16
|
Teji JS, Jain S, Gupta SK, Suri JS. NeoAI 1.0: Machine learning-based paradigm for prediction of neonatal and infant risk of death. Comput Biol Med 2022; 147:105639. [DOI: 10.1016/j.compbiomed.2022.105639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Revised: 05/01/2022] [Accepted: 05/01/2022] [Indexed: 11/29/2022]
|
17
|
Suri JS, Maindarkar MA, Paul S, Ahluwalia P, Bhagawati M, Saba L, Faa G, Saxena S, Singh IM, Chadha PS, Turk M, Johri A, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou AD, Misra DP, Agarwal V, Kitas GD, Kolluri R, Teji JS, Al-Maini M, Dhanjil SK, Sockalingam M, Saxena A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Omerzu T, Naidu S, Nicolaides A, Paraskevas KI, Kalra M, Ruzsa Z, Fouda MM. Deep Learning Paradigm for Cardiovascular Disease/Stroke Risk Stratification in Parkinson's Disease Affected by COVID-19: A Narrative Review. Diagnostics (Basel) 2022; 12:1543. [PMID: 35885449 PMCID: PMC9324237 DOI: 10.3390/diagnostics12071543] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Revised: 06/14/2022] [Accepted: 06/16/2022] [Indexed: 11/16/2022] Open
Abstract
Background and Motivation: Parkinson's disease (PD) is one of the most serious, non-curable, and expensive to treat. Recently, machine learning (ML) has shown to be able to predict cardiovascular/stroke risk in PD patients. The presence of COVID-19 causes the ML systems to become severely non-linear and poses challenges in cardiovascular/stroke risk stratification. Further, due to comorbidity, sample size constraints, and poor scientific and clinical validation techniques, there have been no well-explained ML paradigms. Deep neural networks are powerful learning machines that generalize non-linear conditions. This study presents a novel investigation of deep learning (DL) solutions for CVD/stroke risk prediction in PD patients affected by the COVID-19 framework. Method: The PRISMA search strategy was used for the selection of 292 studies closely associated with the effect of PD on CVD risk in the COVID-19 framework. We study the hypothesis that PD in the presence of COVID-19 can cause more harm to the heart and brain than in non-COVID-19 conditions. COVID-19 lung damage severity can be used as a covariate during DL training model designs. We, therefore, propose a DL model for the estimation of, (i) COVID-19 lesions in computed tomography (CT) scans and (ii) combining the covariates of PD, COVID-19 lesions, office and laboratory arterial atherosclerotic image-based biomarkers, and medicine usage for the PD patients for the design of DL point-based models for CVD/stroke risk stratification. Results: We validated the feasibility of CVD/stroke risk stratification in PD patients in the presence of a COVID-19 environment and this was also verified. DL architectures like long short-term memory (LSTM), and recurrent neural network (RNN) were studied for CVD/stroke risk stratification showing powerful designs. Lastly, we examined the artificial intelligence bias and provided recommendations for early detection of CVD/stroke in PD patients in the presence of COVID-19. Conclusion: The DL is a very powerful tool for predicting CVD/stroke risk in PD patients affected by COVID-19.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (M.A.M.); (I.M.S.); (P.S.C.); (S.K.D.)
| | - Mahesh A. Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (M.A.M.); (I.M.S.); (P.S.C.); (S.K.D.)
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.B.)
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.B.)
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India;
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.B.)
| | - Luca Saba
- Department of Radiology, and Pathology, Azienda Ospedaliero Universitaria, 09123 Cagliari, Italy; (L.S.); (G.F.)
| | - Gavino Faa
- Department of Radiology, and Pathology, Azienda Ospedaliero Universitaria, 09123 Cagliari, Italy; (L.S.); (G.F.)
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751029, India;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (M.A.M.); (I.M.S.); (P.S.C.); (S.K.D.)
| | - Paramjit S. Chadha
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (M.A.M.); (I.M.S.); (P.S.C.); (S.K.D.)
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (M.T.); (T.O.)
| | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India; (N.N.K.); (A.S.)
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Sofia Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 176 74 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Rheumatology Unit, National Kapodistrian University of Athens, 157 72 Athens, Greece; (D.W.S.); (P.P.S.)
| | | | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 157 72 Athens, Greece; (D.W.S.); (P.P.S.)
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 541 24 Thessaloniki, Greece;
| | - Athanase D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 157 72 Athens, Greece;
| | - Durga Prasanna Misra
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Raghu Kolluri
- OhioHealth Heart and Vascular, Mansfield, OH 44905, USA;
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology, and Rheumatology Institute, Toronto, ON M5G 1N8, Canada;
| | - Surinder K. Dhanjil
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (M.A.M.); (I.M.S.); (P.S.C.); (S.K.D.)
| | | | - Ajit Saxena
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India; (N.N.K.); (A.S.)
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA 95823, USA;
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (M.T.); (T.O.)
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Engomi 2408, Cyprus;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| | - Mannudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA;
| | - Zoltán Ruzsa
- Invasive Cardiology Division, Faculty of Medicine, University of Szeged, 6720 Szeged, Hungary;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| |
Collapse
|
18
|
Khanna NN, Maindarkar M, Saxena A, Ahluwalia P, Paul S, Srivastava SK, Cuadrado-Godia E, Sharma A, Omerzu T, Saba L, Mavrogeni S, Turk M, Laird JR, Kitas GD, Fatemi M, Barqawi AB, Miner M, Singh IM, Johri A, Kalra MM, Agarwal V, Paraskevas KI, Teji JS, Fouda MM, Pareek G, Suri JS. Cardiovascular/Stroke Risk Assessment in Patients with Erectile Dysfunction-A Role of Carotid Wall Arterial Imaging and Plaque Tissue Characterization Using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:1249. [PMID: 35626404 PMCID: PMC9141739 DOI: 10.3390/diagnostics12051249] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/14/2022] [Accepted: 05/15/2022] [Indexed: 12/12/2022] Open
Abstract
PURPOSE The role of erectile dysfunction (ED) has recently shown an association with the risk of stroke and coronary heart disease (CHD) via the atherosclerotic pathway. Cardiovascular disease (CVD)/stroke risk has been widely understood with the help of carotid artery disease (CTAD), a surrogate biomarker for CHD. The proposed study emphasizes artificial intelligence-based frameworks such as machine learning (ML) and deep learning (DL) that can accurately predict the severity of CVD/stroke risk using carotid wall arterial imaging in ED patients. METHODS Using the PRISMA model, 231 of the best studies were selected. The proposed study mainly consists of two components: (i) the pathophysiology of ED and its link with coronary artery disease (COAD) and CHD in the ED framework and (ii) the ultrasonic-image morphological changes in the carotid arterial walls by quantifying the wall parameters and the characterization of the wall tissue by adapting the ML/DL-based methods, both for the prediction of the severity of CVD risk. The proposed study analyzes the hypothesis that ML/DL can lead to an accurate and early diagnosis of the CVD/stroke risk in ED patients. Our finding suggests that the routine ED patient practice can be amended for ML/DL-based CVD/stroke risk assessment using carotid wall arterial imaging leading to fast, reliable, and accurate CVD/stroke risk stratification. SUMMARY We conclude that ML and DL methods are very powerful tools for the characterization of CVD/stroke in patients with varying ED conditions. We anticipate a rapid growth of these tools for early and better CVD/stroke risk management in ED patients.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Mahesh Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Ajit Saxena
- Department of Urology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India;
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
| | - Saurabh K. Srivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad 244001, India;
| | - Elisa Cuadrado-Godia
- Department of Neurology, Hospital del Mar Medical Research Institute, 08003 Barcelona, Spain;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09124 Cagliari, Italy;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 176 74 Athens, Greece;
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, NY 55905, USA;
| | - Al Baha Barqawi
- Division of Urology, Department of Surgery, University of Colorado Anschutz Medical Campus, Aurora, CO 80045, USA;
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | | | - Vikas Agarwal
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA;
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| |
Collapse
|
19
|
Suri JS, Paul S, Maindarkar MA, Puvvula A, Saxena S, Saba L, Turk M, Laird JR, Khanna NN, Viskovic K, Singh IM, Kalra M, Krishnan PR, Johri A, Paraskevas KI. Cardiovascular/Stroke Risk Stratification in Parkinson's Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review. Metabolites 2022; 12:metabo12040312. [PMID: 35448500 PMCID: PMC9033076 DOI: 10.3390/metabo12040312] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 12/20/2022] Open
Abstract
Parkinson’s disease (PD) is a severe, incurable, and costly condition leading to heart failure. The link between PD and cardiovascular disease (CVD) is not available, leading to controversies and poor prognosis. Artificial Intelligence (AI) has already shown promise for CVD/stroke risk stratification. However, due to a lack of sample size, comorbidity, insufficient validation, clinical examination, and a lack of big data configuration, there have been no well-explained bias-free AI investigations to establish the CVD/Stroke risk stratification in the PD framework. The study has two objectives: (i) to establish a solid link between PD and CVD/stroke; and (ii) to use the AI paradigm to examine a well-defined CVD/stroke risk stratification in the PD framework. The PRISMA search strategy selected 223 studies for CVD/stroke risk, of which 54 and 44 studies were related to the link between PD-CVD, and PD-stroke, respectively, 59 studies for joint PD-CVD-Stroke framework, and 66 studies were only for the early PD diagnosis without CVD/stroke link. Sequential biological links were used for establishing the hypothesis. For AI design, PD risk factors as covariates along with CVD/stroke as the gold standard were used for predicting the CVD/stroke risk. The most fundamental cause of CVD/stroke damage due to PD is cardiac autonomic dysfunction due to neurodegeneration that leads to heart failure and its edema, and this validated our hypothesis. Finally, we present the novel AI solutions for CVD/stroke risk prediction in the PD framework. The study also recommends strategies for removing the bias in AI for CVD/stroke risk prediction using the PD framework.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Maheshrao A. Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Annu’s Hospitals for Skin & Diabetes, Gudur 524101, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751003, India;
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09121 Cagliari, Italy;
| | - Monika Turk
- Deparment of Neurology, University Medical Centre Maribor, 1262 Maribor, Slovenia;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
| | - Mannudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA;
| | | | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| |
Collapse
|
20
|
Suri JS, Bhagawati M, Paul S, Protogeron A, Sfikakis PP, Kitas GD, Khanna NN, Ruzsa Z, Sharma AM, Saxena S, Faa G, Paraskevas KI, Laird JR, Johri AM, Saba L, Kalra M. Understanding the bias in machine learning systems for cardiovascular disease risk assessment: The first of its kind review. Comput Biol Med 2022; 142:105204. [DOI: 10.1016/j.compbiomed.2021.105204] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 12/29/2021] [Accepted: 12/29/2021] [Indexed: 02/09/2023]
|
21
|
Paul S, Maindarkar M, Saxena S, Saba L, Turk M, Kalra M, Krishnan PR, Suri JS. Bias Investigation in Artificial Intelligence Systems for Early Detection of Parkinson's Disease: A Narrative Review. Diagnostics (Basel) 2022; 12:166. [PMID: 35054333 PMCID: PMC8774851 DOI: 10.3390/diagnostics12010166] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 12/27/2021] [Accepted: 01/01/2022] [Indexed: 12/13/2022] Open
Abstract
Background and Motivation: Diagnosis of Parkinson's disease (PD) is often based on medical attention and clinical signs. It is subjective and does not have a good prognosis. Artificial Intelligence (AI) has played a promising role in the diagnosis of PD. However, it introduces bias due to lack of sample size, poor validation, clinical evaluation, and lack of big data configuration. The purpose of this study is to compute the risk of bias (RoB) automatically. METHOD The PRISMA search strategy was adopted to select the best 39 AI studies out of 85 PD studies closely associated with early diagnosis PD. The studies were used to compute 30 AI attributes (based on 6 AI clusters), using AP(ai)Bias 1.0 (AtheroPointTM, Roseville, CA, USA), and the mean aggregate score was computed. The studies were ranked and two cutoffs (Moderate-Low (ML) and High-Moderate (MH)) were determined to segregate the studies into three bins: low-, moderate-, and high-bias. RESULT The ML and HM cutoffs were 3.50 and 2.33, respectively, which constituted 7, 13, and 6 for low-, moderate-, and high-bias studies. The best and worst architectures were "deep learning with sketches as outcomes" and "machine learning with Electroencephalography," respectively. We recommend (i) the usage of power analysis in big data framework, (ii) that it must undergo scientific validation using unseen AI models, and (iii) that it should be taken towards clinical evaluation for reliability and stability tests. CONCLUSION The AI is a vital component for the diagnosis of early PD and the recommendations must be followed to lower the RoB.
Collapse
Affiliation(s)
- Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Maheshrao Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751003, India
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09121 Cagliari, Italy
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 1262 Maribor, Slovenia
| | - Manudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA
| | | | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
22
|
Suri JS, Agarwal S, Carriero A, Paschè A, Danna PSC, Columbu M, Saba L, Viskovic K, Mehmedović A, Agarwal S, Gupta L, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Nagy F, Ruzsa Z, Gupta A, Naidu S, Paraskevas KI, Kalra MK. COVLIAS 1.0 vs. MedSeg: Artificial Intelligence-Based Comparative Study for Automated COVID-19 Computed Tomography Lung Segmentation in Italian and Croatian Cohorts. Diagnostics (Basel) 2021; 11:diagnostics11122367. [PMID: 34943603 PMCID: PMC8699928 DOI: 10.3390/diagnostics11122367] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Revised: 11/29/2021] [Accepted: 12/13/2021] [Indexed: 02/07/2023] Open
Abstract
(1) Background: COVID-19 computed tomography (CT) lung segmentation is critical for COVID lung severity diagnosis. Earlier proposed approaches during 2020–2021 were semiautomated or automated but not accurate, user-friendly, and industry-standard benchmarked. The proposed study compared the COVID Lung Image Analysis System, COVLIAS 1.0 (GBTI, Inc., and AtheroPointTM, Roseville, CA, USA, referred to as COVLIAS), against MedSeg, a web-based Artificial Intelligence (AI) segmentation tool, where COVLIAS uses hybrid deep learning (HDL) models for CT lung segmentation. (2) Materials and Methods: The proposed study used 5000 ITALIAN COVID-19 positive CT lung images collected from 72 patients (experimental data) that confirmed the reverse transcription-polymerase chain reaction (RT-PCR) test. Two hybrid AI models from the COVLIAS system, namely, VGG-SegNet (HDL 1) and ResNet-SegNet (HDL 2), were used to segment the CT lungs. As part of the results, we compared both COVLIAS and MedSeg against two manual delineations (MD 1 and MD 2) using (i) Bland–Altman plots, (ii) Correlation coefficient (CC) plots, (iii) Receiver operating characteristic curve, and (iv) Figure of Merit and (v) visual overlays. A cohort of 500 CROATIA COVID-19 positive CT lung images (validation data) was used. A previously trained COVLIAS model was directly applied to the validation data (as part of Unseen-AI) to segment the CT lungs and compare them against MedSeg. (3) Result: For the experimental data, the four CCs between COVLIAS (HDL 1) vs. MD 1, COVLIAS (HDL 1) vs. MD 2, COVLIAS (HDL 2) vs. MD 1, and COVLIAS (HDL 2) vs. MD 2 were 0.96, 0.96, 0.96, and 0.96, respectively. The mean value of the COVLIAS system for the above four readings was 0.96. CC between MedSeg vs. MD 1 and MedSeg vs. MD 2 was 0.98 and 0.98, respectively. Both had a mean value of 0.98. On the validation data, the CC between COVLIAS (HDL 1) vs. MedSeg and COVLIAS (HDL 2) vs. MedSeg was 0.98 and 0.99, respectively. For the experimental data, the difference between the mean values for COVLIAS and MedSeg showed a difference of <2.5%, meeting the standard of equivalence. The average running times for COVLIAS and MedSeg on a single lung CT slice were ~4 s and ~10 s, respectively. (4) Conclusions: The performances of COVLIAS and MedSeg were similar. However, COVLIAS showed improved computing time over MedSeg.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA; (S.A.); (S.A.); (L.G.)
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA; (S.A.); (S.A.); (L.G.)
- Department of Computer Science Engineering, Pranveer Singh Institute of Technology, Kanpur 209305, India
| | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), 28100 Novara, Italy;
| | - Alessio Paschè
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (A.P.); (P.S.C.D.); (M.C.); (L.S.); (A.B.)
| | - Pietro S. C. Danna
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (A.P.); (P.S.C.D.); (M.C.); (L.S.); (A.B.)
| | - Marta Columbu
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (A.P.); (P.S.C.D.); (M.C.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (A.P.); (P.S.C.D.); (M.C.); (L.S.); (A.B.)
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10 000 Zagreb, Croatia; (K.V.); (A.M.)
| | - Armin Mehmedović
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10 000 Zagreb, Croatia; (K.V.); (A.M.)
| | - Samriddhi Agarwal
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA; (S.A.); (S.A.); (L.G.)
- Department of Computer Science Engineering, Pranveer Singh Institute of Technology, Kanpur 209305, India
| | - Lakshya Gupta
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA; (S.A.); (S.A.); (L.G.)
| | - Gavino Faa
- Department of Pathology, AOU of Cagliari, 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 17674 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (A.P.); (P.S.C.D.); (M.C.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece;
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece;
| | - Athanasios Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Nicosia 2408, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95611, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Ferenc Nagy
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Archna Gupta
- Radiology Department, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | | | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA;
| |
Collapse
|
23
|
A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework. Comput Biol Med 2021; 141:105131. [PMID: 34922173 DOI: 10.1016/j.compbiomed.2021.105131] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Revised: 11/20/2021] [Accepted: 12/09/2021] [Indexed: 12/12/2022]
Abstract
BACKGROUND Early and automated detection of carotid plaques prevents strokes, which are the second leading cause of death worldwide according to the World Health Organization. Artificial intelligence (AI) offers automated solutions for plaque tissue characterization. Recently, solo deep learning (SDL) models have been used, but they do not take advantage of the tandem connectivity offered by AI's hybrid nature. Therefore, this study explores the use of hybrid deep learning (HDL) models in a multicenter framework, making this study the first of its kind. METHODS We hypothesize that HDL techniques perform better than SDL and transfer learning (TL) techniques. We propose two kinds of HDL frameworks: (i) the fusion of two SDLs (Inception with ResNet) or (ii) 10 other kinds of tandem models that fuse SDL with ML. The system Atheromatic™ 2.0HDL (AtheroPoint, CA, USA) was designed on an augmentation framework and three kinds of loss functions (cross-entropy, hinge, and mean-square-error) during training to determine the best optimization paradigm. These 11 combined HDL models were then benchmarked against one SDL model and five types of TL models; thus, this study considers a total of 17 AI models. RESULTS Among the 17 AI models, the best performing HDL system was that comprising CNN and decision tree (DT), as its accuracy and area-under-the-curve were 99.78 ± 1.05% and 0.99 (p<0.0001), respectively. These values are 6.4% and 3.2% better than those recorded for the SDL and TL models, respectively. We validated the performance of the HDL models with diagnostics odds ratio (DOR) and Cohen and Kappa statistics; here, HDL outperformed DL and TL by 23% and 7%, respectively. The online system ran in <2 s. CONCLUSION HDL is a fast, reliable, and effective tool for characterizing the carotid plaque for early stroke risk stratification.
Collapse
|
24
|
Sanagala SS, Nicolaides A, Gupta SK, Koppula VK, Saba L, Agarwal S, Johri AM, Kalra MS, Suri JS. Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification. Diagnostics (Basel) 2021; 11:2109. [PMID: 34829456 PMCID: PMC8622690 DOI: 10.3390/diagnostics11112109] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 11/03/2021] [Accepted: 11/09/2021] [Indexed: 12/24/2022] Open
Abstract
Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.
Collapse
Affiliation(s)
- Skandha S. Sanagala
- CSE Department, CMR College of Engineering & Technology, Hyderabad 501401, TS, India; (S.S.S.); (V.K.K.)
- CSE Department, Bennett University, Greater Noida 203206, UP, India;
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia 1700, Cyprus;
| | - Suneet K. Gupta
- CSE Department, Bennett University, Greater Noida 203206, UP, India;
| | - Vijaya K. Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad 501401, TS, India; (S.S.S.); (V.K.K.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | | | - Amer M. Johri
- Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Manudeep S. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™ LLC, Roseville, CA 95661, USA
| |
Collapse
|
25
|
Akazawa M, Hashimoto K. Artificial intelligence in gynecologic cancers: Current status and future challenges - A systematic review. Artif Intell Med 2021; 120:102164. [PMID: 34629152 DOI: 10.1016/j.artmed.2021.102164] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 05/28/2021] [Accepted: 08/31/2021] [Indexed: 11/30/2022]
Abstract
OBJECTIVE Over the past years, the application of artificial intelligence (AI) in medicine has increased rapidly, especially in diagnostics, and in the near future, the role of AI in medicine will become progressively more important. In this study, we elucidated the state of AI research on gynecologic cancers. METHODS A search was conducted in three databases-PubMed, Web of Science, and Scopus-for research papers dated between January 2010 and December 2020. As keywords, we used "artificial intelligence," "deep learning," "machine learning," and "neural network," combined with "cervical cancer," "endometrial cancer," "uterine cancer," and "ovarian cancer." We excluded genomic and molecular research, as well as automated pap-smear diagnoses and digital colposcopy. RESULTS Of 1632 articles, 71 were eligible, including 34 on cervical cancer, 13 on endometrial cancer, three on uterine sarcoma, and 21 on ovarian cancer. A total of 35 studies (49%) used imaging data and 36 studies (51%) used value-based data as the input data. Magnetic resonance imaging (MRI), computed tomography (CT), ultrasound, cytology, and hysteroscopy data were used as imaging data, and the patients' backgrounds, blood examinations, tumor markers, and indices in pathological examination were used as value-based data. The targets of prediction were definitive diagnosis and prognostic outcome, including overall survival and lymph node metastasis. The size of the dataset was relatively small because 64 studies (90%) included less than 1000 cases, and the median size was 214 cases. The models were evaluated by accuracy scores, area under the receiver operating curve (AUC), and sensitivity/specificity. Owing to the heterogeneity, a quantitative synthesis was not appropriate in this review. CONCLUSIONS In gynecologic oncology, more studies have been conducted on cervical cancer than on ovarian and endometrial cancers. Prognoses were mainly used in the study of cervical cancer, whereas diagnoses were primarily used for studying ovarian cancer. The proficiency of the study design for endometrial cancer and uterine sarcoma was unclear because of the small number of studies conducted. The small size of the dataset and the lack of a dataset for external validation were indicated as the challenges of the studies.
Collapse
Affiliation(s)
- Munetoshi Akazawa
- Department of Obstetrics and Gynecology, Tokyo Women's Medical University Medical Center East, Tokyo, Japan.
| | - Kazunori Hashimoto
- Department of Obstetrics and Gynecology, Tokyo Women's Medical University Medical Center East, Tokyo, Japan
| |
Collapse
|
26
|
Saba L, Sanagala SS, Gupta SK, Koppula VK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Misra DP, Agarwal V, Sharma AM, Viswanathan V, Rathore VS, Turk M, Kolluri R, Viskovic K, Cuadrado-Godia E, Kitas GD, Sharma N, Nicolaides A, Suri JS. Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:1206. [PMID: 34430647 PMCID: PMC8350643 DOI: 10.21037/atm-20-7676] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 02/25/2021] [Indexed: 12/12/2022]
Abstract
Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (AOU), Cagliari, Italy
| | - Skandha S Sanagala
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India.,CSE Department, Bennett University, Greater Noida, UP, India
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Vijaya K Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, Rhode Island, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian University of Athens, Athens, Greece
| | - Durga P Misra
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Vikas Agarwal
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Vijay S Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | | | | | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Neeraj Sharma
- Department of Biomedical Engineering, IIT-BHU, Banaras, UP, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| |
Collapse
|
27
|
Ștefan RA, Ștefan PA, Mihu CM, Csutak C, Melincovici CS, Crivii CB, Maluțan AM, Hîțu L, Lebovici A. Ultrasonography in the Differentiation of Endometriomas from Hemorrhagic Ovarian Cysts: The Role of Texture Analysis. J Pers Med 2021; 11:jpm11070611. [PMID: 34203314 PMCID: PMC8306221 DOI: 10.3390/jpm11070611] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 06/21/2021] [Accepted: 06/25/2021] [Indexed: 01/08/2023] Open
Abstract
The ultrasonographic (US) features of endometriomas and hemorrhagic ovarian cysts (HOCs) are often overlapping. With the emergence of new computer-aided diagnosis techniques, this is the first study to investigate whether texture analysis (TA) could improve the discrimination between the two lesions in comparison with classic US evaluation. Fifty-six ovarian cysts (endometriomas, 30; HOCs, 26) were retrospectively included. Four classic US features of endometriomas (low-level internal echoes, perceptible walls, no solid components, and less than five locules) and 275 texture parameters were assessed for every lesion, and the ability to identify endometriomas was evaluated through univariate, multivariate, and receiver operating characteristics analyses. The sensitivity (Se) and specificity (Sp) were calculated with 95% confidence intervals (CIs). The texture model, consisting of seven independent predictors (five variations of difference of variance, image contrast, and the 10th percentile; 100% Se and 100% Sp), was able to outperform the ultrasound model composed of three independent features (low-level internal echoes, perceptible walls, and less than five locules; 74.19% Se and 84.62% Sp) in the diagnosis of endometriomas. The TA showed statistically significant differences between the groups and high diagnostic value, but it remains unclear if the textures reflect the intrinsic histological characteristics of the two lesions.
Collapse
Affiliation(s)
- Roxana-Adelina Ștefan
- Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street, Number 4, 400349 Cluj-Napoca, Romania; (R.-A.Ș.); (C.M.M.); (C.S.M.)
- Obstetrics and Gynecology Clinic “Dominic Stanca”, County Emergency Hospital, 21 Decembrie 1989 Boulevard, Number 55, 400094 Cluj-Napoca, Romania;
| | - Paul-Andrei Ștefan
- Anatomy and Embryology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Victor Babes, Street, Number 8, 400012 Cluj-Napoca, Romania;
- Radiology and Imaging Department, County Emergency Hospital, Cluj-Napoca, Clinicilor Street, Number 5, 400006 Cluj-Napoca, Romania; (C.C.); (A.L.)
- Correspondence: or
| | - Carmen Mihaela Mihu
- Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street, Number 4, 400349 Cluj-Napoca, Romania; (R.-A.Ș.); (C.M.M.); (C.S.M.)
- Radiology and Imaging Department, County Emergency Hospital, Cluj-Napoca, Clinicilor Street, Number 5, 400006 Cluj-Napoca, Romania; (C.C.); (A.L.)
| | - Csaba Csutak
- Radiology and Imaging Department, County Emergency Hospital, Cluj-Napoca, Clinicilor Street, Number 5, 400006 Cluj-Napoca, Romania; (C.C.); (A.L.)
- Radiology, Surgical Specialties Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Clinicilor Street, Number 3-5, 400006 Cluj-Napoca, Romania
| | - Carmen Stanca Melincovici
- Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street, Number 4, 400349 Cluj-Napoca, Romania; (R.-A.Ș.); (C.M.M.); (C.S.M.)
- Radiology and Imaging Department, County Emergency Hospital, Cluj-Napoca, Clinicilor Street, Number 5, 400006 Cluj-Napoca, Romania; (C.C.); (A.L.)
| | - Carmen Bianca Crivii
- Anatomy and Embryology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Victor Babes, Street, Number 8, 400012 Cluj-Napoca, Romania;
| | - Andrei Mihai Maluțan
- Obstetrics and Gynecology Clinic “Dominic Stanca”, County Emergency Hospital, 21 Decembrie 1989 Boulevard, Number 55, 400094 Cluj-Napoca, Romania;
- Obstetrics and Gynecology Clinic II, Mother and Child Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, 21 Decembrie 1989 Boulevard, Number 55, 400094 Cluj-Napoca, Romania
| | - Liviu Hîțu
- Doctoral School, Iuliu Hațieganu University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania;
| | - Andrei Lebovici
- Radiology and Imaging Department, County Emergency Hospital, Cluj-Napoca, Clinicilor Street, Number 5, 400006 Cluj-Napoca, Romania; (C.C.); (A.L.)
- Radiology, Surgical Specialties Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Clinicilor Street, Number 3-5, 400006 Cluj-Napoca, Romania
| |
Collapse
|
28
|
Tandel GS, Tiwari A, Kakde OG. Performance optimisation of deep learning models using majority voting algorithm for brain tumour classification. Comput Biol Med 2021; 135:104564. [PMID: 34217980 DOI: 10.1016/j.compbiomed.2021.104564] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Revised: 06/08/2021] [Accepted: 06/08/2021] [Indexed: 12/18/2022]
Abstract
BACKGROUND Although biopsy is the gold standard for tumour grading, being invasive, this procedure also proves fatal to the brain. Thus, non-invasive methods for brain tumour grading are urgently needed. Here, a magnetic resonance imaging (MRI)-based non-invasive brain tumour grading method has been proposed using deep learning (DL) and machine learning (ML) techniques. METHOD Four clinically applicable datasets were designed. The four datasets were trained and tested on five DL-based models (convolutional neural networks), AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50, and five ML-based models, Support Vector Machine, K-Nearest Neighbours, Naïve Bayes, Decision Tree, and Linear Discrimination using five-fold cross-validation. A majority voting (MajVot)-based ensemble algorithm has been proposed to optimise the overall classification performance of five DL and five ML-based models. RESULTS The average accuracy improvement of four datasets using the DL-based MajVot algorithm against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50 models was 2.02%, 1.11%, 1.04%, 2.67%, and 1.65%, respectively. Further, a 10.12% improvement was seen in the average accuracy of four datasets using the DL method against ML. Furthermore, the proposed DL-based MajVot algorithm was validated on synthetic face data and improved the male versus female face image classification accuracy by 2.88%, 0.71%, 1.90%, 2.24%, and 0.35% against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50, respectively. CONCLUSION The proposed MajVot algorithm achieved promising results for brain tumour classification and is able to utilise the combined potential of multiple models.
Collapse
Affiliation(s)
- Gopal S Tandel
- Department of Computer Science and Engineering, Visvesvaraya National Institute of Technology, Nagpur, 440010, India.
| | - Ashish Tiwari
- Department of Computer Science and Engineering, Visvesvaraya National Institute of Technology, Nagpur, 440010, India.
| | - O G Kakde
- Indian Institute of Information Technology, Nagpur, 440006, India.
| |
Collapse
|
29
|
Ștefan PA, Lupean RA, Mihu CM, Lebovici A, Oancea MD, Hîțu L, Duma D, Csutak C. Ultrasonography in the Diagnosis of Adnexal Lesions: The Role of Texture Analysis. Diagnostics (Basel) 2021; 11:diagnostics11050812. [PMID: 33947150 PMCID: PMC8145244 DOI: 10.3390/diagnostics11050812] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Revised: 04/23/2021] [Accepted: 04/26/2021] [Indexed: 12/31/2022] Open
Abstract
The classic ultrasonographic differentiation between benign and malignant adnexal masses encounters several limitations. Ultrasonography-based texture analysis (USTA) offers a new perspective, but its role has been incompletely evaluated. This study aimed to further investigate USTA’s capacity in differentiating benign from malignant adnexal tumors, as well as comparing the workflow and the results with previously-published research. A total of 123 adnexal lesions (benign, 88; malignant, 35) were retrospectively included. The USTA was performed on dedicated software. By applying three reduction techniques, 23 features with the highest discriminatory potential were selected. The features’ ability to identify ovarian malignancies was evaluated through univariate, multivariate, and receiver operating characteristics analyses, and also by the use of the k-nearest neighbor (KNN) classifier. Three parameters were independent predictors for ovarian neoplasms (sum variance, and two variations of the sum of squares). Benign and malignant lesions were differentiated with 90.48% sensitivity and 93.1% specificity by the prediction model (which included the three independent predictors), and with 71.43–80% sensitivity and 87.5–89.77% specificity by the KNN classifier. The USTA shows statistically significant differences between the textures of the two groups, but it is unclear whether the parameters can reflect the true histopathological characteristics of adnexal lesions.
Collapse
Affiliation(s)
- Paul-Andrei Ștefan
- Anatomy and Embryology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Victor Babes Street 8, 400012 Cluj-Napoca, Romania;
- Radiology and Imaging Department, County Emergency Hospital, Clinicilor Street 5, 400006 Cluj-Napoca, Romania; (C.M.M.); (A.L.); (D.D.); (C.C.)
| | - Roxana-Adelina Lupean
- Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street 4, 400349 Cluj-Napoca, Romania
- Obstetrics and Gynecology Clinic “Dominic Stanca”, County Emergency Hospital, 21 Decembrie 1989 Boulevard 55, 400094 Cluj-Napoca, Romania;
- Correspondence: ; Tel.: +40-7464-31286
| | - Carmen Mihaela Mihu
- Radiology and Imaging Department, County Emergency Hospital, Clinicilor Street 5, 400006 Cluj-Napoca, Romania; (C.M.M.); (A.L.); (D.D.); (C.C.)
- Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street 4, 400349 Cluj-Napoca, Romania
| | - Andrei Lebovici
- Radiology and Imaging Department, County Emergency Hospital, Clinicilor Street 5, 400006 Cluj-Napoca, Romania; (C.M.M.); (A.L.); (D.D.); (C.C.)
- Radiology, Surgical Specialties Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Clinicilor Street 3–5, 400006 Cluj-Napoca, Romania
| | - Mihaela Daniela Oancea
- Obstetrics and Gynecology Clinic “Dominic Stanca”, County Emergency Hospital, 21 Decembrie 1989 Boulevard 55, 400094 Cluj-Napoca, Romania;
- Obstetrics and Gynecology Clinic II, Mother and Child Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, 21 Decembrie 1989 Boulevard 55, 400094 Cluj-Napoca, Romania
| | - Liviu Hîțu
- Doctoral School, Iuliu Hațieganu University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania;
| | - Daniel Duma
- Radiology and Imaging Department, County Emergency Hospital, Clinicilor Street 5, 400006 Cluj-Napoca, Romania; (C.M.M.); (A.L.); (D.D.); (C.C.)
- Doctoral School, Iuliu Hațieganu University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania;
| | - Csaba Csutak
- Radiology and Imaging Department, County Emergency Hospital, Clinicilor Street 5, 400006 Cluj-Napoca, Romania; (C.M.M.); (A.L.); (D.D.); (C.C.)
- Radiology, Surgical Specialties Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Clinicilor Street 3–5, 400006 Cluj-Napoca, Romania
| |
Collapse
|
30
|
Suri JS, Agarwal S, Gupta SK, Puvvula A, Biswas M, Saba L, Bit A, Tandel GS, Agarwal M, Patrick A, Faa G, Singh IM, Oberleitner R, Turk M, Chadha PS, Johri AM, Miguel Sanches J, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Ahluwalia P, Teji J, Al-Maini M, Dhanjil SK, Sockalingam M, Saxena A, Nicolaides A, Sharma A, Rathore V, Ajuluchukwu JNA, Fatemi M, Alizad A, Viswanathan V, Krishnan PK, Naidu S. A narrative review on characterization of acute respiratory distress syndrome in COVID-19-infected lungs using artificial intelligence. Comput Biol Med 2021; 130:104210. [PMID: 33550068 PMCID: PMC7813499 DOI: 10.1016/j.compbiomed.2021.104210] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Revised: 01/03/2021] [Accepted: 01/03/2021] [Indexed: 02/06/2023]
Abstract
COVID-19 has infected 77.4 million people worldwide and has caused 1.7 million fatalities as of December 21, 2020. The primary cause of death due to COVID-19 is Acute Respiratory Distress Syndrome (ARDS). According to the World Health Organization (WHO), people who are at least 60 years old or have comorbidities that have primarily been targeted are at the highest risk from SARS-CoV-2. Medical imaging provides a non-invasive, touch-free, and relatively safer alternative tool for diagnosis during the current ongoing pandemic. Artificial intelligence (AI) scientists are developing several intelligent computer-aided diagnosis (CAD) tools in multiple imaging modalities, i.e., lung computed tomography (CT), chest X-rays, and lung ultrasounds. These AI tools assist the pulmonary and critical care clinicians through (a) faster detection of the presence of a virus, (b) classifying pneumonia types, and (c) measuring the severity of viral damage in COVID-19-infected patients. Thus, it is of the utmost importance to fully understand the requirements of for a fast and successful, and timely lung scans analysis. This narrative review first presents the pathological layout of the lungs in the COVID-19 scenario, followed by understanding and then explains the comorbid statistical distributions in the ARDS framework. The novelty of this review is the approach to classifying the AI models as per the by school of thought (SoTs), exhibiting based on segregation of techniques and their characteristics. The study also discusses the identification of AI models and its extension from non-ARDS lungs (pre-COVID-19) to ARDS lungs (post-COVID-19). Furthermore, it also presents AI workflow considerations of for medical imaging modalities in the COVID-19 framework. Finally, clinical AI design considerations will be discussed. We conclude that the design of the current existing AI models can be improved by considering comorbidity as an independent factor. Furthermore, ARDS post-processing clinical systems must involve include (i) the clinical validation and verification of AI-models, (ii) reliability and stability criteria, and (iii) easily adaptable, and (iv) generalization assessments of AI systems for their use in pulmonary, critical care, and radiological settings.
Collapse
Affiliation(s)
- Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA.
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA, USA; Department of Computer Science Engineering, PSIT, Kanpur, India
| | - Suneet K Gupta
- Department of Computer Science Engineering, Bennett University, India
| | - Anudeep Puvvula
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA; Annu's Hospitals for Skin and Diabetes, Nellore, AP, India
| | - Mainak Biswas
- Department of Computer Science Engineering, JIS University, Kolkata, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, Cagliari, Italy
| | - Arindam Bit
- Department of Biomedical Engineering, NIT, Raipur, India
| | - Gopal S Tandel
- Department of Computer Science Engineering, VNIT, Nagpur, India
| | - Mohit Agarwal
- Department of Computer Science Engineering, Bennett University, India
| | | | - Gavino Faa
- Department of Pathology - AOU of Cagliari, Italy
| | - Inder M Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA
| | | | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | - Paramjit S Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - J Miguel Sanches
- Institute of Systems and Robotics, Instituto Superior Tecnico, Lisboa, Portugal
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | | | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - David W Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | | | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, Thessaloniki, Greece
| | | | | | - Vikas Agarwal
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK; Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, UK
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Superspeciality Hospital, New Delhi, India
| | - Jagjit Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, Canada
| | | | | | - Ajit Saxena
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Cyprus
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - Vijay Rathore
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA
| | | | - Mostafa Fatemi
- Dept. of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, MN, USA
| | - Azra Alizad
- Dept. of Radiology, Mayo Clinic College of Medicine and Science, MN, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - P K Krishnan
- Neurology Department, Fortis Hospital, Bangalore, India
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| |
Collapse
|
31
|
Agarwal M, Saba L, Gupta SK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Sharma AM, Viswanathan V, Kitas GD, Nicolaides A, Suri JS. Wilson disease tissue classification and characterization using seven artificial intelligence models embedded with 3D optimization paradigm on a weak training brain magnetic resonance imaging datasets: a supercomputer application. Med Biol Eng Comput 2021; 59:511-533. [PMID: 33547549 DOI: 10.1007/s11517-021-02322-0] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 01/18/2021] [Indexed: 01/16/2023]
Abstract
Wilson's disease (WD) is caused by copper accumulation in the brain and liver, and if not treated early, can lead to severe disability and death. WD has shown white matter hyperintensity (WMH) in the brain magnetic resonance scans (MRI) scans, but the diagnosis is challenging due to (i) subtle intensity changes and (ii) weak training MRI when using artificial intelligence (AI). Design and validate seven types of high-performing AI-based computer-aided design (CADx) systems consisting of 3D optimized classification, and characterization of WD against controls. We propose a "conventional deep convolution neural network" (cDCNN) and an "improved DCNN" (iDCNN) where rectified linear unit (ReLU) activation function was modified ensuring "differentiable at zero." Three-dimensional optimization was achieved by recording accuracy while changing the CNN layers and augmentation by several folds. WD was characterized using (i) CNN-based feature map strength and (ii) Bispectrum strengths of pixels having higher probabilities of WD. We further computed the (a) area under the curve (AUC), (b) diagnostic odds ratio (DOR), (c) reliability, and (d) stability and (e) benchmarking. Optimal results were achieved using 9 layers of CNN, with 4-fold augmentation. iDCNN yields superior performance compared to cDCNN with accuracy and AUC of 98.28 ± 1.55, 0.99 (p < 0.0001), and 97.19 ± 2.53%, 0.984 (p < 0.0001), respectively. DOR of iDCNN outperformed cDCNN fourfold. iDCNN also outperformed (a) transfer learning-based "Inception V3" paradigm by 11.92% and (b) four types of "conventional machine learning-based systems": k-NN, decision tree, support vector machine, and random forest by 55.13%, 28.36%, 15.35%, and 14.11%, respectively. The AI-based systems can potentially be useful in the early WD diagnosis. Graphical Abstract.
Collapse
Affiliation(s)
- Mohit Agarwal
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Ontario, Kingston, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Providence, RI, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian Univ. of Athens, Athens, Greece
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA.
| |
Collapse
|
32
|
Agarwal M, Saba L, Gupta SK, Carriero A, Falaschi Z, Paschè A, Danna P, El-Baz A, Naidu S, Suri JS. A Novel Block Imaging Technique Using Nine Artificial Intelligence Models for COVID-19 Disease Classification, Characterization and Severity Measurement in Lung Computed Tomography Scans on an Italian Cohort. J Med Syst 2021; 45:28. [PMID: 33496876 PMCID: PMC7835451 DOI: 10.1007/s10916-021-01707-w] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Accepted: 01/06/2021] [Indexed: 01/31/2023]
Abstract
Computer Tomography (CT) is currently being adapted for visualization of COVID-19 lung damage. Manual classification and characterization of COVID-19 may be biased depending on the expert's opinion. Artificial Intelligence has recently penetrated COVID-19, especially deep learning paradigms. There are nine kinds of classification systems in this study, namely one deep learning-based CNN, five kinds of transfer learning (TL) systems namely VGG16, DenseNet121, DenseNet169, DenseNet201 and MobileNet, three kinds of machine-learning (ML) systems, namely artificial neural network (ANN), decision tree (DT), and random forest (RF) that have been designed for classification of COVID-19 segmented CT lung against Controls. Three kinds of characterization systems were developed namely (a) Block imaging for COVID-19 severity index (CSI); (b) Bispectrum analysis; and (c) Block Entropy. A cohort of Italian patients with 30 controls (990 slices) and 30 COVID-19 patients (705 slices) was used to test the performance of three types of classifiers. Using K10 protocol (90% training and 10% testing), the best accuracy and AUC was for DCNN and RF pairs were 99.41 ± 5.12%, 0.991 (p < 0.0001), and 99.41 ± 0.62%, 0.988 (p < 0.0001), respectively, followed by other ML and TL classifiers. We show that diagnostics odds ratio (DOR) was higher for DL compared to ML, and both, Bispecturm and Block Entropy shows higher values for COVID-19 patients. CSI shows an association with Ground Glass Opacities (0.9146, p < 0.0001). Our hypothesis holds true that deep learning shows superior performance compared to machine learning models. Block imaging is a powerful novel approach for pinpointing COVID-19 severity and is clinically validated.
Collapse
Affiliation(s)
- Mohit Agarwal
- CSE Department, Bennett University, Greater Noida, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria di Cagliari, Cagliari, Monserrato, Italy
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, India
| | - Alessandro Carriero
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Zeno Falaschi
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Alessio Paschè
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Pietro Danna
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Ayman El-Baz
- Biomedical Engineering Department, Louisville, KY, USA
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| | - Jasjit S Suri
- Stroke Diagnosis and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA.
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| |
Collapse
|
33
|
Jamthikar AD, Gupta D, Saba L, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Sattar N, Johri AM, Pareek G, Miner M, Sfikakis PP, Protogerou A, Viswanathan V, Sharma A, Kitas GD, Nicolaides A, Kolluri R, Suri JS. Artificial intelligence framework for predictive cardiovascular and stroke risk assessment models: A narrative review of integrated approaches using carotid ultrasound. Comput Biol Med 2020; 126:104043. [PMID: 33065389 DOI: 10.1016/j.compbiomed.2020.104043] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 09/10/2020] [Accepted: 10/04/2020] [Indexed: 12/12/2022]
Abstract
RECENT FINDINGS Cardiovascular disease (CVD) is the leading cause of mortality and poses challenges for healthcare providers globally. Risk-based approaches for the management of CVD are becoming popular for recommending treatment plans for asymptomatic individuals. Several conventional predictive CVD risk models based do not provide an accurate CVD risk assessment for patients with different baseline risk profiles. Artificial intelligence (AI) algorithms have changed the landscape of CVD risk assessment and demonstrated a better performance when compared against conventional models, mainly due to its ability to handle the input nonlinear variations. Further, it has the flexibility to add risk factors derived from medical imaging modalities that image the morphology of the plaque. The integration of noninvasive carotid ultrasound image-based phenotypes with conventional risk factors in the AI framework has further provided stronger power for CVD risk prediction, so-called "integrated predictive CVD risk models." PURPOSE of the review: The objective of this review is (i) to understand several aspects in the development of predictive CVD risk models, (ii) to explore current conventional predictive risk models and their successes and challenges, and (iii) to refine the search for predictive CVD risk models using noninvasive carotid ultrasound as an exemplar in the artificial intelligence-based framework. CONCLUSION Conventional predictive CVD risk models are suboptimal and could be improved. This review examines the potential to include more noninvasive image-based phenotypes in the CVD risk assessment using powerful AI-based strategies.
Collapse
Affiliation(s)
- Ankush D Jamthikar
- Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Deep Gupta
- Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Luca Saba
- Department of Radiology, University of Cagliari, Italy
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, Croatia
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Naveed Sattar
- Institute of Cardiovascular & Medical Sciences, University of Glasgow, Scotland, UK
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention & Research Unit Clinic & Laboratory of Pathophysiology, National and Kapodistrian Univ. of Athens, Greece
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, United Kingdom
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Nicosia, Cyprus
| | | | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
34
|
Suri JS, Puvvula A, Biswas M, Majhail M, Saba L, Faa G, Singh IM, Oberleitner R, Turk M, Chadha PS, Johri AM, Sanches JM, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Ahluwalia P, Kolluri R, Teji J, Maini MA, Agbakoba A, Dhanjil SK, Sockalingam M, Saxena A, Nicolaides A, Sharma A, Rathore V, Ajuluchukwu JNA, Fatemi M, Alizad A, Viswanathan V, Krishnan PR, Naidu S. COVID-19 pathways for brain and heart injury in comorbidity patients: A role of medical imaging and artificial intelligence-based COVID severity classification: A review. Comput Biol Med 2020; 124:103960. [PMID: 32919186 PMCID: PMC7426723 DOI: 10.1016/j.compbiomed.2020.103960] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 08/06/2020] [Accepted: 08/07/2020] [Indexed: 02/05/2023]
Abstract
Artificial intelligence (AI) has penetrated the field of medicine, particularly the field of radiology. Since its emergence, the highly virulent coronavirus disease 2019 (COVID-19) has infected over 10 million people, leading to over 500,000 deaths as of July 1st, 2020. Since the outbreak began, almost 28,000 articles about COVID-19 have been published (https://pubmed.ncbi.nlm.nih.gov); however, few have explored the role of imaging and artificial intelligence in COVID-19 patients-specifically, those with comorbidities. This paper begins by presenting the four pathways that can lead to heart and brain injuries following a COVID-19 infection. Our survey also offers insights into the role that imaging can play in the treatment of comorbid patients, based on probabilities derived from COVID-19 symptom statistics. Such symptoms include myocardial injury, hypoxia, plaque rupture, arrhythmias, venous thromboembolism, coronary thrombosis, encephalitis, ischemia, inflammation, and lung injury. At its core, this study considers the role of image-based AI, which can be used to characterize the tissues of a COVID-19 patient and classify the severity of their infection. Image-based AI is more important than ever as the pandemic surges and countries worldwide grapple with limited medical resources for detection and diagnosis.
Collapse
Affiliation(s)
- Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA; Annu's Hospitals for Skin and Diabetes, Nellore, AP, India
| | | | - Misha Majhail
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA; Oakmont High School and AtheroPoint™, Roseville, CA, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, Cagliari, Italy
| | - Gavino Faa
- Department of Pathology - AOU of Cagliari, Italy
| | - Inder M Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | | | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | - Paramjit S Chadha
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Amer M Johri
- Department of Medicine, Division of Cardiology,Queen's University, Kingston, Ontario, Canada
| | - J Miguel Sanches
- Institute of Systems and Robotics, Instituto Superior Tecnico, Lisboa, Portugal
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | | | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - David W Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | | | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, Thessaloniki, Greece
| | | | | | - Vikas Agarwal
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK; Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, UK
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Superspeciality Hospital, New Delhi, India
| | | | - Jagjit Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, USA
| | - Mustafa Al Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, Canada
| | | | | | | | - Ajit Saxena
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Cyprus
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | | | - Mostafa Fatemi
- Dept. of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, MN, USA
| | - Azra Alizad
- Dept. of Radiology, Mayo Clinic College of Medicine and Science, MN, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | | | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| |
Collapse
|
35
|
Skandha SS, Gupta SK, Saba L, Koppula VK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Misra DP, Agarwal V, Sharma AM, Viswanathan V, Rathore VS, Turk M, Kolluri R, Viskovic K, Cuadrado-Godia E, Kitas GD, Nicolaides A, Suri JS. 3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0. Comput Biol Med 2020; 125:103958. [PMID: 32927257 DOI: 10.1016/j.compbiomed.2020.103958] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 08/02/2020] [Accepted: 08/03/2020] [Indexed: 12/18/2022]
Abstract
BACKGROUND AND PURPOSE Atherosclerotic plaque tissue rupture is one of the leading causes of strokes. Early carotid plaque monitoring can help reduce cardiovascular morbidity and mortality. Manual ultrasound plaque classification and characterization methods are time-consuming and can be imprecise due to significant variations in tissue characteristics. We report a novel artificial intelligence (AI)-based plaque tissue classification and characterization system. METHODS We hypothesize that symptomatic plaque is hypoechoic due to its large lipid core and minimal collagen, as well as its heterogeneous makeup. Meanwhile, asymptomatic plaque is hyperechoic due to its small lipid core, abundant collagen, and the fact that it is often calcified. We designed a computer-aided diagnosis (CADx) system consisting of three kinds of deep learning (DL) classification paradigms: Deep Convolutional Neural Network (DCNN), Visual Geometric Group-16 (VGG16), and transfer learning, (tCNN). DCNN was 3-D optimized by varying the number of CNN layers and data augmentation frameworks. The DL systems were benchmarked against four types of machine learning (ML) classification systems, and the CADx system was characterized using two novel strategies consisting of DL mean feature strength (MFS) and a bispectrum model using higher-order spectra. RESULTS After balancing symptomatic and asymptomatic plaque classes, a five-fold augmentation process was applied, yielding 1000 carotid scans in each class. Then, using a K10 protocol (trained to test the ratio of 90%-10%), tCNN and DCNN yielded accuracy (area under the curve (AUC)) pairs of 83.33%, 0.833 (p < 0.0001) and 95.66%, 0.956 (p < 0.0001), respectively. DCNN was superior to ML by 7.01%. As part of the characterization process, the MFS of the symptomatic plaque was found to be higher compared to the asymptomatic plaque by 17.5% (p < 0.0001). A similar pattern was seen in the bispectrum, which was higher for symptomatic plaque by 5.4% (p < 0.0001). It took <2 s to perform the online CADx process on a supercomputer. CONCLUSIONS The performance order of the three AI systems was DCNN > tCNN > ML. Bispectrum-based on higher-order spectra proved a powerful paradigm for plaque tissue characterization. Overall, the AI-based systems offer a powerful solution for plaque tissue classification and characterization.
Collapse
Affiliation(s)
- Sanagala S Skandha
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India; CSE Department, Bennett University, Greater Noida, UP, India
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Vijaya K Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, RI, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian Univ. of Athens, Greece
| | - Durga P Misra
- Dept. of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Vikas Agarwal
- Dept. of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Vijay S Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | | | | | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
36
|
Tandel GS, Balestrieri A, Jujaray T, Khanna NN, Saba L, Suri JS. Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm. Comput Biol Med 2020; 122:103804. [DOI: 10.1016/j.compbiomed.2020.103804] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Revised: 05/01/2020] [Accepted: 05/02/2020] [Indexed: 12/18/2022]
|
37
|
The present and future of deep learning in radiology. Eur J Radiol 2019; 114:14-24. [PMID: 31005165 DOI: 10.1016/j.ejrad.2019.02.038] [Citation(s) in RCA: 169] [Impact Index Per Article: 33.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2018] [Revised: 02/17/2019] [Accepted: 02/26/2019] [Indexed: 12/18/2022]
Abstract
The advent of Deep Learning (DL) is poised to dramatically change the delivery of healthcare in the near future. Not only has DL profoundly affected the healthcare industry it has also influenced global businesses. Within a span of very few years, advances such as self-driving cars, robots performing jobs that are hazardous to human, and chat bots talking with human operators have proved that DL has already made large impact on our lives. The open source nature of DL and decreasing prices of computer hardware will further propel such changes. In healthcare, the potential is immense due to the need to automate the processes and evolve error free paradigms. The sheer quantum of DL publications in healthcare has surpassed other domains growing at a very fast pace, particular in radiology. It is therefore imperative for the radiologists to learn about DL and how it differs from other approaches of Artificial Intelligence (AI). The next generation of radiology will see a significant role of DL and will likely serve as the base for augmented radiology (AR). Better clinical judgement by AR will help in improving the quality of life and help in life saving decisions, while lowering healthcare costs. A comprehensive review of DL as well as its implications upon the healthcare is presented in this review. We had analysed 150 articles of DL in healthcare domain from PubMed, Google Scholar, and IEEE EXPLORE focused in medical imagery only. We have further examined the ethic, moral and legal issues surrounding the use of DL in medical imaging.
Collapse
|
38
|
Cuadrado-Godia E, Srivastava SK, Saba L, Araki T, Suri HS, Giannopolulos A, Omerzu T, Laird J, Khanna NN, Mavrogeni S, Kitas GD, Nicolaides A, Suri JS. Geometric Total Plaque Area Is an Equally Powerful Phenotype Compared With Carotid Intima-Media Thickness for Stroke Risk Assessment: A Deep Learning Approach. ACTA ACUST UNITED AC 2018. [DOI: 10.1177/1544316718806421] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Currently, carotid intima-media thickness (cIMT) and geometric total plaque area (gTPA) are computed manually and thus are tedious and prone to interobserver and intraobserver variabilities. This study presents an intelligence-based automated deep learning (DL)–based technique for carotid wall interface detection, cIMT, and lumen diameter (LD) measurements, followed by a 3D cylindrical approach for TPA measurement. The observers were used for manual tracings of which were then used for the design of two DL-based systems. The DL boundaries for inner lumen wall and outer interadventitial borders were used for computing the cIMT and LD. Using cylindrical approach, we computed the gTPA. Furthermore, we compute the 10-year image-based cIMT and gTPA, using the progression rates. A total of 396 B-mode ultrasound right and left common carotid artery images were taken from 203 patients. The mean cIMT and gTPA using DL1 and DL2 is 0.91 mm, 20.52 mm2 and 0.88 mm, 19.44 mm2, respectively. The coefficient of correlation between gTPA and cIMT using DL1 and DL2 is 0.92 ( P < .001) and 0.94 ( P < .001), respectively. The area under the curve (AUC) for gTPA showed an improvement over cIMT by 14.36% and 12.57% for DL1 and DL2, respectively. The corresponding 10-year risk improvements were 9.09% and 6.26%. Our statistical significance tests successfully passed t test, Mann-Whitney, Wilcoxon, Kolmogorov-Smirnov, and Friedman. The study shows gTPA as an equally powerful carotid risk biomarker like cIMT. Given the cIMT and LD, cylindrical fitting is a fast method for gTPA measurements.
Collapse
Affiliation(s)
| | | | - Luca Saba
- Azienda Ospedaliero Universitaria, Cagliari, Italy
| | | | | | | | | | | | | | | | - George D. Kitas
- The University of Manchester, UK
- The Dudley Group NHS Foundation Trust, UK
| | | | | |
Collapse
|
39
|
Deep learning strategy for accurate carotid intima-media thickness measurement: An ultrasound study on Japanese diabetic cohort. Comput Biol Med 2018; 98:100-117. [DOI: 10.1016/j.compbiomed.2018.05.014] [Citation(s) in RCA: 51] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2018] [Revised: 05/10/2018] [Accepted: 05/10/2018] [Indexed: 01/06/2023]
|
40
|
Faust O, Acharya UR, Meiburger KM, Molinari F, Koh JE, Yeong CH, Kongmebhol P, Ng KH. Comparative assessment of texture features for the identification of cancer in ultrasound images: a review. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.01.001] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
41
|
Kaur T, Saini BS, Gupta S. A joint intensity and edge magnitude-based multilevel thresholding algorithm for the automatic segmentation of pathological MR brain images. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2751-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
42
|
Shrivastava VK, Londhe ND, Sonawane RS, Suri JS. Reliability analysis of psoriasis decision support system in principal component analysis framework. DATA KNOWL ENG 2016. [DOI: 10.1016/j.datak.2016.09.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
43
|
Speckle reduction in medical ultrasound images using an unbiased non-local means method. Biomed Signal Process Control 2016. [DOI: 10.1016/j.bspc.2016.03.001] [Citation(s) in RCA: 70] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
44
|
ROSATI SAMANTA, MEIBURGER KRISTENMARIKO, BALESTRA GABRIELLA, ACHARYA URAJENDRA, MOLINARI FILIPPO. CAROTID WALL MEASUREMENT AND ASSESSMENT BASED ON PIXEL-BASED AND LOCAL TEXTURE DESCRIPTORS. J MECH MED BIOL 2016. [DOI: 10.1142/s0219519416400066] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Aim of this paper is to develop an automated system for the classification and characterization of carotid wall status and to develop a robust system based on local texture descriptors. A database of 200 longitudinal ultrasound images of carotid artery is used. One-hundred images with Intima-Media Thickness (IMT) value higher than 0.8[Formula: see text]mm are considered as high risk. Six different rectangular pixel neighborhoods were considered: four areas centered on the selected element, with sizes [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] pixels, and two noncentered areas with sizes [Formula: see text] pixels upwards and downwards. We have extracted various texture descriptors (31 based on the co-occurrence gray level matrix, 13 based on the spatial gray level dependence matrix, and 20 based on the gray level run length matrix (GLRLM) from neighborhood. We have used Quick Reduct Algorithm to select 12 most discriminant features from extracted 211 features. Each pixel is then assigned to the vessel lumen, to the intima-media complex, or to the adventitia by using an integrated system of three feed-forward neural networks. The boundaries between the three regions are used to estimate the IMT value. The texture features associated with GLRLM are found to be clinically most significant. We have obtained an overall classification accuracy of 79.5%, sensitivity of 87%, and specificity of 72%. We observed a unique classification pattern between low risk and high risk images: in the latter ones, a considerable number of pixels of the intima–media complex ([Formula: see text]) was classified as belonging to the adventitia. This percentage is statistically higher than that of low risk images ([Formula: see text]; [Formula: see text]). Locally extracted and pixel-based descriptors are able to capture the inner characteristics of the carotid wall. The presence of misclassified pixels in the intima–media complex is associated to higher cardiovascular risk.
Collapse
Affiliation(s)
- SAMANTA ROSATI
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | | | - GABRIELLA BALESTRA
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U. RAJENDRA ACHARYA
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Malaysia
- Department of Biomedical Engineering, School of Science and Technology, SIM University, Singapore
| | - FILIPPO MOLINARI
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| |
Collapse
|
45
|
Sudarshan VK, Mookiah MRK, Acharya UR, Chandran V, Molinari F, Fujita H, Ng KH. Application of wavelet techniques for cancer diagnosis using ultrasound images: A Review. Comput Biol Med 2015; 69:97-111. [PMID: 26761591 DOI: 10.1016/j.compbiomed.2015.12.006] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2015] [Revised: 11/12/2015] [Accepted: 12/11/2015] [Indexed: 02/01/2023]
Abstract
Ultrasound is an important and low cost imaging modality used to study the internal organs of human body and blood flow through blood vessels. It uses high frequency sound waves to acquire images of internal organs. It is used to screen normal, benign and malignant tissues of various organs. Healthy and malignant tissues generate different echoes for ultrasound. Hence, it provides useful information about the potential tumor tissues that can be analyzed for diagnostic purposes before therapeutic procedures. Ultrasound images are affected with speckle noise due to an air gap between the transducer probe and the body. The challenge is to design and develop robust image preprocessing, segmentation and feature extraction algorithms to locate the tumor region and to extract subtle information from isolated tumor region for diagnosis. This information can be revealed using a scale space technique such as the Discrete Wavelet Transform (DWT). It decomposes an image into images at different scales using low pass and high pass filters. These filters help to identify the detail or sudden changes in intensity in the image. These changes are reflected in the wavelet coefficients. Various texture, statistical and image based features can be extracted from these coefficients. The extracted features are subjected to statistical analysis to identify the significant features to discriminate normal and malignant ultrasound images using supervised classifiers. This paper presents a review of wavelet techniques used for preprocessing, segmentation and feature extraction of breast, thyroid, ovarian and prostate cancer using ultrasound images.
Collapse
Affiliation(s)
- Vidya K Sudarshan
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, 599489, Singapore
| | | | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, 599489, Singapore; Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603 Malaysia; Department of Biomedical Engineering, School of Science and Technology, SIM University, 599491, Singapore
| | - Vinod Chandran
- School of Electrical Engineering and Computer Science, Queensland University of Technology, Brisbane QLD 4000, Australia
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy
| | - Hamido Fujita
- Faculty of Software and Information Science, Iwate Prefectural University (IPU), Iwate 020-0693, Japan
| | - Kwan Hoong Ng
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, 50603, Malaysia
| |
Collapse
|
46
|
First review on psoriasis severity risk stratification: An engineering perspective. Comput Biol Med 2015; 63:52-63. [DOI: 10.1016/j.compbiomed.2015.05.005] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2015] [Revised: 05/05/2015] [Accepted: 05/06/2015] [Indexed: 01/03/2023]
|
47
|
Computer-aided diagnosis of Myocardial Infarction using ultrasound images with DWT, GLCM and HOS methods: A comparative study. Comput Biol Med 2015; 62:86-93. [DOI: 10.1016/j.compbiomed.2015.03.033] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2014] [Revised: 03/19/2015] [Accepted: 03/31/2015] [Indexed: 11/23/2022]
|
48
|
Acharya UR, Molinari F, Sree SV, Swapna G, Saba L, Guerriero S, Suri JS. Ovarian Tissue Characterization in Ultrasound. Technol Cancer Res Treat 2014; 14:251-61. [DOI: 10.1177/1533034614547445] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2013] [Accepted: 06/26/2014] [Indexed: 11/16/2022] Open
Abstract
Ovarian cancer is the most common cause of death among gynecological malignancies. We discuss different types of clinical and nonclinical features that are used to study and analyze the differences between benign and malignant ovarian tumors. Computer-aided diagnostic (CAD) systems of high accuracy are being developed as an initial test for ovarian tumor classification instead of biopsy, which is the current gold standard diagnostic test. We also discuss different aspects of developing a reliable CAD system for the automated classification of ovarian cancer into benign and malignant types. A brief description of the commonly used classifiers in ultrasound-based CAD systems is also given.
Collapse
Affiliation(s)
- U. Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
| | - Filippo Molinari
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - S. Vinitha Sree
- Point-of-Care Devices Division, Global Biomedical Technologies Inc., Roseville, CA, USA
| | - G. Swapna
- Department of Applied Electronics and Instrumentation, Government Engineering College, Kozhikode, Kerala, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria di Cagliari, Cagliari, Italy
| | - Stefano Guerriero
- Department of Obstetrics and Gynecology, University of Cagliari, Ospedale San Giovanni di Dio, Cagliari, Italy
| | - Jasjit S. Suri
- Point-of-Care Devices Division, Global Biomedical Technologies Inc., Roseville, CA, USA
- Monitoring & Diagnostic Division, AtheroPoint LLC, Roseville, CA, USA
- Electrical Engineering Department, Idaho State University, (Aff.), Pocatello, ID, USA
| |
Collapse
|