1
|
Verma M, Abdelrahman L, Collado-Mesa F, Abdel-Mottaleb M. Multimodal Spatiotemporal Deep Learning Framework to Predict Response of Breast Cancer to Neoadjuvant Systemic Therapy. Diagnostics (Basel) 2023; 13:2251. [PMID: 37443648 DOI: 10.3390/diagnostics13132251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/20/2023] [Accepted: 06/27/2023] [Indexed: 07/15/2023] Open
Abstract
Current approaches to breast cancer therapy include neoadjuvant systemic therapy (NST). The efficacy of NST is measured by pathologic complete response (pCR). A patient who attains pCR has significantly enhanced disease-free survival progress. The accurate prediction of pCR in response to a given treatment regimen could increase the likelihood of achieving pCR and prevent toxicities caused by treatments that are not effective. Th early prediction of response to NST can increase the likelihood of survival and help with decisions regarding breast-conserving surgery. An automated NST prediction framework that is able to precisely predict which patient undergoing NST will achieve a pathological complete response (pCR) at an early stage of treatment is needed. Here, we propose an end-to-end efficient multimodal spatiotemporal deep learning framework (deep-NST) framework to predict the outcome of NST prior or at an early stage of treatment. The deep-NST model incorporates imaging data captured at different timestamps of NST regimens, a tumor's molecular data, and a patient's demographic data. The efficacy of the proposed work is validated on the publicly available ISPY-1 dataset, in terms of accuracy, area under the curve (AUC), and computational complexity. In addition, seven ablation experiments were carried out to evaluate the impact of each design module in the proposed work. The experimental results show that the proposed framework performs significantly better than other recent methods.
Collapse
Affiliation(s)
- Monu Verma
- Department of Electrical and Computer Engineering, University of Miami, Miami, FL 33146, USA
| | | | - Fernando Collado-Mesa
- Department of Radiology, Miller School of Medicine, University of Miami, Miami, FL 33146, USA
| | - Mohamed Abdel-Mottaleb
- Department of Electrical and Computer Engineering, University of Miami, Miami, FL 33146, USA
| |
Collapse
|
2
|
Katz JE, Abdelrahman L, Nackeeran S, Ezeh U, Visser U, Deane LA. The Development of an Artificial Intelligence Model Based Solely on Computer Tomography Successfully Predicts Which Patients Will Pass Obstructing Ureteral Calculi. Urology 2023; 174:58-63. [PMID: 36736916 DOI: 10.1016/j.urology.2023.01.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Revised: 11/27/2022] [Accepted: 01/02/2023] [Indexed: 02/05/2023]
Abstract
OBJECTIVE To improve upon prior attempts to predict which patients will pass their obstructing ureteral stones, we developed a machine learning algorithm to predict the passage of obstructing ureteral stones using only the CT scan at a patient's initial presentation. METHODS We obtained Institutional Review Board approval to conduct a retrospective study by extracting data from all patients with an obstructing 3-10 mm ureteral stone. We included patients with sufficient data to be categorized as having either passed or failed to pass an obstructing ureteral stone. We developed a 3D-convolutional neural network (CNN) model using a dynamic learning rate, the Adam optimizer, and early stopping with 10-fold cross-validation. Using this model, we calculated the area under the curve (AUC) and developed a model confusion matrix, which we compared with a model based only on the largest dimension of the stone. RESULTS A total of 138 patients met inclusion criteria and had adequate images that could be preprocessed and included in the study. Seventy patients failed to pass their ureteral stones, and 68 patients passed their stones. For the 3D-CNN model, the mean AUC was 0.95 with an overall mean sensitivity of 95% and mean specificity of 77%, which outperformed the model based on stone-size. CONCLUSION The 3D-CNN model predicts which patients will pass their obstructing ureteral stones based on CT scan alone and does not require any further measurements. This can provide useful clinical information which may help obviate the need for a delay in care for patients who inevitably require surgical intervention.
Collapse
Affiliation(s)
- Jonathan E Katz
- Department of Urology, Desai Sethi Urology Institute, University of Miami, Miami, FL.
| | | | - Sirpi Nackeeran
- Department of Urology, Desai Sethi Urology Institute, University of Miami, Miami, FL
| | - Uche Ezeh
- Department of Urology, Desai Sethi Urology Institute, University of Miami, Miami, FL
| | - Ubbo Visser
- Department of Computer Science, University of Miami, Miami, FL
| | - Leslie A Deane
- Department of Urology, Desai Sethi Urology Institute, University of Miami, Miami, FL
| |
Collapse
|
3
|
Khosla S, Abdelrahman L, Johnson J, Samarah M, Bhattacharya SK. RegenX: an NLP recommendation engine for neuroregeneration topics over time. Ann Eye Sci 2022; 7. [PMID: 36199680 PMCID: PMC9531894 DOI: 10.21037/aes-21-29] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Background: In this investigation, we explore the literature regarding neuroregeneration from the 1700s to the present. The regeneration of central nervous system neurons or the regeneration of axons from cell bodies and their reconnection with other neurons remains a major hurdle. Injuries relating to war and accidents attracted medical professionals throughout early history to regenerate and reconnect nerves. Early literature till 1990 lacked specific molecular details and is likely provide some clues to conditions that promoted neuron and/or axon regeneration. This is an avenue for the application of natural language processing (NLP) to gain actionable intelligence. Post 1990 period saw an explosion of all molecular details. With the advent of genomic, transcriptomics, proteomics, and other omics—there is an emergence of big data sets and is another rich area for application of NLP. How the neuron and/or axon regeneration related keywords have changed over the years is a first step towards this endeavor. Methods: Specifically, this article curates over 600 published works in the field of neuroregeneration. We then apply a dynamic topic modeling algorithm based on the Latent Dirichlet allocation (LDA) algorithm to assess how topics cluster based on topics. Results: Based on how documents are assigned to topics, we then build a recommendation engine to assist researchers to access domain-specific literature based on how their search text matches to recommended document topics. The interface further includes interactive topic visualizations for researchers to understand how topics grow closer and further apart, and how intra-topic composition changes over time. Conclusions: We present a recommendation engine and interactive interface that enables dynamic topic modeling for neuronal regeneration.
Collapse
Affiliation(s)
- Shaan Khosla
- New York University, Center for Data Science, New York, NY, USA
| | - Leila Abdelrahman
- Department of Ophthalmology & Miami Integrative Metabolomics Research Center, University of Miami, Bascom Palmer Eye Institute, Miami, FL, USA
| | - Joseph Johnson
- Department of Marketing, University of Miami, Miami Herbert Business School, Miami, FL, USA
| | | | - Sanjoy K. Bhattacharya
- Department of Ophthalmology & Miami Integrative Metabolomics Research Center, University of Miami, Bascom Palmer Eye Institute, Miami, FL, USA
| |
Collapse
|
4
|
Collao V, Morris J, Zain Chauhan M, Abdelrahman L, Martίnez-de-la-Casa JM, Vidal-Villegas B, Burgos-Blasco B, Bhattacharya SK. Analyses of Pseudoexfoliation aqueous humor lipidome. Mol Omics 2022; 18:387-396. [DOI: 10.1039/d1mo00495f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Pseudoexfoliation syndrome (PEX) is a systemic disorder that manifests as fluffy, proteinaceous fibrillar material throughout the body. In the eye such deposits result in glaucoma (PEXG), due to impeding aqueous...
Collapse
|
5
|
Bai L, Chen S, Gao M, Abdelrahman L, Ghamdi MA, Abdel-Mottaleb M. The Influence of Age and Gender Information on the Diagnosis of Diabetic Retinopathy: Based on Neural Networks. Annu Int Conf IEEE Eng Med Biol Soc 2021; 2021:3514-3517. [PMID: 34891997 DOI: 10.1109/embc46164.2021.9629607] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This paper proposes the importance of age and gender information in the diagnosis of diabetic retinopathy. We utilized Deep Residual Neural Networks (ResNet) and Densely Connected Convolutional Networks (DenseNet), which are proven effective on image classification problems and the diagnosis of diabetic retinopathy using the retinal fundus images. We used the ensemble of several classical networks and decentralized the training so that the network was simple and avoided overfitting. To observe whether the age and gender information could help enhance the performance, we added the information before the dense layer and compared the results with the results that did not add age and gender information. We found that the test accuracy of the network with age and gender information was 2.67% higher than that of the network without age and gender information. Meanwhile, compared with gender information, age information had a better help for the results.Clinical Relevance- The additional information in the dataset (such as age, gender, time of illness, etc.) can improve the accuracy of automatic diagnosis. Therefore, we strongly recommend that researchers add these different kinds of additional information when creating the dataset.
Collapse
|
6
|
Myer C, Abdelrahman L, Banerjee S, Khattri RB, Merritt ME, Junk AK, Lee RK, Bhattacharya SK. Aqueous humor metabolite profile of pseudoexfoliation glaucoma is distinctive. Mol Omics 2021; 16:425-435. [PMID: 32149291 DOI: 10.1039/c9mo00192a] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
Pseudoexfoliation (PEX) is a known cause of secondary open angle glaucoma. PEX glaucoma is associated with structural and metabolic changes in the eye. Despite similarities, PEX and primary open angle glaucoma (POAG) may have differences in the composition of metabolites. We analyzed the metabolites of the aqueous humor (AH) of PEX subjects sequentially first using nuclear magnetic resonance (1H NMR: HSQC and TOCSY), and subsequently with liquid chromatography tandem mass spectrometry (LC-MS/MS) implementing isotopic ratio outlier analysis (IROA) quantification. The findings were compared with previous results for POAG and control subjects analyzed using identical sequential steps. We found significant differences in metabolites between the three conditions. Principle component analysis (PCA) and partial least squares discriminant analysis (PLS-DA) indicated clear grouping based on the metabolomes of the three conditions. We used machine learning algorithms and a percentage set of the data to train, and utilized a different or larger dataset to test whether a trained model can correctly classify the test dataset as PEX, POAG or control. Three different algorithms: linear support vector machines (SVM), deep learning, and a neural network were used for prediction. They all accurately classified the test datasets based on the AH metabolome of the sample. We next compared the AH metabolome with known AH and TM proteomes and genomes in order to understand metabolic pathways that may contribute to alterations in the AH metabolome in PEX. We found potential protein/gene pathways associated with observed significant metabolite changes in PEX.
Collapse
Affiliation(s)
- Ciara Myer
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA
| | - Leila Abdelrahman
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA
| | - Santanu Banerjee
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA and Department of Surgery, University of Miami, Miami, Florida, USA
| | | | | | - Anna K Junk
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA and Miami Veterans Affairs Healthcare System, Miami, Florida, USA
| | - Richard K Lee
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA
| | - Sanjoy K Bhattacharya
- Bascom Palmer Eye Institute, University of Miami, Miami, Florida, USA. and Miami Integrative Metabolomics Research Center, University of Miami, Miami, Florida, USA
| |
Collapse
|
7
|
Meehan SD, Abdelrahman L, Arcuri J, Park KK, Samarah M, Bhattacharya SK. Proteomics and systems biology in optic nerve regeneration. Adv Protein Chem Struct Biol 2021; 127:249-270. [PMID: 34340769 DOI: 10.1016/bs.apcsb.2021.03.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
We present an overview of current state of proteomic approaches as applied to optic nerve regeneration in the historical context of nerve regeneration particularly central nervous system neuronal regeneration. We present outlook pertaining to the optic nerve regeneration proteomics that the latter can extrapolate information from multi-systems level investigations. We present an account of the current need of systems level standardization for comparison of proteome from various models and across different pharmacological or biophysical treatments that promote adult neuron regeneration. We briefly overview the need for deriving knowledge from proteomics and integrating with other omics to obtain greater biological insight into process of adult neuron regeneration in the optic nerve and its potential applicability to other central nervous system neuron regeneration.
Collapse
Affiliation(s)
- Sean D Meehan
- Molecular and Cellular Pharmacology Graduate Program, University of Miami, Miami, FL, United States; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, United States
| | - Leila Abdelrahman
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Department of Electrical and Computer Engineering, University of Miami, Miami, FL, United States
| | - Jennifer Arcuri
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Molecular and Cellular Pharmacology Graduate Program, University of Miami, Miami, FL, United States; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, United States
| | - Kevin K Park
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, United States; Miami Project to Cure Paralysis, University of Miami, Miami, FL, United States
| | | | - Sanjoy K Bhattacharya
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Molecular and Cellular Pharmacology Graduate Program, University of Miami, Miami, FL, United States; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, United States.
| |
Collapse
|
8
|
Abdelrahman L, Al Ghamdi M, Collado-Mesa F, Abdel-Mottaleb M. Convolutional neural networks for breast cancer detection in mammography: A survey. Comput Biol Med 2021; 131:104248. [PMID: 33631497 DOI: 10.1016/j.compbiomed.2021.104248] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Revised: 01/08/2021] [Accepted: 01/25/2021] [Indexed: 12/17/2022]
Abstract
Despite its proven record as a breast cancer screening tool, mammography remains labor-intensive and has recognized limitations, including low sensitivity in women with dense breast tissue. In the last ten years, Neural Network advances have been applied to mammography to help radiologists increase their efficiency and accuracy. This survey aims to present, in an organized and structured manner, the current knowledge base of convolutional neural networks (CNNs) in mammography. The survey first discusses traditional Computer Assisted Detection (CAD) and more recently developed CNN-based models for computer vision in mammography. It then presents and discusses the literature on available mammography training datasets. The survey then presents and discusses current literature on CNNs for four distinct mammography tasks: (1) breast density classification, (2) breast asymmetry detection and classification, (3) calcification detection and classification, and (4) mass detection and classification, including presenting and comparing the reported quantitative results for each task and the pros and cons of the different CNN-based approaches. Then, it offers real-world applications of CNN CAD algorithms by discussing current Food and Drug Administration (FDA) approved models. Finally, this survey highlights the potential opportunities for future work in this field. The material presented and discussed in this survey could serve as a road map for developing CNN-based solutions to improve mammographic detection of breast cancer further.
Collapse
Affiliation(s)
- Leila Abdelrahman
- University of Miami, Department of Electrical and Computer Engineering, Memorial Dr, Coral Gables, FL, 33146, USA
| | - Manal Al Ghamdi
- Umm Al-Qura University, Department of Computer Science, Alawali, Mecca, 24381, Saudi Arabia
| | - Fernando Collado-Mesa
- University of Miami Miller School of Medicine, Department of Radiology, 1115 NW 14th Street Miami, FL, 33136, USA
| | - Mohamed Abdel-Mottaleb
- University of Miami, Department of Electrical and Computer Engineering, Memorial Dr, Coral Gables, FL, 33146, USA.
| |
Collapse
|
9
|
Myer C, Perez J, Abdelrahman L, Mendez R, Khattri RB, Junk AK, Bhattacharya SK. Differentiation of soluble aqueous humor metabolites in primary open angle glaucoma and controls. Exp Eye Res 2020; 194:108024. [PMID: 32246983 DOI: 10.1016/j.exer.2020.108024] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Revised: 03/22/2020] [Accepted: 03/23/2020] [Indexed: 01/06/2023]
Abstract
We report an analysis of the aqueous humor (AH) metabolome of primary open angle glaucoma (POAG) in comparison to normal controls. The AH samples were obtained from human donors [control (n = 35), POAG (n = 23)]. The AH samples were subjected to one-dimensional 1H nuclear magnetic resonance (NMR) analyses on a Bruker Avance 600 MHz instrument with a 1.7 mM NMR probe. The same samples were then subjected to isotopic ratio outlier analysis (IROA) using a Q Exactive orbitrap mass spectrometer after chromatography on an Accela 600 HPLC. Clusterfinder Build 3.1.10 was used for identification and quantification based on long-term metabolite matrix standards. In total, 278 metabolites were identified in control samples and 273 in POAG AH. The metabolites identified were fed into previously reported proteome and genome information and the OmicsNet interaction network generator to construct a protein-metabolite interactions network with an embedded protein-protein network. Significant differences in metabolite composition in POAG compared to controls were identified indicating potential protein/gene pathways associated with these metabolites. These results will expand our previous understanding of the impeded AH metabolite composition, provide new insight into the regulation of AH outflow, and likely aid in future AH and trabecular meshwork multi-omics network analyses.
Collapse
Affiliation(s)
- Ciara Myer
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA
| | - Jordan Perez
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA; Case Western Reserve University, Cleveland, OH, USA
| | - Leila Abdelrahman
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA
| | - Roberto Mendez
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA; Department of Surgery, University of Miami, Miami, FL, USA
| | - Ram B Khattri
- Department of Biochemistry and Molecular Biochemistry, University of Florida, Gainesville, FL, USA
| | - Anna K Junk
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA; Miami Veterans Affairs Health Care System, Miami, FL, USA
| | - Sanjoy K Bhattacharya
- Bascom Palmer Eye Institute, University of Miami, Miami, FL, USA; Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA.
| |
Collapse
|
10
|
Kesh K, Mendez R, Abdelrahman L, Banerjee S, Banerjee S. Type 2 diabetes induced microbiome dysbiosis is associated with therapy resistance in pancreatic adenocarcinoma. Microb Cell Fact 2020; 19:75. [PMID: 32204699 PMCID: PMC7092523 DOI: 10.1186/s12934-020-01330-3] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Accepted: 03/12/2020] [Indexed: 12/14/2022] Open
Abstract
Resistance to therapy is one of the major factors that contribute to dismal survival statistics in pancreatic cancer. While there are many tumor intrinsic and tumor microenvironment driven factors that contribute to therapy resistance, whether pre-existing metabolic diseases like type 2 diabetes (T2D) contribute to this has remained understudied. It is well accepted that hyperglycemia associated with type 2 diabetes changes the gut microbiome. Further, hyperglycemia also enriches for a "stem-like" population within the tumor. In the current study, we observed that in a T2D mouse model, the microbiome changed significantly as the hyperglycemia developed in these animals. Our results further showed that, tumors implanted in the T2D mice responded poorly to gemcitabine/paclitaxel (Gem/Pac) standard of care compared to those in the control group. A metabolomic reconstruction of the WGS of the gut microbiota further revealed that an enrichment of bacterial population involved in drug metabolism in the T2D group. Additionally, we also observed an increase in the CD133+ tumor cells population in the T2D model. These observations indicated that in an animal model for T2D, microbial dysbiosis is associated with increased resistance to chemotherapeutic compounds.
Collapse
Affiliation(s)
- Kousik Kesh
- Department of Surgery, Miller School of Medicine, University of Miami, Miami, FL, USA
- Sylvester Comprehensive Cancer Center, Miami, FL, USA
| | - Roberto Mendez
- Department of Surgery, Miller School of Medicine, University of Miami, Miami, FL, USA
- Sylvester Comprehensive Cancer Center, Miami, FL, USA
- Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA
| | - Leila Abdelrahman
- Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA
| | - Santanu Banerjee
- Sylvester Comprehensive Cancer Center, Miami, FL, USA.
- Miami Integrative Metabolomics Research Center, University of Miami, Miami, FL, USA.
- Department of Surgery, Miller School of Medicine, University of Miami, Biomedical Research Building Suite 516, 1501, NW 10th Ave, Miami, FL, 33156, USA.
| | - Sulagna Banerjee
- Sylvester Comprehensive Cancer Center, Miami, FL, USA.
- Department of Surgery, Miller School of Medicine, University of Miami, Biomedical Research Building, Suite 508, 1501, NW 10th Ave, Miami, FL, 33156, USA.
| |
Collapse
|