1
|
Zhao Z, Zhao M, Yang T, Li J, Qin C, Wang B, Wang L, Li B, Liu J. Identifying significant structural factors associated with knee pain severity in patients with osteoarthritis using machine learning. Sci Rep 2024; 14:14705. [PMID: 38926487 PMCID: PMC11208546 DOI: 10.1038/s41598-024-65613-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 06/21/2024] [Indexed: 06/28/2024] Open
Abstract
Our main objective was to use machine learning methods to identify significant structural factors associated with pain severity in knee osteoarthritis patients. Additionally, we assessed the potential of various classes of imaging data using machine learning techniques to gauge knee pain severity. The data of semi-quantitative assessments of knee radiographs, semi-quantitative assessments of knee magnetic resonance imaging (MRI), and MRI images from 567 individuals in the Osteoarthritis Initiative (OAI) were utilized to train a series of machine learning models. Models were constructed using five machine learning methods: random forests (RF), support vector machines (SVM), logistic regression (LR), decision tree (DT), and Bayesian (Bayes). Employing tenfold cross-validation, we selected the best-performing models based on the area under the curve (AUC). The study results indicate no significant difference in performance among models using different imaging data. Subsequently, we employed a convolutional neural network (CNN) to extract features from magnetic resonance imaging (MRI), and class activation mapping (CAM) was utilized to generate saliency maps, highlighting regions associated with knee pain severity. A radiologist reviewed the images, identifying specific lesions colocalized with the CAM. The review of 421 knees revealed that effusion/synovitis (30.9%) and cartilage loss (30.6%) were the most frequent abnormalities associated with pain severity. Our study suggests cartilage loss and synovitis/effusion lesions as significant structural factors affecting pain severity in patients with knee osteoarthritis. Furthermore, our study highlights the potential of machine learning for assessing knee pain severity using radiographs.
Collapse
Affiliation(s)
- Zhengkuan Zhao
- Department of Joint, Tianjin Hospital, Tianjin, China
- Tianjin Medical University, Tianjin, China
| | - Mingkuan Zhao
- National Elite Institute of Engineering, Chongqing University, Chongqing, China
- School of Computer Science, Xi'an Jiaotong University, Xi'an, China
| | - Tao Yang
- Orthopedics Department, Tianjin Hospital, Tianjin, China
| | - Jie Li
- Tianjin Medical University, Tianjin, China
| | - Chao Qin
- Department of Joint, Tianjin Hospital, Tianjin, China
- Tianjin Medical University, Tianjin, China
| | - Ben Wang
- Tianjin Medical University, Tianjin, China
| | - Li Wang
- Tianjin Medical University, Tianjin, China
| | - Bing Li
- Department of Joint, Tianjin Hospital, Tianjin, China.
| | - Jun Liu
- Department of Joint, Tianjin Hospital, Tianjin, China.
| |
Collapse
|
2
|
Nogay HS, Adeli H. Multiple Classification of Brain MRI Autism Spectrum Disorder by Age and Gender Using Deep Learning. J Med Syst 2024; 48:15. [PMID: 38252192 PMCID: PMC10803393 DOI: 10.1007/s10916-023-02032-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 12/31/2023] [Indexed: 01/23/2024]
Abstract
The fact that the rapid and definitive diagnosis of autism cannot be made today and that autism cannot be treated provides an impetus to look into novel technological solutions. To contribute to the resolution of this problem through multiple classifications by considering age and gender factors, in this study, two quadruple and one octal classifications were performed using a deep learning (DL) approach. Gender in one of the four classifications and age groups in the other were considered. In the octal classification, classes were created considering gender and age groups. In addition to the diagnosis of ASD (Autism Spectrum Disorders), another goal of this study is to find out the contribution of gender and age factors to the diagnosis of ASD by making multiple classifications based on age and gender for the first time. Brain structural MRI (sMRI) scans of participators with ASD and TD (Typical Development) were pre-processed in the system originally designed for this purpose. Using the Canny Edge Detection (CED) algorithm, the sMRI image data was cropped in the data pre-processing stage, and the data set was enlarged five times with the data augmentation (DA) techniques. The most optimal convolutional neural network (CNN) models were developed using the grid search optimization (GSO) algorism. The proposed DL prediction system was tested with the five-fold cross-validation technique. Three CNN models were designed to be used in the system. The first of these models is the quadruple classification model created by taking gender into account (model 1), the second is the quadruple classification model created by taking into account age (model 2), and the third is the eightfold classification model created by taking into account both gender and age (model 3). ). The accuracy rates obtained for all three designed models are 80.94, 85.42 and 67.94, respectively. These obtained accuracy rates were compared with pre-trained models by using the transfer learning approach. As a result, it was revealed that age and gender factors were effective in the diagnosis of ASD with the system developed for ASD multiple classifications, and higher accuracy rates were achieved compared to pre-trained models.
Collapse
Affiliation(s)
- Hidir Selcuk Nogay
- Electrical and Energy Department, Bursa Uludag University, Bursa, Turkey
| | - Hojjat Adeli
- Departments of Biomedical Informatics and Neuroscience, College of Medicine, The Ohio State University Neurology, 370 W. 9th Avenue, Columbus, OH, 43210, USA.
| |
Collapse
|
3
|
Chen Z, Hu B, Liu X, Becker B, Eickhoff SB, Miao K, Gu X, Tang Y, Dai X, Li C, Leonov A, Xiao Z, Feng Z, Chen J, Chuan-Peng H. Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry. BMC Med 2023; 21:241. [PMID: 37400814 DOI: 10.1186/s12916-023-02941-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 06/13/2023] [Indexed: 07/05/2023] Open
Abstract
BACKGROUND The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation. METHODS Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses. RESULTS A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β = - 2.75, p < .001, R2adj = 0.40; r = - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF10 > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance. CONCLUSIONS Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.
Collapse
Affiliation(s)
- Zhiyi Chen
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
- Faculty of Psychology, Southwest University, Chongqing, China.
| | - Bowen Hu
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Xuerong Liu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Benjamin Becker
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, Chengdu, China
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Kuan Miao
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Xingmei Gu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Yancheng Tang
- School of Business and Management, Shanghai International Studies University, Shanghai, China
| | - Xin Dai
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Chao Li
- Department of Radiology, The Third Affiliated Hospital, Sun Yat-Sen University, Guangdong, China
| | - Artemiy Leonov
- School of Psychology, Clark University, Worcester, MA, USA
| | - Zhibing Xiao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zhengzhi Feng
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China.
- Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China.
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
4
|
Guhan Seshadri N, Agrawal S, Kumar Singh B, Geethanjali B, Mahesh V, Pachori RB. EEG based classification of children with learning disabilities using shallow and deep neural network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
5
|
Chen Z, Liu X, Yang Q, Wang YJ, Miao K, Gong Z, Yu Y, Leonov A, Liu C, Feng Z, Chuan-Peng H. Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review. JAMA Netw Open 2023; 6:e231671. [PMID: 36877519 PMCID: PMC9989906 DOI: 10.1001/jamanetworkopen.2023.1671] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/07/2023] Open
Abstract
IMPORTANCE Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated. OBJECTIVE To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis. EVIDENCE REVIEW PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality. FINDINGS A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%). CONCLUSIONS AND RELEVANCE This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.
Collapse
Affiliation(s)
- Zhiyi Chen
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Xuerong Liu
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Qingwu Yang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Yan-Jiang Wang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Kuan Miao
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Zheng Gong
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Yang Yu
- School of Psychology, Third Military Medical University, Chongqing, China
| | - Artemiy Leonov
- Department of Psychology, Clark University, Worcester, Massachusetts
| | - Chunlei Liu
- School of Psychology, Qufu Normal University, Qufu, China
| | - Zhengzhi Feng
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
6
|
Previously Marzena Szkodo MOR, Micai M, Caruso A, Fulceri F, Fazio M, Scattoni ML. Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review. Neurosci Biobehav Rev 2023; 145:105021. [PMID: 36581169 DOI: 10.1016/j.neubiorev.2022.105021] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 12/13/2022] [Accepted: 12/23/2022] [Indexed: 12/27/2022]
Abstract
In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.
Collapse
Affiliation(s)
| | - Martina Micai
- Research Coordination and Support Service, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy.
| | - Angela Caruso
- Research Coordination and Support Service, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy.
| | - Francesca Fulceri
- Research Coordination and Support Service, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy.
| | - Maria Fazio
- Department of Mathematics, Computer Science, Physics and Earth Sciences (MIFT), University of Messina, Viale F. Stagno d'Alcontres, 31, 98166 Messina, Italy.
| | - Maria Luisa Scattoni
- Research Coordination and Support Service, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy.
| |
Collapse
|
7
|
Oliaee A, Mohebbi M, Shirani S, Rostami R. Extraction of discriminative features from EEG signals of dyslexic children; before and after the treatment. Cogn Neurodyn 2022; 16:1249-1259. [PMID: 36408072 PMCID: PMC9666605 DOI: 10.1007/s11571-022-09794-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 02/16/2022] [Accepted: 02/20/2022] [Indexed: 11/25/2022] Open
Abstract
Dyslexia is a neurological disorder manifested as difficulty reading and writing. It can occur despite adequate instruction, intelligence, and intact sensory abilities. Different electroencephalogram (EEG) patterns have been demonstrated between dyslexic and healthy subjects in previous studies. This study focuses on the difference between patients before and after treatment. The main goal is to identify the subset of features that adequately discriminate subjects before and after a specific treatment plan. The treatment consists of Transcranial Direct Current Stimulation (tDCS) and occupational therapy using the BrainWare SAFARI software. The EEG signals of sixteen dyslexic children were recorded during the eyes-closed resting state before and after treatment. The preprocessing step was followed by the extraction of a wide range of features to investigate the differences related to the treatment. An optimal subset of features extracted from recorded EEG signals was determined using Principal Component Analysis (PCA) in conjunction with the Sequential Floating Forward Selection (SFFS) algorithm. The results showed that treatment leads to significant changes in EEG features like spectral and phase-related EEG features, in various regions. It has been demonstrated that the extracted subset of discriminative features can be useful for classification applications in treatment assessment. The most discriminative subset of features could classify the data with an accuracy of 92% with SVM classifier. The above result confirms the efficacy of the treatment plans in improving dyslexic children's cognitive skills.
Collapse
Affiliation(s)
- Anahita Oliaee
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
| | - Maryam Mohebbi
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
| | - Sepehr Shirani
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
| | - Reza Rostami
- Department of Psychology, Faculty of Psychology, University of Tehran, Tehran, Iran
| |
Collapse
|
8
|
Cai J, Zhou J. How many asymptomatic cases were unconfirmed in the US COVID-19 pandemic? The evidence from a serological survey. CHAOS, SOLITONS, AND FRACTALS 2022; 164:112630. [PMID: 36091638 PMCID: PMC9444511 DOI: 10.1016/j.chaos.2022.112630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 07/10/2022] [Accepted: 08/25/2022] [Indexed: 06/15/2023]
Abstract
A serological survey from CDC revealed more than 10% of individuals in America probably resolving or past infection with SARS-CoV-2 at the end of 2020, which illustrated there were massive unconfirmed asymptomatic infected people by contrast with the reported cases numbers. Asymptomatic patients as one of the crucial reasons for the COVID-19 pandemic being tough to contain, estimating the number of unconfirmed ones including the active infected and having cured in this population, is of great guiding significance for formulating epidemic prevention and control policies. This paper proposes a varying coefficient Susceptible-Infected-Removed-Susceptible (vSIRS) model to obtain the time series data of the unconfirmed asymptomatic infected numbers. Moreover, due to the time-varying coefficients, we can effectively track the situation changes of the COVID-19 intervened by related policy support and medical care level through this epidemiological model. A novel two-stage approach with a programming problem is correspondingly developed to accomplish the estimation of the unknown parameters in the vSIRS model. Subsequently, by leveraging seroprevalence data, daily reported cases data, and other clinical information, we apply the vSIRS model to analyze the evolution of COVID-19 in America. The modeling results show millions of active asymptomatic infected individuals were unconfirmed during the autumn and winter of 2020, which was a momentous factor for driving American COVID-19 pandemic.
Collapse
Affiliation(s)
- Junyang Cai
- School of Management, Shanghai University, Shanghai 200444, China
| | - Jian Zhou
- School of Management, Shanghai University, Shanghai 200444, China
| |
Collapse
|