Prediction of drug response in major depressive disorder using ensemble of transfer learning with convolutional neural network based on EEG

Optimizing feature subset for schizophrenia detection using multichannel EEG signals and rough set theory

Schizophrenia (SZ) is a mental disorder that causes lifelong disorders based on delusions, cognitive deficits, and hallucinations. By visual assessment, SZ diagnosis is time-consuming and complicated, because brain states are more effectively revealed by electroencephalogram (EEG) signals, which are effectively used in SZ diagnosis. The application of existing deep learning methods in SZ detection is effective in the classification of 2-dimensional images, and these methods require more computational resources. Therefore, dimensionality reduction is necessary for SZ diagnosis using EEG signals. To reduce the dimensionality of the data, an improved CAO (ICAO) dimensionality reduction method is proposed, which integrates horizontal and vertical crossover approaches with AOA. The optimal feature subset is achieved by satisfying the ICAO conditions, and a fitness function is evaluated based on rough sets for improved accuracy in feature selection. Therefore a Crossover-boosted Archimedes optimization algorithm (AOA) with rough sets for Schizophrenia detection (CAORS-SD) was proposed using multichannel EEG signals from both SZ and normal patients. The signals are decomposed using multivariate empirical mode decomposition into multivariate intrinsic mode functions (MIMFs). Entropy metrics such as spectral entropy, permutation entropy, approximate entropy, sample entropy, and SVD entropy are evaluated on the MIMF domain to detect SZ. The processing time of the kernel support vector machine classifier is minimized with fewer features, reducing the risk Fof overfitting. Accuracy, sensitivity, specificity, precision, and F1-score of the CAORS-SD model should be conducted to diagnose SZ. Therefore, the proposed CAORS-SD method achieves the higher performance of accuracy, sensitivity, specificity, precision, and F1-score values of 96.34, 98.95, 96.86, 98.52, and 96.74% respectively. Also, the CAORS-SD method minimizes the error rate and significantly reduces the execution time.

MuLHiTA: A Novel Multiclass Classification Framework With Multibranch LSTM and Hierarchical Temporal Attention for Early Detection of Mental Stress

Mental stress is an increasingly common psychological issue leading to diseases such as depression, addiction, and heart attack. In this study, an early detection framework based on electroencephalogram (EEG) data is developed for reducing the risk of these diseases. In existing frameworks, signals are often segmented into smaller sections prior to being input to a deep neural network. However, this approach ignores the fundamental nature of EEG signals as a carrier of valuable information (e.g., the integrity of frequency and phase, and temporal fluctuations of EEG components). As such, this type of segmenting may lead to information loss and a failure to effectively identify mental stress levels. Thus, we propose a novel multiclass classification framework termed multibranch LSTM and hierarchical temporal attention (MuLHiTA) for the early identification of mental stress levels. It specifically focuses on not only intraslice (within each slice) but also interslice (between different slices) samples in parallel. This was achieved by including two complementary branches, each of which integrated a specifically designed attention module into a bidirectional long short-term memory (BLSTM) network, enabling extraction of the most discriminative features from interslice and intraslice EEG signals simultaneously. The outputs of attention modules were then summed to obtain a feature representation that contributes to reduce overfitting and more effective multiclass classification. In addition, electrode positions were optimized using neural activity areas under high-stress conditions, thereby reducing computational costs by minimizing the number of critical electrodes. MuLHiTA was evaluated across one private [Montreal imaging stress task (MIST)] and two publicly available EEG datasets [EEG during mental arithmetic tasks (DMAT) and Simultaneous task EEG workload (STEW)]. These were divided into training and test sets using an 8:2 ratio, and the training data were further divided into training and validation sets using a fivefold cross-validation (CV) method, in which the model with the highest accuracy among the five was selected. The model was trained once more with the full training set, and the test data were then used to evaluate its performance. This approach achieved average classification accuracies of 93.58%, 91.80%, and 99.71% for the MIST, STEW, and DMAT datasets, respectively. Experimental results showed MuLHiTA was superior to state-of-the-art algorithms, including EEGNet, BLSTM, EEGLearn, convolutional neural network (CNN)-long short-term memory (LSTM), and convolutional recurrent attention model (CRAM), for multiclass classification. This demonstrates the viability of MuLHiTA for the early detection of mental stress.

Prediction of response to repetitive transcranial magnetic stimulation for major depressive disorder using hybrid Convolutional recurrent neural networks and raw Electroencephalogram Signal

Major Depressive Disorder (MDD) is a high prevalence disease that needs an effective and timely treatment to prevent its progress and additional costs. Repetitive Transcranial Magnetic Stimulation (rTMS) is an effective treatment option for MDD patients which uses strong magnetic pulses to stimulate specific regions of the brain. However, some patients do not respond to this treatment which causes the waste of multiple weeks as treatment time and clinical resources. Therefore developing an effective way for the prediction of response to the rTMS treatment of depression is necessary. In this work, we proposed a hybrid model created by pre-trained Convolutional Neural Networks (CNN) models and Bidirectional Long Short-Term Memory (BLSTM) cells to predict response to rTMS treatment from raw EEG signal. Three pre-trained CNN models named VGG16, InceptionResNetV2, and EffecientNetB0 were utilized as Transfer Learning (TL) models to construct hybrid TL-BLSTM models. Then an ensemble of these models was created using weighted majority voting which the weights were optimized by Differential Evolution (DE) optimization algorithm. Evaluation of these models shows the superior performance of the ensemble model by the accuracy of 98.51%, sensitivity of 98.64%, specificity of 98.36%, F1-score of 98.6%, and AUC of 98.5%. Therefore, the ensemble of the proposed hybrid convolutional recurrent networks can efficiently predict the treatment outcome of rTMS using raw EEG data.

An Enhanced Classification Framework for Limited IoHT Time Series Data Using Ensemble Deep Learning and Image Encoding

Recent studies have illuminated the potential of harnessing the power of Deep Learning (DL) and the Internet of Health Things (IoHT) to detect a variety of disorders, particularly among patients in the middle to later stages of the disease. The utilization of time series data has proven to be a valuable asset in this endeavour. However, the development of effective DL architectures for time series classification with limited data remains a critical gap in the field. Although some studies have explored this area, it is still an understudied and undervalued topic. Thus, there is a crucial need to address this gap and provide insights into designing effective architectures for time series classification with limited data, specifically in the context of healthcare-related time series data for rare diseases. The goal of this study is to investigate the possibility of making accurate predictions with a smaller time series dataset by using an Ensemble DL architecture. This framework is composed of a deep CNN model and transfer learning approaches like ResNet and MobileNet. The ensemble model proposed in this study was supplied with 3D images that were generated from time series data by using Recurrence Plot (RP), Gramian Angular Field (GAF), and Fuzzy Recurrence Plot (FRP) as the transformation techniques. The proposed method has shown promising classification accuracy, even when applied to a small dataset, and surpassed the performance of other state-of-the-art methods when tested on the ECG5000 dataset.Clinical relevance- The proposed deep learning architecture is capable of effectively handling limited clinical time series datasets, enabling the construction of robust models and accurate predictions.

Developing a Supplementary Diagnostic Tool for Breast Cancer Risk Estimation Using Ensemble Transfer Learning

Breast cancer is the most prevalent cancer worldwide. Thus, it is necessary to improve the efficiency of the medical workflow of the disease. Therefore, this study aims to develop a supplementary diagnostic tool for radiologists using ensemble transfer learning and digital mammograms. The digital mammograms and their associated information were collected from the department of radiology and pathology at Hospital Universiti Sains Malaysia. Thirteen pre-trained networks were selected and tested in this study. ResNet101V2 and ResNet152 had the highest mean PR-AUC, MobileNetV3Small and ResNet152 had the highest mean precision, ResNet101 had the highest mean F1 score, and ResNet152 and ResNet152V2 had the highest mean Youden J index. Subsequently, three ensemble models were developed using the top three pre-trained networks whose ranking was based on PR-AUC values, precision, and F1 scores. The final ensemble model, which consisted of Resnet101, Resnet152, and ResNet50V2, had a mean precision value, F1 score, and Youden J index of 0.82, 0.68, and 0.12, respectively. Additionally, the final model demonstrated balanced performance across mammographic density. In conclusion, this study demonstrates the good performance of ensemble transfer learning and digital mammograms in breast cancer risk estimation. This model can be utilised as a supplementary diagnostic tool for radiologists, thus reducing their workloads and further improving the medical workflow in the screening and diagnosis of breast cancer.

An effective brain connectivity technique to predict repetitive transcranial magnetic stimulation outcome for major depressive disorder patients using EEG signals

One of the most effective treatments for drug-resistant Major depressive disorder (MDD) patients is repetitive transcranial magnetic stimulation (rTMS). To improve treatment efficacy and reduce health care costs, it is necessary to predict the treatment response. In this study, we intend to predict the rTMS treatment response in MDD patients from electroencephalogram (EEG) signals before starting the treatment using machine learning approaches. Effective brain connectivity of 19-channel EEG data of MDD patients was calculated by the direct directed transfer function (dDTF) method. Then, using three feature selection methods, the best features were selected and patients were classified as responders or non-responders to rTMS treatment by using the support vector machine (SVM). Results on the 34 MDD patients indicated that the Fp2 region in the delta and theta frequency bands has a significant difference between the two groups and can be used as a significant brain biomarker to assess the rTMS treatment response. Also, the highest accuracy (89.6%) using the SVM classifier for the best features of the dDTF method based on the area under the receiver operating characteristic curve (AUC-ROC) criteria was obtained by combining the delta and theta frequency bands. Consequently, the proposed method can accurately detect the rTMS treatment response in MDD patients before starting treatment on the EEG signal to avoid financial and time costs to patients and medical centers.

Modern Methods of Diagnostics and Treatment of Neurodegenerative Diseases and Depression

This paper discusses the promising areas of research into machine learning applications for the prevention and correction of neurodegenerative and depressive disorders. These two groups of disorders are among the leading causes of decline in the quality of life in the world when estimated using disability-adjusted years. Despite decades of research, the development of new approaches for the assessment (especially pre-clinical) and correction of neurodegenerative diseases and depressive disorders remains among the priority areas of research in neurophysiology, psychology, genetics, and interdisciplinary medicine. Contemporary machine learning technologies and medical data infrastructure create new research opportunities. However, reaching a consensus on the application of new machine learning methods and their integration with the existing standards of care and assessment is still a challenge to overcome before the innovations could be widely introduced to clinics. The research on the development of clinical predictions and classification algorithms contributes towards creating a unified approach to the use of growing clinical data. This unified approach should integrate the requirements of medical professionals, researchers, and governmental regulators. In the current paper, the current state of research into neurodegenerative and depressive disorders is presented.

Attention-Based Convolutional Recurrent Deep Neural Networks for the Prediction of Response to Repetitive Transcranial Magnetic Stimulation for Major Depressive Disorder

Repetitive Transcranial Magnetic Stimulation (rTMS) is proposed as an effective treatment for major depressive disorder (MDD). However, because of the suboptimal treatment outcome of rTMS, the prediction of response to this technique is a crucial task. We developed a deep learning (DL) model to classify responders (R) and non-responders (NR). With this aim, we assessed the pre-treatment EEG signal of 34 MDD patients and extracted effective connectivity (EC) among all electrodes in four frequency bands of EEG signal. Two-dimensional EC maps are put together to create a rich connectivity image and a sequence of these images is fed to the DL model. Then, the DL framework was constructed based on transfer learning (TL) models which are pre-trained convolutional neural networks (CNN) named VGG16, Xception, and EfficientNetB0. Then, long short-term memory (LSTM) cells are equipped with an attention mechanism added on top of TL models to fully exploit the spatiotemporal information of EEG signal. Using leave-one subject out cross validation (LOSO CV), Xception-BLSTM-Attention acquired the highest performance with 98.86% of accuracy and 97.73% of specificity. Fusion of these models as an ensemble model based on optimized majority voting gained 99.32% accuracy and 98.34% of specificity. Therefore, the ensemble of TL-LSTM-Attention models can predict accurately the treatment outcome.

Electroencephalography for predicting antidepressant treatment success: A systematic review and meta-analysis

BACKGROUND

Patients suffering from major depressive disorder (MDD) regularly experience non-response to treatment for their depressive episode. Personalized clinical decision making could shorten depressive episodes and reduce patient suffering. Although no clinical tools are currently available, machine learning analysis of electroencephalography (EEG) shows promise in treatment response prediction.

METHODS

With a systematic review and meta-analysis, we evaluated the accuracy of EEG for individual patient response prediction. Importantly, we included only prediction studies that used cross-validation. We used a bivariate model to calculate prediction success, as expressed by area-under the curve, sensitivity and specificity. Furthermore, we analyzed prediction success for separate antidepressant interventions.

RESULTS

15 studies with 12 individual patient samples and a total of 479 patients were included. Research methods varied considerably between studies. Meta-analysis of results from this heterogeneous set of studies resulted in an area under the curve of 0.91, a sensitivity of 83 % (95 % CI 74-89 %), and a specificity of 86 % (95 % CI 81-90 %). Classification performance did not significantly differ between treatments. Although studies were all internally validated, no externally validated studies have been reported. We found substantial risk of bias caused by methodological shortcomings such as non-independent feature selection, though performance of non-biased studies was comparable.

LIMITATIONS

Sample sizes were relatively small and no study used external validation, increasing the risk of overestimation of accuracy.

CONCLUSIONS

Electroencephalography can predict the response to antidepressant treatment with high accuracy. However, future studies with more rigorous validation are needed to produce a clinical tool to guide interventions in MDD.

PROSPERO REGISTRATION NUMBER

CRD42021268169.

Computational approaches to treatment response prediction in major depression using brain activity and behavioral data: A systematic review

Major depressive disorder is a heterogeneous diagnostic category with multiple available treatments. With the goal of optimizing treatment selection, researchers are developing computational models that attempt to predict treatment response based on various pretreatment measures. In this paper, we review studies that use brain activity data to predict treatment response. Our aim is to highlight and clarify important methodological differences between various studies that relate to the incorporation of domain knowledge, specifically within two approaches delineated as data-driven and theory-driven. We argue that theory-driven generative modeling, which explicitly models information processing in the brain and thus can capture disease mechanisms, is a promising emerging approach that is only beginning to be utilized in treatment response prediction. The predictors extracted via such models could improve interpretability, which is critical for clinical decision-making. We also identify several methodological limitations across the reviewed studies and provide suggestions for addressing them. Namely, we consider problems with dichotomizing treatment outcomes, the importance of investigating more than one treatment in a given study for differential treatment response predictions, the need for a patient-centered approach for defining treatment outcomes, and finally, the use of internal and external validation methods for improving model generalizability.

Predicting treatment response using EEG in major depressive disorder: A machine-learning meta-analysis

Selecting a course of treatment in psychiatry remains a trial-and-error process, and this long-standing clinical challenge has prompted an increased focus on predictive models of treatment response using machine learning techniques. Electroencephalography (EEG) represents a cost-effective and scalable potential measure to predict treatment response to major depressive disorder. We performed separate meta-analyses to determine the ability of models to distinguish between responders and non-responders using EEG across treatments, as well as a performed subgroup analysis of response to transcranial magnetic stimulation (rTMS), and antidepressants (Registration Number: CRD42021257477) in Major Depressive Disorder by searching PubMed, Scopus, and Web of Science for articles published between January 1960 and February 2022. We included 15 studies that predicted treatment responses among patients with major depressive disorder using machine-learning techniques. Within a random-effects model with a restricted maximum likelihood estimator comprising 758 patients, the pooled accuracy across studies was 83.93% (95% CI: 78.90-89.29), with an Area-Under-the-Curve (AUC) of 0.850 (95% CI: 0.747-0.890), and partial AUC of 0.779. The average sensitivity and specificity across models were 77.96% (95% CI: 60.05-88.70), and 84.60% (95% CI: 67.89-92.39), respectively. In a subgroup analysis, greater performance was observed in predicting response to rTMS (Pooled accuracy: 85.70% (95% CI: 77.45-94.83), Area-Under-the-Curve (AUC): 0.928, partial AUC: 0.844), relative to antidepressants (Pooled accuracy: 81.41% (95% CI: 77.45-94.83, AUC: 0.895, pAUC: 0.821). Furthermore, across all meta-analyses, the specificity (true negatives) of EEG models was greater than the sensitivity (true positives), suggesting that EEG models thus far better identify non-responders than responders to treatment in MDD. Studies varied widely in important features across models, although relevant features included absolute and relative power in frontal and temporal electrodes, measures of connectivity, and asymmetry across hemispheres. Predictive models of treatment response using EEG hold promise in major depressive disorder, although there is a need for prospective model validation in independent datasets, and a greater emphasis on replicating physiological markers. Crucially, standardization in cut-off values and clinical scales for defining clinical response and non-response will aid in the reproducibility of findings and the clinical utility of predictive models. Furthermore, several models thus far have used data from open-label trials with small sample sizes and evaluated performance in the absence of training and testing sets, which increases the risk of statistical overfitting. Large consortium studies are required to establish predictive signatures of treatment response using EEG, and better elucidate the replicability of specific markers. Additionally, it is speculated that greater performance was observed in rTMS models, since EEG is assessing neural networks more likely to be directly targeted by rTMS, comprising electrical activity primarily near the surface of the cortex. Prospectively, there is a need for models that examine the comparative effectiveness of multiple treatments across the same patients. However, this will require a thoughtful consideration towards cumulative treatment effects, and whether washout periods between treatments should be utilised. Regardless, longitudinal cross-over trials comparing multiple treatments across the same group of patients will be an important prerequisite step to both facilitate precision psychiatry and identify generalizable physiological predictors of response between and across treatment options.