The Search for Clinically Useful Neuroimaging Markers of Depression-A Worthwhile Pursuit or a Futile Quest?

Examining factors related to low performance of predicting remission in participants with major depressive disorder using neuroimaging data and other clinical features

Major depressive disorder (MDD), a prevalent mental health issue, affects more than 8% of the US population, and almost 17% in the young group of 18-25 years old. Since Covid-19, its prevalence has become even more significant. However, the remission (being free of depression) rates of first-line antidepressant treatments on MDD are only about 30%. To improve treatment outcomes, researchers have built various predictive models for treatment responses and yet none of them have been adopted in clinical use. One reason is that most predictive models are based on data from subjective questionnaires, which are less reliable. Neuroimaging data are promising objective prognostic factors, but they are expensive to obtain and hence predictive models using neuroimaging data are limited and such studies were usually in small scale (N<100). In this paper, we proposed an advanced machine learning (ML) pipeline for small training dataset with large number of features. We implemented multiple imputation for missing data and repeated K-fold cross validation (CV) to robustly estimate predictive performances. Different feature selection methods and stacking methods using 6 general ML models including random forest, gradient boosting decision tree, XGBoost, penalized logistic regression, support vector machine (SVM), and neural network were examined to evaluate the model performances. All predictive models were compared using model performance metrics such as accuracy, balanced accuracy, area under ROC curve (AUC), sensitivity and specificity. Our proposed ML pipeline was applied to a training dataset and obtained an accuracy and AUC above 0.80. But such high performance failed while applying our ML pipeline using an external validation dataset from the EMBARC study which is a multi-center study. We further examined the possible reasons especially the site heterogeneity issue.

Treatment Response Prediction in Major Depressive Disorder Using Multimodal MRI and Clinical Data: Secondary Analysis of a Randomized Clinical Trial

OBJECTIVE

Response to antidepressant treatment in major depressive disorder varies substantially between individuals, which lengthens the process of finding effective treatment. The authors sought to determine whether a multimodal machine learning approach could predict early sertraline response in patients with major depressive disorder. They assessed the predictive contribution of MR neuroimaging and clinical assessments at baseline and after 1 week of treatment.

METHODS

This was a preregistered secondary analysis of data from the Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care (EMBARC) study, a multisite double-blind, placebo-controlled randomized clinical trial that included 296 adult outpatients with unmedicated recurrent or chronic major depressive disorder. MR neuroimaging and clinical data were collected before and after 1 week of treatment. Performance in predicting response and remission, collected after 8 weeks, was quantified using balanced accuracy (bAcc) and area under the receiver operating characteristic curve (AUROC) scores.

RESULTS

A total of 229 patients were included in the analyses (mean age, 38 years [SD=13]; 66% female). Internal cross-validation performance in predicting response to sertraline (bAcc=68% [SD=10], AUROC=0.73 [SD=0.03]) was significantly better than chance. External cross-validation on data from placebo nonresponders (bAcc=62%, AUROC=0.66) and placebo nonresponders who were switched to sertraline (bAcc=65%, AUROC=0.68) resulted in differences that suggest specificity for sertraline treatment compared with placebo treatment. Finally, multimodal models outperformed unimodal models.

CONCLUSIONS

The study results confirm that early sertraline treatment response can be predicted; that the models are sertraline specific compared with placebo; that prediction benefits from integrating multimodal MRI data with clinical data; and that perfusion imaging contributes most to these predictions. Using this approach, a lean and effective protocol could individualize sertraline treatment planning to improve psychiatric care.

Electroencephalography for predicting antidepressant treatment success: A systematic review and meta-analysis

BACKGROUND

Patients suffering from major depressive disorder (MDD) regularly experience non-response to treatment for their depressive episode. Personalized clinical decision making could shorten depressive episodes and reduce patient suffering. Although no clinical tools are currently available, machine learning analysis of electroencephalography (EEG) shows promise in treatment response prediction.

METHODS

With a systematic review and meta-analysis, we evaluated the accuracy of EEG for individual patient response prediction. Importantly, we included only prediction studies that used cross-validation. We used a bivariate model to calculate prediction success, as expressed by area-under the curve, sensitivity and specificity. Furthermore, we analyzed prediction success for separate antidepressant interventions.

RESULTS

15 studies with 12 individual patient samples and a total of 479 patients were included. Research methods varied considerably between studies. Meta-analysis of results from this heterogeneous set of studies resulted in an area under the curve of 0.91, a sensitivity of 83 % (95 % CI 74-89 %), and a specificity of 86 % (95 % CI 81-90 %). Classification performance did not significantly differ between treatments. Although studies were all internally validated, no externally validated studies have been reported. We found substantial risk of bias caused by methodological shortcomings such as non-independent feature selection, though performance of non-biased studies was comparable.

LIMITATIONS

Sample sizes were relatively small and no study used external validation, increasing the risk of overestimation of accuracy.

CONCLUSIONS

Electroencephalography can predict the response to antidepressant treatment with high accuracy. However, future studies with more rigorous validation are needed to produce a clinical tool to guide interventions in MDD.

PROSPERO REGISTRATION NUMBER

CRD42021268169.