Clinical utility of machine-learning approaches in schizophrenia: improving diagnostic confidence for translational neuroimaging

Identification of male schizophrenia patients using brain morphology based on machine learning algorithms

BACKGROUND

Schizophrenia is a severe psychiatric disease, and its prevalence is higher. However, diagnosis of early-stage schizophrenia is still considered a challenging task.

AIM

To employ brain morphological features and machine learning method to differentiate male individuals with schizophrenia from healthy controls.

METHODS

The least absolute shrinkage and selection operator and t tests were applied to select important features from structural magnetic resonance images as input features for classification. Four commonly used machine learning algorithms, the general linear model, random forest (RF), k-nearest neighbors, and support vector machine algorithms, were used to develop the classification models. The performance of the classification models was evaluated according to the area under the receiver operating characteristic curve (AUC).

RESULTS

A total of 8 important features with significant differences between groups were considered as input features for the establishment of classification models based on the four machine learning algorithms. Compared to other machine learning algorithms, RF yielded better performance in the discrimination of male schizophrenic individuals from healthy controls, with an AUC of 0.886.

CONCLUSION

Our research suggests that brain morphological features can be used to improve the early diagnosis of schizophrenia in male patients.

The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis

Objective

Machine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.

Methods

English databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.

Results

Thirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.

Conclusion

ML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.

Supervised machine learning classification of psychosis biotypes based on brain structure: findings from the Bipolar-Schizophrenia network for intermediate phenotypes (B-SNIP)

Traditional diagnostic formulations of psychotic disorders have low correspondence with underlying disease neurobiology. This has led to a growing interest in using brain-based biomarkers to capture biologically-informed psychosis constructs. Building upon our prior work on the B-SNIP Psychosis Biotypes, we aimed to examine whether structural MRI (an independent biomarker not used in the Biotype development) can effectively classify the Biotypes. Whole brain voxel-wise grey matter density (GMD) maps from T1-weighted images were used to train and test (using repeated randomized train/test splits) binary L2-penalized logistic regression models to discriminate psychosis cases (n = 557) from healthy controls (CON, n = 251). A total of six models were evaluated across two psychosis categorization schemes: (i) three Biotypes (B1, B2, B3) and (ii) three DSM diagnoses (schizophrenia (SZ), schizoaffective (SAD) and bipolar (BD) disorders). Above-chance classification accuracies were observed in all Biotype (B1 = 0.70, B2 = 0.65, and B3 = 0.56) and diagnosis (SZ = 0.64, SAD = 0.64, and BD = 0.59) models. However, the only model that showed evidence of specificity was B1, i.e., the model was able to discriminate B1 vs. CON and did not misclassify other psychosis cases (B2 or B3) as B1 at rates above nominal chance. The GMD-based classifier evidence for B1 showed a negative association with an estimate of premorbid general intellectual ability, regardless of group membership, i.e. psychosis or CON. Our findings indicate that, complimentary to clinical diagnoses, the B-SNIP Psychosis Biotypes may offer a promising approach to capture specific aspects of psychosis neurobiology.

A meta-analysis and systematic review of single vs. multimodal neuroimaging techniques in the classification of psychosis

BACKGROUND

Psychotic disorders are characterized by structural and functional abnormalities in brain networks. Neuroimaging techniques map and characterize such abnormalities using unique features (e.g., structural integrity, coactivation). However, it is unclear if a specific method, or a combination of modalities, is particularly effective in identifying differences in brain networks of someone with a psychotic disorder.

METHODS

A systematic meta-analysis evaluated machine learning classification of schizophrenia spectrum disorders in comparison to healthy control participants using various neuroimaging modalities (i.e., T1-weighted imaging (T1), diffusion tensor imaging (DTI), resting state functional connectivity (rs-FC), or some combination (multimodal)). Criteria for manuscript inclusion included whole-brain analyses and cross-validation to provide a complete picture regarding the predictive ability of large-scale brain systems in psychosis. For this meta-analysis, we searched Ovid MEDLINE, PubMed, PsychInfo, Google Scholar, and Web of Science published between inception and March 13th 2023. Prediction results were averaged for studies using the same dataset, but parallel analyses were run that included studies with pooled sample across many datasets. We assessed bias through funnel plot asymmetry. A bivariate regression model determined whether differences in imaging modality, demographics, and preprocessing methods moderated classification. Separate models were run for studies with internal prediction (via cross-validation) and external prediction.

RESULTS

93 studies were identified for quantitative review (30 T1, 9 DTI, 40 rs-FC, and 14 multimodal). As a whole, all modalities reliably differentiated those with schizophrenia spectrum disorders from controls (OR = 2.64 (95%CI = 2.33 to 2.95)). However, classification was relatively similar across modalities: no differences were seen across modalities in the classification of independent internal data, and a small advantage was seen for rs-FC studies relative to T1 studies in classification in external datasets. We found large amounts of heterogeneity across results resulting in significant signs of bias in funnel plots and Egger's tests. Results remained similar, however, when studies were restricted to those with less heterogeneity, with continued small advantages for rs-FC relative to structural measures. Notably, in all cases, no significant differences were seen between multimodal and unimodal approaches, with rs-FC and unimodal studies reporting largely overlapping classification performance. Differences in demographics and analysis or denoising were not associated with changes in classification scores.

CONCLUSIONS

The results of this study suggest that neuroimaging approaches have promise in the classification of psychosis. Interestingly, at present most modalities perform similarly in the classification of psychosis, with slight advantages for rs-FC relative to structural modalities in some specific cases. Notably, results differed substantially across studies, with suggestions of biased effect sizes, particularly highlighting the need for more studies using external prediction and large sample sizes. Adopting more rigorous and systematized standards will add significant value toward understanding and treating this critical population.

Symptom-circuit mappings of the schizophrenia connectome

OBJECTIVE

This paper aims to model the anatomical circuits underlying schizophrenia symptoms, and to explore patterns of abnormal connectivity among brain networks affected by psychopathology.

METHODS

T1 magnetic resonance imaging (MRI), diffusion weighted imaging (DWI), and resting-state functional MRI (rsfMRI) were obtained from a total of 126 patients with schizophrenia who were recruited for the study. The images were processed using the Omniscient software (https://www.o8t. com). We further apply the use of the Hollow-tree Super (HoTS) method to gain insights into what brain regions had abnormal connectivity that might be linked to the symptoms of schizophrenia.

RESULTS

The Positive and Negative Symptom Scale is characterised into 6 factors. Each symptom is mapped with specific anatomical abnormalities and circuits. Comparison between factors reveals co-occurrence in parcels in Factor 1 and Factor 2. Multiple large-scale networks are involved in SCZ symptomatology, with functional connectivity within Default Mode Network (DMN) and Central Executive Network (CEN) regions most frequently associated with measures of psychopathology.

CONCLUSION

We present a summary of the relevant anatomy for regions of the cortical areas as part of a larger effort to understand its contribution in schizophrenia. This unique machine learning-type approach maps symptoms to specific brain regions and circuits by bridging the diagnostic subtypes and analysing the features of the connectome.

A morphological study of schizophrenia with magnetic resonance imaging, advanced analytics, and machine learning

We have performed a morphological analysis of patients with schizophrenia and compared them with healthy controls. Our analysis includes the use of publicly available automated extraction tools to assess regional cortical thickness (inclusive of within region cortical thickness variability) from structural magnetic resonance imaging (MRI), to characterize group-wise abnormalities associated with schizophrenia based on a publicly available dataset. We have also performed a correlation analysis between the automatically extracted biomarkers and a variety of patient clinical variables available. Finally, we also present the results of a machine learning analysis. Results demonstrate regional cortical thickness abnormalities in schizophrenia. We observed a correlation (rho = 0.474) between patients’ depression and the average cortical thickness of the right medial orbitofrontal cortex. Our leading machine learning technology evaluated was the support vector machine with stepwise feature selection, yielding a sensitivity of 92% and a specificity of 74%, based on regional brain measurements, including from the insula, superior frontal, caudate, calcarine sulcus, gyrus rectus, and rostral middle frontal regions. These results imply that advanced analytic techniques combining MRI with automated biomarker extraction can be helpful in characterizing patients with schizophrenia.

Ultra-high field neuroimaging in psychosis: A narrative review

Schizophrenia and related psychoses are complex neuropsychiatric diseases representing dysconnectivity across multiple scales, through the micro (cellular), meso (brain network), manifest (behavioral), and social (interpersonal) levels. In vivo human neuroimaging, particularly at ultra-high field (UHF), offers unprecedented opportunity to examine multiscale dysconnectivity in psychosis. In this review, we provide an overview of the literature to date on UHF in psychosis, focusing on microscale findings from magnetic resonance spectroscopy (MRS), mesoscale studies on structural and functional magnetic resonance imaging (fMRI), and multiscale studies assessing multiple neuroimaging modalities and relating UHF findings to behavior. We highlight key insights and considerations from multiscale and longitudinal studies and provide recommendations for future research on UHF neuroimaging in psychosis.

Machine Learning in Neuro-Oncology, Epilepsy, Alzheimer's Disease, and Schizophrenia

Applications of machine learning (ML) in translational medicine include therapeutic drug creation, diagnostic development, surgical planning, outcome prediction, and intraoperative assistance. Opportunities in the neurosciences are rich given advancement in our understanding of the brain, expanding indications for intervention, and diagnostic challenges often characterized by multiple clinical and environmental factors. We present a review of ML in neuro-oncology, epilepsy, Alzheimer's disease, and schizophrenia to highlight recent progression in these field, optimizing machine learning capabilities in their current forms. Supervised learning models appear to be the most commonly incorporated algorithm models for machine learning across the reviewed neuroscience disciplines with primary aim of diagnosis. Accuracy ranges are high from 63% to 99% across all algorithms investigated. Machine learning contributions to neurosurgery, neurology, psychiatry, and the clinical and basic science neurosciences may enhance current medical best practices while also broadening our understanding of dynamic neural networks and the brain.

Computing schizophrenia: ethical challenges for machine learning in psychiatry

Recent advances in machine learning (ML) promise far-reaching improvements across medical care, not least within psychiatry. While to date no psychiatric application of ML constitutes standard clinical practice, it seems crucial to get ahead of these developments and address their ethical challenges early on. Following a short general introduction concerning ML in psychiatry, we do so by focusing on schizophrenia as a paradigmatic case. Based on recent research employing ML to further the diagnosis, treatment, and prediction of schizophrenia, we discuss three hypothetical case studies of ML applications with view to their ethical dimensions. Throughout this discussion, we follow the principlist framework by Tom Beauchamp and James Childress to analyse potential problems in detail. In particular, we structure our analysis around their principles of beneficence, non-maleficence, respect for autonomy, and justice. We conclude with a call for cautious optimism concerning the implementation of ML in psychiatry if close attention is paid to the particular intricacies of psychiatric disorders and its success evaluated based on tangible clinical benefit for patients.

Grey matter volume abnormalities in the first depressive episode of medication-naïve adult individuals: a systematic review of voxel based morphometric studies

BACKGROUND

To identify the reliable and consistent grey matter volume (GMV) abnormalities associated with major depressive disorder (MDD), we excluded the influence of confounding clinical characteristics, comorbidities and brain degeneration on brain morphological abnormalities by inclusion of non-comorbid and non-geriatric drug-naïve MDD individuals experiencing first episode depressive.

METHODS

The PubMed, Scopus, Web of Science, Science Direct and Google scholar databases were searched for papers published in English up to April 2020.

RESULTS

A total of 21 voxel based morphometric (VBM) studies comparing 845 individuals in the first depressive episode and medication-naïve with 940 healthy control subjects were included. The results showed a grey matter volumes reductions in the orbitofrontal cortex (OFC), prefrontal cortex (PFC), frontal and temporal gyri, temporal pole, insular lobe, thalamus, basal ganglia, cerebellum, hippocampus, cingulate cortex, and amygdala. In addition, increased grey matter volumes in the postcentral gyrus, superior frontal gyrus, insula, basal ganglia, thalamus, amygdala, cuneus, and precuneus differentiated the first depressive episode in medication-naïve individuals from healthy subjects.

CONCLUSION

The present systematic review provided additional support for the involvement of grey matter structural abnormalities in limbic-cortical circuits as possibly specific structural abnormalities in the early stage of MDD.Key pointsDistinct brain regions in MDD patients might be associated with the early stages of illness, and thus it is critical to study the causal relationship between brain structures and the onset of the disease to improve the evaluation in clinic.Grey matter alterations in the fronto-limbic networks in the first episode, medication-naïve MDD might suggest that these abnormalities may play an important role in the neuropathophysiology of MDD at its onset.First episode, medically naïve depressive patients show grey matter volume alterations in brain regions mainly associated with emotion regulation including parietal-temporal regions, PFC, insular lobe, thalamus, basal ganglia, cerebellum and limbic structures that may be specific changes in early stage of MDD.Genotype-diagnosis interaction effects on brain morphology in the cortico-limbic-striatal circuits, including the PFC, amygdala, hippocampus and striatum that might be implicated in the dysfunctional regulation of emotion in first-episode MDD patients.Future longitudinal and prospective studies should be conducted to identify the core structural brain changes in people at-risk for MDD and explore the association of their brain volumes with symptom onset.

Hold-out validation for the assessment of stability and reliability of multivariable regression demonstrated with magnetic resonance imaging of patients with schizophrenia

Neuroscience studies are very often tasked with identifying measurable differences between two groups of subjects, typically one group with a pathological condition and one group representing control subjects. It is often expected that the measurements acquired for comparing groups are also affected by a variety of additional patient characteristics such as sex, age, and comorbidities. Multivariable regression (MVR) is a statistical analysis technique commonly employed in neuroscience studies to "control for" or "adjust for" secondary effects (such as sex, age, and comorbidities) in order to ensure that the main study findings are focused on actual differences between the groups of interest associated with the condition under investigation. It is common practice in the neuroscience literature to utilize MVR to control for secondary effects; however, at present, it is not typically possible to assess whether the MVR adjustments correct for more error than they introduce. In common neuroscience practice, MVR models are not validated and no attempt to characterize deficiencies in the MVR model is made. In this article, we demonstrate how standard hold-out validation techniques (commonly used in machine learning analyses) that involve repeatedly randomly dividing datasets into training and testing samples can be adapted to the assessment of stability and reliability of MVR models with a publicly available neurological magnetic resonance imaging (MRI) dataset of patients with schizophrenia. Results demonstrate that MVR can introduce measurement error up to 30.06% and, on average across all considered measurements, introduce 9.84% error on this dataset. When hold-out validated MVR does not agree with the results of the standard use of MVR, the use of MVR in the given application is unstable. Thus, this paper helps evaluate the extent to which the simplistic use of MVR introduces study error in neuroscientific analyses with an analysis of patients with schizophrenia.

Schizophrenia: A Survey of Artificial Intelligence Techniques Applied to Detection and Classification

Artificial Intelligence in healthcare employs machine learning algorithms to emulate human cognition in the analysis of complicated or large sets of data. Specifically, artificial intelligence taps on the ability of computer algorithms and software with allowable thresholds to make deterministic approximate conclusions. In comparison to traditional technologies in healthcare, artificial intelligence enhances the process of data analysis without the need for human input, producing nearly equally reliable, well defined output. Schizophrenia is a chronic mental health condition that affects millions worldwide, with impairment in thinking and behaviour that may be significantly disabling to daily living. Multiple artificial intelligence and machine learning algorithms have been utilized to analyze the different components of schizophrenia, such as in prediction of disease, and assessment of current prevention methods. These are carried out in hope of assisting with diagnosis and provision of viable options for individuals affected. In this paper, we review the progress of the use of artificial intelligence in schizophrenia.

Cost-effectiveness of neuroimaging technologies in management of psychiatric and insomnia disorders: A meta-analysis and prospective cost analysis

BACKGROUND

The optimal diagnostic strategy for patients with psychiatric and insomnia disorders has not been established yet.

PURPOSE

The purpose of this study was to perform cost-effectiveness analysis of six neuroimaging technologies in diagnosis of patients with psychiatric and insomnia disorders.

METHODS

An economic evaluation study was conducted in three parts, including a systematic review for determining diagnostic accuracy, a descriptive cross-sectional study with Activity-Based Costing (ABC) technique for tracing resource consumption, and a cost-effectiveness analysis using a short-term decision-analytic model.

RESULTS

In the first phase, 93 diagnostic accuracy studies were included in the systematic review. The accumulated results (meta-analysis) showed that the highest diagnostic accuracy for psychiatric and insomnia disorders was attributed to PET (sensitivity of 90% and specificity of 80%) and MRI (sensitivity of 76% and specificity of 78%) respectively. In the second phase of the study, we calculated the cost of each technology. The results showed that MRI has the lowest cost. Based on the results in the model of cost-effectiveness sMRI ($ 50.08 per accurate diagnosis) and MRI ($ 58.54 per accurate diagnosis) were more cost-effective neuroimaging technologies.

CONCLUSION

In psychiatric disorders, no single strategy was characterized by both low cost and high accuracy. However, MRI and PET scan had lower cost and higher accuracy for psychiatric disorders, respectively. MRI was the least costly with the highest diagnostic accuracy in insomnia disorders. Based on our model, sMRI in psychiatric disorders and MRI in insomnia disorders were the most cost-effective technologies.

White matter alteration in adults with prelingual deafness: A TBSS and SBM analysis of fractional anisotropy data

A loss of hearing in early life leads to diversifications of important white matter networks. Previous studies related to WM alterations in adult deaf individuals mainly involved univariate analysis of fractional anisotropy (FA) data and volumetric analysis, which yielded inconsistent results. To address this issue, we investigated the FA value alterations in 38 prelingual adult deaf individuals and compared the results with those obtained from the same number of adults with normal hearing by using univariate (tract-based spatial statistics) and multivariate (source-based morphometry) methods. The findings from tract-based spatial statistics suggested an increased FA value in regions such as the left cingulate gyrus, left inferior frontal occipital fasciculus, left inferior longitudinal fasciculus and superior corona radiata; however, the results indicated a decreased FA value in the left planum temporale of adult deaf individuals. While source-based morphometry analysis outlined higher FA values in regions such as bilateral lingual gyrus, bilateral cerebellum, bilateral putamen and bilateral caudate, a considerable decrease was observed in the bilateral superior temporal region of the deaf group. These alterations in multiple neural regions might be linked to the compensatory cross-modal reorganizations attributed to early hearing loss.

Support vector machine-based classification of schizophrenia patients and healthy controls using structural magnetic resonance imaging from two independent sites

Structural brain alterations have been repeatedly reported in schizophrenia; however, the pathophysiology of its alterations remains unclear. Multivariate pattern recognition analysis such as support vector machines can classify patients and healthy controls by detecting subtle and spatially distributed patterns of structural alterations. We aimed to use a support vector machine to distinguish patients with schizophrenia from control participants on the basis of structural magnetic resonance imaging data and delineate the patterns of structural alterations that significantly contributed to the classification performance. We used independent datasets from different sites with different magnetic resonance imaging scanners, protocols and clinical characteristics of the patient group to achieve a more accurate estimate of the classification performance of support vector machines. We developed a support vector machine classifier using the dataset from one site (101 participants) and evaluated the performance of the trained support vector machine using a dataset from the other site (97 participants) and vice versa. We assessed the performance of the trained support vector machines in each support vector machine classifier. Both support vector machine classifiers attained a classification accuracy of >70% with two independent datasets indicating a consistently high performance of support vector machines even when used to classify data from different sites, scanners and different acquisition protocols. The regions contributing to the classification accuracy included the bilateral medial frontal cortex, superior temporal cortex, insula, occipital cortex, cerebellum, and thalamus, which have been reported to be related to the pathogenesis of schizophrenia. These results indicated that the support vector machine could detect subtle structural brain alterations and might aid our understanding of the pathophysiology of these changes in schizophrenia, which could be one of the diagnostic findings of schizophrenia.

Spectral features based convolutional neural network for accurate and prompt identification of schizophrenic patients

Schizophrenia is a fatal mental disorder, which affects millions of people globally by the disturbance in their thinking, feeling and behaviour. In the age of the internet of things assisted with cloud computing and machine learning techniques, the computer-aided diagnosis of schizophrenia is essentially required to provide its patients with an opportunity to own a better quality of life. In this context, the present paper proposes a spectral features based convolutional neural network (CNN) model for accurate identification of schizophrenic patients using spectral analysis of multichannel EEG signals in real-time. This model processes acquired EEG signals with filtering, segmentation and conversion into frequency domain. Then, given frequency domain segments are divided into six distinct spectral bands like delta, theta-1, theta-2, alpha, beta and gamma. The spectral features including mean spectral amplitude, spectral power and Hjorth descriptors (Activity, Mobility and Complexity) are extracted from each band. These features are independently fed to the proposed spectral features-based CNN and long short-term memory network (LSTM) models for classification. This work also makes use of raw time-domain and frequency-domain EEG segments for classification using temporal CNN and spectral CNN models of same architectures respectively. The overall analysis of simulation results of all models exhibits that the proposed spectral features based CNN model is an efficient technique for accurate and prompt identification of schizophrenic patients among healthy individuals with average classification accuracies of 94.08% and 98.56% for two different datasets with optimally small classification time.

Fueling Clinical and Translational Research in Appalachia: Informatics Platform Approach

BACKGROUND

The Appalachian population is distinct, not just culturally and geographically but also in its health care needs, facing the most health care disparities in the United States. To meet these unique demands, Appalachian medical centers need an arsenal of analytics and data science tools with the foundation of a centralized data warehouse to transform health care data into actionable clinical interventions. However, this is an especially challenging task given the fragmented state of medical data within Appalachia and the need for integration of other types of data such as environmental, social, and economic with medical data.

OBJECTIVE

This paper aims to present the structure and process of the development of an integrated platform at a midlevel Appalachian academic medical center along with its initial uses.

METHODS

The Appalachian Informatics Platform was developed by the Appalachian Clinical and Translational Science Institute's Division of Clinical Informatics and consists of 4 major components: a centralized clinical data warehouse, modeling (statistical and machine learning), visualization, and model evaluation. Data from different clinical systems, billing systems, and state- or national-level data sets were integrated into a centralized data warehouse. The platform supports research efforts by enabling curation and analysis of data using the different components, as appropriate.

RESULTS

The Appalachian Informatics Platform is functional and has supported several research efforts since its implementation for a variety of purposes, such as increasing knowledge of the pathophysiology of diseases, risk identification, risk prediction, and health care resource utilization research and estimation of the economic impact of diseases.

CONCLUSIONS

The platform provides an inexpensive yet seamless way to translate clinical and translational research ideas into clinical applications for regions similar to Appalachia that have limited resources and a largely rural population.

Towards a brain-based predictome of mental illness

Neuroimaging-based approaches have been extensively applied to study mental illness in recent years and have deepened our understanding of both cognitively healthy and disordered brain structure and function. Recent advancements in machine learning techniques have shown promising outcomes for individualized prediction and characterization of patients with psychiatric disorders. Studies have utilized features from a variety of neuroimaging modalities, including structural, functional, and diffusion magnetic resonance imaging data, as well as jointly estimated features from multiple modalities, to assess patients with heterogeneous mental disorders, such as schizophrenia and autism. We use the term "predictome" to describe the use of multivariate brain network features from one or more neuroimaging modalities to predict mental illness. In the predictome, multiple brain network-based features (either from the same modality or multiple modalities) are incorporated into a predictive model to jointly estimate features that are unique to a disorder and predict subjects accordingly. To date, more than 650 studies have been published on subject-level prediction focusing on psychiatric disorders. We have surveyed about 250 studies including schizophrenia, major depression, bipolar disorder, autism spectrum disorder, attention-deficit hyperactivity disorder, obsessive-compulsive disorder, social anxiety disorder, posttraumatic stress disorder, and substance dependence. In this review, we present a comprehensive review of recent neuroimaging-based predictomic approaches, current trends, and common shortcomings and share our vision for future directions.

Precision Telemedicine through Crowdsourced Machine Learning: Testing Variability of Crowd Workers for Video-Based Autism Feature Recognition

Mobilized telemedicine is becoming a key, and even necessary, facet of both precision health and precision medicine. In this study, we evaluate the capability and potential of a crowd of virtual workers-defined as vetted members of popular crowdsourcing platforms-to aid in the task of diagnosing autism. We evaluate workers when crowdsourcing the task of providing categorical ordinal behavioral ratings to unstructured public YouTube videos of children with autism and neurotypical controls. To evaluate emerging patterns that are consistent across independent crowds, we target workers from distinct geographic loci on two crowdsourcing platforms: an international group of workers on Amazon Mechanical Turk (MTurk) (N = 15) and Microworkers from Bangladesh (N = 56), Kenya (N = 23), and the Philippines (N = 25). We feed worker responses as input to a validated diagnostic machine learning classifier trained on clinician-filled electronic health records. We find that regardless of crowd platform or targeted country, workers vary in the average confidence of the correct diagnosis predicted by the classifier. The best worker responses produce a mean probability of the correct class above 80% and over one standard deviation above 50%, accuracy and variability on par with experts according to prior studies. There is a weak correlation between mean time spent on task and mean performance (r = 0.358, p = 0.005). These results demonstrate that while the crowd can produce accurate diagnoses, there are intrinsic differences in crowdworker ability to rate behavioral features. We propose a novel strategy for recruitment of crowdsourced workers to ensure high quality diagnostic evaluations of autism, and potentially many other pediatric behavioral health conditions. Our approach represents a viable step in the direction of crowd-based approaches for more scalable and affordable precision medicine.

A Systematic Characterization of Structural Brain Changes in Schizophrenia

A systematic characterization of the similarities and differences among different methods for detecting structural brain abnormalities in schizophrenia, such as voxel-based morphometry (VBM), tensor-based morphometry (TBM), and projection-based thickness (PBT), is important for understanding the brain pathology in schizophrenia and for developing effective biomarkers for a diagnosis of schizophrenia. However, such studies are still lacking. Here, we performed VBM, TBM, and PBT analyses on T1-weighted brain MR images acquired from 116 patients with schizophrenia and 116 healthy controls. We found that, although all methods detected wide-spread structural changes, different methods captured different information - only 10.35% of the grey matter changes in cortex were detected by all three methods, and VBM only detected 11.36% of the white matter changes detected by TBM. Further, pattern classification between patients and controls revealed that combining different measures improved the classification accuracy (81.9%), indicating that fusion of different structural measures serves as a better neuroimaging marker for the objective diagnosis of schizophrenia.

Development of an Al-Based Web Diagnostic System for Phenotyping Psychiatric Disorders

Background: Artificial intelligence (AI)-based medical diagnostic applications are on the rise. Our recent study has suggested an explainable deep neural network (EDNN) framework for identifying key structural deficits related to the pathology of schizophrenia. Here, we presented an AI-based web diagnostic system for schizophrenia under the EDNN framework with three-dimensional (3D) visualization of subjects' neuroimaging dataset. Methods: This AI-based web diagnostic system consisted of a web server and a neuroimaging diagnostic database. The web server deployed the EDNN algorithm under the Node.js environment. Feature selection and network model building were performed on the dataset obtained from two hundred schizophrenic patients and healthy controls in the Taiwan Aging and Mental Illness (TAMI) cohort. We included an independent cohort with 88 schizophrenic patients and 44 healthy controls recruited at Tri-Service General Hospital Beitou Branch for validation purposes. Results: Our AI-based web diagnostic system achieved 84.00% accuracy (89.47% sensitivity, 80.62% specificity) for gray matter (GM) and 90.22% accuracy (89.21% sensitivity, 91.23% specificity) for white matter (WM) on the TAMI cohort. For the Beitou cohort as an unseen test set, the model achieved 77.27 and 70.45% accuracy for GM and WM. Furthermore, it achieved 85.50 and 88.20% accuracy after model retraining to mitigate the effects of drift on the predictive capability. Moreover, our system visualized the identified voxels in brain atrophy in a 3D manner with patients' structural image, optimizing the evaluation process of the diagnostic results. Discussion: Together, our approach under the EDNN framework demonstrated the potential future direction of making a schizophrenia diagnosis based on structural brain imaging data. Our deep learning model is explainable, arguing for the accuracy of the key information related to the pathology of schizophrenia when using the AI-based web assessment platform. The rationale of this approach is in accordance with the Research Domain Criteria suggested by the National Institute of Mental Health.

Schizophrenia Exhibits Bi-directional Brain-Wide Alterations in Cortico-Striato-Cerebellar Circuits

Distributed neural dysconnectivity is considered a hallmark feature of schizophrenia (SCZ), yet a tension exists between studies pinpointing focal disruptions versus those implicating brain-wide disturbances. The cerebellum and the striatum communicate reciprocally with the thalamus and cortex through monosynaptic and polysynaptic connections, forming cortico-striatal-thalamic-cerebellar (CSTC) functional pathways that may be sensitive to brain-wide dysconnectivity in SCZ. It remains unknown if the same pattern of alterations persists across CSTC systems, or if specific alterations exist along key functional elements of these networks. We characterized connectivity along major functional CSTC subdivisions using resting-state functional magnetic resonance imaging in 159 chronic patients and 162 matched controls. Associative CSTC subdivisions revealed consistent brain-wide bi-directional alterations in patients, marked by hyper-connectivity with sensory-motor cortices and hypo-connectivity with association cortex. Focusing on the cerebellar and striatal components, we validate the effects using data-driven k-means clustering of voxel-wise dysconnectivity and support vector machine classifiers. We replicate these results in an independent sample of 202 controls and 145 patients, additionally demonstrating that these neural effects relate to cognitive performance across subjects. Taken together, these results from complementary approaches implicate a consistent motif of brain-wide alterations in CSTC systems in SCZ, calling into question accounts of exclusively focal functional disturbances.

Machine learning and big data: Implications for disease modeling and therapeutic discovery in psychiatry

INTRODUCTION

Machine learning capability holds promise to inform disease models, the discovery and development of novel disease modifying therapeutics and prevention strategies in psychiatry. Herein, we provide an introduction on how machine learning/Artificial Intelligence (AI) may instantiate such capabilities, as well as provide rationale for its application to psychiatry in both research and clinical ecosystems.

METHODS

Databases PubMed and PsycINFO were searched from 1966 to June 2016 for keywords:Big Data, Machine Learning, Precision Medicine, Artificial Intelligence, Mental Health, Mental Disease, Psychiatry, Data Mining, RDoC, and Research Domain Criteria. Articles selected for review were those that were determined to be aligned with the objective of this particular paper.

RESULTS

Results indicate that AI is a viable option to build useful predictors of outcome while offering objective and comparable accuracy metrics, a unique opportunity, particularly in mental health research. The approach has also consistently brought notable insight into disease models through processing the vast amount of already available multi-domain, semi-structured medical data. The opportunity for AI in psychiatry, in addition to disease-model refinement, is in characterizing those at risk, and it is likely also relevant to personalizing and discovering therapeutics.

CONCLUSIONS

Machine learning currently provides an opportunity to parse disease models in complex, multi-factorial disease states (e.g. mental disorders) and could possibly inform treatment selection with existing therapies and provide bases for domain-based therapeutic discovery.

N-BiC: A Method for Multi-Component and Symptom Biclustering of Structural MRI Data: Application to Schizophrenia

OBJECTIVE

We propose and develop a novel biclustering (N-BiC) approach for performing N-way biclustering of neuroimaging data. Our approach is applicable to an arbitrary number of features from both imaging and behavioral data (e.g., symptoms). We applied it to structural MRI data from patients with schizophrenia.

METHODS

It uses a source-based morphometry approach [i.e., independent component analysis of gray matter segmentation maps] to decompose the data into a set of spatial maps, each of which includes regions that covary among individuals. Then, the loading parameters for components of interest are entered to an exhaustive search, which incorporates a modified depth-first search technique to carry out the biclustering, with the goal of obtaining submatrices where the selected rows (individuals) show homogeneity in their expressions of selected columns (components) and vice versa.

RESULTS

Findings demonstrate that multiple biclusters have an evident association with distinct brain networks for the different types of symptoms in schizophrenia. The study identifies two components: inferior temporal gyrus (16) and brainstem (7), which are related to positive (distortion/excess of normal function) and negative (diminution/loss of normal function) symptoms in schizophrenia, respectively.

CONCLUSION

N-BiC is a data-driven method of biclustering MRI data that can exhaustively explore relationships/substructures from a dataset without any prior information with a higher degree of robustness than earlier biclustering applications.

SIGNIFICANCE

The use of such approaches is important to investigate the underlying biological substrates of mental illness by grouping patients into homogeneous subjects, as the schizophrenia diagnosis is known to be relatively nonspecific and heterogeneous.

Low-rank network signatures in the triple network separate schizophrenia and major depressive disorder

Brain imaging studies have revealed that functional and structural brain connectivity in the so-called triple network (i.e., default mode network (DMN), salience network (SN) and central executive network (CEN)) are consistently altered in schizophrenia. However, similar changes have also been found in patients with major depressive disorder, prompting the question of specific triple network signatures for the two disorders. In this study, we proposed Supervised Convex Nonnegative Matrix Factorization (SCNMF) to extract distributed multi-modal brain patterns. These patterns distinguish schizophrenia and major depressive disorder in a latent low-dimensional space of the triple brain network. Specifically, 21 patients of schizophrenia and 25 patients of major depressive disorder were assessed by T1-weighted, diffusion-weighted, and resting-state functional MRIs. Individual structural and functional connectivity networks, based on pre-defined regions of the triple network were constructed, respectively. Afterwards, SCNMF was employed to extract the discriminative patterns. Experiments indicate that SCNMF allows extracting the low-rank discriminative patterns between the two disorders, achieving a classification accuracy of 82.6% based on the extracted functional and structural abnormalities with support vector machine. Experimental results show the specific brain patterns for schizophrenia and major depressive disorder that are multi-modal, complex, and distributed in the triple network. Parts of the prefrontal cortex including superior frontal gyri showed variation between patients with schizophrenia and major depression due to structural properties. In terms of functional properties, the middle cingulate cortex, inferior parietal lobule, and cingulate cortex were the most discriminative regions.

Machine learning techniques in a structural and functional MRI diagnostic approach in schizophrenia: a systematic review

BACKGROUND

Diagnosis of schizophrenia (SCZ) is made exclusively clinically, since specific biomarkers that can predict the disease accurately remain unknown. Machine learning (ML) represents a promising approach that could support clinicians in the diagnosis of mental disorders.

OBJECTIVES

A systematic review, according to the PRISMA statement, was conducted to evaluate its accuracy to distinguish SCZ patients from healthy controls.

METHODS

We systematically searched PubMed, Embase, MEDLINE, PsychINFO and the Cochrane Library through December 2018 using generic terms for ML techniques and SCZ without language or time restriction. Thirty-five studies were included in this review: eight of them used structural neuroimaging, twenty-six used functional neuroimaging and one both, with a minimum accuracy >60% (most of them 75-90%). Sensitivity, Specificity and accuracy were extracted from each publication or obtained directly from authors.

RESULTS

Support vector machine, the most frequent technique, if associated with other ML techniques achieved accuracy close to 100%. The prefrontal and temporal cortices appeared to be the most useful brain regions for the diagnosis of SCZ. ML analysis can efficiently detect significantly altered brain connectivity in patients with SCZ (eg, default mode network, visual network, sensorimotor network, frontoparietal network and salience network).

CONCLUSION

The greater accuracy demonstrated by these predictive models and the new models resulting from the integration of multiple ML techniques will be increasingly decisive for early diagnosis and evaluation of the treatment response and to establish the prognosis of patients with SCZ. To achieve a real benefit for patients, the future challenge is to reach an accurate diagnosis not only through clinical evaluation but also with the aid of ML algorithms.

Gender, Personality Traits and Experience With Psychiatric Patients as Predictors of Stigma in Italian Psychology Students

A sample of undergraduate Psychology students (n = 1005), prevalently females (82.4%), mean age 20.5 (sd 2.5), was examined regarding their attitudes toward people suffering from mental illness. The survey instrument included a brief form for demographic variables, the Attribution Questionnaire-9 (AQ-9), the Ten Items Personality Inventory (TIPI), and two questions exploring attitudes toward open-door and restraint-free policies in Psychiatry. Higher levels of stigmatizing attitudes were found in males (Pity, Blame, Help, and Avoidance) and in those (76.5%) who had never had any experience with psychiatric patients (Danger, Fear, Blame, Segregation, Help, Avoidance and Coercion). A similar trend was also found in those who don't share the policy of no seclusion/restraint, while subjects who are favorable to open-door policies reported higher Coercion scores. No correlations were found between dimensions of stigma and personality traits. A machine learning approach was then used to explore the role of demographic, academic and personality variables as predictors of stigmatizing attitudes. Agreeableness and Extraversion emerged as the most relevant predictors for blaming attitudes, while Emotional Stability and Openness appeared to be the most effective contributors to Anger. Our results confirmed that a training experience in Psychiatry might successfully reduce stigma in Psychology students. Further research, with increased generalizability of samples and more reliable instruments, should address the role of personality traits and gender on attitudes toward people suffering from mental illness.

Data Driven Classification Using fMRI Network Measures: Application to Schizophrenia

Using classification to identify biomarkers for various brain disorders has become a common practice among the functional MR imaging community. Typical classification pipeline includes taking the time series, extracting features from them, and using them to classify a set of patients and healthy controls. The most informative features are then presented as novel biomarkers. In this paper, we compared the results of single and double cross validation schemes on a cohort of 170 subjects with schizophrenia and healthy control subjects. We used graph theoretic measures as our features, comparing the use of functional and anatomical atlases to define nodes and the effect of prewhitening to remove autocorrelation trends. We found that double cross validation resulted in a 20% decrease in classification performance compared to single cross validation. The anatomical atlas resulted in higher classification results. Prewhitening resulted in a 10% boost in classification performance. Overall, a classification performance of 80% was obtained with a double-cross validation scheme using prewhitened time series and an anatomical brain atlas. However, reproducibility of classification within subjects across scans was surprisingly low and comparable to across subject classification rates, indicating that subject state during the short scan significantly influences the estimated features and classification performance.

Deficit schizophrenia is a discrete diagnostic category defined by neuro-immune and neurocognitive features: results of supervised machine learning

Deficit schizophrenia is characterized by neurocognitive impairments and changes in the patterning of IgA/IgM responses to plasma tryptophan catabolites (TRYCATs). In the current study, supervised pattern recognition methods, including logistic regression analysis (LRA), Support Vector Machine (SVM), and Soft Independent Modeling of Class Analogy (SIMCA), were used to examine whether deficit schizophrenia is a discrete diagnostic class with respect to Consortium To Establish a Registry for Alzheimer's disease (CERAD) and Cambridge Neuropsychological Test Automated Battery (CANTAB) tests and IgA/IgM responses to noxious (NOX) and generally more protective (PRO) TRYCATs. We recruited patients with (n = 40) and without (n = 40) deficit schizophrenia and healthy volunteers (n = 40). The combined use of TRYCAT and CERAD features strongly segregates deficit from nondeficit schizophrenia and healthy controls. Three out of the top five most important features in LRA, SVM and SIMCA agreed, namely two different NOX/PRO TRYCAT ratios and false memory recall. SIMCA shows that deficit schizophrenia is significantly separated from nondeficit schizophrenia and controls with as top 6 features IgA responses to picolinic acid, IgM responses to 3-OH-kynurenine and kynurenic acid, and impairments in Word List Memory and Verbal Fluency Tests and Mini-Mental State Examination. Nevertheless, nondeficit schizophrenia was not significantly separated from controls. The results show that schizophrenia is not a unitary disease with mere continuous differences in severity of illness between apparent subtypes. Deficit schizophrenia is a qualitatively distinct class defined by neuroimmune (autoimmune responses to TRYCATs) and neurocognitive (episodic and semantic memory) features coupled or not with clinical (negative) symptoms.

Disorganized Gyrification Network Properties During the Transition to Psychosis

IMPORTANCE

There is urgent need to improve the limited prognostic accuracy of clinical instruments to predict psychosis onset in individuals at clinical high risk (CHR) for psychosis. As yet, no reliable biological marker has been established to delineate CHR individuals who will develop psychosis from those who will not.

OBJECTIVES

To investigate abnormalities in a graph-based gyrification connectome in the early stages of psychosis and to test the accuracy of this systems-based approach to predict a transition to psychosis among CHR individuals.

DESIGN, SETTING, AND PARTICIPANTS

This investigation was a cross-sectional magnetic resonance imaging (MRI) study with follow-up assessment to determine the transition status of CHR individuals. Participants were recruited from a specialized clinic for the early detection of psychosis at the Department of Psychiatry (Universitäre Psychiatrische Kliniken [UPK]), University of Basel, Basel, Switzerland. Participants included individuals in the following 4 study groups: 44 healthy controls (HC group), 63 at-risk mental state (ARMS) individuals without later transition to psychosis (ARMS-NT group), 16 ARMS individuals with later transition to psychosis (ARMS-T group), and 38 antipsychotic-free patients with first-episode psychosis (FEP group). The study dates were November 2008 to November 2014. The dates of analysis were March to November 2017.

MAIN OUTCOMES AND MEASURES

Gyrification-based structural covariance networks (connectomes) were constructed to quantify global integration, segregation, and small-worldness. Group differences in network measures were assessed using functional data analysis across a range of network densities. The extremely randomized trees algorithm with repeated 5-fold cross-validation was used to delineate ARMS-T individuals from ARMS-NT individuals. Permutation tests were conducted to assess the significance of classification performance measures.

RESULTS

The 4 study groups comprised 161 participants with mean (SD) ages ranging from 24.0 (4.7) to 25.9 (5.7) years. Small-worldness was reduced in the ARMS-T and FEP groups and was associated with decreased integration and increased segregation in both groups (Hedges g range, 0.666-1.050). Using the connectome properties as features, a good classification performance was obtained (accuracy, 90.49%; balanced accuracy, 81.34%; positive predictive value, 84.47%; negative predictive value, 92.18%; sensitivity, 66.11%; specificity, 96.58%; and area under the curve, 88.30%).

CONCLUSIONS AND RELEVANCE

These findings suggest that there is poor integration in the coordinated development of cortical folding in patients who develop psychosis. These results further suggest that gyrification-based connectomes might be a promising means to generate systems-based measures from anatomical data to improve individual prediction of a transition to psychosis in CHR individuals.

Development of a Behavioral Health Stigma Measure and Application of Machine Learning for Classification

Objective: Given the growing public health importance of measuring the change in mental health stigma over time, the goal of this study was to demonstrate the potential for using machine learning as a tool to analyze patterns of social stigma as a complement to traditional research methods. Methods: A total of 1,904 participants were recruited through Sona Systems, Ltd (Tallinn, Estonia), an experiment management system for online research, to complete a self-reported survey. The collected data were used to develop a new measure of mental (behavioral) health stigma. To build a classification predictive model of stigma, a decision tree was used as the data mining tool, wherein a set of classification rules was generated and tested for its ability to examine the prevalence of stigma. Results: A three-factor stigma model was supported and confirmed. Results indicate that the measure is content-valid and internally consistent. Performance evaluation of the machine learning-based classification algorithm revealed a sufficient inter-rater reliability with a predictive accuracy of 92.4 percent. Conclusion: This study illustrates the potential for applying machine learning to derive a data-driven understanding of the extent to which stigma is prevalent in society. It establishes a framework for the development of an index to track stigma over time and to assist healthcare decision-makers with improving the health of populations and the experience of care for patients.

An Update on Promising Biomarkers in Schizophrenia

Given the heterogeneity of symptoms in patients with schizophrenia and current treatment limitations, biomarkers may play an important role in diagnosis, subtype stratification, and the assessment of treatment response. Though many potential biomarkers have been studied, we have chosen to focus on some of the most promising and potentially clinically relevant biomarkers to review herein. These include markers of inflammation, neuroimaging biomarkers, brain-derived neurotrophic factor, genetic/epigenetic markers, and speech analysis. This will provide a broad overview of putative biomarkers that could become clinically relevant in the future, though none currently appear ready to assist the clinician in identifying cases of schizophrenia, subtypes of the disorder, treatment choice, or response. Nonetheless, some biomarkers, such as C-reactive protein (CRP), may be useful at identifying individuals who may be more highly inflamed, which could drive treatment choice. Though checking CRP is not a standard of practice, this is one example of how biomarkers may drive treatment decisions in the future, supporting precision medicine. Similarly, technological advances may one day allow clinicians to detect changes in speech patterns, which could represent a noninvasive, clinically useful tool in the future. We conclude the review by highlighting two important potential clinical uses for biomarkers in schizophrenia: the identification of individuals who may convert from clinical high risk and the stratification of patients via different biomarkers that may supersede clinical diagnosis. Given the enormous burden of illness of schizophrenia, the search for clinically relevant biomarkers is of great importance to improve the lives of patients with the disorder.

Segmentation and texture analysis of structural biomarkers using neighborhood-clustering-based level set in MRI of the schizophrenic brain

OBJECTIVE

Schizophrenia (SZ) is a psychiatric disorder that especially affects individuals during their adolescence. There is a need to study the subanatomical regions of SZ brain on magnetic resonance images (MRI) based on morphometry. In this work, an attempt was made to analyze alterations in structure and texture patterns in images of the SZ brain using the level-set method and Laws texture features.

MATERIALS AND METHODS

T1-weighted MRI of the brain from Center of Biomedical Research Excellence (COBRE) database were considered for analysis. Segmentation was carried out using the level-set method. Geometrical and Laws texture features were extracted from the segmented brain stem, corpus callosum, cerebellum, and ventricle regions to analyze pattern changes in SZ.

RESULTS

The level-set method segmented multiple brain regions, with higher similarity and correlation values compared with an optimized method. The geometric features obtained from regions of the corpus callosum and ventricle showed significant variation (p < 0.00001) between normal and SZ brain. Laws texture feature identified a heterogeneous appearance in the brain stem, corpus callosum and ventricular regions, and features from the brain stem were correlated with Positive and Negative Syndrome Scale (PANSS) score (p < 0.005).

CONCLUSION

A framework of geometric and Laws texture features obtained from brain subregions can be used as a supplement for diagnosis of psychiatric disorders.

Clinical utility of a short resting-state MRI scan in differentiating bipolar from unipolar depression

OBJECTIVE

Depression in bipolar disorder (BipD) requires a therapeutic approach that is from treating unipolar major depressive disorder (UniD), but to date, no reliable methods could separate these two disorders. The aim of this study was to establish the clinical validity and utility of a non-invasive functional MRI-based method to classify BipD from UniD.

METHOD

The degree of connectivity (degree centrality or DC) of every small unit (voxel) with every other unit of the brain was estimated in 22 patients with BipD and 22 age, gender, and depressive severity-matched patients with UniD and 22 healthy controls. Pattern classification analysis was carried out using a support-vector machine (SVM) approach.

RESULTS

Degree centrality pattern from 8-min resting fMRI discriminated BipD from UniD with an accuracy of 86% and diagnostic odds ratio of 9.6. DC was reduced in the left insula and increased in bilateral precuneus in BipD when compared to UniD. In this sample with a high degree of uncertainty (50% prior probability), positive predictive value of the DC test was 79%.

CONCLUSION

Degree centrality maps are potential candidate measures to separate bipolar depression from unipolar depression. Test performance reported here requires further pragmatic evaluation in regular clinical practice.

Auditory prediction errors as individual biomarkers of schizophrenia

Schizophrenia is a complex psychiatric disorder, typically diagnosed through symptomatic evidence collected through patient interview. We aim to develop an objective biologically-based computational tool which aids diagnosis and relies on accessible imaging technologies such as electroencephalography (EEG). To achieve this, we used machine learning techniques and a combination of paradigms designed to elicit prediction errors or Mismatch Negativity (MMN) responses. MMN, an EEG component elicited by unpredictable changes in sequences of auditory stimuli, has previously been shown to be reduced in people with schizophrenia and this is arguably one of the most reproducible neurophysiological markers of schizophrenia.

EEG data were acquired from 21 patients with schizophrenia and 22 healthy controls whilst they listened to three auditory oddball paradigms comprising sequences of tones which deviated in 10% of trials from regularly occurring standard tones. Deviant tones shared the same properties as standard tones, except for one physical aspect: 1) duration - the deviant stimulus was twice the duration of the standard; 2) monaural gap - deviants had a silent interval omitted from the standard, or 3) inter-aural timing difference, which caused the deviant location to be perceived as 90° away from the standards.

We used multivariate pattern analysis, a machine learning technique implemented in the Pattern Recognition for Neuroimaging Toolbox (PRoNTo) to classify images generated through statistical parametric mapping (SPM) of spatiotemporal EEG data, i.e. event-related potentials measured on the two-dimensional surface of the scalp over time. Using support vector machine (SVM) and Gaussian processes classifiers (GPC), we were able classify individual patients and controls with balanced accuracies of up to 80.48% (p-values = 0.0326, FDR corrected) and an ROC analysis yielding an AUC of 0.87. Crucially, a GP regression revealed that MMN predicted global assessment of functioning (GAF) scores (correlation = 0.73, R² = 0.53, p = 0.0006).

•

The diagnostic utility of multiple auditory oddball stimulus paradigms is assessed.

•

Greatest classification accuracy was achieved using a monaural gap stimulus paradigm.

•

The full post-stimulus epoch contains relevant discriminatory components.

Multi-center machine learning in imaging psychiatry: A meta-model approach

One of the biggest problems in automated diagnosis of psychiatric disorders from medical images is the lack of sufficiently large samples for training. Sample size is especially important in the case of highly heterogeneous disorders such as schizophrenia, where machine learning models built on relatively low numbers of subjects may suffer from poor generalizability. Via multicenter studies and consortium initiatives researchers have tried to solve this problem by combining data sets from multiple sites. The necessary sharing of (raw) data is, however, often hindered by legal and ethical issues. Moreover, in the case of very large samples, the computational complexity might become too large. The solution to this problem could be distributed learning. In this paper we investigated the possibility to create a meta-model by combining support vector machines (SVM) classifiers trained on the local datasets, without the need for sharing medical images or any other personal data. Validation was done in a 4-center setup comprising of 480 first-episode schizophrenia patients and healthy controls in total. We built SVM models to separate patients from controls based on three different kinds of imaging features derived from structural MRI scans, and compared models built on the joint multicenter data to the meta-models. The results showed that the combined meta-model had high similarity to the model built on all data pooled together and comparable classification performance on all three imaging features. Both similarity and performance was superior to that of the local models. We conclude that combining models is thus a viable alternative that facilitates data sharing and creating bigger and more informative models.

Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls

Neuroimaging-based single subject prediction of brain disorders has gained increasing attention in recent years. Using a variety of neuroimaging modalities such as structural, functional and diffusion MRI, along with machine learning techniques, hundreds of studies have been carried out for accurate classification of patients with heterogeneous mental and neurodegenerative disorders such as schizophrenia and Alzheimer's disease. More than 500 studies have been published during the past quarter century on single subject prediction focused on a multiple brain disorders. In the first part of this study, we provide a survey of more than 200 reports in this field with a focus on schizophrenia, mild cognitive impairment (MCI), Alzheimer's disease (AD), depressive disorders, autism spectrum disease (ASD) and attention-deficit hyperactivity disorder (ADHD). Detailed information about those studies such as sample size, type and number of extracted features and reported accuracy are summarized and discussed. To our knowledge, this is by far the most comprehensive review of neuroimaging-based single subject prediction of brain disorders. In the second part, we present our opinion on major pitfalls of those studies from a machine learning point of view. Common biases are discussed and suggestions are provided. Moreover, emerging trends such as decentralized data sharing, multimodal brain imaging, differential diagnosis, disease subtype classification and deep learning are also discussed. Based on this survey, there is extensive evidence showing the great potential of neuroimaging data for single subject prediction of various disorders. However, the main bottleneck of this exciting field is still the limited sample size, which could be potentially addressed by modern data sharing models such as the ones discussed in this paper. Emerging big data technologies and advanced data-intensive machine learning methodologies such as deep learning have coincided with an increasing need for accurate, robust and generalizable single subject prediction of brain disorders during an exciting time. In this report, we survey the past and offer some opinions regarding the road ahead.

Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism

A clinical tool that can diagnose psychiatric illness using functional or structural magnetic resonance (MR) brain images has the potential to greatly assist physicians and improve treatment efficacy. Working toward the goal of automated diagnosis, we propose an approach for automated classification of ADHD and autism based on histogram of oriented gradients (HOG) features extracted from MR brain images, as well as personal characteristic data features. We describe a learning algorithm that can produce effective classifiers for ADHD and autism when run on two large public datasets. The algorithm is able to distinguish ADHD from control with hold-out accuracy of 69.6% (over baseline 55.0%) using personal characteristics and structural brain scan features when trained on the ADHD-200 dataset (769 participants in training set, 171 in test set). It is able to distinguish autism from control with hold-out accuracy of 65.0% (over baseline 51.6%) using functional images with personal characteristic data when trained on the Autism Brain Imaging Data Exchange (ABIDE) dataset (889 participants in training set, 222 in test set). These results outperform all previously presented methods on both datasets. To our knowledge, this is the first demonstration of a single automated learning process that can produce classifiers for distinguishing patients vs. controls from brain imaging data with above-chance accuracy on large datasets for two different psychiatric illnesses (ADHD and autism). Working toward clinical applications requires robustness against real-world conditions, including the substantial variability that often exists among data collected at different institutions. It is therefore important that our algorithm was successful with the large ADHD-200 and ABIDE datasets, which include data from hundreds of participants collected at multiple institutions. While the resulting classifiers are not yet clinically relevant, this work shows that there is a signal in the (f)MRI data that a learning algorithm is able to find. We anticipate this will lead to yet more accurate classifiers, over these and other psychiatric disorders, working toward the goal of a clinical tool for high accuracy differential diagnosis.

Discriminative Analysis of Migraine without Aura: Using Functional and Structural MRI with a Multi-Feature Classification Approach

Magnetic resonance imaging (MRI) is by nature a multi-modality technique that provides complementary information about different aspects of diseases. So far no attempts have been reported to assess the potential of multi-modal MRI in discriminating individuals with and without migraine, so in this study, we proposed a classification approach to examine whether or not the integration of multiple MRI features could improve the classification performance between migraine patients without aura (MWoA) and healthy controls. Twenty-one MWoA patients and 28 healthy controls participated in this study. Resting-state functional MRI data was acquired to derive three functional measures: the amplitude of low-frequency fluctuations, regional homogeneity and regional functional correlation strength; and structural MRI data was obtained to measure the regional gray matter volume. For each measure, the values of 116 pre-defined regions of interest were extracted as classification features. Features were first selected and combined by a multi-kernel strategy; then a support vector machine classifier was trained to distinguish the subjects at individual level. The performance of the classifier was evaluated using a leave-one-out cross-validation method, and the final classification accuracy obtained was 83.67% (with a sensitivity of 92.86% and a specificity of 71.43%). The anterior cingulate cortex, prefrontal cortex, orbitofrontal cortex and the insula contributed the most discriminative features. In general, our proposed framework shows a promising classification capability for MWoA by integrating information from multiple MRI features.

Multimodal MRI-Based Classification of Trauma Survivors with and without Post-Traumatic Stress Disorder

Post-traumatic stress disorder (PTSD) is a debilitating psychiatric disorder. It can be difficult to discern the symptoms of PTSD and obtain an accurate diagnosis. Different magnetic resonance imaging (MRI) modalities focus on different aspects, which may provide complementary information for PTSD discrimination. However, none of the published studies assessed the diagnostic potential of multimodal MRI in identifying individuals with and without PTSD. In the current study, we investigated whether the complementary information conveyed by multimodal MRI scans could be combined to improve PTSD classification performance. Structural and resting-state functional MRI (rs-fMRI) scans were conducted on 17 PTSD patients, 20 trauma-exposed controls without PTSD (TEC) and 20 non-traumatized healthy controls (HC). Gray matter volume (GMV), amplitude of low-frequency fluctuations (ALFF), and regional homogeneity were extracted as classification features, and in order to integrate the information of structural and functional MRI data, the extracted features were combined by a multi-kernel combination strategy. Then a support vector machine (SVM) classifier was trained to distinguish the subjects at individual level. The performance of the classifier was evaluated using the leave-one-out cross-validation (LOOCV) method. In the pairwise comparison of PTSD, TEC, and HC groups, classification accuracies obtained by the proposed approach were 2.70, 2.50, and 2.71% higher than the best single feature way, with the accuracies of 89.19, 90.00, and 67.57% for PTSD vs. HC, TEC vs. HC, and PTSD vs. TEC respectively. The proposed approach could improve PTSD identification at individual level. Additionally, it provides preliminary support to develop the multimodal MRI method as a clinical diagnostic aid.

Detecting Neuroimaging Biomarkers for Psychiatric Disorders: Sample Size Matters

In a recent review, it was suggested that much larger cohorts are needed to prove the diagnostic value of neuroimaging biomarkers in psychiatry. While within a sample, an increase of diagnostic accuracy of schizophrenia (SZ) with number of subjects (N) has been shown, the relationship between N and accuracy is completely different between studies. Using data from a recent meta-analysis of machine learning (ML) in imaging SZ, we found that while low-N studies can reach 90% and higher accuracy, above N/2 = 50 the maximum accuracy achieved steadily drops to below 70% for N/2 > 150. We investigate the role N plays in the wide variability in accuracy results in SZ studies (63-97%). We hypothesize that the underlying cause of the decrease in accuracy with increasing N is sample heterogeneity. While smaller studies more easily include a homogeneous group of subjects (strict inclusion criteria are easily met; subjects live close to study site), larger studies inevitably need to relax the criteria/recruit from large geographic areas. A SZ prediction model based on a heterogeneous group of patients with presumably a heterogeneous pattern of structural or functional brain changes will not be able to capture the whole variety of changes, thus being limited to patterns shared by most patients. In addition to heterogeneity (sample size), we investigate other factors influencing accuracy and introduce a ML effect size. We derive a simple model of how the different factors, such as sample heterogeneity and study setup determine this ML effect size, and explain the variation in prediction accuracies found from the literature, both in cross-validation and independent sample testing. From this, we argue that smaller-N studies may reach high prediction accuracy at the cost of lower generalizability to other samples. Higher-N studies, on the other hand, will have more generalization power, but at the cost of lower accuracy. In conclusion, when comparing results from different ML studies, the sample sizes should be taken into account. To assess the generalizability of the models, validation (by direct application) of the prediction models should be tested in independent samples. The prediction of more complex measures such as outcome, which are expected to have an underlying pattern of more subtle brain abnormalities (lower effect size), will require large samples.

Structural correlates of formal thought disorder in schizophrenia: An ultra-high field multivariate morphometry study

BACKGROUND

Persistent formal thought disorder (FTD) is one of the most characteristic features of schizophrenia. Several neuroimaging studies report spatially distinct neuroanatomical changes in association with FTD. Given that most studies so far have employed a univariate localisation approach that obscures the study of covarying interregional relationships, the present study focussed on the multivariate systemic pattern of anatomical changes that contribute to FTD.

METHODS

Speech samples from nineteen medicated clinically stable schizophrenia patients and 20 healthy controls were evaluated for subtle formal thought disorder. Ultra high-field (7T) anatomical Magnetic Resonance Imaging scans were obtained from all subjects. Multivariate morphometric patterns were identified using an independent component approach (source based morphometry). Using multiple regression analysis, the morphometric patterns predicting positive and negative FTD scores were identified.

RESULTS

Morphometric variations in grey matter predicted a substantial portion of inter-individual variance in negative but not positive FTD. A pattern of concomitant striato-insular/precuneus reduction along with frontocingular grey matter increase had a significant association with negative FTD.

CONCLUSIONS

These results suggest that concomitant increase and decrease in grey matter occur in association with persistent negative thought disorder in clinically stable individuals with schizophrenia.

Voxel-based morphometry for separation of schizophrenia from other types of psychosis in first episode psychosis

BACKGROUND

Schizophrenia is a psychiatric disorder which involves distortions in thought and perception, blunted affect, and behavioural disturbances. The longer psychosis goes unnoticed and untreated, the more severe the repercussions for relapse and recovery. There is some evidence that early intervention services can help, and diagnostic techniques that could contribute to early intervention may offer clinical utility in these situations. The index test being evaluated in this review is the structural magnetic resonance imaging (MRI) analysis technique known as voxel-based morphometry (VBM) that estimates the distribution of grey matter tissue volume across several brain regions. This review is an exploratory examination of the diagnostic 'potential' of VBM for use as an additional tool in the clinical examination of patients with first episode psychosis to establish whether an individual will progress on to developing schizophrenia as opposed to other types of psychosis.

OBJECTIVES

To determine whether VBM applied to the brain can be used to differentiate schizophrenia from other types of psychosis in participants who have received a clinical diagnosis of first episode psychosis.

SEARCH METHODS

In December 2013, we updated a previous search (May 2012) of MEDLINE, EMBASE, and PsycInfo using OvidSP.

SELECTION CRITERIA

We included retrospective and prospective studies that consecutively or randomly selected adolescent and adult participants (< 45 years) with a first episode of psychosis; and that evaluated the diagnostic accuracy of VBM for differentiating schizophrenia from other psychoses compared with a clinical diagnosis made by a qualified mental health professional, with or without the use of standard operational criteria or symptom checklists. We excluded studies in children, and in adult participants with organic brain disorders or who were at high risk for schizophrenia, such as people with a genetic predisposition.

DATA COLLECTION AND ANALYSIS

Two review authors screened all references for inclusion. We assessed the quality of studies using the QUADAS-2 instrument. Due to a lack of data, we were not able to extract 2 x 2 data tables for each study nor undertake any meta-analysis.

MAIN RESULTS

We included four studies with a total of 275 participants with first episode psychosis. VBM was not used to diagnose schizophrenia in any of the studies, instead VBM was used to quantify the magnitude of differences in grey matter volume. Therefore, none of the included studies reported data that could be used in the analysis, and we summarised the findings narratively for each study.

AUTHORS' CONCLUSIONS

There is no evidence to currently support diagnosing schizophrenia (as opposed to other psychotic disorders) using the pattern of brain changes seen in VBM studies in patients with first episode psychosis. VBM has the potential to discriminate between diagnostic categories but the methods to do this reliably are currently in evolution. In addition, the lack of applicability of the use of VBM to clinical practice in the studies to date limits the usefulness of VBM as a diagnostic aid to differentiate schizophrenia from other types of psychotic presentations in people with first episode of psychosis.

From estimating activation locality to predicting disorder: A review of pattern recognition for neuroimaging-based psychiatric diagnostics

Psychiatric disorders are increasingly being recognised as having a biological basis, but their diagnosis is made exclusively behaviourally. A promising approach for 'biomarker' discovery has been based on pattern recognition methods applied to neuroimaging data, which could yield clinical utility in future. In this review we survey the literature on pattern recognition for making diagnostic predictions in psychiatric disorders, and evaluate progress made in translating such findings towards clinical application. We evaluate studies on many criteria, including data modalities used, the types of features extracted and algorithm applied. We identify problems common to many studies, such as a relatively small sample size and a primary focus on estimating generalisability within a single study. Furthermore, we highlight challenges that are not widely acknowledged in the field including the importance of accommodating disease prevalence, the necessity of more extensive validation using large carefully acquired samples, the need for methodological innovations to improve accuracy and to discriminate between multiple disorders simultaneously. Finally, we identify specific clinical contexts in which pattern recognition can add value in the short to medium term.

Overdiagnosis in the era of neuropsychiatric imaging

New guidelines proposed by the National Institute of Mental Health are intended to transform the management of patients with psychiatric disorders. It is anticipated that neuroimaging and other biomarkers will play a more prominent role in diagnosis and prognosis, especially in the prodromal phase of illness. Earlier treatment of psychiatric disorders has the potential to improve outcomes significantly. However, diagnosis in the absence of symptoms can lead to overdiagnosis. Overdiagnosis is a problem in many fields of medicine but could pose additional problems in psychiatry because of the stigmatization that often accompanies a diagnosis of mental illness. This review discusses the magnetic resonance imaging methods that hold the most promise for evaluating neuropsychiatric disorders, the likelihood that they could lead to overdiagnosis, and opportunities to minimize the impact of overdiagnosis in psychiatric disorders.

Combining various types of classifiers and features extracted from magnetic resonance imaging data in schizophrenia recognition

We investigated a combination of three classification algorithms, namely the modified maximum uncertainty linear discriminant analysis (mMLDA), the centroid method, and the average linkage, with three types of features extracted from three-dimensional T1-weighted magnetic resonance (MR) brain images, specifically MR intensities, grey matter densities, and local deformations for distinguishing 49 first episode schizophrenia male patients from 49 healthy male subjects. The feature sets were reduced using intersubject principal component analysis before classification. By combining the classifiers, we were able to obtain slightly improved results when compared with single classifiers. The best classification performance (81.6% accuracy, 75.5% sensitivity, and 87.8% specificity) was significantly better than classification by chance. We also showed that classifiers based on features calculated using more computation-intensive image preprocessing perform better; mMLDA with classification boundary calculated as weighted mean discriminative scores of the groups had improved sensitivity but similar accuracy compared to the original MLDA; reducing a number of eigenvectors during data reduction did not always lead to higher classification accuracy, since noise as well as the signal important for classification were removed. Our findings provide important information for schizophrenia research and may improve accuracy of computer-aided diagnostics of neuropsychiatric diseases.

Diagnostic classification of schizophrenia patients on the basis of regional reward-related FMRI signal patterns

Functional neuroimaging has provided evidence for altered function of mesolimbic circuits implicated in reward processing, first and foremost the ventral striatum, in patients with schizophrenia. While such findings based on significant group differences in brain activations can provide important insights into the pathomechanisms of mental disorders, the use of neuroimaging results from standard univariate statistical analysis for individual diagnosis has proven difficult. In this proof of concept study, we tested whether the predictive accuracy for the diagnostic classification of schizophrenia patients vs. healthy controls could be improved using multivariate pattern analysis (MVPA) of regional functional magnetic resonance imaging (fMRI) activation patterns for the anticipation of monetary reward. With a searchlight MVPA approach using support vector machine classification, we found that the diagnostic category could be predicted from local activation patterns in frontal, temporal, occipital and midbrain regions, with a maximal cluster peak classification accuracy of 93% for the right pallidum. Region-of-interest based MVPA for the ventral striatum achieved a maximal cluster peak accuracy of 88%, whereas the classification accuracy on the basis of standard univariate analysis reached only 75%. Moreover, using support vector regression we could additionally predict the severity of negative symptoms from ventral striatal activation patterns. These results show that MVPA can be used to substantially increase the accuracy of diagnostic classification on the basis of task-related fMRI signal patterns in a regionally specific way.