1
|
Reading the (functional) writing on the (structural) wall: Multimodal fusion of brain structure and function via a deep neural network based translation approach reveals novel impairments in schizophrenia. Neuroimage 2018; 181:734-747. [PMID: 30055372 DOI: 10.1016/j.neuroimage.2018.07.047] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2017] [Revised: 07/16/2018] [Accepted: 07/18/2018] [Indexed: 01/01/2023] Open
Abstract
This work presents a novel approach to finding linkage/association between multimodal brain imaging data, such as structural MRI (sMRI) and functional MRI (fMRI). Motivated by the machine translation domain, we employ a deep learning model, and consider two different imaging views of the same brain like two different languages conveying some common facts. That analogy enables finding linkages between two modalities. The proposed translation-based fusion model contains a computing layer that learns "alignments" (or links) between dynamic connectivity features from fMRI data and static gray matter patterns from sMRI data. The approach is evaluated on a multi-site dataset consisting of eyes-closed resting state imaging data collected from 298 subjects (age- and gender matched 154 healthy controls and 144 patients with schizophrenia). Results are further confirmed on an independent dataset consisting of eyes-open resting state imaging data from 189 subjects (age- and gender matched 91 healthy controls and 98 patients with schizophrenia). We used dynamic functional connectivity (dFNC) states as the functional features and ICA-based sources from gray matter densities as the structural features. The dFNC states characterized by weakly correlated intrinsic connectivity networks (ICNs) were found to have stronger association with putamen and insular gray matter pattern, while the dFNC states of profuse strongly correlated ICNs exhibited stronger links with the gray matter pattern in precuneus, posterior cingulate cortex (PCC), and temporal cortex. Further investigation with the estimated link strength (or alignment score) showed significant group differences between healthy controls and patients with schizophrenia in several key regions including temporal lobe, and linked these to connectivity states showing less occupancy in healthy controls. Moreover, this novel approach revealed significant correlation between a cognitive score (attention/vigilance) and the function/structure alignment score that was not detected when data modalities were considered separately.
Collapse
|
2
|
The potential of nicotinic enhancement of cognitive remediation training in schizophrenia. Neuropharmacology 2013; 64:185-90. [DOI: 10.1016/j.neuropharm.2012.05.050] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2012] [Revised: 05/29/2012] [Accepted: 05/31/2012] [Indexed: 02/04/2023]
|
3
|
Hahn B, Robinson BM, Kaiser ST, Matveeva TM, Harvey AN, Luck SJ, Gold JM. Kraepelin and Bleuler had it right: people with schizophrenia have deficits sustaining attention over time. JOURNAL OF ABNORMAL PSYCHOLOGY 2012; 121:641-8. [PMID: 22686867 DOI: 10.1037/a0028492] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
An inability to sustain attention was noted in the original clinical descriptions of schizophrenia, but the vast majority of experimental studies have failed to report a performance decrement over time, calling this observation into question. To test for such deficits when task conditions conform to basic science taxonomy for the validity of sustained attention tasks, a dynamic stimulus array was presented in which targets, differing subtly from standard stimuli, were presented infrequently and unpredictably. Both people with schizophrenia (PSZ, n=40) and healthy control subjects (HCS, n=29) displayed a reduction in hit rate and an increase in reaction time (RT) from the first to the second 5-min period. Thereafter, the hit rate of HCS recovered and remained stable, while that of PSZ continued to decline. When performance at task onset was equated between groups, the decrement over time in PSZ remained of the same robust magnitude. Thus, when the nature of the task challenges sustaining attention over time, PSZ display a clear deficit in this ability.
Collapse
Affiliation(s)
- Britta Hahn
- Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore, MD 21228, USA.
| | | | | | | | | | | | | |
Collapse
|
4
|
Abstract
AbstractN-methyl-d-aspartate receptor (NMDAR) dysfunction plays a crucial role in schizophrenia, leading to impairments in cognitive coordination. NMDAR agonists (e.g., glycine) ameliorate negative and cognitive symptoms, consistent with NMDAR models. However, not all types of cognitive coordination use NMDAR. Further, not all aspects of cognitive coordination are impaired in schizophrenia, suggesting the need for specificity in applying the cognitive coordination construct.
Collapse
|
5
|
Abstract
AbstractPhillips & Silverstein's focus on schizophrenia as a failure of “cognitive coordination” is welcome. They note that a simple hypothesis of reduced Gamma synchronisation subserving impaired coordination does not fully account for recent observations. We suggest that schizophrenia reflects a dynamic compensation to a core deficit of coordination, expressed either as hyper- or hyposynchronisation, with neurotransmitter systems and arousal as modulatory mechanisms.
Collapse
|
6
|
Abstract
AbstractNumerous searches have failed to identify a single co-occurrence of total blindness and schizophrenia. Evidence that blindness causes loss of certain NMDA-receptor functions is balanced by reports of compensatory gains. Connections between visual and anterior cingulate NMDA-receptor systems may help to explain how blindness could protect against schizophrenia.
Collapse
|
7
|
Setting domain boundaries for convergence of biological and psychological perspectives on cognitive coordination in schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x0328002x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
AbstractThe claim that the disorganized subtype of schizophrenia results from glutamate hypofunction is enhanced by consideration of current subtypology of schizophrenia, symptom definition, interdependence of neurotransmitters, and the nature of the data needed to support the hypothesis. Careful specification clarifies the clinical reality of disorganization as a feature of schizophrenia and increases the utility of the subtype.
Collapse
|
8
|
Abstract
AbstractAlthough context-processing deficits may be core features of schizophrenia, context remains a poorly defined concept. To test Phillips & Silverstein's model, we need to operationalize context more precisely. We offer several useful ways of framing context and discuss enhancing or facilitating schizophrenic patients' performance under different contextual situations. Furthermore, creativity may be a byproduct of cognitive uncoordination.
Collapse
|
9
|
Abstract
AbstractImpairments in cognitive coordination in schizophrenia are supported by phenomenological data that suggest deficits in the processing of visual context. Although the target article is sympathetic to such a phenomenological perspective, we argue that the relevance of phenomenological data for a wider understanding of consciousness in schizophrenia is not sufficiently addressed by the authors.
Collapse
|
10
|
Guarding against over-inclusive notions of “context”: Psycholinguistic and electrophysiological studies of specific context functions in schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03470027] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractPhillips & Silverstein offer an exciting synthesis of ongoing efforts to link the clinical and cognitive manifestations of schizophrenia with cellular accounts of its pathophysiology. We applaud their efforts but wonder whether the highly inclusive notion of “context” adequately captures some important details regarding schizophrenia and NMDA/glutamate function that are suggested by work on language processing and cognitive electrophysiology.
Collapse
|
11
|
Abstract
AbstractMechanisms that contribute to perceptual processing dysfunction in schizophrenia were examined by Phillips & Silverstein, and formulated as involving disruptions in both local and higher-level coordination of signals. We agree that dysfunction in the coordination of cognitive functions (disconnection) is also indicated for many of the linguistic processing deficits documented for schizophrenia. We suggest, however, that it may be necessary to add a timing mechanism to the theoretical account.
Collapse
|
12
|
Abstract
AbstractSchizophrenics exhibit a deficit in theory of mind (ToM), but an intact theory of biology (ToB). One explanation is that ToM relies on an independent module that is selectively damaged. Phillips & Silverstein's analyses suggest an alternative: ToM requires the type of coordination that is impaired in schizophrenia, whereas ToB is spared because this type of coordination is not involved.
Collapse
|
13
|
Abstract
AbstractThe additional arguments and evidence supplied by the commentaries strengthen the hypothesis that underactivity of NMDA receptors produces impaired cognitive coordination in schizophrenia. This encourages the hope that though the distance from molecules to mind is great, it can nevertheless be traversed. We therefore predict that in this decade or the next molecular psychology will be seen to be as fundamental to our understanding of mind as molecular biology is to our understanding of life.
Collapse
|
14
|
Abstract
AbstractIt is proposed that cortical activity is normally coordinated across synaptically connected areas and that this coordination supports cognitive coherence relations. This view is consistent with the NMDA- hypoactivity hypothesis of the target article in regarding disorganization symptoms in schizophrenia as arising from disruption of normal interareal coordination. This disruption may produce abnormal contextual effects in the cortex that lead to anomalous cognitive coherence relations.
Collapse
|
15
|
Abstract
AbstractThis commentary compares clinical aspects of ketamine with the amphetamine model of schizophrenia. Hallucinations and loss of insight, associated with amphetamine, seem more schizophrenia-like. Flat affect encountered with ketamine is closer to the clinical presentation in schizophrenia. We argue that flat affect is not a sign of schizophrenia, but rather, arisk factorfor chronic schizophrenia.
Collapse
|
16
|
Cortical connectivity in high-frequency beta-rhythm in schizophrenics with positive and negative symptoms. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03440028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
AbstractIn chronic schizophrenic patients with both positive and negative symptoms (see Table 1), interhemispheric connections at the high frequency beta2-rhythm are absent during cognitive tasks, in contrast to normal controls, who have many interhemispheric connections at this frequency in the same situation. Connectivity is a fundamental brain feature, evidently greatly promoted by the NMDA system. It is a more reliable measure of brain function than the spectral power of this rhythm.
Collapse
|
17
|
Where the rubber meets the road: The importance of implementation. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03230028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractPhillips & Silverstein argue that a range of cognitive disturbances in schizophrenia result from a deficit in cognitive coordination attributable to NMDA receptor dysfunction. We suggest that the viability of this hypothesis would be further supported by explicit implementation in a computational framework that can produce quantitative estimates of the behavior of both healthy individuals and individuals with schizophrenia.
Collapse
|
18
|
Context, connection, and coordination: The need to switch. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03370025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractContext, connection, and coordination (CCC) describe well where the problems that apply to thought-disordered patients with schizophrenia lie. But they may be part of the experience of those with other symptom constellations. Switching is an important mechanism to allow context to be applied appropriately to changing circumstances. In some cases, NMDA-voltage modulations may be central, but gain and shift are also functions that monoaminergic systems express in CCC.
Collapse
|
19
|
Synchronous dynamics for cognitive coordination: But how? Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03450024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractAlthough interesting, the hypotheses proposed by Phillips & Silverstein lack unifying structure both in specific mechanisms and in cited evidence. They provide little to support the notion that low-level sensory processing and high-level cognitive coordination share dynamic grouping by synchrony as a common processing mechanism. We suggest that more realistic large-scale modeling at multiple levels is needed to address these issues.
Collapse
|
20
|
A wide-spectrum coordination model of schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03240024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractThe target article presents a model for schizophrenia extending four levels of abstraction: molecules, cells, cognition, and syndrome. An important notion in the model is that of coordination, applicable to both the level of cells and of cognition. The molecular level provides an “implementation” of the coordination at the cellular level, which in turn underlies the coordination at the cognitive level, giving rise to the clinical symptoms.
Collapse
|
21
|
Abstract
AbstractTo understand schizophrenia, a linking hypothesis is needed that shows how brain mechanisms lead to behavioral functions in normals, and also how breakdowns in these mechanisms lead to behavioral symptoms of schizophrenia. Such a linking hypothesis is now available that complements the discussion offered by Phillips & Silverstein (P&S).
Collapse
|
22
|
Spatial integration in perception and cognition: An empirical approach to the pathophysiology of schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03260027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractEvidence for a dysfunction in cognitive coordination in schizophrenia is emerging, but it is not specific enough to prove (or disprove) this long-standing hypothesis. Many aspects of the external world are spatially mapped in the brain. A comprehensive internal representation relies on integration of information across space. Focus on spatial integration in the perceptual and cognitive processes will generate empirical data that shed light on the pathophysiology of schizophrenia.
Collapse
|
23
|
Inferring contextual field interactions from scalp EEG. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03390028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractThis commentary highlights methods for using scalp EEG to make inferences about contextual field interactions, which, in view of the target article, may be specially relevant to the study of schizophrenia. Although scalp EEG has limited spatial resolution, prior knowledge combined with experimental manipulations may be used to strengthen inferences about underlying brain processes. Both spatial and temporal context are discussed within the framework of nonlinear interactions. Finally, results from a visual contour integration EEG pilot study are summarized in view of a hypothesis that relates receptive field and contextual field processing to evoked and induced activity, respectively.
Collapse
|
24
|
Reconciling schizophrenic deficits in top-down and bottom-up processes: Not yet. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03360029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractThis commentary challenges the authors to use their computational modeling techniques to support one of their central claims: that schizophrenic deficits in bottom-up (Gestalt-type tasks) and top-down (cognitive control tasks) context processing tasks arise from the same dysfunction. Further clarification about the limits of cognitive coordination would also strengthen the hypothesis.
Collapse
|
25
|
Cognitive coordination deficits: A necessary but not sufficient factor in the development of schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03290026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractThe Phillips & Silverstein model of NMDA-mediated coordination deficits provides a useful heuristic for the study of schizophrenic cognition. However, the model does not specifically account for the development of schizophrenia-spectrum disorders. The P&S model is compared to Meehl's seminal model of schizotaxia, schizotypy, and schizophrenia, as well as the model of schizophrenic cognitive dysfunction posited by McCarley and colleagues.
Collapse
|
26
|
NMDA-receptor hypofunction versus excessive synaptic elimination as models of schizophrenia. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03320023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractWe propose that the primary cause of schizophrenia is a pathological extension of synaptic pruning involving local connectivity that unfolds ordinarily during adolescence. Computer simulations suggest that this pathology provides reasonable accounts of a range of symptoms in schizophrenia, and is consistent with recent postmortem and genetic studies. NMDA-receptors play a regulatory role in maintaining and/or eliminating cortical synapses, and therefore may play a pathophysiological role.
Collapse
|
27
|
Is sensory gating a form of cognitive coordination? Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03340026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractNeurophysiological investigations of the past two decades have consistently demonstrated a deficit in sensory gating associated with schizophrenia. Phillips & Silverstein interpret this impairment as being consistent with cognitive coordination dysfunction. However, the physiological mechanisms that underlie sensory gating have not been shown to involve gamma-band oscillations or NMDA-receptors, both of which are critical neural elements in the cognitive coordination model.
Collapse
|
28
|
Why do schizophrenic patients hallucinate? Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03410029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractPhillips & Silverstein argue that schizophrenia is a result of a deficit of the contextual coordination of neuronal responses. The authors propose that NMDA-receptors control these modulatory effects. However, hallucinations, which are among the principle symptoms of schizophrenia, imply a flaw in the interactions between neurons that is more fundamental than just a general weakness of contextual modulation.
Collapse
|
29
|
Schizophrenic cognition: Taken out of context? Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03310027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
AbstractThis commentary addresses: (a) the problems of definition which have been prominent in the use of the term context in schizophrenia research; (b) potentially useful distinctions and links with other theories of schizophrenic cognition; and (c) possible pathways to schizophrenic symptoms. It is suggested that at least two major aspects of the operation of context may be distinguished and that both may be impaired in schizophrenia.
Collapse
|
30
|
NMDA synapses can bias competition between object representations and mediate attentional selection. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03400022] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
AbstractPhillips & Silverstein emphasize the gain-control properties of NMDA synapses in cognitive coordination. We endorse their view and suggest that NMDA synapses play a crucial role in biased attentional competition and (visual) working memory. Our simulations show that NMDA synapses can control the storage rate of visual objects. We discuss specific predictions of our model about cognitive effects of NMDA-antagonists and schizophrenia.
Collapse
|
31
|
Combating fuzziness with computational modeling. Behav Brain Sci 2003. [DOI: 10.1017/s0140525x03460020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractPhillips & Silverstein's ambitious link between receptor abnormalities and the symptoms of schizophrenia involves a certain amount of fuzziness: No detailed mechanism is suggested through which the proposed abnormality would lead to psychological traits. We propose that detailed simulation of brain regions, using model neural networks, can aid in understanding the relation between biological abnormality and psychological dysfunction in schizophrenia.
Collapse
|