1
|
Hancock LM, Rao SM, Galioto R. Neuropsychological Manifestations of Multiple Sclerosis. Neurol Clin 2024; 42:835-847. [PMID: 39343478 DOI: 10.1016/j.ncl.2024.05.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/01/2024]
Abstract
This review article summarizes the literature on the cognitive impairment seen amongst people with multiple sclerosis (MS) and how that impairment can impact not only their lives but also how their care needs to be managed. Recommendations regarding screening and monitoring of cognitive issues are reviewed, as well as how common comorbidities can further impact cognition. The current literature with respect to treatment options is also summarized. Finally, the article reviews the literature on some special populations living with MS.
Collapse
Affiliation(s)
- Laura M Hancock
- Center for General Neurology, Neurological Institute, Cleveland Clinic, 9500 Euclid Avenue, S31, Cleveland, OH 44195, USA.
| | - Stephen M Rao
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic, 9500 Euclid Avenue, U10, Cleveland, OH 44195, USA
| | - Rachel Galioto
- Mellen Center for Multiple Sclerosis, Neurological Institute, Cleveland Clinic, 9500 Euclid Avenue, U10, Cleveland, OH 44195, USA
| |
Collapse
|
2
|
Nabizadeh F, Pirahesh K, Azami M, Moradkhani A, Sardaripour A, Ramezannezhad E. T1 and T2 weighted lesions and cognition in multiple Sclerosis: A systematic review and meta-analysis. J Clin Neurosci 2024; 119:1-7. [PMID: 37952373 DOI: 10.1016/j.jocn.2023.11.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 11/01/2023] [Accepted: 11/07/2023] [Indexed: 11/14/2023]
Abstract
BACKGROUND Considering the different results regarding the correlation between Magnetic Resonance Imaging (MRI) structural measures and cognitive dysfunction in patients with MS, we aimed to perform a systematic review and meta-analysis study to investigate the correlation between T1 and T2 weighted lesions and cognitive scores to find the most robust MRI markers for cognitive function in MS population. METHODS The literature of this paper was identified through a comprehensive search of electronic datasets including PubMed, Scopus, Web of Science, and Embase in February 2022. Studies that reported the correlation between cognitive status and T1 and T2 weighted lesions in MS patients were selected. RESULTS 21 studies with a total of 3771 MS patients with mean ages ranging from 30 to 57 years were entered into our study. Our analysis revealed that the volume of T1 lesions was significantly correlated with Symbol Digit Modality test (SDMT) (r: -0.30, 95 %CI: -0.59, -0.01) and Paced Auditory Serial-Addition Task (PASAT) scores (r: -0.23, 95 %CI: -0.36, -0.10). We investigated the correlation between T2 lesions and cognitive scores. The pooled estimates of z scores were significant for SDMT (r: -0.27, 95 %CI: -0.51, -0.03) and PASAT (r: -0.27, 95 %CI: -0.41, -0.13). CONCLUSION In conclusion, our systematic review and meta-analysis study provides strong evidence of the correlation between T1 and T2 lesions and cognitive function in MS patients. Further research is needed to explore the potential mechanisms underlying this relationship and to develop targeted interventions to improve cognitive outcomes in MS patients.
Collapse
Affiliation(s)
- Fardin Nabizadeh
- School of Medicine, Iran University of Medical Sciences, Tehran, Iran; School of Medicine, Tehran University of Medical Science, Tehran, Iran.
| | - Kasra Pirahesh
- Student Research Committee, School of Medicine, Kurdistan University of Medical Science, Sanandaj, Iran
| | - Mobin Azami
- Student Research Committee, School of Medicine, Shahid Beheshti University of Medical Science, Tehran, Iran
| | - Asra Moradkhani
- Student Research Committee, School of Medicine, Shahid Beheshti University of Medical Science, Tehran, Iran
| | | | | |
Collapse
|
3
|
Elkhooly M, Bao F, Raghib M, Millis S, Bernitsas E. Role of white matter in cognitive impairment among relapsing remitting multiple sclerosis patients. Mult Scler Relat Disord 2023; 79:105030. [PMID: 37837669 DOI: 10.1016/j.msard.2023.105030] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 08/14/2023] [Accepted: 09/23/2023] [Indexed: 10/16/2023]
Abstract
BACKGROUND Multiple Sclerosis (MS) associated cognitive impairment is believed to be mostly connected with damage to gray matter. The contribution of white matter is still poorly understood. We aim to examine the relationship between cognition and white matter tracts among relapsing remitting MS (RRMS) patients. METHODS Thirty RRMS patients were selected undergo the (3-seconds-interstimulus-interval paced auditory serial addition test) PASAT-3, the (symbol digit modalities test (SDMT) and full-brain MRI scans on a SIEMENS 3 Tesla Verio scanner. Diffusion Tensor Imaging (DTI) parameters, such as fractional anisotropy (FA) and mean diffusivity (MD) were examined in 37 white matter (WM) tracts. WM tracts were selected from the association pathways, projection pathways, commissural pathways by applying Human Connectome project (HCP)842 tractography atlas after DTI data reconstruction and registration to HCP1065 diffusion template in DSI Studio (version March 2021) In SPSS v26, Spearman's rank correlation analysis was used to examine the connection between DTI WM tracts and cognitive scores. The power of the study was increased by using false discovery rate (FDR) software. RESULTS The mean scores on the PASAT-3 and SDMT were 31.5 ± 12.8 and 46.9 ± 16.7 respectively. Better cognitive performance was correlated to higher FA values, while lower cognitive function was correlated to higher MD values. There was a positive correlation between FA values in the right medial lemniscus and superior cerebellar peduncle and SDMT scores (p 0.05). Additionally, there was a trend for significance between the FA values in the left corticothalamic tract and SDMT scores. MD values in the superior cerebellar peduncle, left arcuate Fasciculus and left extreme capsule were negatively correlated with SDMT scores (p<0.05). PASAT-3 scores were negatively correlated with MD values in the right cerebellum, however, there was no significant correlation between PASAT-3 and FA values. CONCLUSIONS White matter tracts, particularly the superior cerebellar peduncle, contribute to the cognitive impairment in RRMS. Larger sample sizes for longitudinal research are necessary.
Collapse
Affiliation(s)
- Mahmoud Elkhooly
- Neurology Department, Wayne State University, Detroit, MI 48201, USA; Department of Neurology and Psychiatry, Minia University, Minia, Egypt
| | - Fen Bao
- Neurology Department, Wayne State University, Detroit, MI 48201, USA
| | - Muhammad Raghib
- Neurology Department, Wayne State University, Detroit, MI 48201, USA
| | - Scott Millis
- Neurology Department, Wayne State University, Detroit, MI 48201, USA
| | | |
Collapse
|
4
|
Spain RI, Hildebrand A, Waslo CS, Rooney WD, Emmons J, Schwartz DL, Freedman MS, Paz Soldan MM, Repovic P, Solomon AJ, Rinker J, Wallin M, Haselkorn JK, Stuve O, Gross RH, Turner AP. Processing speed and memory test performance are associated with different brain region volumes in Veterans and others with progressive multiple sclerosis. Front Neurol 2023; 14:1188124. [PMID: 37360346 PMCID: PMC10285490 DOI: 10.3389/fneur.2023.1188124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 05/09/2023] [Indexed: 06/28/2023] Open
Abstract
Background Cognitive dysfunction and brain atrophy are both common in progressive multiple sclerosis (MS) but are seldom examined comprehensively in clinical trials. Antioxidant treatment may affect the neurodegeneration characteristic of progressive MS and slow its symptomatic and radiographic correlates. Objectives This study aims to evaluate cross-sectional associations between cognitive battery components of the Brief International Cognitive Assessment for Multiple Sclerosis with whole and segmented brain volumes and to determine if associations differ between secondary progressive (SPMS) and primary progressive (PPMS) MS subtypes. Design The study was based on a baseline analysis from a multi-site randomized controlled trial of the antioxidant lipoic acid in veterans and other people with progressive MS (NCT03161028). Methods Cognitive batteries were conducted by trained research personnel. MRIs were processed at a central processing site for maximum harmonization. Semi-partial Pearson's adjustments evaluated associations between cognitive tests and MRI volumes. Regression analyses evaluated differences in association patterns between SPMS and PPMS cohorts. Results Of the 114 participants, 70% had SPMS. Veterans with MS made up 26% (n = 30) of the total sample and 73% had SPMS. Participants had a mean age of 59.2 and sd 8.5 years, and 54% of them were women, had a disease duration of 22.4 (sd 11.3) years, and had a median Expanded Disability Status Scale of 6.0 (with an interquartile range of 4.0-6.0, moderate disability). The Symbol Digit Modalities Test (processing speed) correlated with whole brain volume (R = 0.29, p = 0.01) and total white matter volume (R = 0.33, p < 0.01). Both the California Verbal Learning Test (verbal memory) and Brief Visuospatial Memory Test-Revised (visual memory) correlated with mean cortical thickness (R = 0.27, p = 0.02 and R = 0.35, p < 0.01, respectively). Correlation patterns were similar in subgroup analyses. Conclusion Brain volumes showed differing patterns of correlation across cognitive tasks in progressive MS. Similar results between SPMS and PPMS cohorts suggest combining progressive MS subtypes in studies involving cognition and brain atrophy in these populations. Longitudinal assessment will determine the therapeutic effects of lipoic acid on cognitive tasks, brain atrophy, and their associations.
Collapse
Affiliation(s)
- Rebecca I. Spain
- Department of Veterans Affairs Portland Health Care System, Portland, OR, United States
- Neurology, Oregon Health & Science University, Portland, OR, United States
| | - Andrea Hildebrand
- Biostatistics and Design Program, Oregon Health & Science University/Portland State University School of Public Health, Portland, OR, United States
| | - Carin S. Waslo
- Department of Veterans Affairs Portland Health Care System, Portland, OR, United States
| | - William D. Rooney
- Advanced Imaging Research Center, Oregon Health & Science University, Portland, OR, United States
| | - Joshua Emmons
- Advanced Imaging Research Center, Oregon Health & Science University, Portland, OR, United States
| | - Daniel L. Schwartz
- Neurology, Oregon Health & Science University, Portland, OR, United States
- Advanced Imaging Research Center, Oregon Health & Science University, Portland, OR, United States
| | - Mark S. Freedman
- Department of Medicine, University of Ottawa and the Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - M. Mateo Paz Soldan
- Department of Veterans Affairs, Salt Lake City Health Care System, Salt Lake City, UT, United States
- Neurology, University of Utah, Salt Lake City, UT, United States
| | - Pavle Repovic
- Neurology, Swedish Medical Center, Seattle, WA, United States
| | - Andrew J. Solomon
- Lerner College of Medicine at the University of Vermont, Burlington, VT, United States
| | - John Rinker
- Neurology, University of Alabama at Birmingham, Birmingham, AL, United States
| | - Mitchell Wallin
- Department of Veterans Affairs Washington DC Medical Center, Washington, DC, United States
- University of Maryland School of Medicine, Baltimore, MD, United States
| | - Jodie K. Haselkorn
- Department of Veterans Affairs, Puget Sound Health Care System, Seattle, WA, United States
- Rehabilitation Medicine & Epidemiology, University of Washington, Seattle, WA, United States
| | - Olaf Stuve
- Department of Veterans Affairs North Texas Health Care System-Dallas, Dallas, TX, United States
- Neurology, University of Texas Southwestern Medical Center, Dallas, TX, United States
- Peter O'Donnell Brain Institute, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Robert H. Gross
- Neurology, University of Colorado Anschutz Medical Campus, Aurora, CO, United States
| | - Aaron P. Turner
- Department of Veterans Affairs, Puget Sound Health Care System, Seattle, WA, United States
- Rehabilitation Medicine & Epidemiology, University of Washington, Seattle, WA, United States
| |
Collapse
|
5
|
Chitnis T, Vandercappellen J, King M, Brichetto G. Symptom Interconnectivity in Multiple Sclerosis: A Narrative Review of Potential Underlying Biological Disease Processes. Neurol Ther 2022; 11:1043-1070. [PMID: 35680693 PMCID: PMC9338216 DOI: 10.1007/s40120-022-00368-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 05/16/2022] [Indexed: 11/18/2022] Open
Abstract
Introduction Fatigue, cognitive impairment, depression, and pain are highly prevalent symptoms in multiple sclerosis (MS). These often co-occur and may be explained by a common etiology. By reviewing existing literature, we aimed to identify potential underlying biological processes implicated in the interconnectivity between these symptoms. Methods A literature search was conducted to identify articles reporting research into the biological mechanisms responsible for the manifestation of fatigue, cognitive impairment, depression, and pain in MS. PubMed was used to search for articles published from July 2011 to July 2021. We reviewed and assessed findings from the literature to identify biological processes common to the symptoms of interest. Results Of 693 articles identified from the search, 252 were selected following screening of titles and abstracts and assessing reference lists of review articles. Four biological processes linked with two or more of the symptoms of interest were frequently identified from the literature: (1) direct neuroanatomical changes to brain regions linked with symptoms of interest (e.g., thalamic injury associated with cognitive impairment, fatigue, and depression), (2) pro-inflammatory cytokines associated with so-called ‘sickness behavior,’ including manifestation of fatigue, transient cognitive impairment, depression, and pain, (3) dysregulation of monoaminergic pathways leading to depressive symptoms and fatigue, and (4) hyperactivity of the hypothalamic–pituitary-adrenal (HPA) axis as a result of pro-inflammatory cytokines promoting the release of brain noradrenaline, serotonin, and tryptophan, which is associated with symptoms of depression and cognitive impairment. Conclusion The co-occurrence of fatigue, cognitive impairment, depression, and pain in MS appears to be associated with a common set of etiological factors, namely neuroanatomical changes, pro-inflammatory cytokines, dysregulation of monoaminergic pathways, and a hyperactive HPA axis. This association of symptoms and biological processes has important implications for disease management strategies and, eventually, could help find a common therapeutic pathway that will impact both inflammation and neuroprotection. Supplementary Information The online version contains supplementary material available at 10.1007/s40120-022-00368-2.
Collapse
Affiliation(s)
- Tanuja Chitnis
- Department of Neurology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA.
| | | | - Miriam King
- Novartis Pharma AG, Fabrikstrasse 12-2, 4056, Basel, Switzerland
| | - Giampaolo Brichetto
- Associazione Italiana Sclerosi Multipla Rehabilitation Center, Via Operai, 30, 16149, Genoa, GE, Italy
| |
Collapse
|
6
|
York EN, Thrippleton MJ, Meijboom R, Hunt DPJ, Waldman AD. Quantitative magnetization transfer imaging in relapsing-remitting multiple sclerosis: a systematic review and meta-analysis. Brain Commun 2022; 4:fcac088. [PMID: 35652121 PMCID: PMC9149789 DOI: 10.1093/braincomms/fcac088] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 12/17/2021] [Accepted: 03/31/2022] [Indexed: 11/28/2022] Open
Abstract
Myelin-sensitive MRI such as magnetization transfer imaging has been widely used in multiple sclerosis. The influence of methodology and differences in disease subtype on imaging findings is, however, not well established. Here, we systematically review magnetization transfer brain imaging findings in relapsing-remitting multiple sclerosis. We examine how methodological differences, disease effects and their interaction influence magnetization transfer imaging measures. Articles published before 06/01/2021 were retrieved from online databases (PubMed, EMBASE and Web of Science) with search terms including 'magnetization transfer' and 'brain' for systematic review, according to a pre-defined protocol. Only studies that used human in vivo quantitative magnetization transfer imaging in adults with relapsing-remitting multiple sclerosis (with or without healthy controls) were included. Additional data from relapsing-remitting multiple sclerosis subjects acquired in other studies comprising mixed disease subtypes were included in meta-analyses. Data including sample size, MRI acquisition protocol parameters, treatments and clinical findings were extracted and qualitatively synthesized. Where possible, effect sizes were calculated for meta-analyses to determine magnetization transfer (i) differences between patients and healthy controls; (ii) longitudinal change and (iii) relationships with clinical disability in relapsing-remitting multiple sclerosis. Eighty-six studies met inclusion criteria. MRI acquisition parameters varied widely, and were also underreported. The majority of studies examined the magnetization transfer ratio in white matter, but magnetization transfer metrics, brain regions examined and results were heterogeneous. The analysis demonstrated a risk of bias due to selective reporting and small sample sizes. The pooled random-effects meta-analysis across all brain compartments revealed magnetization transfer ratio was 1.17 per cent units (95% CI -1.42 to -0.91) lower in relapsing-remitting multiple sclerosis than healthy controls (z-value: -8.99, P < 0.001, 46 studies). Linear mixed-model analysis did not show a significant longitudinal change in magnetization transfer ratio across all brain regions [β = 0.12 (-0.56 to 0.80), t-value = 0.35, P = 0.724, 14 studies] or normal-appearing white matter alone [β = 0.037 (-0.14 to 0.22), t-value = 0.41, P = 0.68, eight studies]. There was a significant negative association between the magnetization transfer ratio and clinical disability, as assessed by the Expanded Disability Status Scale [r = -0.32 (95% CI -0.46 to -0.17); z-value = -4.33, P < 0.001, 13 studies]. Evidence suggests that magnetization transfer imaging metrics are sensitive to pathological brain changes in relapsing-remitting multiple sclerosis, although effect sizes were small in comparison to inter-study variability. Recommendations include: better harmonized magnetization transfer acquisition protocols with detailed methodological reporting standards; larger, well-phenotyped cohorts, including healthy controls; and, further exploration of techniques such as magnetization transfer saturation or inhomogeneous magnetization transfer ratio.
Collapse
Affiliation(s)
- Elizabeth N. York
- Centre for Clinical Brain Sciences, University of
Edinburgh, Edinburgh, UK
| | | | - Rozanna Meijboom
- Centre for Clinical Brain Sciences, University of
Edinburgh, Edinburgh, UK
| | - David P. J. Hunt
- Centre for Clinical Brain Sciences, University of
Edinburgh, Edinburgh, UK
- UK Dementia Research Institute, University of
Edinburgh, Edinburgh, UK
- Anne Rowling Regenerative Neurology Clinic,
University of Edinburgh, Edinburgh, UK
| | - Adam D. Waldman
- Centre for Clinical Brain Sciences, University of
Edinburgh, Edinburgh, UK
- UK Dementia Research Institute, University of
Edinburgh, Edinburgh, UK
| |
Collapse
|
7
|
Mollison D, Sellar R, Bastin M, Mollison D, Chandran S, Wardlaw J, Connick P. The clinico-radiological paradox of cognitive function and MRI burden of white matter lesions in people with multiple sclerosis: A systematic review and meta-analysis. PLoS One 2017; 12:e0177727. [PMID: 28505177 PMCID: PMC5432109 DOI: 10.1371/journal.pone.0177727] [Citation(s) in RCA: 53] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2017] [Accepted: 05/02/2017] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND Moderate correlation exists between the imaging quantification of brain white matter lesions and cognitive performance in people with multiple sclerosis (MS). This may reflect the greater importance of other features, including subvisible pathology, or methodological limitations of the primary literature. OBJECTIVES To summarise the cognitive clinico-radiological paradox and explore the potential methodological factors that could influence the assessment of this relationship. METHODS Systematic review and meta-analysis of primary research relating cognitive function to white matter lesion burden. RESULTS Fifty papers met eligibility criteria for review, and meta-analysis of overall results was possible in thirty-two (2050 participants). Aggregate correlation between cognition and T2 lesion burden was r = -0.30 (95% confidence interval: -0.34, -0.26). Wide methodological variability was seen, particularly related to key factors in the cognitive data capture and image analysis techniques. CONCLUSIONS Resolving the persistent clinico-radiological paradox will likely require simultaneous evaluation of multiple components of the complex pathology using optimum measurement techniques for both cognitive and MRI feature quantification. We recommend a consensus initiative to support common standards for image analysis in MS, enabling benchmarking while also supporting ongoing innovation.
Collapse
Affiliation(s)
- Daisy Mollison
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Robin Sellar
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Mark Bastin
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Denis Mollison
- Department of Actuarial Mathematics and Statistics, Heriot-Watt University, Edinburgh, United Kingdom
| | - Siddharthan Chandran
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Joanna Wardlaw
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Peter Connick
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
8
|
Rao SM, Losinski G, Mourany L, Schindler D, Mamone B, Reece C, Kemeny D, Narayanan S, Miller DM, Bethoux F, Bermel RA, Rudick R, Alberts J. Processing speed test: Validation of a self-administered, iPad®-based tool for screening cognitive dysfunction in a clinic setting. Mult Scler 2017; 23:1929-1937. [DOI: 10.1177/1352458516688955] [Citation(s) in RCA: 78] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Background: Cognitive dysfunction is common in multiple sclerosis (MS) patients and has important consequences for daily activities, yet, unlike motor function, is not routinely assessed in the clinic setting. We developed the Processing Speed Test (PST), a self-administered iPad®-based tool to measure MS-related deficits in processing speed. Objective: To determine whether the PST is valid for screening cognitive dysfunction by comparing it to the paper-and-pencil Symbol Digit Modalities Test (SDMT). Methods: We assessed PST test–retest reliability, sensitivity of PST and SDMT in discriminating MS patients from healthy controls (HC), convergent validity between PST and SDMT, correlations between T2 lesion load and PST and SDMT, and PST performance with and without technician present during administration. Results: PST had excellent test–retest reliability, was highly correlated with SDMT, was slightly more sensitive than SDMT in discriminating MS from HC groups, and correlated better with cerebral T2 lesion load than did SDMT. Finally, PST performance was no different with or without a technician in the testing environment. Conclusion: PST has advantages over SDMT because of its efficient administration, scoring, and potential for medical record or research database integration. PST is a practical tool for routine screening of processing speed deficits in the MS clinic.
Collapse
Affiliation(s)
- Stephen M Rao
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Genna Losinski
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Lyla Mourany
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - David Schindler
- Department of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | | | - Christine Reece
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Danielle Kemeny
- Schey Center for Cognitive Neuroimaging, Lou Ruvo Center for Brain Health, Neurological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Sridar Narayanan
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Deborah M Miller
- Mellen Center for Multiple Sclerosis Treatment and Research, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Francois Bethoux
- Mellen Center for Multiple Sclerosis Treatment and Research, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Robert A Bermel
- Mellen Center for Multiple Sclerosis Treatment and Research, Cleveland Clinic Foundation, Cleveland, OH, USA
| | | | - Jay Alberts
- Department of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| |
Collapse
|
9
|
Costa SL, Genova HM, DeLuca J, Chiaravalloti ND. Information processing speed in multiple sclerosis: Past, present, and future. Mult Scler 2016; 23:772-789. [PMID: 27207446 DOI: 10.1177/1352458516645869] [Citation(s) in RCA: 120] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
BACKGROUND Information processing speed (IPS) is a prevalent cognitive impairment in multiple sclerosis (MS). OBJECTIVES This review aims to summarize the methods applied to assess IPS in MS and its theoretical conceptualization. A PubMed search was performed to select articles published between 1 January 2004 and 31 December 2013, resulting in 157 articles included. RESULTS The majority (54%) of studies assessed IPS with heterogeneous samples (several disease courses). Studies often report controlling for presence of other neurological disorders (60.5%), age (58.6%), education (51.6%), alcohol history (47.8%), or use of steroids (39.5%). Potential confounding variables, such as recent relapses (50.3%), history of developmental disorders (19.1%), and visual problems (29.9%), were often neglected. Assessments used to study IPS were heterogeneous (ranging from simple to complex tasks) among the studies under review, with 62 different tasks used. Only 9.6% of articles defined the construct of IPS and 22.3% discussed IPS in relation to a theoretical model. FUTURE DIRECTIONS The challenges for the upcoming decade include clarification of the definition of IPS as well as its theoretical conceptualization and a consensus on assessment. Based on the results obtained, we propose a new theoretical model, the tri-factor model of IPS.
Collapse
Affiliation(s)
- Silvana L Costa
- Neuropsychology & Neuroscience Laboratory, Kessler Foundation, West Orange, NJ, USA/Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Helen M Genova
- Neuropsychology & Neuroscience Laboratory, Kessler Foundation, West Orange, NJ, USA/Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - John DeLuca
- Neuropsychology & Neuroscience Laboratory, Kessler Foundation, West Orange, NJ, USA/Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA/Department of Neurology, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Nancy D Chiaravalloti
- Neuropsychology & Neuroscience Laboratory, Kessler Foundation, West Orange, NJ, USA/Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| |
Collapse
|
10
|
McCarthy CS, Ramprashad A, Thompson C, Botti JA, Coman IL, Kates WR. A comparison of FreeSurfer-generated data with and without manual intervention. Front Neurosci 2015; 9:379. [PMID: 26539075 PMCID: PMC4612506 DOI: 10.3389/fnins.2015.00379] [Citation(s) in RCA: 94] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Accepted: 09/29/2015] [Indexed: 01/18/2023] Open
Abstract
This paper examined whether FreeSurfer-generated data differed between a fully-automated, unedited pipeline and an edited pipeline that included the application of control points to correct errors in white matter segmentation. In a sample of 30 individuals, we compared the summary statistics of surface area, white matter volumes, and cortical thickness derived from edited and unedited datasets for the 34 regions of interest (ROIs) that FreeSurfer (FS) generates. To determine whether applying control points would alter the detection of significant differences between patient and typical groups, effect sizes between edited and unedited conditions in individuals with the genetic disorder, 22q11.2 deletion syndrome (22q11DS) were compared to neurotypical controls. Analyses were conducted with data that were generated from both a 1.5 tesla and a 3 tesla scanner. For 1.5 tesla data, mean area, volume, and thickness measures did not differ significantly between edited and unedited regions, with the exception of rostral anterior cingulate thickness, lateral orbitofrontal white matter, superior parietal white matter, and precentral gyral thickness. Results were similar for surface area and white matter volumes generated from the 3 tesla scanner. For cortical thickness measures however, seven edited ROI measures, primarily in frontal and temporal regions, differed significantly from their unedited counterparts, and three additional ROI measures approached significance. Mean effect sizes for edited ROIs did not differ from most unedited ROIs for either 1.5 or 3 tesla data. Taken together, these results suggest that although the application of control points may increase the validity of intensity normalization and, ultimately, segmentation, it may not affect the final, extracted metrics that FS generates. Potential exceptions to and limitations of these conclusions are discussed.
Collapse
Affiliation(s)
- Christopher S McCarthy
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| | - Avinash Ramprashad
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| | - Carlie Thompson
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| | - Jo-Anna Botti
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| | - Ioana L Coman
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| | - Wendy R Kates
- Department of Psychiatry and Behavioral Sciences, Center for Psychiatric Neuroimaging, State University of New York at Upstate Medical University Syracuse, NY, USA
| |
Collapse
|
11
|
Patti F, De Stefano M, Lavorgna L, Messina S, Chisari CG, Ippolito D, Lanzillo R, Vacchiano V, Realmuto S, Valentino P, Coniglio G, Buccafusca M, Paolicelli D, D’Ambrosio A, Montella P, Brescia Morra V, Savettieri G, Alfano B, Gallo A, Simone I, Viterbo R, Zappia M, Bonavita S, Tedeschi G. Lesion load may predict long-term cognitive dysfunction in multiple sclerosis patients. PLoS One 2015; 10:e0120754. [PMID: 25816303 PMCID: PMC4376682 DOI: 10.1371/journal.pone.0120754] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2014] [Accepted: 01/26/2015] [Indexed: 11/18/2022] Open
Abstract
Background Magnetic Resonance Imaging (MRI) techniques provided evidences into the understanding of cognitive impairment (CIm) in Multiple Sclerosis (MS). Objectives To investigate the role of white matter (WM) and gray matter (GM) in predicting long-term CIm in a cohort of MS patients. Methods 303 out of 597 patients participating in a previous multicenter clinical-MRI study were enrolled (49.4% were lost at follow-up). The following MRI parameters, expressed as fraction (f) of intracranial volume, were evaluated: cerebrospinal fluid (CSF-f), WM-f, GM-f and abnormal WM (AWM-f), a measure of lesion load. Nine years later, cognitive status was assessed in 241 patients using the Symbol Digit Modalities Test (SDMT), the Semantically Related Word List Test (SRWL), the Modified Card Sorting Test (MCST), and the Paced Auditory Serial Addition Test (PASAT). In particular, being SRWL a memory test, both immediate recall and delayed recall were evaluated. MCST scoring was calculated based on the number of categories, number of perseverative and non-perseverative errors. Results AWM-f was predictive of an impaired performance 9 years ahead in SDMT (OR 1.49, CI 1.12–1.97 p = 0.006), PASAT (OR 1.43, CI 1.14–1.80 p = 0.002), SRWL-immediate recall (OR 1.72 CI 1.35–2.20 p<0.001), SRWL-delayed recall (OR 1.61 CI 1.28–2.03 p<0.001), MCST-category (OR 1.52, CI 1.2–1.9 p<0.001), MCST-perseverative error(OR 1.51 CI 1.2–1.9 p = 0.001), MCST-non perseverative error (OR 1.26 CI 1.02–1.55 p = 0.032). Conclusion In our large MS cohort, focal WM damage appeared to be the most relevant predictor of the long-term cognitive outcome.
Collapse
Affiliation(s)
- Francesco Patti
- Department G.F. Ingrassia, Section of Neurosciences, University of Catania, Catania, Italy
- * E-mail:
| | - Manuela De Stefano
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | - Luigi Lavorgna
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | - Silvia Messina
- Department G.F. Ingrassia, Section of Neurosciences, University of Catania, Catania, Italy
| | - Clara Grazia Chisari
- Department G.F. Ingrassia, Section of Neurosciences, University of Catania, Catania, Italy
| | - Domenico Ippolito
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | - Roberta Lanzillo
- Department of Neurological Sciences, University ‘Federico II,’ Naples, Italy
| | - Veria Vacchiano
- Department of Neurological Sciences, University ‘Federico II,’ Naples, Italy
| | - Sabrina Realmuto
- Department of Experimental Biomedicine and Clinical Neurosciences-University of Palermo, Palermo, Italy
| | - Paola Valentino
- Department of Medical Sciences, Institute of Neurology, University “Magna Graecia”, Catanzaro, Italy
| | | | - Maria Buccafusca
- Department of Neurosciences, Psychiatry and Anaesthesiology, University of Messina, Messina, Italy
| | - Damiano Paolicelli
- Department “Scienze Mediche di Base, Neuroscienze e Organi di Senso”, University of Bari, Bari, Italy
| | - Alessandro D’Ambrosio
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | - Patrizia Montella
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | | | - Giovanni Savettieri
- Department of Experimental Biomedicine and Clinical Neurosciences-University of Palermo, Palermo, Italy
| | - Bruno Alfano
- Biostructure and Bioimaging Institute, National Research Council, Naples, Italy
| | - Antonio Gallo
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| | - Isabella Simone
- Department “Scienze Mediche di Base, Neuroscienze e Organi di Senso”, University of Bari, Bari, Italy
| | - Rosa Viterbo
- Department “Scienze Mediche di Base, Neuroscienze e Organi di Senso”, University of Bari, Bari, Italy
| | - Mario Zappia
- Department G.F. Ingrassia, Section of Neurosciences, University of Catania, Catania, Italy
| | - Simona Bonavita
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
- Neurological Institute for Diagnosis and Care “Hermitage Capodimonte”, Naples, Italy
| | - Gioacchino Tedeschi
- Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences, Second University of Naples, Naples, Italy
| |
Collapse
|
12
|
Veauthier C, Paul F. Sleep disorders in multiple sclerosis and their relationship to fatigue. Sleep Med 2014; 15:5-14. [DOI: 10.1016/j.sleep.2013.08.791] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/26/2013] [Revised: 08/14/2013] [Accepted: 08/20/2013] [Indexed: 10/26/2022]
|
13
|
The nature of verbal memory impairment in multiple sclerosis: a list-learning and meta-analytic study. J Int Neuropsychol Soc 2013; 19:995-1008. [PMID: 24059259 DOI: 10.1017/s1355617713000957] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The primary purpose of this study was to test the hypothesis that multiple sclerosis (MS) patients have impaired acquisition rather than a retrieval deficit. Verbal memory impairment in MS was examined in 53 relapsing-remitting MS patients and 31 healthy controls (HC), and in a meta-analysis of studies that examined memory functioning in MS with list-learning tasks. The MS group demonstrated significantly lower acquisition and delayed recall performance than the HC group, and the meta-analysis revealed that the largest effect sizes were obtained for acquisition measures relative to delayed recall and recognition. Our data argue against a retrieval deficit as the sole explanation for verbal memory impairment in MS, and make a consistent case for the position that deficient acquisition contributes to the memory dysfunction of MS patients. Deficient acquisition may result from demyelination in relevant white matter tracts that reduces encoding efficiency as a result of impaired speed of information processing.
Collapse
|
14
|
Mazerolle EL, Wojtowicz MA, Omisade A, Fisk JD. Intra-individual variability in information processing speed reflects white matter microstructure in multiple sclerosis. NEUROIMAGE-CLINICAL 2013; 2:894-902. [PMID: 24179840 PMCID: PMC3777766 DOI: 10.1016/j.nicl.2013.06.012] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/21/2013] [Revised: 06/18/2013] [Accepted: 06/20/2013] [Indexed: 11/26/2022]
Abstract
Slowed information processing speed is commonly reported in persons with multiple sclerosis (MS), and is typically investigated using clinical neuropsychological tests, which provide sensitive indices of mean-level information processing speed. However, recent studies have demonstrated that within-person variability or intra-individual variability (IIV) in information processing speed may be a more sensitive indicator of neurologic status than mean-level performance on clinical tests. We evaluated the neural basis of increased IIV in mildly affected relapsing–remitting MS patients by characterizing the relation between IIV (controlling for mean-level performance) and white matter integrity using diffusion tensor imaging (DTI). Twenty women with relapsing–remitting MS and 20 matched control participants completed the Computerized Test of Information Processing (CTIP), from which both mean response time and IIV were calculated. Other clinical measures of information processing speed were also collected. Relations between IIV on the CTIP and DTI metrics of white matter microstructure were evaluated using tract-based spatial statistics. We observed slower and more variable responses on the CTIP in MS patients relative to controls. Significant relations between white matter microstructure and IIV were observed for MS patients. Increased IIV was associated with reduced integrity in more white matter tracts than was slowed information processing speed as measured by either mean CTIP response time or other neuropsychological test scores. Thus, despite the common use of mean-level performance as an index of cognitive dysfunction in MS, IIV may be more sensitive to the overall burden of white matter disease at the microstructural level. Furthermore, our study highlights the potential value of considering within-person fluctuations, in addition to mean-level performance, for uncovering brain–behavior relationships in neurologic disorders with widespread white matter pathology. Intra-individual variability (IIV) predicts neurologic status in multiple sclerosis (MS). Diffusion tensor imaging (DTI) was used to study the neural correlates of IIV in MS. IIV was significantly related to DTI metrics in many white matter regions. Compared to mean response speed, IIV may be more sensitive to disease burden in MS. Evaluating IIV may be important for characterizing brain–behavior relationships.
Collapse
Affiliation(s)
- Erin L Mazerolle
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Room WB325, 3801 University St, Montreal, Quebec H3A 2B4, Canada ; Department of Psychology and Neuroscience, Dalhousie University, Life Sciences Centre, P.O. Box 15000, Halifax, Nova Scotia B3H 4R2, Canada
| | | | | | | |
Collapse
|
15
|
Pellicano C, Kane RL, Gallo A, Xiaobai L, Stern SK, Ikonomidou VN, Evangelou IE, Ohayon JM, Ehrmantraut M, Cantor FK, Bagnato F. Cognitive impairment and its relation to imaging measures in multiple sclerosis: a study using a computerized battery. J Neuroimaging 2012; 23:445-52. [PMID: 23227967 DOI: 10.1111/j.1552-6569.2011.00687.x] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
BACKGROUND AND PURPOSE Cognitive impairment (CI) is an important component of multiple sclerosis (MS) disability. A complex biological interplay between white matter (WM) and gray matter (GM) disease likely sustains CI. This study aims to address this issue by exploring the association between the extent of normal WM and GM disease and CI. METHODS Cognitive function of 24 MS patients and 24 healthy volunteers (HVs) was studied using the Automated Neuropsychological Assessment Metrics (ANAM) battery. WM focal lesions and normal appearing WM (NAWM) volume in patients, cortical thickness (CTh) and deep GM structure volumes in both patients and HVs were measured by high field strength (3.0-Tesla; 3T) imaging. RESULTS An analysis of covariance showed that patients performed worse than HVs on Code Substitution Delayed Memory (P = .04) and Procedural Reaction Time (P = .05) indicative of reduced performance in memory, cognitive flexibility, and processing speed. A summary score (Index of Cognitive Efficiency) indicating global test battery performance was also lower for the patient group (P = .04). Significant associations, as determined by the Spearman rank correlation tests, were noted between each of these 3 cognitive scores and measures of NAWM volume [CDD-TP1(r = .609; P = .0035), PRO-TP1 (r = .456; P = .029) and ICE (r = .489; P = .0129)], CTh (r = .5; P ≤ .05) and volume of subcortical normal appearing GM (NAGM) structures (r = .4; P≤ .04), but not WM lesions. CONCLUSIONS Both NAWM and NAGM volumes are related to CI in MS. The results highlight once again the urgent need to develop pharmacological strategies protecting patients from widespread neurodegeneration as possible preventive strategies of CI development.
Collapse
Affiliation(s)
- Clelia Pellicano
- Neuroimmunology Branch (NIB), National Institute of Neurological Disorders and Stroke (NINDS), NIH, Bethesda, MD, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
16
|
Ontaneda D, LaRocca N, Coetzee T, Rudick R. Revisiting the multiple sclerosis functional composite: proceedings from the National Multiple Sclerosis Society (NMSS) Task Force on Clinical Disability Measures. Mult Scler 2012; 18:1074-80. [PMID: 22740488 DOI: 10.1177/1352458512451512] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This article describes proceedings from a meeting of the National Multiple Sclerosis Society (NMSS) Task Force on Clinical Disability Measures (the TF). The TF was appointed by the NMSS Research Programs Advisory Committee with the goal of pooling and analyzing existing datasets to explore the utility of novel disability outcome measures based on the Multiple Sclerosis Functional Composite (MSFC) approach. The TF seeks to determine the suitability of the MSFC approach as a primary clinical outcome measure for registration trials in MS. The TF met in Washington, DC, Dec. 14 and 15, 2011, and provided unanimous support for a collaborative approach involving representatives from academic medicine, the pharmaceutical industry, regulatory agencies, the NMSS and the Critical Path Institute. There was also unanimous agreement that analysis of existing datasets would be useful in making progress toward the objective. The TF placed high value on determining the clinical meaning of individual component measures for the MSFC, and in establishing optimal analysis methods for MSFC so that scores would be more interpretable than the originally recommended z-score method. The background for a collaborative project aimed at developing an improved disability outcome measure is described in this paper.
Collapse
Affiliation(s)
- D Ontaneda
- Mellen Center for MS Treatment and Research, Cleveland Clinic, Cleveland, OH 44195, USA
| | | | | | | | | |
Collapse
|
17
|
Langdon DW, Amato MP, Boringa J, Brochet B, Foley F, Fredrikson S, Hämäläinen P, Hartung HP, Krupp L, Penner IK, Reder AT, Benedict RHB. Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Mult Scler 2011; 18:891-8. [PMID: 22190573 PMCID: PMC3546642 DOI: 10.1177/1352458511431076] [Citation(s) in RCA: 581] [Impact Index Per Article: 44.7] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Background: Cognitive impairment in MS impacts negatively on many patients at all disease stages and in all subtypes. Full clinical cognitive assessment is expensive, requiring expert staff and special equipment. Test versions and normative data are not available for all languages and cultures. Objective: To recommend a brief cognitive assessment for multiple sclerosis (MS) that is optimized for small centers, with one or few staff members, who may not have neuropsychological training and constructed to maximize international use. Methods: An expert committee of twelve members representing the main cultural groups that have so far contributed considerable data about MS cognitive dysfunction was convened. Following exhaustive literature review, peer-reviewed articles were selected to cover a broad spectrum of cultures and scales that targeted cognitive domains vulnerable to MS. Each was rated by two committee members and candidates scales were rated on psychometric qualities (reliability, validity, and sensitivity), international application, ease of administration, feasibility in the specified context, and acceptability to patients. Results: The committee recommended the Symbol Digit Modalities Test, if only 5 minutes was available, with the addition of the California Verbal Learning Test – Second Edition and the Brief Visuospatial Memory Test – Revised learning trials if a further 10 minutes could be allocated for testing. Conclusions: A brief cognitive assessment for MS has been recommended. A validation protocol has been prepared for language groups and validation studies have commenced.
Collapse
Affiliation(s)
- D W Langdon
- Royal Holloway, University of London, Surrey, UK.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|