1
|
Ariesen AMD, Tuomainen RE, De Deyn PP, Tucha O, Koerts J. Let Us Talk Money: Subjectively Reported Financial Performance of People Living with Neurodegenerative Diseases-A Systematic Review. Neuropsychol Rev 2024; 34:668-719. [PMID: 37594689 PMCID: PMC11166770 DOI: 10.1007/s11065-023-09597-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Accepted: 04/28/2023] [Indexed: 08/19/2023]
Abstract
Neurodegenerative diseases (NDDs) form a heterogeneous, widespread group of disorders, generally characterized by progressive cognitive decline and neuropsychiatric disturbances. One of the abilities that seems particularly vulnerable to the impairments in neurodegenerative diseases is the capability to manage one's personal finances. Indeed, people living with neurodegenerative diseases were shown to consistently present with more problems on performance-based financial tasks than healthy individuals. While objective, performance-based tasks provide insight into the financial competence of people living with neurodegenerative diseases in a controlled, standardized setting; relatively little can be said, based on these tasks, about their degree of success in dealing with the financial demands, issues, or questions of everyday life (i.e., financial performance). The aim of this systematic review is to provide an overview of the literature examining self and informant reports of financial performance in people living with neurodegenerative diseases. In total, 22 studies were included that compared the financial performance of people living with mild cognitive impairment (MCI), Alzheimer's disease (AD), Parkinson's disease, or multiple sclerosis to a (cognitively) normal control group. Overall, the results indicate that people living with neurodegenerative diseases are more vulnerable to impairments in financial performance than cognitively normal individuals and that the degree of reported problems seems to be related to the severity of cognitive decline. As the majority of studies however focused on MCI or AD and made use of limited assessment methods, future research should aim to develop and adopt more comprehensive assessments to study strengths and weaknesses in financial performance of people living with different neurodegenerative diseases.
Collapse
Affiliation(s)
- Akke-Marij D Ariesen
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, The Netherlands
| | - Roosa E Tuomainen
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, The Netherlands
| | - Peter P De Deyn
- Department of Neurology and Alzheimer Center Groningen, University Medical Center Groningen, Groningen, The Netherlands
- Laboratory of Neurochemistry and Behaviour, University of Antwerp, Antwerp, Belgium
- Department of Neurology and Memory Clinic, Middelheim General Hospital (ZNA), Antwerp, Belgium
| | - Oliver Tucha
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, The Netherlands
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany
- Department of Psychology, Maynooth University, National University of Ireland, Maynooth, Ireland
| | - Janneke Koerts
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, The Netherlands.
| |
Collapse
|
2
|
Gomes LR, Damasceno BP, de Campos BM, Damasceno A. Impairment of daily occupations in multiple sclerosis: analysis of neuroimaging, general and social cognition, and reserve. Mult Scler Relat Disord 2024; 81:105140. [PMID: 37988860 DOI: 10.1016/j.msard.2023.105140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 11/14/2023] [Accepted: 11/15/2023] [Indexed: 11/23/2023]
Abstract
BACKGROUND Multiple Sclerosis (MS) can impact performance of daily occupations in both relapsing-remitting (RRMS) and secondary-progressive (SPMS) clinical courses. Work force participation decreases with advancing physical disability but the influence of non-motor factors, neuroimaging, and reserve have been scarcely investigated. We aimed to evaluate MRI, clinical, and cognitive (social and general) factors associated with impairment in different daily occupations and address whether cognitive and brain reserve have a positive impact on the ability to maintain these activities. METHODS We prospectively enrolled persons with MS (PwMS) who underwent clinical examination (Expanded Disability Status Scale - EDSS; Timed 25-Foot Walk Test - T25FW; and the Nine Hole Peg Test - 9HPT), general neuropsychological assessment (Brief Repeatable Battery of Neuropsychological Tests - BRBN, including the Symbol Digit Modalities Test - SDMT), social cognition evaluation (Reading the Mind in the Eyes Test), cognitive reserve questionnaire, and MRI (FreeSurfer). We also enrolled healthy subjects for comparison as a control group. Daily occupations (employment, money management, and driving abilities) were assessed in all individuals with questionnaires. RESULTS We included 62 PwMS (32 RRMS and 30 SPMS; mean age 42.8 years; median educational time 12.75 years) and 67 controls (mean age 39.7; median educational time 12.0 years) which were similar regarding demographics, education, and socioeconomic status (p > 0.1). Most PwMS (67.7%) had work-restrictions. They also reported fewer money management and driving abilities than controls (p < 0.001). Work-restriction was associated with physical disability (p = 0.006), SDMT and BRBN performance (p = 0.035 and p = 0.031, respectively), and T2-lesion volume (p = 0.022), with large effect sizes (d > 0.75). After hierarchical linear regression, money management was associated with hand dexterity, general and social cognition, and cognitive reserve (p < 0.03). Variables associated with driving abilities included fatigue, verbal fluency, striatum volume, and brain reserve (p < 0.05). CONCLUSIONS PwMS have more frequent work-restrictions and impairment in money management and driving abilities compared to controls. Cognitive function, physical disability, and MS-lesion burden are strongly associated with work-restriction. Social cognition can also influence financial capacity. Cognitive and brain reserve can help retain some of these daily occupations.
Collapse
Affiliation(s)
| | | | | | - Alfredo Damasceno
- Department of Neurology, University of Campinas (UNICAMP), Campinas, Brazil; Neuroimaging Laboratory, University of Campinas (UNICAMP), Campinas, Brazil.
| |
Collapse
|
3
|
Salsi S, Ariano E, Casey J, Loewen M, Engel L. Financial Capability Interventions Used for Specific Diagnoses Related to Functional Impairment: A Scoping Review. Am J Occup Ther 2024; 78:7801205060. [PMID: 38305720 DOI: 10.5014/ajot.2024.050254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2024] Open
Abstract
IMPORTANCE Occupational therapists often address financial occupations of clients with acquired functional impairments who experience challenges with financial capability (FC). OBJECTIVE To explore the intervention literature aimed at improving FC in five diagnostic adult populations. DATA SOURCES MEDLINE, CINAHL, PsycInfo, EconLit, and EMBASE; researchers also completed backward and forward citation searching and contacted expert authors. STUDY SELECTION AND DATA COLLECTION Two independent reviewers completed article screening, selection, and extraction using a scoping review approach; a priori inclusion criteria were peer-reviewed articles, written in English, involving adults with one of five diagnostic conditions, describing any intervention to improve FC. FINDINGS Twenty-four articles met the inclusion criteria. Most articles were aimed at substance use or mental health populations (n = 20); fewer focused on brain injury (n = 2), multiple sclerosis (n = 1), or mixed-diagnosis (n = 1) populations. Only 4 were randomized controlled trials (RCTs). Interventions were heterogeneous and complex, including components of skills training (n = 21), individualized budgeting (n = 18), representative payeeship (n = 11), education (n = 10), structured goal setting (n = 7), savings building (n = 5), metacognitive strategies (n = 2), and assistive technology (n = 1). CONCLUSIONS AND RELEVANCE Despite growth in the area, the literature regarding FC intervention is limited, with few RCTs and many populations unrepresented. The literature for a systematic review of FC intervention efficacy for these populations is insufficient, particularly because included studies used varied components, limiting comparison. Further research is imperative to guide evidence-based practice. Plain-Language Summary: This study is an overview of literature about interventions to address the financial occupations of clients with acquired functional impairments. The findings give occupational therapy researchers and clinicians the information they need to begin analyzing, using, and building the evidence to support the use of interventions to improve clients' financial capability and well-being.
Collapse
Affiliation(s)
- Sofia Salsi
- Sofia Salsi, MScA OT, OT Reg (MB), is PhD Graduate Student, Applied Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Emily Ariano
- Emily Ariano, MOT, OT Reg (MB), is Occupational Therapist, Victoria General Hospital, Winnipeg, Manitoba, Canada. At the time of this review, Ariano was Master of Occupational Therapy Student, College of Rehabilitation Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Jennifer Casey
- Jennifer Casey, MOT, OT Reg (Ont.), is Occupational Therapist, Children's Therapy Collective and Children's First Initiative, Winnipeg, Manitoba, and Fort Frances, Ontario, Canada. At the time of this review, Casey was Master of Occupational Therapy Student, College of Rehabilitation Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Morgan Loewen
- Morgan Loewen, MOT, OT Reg (MB), is Occupational Therapist, Deer Lodge Centre, Winnipeg, Manitoba, Canada. At the time of this review, Loewen was Master of Occupational Therapy Student, College of Rehabilitation Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Lisa Engel
- Lisa Engel, MSc (OT), PhD, OT Reg (MB), is Assistant Professor, College of Rehabilitation Sciences, University of Manitoba, Winnipeg, Manitoba, Canada, and Institute for Work and Health, Toronto, Ontario, Canada;
| |
Collapse
|
4
|
Prakash RS, Manglani HR, Duraney EJ, Shankar A, Fisher ME, Janssen A, Cea L, Petosa R, Andridge R, Nicholas J. TRACking health behaviors in people with Multiple Sclerosis (TRAC-MS): Study protocol and description of the study sample. Contemp Clin Trials Commun 2022; 30:101006. [PMID: 36203849 PMCID: PMC9529668 DOI: 10.1016/j.conctc.2022.101006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 08/24/2022] [Accepted: 09/17/2022] [Indexed: 01/07/2023] Open
Abstract
Introduction People with multiple sclerosis (PwMS) experience a range of physical, cognitive, and affective symptoms. Behavioral interventions targeting increased physical activity show promising support as low-cost methods to improve working memory, episodic memory, and processing speed in PwMS. In this randomized controlled trial, we will examine the efficacy of a pedometer-tracking intervention, designed to increase low-to-moderate levels of physical activity, for improving working memory in PwMS. Methods and Analysis Eighty-seven PwMS, between the ages of 30-59, have been recruited for the study. Seventy-five of the eligible and interested individuals were randomized to six-month health behavior monitoring groups: a Step-track group or a Water-track group (serving as the active control). Neuropsychological measures, assessing the primary outcome of the study, were administered at pre, midpoint, and post-intervention. Exploratory factor analysis of neuropsychological measures resulted in three factors: a working memory/processing speed factor, a visual episodic memory factor, and a verbal episodic memory factor. Changes in this latent measure of working memory/processing speed is the primary outcome of the current study. Functional MRI data will be analyzed to examine changes in the functional connectivity of the neural network supporting working memory. Ethics and dissemination The institutional review board granted approval for the study and all participants provided written informed consent. The results of this study will provide support showing that step-tracking increases overall levels of physical activity, improves working memory and processing speed, and strengthens the neural circuitry that supports better cognition. Evidence from this study will thus offer promising support for the routine use of step-tracking devices to improve cognitive functioning in PwMS. Study results will be disseminated through peer-reviewed publications and presentations at scientific conferences.
Collapse
Affiliation(s)
- Ruchika S. Prakash
- Department of Psychology, The Ohio State University, Columbus, OH, USA,Center for Cognitive and Behavioral Brain Imaging, The Ohio State University Columbus, OH, USA,Corresponding author. Department of Psychology, The Ohio State University, 139 Psychology Building 1835 Neil Avenue, Columbus, OH 43210, USA.
| | - Heena R. Manglani
- Department of Psychology, The Ohio State University, Columbus, OH, USA
| | | | - Anita Shankar
- Department of Psychology, The Ohio State University, Columbus, OH, USA
| | - Megan E. Fisher
- Department of Psychology, The Ohio State University, Columbus, OH, USA
| | - Alisha Janssen
- Department of Psychology, The Ohio State University, Columbus, OH, USA
| | - Lauren Cea
- Department of Psychology, The Ohio State University, Columbus, OH, USA
| | - Rick Petosa
- Department of Human Sciences, The Ohio State University, Columbus, OH, USA
| | - Rebecca Andridge
- Department of Biostatistics, The Ohio State University, Columbus, OH, USA
| | | |
Collapse
|
5
|
Bónitto JRG, Ayala OD, Botero LC. REAL-LIFE EVIDENCE OF TREATMENT WITH ALEMTUZUMAB IN PATIENTS DIAGNOSED WITH RELAPSING-REMITTING MULTIPLE SCLEROSIS IN COLOMBIA. Mult Scler Relat Disord 2022; 61:103780. [DOI: 10.1016/j.msard.2022.103780] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 02/26/2022] [Accepted: 03/26/2022] [Indexed: 10/18/2022]
|
6
|
Kavaliunas A, Danylaitė Karrenbauer V, Binzer S, Hillert J. Systematic Review of the Socioeconomic Consequences in Patients With Multiple Sclerosis With Different Levels of Disability and Cognitive Function. Front Neurol 2022; 12:737211. [PMID: 35069404 PMCID: PMC8770980 DOI: 10.3389/fneur.2021.737211] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Accepted: 11/25/2021] [Indexed: 11/13/2022] Open
Abstract
Multiple sclerosis (MS) is a challenging and disabling condition, predominantly affecting individuals in early adulthood. MS affects the physical, cognitive, and mental health of persons suffering from the disease as well as having a great impact on their financial status and quality of life. However, there is a lack of systematic approach toward assessing the socioeconomic consequences of MS. Our objective was to systematically review analytical observational studies investigating the socioeconomic consequences in persons with MS with different levels of physical disability and cognitive function. We conducted a systematic review on socioeconomic consequences of MS with a focus on employment-, income-, work ability-, and relationship-related outcomes in persons with MS with special focus on disability and cognition. Additionally, the educational characteristics were examined. From 4,957 studies identified, 214 were assessed for eligibility and a total of 19 studies were included in this qualitative assessment; 21 different outcomes were identified. All identified studies reported higher unemployment, higher early retirement, and higher risk of unemployment in relation to higher physical disability. Also, cognitive function was found to be a predictor of employment (unemployment). The studies pointed out significant correlations between greater disability and lower earnings and higher income from benefits. A study found the same correlation in relation to cognitive function. The studies reported higher work disability in relation to higher physical disability and lower cognitive function. In conclusion, this systematic review summarizes the pronounced differences in various socioeconomic outcomes between patients with MS with regards to their physical disability and cognitive function. In addition, we identified a lack of studies with longitudinal design in this field that can provide more robust estimates with covariate adjustments, such as disease modifying treatments.
Collapse
Affiliation(s)
- Andrius Kavaliunas
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Virginija Danylaitė Karrenbauer
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden.,Neurology Medical Unit, Karolinska University Hospital, Huddinge, Sweden
| | - Stefanie Binzer
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden.,Department of Neurology, Kolding Hospital, Kolding, Denmark
| | - Jan Hillert
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden.,Neurology Medical Unit, Karolinska University Hospital, Huddinge, Sweden
| |
Collapse
|
7
|
Bangma DF, Tucha O, Tucha L, De Deyn PP, Koerts J. How well do people living with neurodegenerative diseases manage their finances? A meta-analysis and systematic review on the capacity to make financial decisions in people living with neurodegenerative diseases. Neurosci Biobehav Rev 2021; 127:709-739. [PMID: 34058557 DOI: 10.1016/j.neubiorev.2021.05.021] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 05/18/2021] [Accepted: 05/20/2021] [Indexed: 12/13/2022]
Abstract
Self and proxy reported questionnaires indicate that people living with a neurodegenerative disease (NDD) have more difficulties with financial decision-making (FDM) than healthy controls. Self-reports, however, rely on adequate insight into everyday functioning and might, therefore, be less reliable. The present study provides a comprehensive overview and meta-analysis of studies evaluating FDM in people living with an NDD. For this, the reliability of performance-based tests to consistently identify FDM difficulties in people living with an NDD compared to healthy controls is evaluated. Furthermore, the associations between FDM and disease severity, performances on standard measures of cognition and demographics are evaluated. All 47 included articles, consistently reported lower performances on performance-based FDM tests of people living with an NDD (including Alzheimer's disease, mild cognitive impairment, frontotemporal dementia, Parkinson's disease, multiple sclerosis or Huntington's disease) compared to healthy controls. The majority of studies, however, focused on Alzheimer's disease and mild cognitive impairment (k = 38). FDM performance appears to be related to cognitive decline, specifically in working memory, processing speed and numeracy.
Collapse
Affiliation(s)
- Dorien F Bangma
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, the Netherlands; Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| | - Oliver Tucha
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, the Netherlands; Department of Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany; Department of Psychology, Maynooth University, National University of Ireland, Maynooth, Ireland
| | - Lara Tucha
- Department of Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany
| | - Peter P De Deyn
- Department of Neurology and Alzheimer Center Groningen, University Medical Center Groningen, Groningen, the Netherlands; Institute Born-Bunge, University of Antwerp, Antwerp, Belgium; Department of Neurology and Memory Clinic, Middelheim General Hospital (ZNA), Antwerp, Belgium
| | - Janneke Koerts
- Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, the Netherlands.
| |
Collapse
|
8
|
Sá MJ, Soares Dos Reis R, Altintas A, Celius EG, Chien C, Comi G, Graus F, Hillert J, Hobart J, Khan G, Kissani N, Langdon D, Leite MI, Okuda DT, Palace J, Papais-Alvarenga RM, Mendes-Pinto I, Shi FD. State of the Art and Future Challenges in Multiple Sclerosis Research and Medical Management: An Insight into the 5th International Porto Congress of Multiple Sclerosis. Neurol Ther 2020; 9:281-300. [PMID: 32666470 PMCID: PMC7606370 DOI: 10.1007/s40120-020-00202-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Indexed: 02/07/2023] Open
Abstract
The 5th International Porto Congress of Multiple Sclerosis took place between the 14th and 16th of February 2019 in Porto, Portugal. Its intensive programme covered a wide-range of themes-including many of the hot topics, challenges, pitfalls and yet unmet needs in the field of multiple sclerosis (MS)-led by a number of well-acknowledged world experts. This meeting review summarizes the talks that took place during the congress, which focussed on issues in MS as diverse as the development and challenges of progressive MS, epidemiology, differential diagnosis, medical management, molecular research and imaging tools.
Collapse
Affiliation(s)
- María José Sá
- Department of Neurology, Centro Hospitalar Universitário de São João, Alameda Prof. Hernáni Monteiro, Porto, Portugal.
- Faculty of Health Sciences, University Fernando Pessoa, Rua Carlos da Maia, Porto, Portugal.
| | - Ricardo Soares Dos Reis
- Department of Neurology, Centro Hospitalar Universitário de São João, Alameda Prof. Hernáni Monteiro, Porto, Portugal.
- Department of Clinical Neurosciences and Mental Health, Faculty of Medicine, University of Porto, Porto, Portugal.
| | - Ayse Altintas
- Department of Neurology, School of Medicine, Koç University, Istanbul, Turkey
| | - Elisabeth Gulowsen Celius
- Department of Neurology, Oslo University Hospital, Ullevål, Oslo, Norway
- Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Claudia Chien
- NeuroCure Clinical Research Center, NeuroCure Cluster of Excellence, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Giancarlo Comi
- Department of Neurology, University Vita-Salute San Raffaele, Milan, Italy
| | - Francesc Graus
- Department of Neurology, August Pi i Sunyer Biomedical Research Institute (IDIBAPS) Hospital Clínic, Barcelona, Spain
| | - Jan Hillert
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Jeremy Hobart
- Department of Neurology, University Hospitals Plymouth, Plymouth, UK
- Peninsula Schools of Medicine and Dentistry, University of Plymouth, Plymouth, UK
| | - Gulfaraz Khan
- Department of Microbiology and Immunology, College of Medicine and Health Sciences, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Najib Kissani
- Neurology Department, Marrakech University Hospital Mohammed VI, Marrakech, Morocco
- Neuroscience Research Laboratory, Marrakesh Medical School, Cadi Ayyad University, Marrakech, Morocco
| | - Dawn Langdon
- Department of Psychology, Royal Holloway, University of London, London, UK
| | - Maria Isabel Leite
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Darin T Okuda
- Department of Neurology and Neurotherapeutics, UT Southwestern Medical Center, Dallas, TX, USA
| | - Jacqueline Palace
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | | | | | - Fu-Dong Shi
- Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| |
Collapse
|
9
|
Weber E, Goverover Y, DeLuca J. Beyond cognitive dysfunction: Relevance of ecological validity of neuropsychological tests in multiple sclerosis. Mult Scler 2020; 25:1412-1419. [PMID: 31469351 DOI: 10.1177/1352458519860318] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In neurological diseases such as multiple sclerosis (MS), a neuropsychological assessment is often requested to assist clinicians in evaluating the role of cognition in a patient's level of everyday functioning. To be effective in this charge, it is assumed that performance on neuropsychological tests is related to how a person may function in everyday life, and the question is often asked: "Are neuropsychological tests ecologically valid?" In this review, we synthesize the literature that examines the use of neuropsychological tests to assess functioning across a variety of everyday functioning domains in MS (i.e. driving, employment, instrumental activities of daily living (IADLs)). However, we critically examine the usefulness of asking this broad question regarding ecological validity, given the psychometric and conceptual pitfalls it may yield. While many neuropsychological tests may be generally considered "ecologically valid" in MS, it is much more helpful to specify for whom, under what circumstances, and to what degree.
Collapse
Affiliation(s)
- Erica Weber
- Kessler Foundation, East Hanover, NJ, USA/ Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Yael Goverover
- Kessler Foundation, East Hanover, NJ, USA/Department of Occupational Therapy, NYU Steinhardt, New York, NY, USA
| | - John DeLuca
- Kessler Foundation, West Orange, NJ, USA/Department of Physical Medicine & Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA/ Department of Neurology, Rutgers New Jersey Medical School, Newark, NJ, USA
| |
Collapse
|
10
|
Venkatesan UM, Lancaster K, Lengenfelder J, Genova HM. Independent contributions of social cognition and depression to functional status after moderate or severe traumatic brain injury. Neuropsychol Rehabil 2020; 31:954-970. [PMID: 32314644 DOI: 10.1080/09602011.2020.1749675] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Impairments in cognitive processing related to social understanding and communication (i.e., "social cognition") are well documented after moderate or severe traumatic brain injury (TBI) and can contribute to negative functional outcome. Depression is also a common feature of TBI with detrimental functional consequences. We evaluated relationships between social cognition, depression symptom severity, and functional status in individuals with chronic TBI (>1 year post injury; n = 25) and healthy controls (n = 30) using objective tests of social cognition as well as self-reported depression (Beck Depression Inventory-II) and functional status (Functional Behavior Profile). Results revealed significant relationships between depression and functional status across the sample, and relationships between social cognition and functional status specific to TBI. In the TBI group only, social cognition significantly predicted both overall and social functional status above and beyond depression. Group differences in functional status were independently mediated by social cognition and, especially, depression. Our findings suggest that social cognitive impairments and depression are distinct, functionally relevant TBI sequelae. Interventions to improve social functioning in this population may be most effective when contextualized within treatments for emotional disturbances.
Collapse
Affiliation(s)
| | - Katie Lancaster
- Kessler Foundation Research Center, West Orange, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Jean Lengenfelder
- Kessler Foundation Research Center, West Orange, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Helen M Genova
- Kessler Foundation Research Center, West Orange, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| |
Collapse
|
11
|
Goverover Y, Genova HM, Smith A, Lengenfelder J, Chiaravalloti ND. Changes in Activity Participation After Multiple Sclerosis Diagnosis. Int J MS Care 2020; 22:23-30. [PMID: 32123525 PMCID: PMC7041618 DOI: 10.7224/1537-2073.2018-036] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
BACKGROUND Multiple sclerosis (MS) results in impairments in cognitive and motor skills, which may reduce the level of activity participation in people with MS. This study compares past and current levels of activity participation in adults with MS and controls. The relationship between retained activity participation (since diagnosis) and cognitive, motor, functional status, and depression symptoms of persons with MS was examined. METHODS Twenty-seven individuals with MS living in the community and 21 controls completed cognitive and motor tests and rated their activity participation (using the Activity Card Sort), depression symptoms, and functional status. RESULTS The MS group reported significantly lower current activity participation than the control group. Percentage of retained activity participation (from prediagnosis to current) in the MS group correlated with time since diagnosis, executive function and motor skill ability, depression symptoms, and current functional status. CONCLUSIONS Persons with MS report negative changes in activity participation in most aspects of life after diagnosis. These findings call attention to changes in activity participation in people with MS that are directly related to disease symptoms. Therefore, using a quantitative measure of activity participation-the Activity Card Sort-can provide important information to aid the clinician in developing individualized treatment goals for people with MS.
Collapse
|
12
|
Chiaravalloti ND, Moore NB, Weber E, DeLuca J. The application of Strategy-based Training to Enhance Memory (STEM) in multiple sclerosis: A pilot RCT. Neuropsychol Rehabil 2019; 31:231-254. [PMID: 31752604 DOI: 10.1080/09602011.2019.1685550] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
New learning and memory (NLM) impairments are common in multiple sclerosis (MS), negatively impacting daily life. Few studies seek to remediate these deficits to improve everyday functioning. Self-generation, spaced learning and retrieval practice have been shown to improve NLM in healthy persons and have been incorporated into an 8-session treatment protocol, Strategy-based Training to Enhance Memory (STEM). STEM teaches participants about each of the techniques, how to apply them in daily life and provides practice. Participants are taught to restructure a memory-demanding situation to optimize self-generation, spaced learning and retrieval practice. This pilot double-blind, placebo-controlled, randomized clinical trial (RCT) tested the efficacy of STEM in 20 learning-impaired participants with clinically definite MS (9 treatment, 11 control). Significant treatment effects were noted on self-report measures of daily functioning (primary outcome). Objective neuropsychological testing approached significance, showing a medium-large effect on verbal NLM. Results suggest that STEM may improve everyday functioning in individuals with MS. A full-scale RCT is warranted to validate findings in a larger sample so that findings may be generalized to the broader MS community.
Collapse
Affiliation(s)
- Nancy D Chiaravalloti
- Kessler Foundation Neuropsychology and Neuroscience Laboratory, East Hanover, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - Nancy B Moore
- Kessler Foundation Neuropsychology and Neuroscience Laboratory, East Hanover, NJ, USA
| | - Erica Weber
- Kessler Foundation Neuropsychology and Neuroscience Laboratory, East Hanover, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA
| | - John DeLuca
- Kessler Foundation Neuropsychology and Neuroscience Laboratory, East Hanover, NJ, USA.,Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, USA.,Department of Neurology, Rutgers New Jersey Medical School, Newark, NJ, USA
| |
Collapse
|
13
|
Yael G, Nancy C, John D. Money Management in Multiple Sclerosis: The Role of Cognitive, Motor, and Affective Factors. Front Neurol 2019; 10:1128. [PMID: 31708860 PMCID: PMC6819515 DOI: 10.3389/fneur.2019.01128] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Accepted: 10/09/2019] [Indexed: 01/12/2023] Open
Abstract
Introduction: Few studies have examined the motor, cognitive, and emotional factors involved in effective money management in persons with multiple sclerosis (MS). The aim of this study was to assess money management in persons MS and examine whether cognitive, motor, and emotional processes can predict money management. Methods: This study included 72 persons with MS and 26 healthy controls (HC). Using an a priori definition of efficient vs. inefficient money management skills, based on the money management questionnaire (self and others), and performance on Actual Reality™ (AR) money management items, MS participants were divided into two groups: efficient or inefficient money management (MS Efficient- MM, n = 34 vs. MS Inefficient-MM, n = 38). These groups were compared on cognitive, motor, and emotional variables. Results: Participants in the MS efficient MM group performed significantly better on executive function and processing speed measures, as well as performance on the 25WT. The MS Efficient -MM group also showed significantly less affective symptomatology (depressive and state anxiety). Importantly, HC performed similarly to the Efficient MM group on these tests. Good executive functioning and low depressive symptomatology predicted efficient money management. Conclusions: This study characterizes some of the major problems and underlying impairments persons with MS are encountering in money management. Practitioners working with persons with MS should be aware that executive function impairments together with depressive symptomatology could signal possible money management dysfunction. The early identification of at-risk persons for money management difficulties could have a profound impact on the quality of life for this subsample of the MS population.
Collapse
Affiliation(s)
- Goverover Yael
- Department of Occupational Therapy, New York University, New York, NY, United States.,Kessler Foundation, West Orange, NJ, United States
| | - Chiaravalloti Nancy
- Kessler Foundation, West Orange, NJ, United States.,Department of Physical Medicine and Rehabilitation, New Jersey Medical School, Rutgers University, Newark, NJ, United States
| | - DeLuca John
- Kessler Foundation, West Orange, NJ, United States.,Department of Physical Medicine and Rehabilitation, New Jersey Medical School, Rutgers University, Newark, NJ, United States
| |
Collapse
|
14
|
Kenney LE, Margolis SA, Davis JD, Tremont G. The Screening Utility and Ecological Validity of the Neuropsychological Assessment Battery Bill Payment Subtest in Older Adults with and without Dementia. Arch Clin Neuropsychol 2019; 34:1156-1164. [DOI: 10.1093/arclin/acz033] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2019] [Revised: 05/31/2019] [Indexed: 11/12/2022] Open
Abstract
Abstract
Objective
The Neuropsychological Assessment Battery Bill Payment subtest has shown strong diagnostic accuracy in dementia due to Alzheimer’s disease (AD) versus non-AD. Its relationship to mild cognitive impairment (MCI) or all-cause dementia has not been fully examined nor has its ecological validity as a proxy of financial independence.
Method
We describe 270 women (63%) and men (age = 72 ± 8.39) who completed Bill Payment during outpatient neuropsychological evaluation. Seventy-one were cognitively normal (CN), 160 had MCI, and 39 had Dementia. Two hundred fourteen were independent in money management, 31 were assisted (had oversight/some help), and 25 were dependent (relied on others). Receiver operating characteristic (ROC) curves tested Bill Payment’s utility as a dementia screen. Kruskal–Wallis tests examined whether Bill Payment differed by levels of financial independence.
Results
At a cutoff of 17, Bill Payment had strong sensitivity (0.87) and specificity (0.80) for dementia versus CN cases. A cutoff of 15 distinguished dementia from MCI (Sn = 0.64, Sp = 0.85), whereas a cutoff of 16 distinguished dementia from functionally unimpaired cases (MCI + CN) with greater sensitivity and similar specificity (Sn = 0.74, Sp = 0.81). Sensitivity attenuated in MCI versus CN cases (Sn = 0.46, Sp = 0.83). Those who were independent in money management had higher scores than assisted and dependent cases (p ≤ 0.046). Assisted and dependent cases were no different (p > 0.05).
Conclusions
Bill Payment is a valid screen of all-cause dementia. Lower Bill Payment scores may mark subtle functional decline beyond cognitive impairment alone. Specifically, results provide preliminary evidence of Bill Payment’s ecological validity as a measure related to financial independence. It may prove useful when impaired financial abilities are suspected but unreported.
Collapse
Affiliation(s)
- Lauren E Kenney
- Department of Psychiatry, Rhode Island Hospital, Providence, RI, USA
| | - Seth A Margolis
- Department of Psychiatry, Rhode Island Hospital, Providence, RI, USA
- Department of Psychiatry & Human Behavior, Warren Alpert Medical School, Brown University, Providence, RI, USA
| | - Jennifer D Davis
- Department of Psychiatry, Rhode Island Hospital, Providence, RI, USA
- Department of Psychiatry & Human Behavior, Warren Alpert Medical School, Brown University, Providence, RI, USA
| | - Geoffrey Tremont
- Department of Psychiatry, Rhode Island Hospital, Providence, RI, USA
- Department of Psychiatry & Human Behavior, Warren Alpert Medical School, Brown University, Providence, RI, USA
| |
Collapse
|
15
|
Clare L, Teale JC, Toms G, Kudlicka A, Evans I, Abrahams S, Goldstein LH, Hindle JV, Ho AK, Jahanshahi M, Langdon D, Morris R, Snowden JS, Davies R, Markova I, Busse M, Thompson-Coon J. Cognitive rehabilitation, self-management, psychotherapeutic and caregiver support interventions in progressive neurodegenerative conditions: A scoping review. NeuroRehabilitation 2019; 43:443-471. [DOI: 10.3233/nre-172353] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Affiliation(s)
- Linda Clare
- Centre for Research in Ageing and Cognitive Health, University of Exeter, Exeter, UK
- PenCLAHRC, University of Exeter Medical School, Exeter, UK
- Centre for Research Excellence in Cognitive Health, Australian National University, Canberra City, ACT, Australia
| | | | - Gill Toms
- Wales School for Social Care Research, Bangor University, Bangor, Wales, UK
| | - Aleksandra Kudlicka
- Centre for Research in Ageing and Cognitive Health, University of Exeter, Exeter, UK
- PenCLAHRC, University of Exeter Medical School, Exeter, UK
| | - Isobel Evans
- Centre for Research in Ageing and Cognitive Health, University of Exeter, Exeter, UK
| | - Sharon Abrahams
- Psychology-PPLS and Euan MacDonald Centre for Motor Neurone Disease Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Laura H. Goldstein
- King’s College London, Institute of Psychiatry, Psychology and Neuroscience, London, UK
| | - John V. Hindle
- Centre for Research in Ageing and Cognitive Health, University of Exeter, Exeter, UK
| | - Aileen K. Ho
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
| | | | - Dawn Langdon
- Department of Psychology, Royal Holloway University of London, London, UK
| | - Robin Morris
- King’s College London, Institute of Psychiatry, Psychology and Neuroscience, London, UK
| | - Julie S. Snowden
- Cerebral Function Unit, Salford Royal NHS Foundation Trust, Salford, UK
| | - Rhys Davies
- Walton Centre NHS Foundation Trust, Liverpool, UK
| | - Ivana Markova
- Hull York Medical School, University of Hull, Hull, UK
| | - Monica Busse
- School of Medicine, Cardiff University, Cardiff, Wales, UK
| | | |
Collapse
|
16
|
Kalb R, Beier M, Benedict RH, Charvet L, Costello K, Feinstein A, Gingold J, Goverover Y, Halper J, Harris C, Kostich L, Krupp L, Lathi E, LaRocca N, Thrower B, DeLuca J. Recommendations for cognitive screening and management in multiple sclerosis care. Mult Scler 2018; 24:1665-1680. [PMID: 30303036 PMCID: PMC6238181 DOI: 10.1177/1352458518803785] [Citation(s) in RCA: 229] [Impact Index Per Article: 38.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Purpose: To promote understanding of cognitive impairment in multiple sclerosis (MS), recommend optimal screening, monitoring, and treatment strategies, and address barriers to optimal management. Methods: The National MS Society (“Society”) convened experts in cognitive dysfunction (clinicians, researchers, and lay people with MS) to review the published literature, reach consensus on optimal strategies for screening, monitoring, and treating cognitive changes, and propose strategies to address barriers to optimal care. Recommendations: Based on current evidence, the Society makes the following recommendations, endorsed by the Consortium of Multiple Sclerosis Centers and the International Multiple Sclerosis Cognition Society:
Collapse
Affiliation(s)
- Rosalind Kalb
- National Multiple Sclerosis Society, New York, NY, USA
| | - Meghan Beier
- Division of Rehabilitation Psychology and Neuropsychology, Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | | - Leigh Charvet
- Department of Neurology, Langone Medical Center, New York University, New York, NY, USA
| | | | - Anthony Feinstein
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | | | | | - June Halper
- The Consortium of Multiple Sclerosis Centers and International Organization of Multiple Sclerosis Nurses, Multiple Sclerosis Nurses International Certification Board, Hackensack, NJ, USA
| | - Colleen Harris
- Multiple Sclerosis Center, University of Calgary, Calgary, AB, Canada
| | - Lori Kostich
- The Mandell Center for Multiple Sclerosis, Mount Sinai Rehabilitation Hospital, Hartford, CT, USA
| | - Lauren Krupp
- Department of Neurology, NYU Langone Health, New York University, New York, NY, USA
| | - Ellen Lathi
- The Elliot Lewis Center for Multiple Sclerosis Care, Wellesley, MA, USA
| | | | - Ben Thrower
- Emory University, Atlanta, GA, USA/Andrew C. Carlos Multiple Sclerosis Institute at Shepherd Center, Atlanta, GA, USA
| | - John DeLuca
- Department of Physical Medicine and Rehabilitation and Department of Neurology, Rutgers New Jersey Medical School, Newark, NJ, USA
| |
Collapse
|
17
|
Role of Demographic and Clinical Factors in Cognitive Functioning of Persons with Relapsing-Remitting and Progressive Multiple Sclerosis. J Int Neuropsychol Soc 2018; 24:139-146. [PMID: 28830576 DOI: 10.1017/s1355617717000777] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
BACKGROUND Age and time post-diagnosis can significantly impact cognitive and motor functions in multiple sclerosis (MS); however, studies often fail to account for these factors when assessing differences between disease courses. OBJECTIVES Examine differences between relapsing-remitting and progressive MS in cognition, motor function, and everyday activities, controlling for age, education, and time post-diagnosis. METHODS Twenty-one persons with relapsing-remitting MS (RRMS group), 21 with progressive MS (PMS group), and 21 healthy participants (HCs), matched on age, education, and time post-diagnosis, completed tests of cognitive abilities, motor functions, and everyday functional activities. RESULTS The two groups with MS did not differ on cognitive performance. Poorer performance in processing speed was noted in both MS groups in comparison with the HC group. Motor function was worse for the PMS group compared with the HC and RRMS groups. The RRMS group showed poorer upper limb functioning compared to the HC group. The PMS group had more difficulty with everyday activities as compared with both the RRMS and HC group. CONCLUSIONS When comparing differences in functioning between MS disease courses, attention should be paid to the demographic characteristics of the samples. (JINS, 2018, 24, 139-146).
Collapse
|
18
|
Goverover Y, Sandroff BM, DeLuca J. Dual Task of Fine Motor Skill and Problem Solving in Individuals With Multiple Sclerosis: A Pilot Study. Arch Phys Med Rehabil 2017; 99:635-640. [PMID: 29108966 DOI: 10.1016/j.apmr.2017.10.012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2017] [Revised: 10/06/2017] [Accepted: 10/14/2017] [Indexed: 10/18/2022]
Abstract
OBJECTIVES To (1) examine and compare dual-task performance in patients with multiple sclerosis (MS) and healthy controls (HCs) using mathematical problem-solving questions that included an everyday competence component while performing an upper extremity fine motor task; and (2) examine whether difficulties in dual-task performance are associated with problems in performing an everyday internet task. DESIGN Pilot study, mixed-design with both a within and between subjects' factor. SETTING A nonprofit rehabilitation research institution and the community. PARTICIPANTS Participants (N=38) included persons with MS (n=19) and HCs (n=19) who were recruited from a nonprofit rehabilitation research institution and from the community. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURES Participant were presented with 2 testing conditions: (1) solving mathematical everyday problems or placing bolts into divots (single-task condition); and (2) solving problems while putting bolts into divots (dual-task condition). Additionally, participants were required to perform a test of everyday internet competence. RESULTS As expected, dual-task performance was significantly worse than either of the single-task tasks (ie, number of bolts into divots or correct answers, and time to answer the questions). Cognitive but not motor dual-task cost was associated with worse performance in activities of everyday internet tasks. CONCLUSIONS Cognitive dual-task cost is significantly associated with worse performance of everyday technology. This was not observed in the motor dual-task cost. The implications of dual-task costs on everyday activity are discussed.
Collapse
Affiliation(s)
- Y Goverover
- Department of Occupational Therapy, New York University, New York, NY; Kessler Foundation, East Hanover, NJ.
| | - B M Sandroff
- Kessler Foundation, East Hanover, NJ; Department of Physical Therapy, University of Alabama at Birmingham, Birmingham, AL
| | - J DeLuca
- Kessler Foundation, East Hanover, NJ; Department of Physical Medicine and Rehabilitation, Rutgers University-New Jersey Medical School, Newark, NJ
| |
Collapse
|
19
|
Benedict RH, DeLuca J, Phillips G, LaRocca N, Hudson LD, Rudick R. Validity of the Symbol Digit Modalities Test as a cognition performance outcome measure for multiple sclerosis. Mult Scler 2017; 23:721-733. [PMID: 28206827 PMCID: PMC5405816 DOI: 10.1177/1352458517690821] [Citation(s) in RCA: 521] [Impact Index Per Article: 74.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Cognitive and motor performance measures are commonly employed in multiple sclerosis (MS) research, particularly when the purpose is to determine the efficacy of treatment. The increasing focus of new therapies on slowing progression or reversing neurological disability makes the utilization of sensitive, reproducible, and valid measures essential. Processing speed is a basic elemental cognitive function that likely influences downstream processes such as memory. The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) includes representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with MS. Among the MSOAC goals is acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful to persons with MS. A critical step for these neuroperformance metrics is elucidation of clinically relevant benchmarks, well-defined degrees of disability, and gradients of change that are deemed clinically meaningful. This topical review provides an overview of research on one particular cognitive measure, the Symbol Digit Modalities Test (SDMT), recognized as being particularly sensitive to slowed processing of information that is commonly seen in MS. The research in MS clearly supports the reliability and validity of this test and recently has supported a responder definition of SDMT change approximating 4 points or 10% in magnitude.
Collapse
Affiliation(s)
- Ralph Hb Benedict
- Department of Neurology and Buffalo General Medical Center, University at Buffalo, Buffalo, NY, USA
| | - John DeLuca
- Kessler Foundation, West Orange, NJ, USA; Rutgers New Jersey Medical School, Newark, NJ, USA
| | | | | | | | | | -
- Multiple Sclerosis Outcome Assessments Consortium (MSOAC), Critical Path Institute, Tucson, AZ, USA
| |
Collapse
|