1
|
Arcara G. Improving equivalent scores for clinical neuropsychology: a new method for regression model selection. Neurol Sci 2024; 45:5685-5695. [PMID: 39419898 DOI: 10.1007/s10072-024-07806-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Accepted: 09/17/2024] [Indexed: 10/19/2024]
Abstract
Equivalent Scores (ES) represent a statistical gold standard to obtain thresholds for clinical inference from normative data. The procedure to obtain ES requires a preliminary mandatory step: to perform a regression model selection to obtain adjusted scores that take into account age, education, and sex. The current article, starting from theoretical considerations, focuses on this step and proposes a new and improved regression model selection method. Results from data simulation show that the newly proposed method outperforms the current one on a wide range of simulation parameters and conditions, leading to better performance in classifying impaired or unimpaired performances, and more precise ES. The article is associated with an online app and R code to allow to easily apply the method to other normative data. This new model selection procedure can be easily incorporated also with other regression-based norm approaches.
Collapse
Affiliation(s)
- Giorgio Arcara
- IRCCS San Camillo Hospital, Venice, Italy.
- University of Padua, Padua, Italy.
| |
Collapse
|
2
|
Pucci V, Contemori G, Saccani MS, Arcara G, Mondini S, Bonato M. Auto-Global Examination of Mental State (Auto-GEMS): a web-based self-administered cognitive screening. Aging Clin Exp Res 2024; 36:216. [PMID: 39527293 PMCID: PMC11554820 DOI: 10.1007/s40520-024-02862-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 10/03/2024] [Indexed: 11/16/2024]
Abstract
Recent methodological developments have contributed to a significant advance in computerised neuropsychological instruments and procedures, including those accessible from remote. In this paper we present Auto-GEMS, a newly developed, web-based, self-administered screening test allowing to quickly estimate an individual's cognitive state also considering their cognitive reserve. Auto-GEMS measures cognitive functioning on eleven items similarly to the in-person paper-and-pencil version (GEMS) and to the remote (phone or video call) version (Tele-GEMS) of the same screening. We collected normative data on a sample of 1308 Italian-speaking participants (age range 18-93) to verify its psychometric properties and computed regression models on demographic variables to establish clinical cut-offs. The psychometric properties of Auto-GEMS have shown good internal consistency, test-retest reliability and convergent validity. This short and user-friendly tool has a number of potential applications. For instance, it can be useful in clinical practice to monitor the cognitive profile of patients or vulnerable individuals, or even administered in a face-to-face, standard clinical setting. It can also be used in research studies to screen participants. The testing materials and the collected data are freely available in a digital archive along with a web App to visualise the test outcome with reference to its normative data.
Collapse
Affiliation(s)
- Veronica Pucci
- Department of Philosophy, Sociology, Education and Applied Psychology, Department of Developmental and Social Psychology and Socialization, and Human Inspired Technology Centre (HIT), University of Padua, Padua, Italy.
| | - Giulio Contemori
- Department of General Psychology, University of Padua, Padua, Italy.
| | - Maria Silvia Saccani
- Padua Neuroscience Centre, University of Padua, Padua, Italy
- IRCSS, San-Camillo Hospital, Venice, Italy
| | - Giorgio Arcara
- Department of General Psychology, University of Padua, Padua, Italy
- IRCSS, San-Camillo Hospital, Venice, Italy
| | - Sara Mondini
- Department of Philosophy, Sociology, Education and Applied Psychology, Department of Developmental and Social Psychology and Socialization, and Human Inspired Technology Centre (HIT), University of Padua, Padua, Italy
- IRCSS, San-Camillo Hospital, Venice, Italy
| | - Mario Bonato
- Department of General Psychology, University of Padua, Padua, Italy.
- Padua Neuroscience Centre, University of Padua, Padua, Italy.
| |
Collapse
|
3
|
Panzavolta A, Cerami C, Caffarra P, De Vita D, Dodich A, Fonti C, L'Abbate F, Laganà V, Lavorgna L, Marra C, Papagno C, Pellegrini FF, Stracciari A, Trojano L, Iaquinta T, Ravizza A, Sternini F, Pandolfi R, Sanzone S, Calore M, Cappa SF. A digital teleneuropsychology platform for the diagnosis of mild cognitive impairment: from concept to certification as a medical device. Neurol Sci 2024; 45:3125-3135. [PMID: 38378904 DOI: 10.1007/s10072-024-07403-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 02/12/2024] [Indexed: 02/22/2024]
Abstract
BACKGROUND Innovative digital solutions are shaping a new concept of dementia care, opening additional venues for prevention, diagnosis, monitoring and treatment. Hereby, we report the development of a tablet-based teleneuropsychology platform (Tenèpsia®), from concept to certification as Medical Device (MD) Class IIA, as per new MD regulation 745/2017. METHODS The platform was designed for the remote cognitive evaluation and created thanks to the effort of a collaborative working group including experts from three Italian scientific societies and Biogen Italia S.r.l. (hereafter "Biogen"), and developers from Xenia Reply and Inside AI. The development strategy was guided by converting traditional paper-and-pencil tests into digital versions while maintaining comparable neuropsychological features and optimizing patient accessibility and user experience. The experts focused on the choice and adaptation of traditional neuropsychology measures for a 45-min teleneuropsychology assessment. RESULTS The developers created a web and a mobile interface, respectively, for the professional (neuropsychologist) and non-professional (patient and caregiver) use. Recording of voice, drawing and typing information was enabled. Instant dashboards provide a quick overview of the patient's condition. Simulation activities were performed to obtain MD certification, valid across Europe. CONCLUSION Neuropsychology services will benefit from the implementation in clinics of harmonized digital tools with adequate scientific and technological standards. The use of digital cognitive testing for the diagnosis of mild cognitive impairment is expected to enhance patient and clinician outcomes through simplified, digital objective data collection, sparing of time and resources, with a positive impact on healthcare costs and access to treatments, reducing inequalities and delays in diagnosis and cure.
Collapse
Affiliation(s)
- Andrea Panzavolta
- IUSS Cognitive Neuroscience (ICoN) Center, Scuola Universitaria Di Studi Superiori IUSS, Piazza Della Vittoria 15, 27100, Pavia, Italy
| | - Chiara Cerami
- IUSS Cognitive Neuroscience (ICoN) Center, Scuola Universitaria Di Studi Superiori IUSS, Piazza Della Vittoria 15, 27100, Pavia, Italy.
- Dementia Research Center, Mondino Foundation IRCCS, Pavia, Italy.
| | - Paolo Caffarra
- Membro esperto Tavolo permanente sulle demenze del Ministero della Salute, Rome, Italy
| | - Dalila De Vita
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Alessandra Dodich
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy
| | - Cristina Fonti
- IRCCS, Istituto Delle Scienze Neurologiche di Bologna, Bologna, Italy
| | - Federica L'Abbate
- Neurology Unit, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Rome, Italy
| | - Valentina Laganà
- Associazione Per La Ricerca Neurogenetica Odv, Lamezia Terme, Italy
| | - Luigi Lavorgna
- Clinica Neurologica I, Azienda Ospedaliera Universitaria, University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Camillo Marra
- Neurology Unit, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Rome, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Costanza Papagno
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy
| | | | - Andrea Stracciari
- Membro esperto Tavolo permanente sulle demenze del Ministero della Salute, Rome, Italy
| | - Luigi Trojano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | | | | | - Federico Sternini
- InsideAI, Bologna, Italy
- PolitoBIOMed Lab, Politecnico Di Torino, Turin, Italy
| | | | | | | | - Stefano F Cappa
- IUSS Cognitive Neuroscience (ICoN) Center, Scuola Universitaria Di Studi Superiori IUSS, Piazza Della Vittoria 15, 27100, Pavia, Italy
- Dementia Research Center, Mondino Foundation IRCCS, Pavia, Italy
| |
Collapse
|
4
|
Contemori G, Saccani MS, Bonato M. Cognitive-Cognitive Dual-task in aging: A cross-sectional online study. PLoS One 2024; 19:e0302152. [PMID: 38848421 PMCID: PMC11161073 DOI: 10.1371/journal.pone.0302152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 03/28/2024] [Indexed: 06/09/2024] Open
Abstract
The prevalence of neurodegenerative disorders, particularly dementia, is on the rise across many countries worldwide. This negative trend calls for improving our understanding of cognitive aging. While motor-cognitive dual-task approaches have already been proven valuable for clinical diagnosis, comparatively less research is available on the application of Cognitive-Cognitive Dual-Tasking (CCDT), across several cognitive domains. Moreover, there is limited understanding about how healthy aging affects performance in such dual-tasks in the general population. CCDT entails engaging individuals in multiple cognitive tasks simultaneously and holds promise for remote e-Health interventions. In this cross-sectional study, our objective was to evaluate the suitability of a newly developed, self-administered, online tool for examining age-related differences in memory performance under dual-tasking. 337 healthy adults aged 50-90 underwent a visual memory test (Memo) under both single and dual-task conditions (attend to auditory letters). Additional measures included questionnaires on subjective memory complaints (MAC-Q), on cognitive reserve (CR), and a cognitive screening (auto-GEMS). As expected, the accuracy of visual memory performance exhibited a negative correlation with age and MAC-Q, and a positive correlation with CR and auto-GEMS scores. Dual-tasking significantly impaired performance, and its detrimental effect decreased with increasing age. Furthermore, the protective effect of cognitive reserve diminished with advancing age. These findings suggest that the commonly observed age-related increase in dual-task costs is not universally applicable across all tasks and cognitive domains. With further refinement, a longitudinal implementation of this approach may assist in identifying individuals with a distinct cognitive trajectory and potentially at a higher risk of developing cognitive decline.
Collapse
Affiliation(s)
- Giulio Contemori
- Department of General Psychology, University of Padova, Padova, Italy
| | - Maria Silvia Saccani
- Department of General Psychology, University of Padova, Padova, Italy
- Padova Neuroscience Center, Padova, Italy
| | - Mario Bonato
- Department of General Psychology, University of Padova, Padova, Italy
- Padova Neuroscience Center, Padova, Italy
| |
Collapse
|
5
|
Aiello EN, Pucci V, Diana L, Corvaglia A, Niang A, Mattiello S, Preti AN, Durante G, Ravelli A, Consonni L, Guerra C, Ponti AD, Sangalli G, Difonzo T, Scarano S, Perucca L, Zago S, Appollonio I, Mondini S, Bolognini N. The Telephone Language Screener (TLS): standardization of a novel telephone-based screening test for language impairment. Neurol Sci 2024; 45:1989-2001. [PMID: 38010584 PMCID: PMC11021315 DOI: 10.1007/s10072-023-07149-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 10/19/2023] [Indexed: 11/29/2023]
Abstract
BACKGROUND This study aimed at developing and standardizing the Telephone Language Screener (TLS), a novel, disease-nonspecific, telephone-based screening test for language disorders. METHODS The TLS was developed in strict pursuance to the current psycholinguistic standards. It comprises nine tasks assessing phonological, lexical-semantic and morpho-syntactic components, as well as an extra Backward Digit Span task. The TLS was administered to 480 healthy participants (HPs), along with the Telephone-based Semantic Verbal Fluency (t-SVF) test and a Telephone-based Composite Language Index (TBCLI), as well as to 37 cerebrovascular/neurodegenerative patients-who also underwent the language subscale of the Telephone Interview for Cognitive Status (TICS-L). An HP subsample was also administered an in-person language battery. Construct validity, factorial structure, internal consistency, test-retest and inter-rater reliability were tested. Norms were derived via Equivalent Scores. The capability of the TLS to discriminate patients from HPs and to identify, among the patient cohort, those with a defective TICS-L, was also examined. RESULTS The TLS was underpinned by a mono-component structure and converged with the t-SVF (p < .001), the TBCLI (p < .001) and the in-person language battery (p = .002). It was internally consistent (McDonald's ω = 0.67) and reliable between raters (ICC = 0.99) and at retest (ICC = 0.83). Age and education, but not sex, were predictors of TLS scores. The TLS optimally discriminated patients from HPs (AUC = 0.80) and successfully identified patients with an impaired TICS-L (AUC = 0.92). In patients, the TLS converged with TICS-L scores (p = 0.016). DISCUSSION The TLS is a valid, reliable, normed and clinically feasible telephone-based screener for language impairment.
Collapse
Affiliation(s)
- Edoardo Nicolò Aiello
- PhD Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy.
| | - Veronica Pucci
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
- Human Inspired Technology Research Centre (HIT), University of Padova, Padua, Italy
| | - Lorenzo Diana
- Laboratory of Neuropsychology, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Alessia Corvaglia
- Department of Biomedical and Clinical Sciences "Luigi Sacco", University of Milan, Milan, Italy
| | - Aida Niang
- Department of Psychology, University of Milano-Bicocca, Milan, Italy
| | - Silvia Mattiello
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
| | - Alice Naomi Preti
- PhD Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Giorgia Durante
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
| | - Adele Ravelli
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
| | - Lucia Consonni
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
| | - Carolina Guerra
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
| | - Adriana Delli Ponti
- Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, University of Milano, Milan, Italy
| | - Gaia Sangalli
- Laboratory of Neuropsychology, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Teresa Difonzo
- Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, University of Milano, Milan, Italy
| | - Stefano Scarano
- Department of Neurorehabilitation Sciences, IRCCS Istituto Auxologico Italiano, Milan, Italy
- Department of Biomedical Sciences for Health, University of Milan, Milan, Italy
| | - Laura Perucca
- Department of Neurorehabilitation Sciences, IRCCS Istituto Auxologico Italiano, Milan, Italy
- Department of Biomedical Sciences for Health, University of Milan, Milan, Italy
| | - Stefano Zago
- Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, University of Milano, Milan, Italy
| | - Ildebrando Appollonio
- Neurology Section, School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Sara Mondini
- Dipartimento di Filosofia, Pedagogia e Psicologia Applicata (FISPPA), University of Padova, SociologiaPadua, Italy
- Human Inspired Technology Research Centre (HIT), University of Padova, Padua, Italy
| | - Nadia Bolognini
- Laboratory of Neuropsychology, IRCCS Istituto Auxologico Italiano, Milan, Italy.
- Department of Psychology, University of Milano-Bicocca, Milan, Italy.
| |
Collapse
|
6
|
Maffezzini S, Pucci V, Riccardi A, Montemurro S, Puthenparampil M, Perini P, Rinaldi F, Gallo P, Arcara G, Mondini S. Clinical Profiles in Multiple Sclerosis: Cognitive Reserve and Motor Impairment along Disease Duration. Behav Sci (Basel) 2023; 13:708. [PMID: 37753986 PMCID: PMC10525733 DOI: 10.3390/bs13090708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 08/16/2023] [Accepted: 08/24/2023] [Indexed: 09/28/2023] Open
Abstract
(i) Background: Cognitive impairment in people with multiple sclerosis (MS) has been studied in relation to certain clinical variables (e.g., motor disability and disease duration) and lifestyle factors such as cognitive reserve (CR). However, only very few studies have considered the interaction of clinical variables and cognitive reserve in preserving the integrity of the neuropsychological profile. In this paper, we hypothesised that a higher level of CR might predict good cognitive efficiency by modulating the clinical outcome of the disease. (ii) Methods: A sample of 100 participants with MS (age range 30-74), was recruited and assessed remotely with a questionnaire to measure CR and a cognitive screening test. Data were analysed through generalized additive models. (iii) Results: We found that the model analysing the interaction between CR and disease duration, and between CR and motor disability, was able to explain a significant percentage of cognitive performance. In particular, higher levels of CR predicted a better cognitive performance despite a long disease duration, unless the motor disability was severe. (iv) Conclusion: This study highlights the crucial role of CR in modulating cognitive efficiency in people with MS.
Collapse
Affiliation(s)
- Sabrina Maffezzini
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
| | - Veronica Pucci
- Department of Philosophy, Sociology, Education and Applied Psychology, University of Padua, 35128 Padova, Italy;
- Human Inspired Technology Centre (HIT), University of Padua, 35122 Padova, Italy
| | - Alice Riccardi
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
| | | | - Marco Puthenparampil
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
- Department of Neuroscience, University of Padua, 35128 Padova, Italy
| | - Paola Perini
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
| | - Francesca Rinaldi
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
| | - Paolo Gallo
- Multiple Sclerosis Centre, University-Hospital of Padua, 35128 Padova, Italy; (S.M.); (A.R.); (M.P.); (P.P.); (F.R.); (P.G.)
- Department of Neuroscience, University of Padua, 35128 Padova, Italy
| | - Giorgio Arcara
- IRCCS San Camillo Hospital, 30126 Venice, Italy; (S.M.); (G.A.)
| | - Sara Mondini
- Department of Philosophy, Sociology, Education and Applied Psychology, University of Padua, 35128 Padova, Italy;
- Human Inspired Technology Centre (HIT), University of Padua, 35122 Padova, Italy
| |
Collapse
|