1
|
Adriasola A, Torres SC, Cañada Y, Chicchi Giglioli IA, García-Blanco A, Sierra P, López-Cerveró M, Chloe BR, Navalón P, Mariano AR. Assessing Executive Functioning in Schizophrenia: Concurrent and Discriminative Validity of a Novel Virtual Cooking Task. CYBERPSYCHOLOGY, BEHAVIOR AND SOCIAL NETWORKING 2024. [PMID: 38860351 DOI: 10.1089/cyber.2023.0443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2024]
Abstract
Deficits in executive functions (EF) are strongly related to real-life functioning and negative symptoms (NS) in schizophrenia. Recently, virtual reality has enabled more ecologically valid approaches to assess EF in simulated "real-life" scenarios among which the virtual cooking task (VCT) has gained attention. However, the clinical implications of the VCT in schizophrenia have not been investigated exhaustively. In this study, clinically stable individuals with schizophrenia (n = 38) and healthy controls (n = 42) completed a novel VCT and a set of computerized standard EF tools (CST) to primarily investigate concurrent and discriminant validity. In addition, the study explored links between EF assessments, functioning, and NS while controlling for antipsychotic intake, clinical stability, and age. This VCT consisted of four tasks with increasing difficulty and time constraints. The most relevant findings indicate that (1) the VCT showed moderate to strong correlations with CST, (2) the VCT discriminated EF performance between both the groups, (3) the VCT predicted interpersonal functioning, and (4) the VCT predicted NS in greater extent than CST. Accordingly, the findings give support to the concurrent and discriminant validity of the VCT to assess EF and indicate its value to deepen the study of collateral functional deficits and NS in schizophrenia.
Collapse
Affiliation(s)
- Asier Adriasola
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
| | - Sergio C Torres
- Human-Centred Technology Institute (Human-tech), Polytechnic University of Valencia, Valencia, Spain
| | - Yolanda Cañada
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
- Mental Health Research Group, La Fe Health Research Institute, Valencia, Spain
| | | | - Ana García-Blanco
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
- Mental Health Research Group, La Fe Health Research Institute, Valencia, Spain
- Department of Psychology, University of Valencia, Valencia, Spain
| | - Pilar Sierra
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
- Mental Health Research Group, La Fe Health Research Institute, Valencia, Spain
- Department of Medicine, University of Valencia, Valencia, Spain
| | - María López-Cerveró
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
| | - Blanes Rodríguez Chloe
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
| | - Pablo Navalón
- Division of Psychiatry and Clinical Psychology, La Fe University and Polytechnic Hospital, Valencia, Spain
- Mental Health Research Group, La Fe Health Research Institute, Valencia, Spain
| | - Alcañiz Raya Mariano
- Human-Centred Technology Institute (Human-tech), Polytechnic University of Valencia, Valencia, Spain
| |
Collapse
|
2
|
Suchy Y, DesRuisseaux LA, Gereau Mora M, Brothers SL, Niermeyer MA. Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action. J Int Neuropsychol Soc 2024; 30:499-522. [PMID: 38251679 DOI: 10.1017/s1355617723000735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
OBJECTIVE "Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid. METHOD MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used. RESULTS About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations). CONCLUSIONS Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).
Collapse
Affiliation(s)
- Yana Suchy
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | | | | | | | - Madison A Niermeyer
- Department of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
3
|
Xie X, Shi R, Yu H, Wan X, Liu T, Duan D, Li D, Wen D. Executive function rehabilitation and evaluation based on brain-computer interface and virtual reality: our opinion. Front Neurosci 2024; 18:1377097. [PMID: 38808030 PMCID: PMC11130371 DOI: 10.3389/fnins.2024.1377097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/29/2024] [Indexed: 05/30/2024] Open
Affiliation(s)
- Xueguang Xie
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Ruihang Shi
- School of Information Science and Engineering, Yanshan University, Qinhuangdao, Hebei, China
| | - Hao Yu
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Xianglong Wan
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Tiange Liu
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Dingna Duan
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Danyang Li
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Dong Wen
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| |
Collapse
|
4
|
Suchy Y, Gereau Mora M, Brothers SL, DesRuisseaux LA. Six elements test vs D-KEFS: what does "Ecological Validity" tell us? J Int Neuropsychol Soc 2024; 30:350-359. [PMID: 38465734 DOI: 10.1017/s1355617723000723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
OBJECTIVE Extensive research shows that tests of executive functioning (EF) predict instrumental activities of daily living (IADLs) but are nevertheless often criticized for having poor ecological validity. The Modified Six Elements Test (MSET) is a pencil-and-paper test that was developed to mimic the demands of daily life, with the assumption that this would result in a more ecologically valid test. Although the MSET has been extensively validated in its ability to capture cognitive deficits in various populations, support for its ability to predict functioning in daily life is mixed. This study aimed to examine the MSET's ability to predict IADLs assessed via three different modalities relative to traditional EF measures. METHOD Participants (93 adults aged 60 - 85) completed the MSET, traditional measures of EF (Delis-Kaplan Executive Function System; D-KEFS), and self-reported and performance-based IADLs in the lab. Participants then completed three weeks of IADL tasks at home, using the Daily Assessment of Independent Living and Executive Skills (DAILIES) protocol. RESULTS The MSET predicted only IADLs completed at home, while the D-KEFS predicted IADLs across all three modalities. Further, the D-KEFS predicted home-based IADLs beyond the MSET when pitted against each other, whereas the MSET did not contribute beyond the D-KEFS. CONCLUSIONS Traditional EF tests (D-KEFS) appear to be superior to the MSET in predicting IADLs in community-dwelling older adults. The present results argue against replacing traditional measures with the MSET when addressing functional independence of generally high-functioning and cognitive healthy older adult patients.
Collapse
Affiliation(s)
- Yana Suchy
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | | | | | | |
Collapse
|
5
|
Kirkham R, Kooijman L, Albertella L, Myles D, Yücel M, Rotaru K. Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review. JMIR Serious Games 2024; 12:e50282. [PMID: 38407958 DOI: 10.2196/50282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 11/26/2023] [Accepted: 12/29/2023] [Indexed: 02/27/2024] Open
Abstract
BACKGROUND Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)-based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility. OBJECTIVE This systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects. METHODS EBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings. RESULTS The search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments. CONCLUSIONS Although it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.
Collapse
Affiliation(s)
- Rebecca Kirkham
- Turner Institute for Brain and Mental Health, School of Psychological Sciences and Monash Biomedical Imaging Facility, Monash University, Clayton, Australia
| | - Lars Kooijman
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Lucy Albertella
- Turner Institute for Brain and Mental Health, School of Psychological Sciences and Monash Biomedical Imaging Facility, Monash University, Clayton, Australia
| | - Dan Myles
- Turner Institute for Brain and Mental Health, School of Psychological Sciences and Monash Biomedical Imaging Facility, Monash University, Clayton, Australia
| | - Murat Yücel
- Queensland Institute of Medical Research Berghofer Medical Research Institute, Herston, Australia
- Department of Psychiatry, School of Clinical Sciences, Monash University, Clayton, Australia
| | - Kristian Rotaru
- Turner Institute for Brain and Mental Health, School of Psychological Sciences and Monash Biomedical Imaging Facility, Monash University, Clayton, Australia
- Monash Business School, Monash University, Caufield, Australia
| |
Collapse
|
6
|
Howlett CA, Miles S, Berryman C, Phillipou A, Moseley GL. Conflation between self-report and neurocognitive assessments of cognitive flexibility: a critical review of the Jingle Fallacy. AUSTRALIAN JOURNAL OF PSYCHOLOGY 2023. [DOI: 10.1080/00049530.2023.2174684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2023]
Affiliation(s)
- Caitlin A. Howlett
- Innovation, Implementation & Clinical Translation (IIMPACT) in Health, University of South Australia, Kaurna Country, Adelaide, Australia
| | - Stephanie Miles
- Centre for Mental Health, Swinburne University of Technology, Melbourne, Australia
| | - Carolyn Berryman
- Innovation, Implementation & Clinical Translation (IIMPACT) in Health, University of South Australia, Kaurna Country, Adelaide, Australia
- Brain Stimulation, Imaging and Cognition Research Group, School of Medicine, The University of Adelaide, Adelaide, Australia
| | - Andrea Phillipou
- Centre for Mental Health, Swinburne University of Technology, Melbourne, Australia
- Department of Mental Health, St Vincent’s Hospital, Melbourne, Australia
- Department of Psychiatry, The University of Melbourne, Melbourne, Australia
- Department of Mental Health, Austin Health, Melbourne, Australia
| | - G. Lorimer Moseley
- Innovation, Implementation & Clinical Translation (IIMPACT) in Health, University of South Australia, Kaurna Country, Adelaide, Australia
| |
Collapse
|
7
|
Wiebe A, Kannen K, Selaskowski B, Mehren A, Thöne AK, Pramme L, Blumenthal N, Li M, Asché L, Jonas S, Bey K, Schulze M, Steffens M, Pensel MC, Guth M, Rohlfsen F, Ekhlas M, Lügering H, Fileccia H, Pakos J, Lux S, Philipsen A, Braun N. Virtual reality in the diagnostic and therapy for mental disorders: A systematic review. Clin Psychol Rev 2022; 98:102213. [PMID: 36356351 DOI: 10.1016/j.cpr.2022.102213] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 08/21/2022] [Accepted: 10/11/2022] [Indexed: 01/27/2023]
Abstract
BACKGROUND Virtual reality (VR) technologies are playing an increasingly important role in the diagnostics and treatment of mental disorders. OBJECTIVE To systematically review the current evidence regarding the use of VR in the diagnostics and treatment of mental disorders. DATA SOURCE Systematic literature searches via PubMed (last literature update: 9th of May 2022) were conducted for the following areas of psychopathology: Specific phobias, panic disorder and agoraphobia, social anxiety disorder, generalized anxiety disorder, posttraumatic stress disorder (PTSD), obsessive-compulsive disorder, eating disorders, dementia disorders, attention-deficit/hyperactivity disorder, depression, autism spectrum disorder, schizophrenia spectrum disorders, and addiction disorders. ELIGIBILITY CRITERIA To be eligible, studies had to be published in English, to be peer-reviewed, to report original research data, to be VR-related, and to deal with one of the above-mentioned areas of psychopathology. STUDY EVALUATION For each study included, various study characteristics (including interventions and conditions, comparators, major outcomes and study designs) were retrieved and a risk of bias score was calculated based on predefined study quality criteria. RESULTS Across all areas of psychopathology, k = 9315 studies were inspected, of which k = 721 studies met the eligibility criteria. From these studies, 43.97% were considered assessment-related, 55.48% therapy-related, and 0.55% were mixed. The highest research activity was found for VR exposure therapy in anxiety disorders, PTSD and addiction disorders, where the most convincing evidence was found, as well as for cognitive trainings in dementia and social skill trainings in autism spectrum disorder. CONCLUSION While VR exposure therapy will likely find its way successively into regular patient care, there are also many other promising approaches, but most are not yet mature enough for clinical application. REVIEW REGISTRATION PROSPERO register CRD42020188436. FUNDING The review was funded by budgets from the University of Bonn. No third party funding was involved.
Collapse
Affiliation(s)
- Annika Wiebe
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Kyra Kannen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Benjamin Selaskowski
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Aylin Mehren
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Ann-Kathrin Thöne
- School of Child and Adolescent Cognitive Behavior Therapy (AKiP), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lisa Pramme
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Nike Blumenthal
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mengtong Li
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Laura Asché
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Stephan Jonas
- Institute for Digital Medicine, University Hospital Bonn, Bonn, Germany
| | - Katharina Bey
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Marcel Schulze
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Maria Steffens
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Max Christian Pensel
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Matthias Guth
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Felicia Rohlfsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mogda Ekhlas
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Lügering
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Fileccia
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Julian Pakos
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Silke Lux
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Alexandra Philipsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Niclas Braun
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany.
| |
Collapse
|
8
|
Seesjärvi E, Puhakka J, Aronen ET, Hering A, Zuber S, Merzon L, Kliegel M, Laine M, Salmi J. EPELI: a novel virtual reality task for the assessment of goal-directed behavior in real-life contexts. PSYCHOLOGICAL RESEARCH 2022:10.1007/s00426-022-01770-z. [PMID: 36418557 PMCID: PMC10366028 DOI: 10.1007/s00426-022-01770-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 11/06/2022] [Indexed: 11/27/2022]
Abstract
AbstractA recently developed virtual reality task, EPELI (Executive Performance in Everyday LIving), quantifies goal-directed behavior in naturalistic conditions. Participants navigate a virtual apartment, performing household chores given by a virtual character. EPELI aims to tap attention, executive function, and prospective memory. To ensure its applicability to further research and clinical work and to study its relationship to relevant background factors, we examined several key properties of EPELI in 77 typically developing 9–13-year-old children. These included EPELI’s internal consistency, age and gender differences, sensitivity to gaming experience, head-mounted display (HMD) type, and verbal recall ability, as well as its relationships with parent-rated everyday executive problems. Of the eight EPELI measures, the following six showed acceptable internal consistency: task and navigation efficacy, number of correctly performed tasks and overall actions, time monitoring, and controller movement. Some measures were associated with age, gender, or verbal encoding ability. Moreover, EPELI performance was associated with parent-rated everyday executive problems. There were no significant associations of gaming background, task familiarity, or HMD type with the EPELI measures. These results attest to the reliability and ecological validity of this new virtual reality tool for the assessment of attention, executive functions, and prospective memory in children.
Collapse
|
9
|
Borgnis F, Baglio F, Pedroli E, Rossetto F, Uccellatore L, Oliveira JAG, Riva G, Cipresso P. Available Virtual Reality-Based Tools for Executive Functions: A Systematic Review. Front Psychol 2022; 13:833136. [PMID: 35478738 PMCID: PMC9036486 DOI: 10.3389/fpsyg.2022.833136] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 03/17/2022] [Indexed: 12/01/2022] Open
Abstract
Introduction Executive dysfunctions constitute a significant public health problem: their high impact on everyday life makes it a priority to identify early strategies for evaluating and rehabilitating these disorders in a real-life context. The ecological limitation of traditional neuropsychological tests and several difficulties in administering tests or training in real-life scenarios have paved the way to use Virtual Reality-based tools to evaluate and rehabilitate Executive Functions (EFs) in real-life. Objective This work aims to conduct a systematic review to provide a detailed description of the VR-based tools currently developed for the evaluation and rehabilitation of EFs. Methods We systematically searched for original manuscripts regarding VR tools and EFs by looking for titles and abstracts in the PubMed, Scopus, PsycInfo, and Web of Science databases up to November 2021 that contained the following keywords “Virtual Reality” AND “Executive function*.” Results and Conclusion We analyzed 301 articles, of which 100 were included. Our work shows that available VR-based tools appear promising solutions for an ecological assessment and treatment of EFs in healthy subjects and several clinical populations.
Collapse
Affiliation(s)
- Francesca Borgnis
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, Milan, Italy
- Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
| | | | - Elisa Pedroli
- Applied Technology for Neuro-Psychology Lab, Istituto Auxologico Italiano, Istituto di Ricovero e Cura a Carattere Scientifico, Milan, Italy
- Faculty of Psychology, eCampus University, Milan, Italy
| | | | - Lidia Uccellatore
- Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
| | | | - Giuseppe Riva
- Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
- Applied Technology for Neuro-Psychology Lab, Istituto Auxologico Italiano, Istituto di Ricovero e Cura a Carattere Scientifico, Milan, Italy
| | - Pietro Cipresso
- Applied Technology for Neuro-Psychology Lab, Istituto Auxologico Italiano, Istituto di Ricovero e Cura a Carattere Scientifico, Milan, Italy
- Department of Psychology, University of Turin, Turin, Italy
- *Correspondence: Pietro Cipresso
| |
Collapse
|