1
|
Waterink L, van der Lee SJ, Nijland D, van der Zee FI, Visser LNC, Pijnenburg YAL, Sikkes SAM, van der Flier WM, Zwan MD. Feasibility and acceptability of remote APOE-genotyping among research volunteers of an online recruitment registry (The Dutch Brain Research Registry). J Prev Alzheimers Dis 2025:100099. [PMID: 40000321 DOI: 10.1016/j.tjpad.2025.100099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2024] [Revised: 01/31/2025] [Accepted: 02/16/2025] [Indexed: 02/27/2025]
Abstract
BACKGROUND Participant recruitment for preclinical Alzheimer's disease (AD) prevention studies is challenging. Online registries facilitate large scale prescreening of individuals at risk for AD to accelerate recruitment. APOE-prescreening has the potential to better identify at-risk individuals. This study investigated the feasibility and acceptability of at-home APOE-genotyping in cognitively-normal registrants of an online registry. METHODS We invited 9,287 cognitively-normal registrants of Dutch Brain Research Registry (DBRR) aged 50 to 75 for at-home APOE-genotype testing, without receiving the results. Feasibility was measured by participation ratio (participation/interested), swab-return ratio (returned-swabs/participation), and genotyping-success ratio (analyzed swabs/returned swabs). Acceptability was measured with online questions about information provision and project scope. We explored prescreening questions potentially reducing screen-failures. RESULTS Feasibility was high with an 0.89 participation ratio (2,886/3,251), 0.90 swab-return ratio (2,886/2,597), 0.99 genotyping-success ratio (2,558/2,597). Acceptability was high, as participants were content with the information provision (87 %-97 %, n= 1,709-1,894), which was also well understood (91 %-93 %, n = 1,772-1,802). Among successful-analyzed swabs (n = 2,558), 27 % participants were APOE-ε4 heterozygote (n = 703), and 2 % homozygote (n = 60). Prescreening on a positive family history leads to a third reduction in the number of invitations needed to identify one APOE-ε4 carrier. CONCLUSION Our results suggest that APOE-ɛ4 genotyping in participants of an online research registry is feasible, well received and could be used to prescreen individuals at risk for AD for prevention studies. Adding a positive family history before invitation for APOE-genotyping, would further improve the prescreening process and reduce screen failures when identifying carriers.
Collapse
Affiliation(s)
- L Waterink
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands.
| | - S J van der Lee
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands; Genomics of Neurodegenerative Diseases and Aging, Human Genetics, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands.
| | - D Nijland
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands; Genomics of Neurodegenerative Diseases and Aging, Human Genetics, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands.
| | - F I van der Zee
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands.
| | - L N C Visser
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands; Department of Medical Psychology, Amsterdam UMC location AMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Public Health research Institute, Quality of Care, Amsterdam, the Netherlands.
| | - Y A L Pijnenburg
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands.
| | - S A M Sikkes
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Faculty of Behavioural and Movement Sciences, Department of Clinical, Neuro and Developmental Psychology, Vrije Universiteit, Amsterdam, the Netherlands.
| | - W M van der Flier
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands; Department of Epidemiology and Data Science, Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
| | - M D Zwan
- Alzheimer Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam UMC location VUmc, Amsterdam, the Netherlands; Amsterdam Neuroscience, Neurodegeneration, Amsterdam, the Netherlands.
| |
Collapse
|
2
|
Patel JS, Christianson TJ, Monahan LT, Frank RD, Fan WZ, Stricker JL, Kremers WK, Karstens AJ, Machulda MM, Fields JA, Hassenstab J, Jack CR, Botha H, Graff-Radford J, Petersen RC, Stricker NH. Usability of the Mayo Test Drive remote self-administered web-based cognitive screening battery in adults aged 35-100 with and without cognitive impairment. J Clin Exp Neuropsychol 2025:1-23. [PMID: 39976252 DOI: 10.1080/13803395.2025.2464633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 02/03/2025] [Indexed: 02/21/2025]
Abstract
BACKGROUND Mayo Test Drive (MTD): Mayo Test Development through Rapid Iteration, Validation and Expansion, is a web-based remote cognitive assessment platform for self-administered neuropsychological measures with previously demonstrated validity and reliability. We examined the usability of MTD and hypothesized that completion rates would be greater than 90%. We explored whether completion and participation rates differed by cognitive status and demographic factors. METHODS A total of 1,950 Mayo Clinic Study of Aging and Mayo Alzheimer's Disease Research Center participants (97% White, 99% Non-Hispanic) were invited to participate in this ancillary, uncompensated remote study. Most invitees were cognitively unimpaired (CU; n = 1,769; 90.7%) and 9.3% were cognitively impaired (CI; n = 181). Usability was objectively defined as the percentage of participants who completed a session after initiating a session for a given timepoint (i.e. completion rates). RESULTS Baseline session completion rates were 98.5% (n = 1199/1217 participants, mean age 71, SD = 12, range 35-100) and were comparable between CU (98.7%) and CI (95.0%) groups (p = .23). Completion rates did not significantly differ by age groups (p > .10) and remained high in individuals 80+ (n = 251, 97.3%). Participation rates were higher in the CU (n = 1142, 65.4%) versus CI (n = 57, 33.1%) group (p < .001); participants were younger and had more years of education (p's < .001). Adherence (i.e. retention) rate for a 7.5-month follow-up session was 89%. Average session duration was 16 min. Most participants used a personal computer (62.7%), followed by a smartphone (22.2%) or tablet (14.8%). Comments entered by 36.4% of participants reflected several themes including acceptability, face validity, usability, and comments informative for session context. CONCLUSIONS MTD demonstrated high usability as defined by completion rates in this research sample that includes a broad age range, though participation rates are lower in individuals with cognitive impairment. Results support good adherence at follow-up, feasibility through mean session duration, and acceptability based on qualitative analysis of participant comments.
Collapse
Affiliation(s)
- Jay S Patel
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| | - Teresa J Christianson
- Division of Biomedical Statistics and Informatics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - Logan T Monahan
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| | - Ryan D Frank
- Division of Biomedical Statistics and Informatics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - Winnie Z Fan
- Division of Biomedical Statistics and Informatics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - John L Stricker
- Department of Information Technology, Mayo Clinic, Rochester, MN, USA
| | - Walter K Kremers
- Division of Biomedical Statistics and Informatics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - Aimee J Karstens
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| | - Mary M Machulda
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| | - Julie A Fields
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| | - Jason Hassenstab
- Department of Neurology and Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | | | - Hugo Botha
- Department of Neurology, Mayo Clinic, Rochester, MN, USA
| | | | | | - Nikki H Stricker
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
3
|
Slotkin J, Kaat AJ, Young SR, Dworak EM, Novack MA, Shono Y, Adam H, Nowinski CJ, Pila S, Hosseinian Z, Varela Diaz M, Almonte-Correa A, Alperin K, Camacho MR, Landavazo B, Nosheny RL, Weiner MW, Gershon RC. Mobile Toolbox sequences task: development and validation of a remote, smartphone-based working memory test. Front Psychol 2025; 15:1497816. [PMID: 39911192 PMCID: PMC11794243 DOI: 10.3389/fpsyg.2024.1497816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Accepted: 12/23/2024] [Indexed: 02/07/2025] Open
Abstract
Objective The ability to assess cognitive skills remotely is increasing with the widespread use and availability of smartphones. The Mobile Toolbox (MTB) is a measurement system that includes Sequences, a new measure of working memory designed specifically for smartphones. This study describes the development of Sequences and presents the studies conducted to evaluate its psychometric properties. Methods We developed a new measure of working memory that can be self-administered remotely using an iOS or Android smartphone. In Sequences, a series of numbers and letters are shown on the screen one at a time, and the participant must first tap the letters they see in alphabetical order, followed by tapping the numbers in ascending numerical order. The Sequences measure was evaluated for usability and feasibility across two pilot studies and then assessed in this validation study (which included a total sample size of N = 1,246). Psychometric properties of the new measure were evaluated in three studies involving participants aged 18-90 years. In Study 1 (N = 92), participants completed MTB measures in a laboratory setting. They were also administered both an equivalent NIH Toolbox (NIHTB) measure along with external measures of similar constructs. In Study 2 (N = 1,007), participants were administered NIHTB measures in the laboratory and then completed MTB measures remotely on their own devices. In Study 3 (N = 147), participants completed MTB measures twice, remotely on their own devices, with a 2-week interval between sessions. Results Sequences exhibited moderately high correlations with a comparable NIHTB test and external measures of a similar construct, while exhibiting a lower correlation with an unrelated test, as hypothesized. Internal consistency was high, but test-retest reliability was moderate. When controlling for age, phone operating system (iOS vs. Android) and sex assigned at birth did not significantly impact performance; however, there was a significant difference between individuals who completed college and those with a high school education or lower. Conclusion The results support the validity of Sequences as a measure of working memory for remote self-administered use. The internal consistency was strong, with moderate test-retest reliability that is likely a function of the test's unproctored self-administration method. The findings suggest that Sequences is appropriate for use with adults aged 18-90 years in remote self-administered designs that focus on group results.
Collapse
Affiliation(s)
- Jerry Slotkin
- Center for Health Assessment Research and Translation, University of Delaware, Newark, DE, United States
| | - Aaron J. Kaat
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Stephanie Ruth Young
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Elizabeth M. Dworak
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Miriam A. Novack
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Yusuke Shono
- School of Community and Global Health, Claremont Graduate University, Claremont, CA, United States
| | - Hubert Adam
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Cindy J. Nowinski
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Sarah Pila
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Zahra Hosseinian
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Maria Varela Diaz
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Anyelo Almonte-Correa
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Keith Alperin
- Helium Foot Software, Inc, Chicago, IL, United States
| | - Monica R. Camacho
- University of California, San Francisco, San Francisco, CA, United States
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, United States
| | - Bernard Landavazo
- University of California, San Francisco, San Francisco, CA, United States
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, United States
| | - Rachel L. Nosheny
- University of California, San Francisco, San Francisco, CA, United States
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, United States
| | - Michael W. Weiner
- University of California, San Francisco, San Francisco, CA, United States
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, United States
| | - Richard C. Gershon
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| |
Collapse
|
4
|
Kang JM, Manjavong M, Jin C, Diaz A, Ashford MT, Eichenbaum J, Thorp E, Wragg E, Zavitz KH, Cormack F, Aaronson A, Mackin RS, Tank R, Landavazo B, Cavallone E, Truran D, Farias ST, Weiner MW, Nosheny RL. Subjective cognitive decline predicts longitudinal neuropsychological test performance in an unsupervised online setting in the Brain Health Registry. Alzheimers Res Ther 2025; 17:10. [PMID: 39773247 PMCID: PMC11706033 DOI: 10.1186/s13195-024-01641-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2024] [Accepted: 12/08/2024] [Indexed: 01/11/2025]
Abstract
BACKGROUNDS Digital, online assessments are efficient means to detect early cognitive decline, but few studies have investigated the relationship between remotely collected subjective cognitive change and cognitive decline. We hypothesized that the Everyday Cognition Scale (ECog), a subjective change measure, predicts longitudinal change in cognition in the Brain Health Registry (BHR), an online registry for neuroscience research. METHODS This study included BHR participants aged 55 + who completed both the baseline ECog and repeated administrations of the CANTAB® Paired Associates Learning (PAL) visual learning and memory test. Both self-reported ECog (Self-ECog) and study partner-reported ECog (SP-ECog), and two PAL scores (first attempt memory score [FAMS] and total errors adjusted [TEA]) were assessed. We estimated associations between multiple ECog scoring outputs (ECog positive [same or above cut-off score], ECog consistent [report of consistent decline in any item], and total score) and longitudinal change in PAL. Additionally we assessed the ability of ECog to identify 'decliners', who exhibited the worst PAL progression slopes corresponding to the fifth percentile and below. RESULTS Participants (n = 16,683) had an average age of 69.07 ± 7.34, 72.04% were female, and had an average of 16.66 ± 2.26 years of education. They were followed for an average of 2.52 ± 1.63 visits over a period of 11.49 ± 11.53 months. Both Self-ECog positive (estimate = -0.01, p < 0.001, R²m = 0.56) and Self-ECog consistent (estimate=-0.01, p = 0.002, R²m = 0.56) were associated with longitudinal change in PAL FAMS after adjusting demographics and clinical confounders. Those who were Self-ECog total (Odds ratio [95% confidence interval] = 1.390 [1.121-1.708]) and SP-ECog consistent (2.417 [1.591-3.655]) had higher probability of being decliners based on PAL FAMS. CONCLUSION In the BHR's unsupervised online setting, baseline subjective change was feasible in predicting longitudinal decline in neuropsychological tests. Online, self-administered measures of subjective cognitive change might have a potential to predict objective subjective change and identify individuals with cognitive impairments.
Collapse
Affiliation(s)
- Jae Myeong Kang
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco, San Francisco, CA, USA
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Department of Psychiatry, Gil Medical Center, Gachon University College of Medicine, Incheon, Republic of Korea
| | - Manchumad Manjavong
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco, San Francisco, CA, USA
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Division of Geriatric Medicine, Department of Internal Medicine, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand
| | - Chengshi Jin
- Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, CA, USA
| | - Adam Diaz
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Northern California Institute for Research and Education (NCIRE), San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | - Miriam T Ashford
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Northern California Institute for Research and Education (NCIRE), San Francisco, CA, USA
| | - Joseph Eichenbaum
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | | | | | | | - Francesca Cormack
- Cambridge Cognition, Cambridge, UK
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - Anna Aaronson
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | - R Scott Mackin
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco, San Francisco, CA, USA
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Rachana Tank
- Dementia Research Centre, UCL Institute of Neurology, University College London, London, WC1E 6BT, UK
| | - Bernard Landavazo
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | - Erika Cavallone
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | - Diana Truran
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Northern California Institute for Research and Education (NCIRE), San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | | | - Michael W Weiner
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
- Northern California Institute for Research and Education (NCIRE), San Francisco, CA, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
- Department of Medicine, University of California San Francisco, San Francisco, CA, USA
| | - Rachel L Nosheny
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco, San Francisco, CA, USA.
- VA Advanced Imaging Research Center, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA.
- Northern California Institute for Research and Education (NCIRE), San Francisco, CA, USA.
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA.
| |
Collapse
|
5
|
Waterink L, Sikkes SAM, Soons LM, Beers S, Meijer‐Krommenhoek Y, van de Rest O, Nynke S, Oosterman JM, Scherder E, Deckers K, Vermeiren Y, de Heus RAA, Köhler S, van der Flier WM, Zwan MD. Evaluation of efficiency and effectiveness of different recruitment strategies for the FINGER-NL multidomain lifestyle intervention trial via the Dutch Brain Research Registry. ALZHEIMER'S & DEMENTIA (NEW YORK, N. Y.) 2025; 11:e70017. [PMID: 39790861 PMCID: PMC11712179 DOI: 10.1002/trc2.70017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 09/30/2024] [Accepted: 10/18/2024] [Indexed: 01/12/2025]
Abstract
INTRODUCTION Recruitment of participants for intervention studies is challenging. We evaluated the effectiveness and efficiency of a participant recruitment campaign through an online registry for the FINGER-NL study, a multi-domain lifestyle intervention trial targeting cognitively healthy individuals aged 60-79 with dementia prevention potential. Additionally, we explored which recruitment strategy successfully reached individuals from underrepresented groups in research. METHODS The campaign entailed seven recruitment strategies referring to The Dutch Brain Research Registry (DBRR): (1) Facebook advertisements, (2) appearance on national television, (3) newspaper articles, (4) researcher outreach, (5) patient organizations, (6) search engines, and (7) other. For each strategy, we describe the number of individuals (a) registered, (b) potentially eligible, and (c) included in FINGER-NL. Subsequently, the efficiency, defined by the eligibility ratio (eligible/registered), and effectiveness, defined by the inclusion ratio (included/registered) were calculated. Associations between recruitment strategies and sociodemographic factors of underrepresented groups were tested with binomial logistic regressions. RESULTS The campaign resulted in 13,795 new DBRR registrants, of which n = 3475 were eligible (eligibility ratio = 0.25) and n = 1008 were included (inclusion ratio = 0.07). The Facebook advertisements and television appearance resulted in the highest numbers of registrants (n = 4678 and n = 2182) which translated to the highest number of inclusions (n = 288 and n = 262). The appearance on national television (eligibility ratio = 0.35), newspaper articles (0.26), and Facebook campaigns (0.26) were the most efficient strategies. The national television appearance (inclusion ratio = 0.13) was the most effective strategy. The Facebook campaign and appearance on national television performed relatively better in recruiting individuals from underrepresented groups. DISCUSSION A multipronged recruitment campaign via a national online recruitment registry is efficient and effective in recruiting and prescreening an adequate number of individuals aged 60-79 years with prevention potential for a multi-site intervention trial within a limited time frame of 15 months. Social media advertisements and television are preferred strategies to recruit individuals from underrepresented groups. Highlights An online brain research registry recruited eligible participants successfully.Mass media recruitment strategies are efficient for reaching large numbers.Direct recruitment through researchers and patient organizations seems more effective.Online registries offer automated prescreening and alternatives for screen-failures.Tailored strategies are needed to reach underrepresented groups to improve diversity.
Collapse
Affiliation(s)
- Lisa Waterink
- Alzheimer Center Amsterdam NeurologyVrije Universiteit Amsterdam, Amsterdam UMC VUmcAmsterdamThe Netherlands
- Amsterdam Neuroscience, NeurodegenerationAmsterdamThe Netherland
| | - Sietske A. M. Sikkes
- Alzheimer Center Amsterdam NeurologyVrije Universiteit Amsterdam, Amsterdam UMC VUmcAmsterdamThe Netherlands
- Faculty of Behavioural and Movement SciencesDepartment of ClinicalNeuro and Developmental PsychologyVrije UniversiteitAmsterdamThe Netherlands
| | - Lion M. Soons
- Alzheimer Centrum LimburgDepartment of Psychiatry and NeuropsychologySchool for Mental Health and Neuroscience (MHeNs)Maastricht UniversityMaastrichtThe Netherlands
| | - Sonja Beers
- Division of Human Nutrition and HealthWageningen University & ResearchWageningenThe Netherlands
| | - Yvonne Meijer‐Krommenhoek
- Department of EpidemiologyUniversity Medical Center Groningen (UMCG)University of Groningen (RUG)GroningenThe Netherlands
| | - Ondine van de Rest
- Division of Human Nutrition and HealthWageningen University & ResearchWageningenThe Netherlands
| | - Smidt Nynke
- Department of EpidemiologyUniversity Medical Center Groningen (UMCG)University of Groningen (RUG)GroningenThe Netherlands
| | - Joukje M. Oosterman
- Donders Institute for BrainCognition and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Erik Scherder
- Faculty of Behavioural and Movement SciencesDepartment of ClinicalNeuro and Developmental PsychologyVrije UniversiteitAmsterdamThe Netherlands
| | - Kay Deckers
- Alzheimer Centrum LimburgDepartment of Psychiatry and NeuropsychologySchool for Mental Health and Neuroscience (MHeNs)Maastricht UniversityMaastrichtThe Netherlands
| | - Yannick Vermeiren
- Division of Human Nutrition and HealthWageningen University & ResearchWageningenThe Netherlands
| | - Rianne A. A. de Heus
- Department of GeriatricsDepartment of Primary and Community CareRadboud University Medical CenterRadboud University Medical CenterRadboudumc Alzheimer CenterNijmegenThe Netherlands
| | - Sebastian Köhler
- Alzheimer Centrum LimburgDepartment of Psychiatry and NeuropsychologySchool for Mental Health and Neuroscience (MHeNs)Maastricht UniversityMaastrichtThe Netherlands
| | - Wiesje M. van der Flier
- Alzheimer Center Amsterdam NeurologyVrije Universiteit Amsterdam, Amsterdam UMC VUmcAmsterdamThe Netherlands
- Amsterdam Neuroscience, NeurodegenerationAmsterdamThe Netherland
- Department of Epidemiology and Data ScienceAmsterdam University Medical CenterVrije Universiteit AmsterdamAmsterdamThe Netherlands
| | | | - Marissa D. Zwan
- Alzheimer Center Amsterdam NeurologyVrije Universiteit Amsterdam, Amsterdam UMC VUmcAmsterdamThe Netherlands
- Amsterdam Neuroscience, NeurodegenerationAmsterdamThe Netherland
| |
Collapse
|
6
|
Lim YY, Mills A, Norfolk M, Rosenich E, Maruff P. Factors influencing rates of unsupervised assessment of short-term learning in cognitively unimpaired adults. J Alzheimers Dis 2025; 103:441-451. [PMID: 39686610 DOI: 10.1177/13872877241302491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2024]
Abstract
BACKGROUND In older adults with preclinical Alzheimer's disease (AD), learning curves derived from validated psychological learning paradigms are reduced to an extent greater than impairment, or decline, on neuropsychological memory tests. OBJECTIVE This study aimed to examine how age, sex, education, mood, and general dementia risk, which also increases risk for preclinical AD, could influence learning curves. METHODS 1050 adults enrolled in the BetterBrains trial completed 10 blocks of ORCA-LLT learning trials over 5 days. Learning curves were derived from improvement in accuracy over trials. Participants also completed questionnaires of demography and mood, and the CAIDE risk score was computed for each participant. RESULTS Most participants (67%) completed ≥6 blocks of ORCA-LLT. Older age (d = 0.75), lower education (d = 0.50), and higher dementia risk (d = 0.36) were associated significantly with slower learning rates. CONCLUSIONS In older adults, learning curves are influenced subtly by age, education, and dementia risk but not by sex or mood.
Collapse
Affiliation(s)
- Yen Ying Lim
- School of Psychological Sciences, Monash University, Clayton, Australia
- Turner Institute for Brain and Mental Health, Monash University, Clayton, Australia
- ARC Centre for Optimal Ageing, Monash University, Clayton, Australia
| | - Andrea Mills
- School of Psychological Sciences, Monash University, Clayton, Australia
- Department of Psychological Sciences, Swinburne University of Technology, Hawthorn, Australia
| | - Maya Norfolk
- School of Psychological Sciences, Monash University, Clayton, Australia
- Turner Institute for Brain and Mental Health, Monash University, Clayton, Australia
| | - Emily Rosenich
- School of Psychological Sciences, Monash University, Clayton, Australia
- Turner Institute for Brain and Mental Health, Monash University, Clayton, Australia
- ARC Centre for Optimal Ageing, Monash University, Clayton, Australia
| | - Paul Maruff
- Turner Institute for Brain and Mental Health, Monash University, Clayton, Australia
- ARC Centre for Optimal Ageing, Monash University, Clayton, Australia
- Cogstate Ltd, Melbourne, Australia
| |
Collapse
|
7
|
Nosheny RL, Miller M, Conti C, Flenniken D, Ashford M, Diaz A, Fockler J, Truran D, Kwang W, Kanoria S, Veitch D, Green RC, Weiner MW. The ADNI Administrative Core: Ensuring ADNI's success and informing future AD clinical trials. Alzheimers Dement 2024; 20:9004-9013. [PMID: 39535465 DOI: 10.1002/alz.14311] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 09/10/2024] [Accepted: 09/11/2024] [Indexed: 11/16/2024]
Abstract
The Alzheimer's Disease Neuroimaging Initiative (ADNI) Administrative Core oversees and coordinates all ADNI activities, to ensure the success and maximize the impact of ADNI in advancing Alzheimer's disease (AD) research and clinical trials. It manages finances and develops policies for data sharing, publications using ADNI data, and access to ADNI biospecimens. The Core develops and executes pilot projects to guide future ADNI activities and identifies key innovative methods for inclusion in ADNI. For ADNI4, the Administrative Core collaborates with the Engagement, Clinical, and Biomarker Cores to develop and evaluate novel, digital methods and infrastructure for participant recruitment, screening, and assessment of participants. The goal of these efforts is to enroll 500 participants, including > 50% from underrepresented populations, 40% with mild cognitive impairment, and 80% with elevated AD biomarkers. This new approach also provides a unique opportunity to validate novel methods. HIGHLIGHTS: The Alzheimer's Disease Neuroimaging Initiative (ADNI) Administrative Core oversees and coordinates all ADNI activities. The overall goal is to ensure ADNI's success and help design future Alzheimer's disease (AD) clinical trials. A key innovation is data sharing without embargo to maximize scientific impact. For ADNI4, novel, digital methods for recruitment and assessment were developed. New methods are designed to improve the participation of underrepresented populations.
Collapse
Affiliation(s)
- Rachel L Nosheny
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco (UCSF), San Francisco, California, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Melanie Miller
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Catherine Conti
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Derek Flenniken
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Miriam Ashford
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Adam Diaz
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Juliet Fockler
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Diana Truran
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Winnie Kwang
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Shaveta Kanoria
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Dallas Veitch
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| | - Robert C Green
- Division of Genetics, Harvard University Medical Center, Boston, Massachusetts, USA
| | - Michael W Weiner
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco (UCSF), San Francisco, California, USA
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
- Northern California Institute for Research and Education, San Francisco, California, USA
- Veteran's Administration Medical Center of San Francisco, San Francisco, California, USA
| |
Collapse
|
8
|
Miller MJ, Diaz A, Conti C, Albala B, Flenniken D, Fockler J, Kwang W, Sacrey DT, Ashford MT, Skirrow C, Weston J, Fristed E, Farias ST, Korecka M, Wan Y, Aisen PS, Beckett L, Harvey D, Lee EB, Petersen RC, Shaw LM, Okonkwo OC, Mindt MR, Weiner MW, Nosheny RL. The ADNI4 Digital Study: A novel approach to recruitment, screening, and assessment of participants for AD clinical research. Alzheimers Dement 2024; 20:7232-7247. [PMID: 39219153 PMCID: PMC11485063 DOI: 10.1002/alz.14234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Revised: 07/18/2024] [Accepted: 07/27/2024] [Indexed: 09/04/2024]
Abstract
INTRODUCTION We evaluated preliminary feasibility of a digital, culturally-informed approach to recruit and screen participants for the Alzheimer's Disease Neuroimaging Initiative (ADNI4). METHODS Participants were recruited using digital advertising and completed digital surveys (e.g., demographics, medical exclusion criteria, 12-item Everyday Cognition Scale [ECog-12]), Novoic Storyteller speech-based cognitive test). Completion rates and assessment performance were compared between underrepresented populations (URPs: individuals from ethnoculturally minoritized or low education backgrounds) and non-URPs. RESULTS Of 3099 participants who provided contact information, 654 enrolled in the cohort, and 595 completed at least one assessment. Two hundred forty-seven participants were from URPs. Of those enrolled, 465 met ADNI4 inclusion criteria and 237 evidenced possible cognitive impairment from ECog-12 or Storyteller performance. URPs had lower ECog and Storyteller completion rates. Scores varied by ethnocultural group and educational level. DISCUSSION Preliminary results demonstrate digital recruitment and screening assessment of an older diverse cohort, including those with possible cognitive impairment, are feasible. Improving engagement and achieving educational diversity are key challenges. HIGHLIGHTS A total of 654 participants enrolled in a digital cohort to facilitate ADNI4 recruitment. Culturally-informed digital ads aided enrollment of underrepresented populations. From those enrolled, 42% were from underrepresented ethnocultural and educational groups. Digital screening tools indicate > 50% of participants likely cognitively impaired. Completion rates and assessment performance vary by ethnocultural group and education.
Collapse
|
9
|
Polk SE, Öhman F, Hassenstab J, König A, Papp KV, Schöll M, Berron D. A scoping review of remote and unsupervised digital cognitive assessments in preclinical Alzheimer's disease. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.09.25.24314349. [PMID: 39399008 PMCID: PMC11469392 DOI: 10.1101/2024.09.25.24314349] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 10/15/2024]
Abstract
Subtle cognitive changes in preclinical Alzheimer's disease (AD) are difficult to detect using traditional pen-and-paper neuropsychological assessments. Remote and unsupervised digital assessments can improve scalability, measurement reliability, and ecological validity, enabling the detection and monitoring of subtle cognitive change. Here, we evaluate such tools deployed in preclinical AD samples, defined as cognitively unimpaired individuals with abnormal levels of amyloid-β (Aβ), or Aβ and tau. In this scoping review, we screened 1,680 unique reports for studies using remote and unsupervised cognitive assessment tools in preclinical AD samples; 23 tools were found. We describe each tool's usability, validity, and reported metrics of reliability. Construct and criterion validity according to associations with established neuropsychological assessments and measures of Aβ and tau are reported. With this review, we aim to present a necessary update to a rapidly evolving field, following a previous review by Öhman and colleagues (2021; Alzheimers Dement. Diagn. Assess. Dis. Monit) and addressing the open questions of feasibility and reliability of remote testing in the target population. We discuss future directions for using remote and unsupervised digital cognitive assessments in preclinical AD and how such tools may be used for longitudinal monitoring of cognitive function, scalable case finding, and individualized prognostics in both clinical trials and healthcare contexts.
Collapse
Affiliation(s)
- S. E. Polk
- Clinical Cognitive Neuroscience, German Center for Neurodegenerative Diseases (DZNE), Magdeburg, DE
| | - F. Öhman
- Wallenberg Centre for Molecular and Translational Medicine, University of Gothenburg, Gothenburg, SE
- Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, SE
- Region Västra Götaland, Sahlgrenska University Hospital, Department of Neuropsychiatry, Gothenburg, SE
| | - J. Hassenstab
- Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
- Department of Neurology, Washington University in St. Louis School of Medicine, St. Louis, MO, USA
| | - A. König
- ki:elements UG, Saarbrücken, DE
- Cognition Behaviour Technology (CoBTek) Lab, University Côte d’Azur, Nice, FR
- Université Côte d’Azur, Centre Hospitalier et Universitaire, Clinique Gériatrique du Cerveau et du Mouvement, Centre Mémoire de Ressources et de Recherche, Nice, FR
| | - K. V. Papp
- Mass General Brigham, Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - M. Schöll
- Wallenberg Centre for Molecular and Translational Medicine, University of Gothenburg, Gothenburg, SE
- Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, SE
- Region Västra Götaland, Sahlgrenska University Hospital, Department of Neuropsychiatry, Gothenburg, SE
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, University College London, UK
| | - D. Berron
- Clinical Cognitive Neuroscience, German Center for Neurodegenerative Diseases (DZNE), Magdeburg, DE
- Center for Behavioral Brain Sciences, Otto-von-Guericke University Magdeburg, Magdeburg, DE
- Clinical Memory Research Unit, Department of Clinical Sciences, Lund University, Lund, SE
| |
Collapse
|
10
|
Rentz DM, Slotkin J, Kaat AJ, Young SR, Dworak EM, Shono Y, Adam H, Nowinski CJ, Pila S, Novack MA, Hosseinian Z, Amagai S, Diaz MV, Almonte-Correa A, Alperin K, Camacho MR, Landavazo B, Nosheny RL, Weiner MW, Gershon RC. Validity and reliability of the Mobile Toolbox Faces and Names memory test. J Neuropsychol 2024. [PMID: 39289902 DOI: 10.1111/jnp.12394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 07/20/2024] [Accepted: 09/02/2024] [Indexed: 09/19/2024]
Abstract
Validation of the Mobile Toolbox Faces and Names associative memory test is presented. Ninety-two participants self-administered Faces and Names in-person; 956 self-administered Faces and Names remotely but took convergent measures in person; and 123 self-administered Faces and Names remotely twice, 14 days apart. Internal consistency (.76-.79) and test-retest reliability (ICC = .73) were acceptable. Convergent validity with WMS-IV Verbal Paired Associates was satisfactory (immediate .54; delayed .58). The findings suggest the remotely administered Faces and Names is a reliable instrument.
Collapse
Affiliation(s)
- Dorene M Rentz
- Department of Neurology, Harvard Medical School, Brigham and Women's Hospital, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Jerry Slotkin
- Center for Health Assessment Research and Translation, University of Delaware, Newark, Delaware, USA
| | - Aaron J Kaat
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Stephanie Ruth Young
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Elizabeth M Dworak
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Yusuke Shono
- School of Community and Global Health, Claremont Graduate University, Claremont, California, USA
| | - Hubert Adam
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Cindy J Nowinski
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Sarah Pila
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Miriam A Novack
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Zahra Hosseinian
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Saki Amagai
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Maria Varela Diaz
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Anyelo Almonte-Correa
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | | | - Monica R Camacho
- University of California san Francisco, San Francisco, California, USA
- San Francisco Veteran's Administration Medical Center, Northern California Institute for Research and Education, San Francisco, California, USA
| | - Bernard Landavazo
- University of California san Francisco, San Francisco, California, USA
- San Francisco Veteran's Administration Medical Center, Northern California Institute for Research and Education, San Francisco, California, USA
| | - Rachel L Nosheny
- University of California san Francisco, San Francisco, California, USA
- San Francisco Veteran's Administration Medical Center, Northern California Institute for Research and Education, San Francisco, California, USA
| | - Michael W Weiner
- University of California san Francisco, San Francisco, California, USA
- San Francisco Veteran's Administration Medical Center, Northern California Institute for Research and Education, San Francisco, California, USA
| | - Richard C Gershon
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| |
Collapse
|
11
|
Young SR, Dworak EM, Kaat AJ, Adam H, Novack MA, Slotkin J, Stoeger J, Nowinski CJ, Hosseinian Z, Amagai S, Pila S, Diaz MV, Correa AA, Alperin K, Omberg L, Kellen M, Camacho MR, Landavazo B, Nosheny RL, Weiner MW, Gershon RM. Development and Validation of a Vocabulary Measure in the Mobile Toolbox. Arch Clin Neuropsychol 2024; 39:714-723. [PMID: 38414411 DOI: 10.1093/arclin/acae010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 01/24/2024] [Accepted: 01/27/2024] [Indexed: 02/29/2024] Open
Abstract
OBJECTIVE We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies. METHOD Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones. RESULTS The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001). CONCLUSION The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.
Collapse
Affiliation(s)
- Stephanie Ruth Young
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Elizabeth M Dworak
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Aaron J Kaat
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Hubert Adam
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Miriam A Novack
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jerry Slotkin
- Center for Health Assessment Research and Translation, University of Delaware, Newark, DE, USA
| | | | - Cindy J Nowinski
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Zahra Hosseinian
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Saki Amagai
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Sarah Pila
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Maria Varela Diaz
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Anyelo Almonte Correa
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | | | | | - Monica R Camacho
- University of California San Francisco, San Francisco CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Bernard Landavazo
- University of California San Francisco, San Francisco CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Rachel L Nosheny
- University of California San Francisco, San Francisco CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Michael W Weiner
- University of California San Francisco, San Francisco CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Richard M Gershon
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
12
|
Novack MA, Young SR, Dworak EM, Kaat AJ, Slotkin J, Nowinski C, Yao L, Adam H, Stoeger J, Hosseinian Z, Amagai S, Pila S, Varela Diaz M, Almonte Correa A, Alperin K, Carlson S, Kellen M, Omberg L, Camacho MR, Landavazo B, Nosheny RL, Weiner MW, Gershon RC. Mobile toolbox (MTB) remote measures of executive function and processing speed: development and validation. J Int Neuropsychol Soc 2024; 30:680-688. [PMID: 38989719 DOI: 10.1017/s1355617724000225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Abstract
OBJECTIVE The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties. METHOD MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (N = 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (N = 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (N = 168), participants completed MTB measures twice remotely, two weeks apart. RESULTS All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability. CONCLUSIONS Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.
Collapse
Affiliation(s)
- Miriam A Novack
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Stephanie Ruth Young
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Elizabeth M Dworak
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Aaron J Kaat
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jerry Slotkin
- Center for Health Assessment Research and Translation, University of Delaware, Newark, DE, USA
| | - Cindy Nowinski
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Lihua Yao
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Hubert Adam
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jordan Stoeger
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Zahra Hosseinian
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Saki Amagai
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Sarah Pila
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Maria Varela Diaz
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Anyelo Almonte Correa
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | | | | | | | - Monica R Camacho
- University of California, San Francisco, NCIRE, San Francisco, CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Bernard Landavazo
- University of California, San Francisco, NCIRE, San Francisco, CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Rachel L Nosheny
- University of California, San Francisco, NCIRE, San Francisco, CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Michael W Weiner
- University of California, San Francisco, NCIRE, San Francisco, CA, USA
- Northern California Institute for Research and Education, San Francisco Veteran's Administration Medical Center, San Francisco, CA, USA
| | - Richard C Gershon
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
13
|
Lu TV, Campos P, Leader S, Lee X, Xu H, Doran E, Grill JD, Lott IT. Comparing research attitudes in Down syndrome and non-Down syndrome research decision-makers. ALZHEIMER'S & DEMENTIA (NEW YORK, N. Y.) 2024; 10:e12478. [PMID: 39086735 PMCID: PMC11289724 DOI: 10.1002/trc2.12478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Revised: 04/29/2024] [Accepted: 05/05/2024] [Indexed: 08/02/2024]
Abstract
INTRODUCTION Recruitment challenges in people with and without Down syndrome (DS) can delay research progress and risk sample bias. This study identified and quantified differences in research attitudes across populations of research enrollment decision-makers for individuals with and without DS. METHODS We performed analyses using data from two registries: the University of California, Irvine Consent-to-Contact (C2C) Registry and DS-Connect. The former represented a sample of non-DS decision-makers (N = 4818), while for the latter, we excluded individuals with DS, leaving a population of DS family decision-makers (N = 976). We assessed scores on the Research Attitudes Questionnaire (RAQ) between DS and non-DS decision-makers. We compared total RAQ scores using linear regression and assessed item-level RAQ differences using proportional odds regression. RESULTS Mean total RAQ scores were not statistically different between decision-makers in the two registries, after adjusting for age, sex, race and ethnicity, education, and the coronavirus disease 2019 (COVID-19) time frame (Est. Diff = 0.11, 95% confidence interval [CI]: -0.22, 0.43; p = 0.531). However, in a pre-specified analysis, we did find evidence of differential attitudes on item-level RAQ scores. Specifically, decision-makers for participants with DS had increased odds of a more favorable response to the question of responsibility to help others (DS vs. non-DS: odds ratio [OR] = 1.26, 95% CI: 1.08, 1.48) and decreased odds of a more favorable response to the question regarding the belief that medical research would find cures for major diseases during their lifetime (DS vs. non-DS: OR = 0.77, 95% CI: 0.66, 0.90). DISCUSSION Our findings provide insights for researchers to develop strategies for recruiting individuals with and without DS into clinical research. The observed item-level differences warrant further investigation to instruct precise recruitment strategies. Highlights Research attitudes between decision-makers for individuals with Down syndrome (DS) and decision-makers without DS were observed to be similar on average.Item-level differences in research attitudes were observed to differ for DS and non-DS decision-makers.These results can help facilitate precise recruitment strategies for populations with DS.
Collapse
Affiliation(s)
- Thuy V. Lu
- Department of StatisticsUniversity of California, IrvineIrvineCaliforniaUSA
- Institute for Memory Impairments and Neurological DisordersUniversity of California, IrvineIrvineCaliforniaUSA
| | - Paola Campos
- Department of MathematicsCalifornia State University, StanislausTurlockCaliforniaUSA
| | - Sean Leader
- Department of StatisticsCal Poly, San Luis ObispoSan Luis ObispoCaliforniaUSA
| | - Xavier Lee
- Department of StatisticsUniversity of WashingtonSeattleWashingtonUSA
| | - Helena Xu
- Department of Statistics and Data ScienceUniversity of CaliforniaLos AngelesCaliforniaUSA
| | - Eric Doran
- Institute for Memory Impairments and Neurological DisordersUniversity of California, IrvineIrvineCaliforniaUSA
| | - Joshua D Grill
- Institute for Memory Impairments and Neurological DisordersUniversity of California, IrvineIrvineCaliforniaUSA
- Department of Neurobiology and BehaviorUniversity of CaliforniaIrvineCaliforniaUSA
- Department of Psychiatry and Human BehaviorUniversity of CaliforniaIrvineCaliforniaUSA
| | - Ira T. Lott
- Institute for Memory Impairments and Neurological DisordersUniversity of California, IrvineIrvineCaliforniaUSA
- School of MedicineUniversity of CaliforniaIrvineCaliforniaUSA
| |
Collapse
|
14
|
Young SR, Dworak EM, Novack MA, Kaat AJ, Adam H, Nowinski CJ, Hosseinian Z, Slotkin J, Stoeger J, Amagai S, Diaz MV, Correa AA, Alperin K, Omberg L, Kellen M, Camacho MR, Landavazo B, Nosheny RL, Weiner MW, Gershon R. Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures. J Clin Exp Neuropsychol 2024; 46:364-373. [PMID: 38753819 PMCID: PMC11309919 DOI: 10.1080/13803395.2024.2353945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 05/06/2024] [Indexed: 05/18/2024]
Abstract
INTRODUCTION Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. METHOD In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. RESULTS Internal consistency was good across samples (ρxx = .80 to .85, p < .001). Test-retest reliability was marginal (ICC = .49, p < .001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ = .44 to .76, p < .001), while correlations with discriminant measures were small (ρ = .23 to .27, p < .05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to -.21, p < .001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p < .001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p < .001), but there were not significantly more perfect scores. CONCLUSION The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples.
Collapse
Affiliation(s)
- Stephanie Ruth Young
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Elizabeth M. Dworak
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Miriam A. Novack
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Aaron J. Kaat
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Hubert Adam
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Cindy J. Nowinski
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Zahra Hosseinian
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Jerry Slotkin
- Center for Health Assessment Research and Translation, University of Delaware, Newark, DE
| | | | - Saki Amagai
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Maria Varela Diaz
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - Anyelo Almonte Correa
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | | | | | | | - Monica R. Camacho
- University of California San Francisco, San Francisco CA
- Northern California Institute for Research and Education, San Francisco Veteran’s Administration Medical Center, San Francisco, CA
| | - Bernard Landavazo
- University of California San Francisco, San Francisco CA
- Northern California Institute for Research and Education, San Francisco Veteran’s Administration Medical Center, San Francisco, CA
| | - Rachel L. Nosheny
- University of California San Francisco, San Francisco CA
- Northern California Institute for Research and Education, San Francisco Veteran’s Administration Medical Center, San Francisco, CA
| | - Michael W. Weiner
- University of California San Francisco, San Francisco CA
- Northern California Institute for Research and Education, San Francisco Veteran’s Administration Medical Center, San Francisco, CA
| | - Richard Gershon
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| |
Collapse
|
15
|
Nutley S, Nguyen BK, Mackin RS, Insel PS, Tosun D, Butters M, Aisen P, Raman R, Saykin AJ, Toga AW, Jack C, Weiner MW, Nelson C, Kassel M, Kryza-Lacombe M, Eichenbaum J, Nosheny RL, Mathews CA. Relationship of Hoarding and Depression Symptoms in Older Adults. Am J Geriatr Psychiatry 2024; 32:497-508. [PMID: 38092621 PMCID: PMC11055473 DOI: 10.1016/j.jagp.2023.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 11/12/2023] [Accepted: 11/17/2023] [Indexed: 03/21/2024]
Abstract
Hoarding disorder (HD) is a debilitating neuropsychiatric condition that affects 2%-6% of the population and increases in incidence with age. Major depressive disorder (MDD) co-occurs with HD in approximately 50% of cases and leads to increased functional impairment and disability. However, only one study to date has examined the rate and trajectory of hoarding symptoms in older individuals with a lifetime history of MDD, including those with current active depression (late-life depression; LLD). We therefore sought to characterize this potentially distinct phenotype. We determined the incidence of HD in two separate cohorts of participants with LLD (n = 73) or lifetime history of MDD (n = 580) and examined the reliability and stability of hoarding symptoms using the Saving Inventory-Revised (SI-R) and Hoarding Rating Scale-Self Report (HRS), as well as the co-variance of hoarding and depression scores over time. HD was present in 12% to 33% of participants with MDD, with higher rates found in those with active depressive symptoms. Hoarding severity was stable across timepoints in both samples (all correlations >0.75), and fewer than 30% of participants in each sample experienced significant changes in severity between any two timepoints. Change in depression symptoms over time did not co-vary with change in hoarding symptoms. These findings indicate that hoarding is a more common comorbidity in LLD than previously suggested, and should be considered in screening and management of LLD. Future studies should further characterize the interaction of these conditions and their impact on outcomes, particularly functional impairment in this vulnerable population.
Collapse
Affiliation(s)
- Sara Nutley
- Department of Psychiatry (SN, BN, CAM), University of Florida College of Medicine, Gainesville, FL; Center for OCD, Anxiety, and Related Disorders (COARD) (SN, BN, CAM), University of Florida, Gainesville, FL; Department of Epidemiology (SN), University of Florida, Gainesville, FL
| | - Binh K Nguyen
- Department of Psychiatry (SN, BN, CAM), University of Florida College of Medicine, Gainesville, FL; Center for OCD, Anxiety, and Related Disorders (COARD) (SN, BN, CAM), University of Florida, Gainesville, FL
| | - Robert Scott Mackin
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA; San Francisco Veterans Administration Medical Center (DT, MW, MK, JE), San Francisco, CA
| | - Philip S Insel
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA
| | - Duygu Tosun
- San Francisco Veterans Administration Medical Center (DT, MW, MK, JE), San Francisco, CA; Department of Radiology (DT, MW, JE, RN), University of California, San Francisco, San Francisco, CA
| | - Meryl Butters
- Department of Psychiatry (MB), University of Pittsburgh School of Medicine, Pittsburgh, PA
| | - Paul Aisen
- University of Southern California (PA, RR), San Diego, CA; Alzheimer's Therapeutic Research Institute (PA, RR), University of Southern California, San Diego, CA
| | - Rema Raman
- University of Southern California (PA, RR), San Diego, CA; Alzheimer's Therapeutic Research Institute (PA, RR), University of Southern California, San Diego, CA
| | - Andrew J Saykin
- Indiana Alzheimer's Disease Research Center and Department of Radiology and Imaging Sciences (AS), Indiana University School of Medicine, Indianapolis, IN
| | - Arthur W Toga
- Laboratory of Neuro Imaging, Stevens Neuroimaging and Informatics Institute, Keck School of Medicine (AT), University of Southern California, Los Angeles, CA
| | | | - Michael W Weiner
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA; San Francisco Veterans Administration Medical Center (DT, MW, MK, JE), San Francisco, CA; Department of Radiology (DT, MW, JE, RN), University of California, San Francisco, San Francisco, CA; Department of Neurology (MW), University of California, San Francisco, San Francisco, CA
| | - Craig Nelson
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA
| | - Michelle Kassel
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA; San Francisco Veterans Administration Medical Center (DT, MW, MK, JE), San Francisco, CA
| | - Maria Kryza-Lacombe
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA; Mental Illness Research Education and Clinical Centers (MK-L), Veterans Administration Medical Center, San Francisco, CA
| | - Joseph Eichenbaum
- San Francisco Veterans Administration Medical Center (DT, MW, MK, JE), San Francisco, CA; Department of Radiology (DT, MW, JE, RN), University of California, San Francisco, San Francisco, CA
| | - Rachel L Nosheny
- Department of Psychiatry and Behavioral Sciences (RM, PI, MW, CN, MK, MK-L, RN), University of California, San Francisco, San Francisco, CA; Department of Radiology (DT, MW, JE, RN), University of California, San Francisco, San Francisco, CA
| | - Carol A Mathews
- Department of Psychiatry (SN, BN, CAM), University of Florida College of Medicine, Gainesville, FL; Center for OCD, Anxiety, and Related Disorders (COARD) (SN, BN, CAM), University of Florida, Gainesville, FL.
| |
Collapse
|
16
|
Tank R, Diaz A, Ashford MT, Miller MJ, Eichenbaum J, Aaronson A, Landavazo B, Neuhaus J, Weiner MW, Mackin RS, Barnes J, Nosheny RL. Examining Demographic Factors, Psychosocial Wellbeing and Cardiovascular Health in Subjective Cognitive Decline in the Brain Health Registry Cohort. J Prev Alzheimers Dis 2024; 11:787-797. [PMID: 38706295 PMCID: PMC11061024 DOI: 10.14283/jpad.2024.39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 12/19/2023] [Indexed: 05/07/2024]
Abstract
BACKGROUND Subjective cognitive decline (SCD) is defined as an individual's perception of sustained cognitive decline compared to their normal state while still performing within boundaries for normal functioning. Demographic, psychosocial and medical factors have been linked to age-related cognitive decline, and Alzheimer's dementia (AD). However, their relation to risk for SCD remains unclear. This study aims to identify demographic factors, psychosocial and cardiovascular health associated with SCD within the Brain Health Registry (BHR) online cohort. METHODS Participants aged 55+ (N=27,596) in the BHR self-reported SCD measured using the Everyday Cognition Scale (ECog) and medical conditions, depressive symptoms, body mass index, quality of sleep, health, family history of AD, years of education, race, ethnicity and gender. Multivariable linear regression was used to examine whether SCD was associated with demographic, psychosocial, and medical conditions. RESULTS We found that advanced age, depressive symptoms, poorer sleep quality and poorer quality of health were positively associated with more self-reported SCD in all models. No race or ethnicity differences were found in association with SCD. Males who reported alcohol and tobacco use or underweight BMI had higher ECog scores compared with females. CONCLUSION In addition to well-established risk factors for cognitive decline, such as age, our study consistently and robustly identified a strong association between psychosocial factors and self-reported cognitive decline in an online cohort. These findings provide further evidence that psychosocial health plays a pivotal role in comprehending the risk of SCD and early-stage cognitive ageing. Our findings emphasise the significance of psychosocial factors within the broader context of cardiovascular and demographic risk factors.
Collapse
Affiliation(s)
- R Tank
- Rachana Tank, Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom,
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
17
|
LaForte E, Young SR, Dworak EM, Novack MA, Kaat AJ, Adam H, Nowinski CJ, Hosseinian Z, Slotkin J, Amagai S, Diaz MV, Correa AA, Alperin K, Camacho M, Landavazo B, Nosheny R, Weiner MW, Gershon RM. Development and Validation the Mobile Toolbox (MTB) Spelling Test. J Prev Alzheimers Dis 2024; 11:1673-1681. [PMID: 39559878 PMCID: PMC11573874 DOI: 10.14283/jpad.2024.158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2024]
Abstract
BACKGROUND Spelling assessments can provide a valuable marker of cognitive change in Alzheimer's disease and related dementias (ADRD) and play an important role in ADRD research. However, most commercial assessments are not well-suited to the needs of researchers or participants; they are expensive and often require face-to-face administration by a trained examiner. To help overcome these barriers and foster progress in ADRD research, the National Institute on Aging (NIA)-funded Mobile Toolbox (MTB) offers a library of cognitive measures that can be self-administered remotely on a participant's own smartphone, including a brand-new Spelling test. OBJECTIVE The goal of this paper is to describe the design, piloting, calibration, and validation of the MTB Spelling test. DESIGN We describe a pilot study, calibration study, and three validation studies, all of which use a cross-sectional design. SETTING The pilot study, calibration study, and validation studies 2 and 3 were conducted remotely, while validation study 1 was conducted in the lab. PARTICIPANTS Participants for all of the studies were recruited from the general population by a thirdparty market research firm and the samples were stratified by age, gender, race, ethnicity, and education to represent the U.S. POPULATION The pilot sample included 1,950 participants and the calibration study included 1335 participants over the age of 8. Validation study 1 included 92 participants ages 20 to 84, validation study 2 included 1021 participants ages 18 to 90, and validation study 3 included 168 participants ages 28 to 87. MEASUREMENTS Participants in each of the studies completed the MTB Spelling test. Participants in validation studies 1 and 2 completed measures from the NIH Toolbox including Oral Reading Recognition as a measure of convergent validity, and Visual Reasoning and the Rey Auditory Verbal Learning as measures of divergent validity. As an additional measure of convergent validity, participants in study 1 also completed the Spelling subtest from the Wechsler Individual Achievement Test, 4th Edition. RESULTS The MTB Spelling test demonstrated evidence of internal consistency (r=.79 to .83) convergent validity (r=.56 to .81, p<.01), discriminant validity (r = .23 to .36, p <.01), test-retest reliability ( ICC=.63 ), and correlations with normal cognitive aging (r = -.06 to -.04, p >.01). CONCLUSION Findings suggest the MTB Spelling test is a reliable and valid measure of English spelling abilities in general population samples, and has potential in ADRD research.
Collapse
Affiliation(s)
- E LaForte
- Stephanie Ruth Young, 625 N. Michigan Ave., 21st Floor Chicago, IL 60611, United States.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Ashford MT, Jin C, Neuhaus J, Diaz A, Aaronson A, Tank R, Eichenbaum J, Camacho MR, Fockler J, Ulbricht A, Flenniken D, Truran D, Mackin RS, Weiner MW, Mindt MR, Nosheny RL. Participant completion of longitudinal assessments in an online cognitive aging registry: The role of medical conditions. ALZHEIMER'S & DEMENTIA (NEW YORK, N. Y.) 2024; 10:e12438. [PMID: 38188606 PMCID: PMC10767283 DOI: 10.1002/trc2.12438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 11/08/2023] [Accepted: 11/16/2023] [Indexed: 01/09/2024]
Abstract
INTRODUCTION This study aimed to understand whether older adults' longitudinal completion of assessments in an online Alzheimer's disease and related dementias (ADRD)-related registry is influenced by self-reported medical conditions. METHODS Brain Health Registry (BHR) is an online cognitive aging and ADRD-related research registry that includes longitudinal health and cognitive assessments. Using logistic regressions, we examined associations between longitudinal registry completion outcomes and self-reported (1) number of medical conditions and (2) eight defined medical condition groups (cardiovascular, metabolic, immune system, ADRD, current psychiatric, substance use/abuse, acquired, other specified conditions) in adults aged 55+ (N = 23,888). Longitudinal registry completion outcomes were assessed by the completion of the BHR initial questionnaire (first questionnaire participants see at each visit) at least twice and completion of a cognitive assessment (Cogstate Brief Battery) at least twice. Models included ethnocultural identity, education, age, and subjective memory concern as covariates. RESULTS We found that the likelihood of longitudinally completing the initial questionnaire was negatively associated with reporting a diagnosis of ADRD and current psychiatric conditions but was positively associated with reporting substance use/abuse and acquired medical conditions. The likelihood of longitudinally completing the cognitive assessment task was negatively associated with number of reported medical conditions, as well as with reporting cardiovascular conditions, ADRD, and current psychiatric conditions. Previously identified associations between ethnocultural identity and longitudinal assessment completion in BHR remained after accounting for the presence of medical conditions. DISCUSSION This post hoc analysis provides novel, initial evidence that older adults' completion of longitudinal assessments in an online registry is associated with the number and types of participant-reported medical conditions. Our findings can inform future efforts to make online studies with longitudinal health and cognitive assessments more usable for older adults with medical conditions. The results need to be interpreted with caution due to selection biases, and the under-inclusion of minoritized communities.
Collapse
Affiliation(s)
- Miriam T. Ashford
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
| | - Chengshi Jin
- University of California San Francisco Department of Epidemiology and Biostatistics San FranciscoSan FranciscoCaliforniaUSA
| | - John Neuhaus
- University of California San Francisco Department of Epidemiology and Biostatistics San FranciscoSan FranciscoCaliforniaUSA
| | - Adam Diaz
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
| | - Anna Aaronson
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
| | - Rachana Tank
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
- Dementia Research CentreUCL Institute of NeurologyUniversity College LondonLondonUK
| | - Joseph Eichenbaum
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
| | - Monica R. Camacho
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
| | - Juliet Fockler
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
| | - Aaron Ulbricht
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
| | - Derek Flenniken
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
| | - Diana Truran
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
| | - Robert Scott Mackin
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Psychiatry and Behavioral SciencesUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Michael W. Weiner
- VA Advanced Imaging Research CenterSan Francisco Veteran's Administration Medical CenterSan FranciscoCaliforniaUSA
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
- Department of Radiology and Biomedical ImagingUniversity of CaliforniaSan FranciscoCaliforniaUSA
- Department of MedicineUniversity of California San FranciscoSan FranciscoCaliforniaUSA
- Department of NeurologyUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| | - Monica Rivera Mindt
- Psychology, Latin American Latino Studies Institute& African and African American StudiesFordham UniversityJoint Appointment in NeurologyIcahn School of Medicine at Mount Sinai ‐ New YorkNew YorkNew YorkUSA
| | - Rachel L. Nosheny
- Department of Veterans Affairs Medical CenterNorthern California Institute for Research and Education (NCIRE)San FranciscoCaliforniaUSA
- Department of Psychiatry and Behavioral SciencesUniversity of California San FranciscoSan FranciscoCaliforniaUSA
| |
Collapse
|
19
|
Nosheny RL, Yen D, Howell T, Camacho M, Moulder K, Gummadi S, Bui C, Kannan S, Ashford MT, Knight K, Mayo C, McMillan M, Petersen RC, Stricker NH, Roberson ED, Chambless C, Gersteneker A, Martin R, Kennedy R, Zhang Y, Kukull W, Flenniken D, Fockler J, Truran D, Mackin RS, Weiner MW, Morris JC, Li Y. Evaluation of the Electronic Clinical Dementia Rating for Dementia Screening. JAMA Netw Open 2023; 6:e2333786. [PMID: 37707812 PMCID: PMC10502518 DOI: 10.1001/jamanetworkopen.2023.33786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 08/01/2023] [Indexed: 09/15/2023] Open
Abstract
Importance The Clinical Dementia Rating (CDR) is a well-validated instrument widely used to detect and stage dementia due to Alzheimer disease. The digital Electronic Clinical Dementia Rating (eCDR) can be remotely self-administered and automatically scored, with potential to facilitate efficient dementia screening and staging. Objective To evaluate the association of the eCDR with the CDR and other in-clinic assessments for screening older adults for cognitive impairment. Design, Setting, and Participants This multisite, cross-sectional study used baseline data from a longitudinal, observational study from 2020 to 2023, including up to 3 years of follow-up. Participants were enrolled from 3 Alzheimer Disease Research Centers and the Brain Health Registry. Participants (aged ≥55 years, with a study partner, and no acute or unstable major medical conditions) were recruited during in-clinic visits or by automated emails. Exposures Participants completed the Uniform Data Set Version 3 (UDS; including the CDR) in supervised clinical research settings, and then completed the eCDR remotely, online and unsupervised, using their own device. Main Outcomes and Measures The primary outcomes were eCDR scores (item; categorical box and global; continuous box and global), CDR scores (item; categorical box and global), and UDS assessment scores. Associations were evaluated using linear and logistic regressions. Results A total of 3565 participants were contacted, and 288 were enrolled. Among 173 participants with item-level data (mean [SD] age, 70.84 [7.65] years; 76 women [43.9%]), eCDR to CDR concordance was 90% or higher for 33 items (63%) and 70% to 89% for 13 items (25%). Box (domain) level concordance ranged from 80% (memory) to 99% (personal care). The global score concordance rate was 81%. κ statistics were fair to moderate. Among 206 participants with box and global scores (mean [SD] age, 71.34 [7.68] years; 95 women [46.1%]), eCDR continuous global score was associated with CDR global (categorical) score with an area under the receiver operating characteristic curve of 0.79 (95% CI, 0.70-0.87). Correlations between eCDR and in-clinic UDS assessments were similar to those between CDR sum of box scores and the same in-clinic assessments. Conclusions and Relevance These findings suggest that the eCDR is valid and has potential use for screening and assessment of older adults for cognitive and functional decline related to Alzheimer disease. Instrument optimization and validation in diverse cohorts in remote settings are crucial for evaluating scalability and eCDR utility in clinical research, trials, and health care settings.
Collapse
Affiliation(s)
- Rachel L. Nosheny
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - Daniel Yen
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
| | - Taylor Howell
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Monica Camacho
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Krista Moulder
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
| | - Shilpa Gummadi
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Chau Bui
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Sandhya Kannan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Miriam T. Ashford
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - Kristen Knight
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Connie Mayo
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
| | - Maureen McMillan
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
| | | | - Nikki H. Stricker
- Division of Neurocognitive Disorders, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
| | - Erik D. Roberson
- Alzheimer’s Disease Center, Center for Neurodegeneration and Experimental Therapeutics, Department of Neurology, University of Alabama at Birmingham, Birmingham
| | - Carol Chambless
- Alzheimer’s Disease Center, Center for Neurodegeneration and Experimental Therapeutics, Department of Neurology, University of Alabama at Birmingham, Birmingham
| | - Adam Gersteneker
- Division of Neuropsychology, Department of Neurology, The University of Alabama at Birmingham, Birmingham
| | - Roy Martin
- Division of Neuropsychology, Department of Neurology, The University of Alabama at Birmingham, Birmingham
| | - Richard Kennedy
- Division of Gerontology, Geriatrics, and Palliative Care, Department of Medicine, University of Alabama at Birmingham, Birmingham
| | - Yue Zhang
- Alzheimer’s Disease Center, Center for Neurodegeneration and Experimental Therapeutics, Department of Neurology, University of Alabama at Birmingham, Birmingham
| | - Walter Kukull
- Department of Epidemiology, University of Washington, Seattle
- National Alzheimer’s Coordinating Center, Seattle, Washington
| | - Derek Flenniken
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - Juliet Fockler
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
| | - Diana Truran
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - R. Scott Mackin
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - Michael W. Weiner
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco
- Department of Radiology and Biomedical Imaging, University of California, San Francisco
- Northern California Institute for Research and Education, Department of Veterans Affairs Medical Center, San Francisco
| | - John C. Morris
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
| | - Yan Li
- Knight Alzheimer’s Disease Research Center, Department of Neurology, Washington University School of Medicine, St Louis, Missouri
- Department of Biostatistics, Washington University School of Medicine, St Louis, Missouri
| |
Collapse
|