1
|
Clifford JO, Anand S, Tarpin-Bernard F, Bergeron MF, Ashford CB, Bayley PJ, Ashford JW. Episodic memory assessment: effects of sex and age on performance and response time during a continuous recognition task. Front Hum Neurosci 2024; 18:1304221. [PMID: 38638807 PMCID: PMC11024362 DOI: 10.3389/fnhum.2024.1304221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 03/08/2024] [Indexed: 04/20/2024] Open
Abstract
Introduction Continuous recognition tasks (CRTs) assess episodic memory (EM), the central functional disturbance in Alzheimer's disease and several related disorders. The online MemTrax computerized CRT provides a platform for screening and assessment that is engaging and can be repeated frequently. MemTrax presents complex visual stimuli, which require complex involvement of the lateral and medial temporal lobes and can be completed in less than 2 min. Results include number of correct recognitions (HITs), recognition failures (MISSes = 1-HITs), correct rejections (CRs), false alarms (FAs = 1-CRs), total correct (TC = HITs + CRs), and response times (RTs) for each HIT and FA. Prior analyses of MemTrax CRT data show no effects of sex but an effect of age on performance. The number of HITs corresponds to faster RT-HITs more closely than TC, and CRs do not relate to RT-HITs. RT-HITs show a typical skewed distribution, and cumulative RT-HITs fit a negative survival curve (RevEx). Thus, this study aimed to define precisely the effects of sex and age on HITS, CRs, RT-HITs, and the dynamics of RTs in an engaged population. Methods MemTrax CRT online data on 18,255 individuals was analyzed for sex, age, and distributions of HITs, CRs, MISSes, FAs, TC, and relationships to both RT-HITs and RT-FAs. Results HITs corresponded more closely to RT-HITs than did TC because CRs did not relate to RT-HITs. RT-FAs had a broader distribution than RT-HITs and were faster than RT-HITs in about half of the sample, slower in the other half. Performance metrics for men and women were the same. HITs declined with age as RT-HITs increased. CRs also decreased with age and RT-FAs increased, but with no correlation. The group over aged 50 years had RT-HITs distributions slower than under 50 years. For both age ranges, the RevEx model explained more than 99% of the variance in RT-HITs. Discussion The dichotomy of HITs and CRs suggests opposing cognitive strategies: (1) less certainty about recognitions, in association with slower RT-HITs and lower HIT percentages suggests recognition difficulty, leading to more MISSes, and (2) decreased CRs (more FAs) but faster RTs to HITs and FAs, suggesting overly quick decisions leading to errors. MemTrax CRT performance provides an indication of EM (HITs and RT-HITs may relate to function of the temporal lobe), executive function (FAs may relate to function of the frontal lobe), processing speed (RTs), cognitive ability, and age-related changes. This CRT provides potential clinical screening utility for early Alzheimer's disease and other conditions affecting EM, other cognitive functions, and more accurate impairment assessment to track changes over time.
Collapse
Affiliation(s)
- James O. Clifford
- Department of Psychology, College of San Mateo, San Mateo, CA, United States
| | - Sulekha Anand
- Department of Biological Sciences, San Jose State University, San Jose, CA, United States
| | | | - Michael F. Bergeron
- Department of Health Sciences, University of Hartford, West Hartford, CT, United States
| | - Curtis B. Ashford
- MemTrax, LLC, Redwood City, CA, United States
- CogniFit, LLC, Redwood City, CA, United States
| | - Peter J. Bayley
- VA Palo Alto Health Care System, Palo Alto, CA, United States
- Department of Psychiatry and Behavioral Sciences, Stanford, CA, United States
| | - John Wesson Ashford
- VA Palo Alto Health Care System, Palo Alto, CA, United States
- Department of Psychiatry and Behavioral Sciences, Stanford, CA, United States
| |
Collapse
|
2
|
Ashford JW, Clifford JO, Anand S, Bergeron MF, Ashford CB, Bayley PJ. Correctness and response time distributions in the MemTrax continuous recognition task: Analysis of strategies and a reverse-exponential model. Front Aging Neurosci 2022; 14:1005298. [PMID: 36437986 PMCID: PMC9682919 DOI: 10.3389/fnagi.2022.1005298] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 10/17/2022] [Indexed: 07/24/2023] Open
Abstract
A critical issue in addressing medical conditions is measurement. Memory measurement is difficult, especially episodic memory, which is disrupted by many conditions. On-line computer testing can precisely measure and assess several memory functions. This study analyzed memory performances from a large group of anonymous, on-line participants using a continuous recognition task (CRT) implemented at https://memtrax.com. These analyses estimated ranges of acceptable performance and average response time (RT). For 344,165 presumed unique individuals completing the CRT a total of 602,272 times, data were stored on a server, including each correct response (HIT), Correct Rejection, and RT to the thousandth of a second. Responses were analyzed, distributions and relationships of these parameters were ascertained, and mean RTs were determined for each participant across the population. From 322,996 valid first tests, analysis of correctness showed that 63% of these tests achieved at least 45 correct (90%), 92% scored at or above 40 correct (80%), and 3% scored 35 correct (70%) or less. The distribution of RTs was skewed with 1% faster than 0.62 s, a median at 0.890 s, and 1% slower than 1.57 s. The RT distribution was best explained by a novel model, the reverse-exponential (RevEx) function. Increased RT speed was most closely associated with increased HIT accuracy. The MemTrax on-line memory test readily provides valid and reliable metrics for assessing individual episodic memory function that could have practical clinical utility for precise assessment of memory dysfunction in many conditions, including improvement or deterioration over time.
Collapse
Affiliation(s)
- J. Wesson Ashford
- War Related Illness and Injury Study Center, VA Palo Alto Health Care System, Palo Alto, CA, United States
- Department of Psychiatry and Behavioral Science, Stanford University, Palo Alto, CA, United States
| | - James O. Clifford
- Department of Psychology, College of San Mateo, San Mateo, CA, United States
| | - Sulekha Anand
- Department of Biological Sciences, San José State University, San Jose, CA, United States
| | - Michael F. Bergeron
- Department of Health Sciences, University of Hartford, West Hartford, CT, United States
| | | | - Peter J. Bayley
- War Related Illness and Injury Study Center, VA Palo Alto Health Care System, Palo Alto, CA, United States
- Department of Psychiatry and Behavioral Science, Stanford University, Palo Alto, CA, United States
| |
Collapse
|
3
|
Kennedy Q, Taylor J, Noda A, Yesavage J, Lazzeroni LC. The STEP model: Characterizing simultaneous time effects on practice for flight simulator performance among middle-aged and older pilots. Psychol Aging 2015; 30:699-711. [PMID: 26280383 DOI: 10.1037/pag0000043] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Understanding the possible effects of the number of practice sessions (practice) and time between practice sessions (interval) among middle-aged and older adults in real-world tasks has important implications for skill maintenance. Prior training and cognitive ability may impact practice and interval effects on real-world tasks. In this study, we took advantage of existing practice data from 5 simulated flights among 263 middle-aged and older pilots with varying levels of flight expertise (defined by U.S. Federal Aviation Administration proficiency ratings). We developed a new Simultaneous Time Effects on Practice (STEP) model: (a) to model the simultaneous effects of practice and interval on performance of the 5 flights, and (b) to examine the effects of selected covariates (i.e., age, flight expertise, and 3 composite measures of cognitive ability). The STEP model demonstrated consistent positive practice effects, negative interval effects, and predicted covariate effects. Age negatively moderated the beneficial effects of practice. Additionally, cognitive processing speed and intraindividual variability (IIV) in processing speed moderated the benefits of practice and/or the negative influence of interval for particular flight performance measures. Expertise did not interact with practice or interval. Results indicated that practice and interval effects occur in simulated flight tasks. However, processing speed and IIV may influence these effects, even among high-functioning adults. Results have implications for the design and assessment of training interventions targeted at middle-aged and older adults for complex real-world tasks.
Collapse
Affiliation(s)
- Quinn Kennedy
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine
| | - Joy Taylor
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine
| | - Art Noda
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine
| | - Jerome Yesavage
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine
| | - Laura C Lazzeroni
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine
| |
Collapse
|
4
|
Kennedy Q, Taylor J, Heraldez D, Noda A, Lazzeroni LC, Yesavage J. Intraindividual variability in basic reaction time predicts middle-aged and older pilots' flight simulator performance. J Gerontol B Psychol Sci Soc Sci 2012; 68:487-94. [PMID: 23052365 DOI: 10.1093/geronb/gbs090] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
OBJECTIVES Intraindividual variability (IIV) is negatively associated with cognitive test performance and is positively associated with age and some neurological disorders. We aimed to extend these findings to a real-world task, flight simulator performance. We hypothesized that IIV predicts poorer initial flight performance and increased rate of decline in performance among middle-aged and older pilots. METHOD Two-hundred and thirty-six pilots (40-69 years) completed annual assessments comprising a cognitive battery and two 75-min simulated flights in a flight simulator. Basic and complex IIV composite variables were created from measures of basic reaction time and shifting and divided attention tasks. Flight simulator performance was characterized by an overall summary score and scores on communication, emergencies, approach, and traffic avoidance components. RESULTS Although basic IIV did not predict rate of decline in flight performance, it had a negative association with initial performance for most flight measures. After taking into account processing speed, basic IIV explained an additional 8%-12% of the negative age effect on initial flight performance. DISCUSSION IIV plays an important role in real-world tasks and is another aspect of cognition that underlies age-related differences in cognitive performance.
Collapse
Affiliation(s)
- Quinn Kennedy
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, California, USA.
| | | | | | | | | | | |
Collapse
|
5
|
Taylor JL, Kennedy Q, Adamson MM, Lazzeroni LC, Noda A, Murphy GM, Yesavage JA. Influences of APOE ε4 and expertise on performance of older pilots. Psychol Aging 2011; 26:480-7. [PMID: 21668123 DOI: 10.1037/a0021697] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Little is known about how APOE ε4-related differences in cognitive performance translate to real-life performance, where training and experience may help to sustain performance. We investigated the influences of APOE ε4 status, expertise (FAA pilot proficiency ratings), and their interaction on longitudinal flight simulator performance. Over a 2-year period, 139 pilots aged 42-69 years were tested annually. APOE ε4 carriers had lower memory performance than noncarriers (p = .019). APOE interacted with Expertise (p = .036), such that the beneficial influence of expertise (p = .013) on longitudinal flight simulator performance was more pronounced for ε4 carriers. Results suggest that relevant training and activity may help sustain middle-aged and older adults' real-world performance, especially among APOE ε4 carriers.
Collapse
Affiliation(s)
- Joy L Taylor
- Psychiatry Service, Department of Veterans Affairs, Palo Alto Health Care System. Palo Alto, CA 94304-1207, USA.
| | | | | | | | | | | | | |
Collapse
|
6
|
BDNF polymorphism predicts the rate of decline in skilled task performance and hippocampal volume in healthy individuals. Transl Psychiatry 2011; 1:e51. [PMID: 22833197 PMCID: PMC3309489 DOI: 10.1038/tp.2011.47] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023] Open
Abstract
Numerous studies have indicated a link between the presence of polymorphism in brain-derived neurotrophic factor (BDNF) and cognitive and affective disorders. However, only a few have studied these effects longitudinally along with structural changes in the brain. This study was carried out to investigate whether valine-to-methionine substitution at position 66 (val66met) of pro-BDNF could be linked to alterations in the rate of decline in skilled task performance and structural changes in hippocampal volume. Participants consisted of 144 healthy Caucasian pilots (aged 40-69 years) who completed a minimum of 3 consecutive annual visits. Standardized flight simulator score (SFSS) was measured as a reliable and quantifiable indicator for skilled task performance. In addition, a subset of these individuals was assessed for hippocampal volume alterations using magnetic resonance imaging. We found that val66met substitution in BDNF correlated longitudinally with the rate of decline in SFSS. Structurally, age-dependent hippocampal volume changes were also significantly altered by this substitution. Our study suggests that val66met polymorphism in BDNF can be linked to the rate of decline in skilled task performance. Furthermore, this polymorphism could be used as a predictor of the effects of age on the structure of the hippocampus in healthy individuals. Such results have implications for understanding possible disabilities in older adults performing skilled tasks who are at a higher risk for cognitive and affective disorders.Translational Psychiatry (2011) 1, e51; doi:10.1038/tp.2011.47; published online 25 October 2011.
Collapse
|
7
|
Yesavage JA, Jo B, Adamson MM, Kennedy Q, Noda A, Hernandez B, Zeitzer JM, Friedman LF, Fairchild K, Scanlon BK, Murphy GM, Taylor JL. Initial cognitive performance predicts longitudinal aviator performance. J Gerontol B Psychol Sci Soc Sci 2011; 66:444-53. [PMID: 21586627 DOI: 10.1093/geronb/gbr031] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVES The goal of the study was to improve prediction of longitudinal flight simulator performance by studying cognitive factors that may moderate the influence of chronological age. METHOD We examined age-related change in aviation performance in aircraft pilots in relation to baseline cognitive ability measures and aviation expertise. Participants were aircraft pilots (N = 276) aged 40-77.9. Flight simulator performance and cognition were tested yearly; there were an average of 4.3 (± 2.7; range 1-13) data points per participant. Each participant was classified into one of the three levels of aviation expertise based on Federal Aviation Administration pilot proficiency ratings: least, moderate, or high expertise. RESULTS Addition of measures of cognitive processing speed and executive function to a model of age-related change in aviation performance significantly improved the model. Processing speed and executive function performance interacted such that the slowest rate of decline in flight simulator performance was found in aviators with the highest scores on tests of these abilities. Expertise was beneficial to pilots across the age range studied; however, expertise did not show evidence of reducing the effect of age. DISCUSSION These data suggest that longitudinal performance on an important real-world activity can be predicted by initial assessment of relevant cognitive abilities.
Collapse
Affiliation(s)
- Jerome A Yesavage
- Stanford/VA Aging Clinical Research Center, VA Palo Alto Health Care System, Palo Alto, CA 94304-1207, USA.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
8
|
The roles of COMT val158met status and aviation expertise in flight simulator performance and cognitive ability. Behav Genet 2010; 41:700-8. [PMID: 21193954 DOI: 10.1007/s10519-010-9436-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2010] [Accepted: 12/17/2010] [Indexed: 10/18/2022]
Abstract
The polymorphic variation in the val158met position of the catechol-O-methyltransferase (COMT) gene is associated with differences in executive performance, processing speed, and attention. The purpose of this study is: (1) replicate previous COMT val158met findings on cognitive performance; (2) determine whether COMT val158met effects extend to a real-world task, aircraft navigation performance in a flight simulator; and (3) determine if aviation expertise moderates any effect of COMT val158met status on flight simulator performance. One hundred seventy two pilots aged 41-69 years, who varied in level of aviation training and experience, completed flight simulator, cognitive, and genetic assessments. Results indicate that although no COMT effect was found for an overall measure of flight performance, a positive effect of the met allele was detected for two aspects of cognitive ability: executive functioning and working memory performance. Pilots with the met/met genotype benefited more from increased levels of expertise than other participants on a traffic avoidance measure, which is a component of flight simulator performance. These preliminary results indicate that COMT val158met polymorphic variation can affect a real-world task.
Collapse
|
9
|
Abstract
Previous studies have consistently reported age-related changes in cognitive abilities and brain structure. Previous studies also suggest compensatory roles for specialized training, skill, and years of education in the age-related decline of cognitive function. The Stanford/VA Aviation Study examines the influence of specialized training and skill level (expertise) on age-related changes in cognition and brain structure. This preliminary report examines the effect of aviation expertise, years of education, age, and brain size on flight simulator performance in pilots aged 45-68 years. Fifty-one pilots were studied with structural magnetic resonance imaging, flight simulator, and processing speed tasks. There were significant main effects of age (p < .01) and expertise (p < .01), but not of whole brain size (p > .1) or education (p > .1), on flight simulator performance. However, even though age and brain size were correlated (r = -0.41), age differences in flight simulator performance were not explained by brain size. Both aviation expertise and education were involved in an interaction with brain size in predicting flight simulator performance (p < .05). These results point to the importance of examining measures of expertise and their interactions to assess age-related cognitive changes.
Collapse
|
10
|
Taylor JL, Kennedy Q, Noda A, Yesavage JA. Pilot age and expertise predict flight simulator performance: a 3-year longitudinal study. Neurology 2007; 68:648-54. [PMID: 17325270 PMCID: PMC2907140 DOI: 10.1212/01.wnl.0000255943.10045.c0] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND Expert knowledge may compensate for age-related declines in basic cognitive and sensory-motor abilities in some skill domains. We investigated the influence of age and aviation expertise (indexed by Federal Aviation Administration pilot ratings) on longitudinal flight simulator performance. METHODS Over a 3-year period, 118 general aviation pilots aged 40 to 69 years were tested annually, in which their flight performance was scored in terms of 1) executing air-traffic controller communications; 2) traffic avoidance; 3) scanning cockpit instruments; 4) executing an approach to landing; and 5) a flight summary score. RESULTS More expert pilots had better flight summary scores at baseline and showed less decline over time. Secondary analyses revealed that expertise effects were most evident in the accuracy of executing aviation communications, the measure on which performance declined most sharply over time. Regarding age, even though older pilots initially performed worse than younger pilots, over time older pilots showed less decline in flight summary scores than younger pilots. Secondary analyses revealed that the oldest pilots did well over time because their traffic avoidance performance improved more vs younger pilots. CONCLUSIONS These longitudinal findings support previous cross-sectional studies in aviation as well as non-aviation domains, which demonstrated the advantageous effect of prior experience and specialized expertise on older adults' skilled cognitive performances.
Collapse
Affiliation(s)
- Joy L Taylor
- Department of Veterans Affairs and Sierra-Pacific MIRECC, Palo Alto, CA, USA.
| | | | | | | |
Collapse
|
11
|
|
12
|
Taylor JL, O'Hara R, Mumenthaler MS, Rosen AC, Yesavage JA. Cognitive ability, expertise, and age differences in following air-traffic control instructions. Psychol Aging 2005; 20:117-33. [PMID: 15769218 DOI: 10.1037/0882-7974.20.1.117] [Citation(s) in RCA: 51] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Differences in cognitive ability and domain-specific expertise may help explain age differences in pilot performance. Pilots heard air-traffic controller messages and then executed them while "flying" in a simulator. Messages varied in length and speech rate. Age was associated with lower accuracy, but the expected Age x Message Difficulty interactions were not obtained. Expertise, as indexed by pilot ratings, was associated with higher accuracy; yet expertise did not reduce age differences in accuracy. The effect of age on communication task accuracy was largely explainable as an age-associated decrease in working memory span, which in turn was explainable as decreases in both speed and interference control. Results are discussed within frameworks of deliberate practice and cognitive mediation of age differences.
Collapse
Affiliation(s)
- Joy L Taylor
- Psychiatry Service, Sierra-Pacific Mental Illness Research, Education and Clinical Center, Department of Veterans Affairs, Palo Alto, CA 94304-1207, USA.
| | | | | | | | | |
Collapse
|
13
|
Morrow DG, Menard WE, Ridolfo HE, Stine-Morrow EAL, Teller T, Bryant D. Expertise, Cognitive Ability, and Age Effects on Pilot Communication. ACTA ACUST UNITED AC 2003. [DOI: 10.1207/s15327108ijap1304_02] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
14
|
Morrow DG, Ridolfo HE, Menard WE, Sanborn A, Stine-Morrow EAL, Magnor C, Herman L, Teller T, Bryant D. Environmental support promotes expertise-based mitigation of age differences on pilot communication tasks. Psychol Aging 2003; 18:268-84. [PMID: 12825776 DOI: 10.1037/0882-7974.18.2.268] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The authors investigated whether expertise is more likely to mitigate age declines when experts rely on environmental support in a pilot/Air Traffic Control (ATC) communication task. Pilots and nonpilots listened to ATC messages that described a route through an airspace, while they referred to a chart of the airspace. They read back (repeated) each message and then answered a probe question about the route. In a preliminary study, participants could take notes while listening to the messages and performing the read-back and probe tasks. In Experiment 1, opportunity to take notes was manipulated. Note taking determined when expertise mitigated age differences on the read-back task. With note taking, read-back accuracy declined with age for nonpilots but not for pilots. Without note taking, similar age-related declines occurred for pilots and nonpilots. Benefits of expertise, younger age, and note taking occurred for probe accuracy, but mitigation did not occur. The findings suggest that older adults take advantage of a domain-relevant form of environmental support (note taking) to maintain performance on some complex tasks despite typical age-related declines in cognitive ability.
Collapse
Affiliation(s)
- Daniel G Morrow
- Institute of Aviation, Aviation Human Factors Division, University of Illinois at Urbana-Champaign, Savoy 61874, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
15
|
|