Sensitivity of the informant questionnaire on cognitive decline: an application of item response theory

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the detection of dementia within a secondary care setting

BACKGROUND

The diagnosis of dementia relies on the presence of new-onset cognitive impairment affecting an individual's functioning and activities of daily living. The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) is a questionnaire instrument, completed by a suitable 'informant' who knows the patient well, designed to assess change in functional performance secondary to cognitive change; it is used as a tool for identifying those who may have dementia. In secondary care there are two specific instances where patients may be assessed for the presence of dementia. These are in the general acute hospital setting, where opportunistic screening may be undertaken, or in specialist memory services where individuals have been referred due to perceived cognitive problems. To ensure an instrument is suitable for diagnostic use in these settings, its test accuracy must be established.

OBJECTIVES

To determine the accuracy of the informant-based questionnaire IQCODE for detection of dementia in a secondary care setting.

SEARCH METHODS

We searched the following sources on the 28th of January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (Ovid SP), EMBASE (Ovid SP), PsycINFO (Ovid SP), BIOSIS Previews (Thomson Reuters Web of Science), Web of Science Core Collection (includes Conference Proceedings Citation Index) (Thomson Reuters Web of Science), CINAHL (EBSCOhost) and LILACS (BIREME). We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (Database of Abstracts of Reviews of Effects - via the Cochrane Library); HTA Database (Health Technology Assessment Database via the Cochrane Library) and ARIF (Birmingham University). We also checked reference lists of relevant studies and reviews, used searches of known relevant studies in PubMed to track related articles, and contacted research groups conducting work on IQCODE for dementia diagnosis to try to find additional studies. We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel and included terms relating to cognitive tests, cognitive screening and dementia. We used standardised database subject headings such as MeSH terms (in MEDLINE) and other standardised headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected those studies performed in secondary-care settings, which included (not necessarily exclusively) IQCODE to assess for the presence of dementia and where dementia diagnosis was confirmed with clinical assessment. For the 'secondary care' setting we included all studies which assessed patients in hospital (e.g. acute unscheduled admissions, referrals to specialist geriatric assessment services etc.) and those referred for specialist 'memory' assessment, typically in psychogeriatric services.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by electronic database searches, and reviewed abstracts of all potentially relevant studies. Two independent assessors checked full papers for eligibility and extracted data. We determined quality assessment (risk of bias and applicability) using the QUADAS-2 tool, and reporting quality using the STARD tool.

MAIN RESULTS

From 72 papers describing IQCODE test accuracy, we included 13 papers, representing data from 2745 individuals (n = 1413 (51%) with dementia). Pooled analysis of all studies using data presented closest to a cut-off of 3.3 indicated that sensitivity was 0.91 (95% CI 0.86 to 0.94); specificity 0.66 (95% CI 0.56 to 0.75); the positive likelihood ratio was 2.7 (95% CI 2.0 to 3.6) and the negative likelihood ratio was 0.14 (95% CI 0.09 to 0.22). There was a statistically significant difference in test accuracy between the general hospital setting and the specialist memory setting (P = 0.019), suggesting that IQCODE performs better in a 'general' setting. We found no significant differences in the test accuracy of the short (16-item) versus the 26-item IQCODE, or in the language of administration. There was significant heterogeneity in the included studies, including a highly varied prevalence of dementia (10.5% to 87.4%). Across the included papers there was substantial potential for bias, particularly around sampling of included participants and selection criteria, which may limit generalisability. There was also evidence of suboptimal reporting, particularly around disease severity and handling indeterminate results, which are important if considering use in clinical practice.

AUTHORS' CONCLUSIONS

The IQCODE can be used to identify older adults in the general hospital setting who are at risk of dementia and require specialist assessment; it is useful specifically for ruling out those without evidence of cognitive decline. The language of administration did not affect test accuracy, which supports the cross-cultural use of the tool. These findings are qualified by the significant heterogeneity, the potential for bias and suboptimal reporting found in the included studies.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the detection of dementia within a general practice (primary care) setting

BACKGROUND

The IQCODE (Informant Questionnaire for Cognitive Decline in the Elderly) is a commonly used questionnaire based tool that uses collateral information to assess for cognitive decline and dementia. Brief tools that can be used for dementia "screening" or "triage" may have particular utility in primary care / general practice healthcare settings but only if they have suitable test accuracy. A synthesis of the available data regarding IQCODE accuracy in a primary care setting should help inform cognitive assessment strategies for clinical practice; research and policy.

OBJECTIVES

To determine the accuracy of the informant-based questionnaire IQCODE, for detection of dementia in a primary care setting.

SEARCH METHODS

A search was performed in the following sources on the 28th of January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (Ovid SP), EMBASE (Ovid SP), PsycINFO (Ovid SP), BIOSIS (Ovid SP), ISI Web of Science and Conference Proceedings (ISI Web of Knowledge), CINHAL (EBSCOhost) and LILACs (BIREME). We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (York University); HTA Database (Health Technology Assessments Database via The Cochrane Library) and ARIF (Birmingham University). We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel and included terms relating to cognitive tests, cognitive screening and dementia. We used standardized database subject headings such as MeSH terms (in MEDLINE) and other standardized headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected those studies performed in primary care settings, which included (not necessarily exclusively) IQCODE to assess for the presence of dementia and where dementia diagnosis was confirmed with clinical assessment. For the "primary care" setting, we included those healthcare settings where unselected patients, present for initial, non-specialist assessment of memory or non-memory related symptoms; often with a view to onward referral for more definitive assessment.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by electronic database searches and abstracts of all potentially relevant studies were reviewed. Full papers were assessed for eligibility and data extracted by two independent assessors. Quality assessment (risk of bias and applicability) was determined using the QUADAS-2 tool. Reporting quality was determined using the STARDdem extension to the STARD tool.

MAIN RESULTS

From 71 papers describing IQCODE test accuracy, we included 1 paper, representing data from 230 individuals (n=16 [7%] with dementia). The paper described those patients consulting a primary care service who self-identified as Japanese-American. Dementia diagnosis was made using Benson & Cummings criteria and the IQCODE was recorded as part of a longer interview with the informant. IQCODE accuracy was assessed at various test thresholds, with a "trade-off" between sensitivity and specificity across these cutpoints. At an IQCODE threshold of 3.2 sensitivity: 100%, specificity: 76%; for IQCODE 3.7 sensitivity: 75%, specificity: 98%. Applying the QUADAS-2 assessments, the study was at high risk of bias in all categories. In particular degree of blinding was unclear and not all participants were included in the final analysis.

AUTHORS' CONCLUSIONS

It is not possible to give definitive guidance on the test accuracy of IQCODE for the diagnosis of dementia in a primary care setting based on the single study identified. We are surprised by the lack of research using the IQCODE in primary care as this is, arguably, the most appropriate setting for targeted case finding of those with undiagnosed dementia in order to maximise opportunities to intervene and provide support for the individual and their carers.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the detection of dementia within community dwelling populations

BACKGROUND

Various tools exist for initial assessment of possible dementia with no consensus on the optimal assessment method. Instruments that use collateral sources to assess change in cognitive function over time may have particular utility. The most commonly used informant dementia assessment is the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). A synthesis of the available data regarding IQCODE accuracy will help inform cognitive assessment strategies for clinical practice, research and policy.

OBJECTIVES

Our primary obective was to determine the accuracy of the informant-based questionnaire IQCODE for detection of dementia within community dwelling populations. Our secondary objective was to describe the effect of heterogeneity on the summary estimates. We were particularly interested in the traditional 26-item scale versus the 16-item short form; and language of administration. We explored the effect of varying the threshold IQCODE score used to define 'test positivity'.

SEARCH METHODS

We searched the following sources on 28 January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (OvidSP), EMBASE (OvidSP), PsycINFO (OvidSP), BIOSIS Previews (ISI Web of Knowledge), Web of Science with Conference Proceedings (ISI Web of Knowledge), LILACS (BIREME). We also searched sources relevant or specific to diagnostic test accuracy: MEDION (Universities of Maastrict and Leuven); DARE (York University); ARIF (Birmingham University). We used sensitive search terms based on MeSH terms and other controlled vocabulary.

SELECTION CRITERIA

We selected those studies performed in community settings that used (not necessarily exclusively) the IQCODE to assess for presence of dementia and, where dementia diagnosis was confirmed with clinical assessment. Our intention with limiting the search to a 'community' setting was to include those studies closest to population level assessment. Within our predefined community inclusion criteria, there were relevant papers that fulfilled our definition of community dwelling but represented a selected population, for example stroke survivors. We included these studies but performed sensitivity analyses to assess the effects of these less representative populations on the summary results.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by the electronic database searches and abstracts of all potentially relevant studies were reviewed. Full papers were assessed for eligibility and data extracted by two independent assessors. For quality assessment (risk of bias and applicability) we used the QUADAS 2 tool. We included test accuracy data on the IQCODE used at predefined diagnostic thresholds. Where data allowed, we performed meta-analyses to calculate summary values of sensitivity and specificity with corresponding 95% confidence intervals (CIs). We pre-specified analyses to describe the effect of IQCODE format (traditional or short form) and language of administration for the IQCODE.

MAIN RESULTS

From 16,144 citations, 71 papers described IQCODE test accuracy. We included 10 papers (11 independent datasets) representing data from 2644 individuals (n = 379 (14%) with dementia). Using IQCODE cut-offs commonly employed in clinical practice (3.3, 3.4, 3.5, 3.6) the sensitivity and specificity of IQCODE for diagnosis of dementia across the studies were generally above 75%. Taking an IQCODE threshold of 3.3 (or closest available) the sensitivity was 0.80 (95% CI 0.75 to 0.85); specificity was 0.84 (95% CI 0.78 to 0.90); positive likelihood ratio was 5.2 (95% CI 3.7 to 7.5) and the negative likelihood ratio was 0.23 (95% CI 0.19 to 0.29). Comparative analysis suggested no significant difference in the test accuracy of the 16 and 26-item IQCODE tests and no significant difference in test accuracy by language of administration. There was little difference in sensitivity across our predefined diagnostic cut-points. There was substantial heterogeneity in the included studies. Sensitivity analyses removing potentially unrepresentative populations in these studies made little difference to the pooled data estimates. The majority of included papers had potential for bias, particularly around participant selection and sampling. The quality of reporting was suboptimal particularly regarding timing of assessments and descriptors of reproducibility and inter-observer variability.

AUTHORS' CONCLUSIONS

Published data suggest that if using the IQCODE for community dwelling older adults, the 16 item IQCODE may be preferable to the traditional scale due to lesser test burden and no obvious difference in accuracy. Although IQCODE test accuracy is in a range that many would consider 'reasonable', in the context of community or population settings the use of the IQCODE alone would result in substantial misdiagnosis and false reassurance. Across the included studies there were issues with heterogeneity, several potential biases and suboptimal reporting quality.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the early detection of dementia across a variety of healthcare settings

BACKGROUND

The Informant Questionnaire for Cognitive Decline in the Elderly (IQCODE) is a structured interview based on informant responses that is used to assess for possible dementia. IQCODE has been used for retrospective or contemporaneous assessment of cognitive decline. There is considerable interest in tests that may identify those at future risk of developing dementia. Assessing a population free of dementia for the prospective development of dementia is an approach often used in studies of dementia biomarkers. In theory, questionnaire-based assessments, such as IQCODE, could be used in a similar way, assessing for dementia that is diagnosed on a later (delayed) assessment.

OBJECTIVES

To determine the accuracy of the informant-based questionnaire IQCODE for the early detection of dementia across a variety of health care settings.

SEARCH METHODS

We searched these sources on 16 January 2016: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE Ovid SP, Embase Ovid SP, PsycINFO Ovid SP, BIOSIS Previews on Thomson Reuters Web of Science, Web of Science Core Collection (includes Conference Proceedings Citation Index) on Thomson Reuters Web of Science, CINAHL EBSCOhost, and LILACS BIREME. We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (Database of Abstracts of Reviews of Effects, in the Cochrane Library); HTA Database (Health Technology Assessment Database, in the Cochrane Library), and ARIF (Birmingham University). We checked reference lists of included studies and reviews, used searches of included studies in PubMed to track related articles, and contacted research groups conducting work on IQCODE for dementia diagnosis to try to find additional studies. We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel, and included terms relating to cognitive tests, cognitive screening, and dementia. We used standardised database subject headings, such as MeSH terms (in MEDLINE) and other standardised headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected studies that included a population free from dementia at baseline, who were assessed with the IQCODE and subsequently assessed for the development of dementia over time. The implication was that at the time of testing, the individual had a cognitive problem sufficient to result in an abnormal IQCODE score (defined by the study authors), but not yet meeting dementia diagnostic criteria.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by the electronic database searches, and reviewed abstracts of all potentially relevant studies. Two assessors independently checked the full papers for eligibility and extracted data. We determined quality assessment (risk of bias and applicability) using the QUADAS-2 tool, and reported quality using the STARDdem tool.

MAIN RESULTS

From 85 papers describing IQCODE, we included three papers, representing data from 626 individuals. Of this total, 22% (N = 135/626) were excluded because of prevalent dementia. There was substantial attrition; 47% (N = 295) of the study population received reference standard assessment at first follow-up (three to six months) and 28% (N = 174) received reference standard assessment at final follow-up (one to three years). Prevalence of dementia ranged from 12% to 26% at first follow-up and 16% to 35% at final follow-up. The three studies were considered to be too heterogenous to combine, so we did not perform meta-analyses to describe summary estimates of interest. Included patients were poststroke (two papers) and hip fracture (one paper). The IQCODE was used at three thresholds of positivity (higher than 3.0, higher than 3.12 and higher than 3.3) to predict those at risk of a future diagnosis of dementia. Using a cut-off of 3.0, IQCODE had a sensitivity of 0.75 (95%CI 0.51 to 0.91) and a specificity of 0.46 (95%CI 0.34 to 0.59) at one year following stroke. Using a cut-off of 3.12, the IQCODE had a sensitivity of 0.80 (95%CI 0.44 to 0.97) and specificity of 0.53 (95C%CI 0.41 to 0.65) for the clinical diagnosis of dementia at six months after hip fracture. Using a cut-off of 3.3, the IQCODE had a sensitivity of 0.84 (95%CI 0.68 to 0.94) and a specificity of 0.87 (95%CI 0.76 to 0.94) for the clinical diagnosis of dementia at one year after stroke. In generaI, the IQCODE was sensitive for identification of those who would develop dementia, but lacked specificity. Methods for both excluding prevalent dementia at baseline and assessing for the development of dementia were varied, and had the potential to introduce bias.

AUTHORS' CONCLUSIONS

Included studies were heterogenous, recruited from specialist settings, and had potential biases. The studies identified did not allow us to make specific recommendations on the use of the IQCODE for the future detection of dementia in clinical practice. The included studies highlighted the challenges of delayed verification dementia research, with issues around prevalent dementia assessment, loss to follow-up over time, and test non-completion potentially limiting the studies. Future research should recognise these issues and have explicit protocols for dealing with them.

Using item response theory to optimize measurement of chronic stress in pregnancy

OBJECTIVE

Utilize Rasch analysis to develop an optimized self-reported measure of stress in pregnancy and examine the association with patient demographics and biologic measures of stress.

STUDY DESIGN

Measured self-reported stress in pregnant women using 12 existing scales. Collected blood for biologic measures of stress (Epstein Barr Virus [EBV], C-Reactive Protein [CRP], Corticotropin Reactive Hormone [pCRH], and Adenocorticotropin Hormone [ACTH]). Used multidimensional scaling and Rasch analysis to produce an item reduced self-report measure.

RESULTS

Enrolled 112 women. Survey items reduced to two factors: perceived stressors and buffers of stress. Women with a domestic partner had lower perceived stress (p = 0.003). Caucasian women reported higher buffers of stress (p = 0.045), as did women with private insurance (p < 0.001), a planned pregnancy (p < 0.01), and a domestic partner (p < 0.001). Women with higher buffers of stress had lower levels of pCRH (adjusted p = 0.01).

CONCLUSION

Item reduced, optimized measures of stress were associated with significant differences in patient demographics and biologic measures of stress.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the early diagnosis of dementia across a variety of healthcare settings

BACKGROUND

The Informant Questionnaire for Cognitive Decline in the Elderly (IQCODE) is a structured interview based on informant responses that is used to assess for possible dementia. IQCODE has been used for retrospective or contemporaneous assessment of cognitive decline. There is considerable interest in tests that may identify those at future risk of developing dementia. Assessing a population free of dementia for the prospective development of dementia is an approach often used in studies of dementia biomarkers. In theory, questionnaire-based assessments, such as IQCODE, could be used in a similar way, assessing for dementia that is diagnosed on a later (delayed) assessment.

OBJECTIVES

To determine the diagnostic accuracy of IQCODE in a population free from dementia for the delayed diagnosis of dementia (test accuracy with delayed verification study design).

SEARCH METHODS

We searched these sources on 16 January 2016: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE Ovid SP, Embase Ovid SP, PsycINFO Ovid SP, BIOSIS Previews on Thomson Reuters Web of Science, Web of Science Core Collection (includes Conference Proceedings Citation Index) on Thomson Reuters Web of Science, CINAHL EBSCOhost, and LILACS BIREME. We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (Database of Abstracts of Reviews of Effects, in the Cochrane Library); HTA Database (Health Technology Assessment Database, in the Cochrane Library), and ARIF (Birmingham University). We checked reference lists of included studies and reviews, used searches of included studies in PubMed to track related articles, and contacted research groups conducting work on IQCODE for dementia diagnosis to try to find additional studies. We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel, and included terms relating to cognitive tests, cognitive screening, and dementia. We used standardised database subject headings, such as MeSH terms (in MEDLINE) and other standardised headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected studies that included a population free from dementia at baseline, who were assessed with the IQCODE and subsequently assessed for the development of dementia over time. The implication was that at the time of testing, the individual had a cognitive problem sufficient to result in an abnormal IQCODE score (defined by the study authors), but not yet meeting dementia diagnostic criteria.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by the electronic database searches, and reviewed abstracts of all potentially relevant studies. Two assessors independently checked the full papers for eligibility and extracted data. We determined quality assessment (risk of bias and applicability) using the QUADAS-2 tool, and reported quality using the STARDdem tool.

MAIN RESULTS

From 85 papers describing IQCODE, we included three papers, representing data from 626 individuals. Of this total, 22% (N = 135/626) were excluded because of prevalent dementia. There was substantial attrition; 47% (N = 295) of the study population received reference standard assessment at first follow-up (three to six months) and 28% (N = 174) received reference standard assessment at final follow-up (one to three years). Prevalence of dementia ranged from 12% to 26% at first follow-up and 16% to 35% at final follow-up.The three studies were considered to be too heterogenous to combine, so we did not perform meta-analyses to describe summary estimates of interest. Included patients were poststroke (two papers) and hip fracture (one paper). The IQCODE was used at three thresholds of positivity (higher than 3.0, higher than 3.12 and higher than 3.3) to predict those at risk of a future diagnosis of dementia. Using a cut-off of 3.0, IQCODE had a sensitivity of 0.75 (95%CI 0.51 to 0.91) and a specificity of 0.46 (95%CI 0.34 to 0.59) at one year following stroke. Using a cut-off of 3.12, the IQCODE had a sensitivity of 0.80 (95%CI 0.44 to 0.97) and specificity of 0.53 (95C%CI 0.41 to 0.65) for the clinical diagnosis of dementia at six months after hip fracture. Using a cut-off of 3.3, the IQCODE had a sensitivity of 0.84 (95%CI 0.68 to 0.94) and a specificity of 0.87 (95%CI 0.76 to 0.94) for the clinical diagnosis of dementia at one year after stroke.In generaI, the IQCODE was sensitive for identification of those who would develop dementia, but lacked specificity. Methods for both excluding prevalent dementia at baseline and assessing for the development of dementia were varied, and had the potential to introduce bias.

AUTHORS' CONCLUSIONS

Included studies were heterogenous, recruited from specialist settings, and had potential biases. The studies identified did not allow us to make specific recommendations on the use of the IQCODE for the future diagnosis of dementia in clinical practice. The included studies highlighted the challenges of delayed verification dementia research, with issues around prevalent dementia assessment, loss to follow-up over time, and test non-completion potentially limiting the studies. Future research should recognise these issues and have explicit protocols for dealing with them.

Re-assessing the dimensional structure of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): empirical evidence for a shortened Brazilian version

BACKGROUND

The dimensional structure, effective number of item responses and item redundancies are controversial features of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) requiring more light. The aims of the present study are to revisit the dimensional structure and propose a shorter version of the instrument.

METHODS

The sample comprised 652 elderly and their informants, either attending a geriatric service of a public university clinic or enrolled in a health care provider database in Rio de Janeiro, Brazil. A Confirmatory Factor Analysis (CFA) first tested the originally proposed one-dimensional structure comprised of 26 items. This was followed by sequential Exploratory Structural Equation Model (ESEM) to evaluate alternative models, in particular a bi-dimensional solution. The identification of residual correlations (RC) lead to a shortened 20-item model, which was tested further via CFA.

RESULTS

The original model fitted poorly (RMSEA = 0.073; 90% CI: 0.069-0.077). Regarding the two-dimensional model, the exploratory procedure (ESEM) indicated several RCs and a lack of factor-based discriminant validity. The ensuing CFA on the one-dimensional model with freely estimated RCs showed an adequate fit (RMSEA = 0.051; 90% CI: 0.047-0.055). Addressing the identified RCs, the CFA on the abridged 20-item version also showed an adequate fit (RMSEA = 0.058; 90% CI: 0.053-0.064) and no further RCs.

CONCLUSION

A one-factor dimensional structure and a reduced version with 20 locally independent items were the most tenable solution. However, although promising, this simpler structure requires further examination before it may be fully supported and recommended.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the diagnosis of dementia within a secondary care setting

BACKGROUND

The diagnosis of dementia relies on the presence of new-onset cognitive impairment affecting an individual's functioning and activities of daily living. The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) is a questionnaire instrument, completed by a suitable 'informant' who knows the patient well, designed to assess change in functional performance secondary to cognitive change; it is used as a tool to identifying those who may have dementia.In secondary care there are two specific instances where patients may be assessed for the presence of dementia. These are in the general acute hospital setting, where opportunistic screening may be undertaken, or in specialist memory services where individuals have been referred due to perceived cognitive problems. To ensure an instrument is suitable for diagnostic use in these settings, its test accuracy must be established.

OBJECTIVES

To determine the diagnostic accuracy of the informant-based questionnaire IQCODE, for detection of all-cause (undifferentiated) dementia in adults presenting to secondary-care services.

SEARCH METHODS

We searched the following sources on the 28th of January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (Ovid SP), EMBASE (Ovid SP), PsycINFO (Ovid SP), BIOSIS Previews (Thomson Reuters Web of Science), Web of Science Core Collection (includes Conference Proceedings Citation Index) (Thomson Reuters Web of Science), CINAHL (EBSCOhost) and LILACS (BIREME). We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (Database of Abstracts of Reviews of Effects - via the Cochrane Library); HTA Database (Health Technology Assessment Database via the Cochrane Library) and ARIF (Birmingham University). We also checked reference lists of relevant studies and reviews, used searches of known relevant studies in PubMed to track related articles, and contacted research groups conducting work on IQCODE for dementia diagnosis to try to find additional studies. We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel and included terms relating to cognitive tests, cognitive screening and dementia. We used standardised database subject headings such as MeSH terms (in MEDLINE) and other standardised headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected those studies performed in secondary-care settings, which included (not necessarily exclusively) IQCODE to assess for the presence of dementia and where dementia diagnosis was confirmed with clinical assessment. For the 'secondary care' setting we included all studies which assessed patients in hospital (e.g. acute unscheduled admissions, referrals to specialist geriatric assessment services etc.) and those referred for specialist 'memory' assessment, typically in psychogeriatric services.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by electronic database searches, and reviewed abstracts of all potentially relevant studies. Two independent assessors checked full papers for eligibility and extracted data. We determined quality assessment (risk of bias and applicability) using the QUADAS-2 tool, and reporting quality using the STARD tool.

MAIN RESULTS

From 72 papers describing IQCODE test accuracy, we included 13 papers, representing data from 2745 individuals (n = 1413 (51%) with dementia). Pooled analysis of all studies using data presented closest to a cut-off of 3.3 indicated that sensitivity was 0.91 (95% CI 0.86 to 0.94); specificity 0.66 (95% CI 0.56 to 0.75); the positive likelihood ratio was 2.7 (95% CI 2.0 to 3.6) and the negative likelihood ratio was 0.14 (95% CI 0.09 to 0.22).There was a statistically significant difference in test accuracy between the general hospital setting and the specialist memory setting (P = 0.019), suggesting that IQCODE performs better in a 'general' setting.We found no significant differences in the test accuracy of the short (16-item) versus the 26-item IQCODE, or in the language of administration.There was significant heterogeneity in the included studies, including a highly varied prevalence of dementia (10.5% to 87.4%). Across the included papers there was substantial potential for bias, particularly around sampling of included participants and selection criteria, which may limit generalisability. There was also evidence of suboptimal reporting, particularly around disease severity and handling indeterminate results, which are important if considering use in clinical practice.

AUTHORS' CONCLUSIONS

The IQCODE can be used to identify older adults in the general hospital setting who are at risk of dementia and require specialist assessment; it is useful specifically for ruling out those without evidence of cognitive decline. The language of administration did not affect test accuracy, which supports the cross-cultural use of the tool. These findings are qualified by the significant heterogeneity, the potential for bias and suboptimal reporting found in the included studies.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the diagnosis of dementia within a general practice (primary care) setting

BACKGROUND

The IQCODE (Informant Questionnaire for Cognitive Decline in the Elderly) is a commonly used questionnaire based tool that uses collateral information to assess for cognitive decline and dementia. Brief tools that can be used for dementia "screening" or "triage" may have particular utility in primary care / general practice healthcare settings but only if they have suitable test accuracy.A synthesis of the available data regarding IQCODE accuracy in a primary care setting should help inform cognitive assessment strategies for clinical practice; research and policy.

OBJECTIVES

We sought to describe the accuracy of IQCODE (the index test) against a clinical diagnosis of dementia (the reference standard). In this review we focus on those studies conducted in a primary care (general practice) setting.

SEARCH METHODS

A search was performed in the following sources on the 28th of January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (Ovid SP), EMBASE (Ovid SP), PsycINFO (Ovid SP), BIOSIS (Ovid SP), ISI Web of Science and Conference Proceedings (ISI Web of Knowledge), CINHAL (EBSCOhost) and LILACs (BIREME). We also searched sources specific to diagnostic test accuracy: MEDION (Universities of Maastricht and Leuven); DARE (York University); HTA Database (Health Technology Assessments Database via The Cochrane Library) and ARIF (Birmingham University). We developed a sensitive search strategy; search terms were designed to cover key concepts using several different approaches run in parallel and included terms relating to cognitive tests, cognitive screening and dementia. We used standardized database subject headings such as MeSH terms (in MEDLINE) and other standardized headings (controlled vocabulary) in other databases, as appropriate.

SELECTION CRITERIA

We selected those studies performed in primary care settings, which included (not necessarily exclusively) IQCODE to assess for the presence of dementia and where dementia diagnosis was confirmed with clinical assessment. For the "primary care" setting, we included those healthcare settings where unselected patients, present for initial, non-specialist assessment of memory or non-memory related symptoms; often with a view to onward referral for more definitive assessment.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by electronic database searches and abstracts of all potentially relevant studies were reviewed. Full papers were assessed for eligibility and data extracted by two independent assessors. Quality assessment (risk of bias and applicability) was determined using the QUADAS-2 tool. Reporting quality was determined using the STARDdem extension to the STARD tool.

MAIN RESULTS

From 71 papers describing IQCODE test accuracy, we included 1 paper, representing data from 230 individuals (n=16 [7%] with dementia). The paper described those patients consulting a primary care service who self-identified as Japanese-American. Dementia diagnosis was made using Benson & Cummings criteria and the IQCODE was recorded as part of a longer interview with the informant.IQCODE accuracy was assessed at various test thresholds, with a "trade-off" between sensitivity and specificity across these cutpoints. At an IQCODE threshold of 3.2 sensitivity: 100%, specificity: 76%; for IQCODE 3.7 sensitivity: 75%, specificity: 98%.Applying the QUADAS-2 assessments, the study was at high risk of bias in all categories. In particular degree of blinding was unclear and not all participants were included in the final analysis.

AUTHORS' CONCLUSIONS

It is not possible to give definitive guidance on the test accuracy of IQCODE for the diagnosis of dementia in a primary care setting based on the single study identified. We are surprised by the lack of research using the IQCODE in primary care as this is, arguably, the most appropriate setting for targeted case finding of those with undiagnosed dementia in order to maximise opportunities to intervene and provide support for the individual and their carers.

Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the diagnosis of dementia within community dwelling populations

BACKGROUND

Various tools exist for initial assessment of possible dementia with no consensus on the optimal assessment method. Instruments that use collateral sources to assess change in cognitive function over time may have particular utility. The most commonly used informant dementia assessment is the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE).A synthesis of the available data regarding IQCODE accuracy will help inform cognitive assessment strategies for clinical practice, research and policy.

OBJECTIVES

Our primary objective was to determine the diagnostic accuracy of the informant based questionnaire IQCODE, for detection of all cause (undifferentiated) dementia in community-dwelling adults with no previous cognitive assessment. We sought to describe the accuracy of IQCODE (the index test) against a clinical diagnosis of dementia (the reference standard). Our secondary objective was to describe the effect of heterogeneity on the summary estimates. We were particularly interested in the traditional 26-item scale versus the 16-item short form; and language of administration. We explored the effect of varying the threshold IQCODE score used to define 'test positivity'.

SEARCH METHODS

We searched the following sources on 28 January 2013: ALOIS (Cochrane Dementia and Cognitive Improvement Group), MEDLINE (OvidSP), EMBASE (OvidSP), PsycINFO (OvidSP), BIOSIS Previews (ISI Web of Knowledge), Web of Science with Conference Proceedings (ISI Web of Knowledge), LILACS (BIREME). We also searched sources relevant or specific to diagnostic test accuracy: MEDION (Universities of Maastrict and Leuven); DARE (York University); ARIF (Birmingham University). We used sensitive search terms based on MeSH terms and other controlled vocabulary.

SELECTION CRITERIA

We selected those studies performed in community settings that used (not necessarily exclusively) the IQCODE to assess for presence of dementia and, where dementia diagnosis was confirmed, with clinical assessment. Our intention with limiting the search to a 'community' setting was to include those studies closest to population level assessment. Within our predefined community inclusion criteria, there were relevant papers that fulfilled our definition of community dwelling but represented a selected population, for example stroke survivors. We included these studies but performed sensitivity analyses to assess the effects of these less representative populations on the summary results.

DATA COLLECTION AND ANALYSIS

We screened all titles generated by the electronic database searches and abstracts of all potentially relevant studies were reviewed. Full papers were assessed for eligibility and data extracted by two independent assessors. For quality assessment (risk of bias and applicability) we used the QUADAS 2 tool. We included test accuracy data on the IQCODE used at predefined diagnostic thresholds. Where data allowed, we performed meta-analyses to calculate summary values of sensitivity and specificity with corresponding 95% confidence intervals (CIs). We pre-specified analyses to describe the effect of IQCODE format (traditional or short form) and language of administration for the IQCODE.

MAIN RESULTS

From 16,144 citations, 71 papers described IQCODE test accuracy. We included 10 papers (11 independent datasets) representing data from 2644 individuals (n = 379 (14%) with dementia). Using IQCODE cut-offs commonly employed in clinical practice (3.3, 3.4, 3.5, 3.6) the sensitivity and specificity of IQCODE for diagnosis of dementia across the studies were generally above 75%.Taking an IQCODE threshold of 3.3 (or closest available) the sensitivity was 0.80 (95% CI 0.75 to 0.85); specificity was 0.84 (95% CI 0.78 to 0.90); positive likelihood ratio was 5.2 (95% CI 3.7 to 7.5) and the negative likelihood ratio was 0.23 (95% CI 0.19 to 0.29).Comparative analysis suggested no significant difference in the test accuracy of the 16 and 26-item IQCODE tests and no significant difference in test accuracy by language of administration. There was little difference in sensitivity across our predefined diagnostic cut-points.There was substantial heterogeneity in the included studies. Sensitivity analyses removing potentially unrepresentative populations in these studies made little difference to the pooled data estimates.The majority of included papers had potential for bias, particularly around participant selection and sampling. The quality of reporting was suboptimal particularly regarding timing of assessments and descriptors of reproducibility and inter-observer variability.

AUTHORS' CONCLUSIONS

Published data suggest that if using the IQCODE for community dwelling older adults, the 16 item IQCODE may be preferable to the traditional scale due to lesser test burden and no obvious difference in accuracy. Although IQCODE test accuracy is in a range that many would consider 'reasonable', in the context of community or population settings the use of the IQCODE alone would result in substantial misdiagnosis and false reassurance. Across the included studies there were issues with heterogeneity, several potential biases and suboptimal reporting quality.

The Alzheimer's Disease Assessment Scale-Cognitive-Plus (ADAS-Cog-Plus): an expansion of the ADAS-Cog to improve responsiveness in MCI

BACKGROUND

The Alzheimer's Disease Assessment Scale cognitive subscale (ADAS-Cog) is widely used in AD, but may be less responsive to change when used in people with mild cognitive impairment (MCI).

METHODS

Participants from the Alzheimer's Disease Neuroimaging Initiative were administered a neuropsychological battery and 1.5 T MRI scans over 2-3 years. Informants were queried regarding functional impairments. Some participants had lumbar punctures to obtain cerebrospinal fluid (CSF). We added executive functioning (EF) and functional ability (FA) items to the ADAS-Cog to generate candidate augmented measures. We calibrated these candidates using baseline data (n = 811) and selected the best candidate that added EF items alone and that added EF and FA items. We selected candidates based on their responsiveness over three years in a training sample of participants with MCI (n = 160). We compared traditional ADAS-Cog scores with the two candidates based on their responsiveness in a validation sample of participants with MCI (n = 234), ability to predict conversion to dementia (n = 394), strength of association with baseline MRI (n = 394) and CSF biomarkers (n = 193).

RESULTS

The selected EF candidate added category fluency (ADAS Plus EF), and the selected EF and FA candidate added category fluency, Digit Symbol, Trail Making, and five items from the Functional Assessment Questionnaire (ADAS Plus EF&FA). The ADAS Plus EF& FA performed as well as or better than traditional ADAS-Cog scores.

CONCLUSION

Adding EF and FA items to the ADAS-Cog may improve responsiveness among people with MCI without impairing validity.

An informant questionnaire for detecting Alzheimer's disease: are some items better than others?

A decline in everyday cognitive functioning is important for diagnosing dementia. Informant questionnaires, such as the informant questionnaire on cognitive decline in the elderly (IQCODE), are used to measure this. Previously, conflicting results on the IQCODEs ability to discriminate between Alzheimer's disease (AD), mild cognitive impairment (MCI), and cognitively healthy elderly were found. We aim to investigate whether specific groups of items are more useful than others in discriminating between these patient groups. Informants of 180 AD, 59 MCI, and 89 patients with subjective memory complaints (SMC) completed the IQCODE. To investigate the grouping of questionnaire items, we used a two-dimensional graded response model (GRM).The association between IQCODE, age, gender, education, and diagnosis was modeled using structural equation modeling. The GRM with two groups of items fitted better than the unidimensional model. However, the high correlation between the dimensions (r=.90) suggested unidimensionality. The structural model showed that the IQCODE was able to differentiate between all patient groups. The IQCODE can be considered as unidimensional and as a useful addition to diagnostic screening in a memory clinic setting, as it was able to distinguish between AD, MCI, and SMC and was not influenced by gender or education.