Cross-sectional analysis of cognitive function using multivariate normative comparisons in men with HIV disease

Self-reported neurocognitive complaints in the Swiss HIV Cohort Study: a viral genome-wide association study

People with HIV may report neurocognitive complaints, with or without associated neurocognitive impairment, varying between individuals and populations. While the HIV genome could play a major role, large systematic viral genome-wide screens to date are lacking. The Swiss HIV Cohort Study biannually enquires neurocognitive complaints. We quantified broad-sense heritability estimates using partial 'pol' sequences from the Swiss HIV Cohort Study resistance database and performed a viral near full-length genome-wide association study for the longitudinal area under the curve of neurocognitive complaints. We performed all analysis (i) restricted to HIV Subtype B and (ii) including all HIV subtypes. From 8547 people with HIV with neurocognitive complaints, we obtained 6966 partial 'pol' sequences and 2334 near full-length HIV sequences. Broad-sense heritability estimates for presence of memory loss complaints ranged between 1% and 17% (Subtype B restricted 1-22%) and increased with the stringency of the phylogenetic distance thresholds. The genome-wide association study revealed one amino acid (Env L641E), after adjusting for multiple testing, positively associated with memory loss complaints (P = 4.3 * 10-6). Other identified mutations, while insignificant after adjusting for multiple testing, were reported in other smaller studies (Tat T64N, Env *291S). We present the first HIV genome-wide association study analysis of neurocognitive complaints and report a first estimate for the heritability of neurocognitive complaints through HIV. Moreover, we could identify one mutation significantly associated with the presence of memory loss complaints. Our findings indicate that neurocognitive complaints are polygenetic and highlight advantages of a whole genome approach for pathogenicity determination.

Behavioral and histological assessment of a novel treatment of neuroHIV in humanized mice

Neurocognitive deficits are prevalent among people living with HIV, likely due to chronic inflammation and oxidative stress in the brain. To date, no pharmaceutical treatments beyond antiretroviral therapy (ARV) has been shown to reduce risk for, or severity of, HIV-associated neurocognitive disorder. Here we investigate a novel compound, CDDO-Me, with documented neuroprotective effects via activation of the nrf2 and inhibition of the NFkB pathways.

Methods

We conducted three studies to assess the efficacy of CDDO-Me alone or in combination with antiretroviral therapy in humanized mice infected with HIV; behavioral, histopathological, and immunohistochemical.

Results

CDDO-Me in combination with ARV rescued social interaction deficits; however, only ARV was associated with preserved functioning in other behaviors, and CDDO-Me may have attenuated those benefits. A modest neuroprotective effect was found for CDDO-Me when administered with ARV, via preservation of PSD-95 expression; however, ARV alone had a more consistent protective effect. No significant changes in antioxidant enzyme expression levels were observed in CDDO-Me-treated animals. Only ARV use seemed to affect some antioxidant levels, indicating that it is ARV rather than CDDO-Me that is the major factor providing neuroprotection in this animal model. Finally, immunohistochemical analysis found that several cellular markers in various brain regions varied due to ARV rather than CDDO-Me.

Conclusion

Limited benefit of CDDO-Me on behavior and neuroprotection were observed. Instead, ARV was shown to be the more beneficial treatment. These experiments support the future use of this chimeric mouse for behavioral experiments in neuroHIV research.

Resting state network connectivity alterations in HIV: Parallels with aging

The increasing incidence of age-related comorbidities in people with HIV (PWH) has led to accelerated aging theories. Functional neuroimaging research, including functional connectivity (FC) using resting-state functional magnetic resonance imaging (rs-fMRI), has identified neural aberrations related to HIV infection. Yet little is known about the relationship between aging and resting-state FC in PWH. This study included 86 virally suppressed PWH and 99 demographically matched controls spanning 22-72 years old who underwent rs-fMRI. The independent and interactive effects of HIV and aging on FC were investigated both within- and between-network using a 7-network atlas. The relationship between HIV-related cognitive deficits and FC was also examined. We also conducted network-based statistical analyses using a brain anatomical atlas (n = 512 regions) to ensure similar results across independent approaches. We found independent effects of age and HIV in between-network FC. The age-related increases in FC were widespread, while PWH displayed further increases above and beyond aging, particularly between-network FC of the default-mode and executive control networks. The results were overall similar using the regional approach. Since both HIV infection and aging are associated with independent increases in between-network FC, HIV infection may be associated with a reorganization of the major brain networks and their functional interactions in a manner similar to aging.

Dynamic impairment classification through arrayed comparisons

The multivariate normative comparison (MNC) method has been used for identifying cognitive impairment. When participants' cognitive brain domains are evaluated regularly, the longitudinal MNC (LMNC) has been introduced to correct for the intercorrelation among repeated assessments of multiple cognitive domains in the same participant. However, it may not be practical to wait until the end of study for diagnosis. For example, in participants of the Multicenter AIDS Cohort Study (MACS), cognitive functioning has been evaluated repeatedly for more than 35 years. Therefore, it is optimal to identify cognitive impairment at each assessment, while the family-wise error rate (FWER) is controlled with unknown number of assessments in future. In this work, we propose to use the difference of consecutive LMNC test statistics to construct independent tests. Frequency modeling can help predict how many assessments each participant will have, so Bonferroni-type correction can be easily adapted. A chi-squared test is used under the assumption of multivariate normality, and permutation test is proposed where this assumption is violated. We showed through simulation and the MACS data that our method controlled FWER below a predetermined level.

Legacy effect on neuropsychological function in HIV-infected men on combination antiretroviral therapy

OBJECTIVE

To determine whether combination antiretroviral therapy (cART) initiation alters the trajectory of cognitive performance in HIV+ men, and whether cognition prior to cART predicts postcART function.

DESIGN

Longitudinal cohort study. Multicenter AIDS Cohort Study.

METHODS

From an initial set of 3701 men with complete neuropsychological data, men with HIV infection were initially matched with men without infection on cognitive status, race, age, and timeline (T0 defined as cART initiation). Propensity score matching was then used to match pairs on depressive symptoms at T0, education, T0 cognitive scores, and recruitment cohort. There were 506 matched pairs of infected and uninfected men in the final analysis. Mixed effect models were constructed to analyze the trajectories of cognitive functions and to test the effect of cART and HIV on cognitive functions over time.

RESULTS

Performance in each cognitive domain did not change following the initiation of cART among HIV-infected men with prior impairment and was comparable to the performance of their matched uninfected men. However, among the infected men who were unimpaired prior to cART, motor function declined significantly faster than it did for uninfected controls.

CONCLUSIONS

Cognitive dysfunction is persistent in HIV-infected men and cART does not alter the trajectory of cognitive decline in men who were impaired prior to effective therapy. This suggests that current cognitive impairment in HIV+ men results from a legacy effect, and from factors other than the HIV itself. Furthermore, motor skills may be uniquely vulnerable to the virus, cART, or age-related co-morbidities.

Differential Effects of AIDS and Chronic Human Immunodeficiency Virus Infection on Gray Matter Volume

BACKGROUND

Age, human immunodeficiency virus (HIV) infection, illicit drug use, and central nervous system (CNS) opportunistic infections can affect brain structure, with the striatum being particularly sensitive to HIV effects. Nevertheless, the impact of non-CNS AIDS-defining illness (ADI) on brain structure has been less investigated. We examined ADI and HIV effects on brain volume.

METHODS

In a cross-sectional study, including 95 virally suppressed seropositive and 84 demographically matched, seronegative participants, we examined serostatus and ADI effects. Cortical and subcortical gray matter volume (GMV) regions of interest were estimated with computational neuroanatomy techniques applied to high-resolution, T1-weighted magnetic resonance imaging data. Linear regression was used to model HIV serostatus and ADI effects on global and regional GMV, adjusting for age, sex, CD4 nadir, drug use, and total intracranial volume.

RESULTS

While HIV serostatus was associated with lower striatal volume (B = -.59 [95% confidence interval {CI}, -1.08 to -.10]), co-occurring ADI was independently associated with lower striatal volume (B = -.73 [95% CI, -1.36 to -.09]). ADI was also associated with lower global (B = -19.35 [95% CI, -32.42 to -6.29]) and regional GMV.

CONCLUSIONS

While HIV infection is associated with a localized effect on striatal structure, having a prior ADI is a strong predictor of smaller global and regional GMV. The lack of interaction between HIV serostatus or ADI with age suggests that chronic HIV infection and ADI have independent effects on brain structure, without associated accelerated lower volume with age. ADI history should be incorporated into statistical adjustments in HIV neuroimaging analysis. These findings also lend support to current HIV treatment guidelines urging prompt antiretroviral therapy initiation after HIV diagnosis.

Tablet-Based Cognitive Impairment Screening for Adults With HIV Seeking Clinical Care: Observational Study

BACKGROUND

Neurological complications including cognitive impairment persist among people with HIV on antiretrovirals; however, cognitive screening is not routinely conducted in HIV clinics.

OBJECTIVE

Our objective for this study was 3-fold: (1) to determine the feasibility of implementing an iPad-based cognitive impairment screener among adults seeking HIV care, (2) to examine the psychometric properties of the tool, and (3) to examine predictors of cognitive impairment using the tool.

METHODS

A convenience sample of participants completed Brain Baseline Assessment of Cognition and Everyday Functioning (BRACE), which included (1) Trail Making Test Part A, measuring psychomotor speed; (2) Trail Making Test Part B, measuring set-shifting; (3) Stroop Color, measuring processing speed; and (4) the Visual-Spatial Learning Test. Global neuropsychological function was estimated as mean T score performance on the 4 outcomes. Impairment on each test or for the global mean was defined as a T score ≤40. Subgroups of participants repeated the tests 4 weeks or >6 months after completing the first test to evaluate intraperson test-retest reliability and practice effects (improvements in performance due to repeated test exposure). An additional subgroup completed a lengthier cognitive battery concurrently to assess validity. Relevant factors were abstracted from electronic medical records to examine predictors of global neuropsychological function.

RESULTS

The study population consisted of 404 people with HIV (age: mean 53.6 years; race: 332/404, 82% Black; 34/404, 8% White, 10/404, 2% American Indian/Alaskan Native; 28/404, 7% other and 230/404, 58% male; 174/404, 42% female) of whom 99% (402/404) were on antiretroviral therapy. Participants completed BRACE in a mean of 12 minutes (SD 3.2), and impairment was demonstrated by 34% (136/404) on Trail Making Test A, 44% (177/404) on Trail Making Test B, 40% (161/404) on Stroop Color, and 17% (67/404) on Visual-Spatial Learning Test. Global impairment was demonstrated by 103 out of 404 (25%). Test-retest reliability for the subset of participants (n=26) repeating the measure at 4 weeks was 0.81 and for the subset of participants (n=67) repeating the measure almost 1 year later (days: median 294, IQR 50) was 0.63. There were no significant practice effects at either time point (P=.20 and P=.68, respectively). With respect for validity, the correlation between global impairment on the lengthier cognitive battery and BRACE was 0.63 (n=61; P<.001), with 84% sensitivity and 94% specificity to impairment on the lengthier cognitive battery.

CONCLUSIONS

We were able to successfully implement BRACE and estimate cognitive impairment burden in the context of routine clinic care. BRACE was also shown to have good psychometric properties. This easy-to-use tool in clinical settings may facilitate the care needs of people with HIV as cognitive impairment continues to remain a concern in people with HIV.

Predicting occupational outcomes from neuropsychological test performance in older people with HIV

OBJECTIVE

The ability to work is amongst the top concerns of people living with well treated HIV. Cognitive impairment has been reported in many otherwise asymptomatic persons living with HIV and even mild impairment is associated with higher rates of occupational difficulties. There are several classification algorithms for HIV-associated neurocognitive disorder (HAND) as well as overall scoring methods available to summarize neuropsychological performance. We asked which method best explained work status and productivity.

DESIGN

Participants (N = 263) drawn from a longitudinal Canadian cohort underwent neuropsychological testing.

METHODS

: Several classification algorithms were applied to establish a HAND diagnosis and two summary measures (NPZ and Global Deficit Score) were computed. Self-reported work status and productivity was assessed at each study visit (four visits, 9 months apart). The association of work status with each diagnostic classification and summary measure was estimated using logistic regression. For those working, the value on the productivity scale was regressed within individuals over time, and the slopes were regressed on each neuropsychological outcome.

RESULTS

The application of different classification algorithms to the neuropsychological data resulted in rates of impairment that ranged from 28.5 to 78.7%. Being classified as impaired by any method was associated with a higher rate of unemployment. None of the diagnostic classifications or summary methods predicted productivity, at time of testing or over the following 36 months.

CONCLUSION

Neuropsychological diagnostic classifications and summary scores identified participants who were more likely to be unemployed, but none explained productivity. New methods of assessing cognition are required to inform optimal workforce engagement.

Gray matter volumes discriminate cognitively impaired and unimpaired people with HIV

BACKGROUND

Current diagnostic criteria of HIV-associated neurocognitive disorders (HAND) rely on neuropsychological assessments. The aim of this study was to evaluate if gray matter volumes (GMV) can distinguish people with HAND, neurocognitively unimpaired people with HIV (unimpaired PWH), and uninfected controls using linear discriminant analyses.

METHODS

A total of 231 participants, including 110 PWH and 121 uninfected controls, completed a neuropsychological assessment and an MRI protocol. Among PWH, HAND (n = 48) and unimpaired PWH (n = 62) designations were determined using the widely accepted Frascati criteria. We then assessed the extent to which GMV, corrected for intracranial volume, could accurately distinguish the three groups using linear discriminant analysis. Sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, area under the curve (AUC), and accuracy were computed for each model using the classification results based on GMV compared to the neuropsychological assessment.

RESULTS

The best performing model was comprised of bilaterally combined GMV and was stratified by sex. Among males, sensitivity was 85.2% (95% CI: 66.3%-95.8%), specificity was 97.0% (95% CI: 91.6%-99.4%), and the AUC was 0.91 (95% CI: 0.83-0.99). Among females, sensitivity was 100.0% (95% CI: 83.9%-100.0%), specificity was 98.8% (95% CI: 93.4%-100.0%), and the AUC was 0.99 (95% CI: 0.98-1.00).

CONCLUSIONS

GMV accurately discriminated HAND from unimpaired PWH and controls. Measures of GMV may be highly sensitive to HAND, and revisions to the Frascati criteria should consider including GMV in conjunction with a neuropsychological assessment to diagnose HAND.

Rates of cognitive impairment in a South African cohort of people with HIV: variation by definitional criteria and lack of association with neuroimaging biomarkers

There is wide variation in the reported prevalence of cognitive impairment in people with HIV (PWH). Part of this variation may be attributable to different studies using different methods of combining neuropsychological test scores to classify participants as either cognitively impaired or unimpaired. Our aim was to determine, in a South African cohort of PWH (N = 148), (a) how much variation in reported rates was due to method used to define cognitive impairment and (b) which method correlated best with MRI biomarkers of HIV-related brain pathology. Participants completed detailed neuropsychological assessment and underwent 3 T structural MRI and diffusion tensor imaging (DTI). We used the neuropsychological data to investigate 20 different methods of determining HIV-associated cognitive impairment. We used the neuroimaging data to obtain volumes for cortical and subcortical grey matter and total white matter and DTI metrics for several white matter tracts. Applying each of the 20 methods to the cognitive dataset resulted in a wide variation (20-97%) in estimated rates of impairment. Logistic regression models showed no method was associated with HIV-related neuroimaging abnormalities as measured by structural volumes or DTI metrics. We conclude that for the population from which this sample was drawn, much of the variation in reported rates of cognitive impairment in PWH is due to the method of classification used, and that none of these methods accurately reflects biological effects of HIV in the brain. We suggest that defining HIV-associated cognitive impairment using neuropsychological test performance only is insufficient; pre-morbid functioning, co-morbidities, cognitive symptoms, and functional impairment should always be considered.

Reductions in Gray Matter Linked to Epigenetic HIV-Associated Accelerated Aging

A growing literature suggests a relationship between HIV-infection and a molecular profile of age acceleration. However, despite the widely known high prevalence of HIV-related brain atrophy and HIV-associated neurocognitive disorder (HAND), epigenetic age acceleration has not been linked to HIV-related changes in structural MRI. We applied morphological MRI methods to study the brain structure of 110 virally suppressed participants with HIV infection and 122 uninfected controls age 22-72. All participants were assessed for cognitive impairment, and blood samples were collected from a subset of 86 participants with HIV and 83 controls to estimate epigenetic age. We examined the group-level interactive effects of HIV and chronological age and then used individual estimations of epigenetic age to understand the relationship between age acceleration and brain structure. Finally, we studied the effects of HAND. HIV-infection was related to gray matter reductions, independent of age. However, using epigenetic age as a biomarker for age acceleration, individual HIV-related age acceleration was associated with reductions in total gray matter. HAND was associated with decreases in thalamic and hippocampal gray matter. In conclusion, despite viral suppression, accentuated gray matter loss is evident with HIV-infection, and greater biological age acceleration specifically relates to such gray matter loss.

Longitudinal 5-year prediction of cognitive impairment among men with HIV disease

BACKGROUND

Although combination antiretroviral therapy reduced the prevalence of HIV-associated dementia, milder syndromes persist. Our goals were to predict cognitive impairment of the Multicenter AIDS Cohort Study (MACS) participants 5 years ahead and from a large pool of factors, select the ones that mostly contributed to our predictions.

DESIGN

Longitudinal, natural and treated history of HIV infection among MSM.

METHODS

The MACS is a longitudinal study of the natural and treated history of HIV disease in MSM; the neuropsychological substudy aims to characterize cognitive disorders in men with HIV disease.

RESULTS

We modeled on an annual basis the risk of cognitive impairment 5 years in the future. We were able to predict cognitive impairment at individual level with high precision and overperform default methods. We found that while a diagnosis of AIDS is a critical risk factor, HIV infection per se does not necessarily convey additional risk. Other infectious processes, most notably hepatitis B and C, are independently associated with increased risk of impairment. The relative importance of an AIDS diagnosis diminished across calendar time.

CONCLUSION

Our prediction models are a powerful tool to help clinicians address dementia in early stages for MACS paticipants. The strongest predictors of future cognitive impairment included the presence of clinical AIDS and hepatitis B or C infection. The fact that the pattern of predictive power differs by calendar year suggests a clinically critical change to the face of the epidemic.

Longitudinal multivariate normative comparisons

Motivated by the Multicenter AIDS Cohort Study (MACS), we develop classification procedures for cognitive impairment based on longitudinal measures. To control family-wise error, we adapt the cross-sectional multivariate normative comparisons (MNC) method to the longitudinal setting. The cross-sectional MNC was proposed to control family-wise error by measuring the distance between multiple domain scores of a participant and the norms of healthy controls and specifically accounting for intercorrelations among all domain scores. However, in a longitudinal setting where domain scores are recorded multiple times, applying the cross-sectional MNC at each visit will still have inflated family-wise error rate due to multiple testing over repeated visits. Thus, we propose longitudinal MNC procedures that are constructed based on multivariate mixed effects models. A χ 2 test procedure is adapted from the cross-sectional MNC to classify impairment on longitudinal multivariate normal data. Meanwhile, a permutation procedure is proposed to handle skewed data. Through simulations we show that our methods can effectively control family-wise error at a predetermined level. A dataset from a neuropsychological substudy of the MACS is used to illustrate the applications of our proposed classification procedures.

The Prevalence of Frascati-Criteria-Based HIV-Associated Neurocognitive Disorder (HAND) in HIV-Infected Adults: A Systematic Review and Meta-Analysis

Background: The HIV associated mortality is decreasing in most countries due to the widespread use of antiretroviral therapy. However, HIV-associated neurocognitive disorder (HAND) remains a problematic issue that lowers the quality of life and increases the public health burden among people living with HIV. The prevalence of HAND varies across studies and selected samples. Therefore, we aimed to quantitatively summarize the pooled prevalence of Frascati-criteria-based HAND and to explore the potential demographic, clinical, and immunological factors. Methods: A comprehensive literature search in PubMed/Medline, Web of Science, Embase, and PsycINFO was performed. A random-effects meta-analysis was conducted using the event rate (ER) for the estimation of the incidence of HAND. Subgroup meta-analyses were used to evaluate between-group differences in categorical variables. Meta-regression with the unrestricted maximum likelihood (ML) method was used to evaluate associations of continuous variables. Results: Eighteen studies whose sample sizes ranged from 206 to 1555 were included in the final analyses. The estimated prevalence of HAND, ANI, MND and HAD were 44.9% (95% CI 37.4-52.7%), 26.2% (95% CI 20.7-32.7%), 8.5% (95% CI 5.6-12.7%), 2.1% (95% CI 1.2-3.7%), respectively. Factors associated with HAND were percent female, current CD4 count, education level and country development level (all ps < 0.05). Conclusion: Longitudinal cohort and multimodal neuroimaging studies are needed to verify the clinical prognosis and the underlying neurocognitive mechanism of HAND. In addition, it is urgently necessary to establish a standardized HAND diagnostic process.

Studying the neuropsychological sequelae of SARS-CoV-2: lessons learned from 35 years of neuroHIV research

The virology of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) and the human immune response to the virus are under vigorous investigation. There are now several reports describing neurological symptoms in individuals who develop coronavirus disease 2019 (COVID-19), the syndrome associated with SARS-CoV-2 infection. The prevalence, incidence, and clinical course of these symptoms will become clearer in the coming months and years through epidemiological studies. However, the long-term neurological and cognitive consequence of SARS-CoV-2 infection will remain conjectural for some time and will likely require the creation of cohort studies that include uninfected individuals. Considering the early evidence for neurological involvement in COVID-19 it may prove helpful to compare SARS-CoV-2 with another endemic and neurovirulent virus, human immunodeficiency virus-1 (HIV-1), when designing such cohort studies and when making predictions about neuropsychological outcomes. In this paper, similarities and differences between SARS-CoV-2 and HIV-1 are reviewed, including routes of neuroinvasion, putative mechanisms of neurovirulence, and factors involved in possible long-term neuropsychological sequelae. Application of the knowledge gained from over three decades of neuroHIV research is discussed, with a focus on alerting researchers and clinicians to the challenges in determining the cause of neurocognitive deficits among long-term survivors.

Lifetime antiretroviral exposure and neurocognitive impairment in HIV

Despite the availability of modern antiretroviral therapy (ART), neurocognitive impairment persists among some persons with HIV (PWH). We investigated the role of exposure to four major classes of ARTs in neurocognitive impairment in PWH. A single-site cohort of 343 PWH was recruited. Lifetime ART medication history was obtained from medical health records. We evaluated the role of ART exposure as a predictor of neurocognitive impairment using univariate analyses and machine learning, while accounting for potential effects of demographic, clinical, and comorbidity-related risk factors. Out of a total of 26 tested variables, two random forest analyses identified the most important characteristics of a neurocognitively impaired group (N = 59): Compared with a neurocognitively high-performing group (N = 132; F₁-score = 0.79), we uncovered 13 important risk factors; compared with an intermediate-performing group (N = 152; F₁-score = 0.75), 16 risk factors emerged. Longer lifetime ART exposure, especially to integrase inhibitors, was one of the most important predictors of neurocognitive impairment in both analyses (rank 2 of 13 and rank 4 of 16, respectively), superseding effects of age (rank 11/13, rank 15/16) and HIV duration (rank 13/13, rank 16/16). Concerning specific integrase inhibitors, the impaired group had significantly longer dolutegravir exposure (p = 0.011) compared with the high-performing group (p = 0.012; trend compared with the intermediate group p = 0.063). A longer duration to integrase inhibitor intake was negatively related to cognition in this cohort. Our findings suggest that possible cognitive complications of long-term exposure to integrase inhibitors, in particular dolutegravir, should be closely monitored in PWH.

Quantifying diagnostic accuracy improvement of new biomarkers for competing risk outcomes

The net reclassification improvement (NRI) and the integrated discrimination improvement (IDI) were originally proposed to characterize accuracy improvement in predicting a binary outcome, when new biomarkers are added to regression models. These two indices have been extended from binary outcomes to multi-categorical and survival outcomes. Working on an AIDS study where the onset of cognitive impairment is competing risk censored by death, we extend the NRI and the IDI to competing risk outcomes, by using cumulative incidence functions to quantify cumulative risks of competing events, and adopting the definitions of the two indices for multi-category outcomes. The "missing" category due to independent censoring is handled through inverse probability weighting. Various competing risk models are considered, such as the Fine and Gray, multistate, and multinomial logistic models. Estimation methods for the NRI and the IDI from competing risk data are presented. The inference for the NRI is constructed based on asymptotic normality of its estimator, and the bias-corrected and accelerated bootstrap procedure is used for the IDI. Simulations demonstrate that the proposed inferential procedures perform very well. The Multicenter AIDS Cohort Study is used to illustrate the practical utility of the extended NRI and IDI for competing risk outcomes.