Clinical prediction models in psychiatry: a systematic review of two decades of progress and challenges

Cost-effectiveness of implementing a suicide prediction tool (OxMIS) in severe mental illness: Economic modeling study

BACKGROUND

Cost-effectiveness analysis needs to be considered when introducing new tools and treatments to clinical services. The number of new assessment tools in mental health has rapidly expanded, including suicide risk assessment. Such suicide-based assessments, when linked to preventative interventions, are integral to high-quality mental health care for people with severe mental illness (SMI). We examined the cost implications of implementing Oxford Mental Illness and Suicide (OxMIS), an evidence-based, scalable suicide risk assessment tool that provides probabilistic estimates of suicide risk over 12 months for people with SMI in England.

METHODS

We developed a decision analytic model using secondary data to estimate the potential cost-effectiveness of incorporating OxMIS into clinical decision-making in secondary care as compared to usual care. Cost-effectiveness was measured in terms of costs per quality-adjusted life years (QALYs) gained. Uncertainty was addressed with deterministic and probabilistic sensitivity analysis.

RESULTS

Conducting suicide risk assessment with OxMIS was potentially cheaper than clinical risk assessment alone by £250 (95% confidence interval, -786;31) to £599 (-1,321;-156) (in 2020-2021 prices) per person with SMI and associated with a small increase in quality of life (0.01 [-0.03;0.05] to 0.01 QALY, [-0.04;0.07]). The estimated incremental cost-effectiveness ratio of implementing OxMIS was cost saving. Using probabilistic sensitivity analysis, 99.96% of 10,000 simulations remained cost saving.

CONCLUSION

Cost-effectiveness analysis can be conducted on risk prediction models. Implementing one such model that focuses on suicide risk in a high-risk population can lead to cost savings and improved health outcomes, especially if explicitly linked to preventative treatments.

Factors affecting HPV infection in U.S. and Beijing females: A modeling study

Background

Human papillomavirus (HPV) infection is an important carcinogenic infection highly prevalent among many populations. However, independent influencing factors and predictive models for HPV infection in both U.S. and Beijing females are rarely confirmed. In this study, our first objective was to explore the overlapping HPV infection-related factors in U.S. and Beijing females. Secondly, we aimed to develop an R package for identifying the top-performing prediction models and build the predictive models for HPV infection using this R package.

Methods

This cross-sectional study used data from the 2009-2016 NHANES (a national population-based study) and the 2019 data on Beijing female union workers from various industries. Prevalence, potential influencing factors, and predictive models for HPV infection in both cohorts were explored.

Results

There were 2,259 (NHANES cohort, age: 20-59 years) and 1,593 (Beijing female cohort, age: 20-70 years) participants included in analyses. The HPV infection rate of U.S. NHANES and Beijing females were, respectively 45.73 and 8.22%. The number of male sex partners, marital status, and history of HPV infection were the predominant factors that influenced HPV infection in both NHANES and Beijing female cohorts. However, condom application was not an independent influencing factor for HPV infection in both cohorts. R package Modelbest was established. The nomogram developed based on Modelbest package showed better performance than the nomogram which only included significant factors in multivariate regression analysis.

Conclusion

Collectively, despite the widespread availability of HPV vaccines, HPV infection is still prevalent. Compared with condom promotion, avoidance of multiple sexual partners seems to be more effective for preventing HPV infection. Nomograms developed based on Modelbest can provide improved personalized risk assessment for HPV infection. Our R package Modelbest has potential to be a powerful tool for future predictive model studies.

Postpartum depression: a developed and validated model predicting individual risk in new mothers

Postpartum depression (PPD) is a serious condition associated with potentially tragic outcomes, and in an ideal world PPDs should be prevented. Risk prediction models have been developed in psychiatry estimating an individual's probability of developing a specific condition, and recently a few models have also emerged within the field of PPD research, although none are implemented in clinical care. For the present study we aimed to develop and validate a prediction model to assess individualized risk of PPD and provide a tentative template for individualized risk calculation offering opportunities for additional external validation of this tool. Danish population registers served as our data sources and PPD was defined as recorded contact to a psychiatric treatment facility (ICD-10 code DF32-33) or redeemed antidepressant prescriptions (ATC code N06A), resulting in a sample of 6,402 PPD cases (development sample) and 2,379 (validation sample). Candidate predictors covered background information including cohabitating status, age, education, and previous psychiatric episodes in index mother (Core model), additional variables related to pregnancy and childbirth (Extended model), and further health information about the mother and her family (Extended+ model). Results indicated our recalibrated Extended model with 14 variables achieved highest performance with satisfying calibration and discrimination. Previous psychiatric history, maternal age, low education, and hyperemesis gravidarum were the most important predictors. Moving forward, external validation of the model represents the next step, while considering who will benefit from preventive PPD interventions, as well as considering potential consequences from false positive and negative test results, defined through different threshold values.