A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients

An observer-rated strategy for differentiating schizophrenic and manic states in inpatient settings

OBJECTIVES

Differentiating schizophrenia from mania in acutely psychotic patients can be difficult, but is important in determining immediate and subsequent management. Such differentiation is generally addressed by clinical interviews, but an observational approach may assist. This paper therefore describes the development of a relevant observational measure.

METHODS

We developed a provisional list of 49 items (weighting features with suggested specificity to schizophrenia and mania) for independent completion by two nurses and judged its ability to predict diagnosis provided by consultant psychiatrists.

RESULTS

Eighty-seven psychotic patients were recruited, and 173 completed data sets were analysed. We refined the item set to two sets of 10 items that best-differentiated schizophrenia from mania and vice versa. Optimal differentiation was achieved with a score of at least 7 on both the schizophrenia and mania item sets. Difference scores (i.e. schizophrenia items affirmed minus mania items affirmed) were also generated, with a difference score of +1 (i.e. one or more schizophrenia items being affirmed than mania items) showing optimal differentiation (sensitivity 0.67, specificity 0.82) between the two conditions. Evaluating all potential difference scores, we demonstrated that, as difference scores increased, diagnostic accuracy in identifying each condition was very high.

CONCLUSION

Analyses allow the properties of an observational measure (the 20-item Sydney Psychosis Observation Tool) to be described. While a single cut-off difference score was derived with acceptable discriminatory ability, we also established the capacity of varying difference scores to assign both schizophrenia and mania diagnoses with high accuracy.

The differential associations of positive and negative symptoms with suicidality

BACKGROUND

Suicide is one of the leading causes of death in people with schizophrenia. Identifying risk factors for suicide in schizophrenia is therefore an important clinical and research priority.

METHOD

A cross-sectional secondary analysis was conducted on the DNA Polymorphisms in Mental Illness Study (DPIM) data. Suicidality data was extracted, and the number of positive and negative symptoms were established for a total of 1494 participants. Logistic and negative binomial regression analyses were conducted to assess for associations between positive or negative symptoms and suicidal ideation, attempt, or number of attempts, whilst adjusting for potential confounders.

RESULTS

Negative symptoms were associated with a reduction in the risk of suicidal ideation (odds ratio [OR]: 0.83; 95 % CI: 0.75-0.91) and suicide attempt (OR: 0.79; 95 % CI: 0.71-0.88) after adjusting for age and sex. Positive symptoms were associated with an increased risk of suicidal ideation (OR: 1.06; 95 % CI: 1.03-1.09), suicide attempt (OR: 1.04; 95 % CI: 1.00-1.07) and number of suicide attempts (incidence rate ratio [IRR]: 1.05; 95 % CI: 1.01-1.08). Further adjusting for depressive symptoms slightly increased the magnitude of associations with negative symptoms but attenuated associations between positive symptoms and suicidality to the null.

CONCLUSIONS

Negative symptoms are associated with a reduced risk of suicidality, whilst positive symptoms are associated with an increased risk of suicidality. Depressive symptoms may confound or mediate these associations.

Psychosocial markers of age at onset in bipolar disorder: a machine learning approach

BACKGROUND

Bipolar disorder is a chronic and severe mental health disorder. Early stratification of individuals into subgroups based on age at onset (AAO) has the potential to inform diagnosis and early intervention. Yet, the psychosocial predictors associated with AAO are unknown.

AIMS

We aim to identify psychosocial factors associated with bipolar disorder AAO.

METHOD

Using data from the Bipolar Disorder Research Network UK, we employed least absolute shrinkage and selection operator regression to identify psychosocial factors associated with bipolar disorder AAO. Twenty-eight factors were entered into our model, with AAO as our outcome measure.

RESULTS

We included 1022 participants with bipolar disorder (μ = 23.0, s.d. ± 9.86) in our model. Six variables predicted an earlier AAO: childhood abuse (β = -0.2855), regular cannabis use in the year before onset (β = -0.2765), death of a close family friend or relative in the 6 months before onset (β = -0.2435), family history of suicide (β = -0.1385), schizotypal personality traits (β = -0.1055) and irritable temperament (β = -0.0685). Five predicted a later AAO: the average number of alcohol units consumed per week in the year before onset (β = 0.1385); birth of a child in the 6 months before onset (β = 0.2755); death of parent, partner, child or sibling in the 6 months before onset (β = 0.3125); seeking work without success for 1 month or more in the 6 months before onset (β = 0.3505) and a major financial crisis in the 6 months before onset (β = 0.4575).

CONCLUSIONS

The identified predictor variables have the potential to help stratify high-risk individuals into likely AAO groups, to inform treatment provision and early intervention.

Outcomes in treatment-resistant schizophrenia: symptoms, function and clozapine plasma concentrations

BACKGROUND

Clozapine is the only medication licenced for treating patients with treatment-refractory schizophrenia. However, there are no evidence-based guidelines as to the optimal plasma level of clozapine to aim for, and their association with clinical and functional outcome.

OBJECTIVE

We assessed the relationship between clinical and functional outcome measures and blood concentrations of clozapine among patients with treatment-refractory psychosis.

METHODS

Data were reviewed in 82 patients with treatment-refractory psychosis admitted to a specialised tertiary-level service and treated with clozapine. Analysis focussed on the relationship between clozapine and norclozapine plasma concentrations and the patient's clinical symptoms and functional status.

RESULTS

Clinical symptom improvement was positively correlated with norclozapine plasma concentrations and inversely correlated with clozapine to norclozapine plasma concentrations ratio. Clozapine concentrations showed a bimodal association with clinical improvement (peaks around 350 and 660 ng/ml). Clinical symptom improvement correlated with functional outcomes, although there was no significant correlation between the latter and clozapine or norclozapine plasma concentrations.

CONCLUSION

Clozapine treatment was associated with optimal clinical improvement at two different peak plasma concentrations around 350 and 650 ng/ml. Clinical improvement was associated with functional outcome; however, functionality was not directly associated with clozapine concentrations. A subset of patients may require higher clozapine plasma concentrations to achieve clinical improvement.

Mental health problems and socioeconomic disadvantage: a controlled household study in rural Ethiopia

Background

There is a lack of high quality population-based studies from low- and middle-income countries examining the relative economic status of households with and without a member with a mental health problem. The aim of the study was to explore the socio-economic status of households with a person with severe mental disorder (SMD; psychosis or bipolar disorder) or depression compared to households without an affected person.

Methods

A population-based, comparative, cross-sectional household survey was conducted in Sodo district, south Ethiopia, between January and November 2015. Two samples were recruited, each with its own comparison group. Sample (1): households of 290 community-ascertained persons with a clinician-confirmed diagnosis of SMD and a comparison group of 289 households without a person with SMD. Sample (2): households of 128 people who attended the primary health care centre and who were identified by primary care staff as having a probable diagnosis of depressive disorder; and comparison households of 129 patients who attended for other reasons and who did not receive a diagnosis of depression. Household socioeconomic status (household income, consumption and asset-based wealth) was assessed using a contextualized version of theWorld Health Organization (WHO) Study on global Ageing and adult health (SAGE) questionnaire. Each disorder group (SMD and depression) was further divided into higher and lower disability groups on the basis of median score on the WHO Disability Assessment Schedule.

Results

Households of a person with SMD who had higher disability were more likely to have a poorer living standard (no toilet facility; p < 0.001). Having a reliable source of regular income was significantly lower in households of a person with SMD (p = 0.008) or depression (p = 0.046) with higher disability than the comparison group. Households of persons with SMD with higher disability earned less (p = 0.005) and owned significantly fewer assets (p < 0.001) than households without SMD. Households including persons with depression who had higher disability had lower income (p = 0.042) and reduced consumption (p = 0.048).

Conclusions

Households with a member who had either SMD or depression were socioeconomically disadvantaged compared to the general population. Moreover, higher disability was associated with worse socio-economic disadvantage. Prospective studies are needed to determine the direction of association. This study indicates a need to consider households of people with SMD or depression as a vulnerable group requiring economic support alongside access to evidence-based mental healthcare.

Electronic supplementary material

The online version of this article (10.1186/s12939-019-1020-4) contains supplementary material, which is available to authorized users.

Catastrophic out-of-pocket payments for households of people with severe mental disorder: a comparative study in rural Ethiopia

BACKGROUND

There are limited data on healthcare spending by households containing a person with severe mental disorder (SMD) in low- and middle-income countries (LMIC). This study aimed to estimate the incidence and intensity of catastrophic out-of-pocket (OOP) payments and coping strategies implemented by households with and without a person with SMD in a rural district of Ethiopia.

METHODS

A comparative cross-sectional community household survey was carried out from January to November 2015 as part of the Emerald programme (emerging mental health systems in low- and middle-income countries). A sample of 290 households including a person with SMD and 289 comparison households without a person with SMD participated in the study. An adapted and abbreviated version of the World Health Organization SAGE (Study on global Ageing and adult health) survey instrument was used. Households were considered to have incurred catastrophic health expenditure if their annual OOP health expenditures exceeded 40% of their annual non-food expenditure. Multiple logistic regression was used to explore factors associated with catastrophic expenditure and types of coping strategies employed.

RESULTS

The incidence of catastrophic OOP payments in the preceding 12 months was 32.2% for households of a person with SMD and 18.2% for comparison households (p = 0.006). In households containing a person with SMD, there was a significant increase in the odds of hardship financial coping strategies (p < 0.001): reducing medical visits, cutting down food consumption, and withdrawing children from school. Households of a person with SMD were also less satisfied with their financial status and perceived their household income to be insufficient to meet their livelihood needs (p < 0.001).

CONCLUSIONS

Catastrophic OOP health expenditures in households of a person with SMD are high and associated with hardship financial coping strategies which may lead to poorer health outcomes, entrenchment of poverty and intergenerational disadvantage. Policy interventions aimed at financial risk pooling mechanisms are crucial to reduce the intensity and impact of OOP payments among vulnerable households living with SMD and support the goal of universal health coverage.

The ICD-11 developmental field study of reliability of diagnoses of high-burden mental disorders: results among adult patients in mental health settings of 13 countries

Reliable, clinically useful, and globally applicable diagnostic classification of mental disorders is an essential foundation for global mental health. The World Health Organization (WHO) is nearing completion of the 11th revision of the International Classification of Diseases and Related Health Problems (ICD-11). The present study assessed inter-diagnostician reliability of mental disorders accounting for the greatest proportion of global disease burden and the highest levels of service utilization - schizophrenia and other primary psychotic disorders, mood disorders, anxiety and fear-related disorders, and disorders specifically associated with stress - among adult patients presenting for treatment at 28 participating centers in 13 countries. A concurrent joint-rater design was used, focusing specifically on whether two clinicians, relying on the same clinical information, agreed on the diagnosis when separately applying the ICD-11 diagnostic guidelines. A total of 1,806 patients were assessed by 339 clinicians in the local language. Intraclass kappa coefficients for diagnoses weighted by site and study prevalence ranged from 0.45 (dysthymic disorder) to 0.88 (social anxiety disorder) and would be considered moderate to almost perfect for all diagnoses. Overall, the reliability of the ICD-11 diagnostic guidelines was superior to that previously reported for equivalent ICD-10 guidelines. These data provide support for the suitability of the ICD-11 diagnostic guidelines for implementation at a global level. The findings will inform further revision of the ICD-11 diagnostic guidelines prior to their publication and the development of programs to support professional training and implementation of the ICD-11 by WHO member states.

[Multi-centre clinical assessment of the Russian language version of the Diagnostic Interview for Psychoses]

OBJECTIVES

The Diagnostic Interview for Psychoses (DIP) was developed to enhance the quality of diagnostic assessment of psychotic disorders. The aim of the study was the adaptation of the Russian language version and evaluation of its validity and reliability.

MATERIAL AND METHODS

Ninety-eight patients with psychotic disorders (89 video recordings) were assessed by 12 interviewers using the Russian version of DIP at 7 clinical sites (in 6 cities of the Russian Federation). DIP ratings on 32 cases of a randomized case sample were made by 9 interviewers and the inter-rater reliability was compared with the researchers' DIP ratings. Overall pairwise agreement and Cohen's kappa were calculated. Diagnostic validity was evaluated on the basis of comparing the researchers' ratings using the Russian version of DIP with the 'gold standard' ratings of the same 62 clinical cases from the Western Australia Family Study Schizophrenia (WAFSS).

RESULTS

The mean duration of the interview was 47±21 minutes. The Kappa statistic demonstrated a significant or almost perfect level of agreement on the majority of DIP items (84.54%) and a significant agreement for the ICD-10 diagnoses generated by the DIP computer diagnostic algorithm (κ=0.68; 95% CI 0.53,0.93). The level of agreement on the researchers' diagnoses was considerably lower (κ=0.31; 95% CI 0.06,0.56). The agreement on affective and positive psychotic symptoms was significantly higher than agreement on negative symptoms (F(2,44)=20.72, p<0.001, η2=0.485). The diagnostic validity of the Russian language version of DIP was confirmed by 73% (45/62) of the Russian DIP diagnoses matching the original WAFSS diagnoses. Among the mismatched diagnoses were 80 cases with a diagnosis of F20 Schizophrenia in the medical documentation compared to the researchers' F20 diagnoses in only 68 patients and in 62 of the DIP computerized diagnostic outputs. The reported level of subjective difficulties experienced when using the DIP was low to moderate.

CONCLUSION

The results of the study confirm the validity and reliability of the Russian version of the DIP for evaluating psychotic disorders. DIP can be recommended for use in education and training, clinical practice and research as an important diagnostic resource.

Improving risk management for violence in mental health services: a multimethods approach

Background

Mental health professionals increasingly carry out risk assessments to prevent future violence by their patients. However, there are problems with accuracy and these assessments do not always translate into successful risk management.

Objectives

Our aim was to improve the accuracy of assessment and identify risk factors that are causal to be targeted by clinicians to ensure good risk management. Our objectives were to investigate key risks at the population level, construct new static and dynamic instruments, test validity and construct new models of risk management using Bayesian networks.

Methods and results

We utilised existing data sets from two national and commissioned a survey to identify risk factors at the population level. We confirmed that certain mental health factors previously thought to convey risk were important in future assessments and excluded others from subsequent parts of the study. Using a first-episode psychosis cohort, we constructed a risk assessment instrument for men and women and showed important sex differences in pathways to violence. We included a 1-year follow-up of patients discharged from medium secure services and validated a previously developed risk assessment guide, the Medium Security Recidivism Assessment Guide (MSRAG). We found that it is essential to combine ratings from static instruments such as the MSRAG with dynamic risk factors. Static levels of risk have important modifying effects on dynamic risk factors for their effects on violence and we further demonstrated this using a sample of released prisoners to construct risk assessment instruments for violence, robbery, drugs and acquisitive convictions. We constructed a preliminary instrument including dynamic risk measures and validated this in a second large data set of released prisoners. Finally, we incorporated findings from the follow-up of psychiatric patients discharged from medium secure services and two samples of released prisoners to construct Bayesian models to guide clinicians in risk management.

Conclusions

Risk factors for violence identified at the population level, including paranoid delusions and anxiety disorder, should be integrated in risk assessments together with established high-risk psychiatric morbidity such as substance misuse and antisocial personality disorder. The incorporation of dynamic factors resulted in improved accuracy, especially when combined in assessments using actuarial measures to obtain levels of risk using static factors. It is important to continue developing dynamic risk and protective measures with the aim of identifying factors that are causally related to violence. Only causal factors should be targeted in violence prevention interventions. Bayesian networks show considerable promise in developing software for clinicians to identify targets for intervention in the field. The Bayesian models developed in this programme are at the prototypical stage and require further programmer development into applications for use on tablets. These should be further tested in the field and then compared with structured professional judgement in a randomised controlled trial in terms of their effectiveness in preventing future violence.

Funding

The National Institute for Health Research Programme Grants for Applied Research programme.

Community-based Rehabilitation Intervention for people with Schizophrenia in Ethiopia (RISE): study protocol for a cluster randomised controlled trial

Background

Care for most people with schizophrenia is best delivered in the community and evidence-based guidelines recommend combining both medication and a psychosocial intervention, such as community-based rehabilitation. There is emerging evidence that community-based rehabilitation for schizophrenia is effective at reducing disability in middle-income country settings, yet there is no published evidence on the effectiveness in settings with fewer mental health resources. This paper describes the protocol of a study that aims to evaluate the effectiveness of community-based rehabilitation as an adjunct to health facility-based care in rural Ethiopia.

Methods

This is a cluster randomised trial set in a rural district in Ethiopia, with sub-district as the unit of randomisation. Participants will be recruited from an existing cohort of people with schizophrenia receiving treatment in primary care. Fifty-four sub-districts will be randomly allocated in a 1:1 ratio to facility-based care plus community-based rehabilitation (intervention arm) or facility-based care alone (control arm). Facility-based care consists of treatment by a nurse or health officer in primary care (antipsychotic medication, basic psychoeducation and follow-up) with referral to a psychiatric nurse-led outpatient clinic or psychiatric hospital when required. Trained community-based rehabilitation workers will deliver a manualised community-based rehabilitation intervention, with regular individual and group supervision. We aim to recruit 182 people with schizophrenia and their caregivers. Potential participants will be screened for eligibility, including enduring or disabling illness. Participants will be recruited after providing informed consent or, for participants without decision-making capacity, after the primary caregiver gives permission on behalf of the participant. The primary outcome is disability measured with the 36-item WHO Disability Assessment Schedule (WHODAS) version 2.0 at 12 months. The sample size will allow us to detect a 20 % difference in WHODAS 2.0 scores between treatment arms with 85 % power. Secondary outcomes include change in symptom severity, economic activity, physical restraint, discrimination and caregiver burden.

Discussion

This is the first trial of community-based rehabilitation for schizophrenia and will determine, as a proof of concept, the added value of community-based rehabilitation compared to facility-based care alone in a low-income country with scarce mental health resources.

Trial registration

Clinical Trials.gov Identifier NCT02160249. Registered on 3 June 2014.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-016-1427-9) contains supplementary material, which is available to authorized users.

A comparison of mental state examination documentation by junior clinicians in electronic health records before and after the introduction of a semi-structured assessment template (OPCRIT+)

OBJECTIVES

The mental state examination (MSE) provides crucial information for healthcare professionals in the assessment and treatment of psychiatric patients as well as potentially providing valuable data for mental health researchers accessing electronic health records (EHRs). We wished to establish if improvements could be achieved in the documenting of MSEs by junior doctors within a large United Kingdom mental health trust following the introduction of an EHR based semi-structured MSE assessment template (OPCRIT+).

METHODS

First, three consultant psychiatrists using a modified version of the Physician Documentation Quality Instrument-9 (PDQI-9) blindly rated fifty MSEs written using OPCRIT+ and fifty normal MSEs written with no template. Second, we conducted an audit to compare the frequency with which individual components of the MSE were documented in the normal MSEs compared with the OPCRIT+MSEs.

RESULTS

PDQI-9 ratings indicated that the OPCRIT+MSEs were more 'Thorough', 'Organized', 'Useful' and 'Comprehensible' as well as being of an overall higher quality than the normal MSEs. The audit identified that the normal MSEs contained fewer mentions of the individual components of 'Thought content', 'Anxiety' and 'Cognition & Insight'.

CONCLUSIONS

These results indicate that a semi-structured assessment template significantly improves the quality of MSE recording by junior doctors within EHRs. Future work should focus on whether such improvements translate into better patient outcomes and have the ability to improve the quality of information available on EHRs to researchers.

Validation of a Population-Based Algorithm to Detect Chronic Psychotic Illness

OBJECTIVE

To validate algorithms to detect people with chronic psychotic illness in population-based health administrative databases.

METHOD

We developed 8 algorithms to detect chronic psychotic illness using hospitalization and physician service claims data from administrative health databases in Ontario to identify cases of chronic psychotic illness between 2002 and 2007. Diagnostic data abstracted from the records of 281 randomly selected psychiatric patients from 2 hospitals in Toronto were linked to the administrative data cohort to test sensitivity, specificity, and positive predictive values (PPV) and negative predictive values.

RESULTS

Using only hospitalization data to capture chronic psychotic illness yielded the highest specificity (range 69.9% to 84.7%) and the highest PPV (range 55.2% to 80.8%). Using physician service claims in addition to hospitalization data to capture cases increased sensitivity (range 90.1% to 98.8%) but decreased specificity (range 31.1% to 68.0%) and PPV (range 38.4% to 71.1%).

CONCLUSION

Using health administrative data to study population-based outcomes for people with chronic psychotic illness is feasible and valid. Researchers can select case identification methods based on whether a more sensitive or more specific definition of chronic psychotic illness is desired.

Skating on thin ice: pragmatic prescribing for medication refractory schizophrenia

BACKGROUND

Clozapine is the treatment of choice for medication refractory psychosis, but it does not benefit half of those put on it. There are numerous studies of potential post-clozapine strategies, but little data to guide the order of such treatment in this common clinical challenge. We describe a naturalistic observational study in 153 patients treated by a specialist psychosis service to identify optimal pharmacotherapy practice, based on outcomes.

METHODS

Medication and clinical data, based on the OPCRIT tool, were examined on admission and discharge from the national psychosis service. The primary outcome measure was the percentage change in mental state examination symptoms between admission and discharge and the association with medication on discharge. Exploratory analyses evaluated the specificity of individual medication effects on symptom clusters.

RESULTS

There were fewer drugs prescribed at discharge relative to admission, suggesting an optimisation of medication, and a doubling of the number of patients treated with clozapine. Treatment with clozapine on discharge was associated with maximal decrease in symptoms from admission. In the group of patients that did not respond to clozapine monotherapy, the most effective drug combinations were clozapine augmentation with 1) sodium valproate, 2) lithium, 3) amisulpride, and 4) quetiapine. There was no support for a dose-response relationship for any drug combination.

CONCLUSIONS

Clozapine monotherapy is clearly the optimal medication in medication refractory schizophrenia and it is possible to maximise its use. In patients unresponsive to clozapine monotherapy, augmentation with sodium valproate, lithium, amisulpride and quetiapine, in that order, is a reasonable treatment algorithm. Reducing the number of ineffective drugs is possible without a detrimental effect on symptoms. Exploratory data indicated that clozapine was beneficial across a range of symptoms domains, whereas olanzapine was beneficial specifically for hallucinations and lamotrigine for comorbid affective symptoms.

Harnessing clinical psychiatric data with an electronic assessment tool (OPCRIT+): the utility of symptom dimensions

Progress in personalised psychiatry is dependent on researchers having access to systematic and accurately acquired symptom data across clinical diagnoses. We have developed a structured psychiatric assessment tool, OPCRIT+, that is being introduced into the electronic medical records system of the South London and Maudsley NHS Foundation Trust which can help to achieve this. In this report we examine the utility of the symptom data being collected with the tool. Cross-sectional mental state data from a mixed-diagnostic cohort of 876 inpatients was subjected to a principal components analysis (PCA). Six components, explaining 46% of the variance in recorded symptoms, were extracted. The components represented dimensions of mania, depression, positive symptoms, anxiety, negative symptoms and disorganization. As indicated by component scores, different clinical diagnoses demonstrated distinct symptom profiles characterized by wide-ranging levels of severity. When comparing the predictive value of symptoms against diagnosis for a variety of clinical outcome measures (e.g. ‘Overactive, aggressive behaviour’), symptoms proved superior in five instances (R² range: 0.06–0.28) whereas diagnosis was best just once (R²∶0.25). This report demonstrates that symptom data being routinely gathered in an NHS trust, when documented on the appropriate tool, have considerable potential for onward use in a variety of clinical and research applications via representation as dimensions of psychopathology.