Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study

Validation of the PECUNIA reference unit costs templates in Spain: a useful tool for multi-national economic evaluations of health technologies

BACKGROUND

The PECUNIA Project was funded by the H2020 programme in which 10 partners from six countries participated. The aim was to develop standardized, harmonized and validated methods and tools to calculate costs in different sectors (such as health and social care, education among others), with the purpose of facilitating comparability of economic evaluations of health technologies across European countries. In this paper we report the first validation of the developed reference unit cost templates in Spain.

METHODS

The evaluation of the PECUNIA Reference Unit Cost (RUC) Templates involved usability, transferability and feasibility assessment. Applicability tests were performed to estimate the cost of a selection of 15 resource items by means of the RUC templates in Spain and in four Spanish regions. External validation involved comparison with existing unit costs.

RESULTS

It was possible to estimate the cost of five services (dental care and general practitioner in the Canary Islands, general practitioner in Spain [tariffs], health-related day care centre and education services provided in a special education school in the Basque Country), car vandalism as an example of potential health-related consequences, and informal care in Spain. The templates were feasible although data completeness depended on the type of data needed to estimate the costs. The templates are transferable across countries although comparability depends on the services available in each jurisdiction.

CONCLUSIONS

The PECUNIA RUC Templates are free and feasible tools to estimate comparable reference unit costs across countries. Although more validation exercises are needed, they seem useful tools to perform robust multi-national economic evaluations and increase the transferability of cost-effectiveness studies of health technologies in Europe. However, they cannot compensate for the lack of data across jurisdictions.

The Development of a New Approach for the Harmonized Multi-Sectoral and Multi-Country Cost Valuation of Services: The PECUNIA Reference Unit Cost (RUC) Templates

BACKGROUND

Increasing healthcare costs require evidence-based resource use allocation for which assessing costs rigorously and comparably is crucial. Harmonized cross-country costing methods for evaluating interventions from a societal perspective are lacking. This study presents the development process and content of the service costing templates developed as part of the European project PECUNIA.

METHODS

The six developmental steps towards technological readiness of the templates included (1) a common conceptual costing framework and review of methodological costing issues, (2) harmonization strategy formulation, (3) proof-of-concept with expert feedback, (4) piloting, (5) validation, and (6) demonstration in six European countries.

RESULTS

The PECUNIA Reference Unit Cost (RUC) Templates for service costing are three new self-completion tools to be used with secondary or primary data for top-down micro-costing or top-down gross-costing approaches. Complementary data collection and unit cost aggregation/weighting templates are available. The applications leading to the final versions including (4) piloting through calculation of 15-unit costs, (5) validation within a Health Technology Assessment framework, and (6) RUC calculations mostly based on secondary data demonstrated the templates' general feasibility, with feedback for improved usability incorporated and a supplementary user guide developed.

CONCLUSION

The validated PECUNIA RUC Templates for multi-sectoral and multi-country service costing allow for harmonized RUC development while incorporating flexibility and transparency in the choice of costing approaches, data sources and magnitude of remaining heterogeneity. The templates are expected to significantly improve the quality, comparability and availability of unit costs for economic evaluations, and promote the transferability of service cost information across Europe.

Assessment of care provision integration in a community-based mental health system: balanced care model implementation in Andalusia (Spain)

BACKGROUND

Andalusia is the second largest region in Spain, and it has developed a comprehensive mental health (MH) plan that encourages the consolidation of the balanced care model. However, its geographical and socioeconomic disparity is a great challenge for a community-based MH system. Both the assessment of the implementation of the MH plan and the development of new tools to support decision-making can be considered critical.

OBJECTIVES

The present study aims (i) to assess how the integration of different types of MH care may influence system performance and (ii) to check the performance evolution of the integration process geographically regarding the small MH areas of Andalusia.

METHODS

The performance of the Andalusian MH system was assessed by combining Monte Carlo simulation, fuzzy inference and data envelopment analysis. The relative technical efficiency was the main performance indicator.

RESULTS

A correct integration of appropriate types of MH care, according to population needs, increases the performance of the Andalusian MH system both from global and regional perspectives. The spatial representation (based on small MH areas) of the results highlights how the performance depends on specific geographical characteristics. By analyzing the identified spatial clusters, defined by different management patterns depending on user and socioeconomic characteristics, benchmark areas and areas for improvement can be studied to design evidence-informed policies and interventions.

CONCLUSIONS

A global analysis of MH system performance was carried out, including both the successive integration of different types of care and its spatial evolution. Although an appropriate integration of different types of MH care has a positive effect on the Andalusian MH system, this process has different profiles depending on specific geographically based user and socioeconomic characteristics. The balanced care model can be considered the paradigm for assessing the performance of a large and populated territory such as Andalusia, which has a community-based MH system. This methodological approach (performance assessment and spatial analysis) may be used as a guide for developing future evidence-informed policies and managerial interventions.

Patterns of service provision in child and adolescent mental health care in Australia

Standard description of local care provision is essential for evidence-informed planning. This study aimed to map and compare the availability and diversity of current mental health service provision for children and adolescents in Australia. We used a standardised service classification instrument, the Description and Evaluation of Services and DirectoriEs (DESDE) tool, to describe service availability in eight urban and two rural health districts in Australia. The pattern of care was compared with that available for other age groups in Australia. Outpatient care was found to be the most common type of service provision, comprising 212 (81.2%) of all services identified. Hospital care (acute and non-acute) was more available in urban than in rural areas (20 services [9.7%] vs 1 [1.8%]). The level of diversity in the types of care available for children and adolescents was lower than that for the general adult population, but slightly higher than that for older people in the same areas. Standardised comparison of the pattern of care across regions reduces ambiguity in service description and classification, enables gap analysis and can inform policy and planning.

A review of information sources and analysis methods for data driven decision aids in child and adolescent mental health services

OBJECTIVE

Clinical data analysis relies on effective methods and appropriate data. Recognizing distinctive clinical services and service functions may lead to improved decision-making. Our first objective is to categorize analytical methods, data sources, and algorithms used in current research on information analysis and decision support in child and adolescent mental health services (CAMHS). Our secondary objective is to identify the potential for data analysis in different clinical services and functions in which data-driven decision aids can be useful.

MATERIALS AND METHODS

We searched related studies in Science Direct and PubMed from 2018 to 2023(Jun), and also in ACM (Association for Computing Machinery) Digital Library, DBLP (Database systems and Logic Programming), and Google Scholar from 2018 to 2021. We have reviewed 39 studies and extracted types of analytical methods, information content, and information sources for decision-making.

RESULTS

In order to compare studies, we developed a framework for characterizing health services, functions, and data features. Most data sets in reviewed studies were small, with a median of 1,176 patients and 46,503 record entries. Structured data was used for all studies except two that used textual clinical notes. Most studies used supervised classification and regression. Service and situation-specific data analysis dominated among the studies, only two studies used temporal, or process features from the patient data. This paper presents and summarizes the utility, but not quality, of the studies according to the care situations and care providers to identify service functions where data-driven decision aids may be relevant.

CONCLUSIONS

Frameworks identifying services, functions, and care processes are necessary for characterizing and comparing electronic health record (EHR) data analysis studies. The majority of studies use features related to diagnosis and assessment and correspondingly have utility for intervention planning and follow-up. Profiling the disease severity of referred patients is also an important application area.

Clarifying terminology and definitions in education services for mental health users: A disambiguation study

In the wake of the mental health crisis in children and adolescents, the coordination of education and mental health services has become a global priority. However, differing terminologies and classifications across sectors, hinder effective comparison. The classification in education focuses mainly on outputs like qualifications or throughputs like teaching programs. This proof-of-concept study tested the applicability of a standard classification of health services, the Description and Evaluation of Services and DirectoriEs (DESDE), to evaluate education services for mental health users in the context of Spain and The Netherlands. It was conducted alongside the PECUNIA project, that sought to develop methods for the assessment of mental health costs and outcomes in different sectors. The study followed an ontoterminology approach involving: 1) identification of services from a predefined list of 46 resource-use items, 2) disambiguation of identified services with the DESDE, and classifying them as accurate, ambiguous, vague or confuse; and 3) external validation by an expert panel. The analysis was conducted at the level of type of resource, target population and care provision. From the initial list, only ten of the resources could be categorized as services using DESDE, and not activities, interventions or professionals. Only four of them (8,65%) were accurate across all disambiguation categories. Experts were unaware of terminology problems in classification of service provision in the education sector. Classifications and glossaries can clarify service naming, description and costing allowing comparative effectiveness analysis and facilitating cross-sectoral planning. This should be grounded in common methodologies, tools, and units of analysis.

Evaluating Aboriginal and Torres Strait Islander Social and Emotional Wellbeing services: A collective case study in Far North Queensland

BACKGROUND

Access to a coordinated range of strengths-based, culturally appropriate community-led primary mental health and Social and Emotional Wellbeing services is critical to the mental health and wellbeing of young Aboriginal and Torres Strait Islander people, and is a policy commitment of the Australian government. However, complex and fragmented service networks and a lack of standardised service data are barriers in identifying what services are available and what care they provide.

METHOD

A standardised service classification tool was used to assess the availability and characteristics of Social and Emotional Wellbeing services for young Aboriginal and Torres Strait Islander people in two regions in Queensland, Australia.

RESULTS

We identified a complex pattern of service availability and gaps in service provision. Non-Indigenous non-governmental organisations provided a significant proportion of services, particularly 'upstream' support, while Aboriginal Community Controlled Organisations were more likely to provide 'downstream' crisis type care. Most services provided by the public sector were through Child Safety and Youth Justice departments.

CONCLUSIONS

Our findings demonstrate the complexity of current networks, and show that non-Indigenous organisations are disproportionately influential in the care received by young Aboriginal and Torres Strait Islander people, despite community goals of self-determination, and government commitment to increasing capacity of Aboriginal Community Controlled Organisations to support their local communities. These findings can be used to support decision making and planning.

Mapping community-based youth mental health services in Tasmania, Australia

BACKGROUND

Tasmania has the most rurally and remotely dispersed population of young people in Australia with high rates of youth experiencing mental ill health and socioeconomic disadvantage. Standard descriptions of mental healthcare provision are necessary for evidence-informed mental healthcare policy, planning and implementation. This systematic scoping study aimed to: (1) map and describe the characteristics of community-based youth mental health services (including substance-use) for young people in Tasmania, Australia and (2) identify gaps in service accessibility and provision.

METHODS

A list of eligible services was developed through a systematic search and consultation with key stakeholders. Data were collected from a representative from each eligible service via an interview or online survey. A standardised framework was used to classify, describe and map services. Thematic analysis was used to analyse service providers' perceived gaps to service access and provision.

RESULTS

Twenty-eight community-based mental health services for youth were identified, predominantly located in the major city of Tasmania's three service regions. Service gaps include the 'missing middle', lack of integrated supports and limited service capacity.

CONCLUSIONS

The findings highlight the limited availability, accessibility and capacity of youth mental health services across Tasmania. Recommendations focus on increasing accessibility of rural/regional supports, provision of assertive outreach, psychosocial support, integrated care and strengthening the rural mental health workforce. These findings may inform the (re)design/(re)development of community-based youth mental health services in Tasmania. The findings may also guide evidence-informed mental health service planning, decision-making, development and implementation of integrated models of youth mental health care across Australia.

The Integrated Atlas of Dementia Care in the Australian Capital Territory: A Collective Case Study of Local Service Provision

Background

This study evaluates the dementia care system in a local area and aimed to include all specialised services designed to provide health and social services to people with dementia or age-related cognitive impairment, as well as general services with a high or very high proportion of clients with dementia.

Methods

The study used an internationally standardised service classification instrument called Description and Evaluation of Services and DirectoriEs for Long Term Care (DESDE-LTC) to identify and describe all services providing care to people with dementia in the Australian Capital Territory (ACT).

Results

A total of 47 service providers were eligible for inclusion. Basic information about the services was collected from their websites, and further information was obtained through interviews with the service providers. Of the 107 services offered by the 47 eligible providers, 27% (n = 29) were specialised services and 73% (n = 78) were general services. Most of the services were residential or outpatient, with a target population mostly of people aged 65 or older, and 50 years or older in the case of Aboriginal and Torres Strait Islander Australians. There were government supports available for most types of care through various programmes.

Conclusions

Dementia care in the ACT relies heavily on general services. More widespread use of standardised methods of service classification in dementia will facilitate comparison with other local areas, allow for monitoring of changes over time, permit comparison with services provided for other health conditions and support evidence-informed local planning.

A novel set of Austrian reference unit costs for comprehensive societal perspectives consistent with latest European costing methods for economic evaluations

Decision making in public health often happens against the background of scarce resources. The systematic use of economic evaluations can be a main enabler in the alignment of public health goals with budgetary constraints. However, the lack of standardized methodology in terms of costing method and perspective are a critical barrier to the implementation of economic evaluations and the international comparability of results. We present a novel set of 22 reference unit costs (RUCs) optimized for cross-sectoral economic evaluations in Austria suitable for international comparability calculated using the standardized PECUNIA RUC Template. The common framework for costing and reporting, as well as the easy availability of the RUCs will reduce the burden on researchers and policy makers in future economic evaluations. The higher quality, accuracy, transparency and availability of economic evidence for policy design will help to improve the efficiency of public health-relevant healthcare decisions and make it easier for policy makers to bring funding arrangements and decision making across multiple sectors in line with Health-in-All-Policies goals.

Patterns of mental health services and mood disorder disability pensions: a standard comparison of Finland's three largest hospital districts

INTRODUCTION

Mental disorders are one of the most common and disabling health conditions worldwide. There is however no consensus on the best practice of system level mental health services (MHS) provision, in order to prevent e.g. mood disorder disability pensions (DPs). We analyzed the MHS provision between Finland's three largest hospital districts Helsinki and Uusimaa (HUS), Southwest Finland and Pirkanmaa, with known differences in mood disorder DP risk but presumably equal rates of mood disorder prevalence.

METHODS

We used public MHS data analyzed with the standardized DEscription and Evaluation of Services and DirectoriEs for Long Term Care (DESDE-LTC) mapping tool, focusing on all MHS, outpatient care provision, local services without and with gatekeeping, and centralized services. We also collected demographic data based on the European Socio-Demographic Schedule (ESDS). As a novel approach, the Gini-Simpson Diversity Index (GSDI) was calculated for the districts.

RESULTS

Evident differences were observed regarding the districts' MHS factors. As the hospital district with lower DP risk, HUS was characterized by the highest level of regional socioeconomic prosperity as well as high service richness and diversity. With a nationally average DP risk, Southwest Finland had the highest number of MHS personnel in full-time equivalents (FTE) per 100 000 inhabitants. Pirkanmaa, with a higher DP risk, had overall the lowest service richness and the lowest FTE of the three districts in all MHS, outpatient care and local services with gatekeeping.

CONCLUSIONS

Our findings indicate that greater richness and diversity of MHS, especially in outpatient and community-based settings, may serve as indicators of a balanced, high-quality service system that is more effective in preventing mood disorder DP and meeting the different needs of the population. In addition, the need for sufficient resourcing in all MHS and outpatient services is indicated. We suggest using diversity indices to complement the measuring and reporting of regional service variation.

Impact of the workforce allocation on the technical performance of mental health services: the collective case of Helsinki-Uusimaa (Finland)

BACKGROUND

Long-term mental health (MH) policies in Finland aimed at investing in community care and promoting reforms have led to a reduction in the number of psychiatric hospital beds. However, most resources are still allocated to hospital and community residential services due to various social, economic and political factors. Despite previous research focussing on the number and cost of these services, no study has evaluated the emerging patterns of use, their technical performance and the relationship with the workforce structure.

OBJECTIVE

The purpose of this study was to observe the patterns of use and their technical performance (efficiency) of the main types of care of MH services in the Helsinki-Uusimaa region (Finland), and to analyse the potential relationship between technical performance and the corresponding workforce structure.

METHODS

The sample included acute hospital residential care, non-hospital residential care and outpatient care services. The analysis was conducted using regression analysis, Monte Carlo simulation, fuzzy inference and data envelopment analysis.

RESULTS

The analysis showed a statistically significant linear relationship between the number of service users and the length of stay, number of beds in non-hospital residential care and number of contacts in outpatient care services. The three service types displayed a similar pattern of technical performance, with high relative technical efficiency on average and a low probability of being efficient. The most efficient acute hospital and outpatient care services integrated multidisciplinary teams, while psychiatrists and nurses characterized non-hospital residential care.

CONCLUSIONS

The results indicated that the number of resources and utilization variables were linearly related to the number of users and that the relative technical efficiency of the services was similar across all types. This suggests homogenous MH management with small variations based on workforce allocation. Therefore, the distribution of workforce capacity should be considered in the development of effective policies and interventions in the southern Finnish MH system.

The identification of economically relevant health and social care services for mental disorders in the PECUNIA project

BACKGROUND

Health economic research is still facing significant problems regarding the standardization and international comparability of health care services. As a result, comparative effectiveness studies and cost-effectiveness analyses are often not comparable. This study is part of the PECUNIA project, which aimed to improve the comparability of economic evaluations by developing instruments for the internationally standardized measurement and valuation of health care services for mental disorders. The aim of this study was to identify internationally relevant services in the health and social care sectors relevant for health economic studies for mental disorders.

METHODS

A systematic literature review on cost-of-illness studies and economic evaluations was conducted to identify relevant services, complemented by an additional grey literature search and a search of resource use measurement (RUM) questionnaires. A preliminary long-list of identified services was explored and reduced to a short-list by multiple consolidation rounds within the international research team and an external international expert survey in six European countries.

RESULTS

After duplicate removal, the systematic search yielded 15,218 hits. From these 295 potential services could be identified. The grey literature search led to 368 and the RUM search to 36 additional potential services. The consolidation process resulted in a preliminary list of 186 health and social care services which underwent an external expert survey. A final consolidation step led to a basic list of 56 services grouped into residential care, daycare, outpatient care, information for care, accessibility to care, and self-help and voluntary care.

CONCLUSIONS

The initial literature searches led to an extensive number of potential service items for health and social care. Many of these items turned out to be procedures, interventions or providing professionals rather than services and were removed from further analysis. The resulting list was used as a basis for typological coding, the development of RUM questionnaires and corresponding unit costs for international mental health economic studies in the PECUNIA project.

Standardized Systematic Description of Provision of Care for Multiple Sclerosis at a Local Level: A Demonstration Study

BACKGROUND

This study evaluates and describes the pattern of services provided for people living with multiple sclerosis (MS) in a local area as a starting point for a more global assessment.

METHODS

A health care ecosystem approach has been followed using an internationally standardized service classification instrument-the Description and Evaluation of Services and DirectoriEs for Long Term Care (DESDE-LTC)-to identify and describe all services providing care to people with MS in the Australian Capital Territory, Australia. Available services were classified according to the target population into those specifically dedicated to people living with MS and those providing general neurologic services, both public and private, and across both social and health sectors.

RESULTS

A limited range of services was available. There were no local facilities providing or coordinating multidisciplinary integrated care specific to people with MS. Subspecialty services specific to MS were limited in number (6 of the 28 services), and use of specialist services provided in neighboring states was frequently reported. Overall, very few services were provided outside the core health sector (4%).

CONCLUSIONS

The provision of care to people living with MS in the Australian Capital Territory is fragmented and relies heavily on generic neurology services in the public and private sectors. More widespread use of the DESDE-LTC as a standardized method of service classification in MS will facilitate comparison with other local areas, allow monitoring of changes over time, and permit comparison with services provided for other health conditions (eg, dementia, mental disorders).

Patterns of mental healthcare provision in rural areas: A demonstration study in Australia and Europe

INTRODUCTION

Mental healthcare systems are primarily designed to urban populations. However, the specific characteristics of rural areas require specific strategies, resource allocation, and indicators which fit their local conditions. This planning process requires comparison with other rural areas. This demonstration study aimed to describe and compare specialized rural adult mental health services in Australia, Norway, and Spain; and to demonstrate the readiness of the healthcare ecosystem approach and the DESDE-LTC mapping tool (Description and Evaluation of Services and Directories of Long Term Care) for comparing rural care between countries and across areas.

METHODS

The study described and classified the services using the DESDE-LTC. The analyses included context analysis, care availability, placement capacity, balance of care, and diversity of care. Additionally, readiness (Technology Readiness Levels - TRL) and impact analyses (Adoption Impact Ladder - AIL) were also assessed by two independent raters.

RESULTS

The findings demonstrated the usability of the healthcare ecosystem approach and the DESDE-LTC to map and identify differences and similarities in the pattern of care of highly divergent rural areas. Day care had a greater weight in the European pattern of care, while it was replaced by social outpatient care in Australian areas. In contrast, care coordination was more common in Australia, pointing to a more fragmented system that requires navigation services. The share between hospital and community residential care showed no differences between the two regions, but there were differences between catchment areas. The healthcare ecosystem approach showed a TRL 8 (the tool has been demonstrated in a real-world environment and it is ready for release and general use) and an AIL of 5 (the target public agencies provided resources for its completion). Two experts evaluated the readiness of the use of DESDE-LTC in their respective regional studies. All of them were classified using the TRL.

DISCUSSION

In conclusion, this study strongly supports gathering data on the provision of care in rural areas using standardized methods to inform rural service planning. It provides information on context and service availability, capacity and balance of care that may improve, directly or through subsequent analyses, the management and planning of services in rural areas.

Unit Costs in Health Economic Evaluations: Quo Vadis, Austria?

Evidence-informed healthcare decision-making relies on high quality data inputs, including robust unit costs, which in many countries are not readily available. The objective of the Department of Health Economics' Unit Cost Online Database, developed based on systematic reviews of Austrian costing studies, is to make conducting economic evaluations from healthcare and societal perspectives more feasible with publicly available unit cost information in Austria. This article aims to describe trends in unit cost data sources and reporting using this comprehensive database as a case study to encourage relevant national and international methodological discussions. Database analysis and synthesis included publication/study characteristics and costing reporting details in line with the Consolidated Health Economic Evaluation Reporting Standards (CHEERS 2022) with the year of the database launch as the cut-off point to assess how the methods have developed over time. Forty-two full economic evaluations and 278 unit costs were analyzed (2004-2016: 34 studies/232 unit costs, 2017-2022: 8 studies/46 unit costs). Although the reporting quality of costing details including the study perspective, unit cost sources and years has improved since 2017, the unit cost estimates and sources remained heterogeneous in Austria. While methodologically standardized national-level unit costs would be the gold standard, a systematically collated list of unit costs is a first step towards supporting health economic evaluations nationally.

Analysis of the mental health service provision in Qatar: Progressing in community mental health in a Middle East country

Background

Qatari health planning in the last decade aimed to make the transition from the traditional hospital-based psychiatric care to a community-based care, building an integrated and comprehensive mental health system. The objective of this study was to explore the mental health service provision in Qatar in 2018 and 2022. This time span coincided with two mental health plans (2013-2018 and 2019-2022) and one health plan (2018-2022).

Methods

This study followed a healthcare ecosystem approach, including context analysis and the standard description and classification of mental health services. Service provision was studied applying DESDE-LTC system (Description and Evaluation of Services and DirectoriEs-Long Term Care), an internationally validated methodology to assess and describe mental health services. Service data were analyzed along with sociodemographic indicators from public statistics to know the care context.

Results

The availability of specialized mental health services increased for adults, although it remained the same for other age groups. The diversity of care and the weight of health-related care over social-related care also remained quite similar. It was noteworthy the development of new services for young adults, migrant workers, and female populations.

Conclusion

This was the first time that this service research methodology has been applied in a Middle East country to study its mental healthcare pattern. The analysis of the mental healthcare pattern in the study time period showed the continued progress toward community-based care in Qatar in the framework of three health plans and despite the unexpected COVID-19 world pandemic.

Magnitude of terminological bias in international health services research: a disambiguation analysis in mental health

AIMS

Health services research (HSR) is affected by a widespread problem related to service terminology including non-commensurability (using different units of analysis for comparisons) and terminological unclarity due to ambiguity and vagueness of terms. The aim of this study was to identify the magnitude of the terminological bias in health and social services research and health economics by applying an international classification system.

METHODS

This study, that was part of the PECUNIA project, followed an ontoterminology approach (disambiguation of technical and scientific terms using a taxonomy and a glossary of terms). A listing of 56 types of health and social services relevant for mental health was compiled from a systematic review of the literature and feedback provided by 29 experts in six European countries. The disambiguation of terms was performed using an ontology-based classification of services (Description and Evaluation of Services and DirectoriEs - DESDE), and its glossary of terms. The analysis focused on the commensurability and the clarity of definitions according to the reference classification system. Interrater reliability was analysed using κ.

RESULTS

The disambiguation revealed that only 13 terms (23%) of the 56 services selected were accurate. Six terms (11%) were confusing as they did not correspond to services as defined in the reference classification system (non-commensurability bias), 27 (48%) did not include a clear definition of the target population for which the service was intended, and the definition of types of services was unclear in 59% of the terms: 15 were ambiguous and 11 vague. The κ analyses were significant for agreements in unit of analysis and assignment of DESDE codes and very high in definition of target population.

CONCLUSIONS

Service terminology is a source of systematic bias in health service research, and certainly in mental healthcare. The magnitude of the problem is substantial. This finding has major implications for the international comparability of resource use in health economics, quality and equality research. The approach presented in this paper contributes to minimise differentiation between services by taking into account key features such as target population, care setting, main activities and type and number of professionals among others. This approach also contributes to support financial incentives for effective health promotion and disease prevention. A detailed analysis of services in terms of cost measurement for economic evaluations reveals the necessity and usefulness of defining services using a coding system and taxonomical criteria rather than by 'text-based descriptions'.

Innovating European Long-Term Care Policies through the Socio-Economic Support of Families: A Lesson from Practices

TC and socio-economic deprivation of families are two relevant issues in international debate. The economic or time investment made by families in caregiving has an impact on the socio-economic status of family members in terms of economic means and social inclusion. This study analyzes the practices that are supported by home LTC, examining their characteristics, identifying their strengths, weaknesses, drivers, and barriers, as well as identifying social innovation aspects. The study provides a qualitative interpretative comparison of 22 practices from eight countries, representing the four LTC care models existing in Europe. Cross-studies aid in the development of sustainable policies. The study highlights the differences and similarities between selected practices. The results indicate the effectiveness of integrative and coordination strategies at the macro, meso, and micro levels for the development of supportive policies for family members with burdens of care. Nevertheless, the results underline the lack of a genuine focus on families’ socio-economic support for providing care. The partial support provided by compensatory cash benefits or unpaid care leave schemes partially addresses the difficulties of familial burden of care. The study recommends that fair economic compensation and social security benefits be incorporated into innovative and sustainable strategies for supporting caregiving in LTC and welfare schemes.

Use of a decision support system for benchmarking analysis and organizational improvement of regional mental health care: Efficiency, stability and entropy assessment of the mental health ecosystem of Gipuzkoa (Basque Country, Spain)

Decision support systems are appropriate tools for guiding policymaking processes, especially in mental health (MH), where care provision should be delivered in a balanced and integrated way. This study aims to develop an analytical process for (i) assessing the performance of an MH ecosystem and (ii) identifying benchmark and target-for-improvement catchment areas. MH provision (inpatient, day and outpatient types of care) was analysed in the Mental Health Network of Gipuzkoa (Osakidetza, Basque Country, Spain) using a decision support system that integrated data envelopment analysis, Monte Carlo simulation and artificial intelligence. The unit of analysis was the 13 catchment areas defined by a reference MH centre. MH ecosystem performance was assessed by the following indicators: relative technical efficiency, stability and entropy to guide organizational interventions. Globally, the MH system of Gipuzkoa showed high efficiency scores in each main type of care (inpatient, day and outpatient), but it can be considered unstable (small changes can have relevant impacts on MH provision and performance). Both benchmark and target-for-improvement areas were identified and described. This article provides a guide for evidence-informed decision-making and policy design to improve the continuity of MH care after inpatient discharges. The findings show that it is crucial to design interventions and strategies (i) considering the characteristics of the area to be improved and (ii) assessing the potential impact on the performance of the global MH care ecosystem. For performance improvement, it is recommended to reduce admissions and readmissions for inpatient care, increase workforce capacity and utilization of day care services and increase the availability of outpatient care services.

In Search for Comparability: The PECUNIA Reference Unit Costs for Health and Social Care Services in Europe

Improving the efficiency of mental healthcare service delivery by learning from international best-practice examples requires valid data, including robust unit costs, which currently often lack cross-country comparability. The European ProgrammE in Costing, resource use measurement and outcome valuation for Use in multi-sectoral National and International health economic evaluAtions (PECUNIA) aimed to harmonize the international unit cost development. This article presents the methodology and set of 36 externally validated, standardized reference unit costs (RUCs) for five health and social care services (general practitioner, dentist, help-line, day-care center, nursing home) in Austria, England, Germany, Hungary, The Netherlands, and Spain based on unambiguous service definitions using the extended DESDE PECUNIA coding framework. The resulting PECUNIA RUCs are largely comparable across countries, with any causes for deviations (e.g., country-specific scope of services) transparently documented. Even under standardized methods, notable limitations due to data-driven divergences in key costing parameters remain. Increased cross-country comparability by adopting a uniform methodology and definitions can advance the quality of evidence-based policy guidance derived from health economic evaluations. The PECUNIA RUCs are available free of charge and aim to significantly improve the quality and feasibility of future economic evaluations and their transferability across mental health systems.

Establishing a comprehensive list of mental health-related services and resource use items in Austria: A national-level, cross-sectoral country report for the PECUNIA project

BACKGROUND

A comprehensive, comparable assessment of the economic disease burden and the value of relevant care forms a major challenge in the case of mental diseases. This study aimed to inform the development of a resource use measurement (RUM) instrument and harmonized reference unit costs valid for multi-sectoral and multi-national cost assessments for mental health diseases as part of the European PECUNIA project.

METHODS

An iterative, multi-methods approach was applied. Systematic literature reviews appended with national grey literature searches in six European countries were conducted to generate preliminary, literature-based, international, mental health-related service and resource use lists for all investigated sectors in 2018. As part of a multi-national expert survey, these lists were reviewed by 18 Austrian sector-specific experts regarding the clarity, relevance, comprehensiveness and availability in the Austrian context.

RESULTS

Out of 295 items included in the preliminary, international, sector-specific lists (health and social care-201 items, criminal justice-35 items, education-39 items; patient, family and informal care-20 items), a total of 261 items and descriptions (88%) were considered clear by all experts. 42 items (14%) were considered not existing in Austria, and 111 items (38%) were prioritized regarding their relevance in the national context. Thirteen additional items (4%) were suggested to be added to accommodate for Austria-specific features of the individual sectors. Major typological difficulties based on item names were observed.

CONCLUSIONS

The identified country-specific variations and general typological bias and their potential contributions to service and resource use cost variations across countries and sectors call for further systematic investigation. Next, PECUNIA will develop internationally harmonized and comparable definitions of the listed items and their units of analysis based on a new conceptual multi-sectoral costing framework. The developed lists will require consolidation and further prioritization for the development of a patient-reported RUM instrument and consequent reference unit cost valuation.

Modelling the balance of care: Impact of an evidence-informed policy on a mental health ecosystem

Major efforts worldwide have been made to provide balanced Mental Health (MH) care. Any integrated MH ecosystem includes hospital and community-based care, highlighting the role of outpatient care in reducing relapses and readmissions. This study aimed (i) to identify potential expert-based causal relationships between inpatient and outpatient care variables, (ii) to assess them by using statistical procedures, and finally (iii) to assess the potential impact of a specific policy enhancing the MH care balance on real ecosystem performance. Causal relationships (Bayesian network) between inpatient and outpatient care variables were defined by expert knowledge and confirmed by using multivariate linear regression (generalized least squares). Based on the Bayesian network and regression results, a decision support system that combines data envelopment analysis, Monte Carlo simulation and fuzzy inference was used to assess the potential impact of the designed policy. As expected, there were strong statistical relationships between outpatient and inpatient care variables, which preliminarily confirmed their potential and a priori causal nature. The global impact of the proposed policy on the ecosystem was positive in terms of efficiency assessment, stability and entropy. To the best of our knowledge, this is the first study that formalized expert-based causal relationships between inpatient and outpatient care variables. These relationships, structured by a Bayesian network, can be used for designing evidence-informed policies trying to balance MH care provision. By integrating causal models and statistical analysis, decision support systems are useful tools to support evidence-informed planning and decision making, as they allow us to predict the potential impact of specific policies on the ecosystem prior to its real application, reducing the risk and considering the population’s needs and scientific findings.

Disambiguation of psychotherapy: a search for meaning

This analysis identifies the significant problem of ambiguity, variation and vagueness in relation to the intervention described as 'psychotherapy'. Its purpose is to raise international awareness of this problem and alternative solutions.

Do Costs in the Education Sector Matter? A Systematic Literature Review of the Economic Impact of Psychosocial Problems on the Education Sector

BACKGROUND

Psychosocial (e.g., anxiety or behavior) problems lead to costs not only in the healthcare sector but also in education and other sectors. As psychosocial problems develop during the critical period of establishing educational trajectories, education costs are particularly relevant in the context of psychosocial problems among children and adolescents.

OBJECTIVES

This study aimed to gain insights into the methods used for the inclusion of education costs in health economics studies and into the proportion of the education costs in relation to the total costs associated with a condition or an intervention.

METHODS

We systematically searched the PubMed, Embase, SSCI, CINAHL, PsycINFO, ERIC, and Econlit databases in August 2019 for economic evaluations of mental health, psychosocial and educational interventions, and cost-of-illness studies of mental, behavioral, and neurodevelopmental disorders conducted from a societal perspective in populations of children and adolescents. An additional search was conducted in February 2021 to update the review.

RESULTS

In total, 49 articles were included in the analysis. The most common cost items were special education, school absenteeism, and various educational professionals (educational psychologist). A variety of methods were employed for the identification, measurement, and/or valuation of education costs. The proportion of education costs to the total costs of condition/intervention ranged from 0 to 67%, with the mean being 18.5%.

DISCUSSION

Since education costs can constitute a significant proportion of the total costs of an intervention or condition, including them in health economics studies might be important in informing optimal resource allocation decisions. Although various methods are available for including education costs in health economics studies, further research is needed to develop evidence-based methods for producing comparable estimates.

A new bottom-up method for the standard analysis and comparison of workforce capacity in mental healthcare planning: Demonstration study in the Australian Capital Territory

The aims of this study are to evaluate and describe mental health workforce and capacity, and to describe the relationship between workforce capacity and patterns of care in local areas. We conducted a comparative demonstration study of the applicability of an internationally validated standardised service classification instrument—the Description and Evaluation of Services and Directories—DESDE-LTC) using the emerging mental health ecosystems research (MHESR) approach. Using DESDE-LTC as the framework, and drawing from international occupation classifications, the workforce was classified according to characteristics including the type of care provided and professional background. Our reference area was the Australian Capital Territory, which we compared with two other urban districts in Australia (Sydney and South East Sydney) and three benchmark international health districts (Helsinki-Uusima (Finland), Verona (Italy) and Gipuzkoa (Spain)). We also compared our data with national level data where available. The Australian and Finnish regions had a larger and more highly skilled workforce than the southern European regions. The pattern of workforce availability and profile varied, even within the same country, at the local level. We found significant differences between regional rates of identified rates of psychiatrists and psychologists, and national averages. Using a standardised classification instrument at the local level, and our occupational groupings, we were able to assess the available workforce and provide information relevant to planners about the actual capacity of the system. Data obtained at local level is critical to providing planners with reliable data to inform their decision making.

A Semiautomated Classification System for Producing Service Directories in Social and Health Care (DESDE-AND): Maturity Assessment Study

BACKGROUND

DESDE-LTC (Description and Evaluation of Services and DirectoriEs for Long-Term Care) is an international classification system that allows standardized coding and comparisons between different territories and care sectors, such as health and social care, in defined geographic areas. We adapted DESDE-LTC into a computer tool (DESDE-AND) for compiling a directory of care services in Andalucia, Spain.

OBJECTIVE

The aim of this study was to evaluate the maturity of DESDE-AND. A secondary objective of this study is to show the practicality of a new combined set of standard evaluation tools for measuring the maturity of health technology products.

METHODS

A system for semiautomated coding of service provision has been co-designed. A panel of 23 domain experts and a group of 68 end users participated in its maturity assessment that included its technology readiness level (TRL), usability, validity, adoption (Adoption Impact Ladder [AIL]), and overall degree of maturity [implementation maturity model [IMM]). We piloted the prototype in an urban environment (Seville, Spain).

RESULTS

The prototype was demonstrated in an operational environment (TRL 7). Sixty-eight different care services were coded, generating fact sheets for each service and its geolocation map. The observed agreement was 90%, with moderate reliability. The tool was partially adopted by the regional government of Andalucia (Spain), reaching a level 5 in adoption (AIL) and a level 4 in maturity (IMM) and is ready for full implementation.

CONCLUSIONS

DESDE-AND is a usable and manageable system for coding and compiling service directories and it can be used as a core module of decision support systems to guide planning in complex cross-sectoral areas such as combined social and health care.

International experiences of the active period of COVID-19 - Mental health care

AIM

To summarise commonalities and variations in the mental health response to COVID-19 across different sites and countries, with a view to better understanding key steps not only in crisis management, but for future systemic reform of mental health care.

METHOD

We conducted a Rapid Synthesis and Translation Process of lessons learned from an international panel of experts, collecting on the ground experiences of the pandemic as it evolved in real time. Digital conferencing and individual interviews were used to rapidly acquire knowledge on the COVID-19 outbreak across 16 locations in Australia, Denmark, Italy, Spain, Taiwan, the UK, and the USA.

RESULTS

COVID-19 has had massive impacts on mental health care internationally. Most systems were under-resourced and under-prepared, struggling to manage both existing and new clients. There were significant differences between sites, depending on the explosivity the pandemic and the readiness of the mental health system. Integrated, community mental health systems exhibited greater adaptability in contrast to services which depended on face-to-face and hospital-based care. COVID-19 has demonstrated the need for a new approach to rapid response to crisis in mental health. New decision support system tools are necessary to ensure local decision-makers can effectively respond to the enormous practical challenges posed in these circumstances.

CONCLUSIONS

The process we have undertaken has generated clear lessons for mental health policymakers worldwide, beyond pandemic planning and response to guide next steps in systemic mental health reform. Key here is achieving some balance between national leadership and local context adaptation of evidence.

Building a statistical classification: A new tool for classification development and testing

Statistical classifications are essential for collecting consistent data that can be compared over space and time. However, a publicly-documented body of practice concerning how to undertake the development and testing of a statistical classification is currently lacking. What aspects of the classification should be tested during the development process? How do we judge whether the classification is fit-for-purpose? How should problems and shortcomings be identified so that they can be remedied? To fill this gap, we drew on existing, authoritative sources to develop an analytic structure for use in the development and testing of statistical classifications. It consists of two components: (1) a statistical classification development and testing framework reflecting the required features of a statistical classification; and (2) a 4-tier model representing the main elements that make up a statistical classification, to use as a heuristic structure within which to locate issues identified and consider how they can be addressed. In this paper, we outline the development of the framework and model, and reflect on their application in testing a draft classification of health interventions. We propose this analytic structure as a new tool to support those engaged in the development of statistical classifications.

Patterns of Service Provision in Older People's Mental Health Care in Australia

Australia has a population of around 4 million people aged 65 years and over, many of whom are at risk of developing cognitive decline, mental illness, and/or psychological problems associated with physical illnesses. The aim of this study was to describe the pattern of specialised mental healthcare provision (availability, placement capacity, balance of care and diversity) for this age group in urban and rural health districts in Australia. The Description and Evaluation of Services and DirectoriEs for Long Term Care (DESDE-LTC) tool was used in nine urban and two rural health districts of the thirty-one Primary Health Networks across Australia. For the most part service provision was limited to hospital and outpatient care across all study areas. The latter was mainly restricted to health-related outpatient care, and there was a relative lack of social outpatient care. While both acute and non-acute hospital care were available in urban areas, in rural areas hospital care was limited to acute care. Limited access to comprehensive mental health care, and the uniformity in provision across areas in spite of differences in demographic, socioeconomic and health characteristics raises issues of equity in regard to psychogeriatric care in this country. Comparing patterns of mental health service provision across the age span using the same classification method allows for a better understanding of care provision and gap analysis for evidence-informed policy.

A Method to Compare the Delivery of Psychiatric Care for People with Treatment-Resistant Schizophrenia

INTRODUCTION

Community services are gaining ground when it comes to attention to patients with psychiatric diseases. Regarding patients with treatment-resistant schizophrenia (TRS), the use of information and communication technology (ICT) could help to shift the focus from hospital-centered attention to community services. This study compares the differences in mental health services provided for patients with TRS in Budapest (Hungary), Tel-Aviv (Israel) and Catalonia (Spain) by means of a method for the quick appraisal of gaps among the three places, for a potential implementation of the same ICT tool in these regions.

METHODS

An adapted version of the Description and Standardised Evaluation of Services and Directories in Europe for Long Term Care (DESDE-LTC) instrument was made by researchers in Semmelweis University (Budapest, Hungary), Gertner Institute (Tel-Aviv, Israel) and Hospital de la Santa Creu I Sant Pau and Parc Sanitari Sant Joan de Déu (Catalonia, Spain).

RESULTS

Two types of outpatient care services were available in the three regions. Only one type of day-care facility was common in the whole study area. Two residential care services, one for acute and the other for non-acute patients were available in every region. Finally, two self-care and volunteer-care facilities were available in the three places.

CONCLUSION

Although the availability of services was different in each region, most of the services provided were sufficiently similar to allow the implementation of the same ICT solution in the three places.

Patterns of Mental Health Care in Remote Areas: Kimberley (Australia), Nunavik (Canada), and Lapland (Finland): Modèles de soins de santé mentale dans les régions éloignées: Kimberley (Australie), Nunavik (Canada) et Laponie (Finlande)

OBJECTIVE

Mental health (MH) care in remote areas is frequently scarce and fragmented and difficult to compare objectively with other areas even in the same country. This study aimed to analyze the adult MH service provision in 3 remote areas of Organization for Economic Cooperation and Development countries in the world.

METHODS

We used an internationally agreed set of systems indicators, terminology, and classification of services (Description and Evaluation of Services and DirectoriEs for Long Term Care). This instrument provided a standard description of MH care provision in the Kimberley region (Australia), Nunavik (Canada), and Lapland (Finland), areas characterized by an extremely low population density and high relative rates of Indigenous peoples.

RESULTS

All areas showed high rates of deprivation within their national contexts. MH services were mostly provided by the public sector supplemented by nonprofit organizations. This study found a higher provision per inhabitant of community residential care in Nunavik in relation to the other areas; higher provision of community outreach services in the Kimberley; and a lack of day services except in Lapland. Specific cultural-based services for the Indigenous population were identified only in the Kimberley. MH care in Lapland was self-sufficient, and its care pattern was similar to other Finnish areas, while the Kimberley and Nunavik differed from the standard pattern of care in their respective countries and relied partly on services located outside their boundaries for treating severe cases.

CONCLUSION

We found common challenges in these remote areas but a huge diversity in the patterns of MH care. The implementation of care interventions should be locally tailored considering both the environmental characteristics and the existing pattern of service provision.

Old age mental health services in Southern Balkans: Features, geospatial distribution, current needs, and future perspectives

BACKGROUND

Healthcare services are increasingly confronted with challenges related to old age mental disorders. The survey aimed to provide an overview of existing psychogeriatric services in Albania, Bulgaria, Greece, and North Macedonia.

METHODS

After identification of psychogeriatric units across the four countries, their head physicians were asked to provide data on their clinical, teaching, and research activity, as well as staff composition. Moreover, the attitudes of head physicians to current needs and future service development were explored.

RESULTS

A total of 15 psychogeriatric units were identified (3 in Bulgaria, 8 in Greece, and 4 in North Macedonia). Results show wide variation regarding the location, team size and composition, service availability, numbers of patients attending, and inpatient treatment length. Most head physicians underscored the urgent need for breakthroughs in the graduate and postgraduate education in psychogeriatrics of medical and nonmedical professionals, as well as in the interconnection of their units with community primary healthcare services and long-term care facilities for seniors via telemedicine. They would welcome the development of national standards for psychogeriatric units, potentially embodying clear pointers for action. A number of head physicians advocated the development of nationwide old age mental health registries.

CONCLUSIONS

Regional disparities in resources and services for seniors' mental health services were unveiled. These data may enrich the dialogue on optimizing psychogeriatric services through planning future cross-border collaborations mainly based on telemedicine services, especially in the era of the novel coronavirus pandemic, and training/education in psychogeriatrics of mental health professionals.

[Everything is on the map: Integrated Mental Health Atlases as support tools for service planning. SESPAS Report 2020]

OBJECTIVE

This article reviews the usability of the Integrated Atlases of Mental Health as a decision support tool for service planning following a health ecosystem research approach.

METHOD

This study describes the types of atlases and the procedure for their development. Atlases carried out in Spain are presented and their impact in mental health service planning is assessed. Atlases comprise information on the local characteristics of the health care system, geographical availability of resources collected with the DESDE-LTC instrument and their use. Atlases use geographic information systems and other visualisation tools. Atlases follow a bottom-up collaborative approach involving decision-makers from planning agencies for their development and external validation.

RESULTS

Since 2005, Integrated Atlases of Mental Health have been developed for nine regions in Spain comprising over 65% of the Spanish inhabitants. The impact on service planning has been unequal for the different regions. Catalonia, Biscay and Gipuzkoa, and Andalusia reach the highest impact. In these areas, health advisors have been actively involved in their co-design and implementation in service planning.

CONCLUSIONS

Atlases allow detecting care gaps and duplications in care provision; monitoring changes of the system over time, and carrying out national and international comparisons, efficiency modelling and benchmarking. The knowledge provided by atlases could be incorporated to decision support systems in order to support an efficient mental health service planning based on evidence-informed policy.

Service availability and capacity in rural mental health in Australia: Analysing gaps using an Integrated Mental Health Atlas

OBJECTIVE

Access to services and workforce shortages are major challenges in rural areas worldwide. In order to improve access to mental health care, it is imperative to understand what services are available, what their capacity is and where existing funds might be spent to increase availability and accessibility. The aim of this study is to investigate mental health service provision in a selection of rural and remote areas across Australia by analysing service availability, placement capacity and diversity.

METHOD

This research studies the health regions of Western New South Wales and Country Western Australia and their nine health areas. Service provision was analysed using the DESDE-LTC system for long-term care service description and classification that allows international comparison. Rates per 100,000 inhabitants were calculated to compare the care availability and placement capacity for children and adolescents, adults and older adults.

RESULTS

The lowest diversity was found in northern Western Australia. Overall, Western New South Wales had a higher availability of non-acute outpatient services for adults, but hardly any acute outpatient services. In Country Western Australia, substantially fewer non-acute outpatient services were found, while acute services were much more common. Acute inpatient care services were more common in Western New South Wales, while sub-acute inpatient services and non-acute day care services were only found in Western New South Wales.

CONCLUSION

The number and span of services in the two regions showed discrepancies both within and between regions, raising issues on the equity of access to mental health care in Australia. The standard description of the local pattern of rural mental health care and its comparison across jurisdictions is critical for evidence-informed policy planning and resource allocation.

Standardised description of health and social care: A systematic review of use of the ESMS/DESDE (European Service Mapping Schedule/Description and Evaluation of Services and DirectoriEs)

BACKGROUND

Evidence-informed planning and interpretation of research results both require standardised description of local care delivery context. Such context analysis descriptions should be comparable across regions and countries to allow benchmarking and organizational learning, and for research findings to be interpreted in context. The European Service Mapping Schedule (ESMS) is a classification of adult mental health services that was later adapted for the assessment of health and social systems research (Description and Evaluation of Services and DirectoriEs - DESDE). The aim of the study was to review the diffusion and use of the ESMS/DESDE system in health and social care and its impact in health policy and decision-making.

METHOD

We conducted a systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (1997-2018).

RESULTS

Out of 155 papers mentioning ESMS/DESDE, 71 have used it for service research and planning. The classification has been translated into eight languages and has been used by seven international research networks. Since 2000, it has originated 11 instruments for health system research with extensive analysis of their metric properties. The ESMS/DESDE coding system has been used in 585 catchment areas in 34 countries for description of services delivery at local, regional and national levels.

CONCLUSIONS

The ESMS/DESDE system provides a common terminology, a classification of care services, and a set of tools allowing a variety of aims to be addressed in healthcare and health systems research. It facilitates comparisons across and within countries for evidence-informed planning.

The REFINEMENT Glossary of Terms: An International Terminology for Mental Health Systems Assessment

Comparing mental health systems across countries is difficult because of the lack of an agreed upon terminology covering services and related financing issues. Within the European Union project REFINEMENT, international mental health care experts applied an innovative mixed "top-down" and "bottom-up" approach following a multistep design thinking strategy to compile a glossary on mental health systems, using local services as pilots. The final REFINEMENT glossary consisted of 432 terms related to service provision, service utilisation, quality of care and financing. The aim of this study was to describe the iterative process and methodology of developing this glossary.

Standard comparison of local mental health care systems in eight European countries

AIMS

There is a need of more quantitative standardised data to compare local Mental Health Systems (MHSs) across international jurisdictions. Problems related to terminological variability and commensurability in the evaluation of services hamper like-with-like comparisons and hinder the development of work in this area. This study was aimed to provide standard assessment and comparison of MHS in selected local areas in Europe, contributing to a better understanding of MHS and related allocation of resources at local level and to lessen the scarcity in standard service comparison in Europe. This study is part of the Seventh Framework programme REFINEMENT (Research on Financing Systems' Effect on the Quality of Mental Health Care in Europe) project.

METHODS

A total of eight study areas from European countries with different systems of care (Austria, England, Finland, France, Italy, Norway, Romania, Spain) were analysed using a standard open-access classification system (Description and Evaluation of Services for Long Term Care in Europe, DESDE-LTC). All publicly funded services universally accessible to adults (≥18 years) with a psychiatric disorder were coded. Care availability, diversity and capacity were compared across these eight local MHS.

RESULTS

The comparison of MHS revealed more community-oriented delivery systems in the areas of England (Hampshire) and Southern European countries (Verona - Italy and Girona - Spain). Community-oriented systems with a higher proportion of hospital care were identified in Austria (Industrieviertel) and Scandinavian countries (Sør-Trøndelag in Norway and Helsinki-Uusimaa in Finland), while Loiret (France) was considered as a predominantly hospital-based system. The MHS in Suceava (Romania) was still in transition to community care.

CONCLUSIONS

There is a significant variation in care availability and capacity across MHS of local areas in Europe. This information is relevant for understanding the process of implementation of community-oriented mental health care in local areas. Standard comparison of care provision in local areas is important for context analysis and policy planning.

Healthcare ecosystems research in mental health: a scoping review of methods to describe the context of local care delivery

BACKGROUND

Evidence from the context of local health ecosystems is highly relevant for research and policymaking to understand geographical variations in outcomes of health care delivery. In mental health systems, the analysis of context presents particular challenges related to their complexity and to methodological difficulties. Method guidelines and standard recommendations for conducting context analysis of local mental health care are urgently needed. This scoping study reviews current methods of context analysis in mental health systems to establish the parameters of research activity examining availability and capacity of care at the local level, and to identify any gaps in the literature.

METHODS

A scoping review based on a systematic search of key databases was conducted for the period 2005-2016. A systems dynamics/complexity approach was adopted, using a modified version of Tansella and Thornicroft's matrix model of mental health care as the conceptual framework for our analysis.

RESULTS

The lack of a specific terminology in the area meant that from 10,911 titles identified at the initial search, only 46 papers met inclusion criteria. Of these, 21 had serious methodological limitations. Fifteen papers did not use any kind of formal framework, and five of those did not describe their method. Units of analysis varied widely and across different levels of the system. Six instruments to describe service availability and capacity were identified, of which three had been psychometrically validated. A limitation was the exclusion of grey literature from the review. However, the imprecise nature of the terminology, and high number of initial results, makes the inclusion of grey literature not feasible.

CONCLUSION

We identified that, in spite of its relevance, context studies in mental health services is a very limited research area. Few validated instruments are available. Methodological limitations in many papers mean that the particular challenges of mental health systems research such as system complexity, data availability and terminological variability are generally poorly addressed, presenting a barrier to valid system comparison. The modified Thornicroft and Tansella matrix and related ecological production of care model provide the main model for research within the area of health care ecosystems.

A decision support system for assessing management interventions in a mental health ecosystem: The case of Bizkaia (Basque Country, Spain)

Evidence-informed strategic planning is a top priority in Mental Health (MH) due to the burden associated with this group of disorders and its societal costs. However, MH systems are highly complex, and decision support tools should follow a systems thinking approach that incorporates expert knowledge. The aim of this paper is to introduce a new Decision Support System (DSS) to improve knowledge on the health ecosystem, resource allocation and management in regional MH planning. The Efficient Decision Support-Mental Health (EDeS-MH) is a DSS that integrates an operational model to assess the Relative Technical Efficiency (RTE) of small health areas, a Monte-Carlo simulation engine (that carries out the Monte-Carlo simulation technique), a fuzzy inference engine prototype and basic statistics as well as system stability and entropy indicators. The stability indicator assesses the sensitivity of the model results due to data variations (derived from structural changes). The entropy indicator assesses the inner uncertainty of the results. RTE is multidimensional, that is, it was evaluated by using 15 variable combinations called scenarios. Each scenario, designed by experts in MH planning, has its own meaning based on different types of care. Three management interventions on the MH system in Bizkaia were analysed using key performance indicators of the service availability, placement capacity in day care, health care workforce capacity, and resource utilisation data of hospital and community care. The potential impact of these interventions has been assessed at both local and system levels. The system reacts positively to the proposals by a slight increase in its efficiency and stability (and its corresponding decrease in the entropy). However, depending on the analysed scenario, RTE, stability and entropy statistics can have a positive, neutral or negative behaviour. Using this information, decision makers can design new specific interventions/policies. EDeS-MH has been tested and face-validated in a real management situation in the Bizkaia MH system.

Causal Modelling for Supporting Planning and Management of Mental Health Services and Systems: A Systematic Review

Mental health services and systems (MHSS) are characterized by their complexity. Causal modelling is a tool for decision-making based on identifying critical variables and their causal relationships. In the last two decades, great efforts have been made to provide integrated and balanced mental health care, but there is no a clear systematization of causal links among MHSS variables. This study aims to review the empirical background of causal modelling applications (Bayesian networks and structural equation modelling) for MHSS management. The study followed the PRISMA guidelines (PROSPERO: CRD42018102518). The quality of the studies was assessed by using a new checklist based on MHSS structure, target population, resources, outcomes, and methodology. Seven out of 1847 studies fulfilled the inclusion criteria. After the review, the selected papers showed very different objectives and subjects of study. This finding seems to indicate that causal modelling has potential to be relevant for decision-making. The main findings provided information about the complexity of the analyzed systems, distinguishing whether they analyzed a single MHSS or a group of MHSSs. The discriminative power of the checklist for quality assessment was evaluated, with positive results. This review identified relevant strategies for policy-making. Causal modelling can be used for better understanding the MHSS behavior, identifying service performance factors, and improving evidence-informed policy-making.

Organisational impact of the National Disability Insurance Scheme transition on mental health care providers: the experience in the Australian Capital Territory

OBJECTIVES:

Concerns raised about the appropriateness of the National Disability Insurance Scheme (NDIS) in Australia for people with mental illness have not been given full weight due to a perceived lack of available evidence. In the Australian Capital Territory (ACT), one of the pilot sites of the Scheme, mental health care providers across all relevant sectors who were interviewed for a local Atlas of Mental Health Care described the impact of the scheme on their service provision.

METHODS:

All mental health care providers from every sector in the ACT were contacted. The participation rate was 92%. We used the Description and Evaluation of Services and Directories for Long Term Care to assess all service provision at the local level.

RESULTS:

Around one-third of services interviewed lacked funding stability for longer than 12 months. Nine of the 12 services who commented on the impact of the NDIS expressed deep concern over problems in planning and other issues.

CONCLUSIONS:

The transition to NDIS has had a major impact on ACT service providers. The ACT was a best-case scenario as it was one of the NDIS pilot sites.

Integrated mapping of local mental health systems in Central Chile

OBJECTIVE

To describe the availability of local mental health (MH) services in small MH catchment areas in Central Chile, using a bottom-up approach.

METHODS

MH services of 19 small MH catchment areas in five health districts of Central Chile that provide health care to more than 4 million inhabitants were assessed using DESDE-LTC (Description and Evaluation of Services and Directories in Europe for Long-Term Care), a tool for standardized description and classification of LTC health services, in a study conducted in 2012 ("DESDE-Chile") designed to complement other studies conducted in 2004 and 2012 at the national and regional level using the World Health Organization Assessment Instrument for Mental Health Systems (WHO-AIMS). Key informants from national, regional, and local health authorities were contacted to compile a comprehensive list of MH services or facilities (health, social services, education, employment, and housing). The analysis of local care provision covered three criteria-service availability, placement capacity, and workforce capacity.

RESULTS

The study detected disparities in all three criteria (availability and placement and workforce capacity) across the five health districts, between urban and rural areas, and between neighboring urban areas. Analysis of service availability revealed differences in the weight of residential services versus day and outpatient care. The Talcahuano area could be considered a benchmark of MH care in Central Chile, based on its service provision patterns, and the criteria of the community care model. The list of MH services identified in this study differed from the one generated in the 2012 WHO-AIMS study.

CONCLUSIONS

This survey of local MH service provision in small catchment areas using the DESDE-LTC tool provided MH service provision data that complemented information collected in other studies conducted at the national/regional level using the WHO-AIMS tool. The bottom-up approach applied in this study would also be useful for the assessment of equity and accessibility and local planning.

The balance of adult mental health care: provision of core health versus other types of care in eight European countries

AIMS

Although many mental health care systems provide care interventions that are not related to direct health care, little is known about the interfaces between the latter and core health care. 'Core health care' refers to services whose explicit aim is direct clinical treatment which is usually provided by health professionals, i.e., physicians, nurses, psychologists. 'Other care' is typically provided by other staff and includes accommodation, training, promotion of independence, employment support and social skills. In such a definition, 'other care' does not necessarily mean being funded or governed differently. The aims of the study were: (1) using a standard classification system (Description and Evaluation of Services and Directories in Europe for Long Term Care, DESDE-LTC) to identify 'core health' and 'other care' services provided to adults with mental health problems; and (2) to investigate the balance of care by analysing the types and characteristics of core health and other care services.

METHODS

The study was conducted in eight selected local areas in eight European countries with different mental health systems. All publicly funded mental health services, regardless of the funding agency, for people over 18 years old were identified and coded. The availability, capacity and the workforce of the local mental health services were described using their functional main activity or 'Main Types of Care' (MTC) as the standard for international comparison, following the DESDE-LTC system.

RESULTS

In these European study areas, 822 MTCs were identified as providing core health care and 448 provided other types of care. Even though one-third of mental health services in the selected study areas provided interventions that were coded as 'other care', significant variation was found in the typology and characteristics of these services across the eight study areas.

CONCLUSIONS

The functional distinction between core health and other care overcomes the traditional division between 'health' and 'social' sectors based on governance and funding. The overall balance between core health and other care services varied significantly across the European sites. Mental health systems cannot be understood or planned without taking into account the availability and capacity of all services specifically available for this target population, including those outside the health sector.

A Comparison of Mental Health Care Systems in Northern and Southern Europe: A Service Mapping Study

Mental health services (MHS) have gone through vast changes during the last decades, shifting from hospital to community-based care. Developing the optimal balance and use of resources requires standard comparisons of mental health care systems across countries. This study aimed to compare the structure, personnel resource allocation, and the productivity of the MHS in two benchmark health districts in a Nordic welfare state and a southern European, family-centered country. The study is part of the REFINEMENT (Research on Financing Systems' Effect on the Quality of Mental Health Care) project. The study areas were the Helsinki and Uusimaa region in Finland and the Girona region in Spain. The MHS were mapped by using the DESDE-LTC (Description and Evaluation of Services and Directories for Long Term Care) tool. There were 6.7 times more personnel resources in the MHS in Helsinki and Uusimaa than in Girona. The resource allocation was more residential-service-oriented in Helsinki and Uusimaa. The difference in mental health personnel resources is not explained by the respective differences in the need for MHS among the population. It is important to make a standard comparison of the MHS for supporting policymaking and to ensure equal access to care across European countries.

Identifying Local and Centralized Mental Health Services-The Development of a New Categorizing Variable

The challenges of mental health and substance abuse services (MHS) require shifting of the balance of resources from institutional care to community care. In order to track progress, an instrument that can describe these attributes of MHS is needed. We created a coding variable in the European Service Mapping Schedule-Revised (ESMS-R) mapping tool using a modified Delphi panel that classified MHS into centralized, local services with gatekeeping and local services without gatekeeping. For feasibility and validity, we tested the variable on a dataset comprising MHS in Southern Finland, covering a population of 2.3 million people. There were differences in the characteristics of services between our study regions. In our data, 41% were classified as centralized, 37% as local without gatekeeping and 22% as local services with gatekeeping. The proportion of resources allocated to local services varied from 20% to 43%. Reclassifying ESMS-R is an easy way to compare the important local vs. centralized balance of MHS systems globally, where such data exists. Further international studies comparing systems and validating this approach are needed.

Use of the self-organising map network (SOMNet) as a decision support system for regional mental health planning

Background

Decision-making in mental health systems should be supported by the evidence-informed knowledge transfer of data. Since mental health systems are inherently complex, involving interactions between its structures, processes and outcomes, decision support systems (DSS) need to be developed using advanced computational methods and visual tools to allow full system analysis, whilst incorporating domain experts in the analysis process. In this study, we use a DSS model developed for interactive data mining and domain expert collaboration in the analysis of complex mental health systems to improve system knowledge and evidence-informed policy planning.

Methods

We combine an interactive visual data mining approach, the self-organising map network (SOMNet), with an operational expert knowledge approach, expert-based collaborative analysis (EbCA), to develop a DSS model. The SOMNet was applied to the analysis of healthcare patterns and indicators of three different regional mental health systems in Spain, comprising 106 small catchment areas and providing healthcare for over 9 million inhabitants. Based on the EbCA, the domain experts in the development team guided and evaluated the analytical processes and results. Another group of 13 domain experts in mental health systems planning and research evaluated the model based on the analytical information of the SOMNet approach for processing information and discovering knowledge in a real-world context. Through the evaluation, the domain experts assessed the feasibility and technology readiness level (TRL) of the DSS model.

Results

The SOMNet, combined with the EbCA, effectively processed evidence-based information when analysing system outliers, explaining global and local patterns, and refining key performance indicators with their analytical interpretations. The evaluation results showed that the DSS model was feasible by the domain experts and reached level 7 of the TRL (system prototype demonstration in operational environment).

Conclusions

This study supports the benefits of combining health systems engineering (SOMNet) and expert knowledge (EbCA) to analyse the complexity of health systems research. The use of the SOMNet approach contributes to the demonstration of DSS for mental health planning in practice.

Electronic supplementary material

The online version of this article (10.1186/s12961-018-0308-y) contains supplementary material, which is available to authorized users.

Geographic variations in involuntary care and associations with the supply of health and social care: results from a nationwide study

Background

Involuntary psychiatric care remains controversial. Geographic disparities in its use can challenge the appropriateness of the care provided when they do not result from different health needs of the population. These disparities should be reduced through dedicated health policies. However, their association with the supply of health and social care, which could be targeted by such policies, has been insufficiently studied. Our objectives were therefore to describe geographic variations in involuntary admission rates across France and to identify the characteristics of the supply of care which were associated with these variations.

Methods

Involuntary admission rate per 100,000 adult inhabitants was calculated in French psychiatric sectors’ catchment areas using 2012 data from the national psychiatric discharge database. Its variations were first described numerically and graphically. Several factors potentially associated with these variations were then considered in a negative binomial regression with an offset term accounting for the size of catchment areas. They included characteristics of the supply of care (public and private care, health and social care, hospital and community-based care, specialised and non-specialised care) as well as adjustment factors related to epidemiological characteristics of the population of each sector’s catchment area and its level of urbanization. Such variables were extracted from complementary administrative databases. Supply characteristics associated with geographic variations were identified using a significance level of 0.05.

Results

Significant variations in involuntary admission rates were observed between psychiatric sectors’ catchment areas with a coefficient of variation close to 80%. These variations were associated with some characteristics of the supply of health and social care in the sectors’ catchment areas. Notably, an increase in the availability of community-based private psychiatrists and the capacity of housing institutions for disabled individuals was associated with a decrease in involuntary admission rates while an increase in the availability of general practitioners was associated with an increase in those rates.

Conclusions

There is evidence of considerable variations in involuntary admission rates between psychiatric sectors’ catchment areas. Our results provide lines of thoughts to reduce such variations, in particular by supporting an increase in the availability of upstream and downstream care in the community.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3064-3) contains supplementary material, which is available to authorized users.

What Works? Toward a New Classification System for Mental Health Supported Accommodation Services: The Simple Taxonomy for Supported Accommodation (STAX-SA)

Inconsistent terminology and variation in service models have made synthesis of the supported accommodation literature challenging. To overcome this, we developed a brief, categorical taxonomy that aimed to capture the defining features of different supported accommodation models: the simple taxonomy for supported accommodation (STAX-SA). Data from a previous review of existing classification systems were used to develop the taxonomy structure. After initial testing and amendments, the STAX-SA and an existing taxonomy were applied to 132 supported accommodation service descriptions drawn from two systematic reviews and their performance compared. To assess external validity, the STAX-SA was distributed to a sample of supported accommodation managers in England and they were asked to use it to classify their services. The final version of the STAX-SA comprised of five supported accommodation 'types', based on four domains; Staffing location; Level of support; Emphasis on move-on; and Physical setting. The STAX-SA accurately categorized 71.1% (n = 94) of service descriptions, outperforming the comparison tool, and was not affected by publication date or research design. The STAX-SA effectively discriminated between 'real world' service models in England and 53.2% (n = 17) of service managers indicated that the taxonomy was 'Very effective' or 'Extremely effective' in capturing key characteristics of their service. The STAX-SA is an effective tool for classifying supported accommodation models and represents a promising approach to synthesizing the extant effectiveness literature. The authors recommend the development of reporting guidelines for future supported accommodation publications to facilitate comparison between models.