Outcome measures for oral health based on clinical assessments and claims data: feasibility evaluation in practice

Oral Health Outcome Measures: A Feasibility Evaluation

OBJECTIVES

Outcomes of oral health care must be measured and analysed to improve oral health care delivery, outcomes, and quality. This study aims to develop and test outcome measures for the needs of oral health organisers and explore their feasibility using clinical data.

METHODS

Based on the literature review and oral health advisory board, outcome measures for oral health care were identified, developed, and tested. Data from 425,000 clinical examinations were obtained from the clinical records of 8 public oral care providers in Finland.

RESULTS

The advisory board selected 7 outcome measures: 1 on oral self-care, 2 on periodontitis, 3 on caries, and 1 on missing teeth. A large variation was found in the diagnostic and data entry practices of these outcome measures. The coverage of caries and missing teeth entries was good, but the quality of initial and remineralised caries entries was questionable. The caries and missing teeth measures show statistically significant differences amongst some providers.

CONCLUSIONS

The measures "new cavitated caries surfaces," "cavity-free clinical examinations," and "the change in the missing value" were evaluated as feasible. The results of these measures provided insight about the effectiveness of oral care and enabled the comparison between the providers and age groups. Statistically significant differences between the providers in the measures imply potential possibilities for providers to learn from each other.

Development of quality measures to assess tooth decay outcomes from electronic health record data

OBJECTIVES

To develop outcomes of care quality measures derived from the dental electronic health record (EHR) to assess the occurrence and timely treatment of tooth decay.

METHODS

Quality measures were developed to assess whether decay was treated within 6 months and if new decay occurred in patients seen. Using EHR-derived data of the state of each tooth surface, algorithms compared the patient's teeth at different dates to determine if decay was treated or new decay had occurred. Manual chart reviews were conducted at three sites to validate the measures. The measures were implemented and scores were calculated for three sites over four calendar years, 2016 through 2019.

RESULTS

About 954 charts were manually reviewed for the timely treatment of tooth decay measure, with measure performance of sensitivity 97%, specificity 85%, positive predictive value (PPV) 91%, negative predictive value (NPV) 95%. About 739 charts were reviewed for new decay measure, with sensitivity 94%, specificity 99%, PPV 99%, and NPV 94%. Across all sites and years, 52.8% of patients with decay were fully treated within 6 months of diagnosis (n = 247,959). A total of 23.8% of patients experienced new decay, measured at an annual exam (n = 640,004).

CONCLUSION

Methods were developed and validated for assessing timely treatment of decay and occurrence of new decay derived from EHR data, creating effective outcome measures. These EHR-based quality measures produce accurate and reliable results that support efforts and advancement in quality assessment, quality improvement, patient care and research.

Development of a competency-based clinical assessment instrument for exit level Oral Hygiene students at the University of Western Cape

Seminal to the process of a health sciences curriculum evaluation is the periodic review of clinical assessment instruments that measure competency. An assessment of quality is facilitated by using a well-structured, authentic and reliable instrument. This process rests on designing and measuring the instrument against a sound framework and validating it for scientific merit. This paper documents the pedagogy and the process taken in developing an improved formative competency-based assessment instrument for the final year students of the Bachelor of Oral Health program (BOH) at the University of the Western Cape (UWC).

Methods: A qualitative research study design employing the Nominal Group Technique (NGT) was used as a method for gaining small group consensus on the clinical assessment instrument for exit level Oral Hygiene (BOH3) students within the parameters of assessment principles. The key contributors to the instrument development process were the academic staff of the Department of Oral Hygiene, involved in clinical teaching and assessment of student competency.

Results: The domains of ethics and professionalism, patient assessment, diagnosis, treatment planning and implementation was identified as the core elements in the assessment. The principles of assessment, which include, alignment with outcomes, feedback, transparency and validity, were used to guide the instrument development. The assessment criteria were cross examined for alignment to the learning outcomes of the module and the program whilst formative feedback was foregrounded as a central feature to support student learning and progress monitoring. Transparency was obtained by providing students access to the instrument before and after the assessment including the written feedback on their performance. The instrument embodied a range of criteria to be assessed rather than on the awarding of a cumulative score. This allowed for the identification of the criteria or domain within which a student is struggling or excelling. Consensus on the instrument design was achieved using the NGT phases throughout the instrument development process including the weighting of the domains and grading. This level of engagement together with the application of scientifically sound assessment principles contributed to the validation of the instrument.

Conclusion: The development of a competency-based assessment instrument was the result of a structured, collaborative and scientifically engaged process framed around specific assessment principles. The process culminated in the development of a formative competency-based clinical assessment instrument that was fit for purpose in the Bachelor of Oral Health program.

The Nominal Group Technique served to be a valuable approach for small group consensus in developing the instrument. It served to promote individual perspectives and to generate debate and group discussion between academics that were proficient in clinical teaching and, finally to facilitate group consensus on the instrument structure and system for administration.

Dental Anxiety and Oral-Health-Related Quality of Life among Rural Community-Dwelling Older Adults

Aim: This study aimed to investigate the association between dental anxiety (DA) and oral-health-related quality of life (OHRQoL) among rural community-dwelling older adults. Methods: A cross-sectional descriptive study was conducted among 390 rural community-dwelling older adults attending outpatient clinics of the Damanhur National Medical Institute during the year 2021. Three instruments were used: a demographic and clinical data structured interview schedule, Modified Dental Anxiety Scale (MDAS), and the Oral Health Impact Profile (OHIP-5) questionnaire. All statistical analyses were considered significant at a p-value of ≤0.001. Results: The main results showed that the prevalence of DA among participants was 90.5%, and 66.9% of the studied elderly population were either extremely (phobic) or very anxious. Moreover, a significant association was found between older adults’ DA and their OHRQoL (p ˂ 0.001). Conclusions: It was concluded that DA represents a common problem among rural community-dwelling older adults and is a predictor for poor OHRQoL. Raising community awareness about the importance of oral health and implementing measures to avoid DA through specialized community campaigns is recommended, particularly in rural areas.

Frequency of Four-dimensional Oral Health Problems across Dental Fields - a Comparative Survey of Slovenian and International Dentists

Objectives

To compare the frequency of patients’ oral health problems and prevention needs among Slovenian and international dentists with the aim to validate the four oral health-related quality of life (OHRQoL) dimensions across six clinical dental fields in all World Health Organization (WHO) regions.

Methods

An anonymous electronic survey in the English language was designed using Qualtrics software. A probability sampling for Slovenia and a convenience sampling strategy for dentist recruitment was applied for 31 countries. Dentists engaged in six dental fields were asked to categorize their patients’ oral health problems and prevention needs into the four OHRQoL dimensions (Oral Function, Orofacial Pain, Orofacial Appearance, and Psychosocial Impact). Proportions of patients’ problems and prevention needs were calculated together with the significance of Slovenian and international dentists’ differences based on dental fields and WHO regions.

Results

Dentists (n=1,580) from 32 countries completed the survey. There were 223 Slovenian dentists (females: 68%) with a mean age (SD) of 41 (10.6) years and 1,358 international dentists (females: 51%) with a mean age (SD) of 38 (10.4). Pain-related problems and prevention needs were the most prevalent among all six dental fields reported by dentists; Slovenian (37%) and 31 countries (45%). According to Cohen, differences between Slovenia, the broader European Region, and 31 countries were considered non-significant (<0.1).

Conclusion

According to the dentists’ responses, the frequency of patients’ oral health problems and prevention needs are proportionate between Slovenia and 31 countries, regionally and globally. The four OHRQoL dimensions can be considered universal across all dental fields.

The relationship between claimed restorations and future restorations in children and adolescents: An observational follow-up study on risk categories for dental caries

Various models are available to assess caries risk in individuals. In general past caries experience is considered as the best single predictor for future caries development in populations. Likewise, recent restorations have been used to predict future restorations. We aimed to evaluate a classification model for risk categories for dental caries in children based on claims data from Dutch healthcare insurance company Zilveren Kruis. The baseline caries risk categories were derived from the number of claimed restorations in two baseline years (2010 through 2011). These categories were defined as low (no new restorations), moderate (1 new restoration), and high (2 or more new restorations). First, we analyzed the relationship between baseline caries risk categories and the number of new restorations during 3 years of follow-up (2012 through 2014). Secondly, we used negative binominal two-level analyses to determine the accuracy of our classification model in predicting new restorations during follow-up. Thirdly, we reclassified the participants after 3 years and determined the changes in the categorization. We included insurance claims data for the oral healthcare services in 28,305 children and adolescents from 334 dental practices for the period 2010–2014. At baseline, 68% of the participants were in risk category low, 13% in moderate and 19% in high. The mean number of new restorations during follow-up was 0.81 (SD 1.72) in baseline risk category low, 1.61 (SD 2.35) in moderate, and 2.65 (SD 3.32) in high. The accuracy of the multivariate model for predicting 0/>0 restorations was 50%. After 3 years, 60% of the study participants were in the same risk category, 20% were in a lower, and 21% in a higher risk category. Risk categories based on claimed restorations were related to the number of new restorations in groups. As such, they could support planning and evaluation of oral healthcare services.

Usage and Scientific Properties of the ADVOCATE Oral Health Care Measures

BACKGROUND

Feedback information about the quality of oral health care is important for reflective learning by oral health care professionals and the wider health system. To this end, a list of 48 topics describing oral health and oral health care was recently agreed as part of the EU H2020 ADVOCATE project.

OBJECTIVE

This article reports on the formulation of measures based on the ADVOCATE topics and provides information on usage, reporting, validity, and reliability of the measures.

METHODS

The AIRE instrument was used to guide the methodological approach adopted. The appropriateness of the measures was tested among 39 general dental practitioners (GDPs) in Denmark, Germany, and the Netherlands. Data were collected from a convenience sample of patients via a questionnaire deployed in an online application in their practice. Feasibility, acceptability, and usefulness of the measures were evaluated through focus group interviews with GDPs. Face validity and test-retest reliability of the measures were assessed.

RESULTS

For 46 of the 48 topics, a measure could be defined by constructing a definition and a numerator and denominator. Data collection for all 46 measures was feasible and acceptable for patients using the online questionnaire. The practicalities of using claims data for the purpose of giving feedback to individual and groups of GDPs proved to be challenging in terms of timely access of such data, the granularity of the data, and matching the content of the data with the consented items on quality of oral health care. Face validity was considered appropriate, as the patients found the questionnaire easy to understand. Test-retest reliability was found to be acceptable for 36 of 46 measures.

CONCLUSION

The broad range of the ADVOCATE oral health care measures could make a useful contribution to a more transparent, evidence-based, and patient-centered oral health care system.

KNOWLEDGE TRANSFER STATEMENT

This study shows the usage, reliability, and validity of 46 oral health care measures. The measures, which include patient experience and health behaviors, were found to be useful to stimulate discussions about clinical practice. The measures can provide essential information for quality improvement strategies and useful and relevant feedback information for GDPs.

Adults' dental treatment in 2001-2013 in Finnish public dental service

BACKGROUND

All adults over 17 years of age have access to the Public Dental Service after the Finnish Dental Care Reform in 2001-2002. This study aimed to survey the treatment needs and treatment measures provided for adult patients and changes in these during the period 2001-2013.

METHODS

Sing each person's unique identifier, demographic data on dental visits during the period 2001-2013 were collected from municipal databases in five PDS-units covering 320,000 inhabitants. The numbers of visitors, those in need of basic periodontal or caries treatment (CPI > 2 and D + d > 0) were calculated for three age groups. Treatment provided was also calculated in 13 treatment categories. Trend analyses were performed to study changes during the study period.

RESULTS

Restorative treatments (968,772; 23.6%), examinations (658,394; 16.1%), radiographs taken (529,875; 12.9%) anaesthesia used (521,169; 12.7%) and emergency treatments (348,229; 8.5%) made up 73.8% of all treatment measures during the entire study period. Periodontal treatment (7.8%) and caries prevention (3.9%) made up a small part of the care provided and prosthetics and treatment of TMJ disorders were extremely uncommon (fewer than 1%). Treatments related to caries (restorative treatment, examinations, endodontics, emergencies, anaesthesia and radiographs) made up 60.4% of the dental personnel's treatment time. During the study period, statistically significant increasing trends were found for radiographs (p < 0.001***), anaesthesia (p = 0.003**) and total number of treatments (p = 0.009**). There was a slight decreasing trend in treatment need among the youngest adults (18-39 years; p = 0.033*).

CONCLUSION

Compared with the results of national epidemiological studies, insufficient periodontal treatment is provided and prosthetic treatment is almost totally neglected in the PDS. Rather, adults' dental treatment concentrates on treatment of caries. The unmet needs may be due to tradition, inadequate treatment processes or a lack of resources or failed salary incentives.

Reexamining dental outreach programs: A model for local empowerment and sustainable development

BACKGROUND

To address the inadequacy of oral health care in developing nations, outreach programs have facilitated the provision of dental services by foreign volunteers to areas of need. However, the effectiveness of the current aid model on the long-term well-being of the recipient population and sustainability of efforts remains uncertain. The authors examine the strengths and areas of improvement of outreach initiatives to inform a reorientation of the aid model.

METHODS

The authors conducted a PubMed search and reviewed included articles to assess the current limitations and recommended strategies for outreach programs. The identified limitations and strategies were sorted into 4 key areas of change and organized using the Theory of Change framework to inform an improved aid model.

RESULTS

The current aid models were found to have limitations in scope and coverage, interventions that were not applicable or integrated into local systems, and an inadequate evidence base. To address these limitations, efforts should be directed at the capacity building of local workers through individual training and evidence-based interventions, improved understanding of local contexts, and integration and alignment with local systems.

CONCLUSIONS

The empowerment of local communities is critical in ensuring an effective and sustainable aid model in developing nations.

PRACTICAL IMPLICATIONS

By adopting an improved aid model, outreach programs can enhance the long-term access and availability of quality oral health care that is delivered by local providers and communities.

Perspectives of general dental practitioners on preventive, patient-centred, and evidence-based oral healthcare-A Q-methodology study

Objective

In the last 30 years, innovations in oral healthcare (OHC), such as advanced restorative techniques, shifts towards preventive and evidence-based care and changes in patients’ expectations, have increased the complexity of clinical decision-making in OHC. Little is known about the perspectives of general dental practitioners (GDPs) on the value of providing preventive, patient-centred and evidence-based OHC. This study aimed to explore the range of perspectives present amongst GDPs on OHC.

Method

Q-methodology was used to explore perspectives among 78 GDPs working in the Netherlands. Participants were asked to sort 50 statements representing three central domains in OHC: i.) restorative versus preventative OHC, ii.) disease-centred versus patient-centred OHC and iii.) expertise-based versus evidence-based OHC. Opinion statements about delivering OHC were formulated on the basis of published literature and input from OHC professionals. By-person factor analysis was used to reveal clusters of communality in statement rankings, which were interpreted and formed perspectives on OHC.

Results

Four perspectives, explaining 47% of variance, on OHC were identified amongst GDPs: ‘the patient-focused dentist who values prevention’, ‘the outcome-oriented dentist who values learning from colleagues’, ‘the team player with ultimate care responsibility’ and ‘the dentist who considers oral health the responsibility of the patient.’

Conclusion

Q-methodology can be effectively used to describe the different perspectives that GDPs have on the challenges of preventive, patient-centred and evidence-based OHC. GDPs should not be seen as a homogenous group; rather they have different views and approaches to the care they provide. This has implications for health systems; awareness of the heterogeneity of practitioners’ perspectives can potentially be used to develop bespoke quality of care improvement strategies that constructively engage with each of these different groups.

Improving oral healthcare using academic detailing - design of the ADVOCATE Field Studies

Background: Academic detailing (AD) is a defined form of educational outreach that can be deployed to intrinsically motivate practitioners towards improving quality of care. This paper describes the design of the ADVOCATE Field Studies. This proof of concept study aims to evaluate the feasibility, acceptability and usefulness of AD, reinforced with feedback information to promote prevention-oriented, patient-centred and evidence-based oral healthcare delivery by general dental practitioners (GDPs). Methods: Six groups of GDPs will be recruited; two groups of six to eight GDPs in each of three countries - the Netherlands, Germany and Denmark. GDPs will meet for four Academic Detailing Group (ADG) meetings for open discussions using comparative feedback data to stimulate debate about their dental practice performance and care delivery. Group meetings will be moderated using the AD methodology. Qualitative data will be collected through focus group interviews, an online discussion forum, field notes and debriefs of ADG meetings and analysed by conventional content analysis using MaxQDA software. Discussion: The results of the study will provide novel information on the feasibility, perceived acceptability and usefulness of AD and feedback data for GDPs to improve oral healthcare delivery.

Children and adolescents´ dental treatment in 2001-2013 in the Finnish public dental service

Background

The Public Dental Service (PDS) in Finland has catered for the overwhelming majority of the young for more than 50 years. They have had examinations, preventive measures and all other necessary treatment free of charge. This study aimed to survey the treatment needs and treatment measures provided for children and adolescents and changes in these during the period 2001–2013.

Methods

Using each person’s unique identifier, data on patients (< 18 years), their oral health (CPI > 2, D + d > 0) and treatment received in the period 2001–2013 were collected retrospectively from municipal databases in five PDS-units covering 320,000 inhabitants. The National Institute for Health and Welfare gave ethical approval. Permission to use local data was received from the Directors in the PDS units. Treatment measures were grouped into 14 categories and patients into three age categories (0–6 years, 7–13 years and 14–17 years). Trend analysis was used to test changes over time.

Results

About 40,000 children and adolescents visited the PDS each year and 2,488,805 treatment measures were provided for them during the entire study period. The proportion of those in need of treatment decreased from 44.4 to 33.2% during the study period. The most common treatment categories were examinations (613,753, 24.7%), orthodontics (499,033, 20.1%), preventive measures (372,473, 15.0%) and restorative treatment (355,325, 14.3%); these made up 74% of all treatment measures. During the study period, statistically highly significant (p < 0.001***) increasing trends were found for examinations, anaesthesia and the total number of treatment measures, and a significant (p < 0.001***) decreasing trend in restorative treatment were found for all the young. More preventive treatment measures were provided for those not in need of treatment compared with those in need of treatment.

Conclusion

Although children’s oral health had improved and restorative treatment provided had decreased, the total number of treatment measures increased. Healthy children received frequent examinations and high numbers of preventive treatment measures. Targeting treatment according to needs was not satisfactory.

Quality measures for dental care: A systematic review

Objectives

This systematic review aimed to (a) provide an overview of existing quality measures in the field of oral health care, and to (b) evaluate the scientific soundness and applicability of these quality measures.

Methods

A systematic search was conducted in three electronic databases MEDLINE (via PubMed), EMBASE (via OVID) and LILACS (via BIREME). The search was restricted to articles published between 2002 and 2018. Publications reporting on the development process or clinimetric properties of oral health care quality measures for outpatient oral health care in dental practices were included. The identified publications reporting on oral health care quality measures were critically appraised with the Appraisal of Indicators through Research and Evaluation 2.0 (AIRE 2.0) instrument to evaluate the soundness and applicability of the measures.

Results

The search strategy resulted in 2541 unique and potentially relevant articles. In total, 24 publications were included yielding 215 quality measures. The critical appraisal showed a large variation in the quality of the included publications (AIRE scores ranging from 38 to 78 out of 80 possible points). The majority of measures (n = 71) referred to treatment and preventive services. Comparably, few measures referred to the domain patient safety (n = 3). The development process of measures often exhibited a lack of involvement of patients and dental professionals. Few projects reported on the validity (n = 2) and reliability (n = 3) of the measures. Four projects piloted the measures for implementation in practice.

Conclusions

This systematic review provides an overview of the status quo with respect to existing quality measures in oral health care. Potential opportunities include the piloting and testing of quality measures and the establishment of suitable information systems that allow the provision of transparent routine feedback on the quality of oral health care.