Families' healthcare experiences for children with inherited metabolic diseases: protocol for a mixed methods cohort study

INTRODUCTION

Children with inherited metabolic diseases (IMDs) often have complex and intensive healthcare needs and their families face challenges in receiving high-quality, family centred health services. Improvement in care requires complex interventions involving multiple components and stakeholders, customised to specific care contexts. This study aims to comprehensively understand the healthcare experiences of children with IMDs and their families across Canada.

METHODS AND ANALYSIS

A two-stage explanatory sequential mixed methods design will be used. Stage 1: quantitative data on healthcare networks and encounter experiences will be collected from 100 parent/guardians through a care map, 2 baseline questionnaires and 17 weekly diaries over 5-7 months. Care networks will be analysed using social network analysis. Relationships between demographic or clinical variables and ratings of healthcare experiences across a range of family centred care dimensions will be analysed using generalised linear regression. Other quantitative data related to family experiences and healthcare experiences will be summarised descriptively. Ongoing analysis of quantitative data and purposive, maximum variation sampling will inform sample selection for stage 2: a subset of stage 1 participants will participate in one-on-one videoconference interviews to elaborate on the quantitative data regarding care networks and healthcare experiences. Interview data will be analysed thematically. Qualitative and quantitative data will be merged during analysis to arrive at an enhanced understanding of care experiences. Quantitative and qualitative data will be combined and presented narratively using a weaving approach (jointly on a theme-by-theme basis) and visually in a side-by-side joint display.

ETHICS AND DISSEMINATION

The study protocol and procedures were approved by the Children's Hospital of Eastern Ontario's Research Ethics Board, the University of Ottawa Research Ethics Board and the research ethics boards of each participating study centre. Findings will be published in peer-reviewed journals and presented at scientific conferences.

Direct composite resin fillings versus amalgam fillings for permanent posterior teeth

BACKGROUND

Traditionally, amalgam has been used for filling cavities in posterior teeth, and it continues to be the restorative material of choice in some low- and middle-income countries due to its effectiveness and relatively low cost. However, there are concerns over the use of amalgam restorations (fillings) with regard to mercury release in the body and the environmental impact of mercury disposal. Dental composite resin materials are an aesthetic alternative to amalgam, and their mechanical properties have developed sufficiently to make them suitable for restoring posterior teeth. Nevertheless, composite resin materials may have potential for toxicity to human health and the environment. The United Nations Environment Programme has established the Minamata Convention on Mercury, which is an international treaty that aims "to protect the [sic] human health and the environment from anthropogenic emissions and releases of mercury and mercury compounds". It entered into force in August 2017, and as of February 2021 had been ratified by 127 governments. Ratification involves committing to the adoption of at least two of nine proposed measures to phase down the use of mercury, including amalgam in dentistry. In light of this, we have updated a review originally published in 2014, expanding the scope of the review by undertaking an additional search for harms outcomes. Our review synthesises the results of studies that evaluate the long-term effectiveness and safety of amalgam versus composite resin restorations, and evaluates the level of certainty we can have in that evidence.

OBJECTIVES

To examine the effects (i.e. efficacy and safety) of direct composite resin fillings versus amalgam fillings.

SEARCH METHODS

An information specialist searched five bibliographic databases up to 16 February 2021 and used additional search methods to identify published, unpublished and ongoing studies SELECTION CRITERIA: To assess efficacy, we included randomised controlled trials (RCTs) comparing dental composite resin with amalgam restorations in permanent posterior teeth that assessed restoration failure or survival at follow-up of at least three years. To assess safety, we sought non-randomised studies in addition to RCTs that directly compared composite resin and amalgam restorative materials and measured toxicity, sensitivity, allergy, or injury.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane.

MAIN RESULTS

We included a total of eight studies in this updated review, all of which were RCTs. Two studies used a parallel-group design, and six used a split-mouth design. We judged all of the included studies to be at high risk of bias due to lack of blinding and issues related to unit of analysis. We identified one new trial since the previous version of this review (2014), as well as eight additional papers that assessed safety, all of which related to the two parallel-group studies that were already included in the review. For our primary meta-analyses, we combined data from the two parallel-group trials, which involved 1645 composite restorations and 1365 amalgam restorations in 921 children. We found low-certainty evidence that composite resin restorations had almost double the risk of failure compared to amalgam restorations (risk ratio (RR) 1.89, 95% confidence interval (CI) 1.52 to 2.35; P < 0.001), and were at much higher risk of secondary caries (RR 2.14, 95% CI 1.67 to 2.74; P < 0.001). We found low-certainty evidence that composite resin restorations were not more likely to result in restoration fracture (RR 0.87, 95% CI 0.46 to 1.64; P = 0.66). Six trials used a split-mouth design. We considered these studies separately, as their reliability was compromised due to poor reporting, unit of analysis errors, and variability in methods and findings. Subgroup analysis showed that the findings were consistent with the results of the parallel-group studies. Three trials investigated possible harms of dental restorations. Higher urinary mercury levels were reported amongst children with amalgam restorations in two trials, but the levels were lower than what is known to be toxic. Some differences between amalgam and composite resin groups were observed on certain measures of renal, neuropsychological, and psychosocial function, physical development, and postoperative sensitivity; however, no consistent or clinically important harms were found. We considered that the vast number of comparisons made false-positive results likely. There was no evidence of differences between the amalgam and composite resin groups in neurological symptoms, immune function, and urinary porphyrin excretion. The evidence is of very low certainty, with most harms outcomes reported in only one trial.

AUTHORS' CONCLUSIONS

Low-certainty evidence suggests that composite resin restorations may have almost double the failure rate of amalgam restorations. The risk of restoration fracture does not seem to be higher with composite resin restorations, but there is a much higher risk of developing secondary caries. Very low-certainty evidence suggests that there may be no clinically important differences in the safety profile of amalgam compared with composite resin dental restorations. This review supports the utility of amalgam restorations, and the results may be particularly useful in parts of the world where amalgam is still the material of choice to restore posterior teeth with proximal caries. Of note, however, is that composite resin materials have undergone important improvements in the years since the trials informing the primary analyses for this review were conducted. The global phase-down of dental amalgam via the Minamata Convention on Mercury is an important consideration when deciding between amalgam and composite resin dental materials. The choice of which dental material to use will depend on shared decision-making between dental providers and patients in the clinic setting, and local directives and protocols.

Evidence summaries: the evolution of a rapid review approach

BACKGROUND

Rapid reviews have emerged as a streamlined approach to synthesizing evidence - typically for informing emergent decisions faced by decision makers in health care settings. Although there is growing use of rapid review 'methods', and proliferation of rapid review products, there is a dearth of published literature on rapid review methodology. This paper outlines our experience with rapidly producing, publishing and disseminating evidence summaries in the context of our Knowledge to Action (KTA) research program.

METHODS

The KTA research program is a two-year project designed to develop and assess the impact of a regional knowledge infrastructure that supports evidence-informed decision making by regional managers and stakeholders. As part of this program, we have developed evidence summaries - our form of rapid review - which have come to be a flagship component of this project. Our eight-step approach for producing evidence summaries has been developed iteratively, based on evidence (where available), experience and knowledge user feedback. The aim of our evidence summary approach is to deliver quality evidence that is both timely and user-friendly.

RESULTS

From November 2009 to March 2011 we have produced 11 evidence summaries on a diverse range of questions identified by our knowledge users. Topic areas have included questions of clinical effectiveness to questions on health systems and/or health services. Knowledge users have reported evidence summaries to be of high value in informing their decisions and initiatives. We continue to experiment with incorporating more of the established methods of systematic reviews, while maintaining our capacity to deliver a final product in a timely manner.

CONCLUSIONS

The evolution of the KTA rapid review evidence summaries has been a positive one. We have developed an approach that appears to be addressing a need by knowledge users for timely, user-friendly, and trustworthy evidence and have transparently reported these methods here for the wider rapid review and scientific community.

Reporting guidelines for survey research: an analysis of published guidance and reporting practices

BACKGROUND

Research needs to be reported transparently so readers can critically assess the strengths and weaknesses of the design, conduct, and analysis of studies. Reporting guidelines have been developed to inform reporting for a variety of study designs. The objective of this study was to identify whether there is a need to develop a reporting guideline for survey research.

METHODS AND FINDINGS

We conducted a three-part project: (1) a systematic review of the literature (including "Instructions to Authors" from the top five journals of 33 medical specialties and top 15 general and internal medicine journals) to identify guidance for reporting survey research; (2) a systematic review of evidence on the quality of reporting of surveys; and (3) a review of reporting of key quality criteria for survey research in 117 recently published reports of self-administered surveys. Fewer than 7% of medical journals (n = 165) provided guidance to authors on survey research despite a majority having published survey-based studies in recent years. We identified four published checklists for conducting or reporting survey research, none of which were validated. We identified eight previous reviews of survey reporting quality, which focused on issues of non-response and accessibility of questionnaires. Our own review of 117 published survey studies revealed that many items were poorly reported: few studies provided the survey or core questions (35%), reported the validity or reliability of the instrument (19%), defined the response rate (25%), discussed the representativeness of the sample (11%), or identified how missing data were handled (11%).

CONCLUSIONS

There is limited guidance and no consensus regarding the optimal reporting of survey research. The majority of key reporting criteria are poorly reported in peer-reviewed survey research articles. Our findings highlight the need for clear and consistent reporting guidelines specific to survey research.

Decision aids for people facing health treatment or screening decisions

BACKGROUND

Decision aids prepare people to participate in 'close call' decisions that involve weighing benefits, harms, and scientific uncertainty.

OBJECTIVES

To conduct a systematic review of randomised controlled trials (RCTs) evaluating the efficacy of decision aids for people facing difficult treatment or screening decisions.

SEARCH STRATEGY

We searched MEDLINE (Ovid) (1966 to July 2006); Cochrane Central Register of Controlled Trials (CENTRAL, The Cochrane Library; 2006, Issue 2); CINAHL (Ovid) (1982 to July 2006); EMBASE (Ovid) (1980 to July 2006); and PsycINFO (Ovid) (1806 to July 2006). We contacted researchers active in the field up to December 2006. There were no language restrictions.

SELECTION CRITERIA

We included published RCTs of interventions designed to aid patients' decision making by providing information about treatment or screening options and their associated outcomes, compared to no intervention, usual care, and alternate interventions. We excluded studies in which participants were not making an active treatment or screening decision, or if the study's intervention was not available to determine that it met the minimum criteria to qualify as a patient decision aid.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened abstracts for inclusion, and extracted data from included studies using standardized forms. The primary outcomes focused on the effectiveness criteria of the International Patient Decision Aid Standards (IPDAS) Collaboration: attributes of the decision and attributes of the decision process. We considered other behavioural, health, and health system effects as secondary outcomes. We pooled results of RCTs using mean differences (MD) and relative risks (RR) using a random effects model.

MAIN RESULTS

This update added 25 new RCTs, bringing the total to 55. Thirty-eight (69%) used at least one measure that mapped onto an IPDAS effectiveness criterion: decision attributes: knowledge scores (27 trials); accurate risk perceptions (11 trials); and value congruence with chosen option (4 trials); and decision process attributes: feeling informed (15 trials) and feeling clear about values (13 trials).This review confirmed the following findings from the previous (2003) review. Decision aids performed better than usual care interventions in terms of: a) greater knowledge (MD 15.2 out of 100; 95% CI 11.7 to 18.7); b) lower decisional conflict related to feeling uninformed (MD -8.3 of 100; 95% CI -11.9 to -4.8); c) lower decisional conflict related to feeling unclear about personal values (MD -6.4; 95% CI -10.0 to -2.7); d) reduced the proportion of people who were passive in decision making (RR 0.6; 95% CI 0.5 to 0.8); and e) reduced proportion of people who remained undecided post-intervention (RR 0.5; 95% CI 0.3 to 0.8). When simpler decision aids were compared to more detailed decision aids, the relative improvement was significant in knowledge (MD 4.6 out of 100; 95% CI 3.0 to 6.2) and there was some evidence of greater agreement between values and choice.In this review, we were able to explore the use of probabilities in decision aids. Exposure to a decision aid with probabilities resulted in a higher proportion of people with accurate risk perceptions (RR 1.6; 95% CI 1.4 to 1.9). The effect was stronger when probabilities were measured quantitatively (RR 1.8; 95% CI 1.4 to 2.3) versus qualitatively (RR 1.3; 95% CI 1.1 to 1.5).As in the previous review, exposure to decision aids continued to demonstrate reduced rates of: elective invasive surgery in favour of conservative options, decision aid versus usual care (RR 0.8; 95% CI 0.6 to 0.9); and use of menopausal hormones, detailed versus simple aid (RR 0.7; 95% CI 0.6 to 1.0). There is now evidence that exposure to decision aids results in reduced PSA screening, decision aid versus usual care (RR 0.8; 95% CI 0.7 to 1.0) . For other decisions, the effect on decisions remains variable.As in the previous review, decision aids are no better than comparisons in affecting satisfaction with decision making, anxiety, and health outcomes. The effects of decision aids on other outcomes (patient-practitioner communication, consultation length, continuance, resource use) were inconclusive.There were no trials evaluating the IPDAS decision process criteria relating to helping patients to recognize a decision needs to be made, understand that values affect the decision, or discuss values with the practitioner.

AUTHORS' CONCLUSIONS

Patient decision aids increase people's involvement and are more likely to lead to informed values-based decisions; however, the size of the effect varies across studies. Decision aids have a variable effect on decisions. They reduce the use of discretionary surgery without apparent adverse effects on health outcomes or satisfaction. The degree of detail patient decision aids require for positive effects on decision quality should be explored. The effects on continuance with chosen option, patient-practitioner communication, consultation length, and cost-effectiveness need further evaluation.

Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi)

Objectives

To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).

Design

Scale development study, involving construct, item and scale development, validation and reliability testing.

Setting

There has been increasing use of decision support technologies – adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.

Methods

Scale development study, involving construct, item and scale development, validation and reliability testing.

Participants

Twenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi). In the fourth Stage (reliability study), eight raters assessed thirty randomly selected decision support technologies.

Results

IPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100) for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30), enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68). Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items) was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92).

Conclusions

This work demonstrates that IPDASi has the ability to assess the quality of decision support technologies. The existing IPDASi provides an assessment of the quality of a DST's components and will be used as a tool to provide formative advice to DSTs developers and summative assessments for those who want to compare their tools against an existing benchmark.

Personal stories in publicly available patient decision aids

OBJECTIVE

To characterize the use of personal stories in publicly available patient decision aids (PtDAs).

METHODS

Descriptive study guided by a structured coding taxonomy based on the International Patient Decision Aid Standards, Ottawa Decision Support Framework, Decisional Conflict Scale and qualitative content analysis. Personal story was defined as an illustrative, first-person narrative in any format. Sampling from the 2007 Cochrane A to Z Inventory was stratified by developer and one-third of PtDAs were randomly sampled.

RESULTS

Of 200 publicly available PtDAs from 5 developers, 168 from 3 developers contained stories. A stratified sample of 56 PtDAs contained 260 stories. Thirty of 56 PtDAs presented an equal number of stories favouring or against the most intensive option. Thirty PtDAs described narrators' satisfaction with outcome(s): 21 contained only stories portraying satisfaction; 9 contained stories portraying satisfaction and dissatisfaction.

CONCLUSION

Publicly available PtDAs vary in their use of stories. Most PtDAs balance the number of stories favouring and against the most intensive option presented; most PtDAs do not balance the number of stories portraying satisfaction or dissatisfaction with the outcome(s) of the decision.

PRACTICE IMPLICATIONS

Research is needed to better understand the impact of stories on patient decision making and to inform the guidelines for their inclusion in PtDAs.

Do Patient Decision Aids Meet Effectiveness Criteria of the International Patient Decision Aid Standards Collaboration? A Systematic Review and Meta-analysis

Objective. To describe the extent to which patient decision aids (PtDAs) meet effectiveness standards of the International Patient Decision Aids Collaboration (IPDAS). Data sources. Five electronic databases (to July 2006) and personal contacts (to December 2006). Results. Among 55 randomized controlled trials, 38 (69%) used at least 1 measure that mapped onto an IPDAS effectiveness criterion. Measures of decision quality were knowledge scores (27 trials), accurate risk perceptions (12 trials), and value congruence with the chosen option (3 trials). PtDAs improved knowledge scores relative to usual care (weighted mean difference [WMD] = 15.2%, 95% confidence interval [CI] = 11.7 to 18.7); detailed PtDAs were somewhat more effective than simpler PtDAs (WMD = 4.6%, 95% CI = 3.0 to 6.2). PtDAs with probabilities improved accurate risk perceptions relative to those without probabilities (relative risk = 1.6, 95% CI = 1.4 to 1.9). Relative to simpler PtDAs, detailed PtDAs improved value congruence with the chosen option. Only 2 of 6 IPDAS decision process criteria were measured: feeling informed (15 trials) and feeling clear about values (13 trials). PtDAs improved these process measures relative to usual care (feeling uninformed WMD = —8.4, 95% CI = —11.9 to —4.8; unclear values WMD = —6.3, 95% CI = —10.0 to —2.7). There was no difference in process measures when detailed and simple PtDAs were compared. Conclusions. PtDAs improve decision quality and the decision process's measures of feeling informed and clear about values; however, the size of the effect varies across studies. Several IPDAS decision process measures have not been used. Future trials need to use a minimum data set of IPDAS evaluation measures. The degree of detail PtDAs require for positive effects on IPDAS criteria should be explored.