Development and use of a content search strategy for retrieving studies on patients' views and preferences

Patients' values and preferences for health states in allergic rhinitis-An artificial intelligence supported systematic review

BACKGROUND

Allergic rhinitis (AR) impacts patients' physical and emotional well-being. Assessing patients' values and preferences (V&P) related to AR is an essential part of patient-centered care and of the guideline development process. We aimed to systematically summarize the information about patients' V&P on AR and its symptoms and impact on daily life.

METHODS

We conducted systematic review in a MEDLINE, Embase, PsychInfo, and CINAHL databases. We included studies which quantitatively assessed patients' V&P for specific outcomes in AR by assessing utilities, applying discrete choice approaches, or rating and ranking outcomes. We grouped outcomes as AR symptoms, functional status, and care-related patient experience. Study selection and data extraction were supported by the Laser AI tool. We rated the certainty of evidence (CoE) using the GRADE approach.

RESULTS

Thirty-six studies (41 records) were included: nine utility studies, seven direct-choice studies and 21 studies of rating or ranking outcomes. Utilities were lower with increased AR severity and with the concomitant presence of asthma, but not with whether AR was seasonal or perennial (CoE = low-high). Patients rated AR symptom-related outcomes as more important than those related to care-related patient experience and functional status (CoE = very low-moderate). Nasal symptoms (mainly nasal congestion) followed by breathing disorders, general and ocular symptoms were rated as the symptoms with the highest impact.

CONCLUSIONS

This systematic review provides a comprehensive overview of V&P of patients with AR. Patients generally considered nasal symptoms as the most important. Future studies with standardized methods are needed to provide more information on V&P in AR.

Validation of an interprofessional education search strategy in PubMed to optimize IPE literature searching

Objective

With exponential growth in the publication of interprofessional education (IPE) research studies, it has become more difficult to find relevant literature and stay abreast of the latest research. To address this gap, we developed, evaluated, and validated search strategies for IPE studies in PubMed, to improve future access to and synthesis of IPE research. These search strategies, or search hedges, provide comprehensive, validated sets of search terms for IPE publications.

Methods

The search strategies were created for PubMed using relative recall methodology. The research methods followed the guidance of previous search hedge and search filter validation studies in creating a gold standard set of relevant references using systematic reviews, having expert searchers identify and test search terms, and using relative recall calculations to validate the searches' performance against the gold standard set.

Results

The three recommended search hedges for IPE studies presented had recall of 71.5%, 82.7%, and 95.1%; the first more focused for efficient literature searching, the last with high recall for comprehensive literature searching, and the remaining hedge as a middle ground between the other two options.

Conclusion

These validated search hedges can be used in PubMed to expedite finding relevant scholarships, staying up to date with IPE research, and conducting literature reviews and evidence syntheses.

Minimally Invasive Bleb Surgery for Glaucoma: A Health Technology Assessment

Background

Glaucoma is the term for a group of eye disorders that causes progressive damage to the optic nerve, which can lead to visual impairment and, potentially, irreversible blindness. Minimally invasive bleb surgery (MIBS) reduces eye pressure through the implantation of a device that creates a new subconjunctival outflow pathway for eye fluid drainage. MIBS is a less invasive alternative to conventional/incisional glaucoma surgery (e.g., trabeculectomy). We conducted a health technology assessment of MIBS for people with glaucoma, which included an evaluation of effectiveness, safety, the budget impact of publicly funding MIBS, and patient preferences and values.

Methods

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using the Cochrane Risk of Bias 1.0 tool for randomized controlled trials (RCTs) and the Risk of Bias Assessment tool for Nonrandomized Studies (RoBANS) for comparative observational studies, and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We conducted an economic literature search and we estimated the budget impact of publicly funding MIBS in Ontario. We did not conduct a primary economic evaluation due to the limited long-term effectiveness data. We summarized the preferences and values evidence from previous health technology assessments to understand the perspectives and experiences of patients with glaucoma.

Results

We included 41 studies (2 RCTs and 39 comparative observational studies) in the clinical evidence review. MIBS may reduce intraocular pressure and the number of medications used, but we are uncertain if MIBS results in outcomes similar to trabeculectomy (GRADE: Moderate to Very low). Compared with trabeculectomy, MIBS may result in fewer follow-up visits and interventions, and adverse events (GRADE: Moderate to Very Low). MIBS may also reduce intraocular pressure and the number of antiglaucoma medications used, compared with other glaucoma treatments, but the evidence is uncertain (GRADE: Very low). Our economic evidence review identified two directly applicable studies. The results of these studies indicate that the cost-effectiveness of MIBS is highly uncertain, and the cost of glaucoma interventions are likely to vary across provinces. The annual budget impact of publicly funding MIBS in Ontario ranged from $0.11 million in year 1 to $0.67 million in year 5, for a total 5-year budget impact estimate of $1.93 million. Preferences and values evidence suggests that fear of ultimate blindness and difficulty managing medication for glaucoma led patients to explore other treatment options such as MIBS. Glaucoma patients found minimally invasive glaucoma surgery (MIGS) procedure beneficial, with minimal side effects and recovery time.

Conclusions

Minimally invasive bleb surgery reduces intraocular eye pressure and the number of antiglaucoma medications needed, but we are uncertain if the outcomes are similar to trabeculectomy (GRADE: Moderate to Very low). However, MIBS may be safer than trabeculectomy (GRADE: Moderate to Very low) and result in fewer follow-ups (GRADE: Moderate to Very low). MIBS may also improve glaucoma symptoms compared with other glaucoma treatments, but the evidence is very uncertain (GRADE: Very low).We estimate that publicly funding MIBS would result in an additional cost of $1.93 million over 5 years. Patients who underwent MIGS procedures found them to be generally successful and beneficial, with minimal side effects and recovery time. We could not draw conclusions about specific MIBS procedures or long-term outcomes.

Intrathecal Drug Delivery Systems for Cancer Pain: A Health Technology Assessment

Background

Pain is a common and very distressing symptom for adults and children with cancer. Compared with other routes of delivery, infusing pain medication directly into the intrathecal space around the spinal cord may reduce the incidence of systemic side effects and allow for more rapid and effective pain relief. We conducted a health technology assessment of intrathecal drug delivery systems (IDDSs) for adults and children with cancer pain, which included an evaluation of effectiveness, safety, cost-effectiveness, the budget impact of publicly funding IDDSs, patient preferences and values, and ethical considerations.

Methods

We performed a systematic literature search of the clinical evidence to retrieve systematic reviews, and we selected and reported results from 2 recent reviews that were relevant to our research questions. We complemented the chosen systematic reviews with a literature search to identify primary studies published after December 2020. We used the Risk of Bias in Systematic Reviews (ROBIS) tool to assess the risk of bias of each included systematic review. We assessed the quality of the body of evidence according to the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted a cost-effectiveness analysis comparing IDDSs with standard care (i.e., non-IDDS methods of pain management) from a public payer perspective. We also analyzed the budget impact of publicly funding IDDSs in Ontario. To contextualize the potential value of IDDSs, we spoke with patients with cancer pain and with caregivers of patients with cancer pain. We explored ethical considerations from a review of published literature on the use of IDDSs for the management of cancer pain in adults and children as well as a review of the other components of this health technology assessment to identify ethical considerations relevant to the Ontario context.

Results

We included 2 systematic reviews (1 on adults and 1 on children) in the clinical evidence review. In adults with cancer pain who have a life expectancy greater than 6 months, intrathecal drug delivery was associated with a significant reduction in pain intensity compared with before implantation up to a 1-year follow-up (GRADE: Moderate to Low). Improved pain management appeared to be maintained beyond a 4-week follow-up. IDDSs likely decrease the use of systemic opioids (GRADE: Moderate to Low). They may also improve health-related quality of life (GRADE: Low), functional outcomes (GRADE: Low), and survival (GRADE: Low to Very low). In children with cancer pain, IDDSs may reduce pain intensity, improve functional outcomes, and improve survival, but the evidence is very uncertain (all GRADEs: Very low). IDDS implantation carries certain rare risks related to mechanical errors, drug-related side effects, and surgical complications. There are inherent limitations in conducting research in patients with refractory cancer pain; therefore, it is unlikely that higher-quality evidence will emerge in the next few years. Our primary economic evaluation found that IDDSs are more effective and more costly than standard care. The incremental cost-effectiveness ratio of IDDSs compared with standard care is $57,314 per quality-adjusted life-year (QALY) gained. The probability of IDDSs being cost-effective versus standard care is 43.46% at a willingness-to-pay of $50,000 per QALY gained and 72.54% at a willingness-to-pay of $100,000 per QALY gained. Publicly funding IDDSs in Ontario would cost an additional $0.27 million per year, for a total of $1.34 million over the next 5 years. The patients with cancer pain and caregivers with whom we spoke described the debilitating nature of cancer pain and the difficulty of finding effective pain management options. Patients with experience of an IDDS spoke of its effectiveness and its positive impact on their quality of life and mental health. Implementing IDDSs for patients with cancer pain raises several ethical and equity considerations related to the experiences and management of cancer pain, how limitations in evidence may entail uncertainties in clinical and health system decision-making, as well as clinical, geographic, and health system access barriers.

Conclusions

Intrathecal drug delivery likely reduces pain intensity and decreases the use of systemic opioids in adults with cancer pain who have a life expectancy greater than 6 months. It may also improve health-related quality of life, functional outcomes, and survival, although the evidence for survival is very uncertain. The clinical evidence in children with cancer pain is very uncertain. IDDS implantation is reasonably safe. Intrathecal drug delivery is more effective and more costly than standard care. We estimate that funding IDDSs in Ontario will result in additional costs of $0.27 million per year, for a total of $1.34 million over the next 5 years. Considerations related to funding and implementing IDDSs for patients with cancer pain in Ontario will require explicit and focused attention to considerations of equity and access in the diagnosis and management of cancer pain and in the use, clinical uptake, and delivery of IDDS pain management.

How Do Patients With Type 2 Diabetes Mellitus Value the Importance of Outcomes? An Overview of Reviews

OBJECTIVES

We aimed to assess how patients value the importance of type 2 diabetes mellitus (T2DM) related outcomes.

METHODS

Overview of systematic reviews (SRs) reporting patients' utilities or disutilities for T2DM outcomes. We searched 3 databases from inception until June 2021. Study selection and data extraction were conducted in pairs. We evaluated the quality of SRs with the Joanna Briggs Institute Checklist, and the overlap with the corrected covered area. We estimated descriptive statistics, and, when possible, conducted metanalysis.

RESULTS

We identified 11 SRs, including 119 studies and 70 outcomes. Most reviews were high-quality SRs. The outcomes with the lowest utilities were hypoglycemia with very severe symptoms (acute complications), stroke (macrovascular complications), diabetic peripheral neuropathy with severe pain (microvascular complications), extreme obesity (comorbidities), and insulin only or combined (management of diabetes). Good/excellent glucose control and noninsulin injectable showed higher values than T2DM without complications. The outcomes with the highest disutilities were amputation, depression, major hypoglycemia, stroke, and management using only insulin.

CONCLUSIONS

We provide standardized, reliable utility values (or associated disutilities) for T2DM, acute, microvascular and macrovascular complications, related comorbidities and treatments that may support judgments when making clinical recommendations, designing decision support tools, and developing interventions and economic analysis.

Homologous Recombination Deficiency Testing to Inform Patient Decisions About Niraparib Maintenance Therapy for High-Grade Serous or Endometrioid Epithelial Ovarian Cancer: A Health Technology Assessment

Background

Ovarian cancer affects the cells of the ovaries, and epithelial cancer is the most common type of malignant ovarian cancer. The homologous recombination repair pathway enables error-free repair of DNA double-strand breaks. Damage of key genes associated with this pathway leads to homologous recombination deficiency (HRD), which results in unrepaired DNA and can lead to cancer. Tumours with HRD are believed to be sensitive to treatment with poly-adenosine diphosphate (ADP)-ribose polymerase (PARP) inhibitors, such as niraparib. We conducted a health technology assessment to evaluate the clinical utility and cost-effectiveness of HRD testing to inform patient decisions about the use of niraparib maintenance therapy for patients with high-grade serous or endometrioid epithelial ovarian cancer. We also evaluated the efficacy and safety of niraparib maintenance therapy in patients with HRD or homologous recombination proficiency (HRP), the cost-effectiveness of HRD testing, the budget impact of publicly funding HRD testing, and patient preferences and values.

Methods

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using the Cochrane risk-of-bias tool for randomized trials version 2, and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted a cost-utility analysis with a 5-year time horizon from a public payer perspective. We also analyzed the budget impact of publicly funding HRD testing in people with ovarian cancer in Ontario. We performed a literature search for quantitative evidence of patient and provider preferences with respect to HRD testing and maintenance therapy with PARP inhibitors. To contextualize the potential value of HRD testing, we spoke with people with ovarian cancer.

Results

The clinical evidence review included two studies in high-grade epithelial ovarian cancer (one in patients with newly diagnosed advanced cases and one in patients with recurrent cancer). The studies evaluated niraparib maintenance therapy compared with no maintenance therapy and used HRD testing to group patients according to HRD status. Compared to placebo, niraparib maintenance therapy improved progression-free survival in patients with newly diagnosed and recurrent ovarian cancer, and in tumours with HRD or HRP (GRADE: High), but the studies did not compare the results between the HRD and HRP groups. The frequency of adverse events was higher in the niraparib group. We identified no studies that evaluated the clinical utility of HRD testing.We conducted a primary economic evaluation to evaluate the cost-effectiveness of HRD testing for people with newly diagnosed ovarian cancer in an Ontario setting. Our analysis used a 5-year time horizon. HRD testing (for all eligible people or only for people with BRCA wild type) resulted in a lower proportion of patients receiving niraparib maintenance therapy, leading to lower costs and fewer quality-adjusted life-years (QALYs). The average total cost per patient was $131,375 for no HRD testing, $126,867 for HRD testing only in people with BRCA wild type, and $127,746 for HRD testing in all eligible people. The average total QALYs per patient were 2.087 for no HRD testing, 1.971 for HRD testing only in people with BRCA wild type, and 1.971 for HRD testing in all eligible people. Our budget impact analysis suggested that assuming a high uptake rate, publicly funding HRD testing for people with newly diagnosed ovarian cancer would lead to a total saving of $9.00 million (if HRD testing were funded for all) to $12.67 million (if HRD testing were funded for people with BRCA wild type) over the next 5 years. Publicly funding HRD testing for people with recurrent cancer would lead to a total saving of $16.31 million (if HRD testing were funded for all) to $21.67 million (if HRD testing were funded for people with BRCA wild type) over the next 5 years.We identified no studies that evaluated quantitative preferences for HRD testing. Based on two studies that evaluated patients and oncologists' preferences for maintenance therapy with a PARP inhibitor in the recurrent setting, a decrease in moderate to severe adverse events was more important for patients than an improvement in progression-free survival; however, improvement in progression-free survival was more important for oncologists. Both patients and oncologists accepted some trade-offs between efficacy and safety. The people with ovarian cancer we spoke with demonstrated a shared value for access to information, prevention of cancer recurrence, and overall survival with minimal adverse effects. This was consistent with findings from another survey in patients with ovarian cancer and at least one episode of recurrence, which suggest that patients prioritize treatment benefit over some treatment adverse events in the context of niraparib maintenance therapy. Interviewees also emphasized the importance of the patient-doctor partnership, access to local health care services, and patient education.

Conclusions

In patients with newly diagnosed (advanced) or recurrent high-grade serous or endometrioid ovarian cancer, niraparib maintenance therapy improved progression-free survival compared with no maintenance therapy in tumours with HRD or HRP (GRADE: High). Because we identified no studies on the clinical utility of HRD testing, we cannot comment on how it would affect patient decisions and clinical outcomes.Over a 5-year time horizon, HRD testing for people with BRCA wild type could save $4,509 per person and lead to a loss of 0.116 QALY. The findings of our economic analyses are dependent on assumptions about the use of niraparib following HRD testing. We estimate that publicly funding HRD testing would lead to a total saving of $9 million to $12.67 million for newly diagnosed cancer, and a total saving of $16.31 million to $21.67 million for recurrent cancer over 5 years, assuming the use of niraparib maintenance therapy would be reduced following HRD testing.Patients prioritized decreasing the risk of moderate to severe adverse events of maintenance therapy with PARP inhibitors over improving progression-free survival, and oncologists prioritized improving progression-free survival over decreasing the risk of moderate to severe adverse events. However, both patients and oncologists were open to accepting certain trade-offs between treatment efficacy and toxicity. The people we interviewed, who had lived experience with ovarian cancer and genetic testing, valued the potential clinical benefits of HRD testing for themselves and their family members. They emphasized patient education as an important consideration for public funding in Ontario.

Carrier Screening Programs for Cystic Fibrosis, Fragile X Syndrome, Hemoglobinopathies and Thalassemia, and Spinal Muscular Atrophy: A Health Technology Assessment

Background

We conducted a health technology assessment to evaluate the safety, effectiveness, and cost-effectiveness of carrier screening programs for cystic fibrosis (CF), fragile X syndrome (FXS), hemoglobinopathies and thalassemia, and spinal muscular atrophy (SMA) in people who are considering a pregnancy or who are pregnant. We also evaluated the budget impact of publicly funding carrier screening programs, and patient preferences and values.

Methods

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using the Cochrane Risk of Bias tool and the Risk of Bias Assessment tool for Non-randomized Studies (RoBANS), and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted cost-effectiveness analyses comparing preconception or prenatal carrier screening programs to no screening. We considered four carrier screening strategies: 1) universal screening with standard panels; 2) universal screening with a hypothetical expanded panel; 3) risk-based screening with standard panels; and 4) risk-based screening with a hypothetical expanded panel. We also estimated the 5-year budget impact of publicly funding preconception or prenatal carrier screening programs for the given conditions in Ontario. To contextualize the potential value of carrier screening, we spoke with 22 people who had sought out carrier screening.

Results

We included 107 studies in the clinical evidence review. Carrier screening for CF, hemoglobinopathies and thalassemia, FXS, and SMA likely results in the identification of couples with an increased chance of having an affected pregnancy (GRADE: Moderate). Screening likely impacts reproductive decision-making (GRADE: Moderate) and may result in lower anxiety among pregnant people, although the evidence is uncertain (GRADE: Very low).We included 21 studies in the economic evidence review, but none of the study findings were directly applicable to the Ontario context. Our cost-effectiveness analyses showed that in the short term, preconception or prenatal carrier screening programs identified more at-risk pregnancies (i.e., couples that tested positive) and provided more reproductive choice options compared with no screening, but were associated with higher costs. While all screening strategies had similar values for health outcomes, when comparing all strategies together, universal screening with standard panels was the most cost-effective strategy for both preconception and prenatal periods. The incremental cost-effectiveness ratios (ICERs) of universal screening with standard panels compared with no screening in the preconception period were $29,106 per additional at-risk pregnancy detected and $367,731 per affected birth averted; the corresponding ICERs in the prenatal period were about $29,759 per additional at-risk pregnancy detected and $431,807 per affected birth averted.We estimated that publicly funding a universal carrier screening program in the preconception period over the next 5 years would require between $208 million and $491 million. Publicly funding a risk-based screening program in the preconception period over the next 5 years would require between $1.3 million and $2.7 million. Publicly funding a universal carrier screening program in the prenatal period over the next 5 years would require between $128 million and $305 million. Publicly funding a risk-based screening program in the prenatal period over the next 5 years would require between $0.8 million and $1.7 million. Accounting for treatment costs of the screened health conditions resulted in a decrease in the budget impact of universally provided carrier screening programs or cost savings for risk-based programs.Participants value the perceived potential positive impact of carrier screening programs such as medical benefits from early detection and treatment, information for reproductive decision-making, and the social benefit of awareness and preparation. There was a strong preference expressed for thorough, timely, unbiased information to allow for informed reproductive decision-making.

Conclusions

Carrier screening for CF, FXS, hemoglobinopathies and thalassemia, and SMA is effective at identifying at-risk couples, and test results may impact preconception and reproductive decision-making.The cost-effectiveness and budget impact of carrier screening programs are uncertain for Ontario. Over the short term, carrier screening programs are associated with higher costs, and also higher chances of detecting at-risk pregnancies compared with no screening. The 5-year budget impact of publicly funding universal carrier screening programs is larger than that of risk-based programs. However, accounting for treatment costs of the screened health conditions results in a decrease in the total additional costs for universal carrier screening programs or in cost savings for risk-based programs.The people we spoke with who had sought out carrier screening valued the potential medical benefits of early detection and treatment, particularly the support and preparation for having a child with a potential genetic condition.

Patients' and informal caregivers' perspectives on self-management interventions for type 2 diabetes mellitus outcomes: a mixed-methods overview of 14 years of reviews

BACKGROUND

Self-management interventions (SMIs) are core components of high-quality care in type 2 diabetes mellitus (T2DM). We aimed to identify and summarise the scientific evidence exploring the perspectives of patients with T2DM and their informal caregivers on outcomes of SMIs, and the key themes to enhance T2DM patient-centred care.

METHODS

We conducted a mixed-methods overview of reviews. We searched MEDLINE, CINAHL and PsycINFO, up to June 2021 for systematic reviews (SRs) exploring the perspectives of adults with T2DM and their informal caregivers, regarding self-management. Two reviewers conducted independently study selection, data extraction and quality assessment. We estimated the degree of overlap across SRs. We performed a qualitative analysis using a thematic synthesis approach.

RESULTS

We identified 54 SRs, corresponding to 939 studies, with a slight overlap. Most SRs (47/54, 87%) were considered high quality. We developed summaries for 22 outcomes and identified six overarching themes: (1) diabetic identity; (2) accessing healthcare; (3) experience of care; (4) engagement with self-management; (5) outcomes awareness; and (6) challenges adhering to self-management. We found important variability in how patients with T2DM and their informal caregivers value critical outcomes influenced by the disease progression and several contextual factors.

CONCLUSIONS

Our findings represent what matters most to patients with T2DM and their informal caregivers regarding outcomes of SMIs. Our results can facilitate the development and evaluation of SMIs, and guide decision-making in diabetes care, including the formulation of decisions and recommendations.

Patient preferences for epilepsy treatment: a systematic review of discrete choice experimental studies

BACKGROUND

This review aimed to 1) identify and assess the quality of discrete choice experiments (DCEs) examining preferences related to epilepsy treatment; 2) summarize the attributes and attribute levels measured in these studies; 3) identify how researchers selected and developed these attributes; and 4) identify which attributes are most important for epilepsy patients.

METHODS

A systematic literature review using PubMed, Web of Science and Scopus databases from database inception to February or April 2022. We included primary discrete-choice experiments eliciting preferences for various attributes of pharmacological and surgical interventions in patients diagnosed with epilepsy or the parents/carers of children with epilepsy. We excluded non- primary studies, studies assessing preferences for nonpharmacological treatment and studies that elicit preferences using methods other than discrete choice experiments. Two authors independently selected studies, extracted data and assessed risk of bias of studies. The quality of the included studies was assessed using two validated checklists. Study characteristics and findings were summarized descriptively.

RESULTS

A total of seven studies were included in the review. The majority of studies explored patients' preferences, and two compared the preferences of patients with physicians. The majority (n = 6) compared two medications, and one compared two surgical options to continuing medication options. The studies examined 44 attributes in total, including side effects (n = 26), efficacy expressed as being seizure free or have fewer seizures (n = 8), costs (n = 3), dosing frequency (n = 3), duration of side effects (n = 2), mortality (n = 1), long-term problems after surgery (n = 1) and surgical options (n = 1). The findings indicate that people with epilepsy have strong preferences for improving seizure control, which was ranked as the top priority in all studies. Patients also have a strong preference for the reduction of adverse effects and may be willing to make trade-offs between improved seizure control and reduction of long-term side effects that may impact their quality of life.

CONCLUSIONS

The use of DCEs in measuring patients' preference for epilepsy treatment is accumulating. However, inadequate reporting of methodological details may reduce decision-makers' confidence in the findings. Suggestions for future research are provided.

Methods to Summarize Discrete-Choice Experiments in a Systematic Review: A Scoping Review

BACKGROUND AND OBJECTIVE

Systematic reviews of discrete-choice experiments (DCEs) are being increasingly conducted. The objective of this scoping review was to identify and describe the methodologies that have been used to summarize results across DCEs.

METHODS

We searched the electronic databases MEDLINE and EMBASE from inception to March 18, 2021, to identify English-language systematic reviews of patient preferences that included at least two DCEs and extracted data on attribute importance. The methods used to summarize results across DCEs were classified into narrative, semi-quantitative, and quantitative (meta-analytic) approaches and compared. Approaches to characterize the extent of preference heterogeneity were also described.

RESULTS

From 7362 unique records, we identified 54 eligible reviews from 2010 to Mar 2021, across a broad range of health conditions. Most (83%) used a narrative approach to summarize findings of DCEs, often citing differences in studies as the reason for not formally pooling findings. Semi-quantitative approaches included summarizing the frequency of the most important attributes, the frequency of attribute statistical significance, or tabulated comparisons of attribute importance for each pair of attributes. One review conducted a meta-analysis using the maximum acceptable risk. While reviews often commented on the heterogeneity of patient preferences, few (6%) addressed this systematically across studies.

CONCLUSION

While not commonly used, several semi-quantitative and one quantitative approach for synthesizing results of DCEs were identified, which may be useful for generating summary estimates across DCEs when appropriate. Further work is needed to assess the validity and usefulness of these approaches.

Women's values and preferences on low-molecular-weight heparin and pregnancy: a mixed-methods systematic review

BACKGROUND

Venous thromboembolism (VTE) in pregnancy is an important cause of maternal morbidity and mortality. Low-molecular-weight heparin (LMWH) is the cornerstone of prophylaxis and treatment of thrombotic events during pregnancy. LMWH has fewer adverse effects than other anticoagulants, does not cross the placenta, and is safe for the fetus. However, the use of LMWH during pregnancy is sensitive to womens' underlying preferences. The objective of this review is to systematically assess women's values and preferences research evidence on this topic.

METHODS

We searched four electronic databases from inception to March 2022, and included studies examining values and preferences of using LMWH among pregnant women at risk of VTE. We followed a convergent integrated mixed-methods design to compare and contrast quantitative outcomes (utility and non-utility measures) and qualitative findings. We assessed the certainty of the values and preferences evidence with the GRADE approach for quantitative findings, and with GRADE-CERqual for qualitative evidence. Results were presented in a conjoint display.

RESULTS

We screened 3,393 references and identified seven eligible studies. The mixed methods analysis resulted in four themes. Datasets confirmed each other in that: 1) the majority of women consider that benefits of treatment outweigh the inconveniences of daily injections; and 2) main concerns around medication are safety and injections administration. Quantitative outcomes expanded on the qualitative findings in that: 3) participants who perceived a higher risk of VTE were more willing to take LMWH. Finally, we found a discrepancy between the datasets around: 4) the amount of information preferred to make the decision; however, qualitative data expanded to clarify that women prefer making informed decisions and receive support from their clinician in their decision-making process.

CONCLUSIONS

We are moderately confident that in the context of pregnancy, using LMWH is preferred by women given its net beneficial balance. Integrating data from different sources of evidence, and representing them in a jointly manner helps to identify patient's values and preferences. Our results may inform clinical practice guidelines and support shared decision-making process in the clinical encounter for the management of VTE in the context of pregnancy.

Genetic Testing for Familial Hypercholesterolemia: Health Technology Assessment

BACKGROUND

Familial hypercholesterolemia (FH) is an inherited disorder characterized by abnormally elevated low-density lipoprotein (LDL) cholesterol serum levels from birth, which increases the risk of premature atherosclerotic cardiovascular disease. Genetic testing is a type of a medical test that looks for changes in genes or chromosome structure to discover genetic differences, anomalies, or mutations that may prove pathological. It is regarded as the gold standard for screening and diagnosing FH. We conducted a health technology assessment on genetic testing for people with FH and their relatives (i.e., cascade screening). The assessment included an evaluation of clinical utility (the ability of a test to improve health outcomes), the diagnostic yield (ability of a test to identify people with FH), cost-effectiveness, the budget impact of publicly funding genetic testing for FH, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. For evaluation of clinical utility, we assessed the risk of bias of each included study using the ROBINS-I tool and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria.We performed a systematic economic literature search and conducted a cost-effectiveness and cost-utility analysis with a lifetime horizon from a public payer perspective. We assessed the cost-effectiveness of using genetic testing both for confirming a FH clinical diagnosis and for cascade screening in relatives of genetically confirmed cases. We evaluated the cost effectiveness of cascade screening strategies with genetic testing, sequential testing, and lipid testing approaches. We also analyzed the budget impact of publicly funding genetic testing in Ontario.

RESULTS

We included 11 studies in the clinical evidence review. Overall, our review found that genetic testing to diagnose FH improves several health outcomes (GRADE: Moderate) compared with clinical evaluation without a genetic test. We also found that genetic cascade screening leads to a high diagnostic yield of FH.According to our primary economic evaluation, genetic testing is a dominant strategy (more effective and less costly) compared with no genetic testing for individuals with a FH clinical diagnosis. It reduced the number of FH diagnoses, led to fewer cardiovascular events, and improved QALYs. For first-degree relatives of genetically confirmed cases, all cascade screening strategies (genetic testing, sequential testing, and lipid testing) were cost-effective when compared with no cascade screening in a pairwise fashion. The ICERs of cascade screening with genetic, sequential, and lipid testing compared with no cascade screening were $58,390, $50,220, and $45,754 per QALY gained, respectively. When comparing all screening strategies together, cascade screening with lipid testing was the most cost-effective strategy. At commonly used willingness-to-pay values of $50,000 and $100,000 per QALY gained, the probability of lipid cascade screening being cost-effective was 53.5% and 71.5%, respectively.The annual budget impact of publicly funding genetic testing for individuals with a clinical FH diagnosis in Ontario ranged from a cost saving of $2 million in year 1 to $64 million in year 5, for a total of $141 million saved over the next 5 years, assuming the cost of genetic testing remains at $490 per person. If only testing-related costs were considered, the budget impact was estimated to be an additional cost of $7 million in year 1, increasing to $20 million in year 5, for a total cost of $64 million over the next 5 years. For relatives of genetically confirmed cases, publicly funding genetic cascade screening would lead to an additional cost of $5 million in year 1, increasing to $27 million in year 5, for a total cost of $73 million over the next 5 years. If only testing-related costs were considered, the budget impact was estimated to be an additional of $66 million.

CONCLUSIONS

Genetic testing for FH has a higher clinical utility than clinical evaluation without a genetic test. It also results in a high diagnostic yield of FH through cascade screening. For individuals with a clinical diagnosis of FH, genetic testing would be a cost-saving and more effective diagnostic strategy. For relatives of index cases confirmed through genetic testing, genetic and lipid cascade screening are both cost-effective compared with no screening, but genetic cascade screening is less cost-effective than lipid cascade screening. We estimated that publicly funding genetic testing for individuals with a clinical diagnosis of FH in Ontario would save $141 million, and publicly funding genetic testing in a cascade screening program for relatives would cost an additional $73 million over the next five years.Most people with a positive genetic test perceived the screening, diagnosis, and treatment for FH more positively. The discovery of the condition can lead people to adhere to relevant treatments in an effort to control their cholesterol levels. People we spoke with felt that greater awareness and education would allow for more efficient uptake of cascade screening.

Understanding patients' and significant others' preferences on starting a diagnostic trajectory for dementia: An integrative review

OBJECTIVE

To explore the preferences of people with memory complaints (PwMC) and their significant others regarding starting a diagnostic trajectory for dementia.

METHODS

A systematic literature search was conducted in PubMed, PsycINFO, CINAHL, Web of Science, and Embase. Selection of abstracts and papers was performed independently by two researchers. Methodological quality was assessed with the Mixed Method Appraisal Tool. Result sections of the selected papers were thematically synthesized.

RESULTS

From 2497 citations, seven qualitative studies and two mixed methods studies published between 2010 and 2020 were included. Overall quality of the studies was high to moderate. A thematic synthesis showed that preferences for starting a diagnostic trajectory arose from the feeling of needing to do something about the symptoms, beliefs on the necessity and expected outcomes of starting a diagnostic trajectory. These views were influenced by normalization or validation of symptoms, the support or wishes of the social network, interactions with health care professionals, the health status of the PwMC, and societal factors such as stigma and socioeconomic status.

CONCLUSION

A variety of considerations with regard to decision-making on starting a diagnostic trajectory for dementia were identified. This emphasizes the need to explore individual preferences to facilitate a timely dementia diagnosis.

Patient-based benefit-risk assessment of medicines: development, refinement, and validation of a content search strategy to retrieve relevant studies

Introduction:

Poor indexing and inconsistent use of terms and keywords may prevent efficient retrieval of studies on the patient-based benefit-risk assessment (BRA) of medicines. We aimed to develop and validate an objectively derived content search strategy containing generic search terms that can be adapted for any search for evidence on patient-based BRA of medicines for any therapeutic area.

Methods:

We used a robust multistep process to develop and validate the content search strategy: (1) we developed a bank of search terms derived from screening studies on patient-based BRA of medicines in various therapeutic areas, (2) we refined the proposed content search strategy through an iterative process of testing sensitivity and precision of search terms, and (3) we validated the final search strategy in PubMed by firstly using multiple sclerosis as a case condition and secondly computing its relative performance versus a published systematic review on patient-based BRA of medicines in rheumatoid arthritis.

Results:

We conceptualized a final search strategy to retrieve studies on patient-based BRA containing generic search terms grouped into two domains, namely the patient and the BRA of medicines (sensitivity 84%, specificity 99.4%, precision 20.7%). The relative performance of the content search strategy was 85.7% compared with a search from a published systematic review of patient preferences in the treatment of rheumatoid arthritis. We also developed a more extended filter, with a relative performance of 93.3% when compared with a search from a published systematic review of patient preferences in lung cancer.

The development of a core outcomes set for self-management interventions for patients living with obesity

Self-management interventions (SMIs) can improve the life of patients living with obesity. However, there is variability in the outcomes used to assess the effectiveness of SMIs and these are often not relevant for patients. In the context of COMPAR-EU, our aim was to develop a core outcome set (COS) for the evaluation of SMIs for patients with obesity. We followed a four steps multimethod approach: (1) the development of the initial catalogue of outcomes; (2) a scoping review of reviews on patients' values and preferences on outcomes of self-management (SM); (3) a Delphi survey including patients and patient representatives to rate the importance of outcomes; and (4) a 2-day consensus workshop with patients, patient representatives, healthcare professionals and researchers. The initial catalogue included 82 outcomes. Ten patients and patient's representatives participated in the Delphi survey. We identified 16 themes through the thematic synthesis of the scoping review that informed 37.80% of the outcomes on initial catalogue. Five patients, five healthcare professionals, and four researchers participated in the consensus workshop. After the consensus process, 15 outcomes were selected to be part of the final COS, and five supplementary outcomes were also provided. We developed a COS for the evaluation of SMIs in obesity with a significant involvement of patients and other key stakeholders. This COS will help improving data synthesis and increasing the value of SM research data in healthcare decision making.

Experiences of living with long COVID and of accessing healthcare services: a qualitative systematic review

OBJECTIVE

To explore the experiences of people living with long COVID and how they perceive the healthcare services available to them.

DESIGN

Qualitative systematic review.

DATA SOURCES

Electronic literature searches of websites, bibliographic databases and discussion forums, including PubMed LitCovid, Proquest COVID, EPPI Centre living systematic map of evidence, medRxiv, bioRxiv, Medline, Psychinfo and Web of Science Core Collection were conducted to identify qualitative literature published in English up to 13 January 2021.

INCLUSION CRITERIA

Papers reporting qualitative or mixed-methods studies that focused on the experiences of long COVID and/or perceptions of accessing healthcare by people with long COVID. Title/abstract and full-text screening were conducted by two reviewers independently, with conflicts resolved by discussion or a third reviewer.

QUALITY APPRAISAL

Two reviewers independently appraised included studies using the qualitative CASP (Critical Appraisal Skills Programme) checklist. Conflicts were resolved by discussion or a third reviewer.

DATA EXTRACTION AND SYNTHESIS

Thematic synthesis, involving line-by-line reading, generation of concepts, descriptive and analytical themes, was conducted by the review team with regular discussion.

RESULTS

Five studies published in 2020 met the inclusion criteria, two international surveys and three qualitative studies from the UK. Sample sizes varied from 24 (interview study) to 3762 (survey). Participants were predominantly young white females recruited from social media or online support groups. Three analytical themes were generated: (1) symptoms and self-directed management of long COVID; (2) emotional aspects of living with long COVID and (3) healthcare experiences associated with long COVID.

CONCLUSIONS

People experience long COVID as a heterogeneous condition, with a variety of physical and emotional consequences. It appears that greater knowledge of long COVID is required by a number of stakeholders and that the design of emerging long COVID services or adaptation of existing services for long COVID patients should take account of patients' experiences in their design.

The perspectives of patients and their caregivers on self-management interventions for chronic conditions: a protocol for a mixed-methods overview

Introduction: Self-management (SM) interventions are complex interventions and one of the main components of high-quality chronic disease care for which the incorporation of the perspectives of patients and their informal caregivers is crucial. We aim to identify, appraise and synthesise the evidence exploring patients’ and caregivers’ perspectives on SM interventions. More precisely, we aim to 1) describe how they value the importance of outcomes of SM interventions, and 2) identify the factors that might impact on acceptability and feasibility of SM interventions based on their preferences and experiences. Methods and analysis: We will conduct four mixed-methods overviews as part of COMPAR-EU, a European Union (EU) funded project aimed to identify the most effective and cost-effective SM interventions for chronic obstructive pulmonary disease (COPD), heart failure (HF), obesity, and type 2 diabetes mellitus (T2DM). We will search in MEDLINE, CINAHL, and PsycINFO for systematic reviews of studies addressing patients’ preferences on outcomes, or their experiences with SM alongside their disease trajectory or with SM interventions, published in English. Selection of studies and data extraction will be conducted in pairs. We will assess the overlap of studies and methodological quality. We will follow a three-step synthesis process: 1) narrative synthesis for quantitative evidence, 2) thematic synthesis for qualitative evidence, and 3) integration of findings in the interpretation phase. Additionally, we will consult on the relevance of findings with patients and their caregivers. Systematic review registration: PROSPERO CRD42019117867

Feasibility of national living guideline methods: the Australian Stroke Guidelines

OBJECTIVE

Maintaining clinical guideline currency has been one challenge to traditional guideline development. This paper describes the methods used to maintain a large national guideline for stroke management.

STUDY DESIGN AND SETTING

The Australian Stroke Clinical Guidelines are developed to meet Australian National Health and Medical Research Council (NHMRC) standards. Monthly surveillance is conducted for new systematic reviews and randomised controlled studies. Included studies undergo data extraction followed by preparation of updated evidence-to-decision frameworks which are used to inform updates, or development of new recommendations. Small writing groups made up of clinical experts and those with lived experience review and agree on changes, which are finally reviewed by a multidisciplinary Guidelines Steering Group. Draft changes are developed and published using the online MAGICapp platform, with dissemination and promotion via traditional methods as well as social media.

RESULTS

Each month approximately 350 abstracts are considered, covering 96 clinical topics and taking on average 16 hours to review. There have been four major guideline updates covering 34 new and updated recommendations.

CONCLUSION

It is feasible to use 'living' methods to maintain the Australian Clinical Guidelines for Stroke Management. Further work is now needed to understand the impact of living guidelines.

How do middle-aged and older adults with chronic hip pain view their health problem and its care? A protocol for a systematic review and qualitative evidence synthesis

INTRODUCTION

Chronic hip pain in middle-aged and older adults is common and disabling. Patient-centred care of chronic hip pain requires a comprehensive understanding of how people with chronic hip pain view their health problem and its care. This paper outlines a protocol to synthesise qualitative evidence of middle-aged and older adults' views, beliefs, expectations and preferences about their chronic hip pain and its care.

METHODS AND ANALYSIS

We will perform a qualitative evidence synthesis using a framework approach. We will conduct this study in accord with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement and the Enhancing Transparency in Reporting the synthesis of Qualitative research checklist. We will search MEDLINE, CINAHL, The Cochrane Central Register of Controlled Trials, EMBASE and PsycINFO using a comprehensive search strategy. A priori selection criteria include qualitative studies involving samples with a mean age over 45 and where 80% or more have chronic hip pain. Two or more reviewers will independently screen studies for eligibility, assess methodological strengths and limitations using the Critical Appraisal Skills Programme qualitative studies checklist, perform data extraction and synthesis and determine ratings of confidence in each review finding using the Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative research approach. Data extraction and synthesis will be guided by the Common-Sense Model of Self-Regulation. All authors will contribute to interpreting, refining and finalising review findings. This protocol is registered on PROSPERO and reported according to the PRISMA Statement for Protocols (PRISMA-P) checklist.

ETHICS AND DISSEMINATION

Ethics approval is not required for this systematic review as primary data will not be collected. The findings of the review will be disseminated through publication in an academic journal and scientific conferences.

PROSPERO REGISTRATION NUMBER

PROSPERO registration number: CRD42021246305.

The Perspectives of Patients with Chronic Diseases and Their Caregivers on Self-Management Interventions: A Scoping Review of Reviews

BACKGROUND

Self-management (SM) interventions are supportive interventions systematically provided by healthcare professionals, peers, or laypersons to increase the skills and confidence of patients in their ability to manage chronic diseases. We had two objectives: (1) to summarise the preferences and experiences of patients and their caregivers (informal caregivers and healthcare professionals) with SM in four chronic diseases and (2) to identify and describe the relevant outcomes for SM interventions from these perspectives.

METHODS

We conducted a mixed-methods scoping review of reviews. We searched three databases until December 2020 for quantitative, qualitative, or mixed-methods reviews exploring patients' and caregivers' preferences or experiences with SM in type 2 diabetes mellitus (T2DM), obesity, chronic obstructive pulmonary disease (COPD), and heart failure (HF). Quantitative data were narratively synthesised, and qualitative data followed a three-step descriptive thematic synthesis. Identified themes were categorised into outcomes or modifiable factors of SM interventions.

RESULTS

We included 148 reviews covering T2DM (n = 53 [35.8%]), obesity (n = 20 [13.5%]), COPD (n = 32 [21.6%]), HF (n = 38 [25.7%]), and those with more than one disease (n = 5 [3.4%]). We identified 12 main themes. Eight described the process of SM (disease progression, SM behaviours, social support, interaction with healthcare professionals, access to healthcare, costs for patients, culturally defined roles and perceptions, and health knowledge), and four described their experiences with SM interventions (the perceived benefit of the intervention, individualised care, sense of community with peers, and usability of equipment). Most themes and subthemes were categorised as outcomes of SM interventions.

CONCLUSION

The process of SM shaped the perspectives of patients and their caregivers on SM interventions. Their perspectives were influenced by the perceived benefit of the intervention, the sense of community with peers, the intervention's usability, and the level of individualised care. Our findings can inform the selection of patient-important outcomes, decision-making processes, including the formulation of recommendations, and the design and implementation of SM interventions.

Values and preferences towards medical cannabis among people living with chronic pain: a mixed-methods systematic review

OBJECTIVE

To explore values and preferences towards medical cannabis among people living with chronic pain.

DESIGN

Mixed-methods systematic review.

DATA SOURCES

We searched MEDLINE, EMBASE and PsycINFO from inception to 17 March 2020.

STUDY SELECTION

Pairs of reviewers independently screened search results and included quantitative, qualitative and mixed-methods studies reporting values and preferences towards medical cannabis among people living with chronic pain.

REVIEW METHODS

We analysed data using meta-narrative synthesis (quantitative findings were qualitised) and tabulated review findings according to identified themes. We used the Grading of Recommendations Assessment, Development and Evaluation approach to assess certainty of evidence.

RESULTS

Of 1838 initial records, 15 studies proved eligible for review. High to moderate certainty evidence showed that patient's use of medical cannabis for chronic pain was influenced by both positive (eg, support from friends and family) and negative social factors (eg, stigma surrounding cannabis use). Most patients using medical cannabis favoured products with balanced ratios of tetrahydrocannabinol (THC) and cannabidiol (CBD), or high levels of CBD, but not high THC preparations. Many valued the effectiveness of medical cannabis for symptom management even when experiencing adverse events related to concentration, memory or fatigue. Reducing use of prescription medication was a motivating factor for use of medical cannabis, and concerns regarding addiction, losing control or acting strangely were disincentives. Out-of-pocket costs were a barrier, whereas legalisation of medical cannabis improved access and incentivised use.Low to very low certainty evidence suggested highly variable values towards medical cannabis among people living with chronic pain. Individuals with pain related to life-limiting disease were more willing to use medical cannabis, and preferred oral over inhaled administration.

CONCLUSIONS

Our findings highlight factors that clinicians should consider when discussing medical cannabis. The variability of patients' values and preferences emphasise the need for shared decision making when considering medical cannabis for chronic pain.

Internet-Delivered Cognitive Behavioural Therapy for Post-traumatic Stress Disorder or Acute Stress Disorder: A Health Technology Assessment

BACKGROUND

Post-traumatic stress disorder (PTSD) and acute stress disorder (ASD) are mental health conditions that may emerge following a frightening or traumatic event in a person's life. We conducted a health technology assessment of internet-delivered cognitive behavioural therapy (iCBT) for adults with PTSD or ASD, which included an evaluation of effectiveness, safety, cost-effectiveness, the budget impact of publicly funding iCBT for PTSD or ADS, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of systematic reviews using ROBIS and of randomized controlled trials (RCTs) using the Cochrane Risk of Bias Tool, and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria.We performed a systematic economic literature search to summarize the economic evidence on the cost-effectiveness of iCBT for adults with PTSD or ASD. We did not conduct a primary economic evaluation on iCBT for adults with PTSD, as an existing cost-utility analysis is directly applicable to this research question. We did not conduct a primary economic evaluation on iCBT for adults with ASD, as there is limited clinical evidence on this topic and because evidence on iCBT for PTSD may be generalizable to iCBT for ASD at risk of progressing to PTSD. We analyzed the budget impact of publicly funding iCBT for adults with PTSD or ASD in Ontario over the next 5 years.To contextualize the potential value of iCBT for PTSD, we reviewed relevant literature on patients' preferences and values and spoke with people who have lived experience with PTSD to explore their values, needs, and priorities.

RESULTS

We identified no studies on the use of iCBT for prevention of PTSD or studies on the use of iCBT to treat ASD, nor studies that directly compared iCBT with face-to-face CBT for the treatment of PTSD. We included one systematic review of the use of iCBT to treat PTSD (10 RCTs, N = 720). Overall, iCBT is more effective than wait-list (waiting for iCBT) or usual care alone for reducing the severity of PTSD symptoms (standardized mean difference [SMD] = -0.60 [95% CI -0.97 to -0.24]; N = 560, 8 RCTs) (GRADE: Very low). Internet-delivered CBT is not more effective than non-CBT internet-delivered interventions for reducing the severity of PTSD symptoms (SMD = -0.08 [-0.52 to 0.35]; N = 82, 2 RCTs) (GRADE: Very low).We identified one economic evaluation on the cost-effectiveness of iCBT for adults with PTSD. For adults with PTSD, iCBT was found to be dominant (i.e., less costly and more effective) compared with usual care. The model used a Canadian public health care payer perspective, and there were no major limitations to the model structure, time horizon, or source of model inputs. The annual budget impact of publicly funding iCBT in Ontario over the next 5 years ranges from an additional $2.43 million in year 1 to $2.37 million in year 5, for a total additional cost of $16.53 million over the next 5 years. If treatment costs alone are considered, the annual budget impact ranges from an additional $3.37 million in year 1 to $17.84 million in year 5, for a total additional cost of $52.61 million over the next 5 years.Our review of the quantitative literature on patient preferences found that adults with PTSD may experience iCBT as a generally acceptable form of treatment, but there is uncertainty in the evidence due to incomplete follow-up in studies and variability in the nature and extent of the therapist-patient relationship. The 10 people we spoke with had all been diagnosed with PTSD. They reported on its negative impact on their quality of life, including difficulty in managing everyday activities, relationships, and employment. Participants viewed iCBT as beneficial to managing their PTSD symptoms but stressed the importance of combining it with face-to-face CBT. However, wait times for PTSD services are long, and out-of-pocket expenses could be a barrier for people without private insurance.

CONCLUSIONS

Internet-delivered CBT may reduce the severity of PTSD symptoms compared with wait-list or usual care, but the evidence is very uncertain, and iCBT may have little to no effect on improving PTSD symptoms compared with non-CBT interventions delivered online, but here as well the evidence is very uncertain.For adults with PTSD, iCBT may be cost-effective compared with usual care. We estimate that publicly funding iCBT in Ontario would result in additional costs of between $2.37 million and $2.43 million per year over the next 5 years.People with PTSD seem to generally find iCBT as an acceptable treatment option. People with PTSD with whom we spoke viewed iCBT to be effective and recommended it be combined with in-person psychotherapy.

Repetitive Transcranial Magnetic Stimulation for People With Treatment-Resistant Depression: A Health Technology Assessment

BACKGROUND

Major depression is one of the most diagnosed mental illnesses in Canada. Generally, people are treated successfully with antidepressants or psychotherapy, but some people do not respond to these treatments (called treatment-resistant depression [TRD]). Repetitive transcranial magnetic stimulation (rTMS) delivers magnetic pulses to stimulate the areas of the brain associated with mood regulation. Several modalities of rTMS exist (e.g., high frequency rTMS, intermittent theta burst stimulation [iTBS], deep transcranial magnetic stimulation). We conducted a health technology assessment of rTMS for people with TRD, which included an evaluation of effectiveness, safety, cost-effectiveness, the budget impact of publicly funding rTMS, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using the Risk of Bias in Systematic Reviews (ROBIS) tool and Cochrane Risk of Bias for Randomized Controlled Trials and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted a cost-utility analysis with a 3-year horizon from a public payer perspective. We also analyzed the 5-year budget impact of publicly funding rTMS for people with TRD in Ontario. To assess the potential value of rTMS, we spoke with people who have TRD. Seven rTMS modalities were considered: low-frequency (1 Hz) stimulation, high-frequency (10-20 Hz) stimulation, unilateral stimulation, bilateral stimulation, iTBS, continuous theta burst stimulation, and deep transcranial magnetic stimulation.

RESULTS

We included 58 primary studies, 9 systematic reviews, and 1 network meta-analysis in the clinical evidence review. Most rTMS modalities were more effective than sham treatment for all outcomes (GRADE: Moderate to High). All rTMS modalities were similar to one another in response and remission rates (GRADE: not reported) and were similar to electroconvulsive therapy (ECT) in response and remission rates (GRADE: Moderate). Moreover, in both the reference case and scenario analyses, two rTMS modalities (rTMS or iTBS), followed by ECT when patients did not respond to initial treatment, were less expensive and more effective than ECT alone. They were cost-effective compared with pharmacotherapy alone at a willingness-to-pay amount of $50,000 per quality-adjusted life-year (QALY). The annual budget impact of publicly funding rTMS would range from $9.3 million in year 1 to $15.76 million in year 5, for a total of $63.2 million over the next 5 years. People with TRD we spoke with reported that their experiences were generally favourable, and their attitudes toward rTMS were positive. Similarly, psychiatrists had positive attitudes toward and acceptance of rTMS. Our quantitative literature review on preferences revealed some gaps in psychiatrists' knowledge of rTMS, which could have been influenced by their level of training on rTMS.

CONCLUSIONS

Most rTMS modalities are likely more effective than sham rTMS on all outcomes. All rTMS modalities are similar to ECT and to one another in response and remission rates. Compared with ECT alone, two rTMS modalities (high-frequency rTMS and iTBS), followed by ECT when necessary in a stepped care pathway, were less costly and more effective for managing adults with TRD. These types of rTMS (high-frequency rTMS and iTBS) were cost-effective compared with pharmacotherapy alone at a willingness-to-pay amount of $50,000 per QALY. Publicly funding rTMS (high-frequency rTMS and iTBS) for the treatment of adults with TRD in Ontario over the next 5 years would add $63.2 million in total costs. People with TRD had positive experiences and attitudes toward rTMS.

Vaginal Pessaries for Pelvic Organ Prolapse or Stress Urinary Incontinence: A Health Technology Assessment

BACKGROUND

Pelvic organ prolapse (POP) is the downward descent of the female pelvic organs into or through the vagina. The symptom that most strongly correlates with and is most specific for POP is a feeling of vaginal bulging. Stress urinary incontinence (SUI) is an involuntary loss of urine upon physical exertion or sneezing or coughing. Conservative (non-surgical) treatment options for both conditions include vaginal pessaries. We conducted a health technology assessment of vaginal pessaries for the treatment of POP and SUI, which included an evaluation of effectiveness, safety, cost-effectiveness, the budget impact of publicly funding vaginal pessaries, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using ROBIS, the Cochrane Risk of Bias tool, and the Newcastle-Ottawa Scale and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted a cost-utility analysis with a 10-year horizon from a public payer perspective. We also analyzed the budget impact of publicly funding vaginal pessaries for individuals with pelvic organ prolapse and/or stress urinary incontinence in Ontario. We explored the underlying values, needs, and priorities of those who have lived experience with POP and/or SUI, as well as the preferences and perceptions of both patients and providers of vaginal pessaries.

RESULTS

We included 15 studies in the clinical evidence review. Compared with no treatment for people with SUI, pessaries were associated with a significant improvement in some symptoms at 14 days follow-up (SUI subscore of Urinary Symptom Profile, mean difference -2.20; 95% CI -3.47 to -0.93; GRADE: Very low). Compared with pelvic floor muscle training (PFMT), pessaries were associated with no difference in improvement at 12 months follow-up for some symptoms (Urinary Distress Inventory subscale of the Pelvic Floor Distress Inventory, risk ratio = 0.86; 95% CI 0.64 to 1.16; GRADE: Low). For people with POP, pessaries were associated with a significant improvement in the Pelvic Organ Prolapse Distress Inventory score and in sexual function compared with PFMT plus feedback/electrical stimulation/lifestyle advice at 12- and 24-month follow ups (GRADE: Low). Pessary continuation rate at 12 months follow up was reported to be 60% (44/74 patients) (GRADE: Very low).When evaluating various POP and SUI treatments in sequential order, pessaries were within the most cost-effective treatment sequence; therefore, it is likely to be a cost-effective intervention for treating POP and SUI. There was a high degree of certainty that pessaries were cost-effective in a population with POP, and a moderate degree of certainty in a population with SUI. When the treatment sequence of pessaries and surgery was compared with surgery alone, the pessaries treatment sequence dominates surgery in the cohort with POP, and in the cohort with SUI pessaries had an incremental cost-effectiveness ratio (ICER) of $1,033 per QALY gained. The annual budget impact of publicly funding vaginal pessaries in Ontario over the next 5 years ranges from $0.3 million in year 1 to $0.5 million in year 5 for POP, and $0.2 million in year 1 to $0.3 million in year 5 for SUI.We included one study in our quantitative evidence review and spoke to 29 people in our direct patient engagement. The evidence indicated that patient preferences vary and that patients accept the risks of their chosen treatment option. The 24 people we spoke with who had direct experience with vaginal pessaries reported that their POP and/or SUI limited their social activities and restricted their activity levels, taking a huge emotional toll. Many were hesitant or even fearful of surgery due to side effects and perceived failure rate of the surgery. Most people reported that pessaries relieved most or all of their symptoms, allowing them to return to their normal daily activities. However, wait times for pessary fittings could be as long as 2 years, and out-of-pocket expenses could be a barrier for people without extended insurance.

CONCLUSIONS

For people with SUI, vaginal pessaries may improve symptoms compared with no treatment, but the evidence is very uncertain. Pessaries may result in little to no difference in longer-term improvement of SUI symptoms compared with PFMT. For people with POP, pessaries may improve some longer-term symptoms, as well as sexual function compared with PFMT. For people with symptomatic POP and SUI, vaginal pessaries may be a cost-effective intervention to be used within a stepped care model (a sequence of interventions followed after the current treatment proves ineffective). We estimate that publicly funding vaginal pessaries in Ontario would result in a total 5-year budget impact of $2.0 million for POP and $1.3 million for SUI. People with POP and/or SUI reported pessary use as being an effective treatment option to manage their symptoms.

Self-management interventions for adults living with Chronic Obstructive Pulmonary Disease (COPD): The development of a Core Outcome Set for COMPAR-EU project

BACKGROUND

A large body of evidence suggests that self-management interventions (SMIs) may improve outcomes in chronic obstructive pulmonary disease (COPD). However, accurate comparisons of the relative effectiveness of SMIs are challenging, partly due to heterogeneity of outcomes across trials and uncertainty about the importance of these outcomes for patients. We aimed to develop a core set of patient-relevant outcomes (COS) for SMIs trials to enhance comparability of interventions and ensure person-centred care.

METHODS

We undertook an innovative approach consisting of four interlinked stages: i) Development of an initial catalogue of outcomes from previous EU-funded projects and/or published studies, ii) Scoping review of reviews on patients and caregivers' perspectives to identify outcomes of interest, iii) Two-round Delphi online survey with patients and patient representatives to rate the importance of outcomes, and iv) Face-to-face consensus workshop with patients, patient representatives, health professionals and researchers to develop the COS.

RESULTS

From an initial list of 79 potential outcomes, 16 were included in the COS plus one supplementary outcome relevant to all participants. These were related to patient and caregiver knowledge/competence, self-efficacy, patient activation, self-monitoring, adherence, smoking cessation, COPD symptoms, physical activity, sleep quality, caregiver quality of life, activities of daily living, coping with the disease, participation and decision-making, emergency room visits/admissions and cost effectiveness.

CONCLUSION

The development of the COPD COS for the evaluation of SMIs will increase consistency in the measurement and reporting of outcomes across trials. It will also contribute to more personalized health care and more informed health decisions in clinical practice as patients' preferences regarding COPD outcomes are more systematically included.

Patient values and preferences on valve replacement for aortic stenosis: a systematic review

The review aims to summarise evidence addressing patients’ values, preferences and practical issues on deciding between transcatheter aortic valve insertion (TAVI) and surgical aortic valve replacement (SAVR) for aortic stenosis. We searched databases and grey literature until June 2020. We included studies of adults with aortic stenosis eliciting values and preferences about treatment, excluding medical management or palliative care. Qualitative findings were synthesised using thematic analysis, and quantitative findings were narratively described. Evidence certainty was assessed using CERQual (Confidence in the Evidence from Reviews of Qualitative Research) and GRADE (Grading of Recommendations Assessment, Development and Evaluation). We included eight studies. Findings ranged from low to very low certainty. Most studies only addressed TAVI. Studies addressing both TAVI and SAVR reported on factors affecting patients’ decision-making along with treatment effectiveness, instead of trade-offs between procedures. Willingness to accept risk varied considerably. To improve their health status, participants were willing to accept higher mortality risk than current evidence suggests for either procedure. No study explicitly addressed valve reintervention, and one study reported variability in willingness to accept shorter duration of known effectiveness of TAVI compared with SAVR. The most common themes were desire for symptom relief and improved function. Participants preferred minimally invasive procedures with shorter hospital stay and recovery. The current body of evidence on patients’ values, preferences and practical issues related to aortic stenosis management is of suboptimal rigour and reports widely disparate results regarding patients’ perceptions. These findings emphasise the need for higher quality studies to inform clinical practice guidelines and the central importance of shared decision-making to individualise care fitted to each patient.

Qualitative evidence synthesis of values and preferences to inform infant feeding in the context of non-HIV transmission risk

Background

Breastfeeding is recommended by many organisations, but feeding choices can take on complexity against a backdrop of a transmissible infection risk. The aim of this synthesis is to explore what is known about the values and preferences of pregnant women, mothers, family members and health practitioners, policy makers and providers (midwives) concerning feeding when there is a risk of Mother-to-Child transmission [MTCT] of an infectious disease (other than HIV/AIDS) to infants (0–2 years of age).

Methods

A qualitative evidence synthesis and GRADE CERQual assessment of relevant studies of values and preferences regarding infant feeding options in the context of non-HIV MTCT risk.

Results

The synthesis included eight qualitative studies. Four studies focussed on human T-cell lymphotropic virus type 1 (HTLV-1), three studies on Ebola, and one study on influenza vaccination. Mothers reported feeling sadness and guilt at not breastfeeding, while recognising that it was important for the health of their baby not to breastfeed. Mothers were reportedly appreciative of the provision of appropriate facilities, and the advice of those health professionals who knew about the diseases, but felt other professionals lacked knowledge about the transmission risk of conditions such as HTLV-1. All groups expressed concerns about social perceptions of not breastfeeding, as well as the alternatives. The evidence was coherent and relevant, but there were serious concerns about adequacy and methodological limitations, such as potential social desirability bias in some studies.

Conclusions

This synthesis describes the reported values and preferences of pregnant women, mothers, and others concerning feeding when there is a risk of Mother-to-Child transmission (MTCT) of an infectious disease (other than HIV/AIDS) to an infant when breastfeeding. However, the evidence in the peer-reviewed literature is limited both in quality and quantity.

Noninvasive Fetal RhD Blood Group Genotyping: A Health Technology Assessment

BACKGROUND

RhD blood group incompatibility during pregnancy can cause serious health problems for the fetus. Noninvasive fetal RhD blood group genotyping is a test for fetal RhD status that may help prevent unnecessary preventive treatment (Rh immunoglobulin [RhIG] injections) and intensive pregnancy monitoring. We conducted a health technology assessment of noninvasive fetal RhD blood group genotyping for RhD-negative (RhD-) pregnancies. Our assessment evaluated the test's diagnostic accuracy, clinical utility, and cost-effectiveness, the budget impact of publicly funding this test, and patients' and providers' preferences and values.

METHODS

We performed a systematic literature search of the clinical and economic evidence to conduct an overview of reviews for test accuracy, a systematic review for clinical utility, and a review of the test's cost-effectiveness compared with usual care. We assessed the risk of bias of each included systematic review and study using the ROBIS and RoBANs tools, respectively. We assessed the quality of the body of clinical evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We developed probabilistic Markov microsimulation models to determine the cost-effectiveness and cost-utility of noninvasive fetal RhD genotyping compared with usual care from the Ontario Ministry of Health perspective. We also estimated the 5-year budget impact of publicly funding this test in Ontario. To examine patient and provider preferences related to noninvasive fetal RhD genotyping, we conducted a literature survey of quantitative studies on preference; the Canadian Agency for Drugs and Technologies in Health (CADTH) performed a review of qualitative literature about patient preferences; and we conducted interviews and an online survey with Ontario patients.

RESULTS

We included six systematic reviews in the overview of reviews on diagnostic test accuracy and 11 studies in the clinical utility review. Across systematic reviews, test accuracy was high for noninvasive fetal RhD genotyping. The evidence suggests that implementation of noninvasive fetal RhD genotyping may lead to avoidance of unnecessary RhIG prophylaxis (GRADE: Low), good compliance with targeted RhIG prophylaxis (GRADE: Very low), and high uptake of genotyping (GRADE: Low). Alloimmunization may not increase when using noninvasive fetal RhD genotyping to target prenatal RhIG prophylaxis (GRADE: Very low), and may allow unnecessary monitoring and invasive procedures to be avoided in alloimmunized pregnancies (GRADE: Very low).We included eight published economic studies that reported inconsistent results regarding the cost-effectiveness of noninvasive fetal RhD genotyping. In nonalloimmunized RhD- pregnancies, compared with usual care, the intervention identified more maternal alloimmunization cases (probability: 0.0022 vs. 0.0020) and was associated with a reduced number of RhIG injections per pregnancy (1.79 vs 1.43). It was more expensive ($154, 95% credible interval [CrI] $139 to $169) but had little impact on the QALYs of newborns followed over a 10-year time horizon (0.0007, 95% CrI -0.01 to 0.01). The cost of noninvasive fetal RhD genotyping and inclusion of paternal RhD typing were drivers of the cost-effectiveness results in this population. In alloimmunized RhD- pregnancies, noninvasive fetal RhD genotyping was associated with lower resource use during the pregnancy. Compared with usual care, it was less costly (-$6,280, 95% CrI -$6,325 to -$6,229) and more effective (0.19 QALYs, 95% CrI 0.17 to 0.20).The annual budget impact of publicly funding noninvasive fetal RhD genotyping in nonalloimmunized RhD- pregnancies in Ontario ranges from $2.6 million in year 1 (uptake of 80%) to $3.4 million in year 5 (uptake of 100%), with a 5-year total of about $14.8 million. In alloimmunized pregnancies, we estimate cost savings, from about $9 million in year 1 to about $12 million in year 5, with 5-year total savings of about $51.5 million.We included two studies in the survey of quantitative preferences literature. In the quantitative literature, RhD- pregnant people support routine offering of noninvasive fetal RhD genotyping as part of pregnancy care, with a preference to be adequately informed about the test process, attributes, timing, and risks in advance of the test, ideally in a dialogue with their health care provider. More than half of obstetric health care providers were supportive of offering the test. The qualitative review by CADTH and our own engagement with Ontario patients yielded similar results. Participants consistently expressed a desire for more information about the test and assurance about its safety. They also consistently mentioned the prevention of unnecessary monitoring and treatment as potential benefits.

CONCLUSIONS

Noninvasive fetal RhD blood group genotyping is an accurate test to determine RhD incompatibility and guide management of RhD- pregnancies. Compared with usual care, noninvasive fetal RhD genotyping is less costly and more effective for the management of alloimmunized pregnancies. For nonalloimmunized pregnancies, noninvasive fetal RhD genotyping would generally not be considered cost-effective, compared with usual care, unless the cost of testing is much lower than what is proposed now. Publicly funding noninvasive fetal RhD genotyping for guiding the management of RhD- pregnancies in Ontario over next 5 years is associated with a total budget impact of about $15 million in nonalloimmunized pregnancies and total cost savings of about $51 million in alloimmunized pregnancies. Patients and providers indicated support for the routine use of noninvasive fetal RhD genotyping in RhD- pregnancies.

Home Narrowband Ultraviolet B Phototherapy for Photoresponsive Skin Conditions: A Health Technology Assessment

BACKGROUND

Skin conditions are photoresponsive if they respond to ultraviolet (UV) radiation with partial or complete clearing. Ultraviolet phototherapy is performed by exposing the skin to UV radiation on a regular basis under medical supervision. Three types of UV radiation are used to treat photoresponsive skin conditions: broadband ultraviolet B (BB-UVB), psoralen plus ultraviolet A (PUVA), and narrowband ultraviolet B (NB-UVB). Narrowband UVB phototherapy is generally more effective than BB-UVB and safer than PUVA in the management of several photoresponsive skin conditions. While typically performed in an outpatient clinic setting, home NB-UVB phototherapy may be a viable option for people with limited access to outpatient treatment. We conducted a health technology assessment of home NB-UVB phototherapy for people with photoresponsive skin conditions that included an evaluation of the effectiveness, safety, cost-effectiveness, and budget impact of publicly funding home NB-UVB phototherapy, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using version 2 of the Cochrane risk-of-bias tool for randomized studies, and we assessed the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted a cost-utility analysis with a 10-year horizon from a public payer perspective. The cost-utility analysis was conducted for psoriasis based on the available clinical evidence. We also analyzed the budget impact of publicly funding home NB-UVB phototherapy in people with photoresponsive skin conditions in Ontario. To contextualize the potential value of NB-UVB phototherapy, we spoke with people with photoresponsive skin conditions.

RESULTS

We included one randomized controlled trial in the clinical evidence review. We found that home NB-UVB phototherapy is at least as effective as outpatient clinic NB-UVB phototherapy for the treatment of mild to severe psoriasis (the only photoresponsive skin condition investigated in the included study). In the included study, 82% of participants were treated at home, compared with 79% treated in an outpatient clinic setting (many participants had experience with both treatment settings). They demonstrated an improvement in baseline Psoriasis Area and Severity Index 50 (mean difference 2.8%, 95% confidence interval -8.6% to 14.2%), with the mean difference exceeding the preset noninferiority margin of -15%. Similar results were observed for other psoriasis area and severity indices (GRADE: Moderate). Episodes of mild erythema, burning sensation, severe erythema, and blistering were reported in both treatment groups, but were too few to allow a comparative safety assessment (GRADE: Low).The primary economic evaluation showed that home NB-UVB phototherapy is more costly (incremental cost $4,509) and has higher quality-adjusted life-years (QALYs; incremental QALY 0.29) than outpatient clinic NB-UVB. Our best estimate of the incremental cost-effectiveness ratio of home NB-UVB compared with outpatient clinic NB-UVB is $15,675 per QALY gained. The probability of home NB-UVB being cost-effective versus outpatient clinic NB-UVB is 77% at a willingness-to-pay of $50,000 per QALY gained. Publicly funding home NB-UVB phototherapy in the psoriasis population would lead to about $0.7 million each year and a total 5-year net budget impact of about $3.3 million. Publicly funding home treatment for people with photoresponsive skin conditions would lead to about $1.3 million each year and a total 5-year net budget impact of $6.3 million; however, this scenario accounted for the cost of phototherapy only (it did not include treatment-specific medical costs for conditions other than psoriasis).People with photoresponsive skin conditions with whom we spoke viewed home NB-UVB phototherapy as beneficial for those with health conditions that make it difficult to travel, for those with busy schedules, and for those who may not have the means to pay for travel to clinics.

CONCLUSIONS

Home NB-UVB phototherapy is at least as effective as outpatient clinic NB-UVB phototherapy for the treatment of mild to severe psoriasis (GRADE: Moderate). We are uncertain if adverse events happen more often or less often with home NB-UVB phototherapy than outpatient clinic NB-UVB phototherapy (GRADE: Low).Home NB-UVB phototherapy has an ICER of $15,675 per QALY gained, and the probability of home NB-UVB phototherapy being cost-effective is 77% at a willingness-to-pay of $50,000 per QALY gained. When accounting for the cost of phototherapy and other psoriasis-specific treatment costs (e.g., physician visits and adjuvant treatments), publicly funding home NB-UVB phototherapy in the psoriasis population would lead to a total 5-year net budget impact of about $3.3 million. Funding home NB-UVB phototherapy to people with photoresponsive skin conditions would lead to a total 5-year net budget impact of $6.3 million.People with photoresponsive skin conditions with whom we spoke viewed both outpatient clinic and home NB-UVB phototherapy to be effective treatment options.

Transcatheter Aortic Valve Implantation in Patients With Severe Aortic Valve Stenosis at Low Surgical Risk: A Health Technology Assessment

BACKGROUND

Surgical aortic valve replacement (SAVR) is the conventional treatment for patients with severe aortic valve stenosis at low surgical risk. Transcatheter aortic valve implantation (TAVI) is a less invasive procedure. We conducted a health technology assessment (HTA) of TAVI for patients with severe aortic valve stenosis at low surgical risk, which included an evaluation of effectiveness, safety, cost-effectiveness, the budget impact of publicly funding TAVI, and patient preferences and values.

METHODS

We used the 2016 Health Quality Ontario HTA on TAVI² as a source of eligible studies and performed a systematic literature search for studies published since the 2016 review. Eligible primary studies identified both through the 2016 HTA and through our complementary literature search were used in a de novo analysis. We assessed the risk of bias of each included study using the Cochrane risk-of-bias tool and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria.An applicable, previously conducted cost-effectiveness analysis was available, so we did not conduct a primary economic evaluation. We analyzed the budget impact of publicly funding TAVI in people at low surgical risk in Ontario. We also performed a literature survey of the quantitative evidence of preferences and values of patients for TAVI. The Canadian Agency for Drugs and Technologies in Health (CADTH) conducted a review to evaluate the qualitative literature on patient and provider preferences and values for TAVI. To contextualize the potential value of TAVI, we spoke with people with severe aortic valve stenosis.

RESULTS

We identified two randomized controlled trials that compared TAVI (transfemoral route) and SAVR in patients with severe aortic valve stenosis at low surgical risk. Both studies have an ongoing follow-up of 10 years, but 1-year and limited 2-year follow-up results are currently available. At 30 days, compared with SAVR, TAVI had a slightly lower risk of mortality (risk difference -0.8%, 95% confidence interval [CI] -1.5% to -0.1%, GRADE: Moderate) and disabling stroke (risk difference -0.8%, 95% CI -1.8% to -0.2%, GRADE: Moderate), and resulted in more patients with symptom improvement (risk difference 11.8%, 95% CI 8.2% to 15.5%, GRADE: High) and in a greater improvement in quality of life (GRADE: High). At 1 year, TAVI and SAVR were similar with regard to mortality (GRADE: Low), although TAVI may result in a slightly lower risk of disabling stroke (GRADE: Moderate). Both TAVI and SAVR resulted in a similar improvement in symptoms and quality of life at 1 year (GRADE: Moderate). Compared with SAVR, TAVI had a higher risk of some complications and a lower risk of others.Device-related costs for TAVI (about $25,000) are higher than for SAVR (about $6,000). A published cost-effectiveness analysis conducted from an Ontario Ministry of Health perspective showed TAVI to be more expensive and, on average, slightly more effective (i.e., it was associated with more quality-adjusted life-years [QALYs]) than SAVR. Compared with SAVR, the incremental cost-effectiveness ratios (ICERs) were $27,196 per QALY and $59,641 per QALY for balloon-expandable and self-expanding TAVI, respectively. Balloon-expandable TAVI was less costly (by $2,330 on average) and slightly more effective (by 0.02 QALY on average) than self-expanding TAVI. Among the three interventions, balloon-expandable TAVI had the highest probability of being cost-effective. It was the preferred option in 53% and 59% of model iterations, at willingness-to-pay values of $50,000 and $100,000 per QALY, respectively. Self-expanding TAVI was preferred in less than 10% of iterations. The budget impact of publicly funding TAVI in Ontario is estimated to be an additional $5 to $8 million each year for the next 5 years. The budget impact could be significantly reduced with reductions in the device price.We did not find any quantitative or qualitative evidence on patient preferences and values specific to the low-risk surgical group. Among a mixed or generally high-risk and population, people typically preferred the less invasive nature and the faster recovery time of TAVI compared with SAVR, and people were satisfied with the TAVI procedure. Patients with severe aortic valve stenosis at low surgical risk and their caregivers perceived that TAVI minimized pain and recovery time. Most patients who had TAVI returned to their usual activities more quickly than they would have if they had had SAVR. Our direct patient and caregiver consultations indicated a preference for TAVI over SAVR.

CONCLUSIONS

Both TAVI (transfemoral route) and SAVR resulted in improved patient symptoms and quality of life during the 1 year of follow-up. The TAVI procedure is less invasive and resulted in greater symptom improvement and quality of life than SAVR 30 days after surgery. The TAVI procedure also resulted in a small improvement in mortality and disabling stroke at 30 days. At 1 year, TAVI and SAVR were similar with regard to mortality, although TAVI may result in a slightly lower risk of disabling stroke. According to the study authors, longer follow-up is needed to better understand how long TAVI valves last and to draw definitive conclusions on the long-term outcomes of TAVI compared with SAVR beyond 1 year.The TAVI procedure might be cost-effective for patients at low surgical risk; however, there is some uncertainty in this result. We estimated that the additional cost to provide public funding for TAVI in people with severe aortic valve stenosis at low surgical risk would range from about $5 million to $8 million over the next 5 years.Among a mixed or generally high-risk population, people typically preferred the less invasive nature and the faster recovery time of TAVI compared with SAVR.

Patient values and preferences regarding VTE disease: a systematic review to inform American Society of Hematology guidelines

Values and preferences relate to the importance that patients place on health outcomes (eg, bleeding, having a deep venous thrombosis) and are essential when weighing benefits and harms in guideline recommendations. To inform the American Society of Hematology guidelines for management of venous thromboembolism (VTE) disease, we conducted a systematic review of patients' values and preferences related to VTE. We searched Medline, Embase, Cochrane Central Register of Controlled Trials, PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature from inception to April of 2018 (PROSPERO-CRD42018094003). We included quantitative and qualitative studies. We followed Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidance for rating the certainty and presenting findings for quantitative research about the relative importance of health outcomes and a grounded theory approach for qualitative thematic synthesis. We identified 14 quantitative studies (2465 participants) describing the relative importance of VTE-related health states in a widely diverse population of patients, showing overall small to important impact on patients' lives (certainty of the evidence from low to moderate). Additionally, evidence from 34 quantitative studies (6424 participants) and 15 qualitative studies (570 participants) revealed that patients put higher value on VTE risk reduction than on the potential harms of the treatment (certainty of evidence from low to moderate). Studies also suggested a clear preference for oral medication over subcutaneous medication (moderate certainty). The observed variability in health state values may be a result of differences in the approaches used to elicit them and the diversity of included populations rather than true variability in values. This finding highlights the necessity to explore the variability induced by different approaches to ascertain values.

Genome-Wide Sequencing for Unexplained Developmental Disabilities or Multiple Congenital Anomalies: A Health Technology Assessment

BACKGROUND

People with unexplained developmental disabilities or multiple congenital anomalies might have had many biochemical, metabolic, and genetic tests for a period of years without receiving a diagnosis. A genetic diagnosis can help these people and their families better understand their condition and may help them to connect with others who have the same condition. Ontario Health (Quality), in collaboration with the Canadian Agency for Drugs and Technologies in Health (CADTH) conducted a health technology assessment about the use of genome-wide sequencing for patients with unexplained developmental disabilities or multiple congenital anomalies. Ontario Health (Quality) evaluated the effectiveness, cost-effectiveness, and budget impact of publicly funding genome-wide sequencing. We also conducted interviews with patients and examined the quantitative evidence of preferences and values literature to better understand the patient preferences and values for these tests.

METHODS

Ontario Health (Quality) performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using the Risk of Bias Assessment tool for Non-randomized Studies (RoBANS) and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We also performed a search of the quantitative evidence and undertook direct patient engagement to ascertain patient preferences for genetic testing for unexplained developmental disabilities or multiple congenital anomalies. CADTH performed a review of qualitative literature about patient perspectives and experiences, and a review of ethical issues.Ontario Health (Quality) performed an economic literature review of genome-wide sequencing in people with unexplained developmental disabilities or multiple congenital anomalies. Although we found eight published cost-effectiveness studies, none completely addressed our research question. Therefore, we conducted a primary economic evaluation using a discrete event simulation model. Owing to its high cost and early stage of clinical implementation, whole exome sequencing is primarily used for people who do not have a diagnosis from standard testing (referred to here as whole exome sequencing after standard testing; standard testing includes chromosomal microarray and targeted single-gene tests or gene panels). Therefore, in our first analysis, we evaluated the cost-effectiveness of whole exome sequencing after standard testing versus standard testing alone. In our second analysis, we explored the cost-effectiveness of whole exome and whole genome sequencing used at various times in the diagnostic pathway (e.g., first tier, second tier, after standard testing) versus standard testing. We also estimated the budget impact of publicly funding genome-wide sequencing in Ontario for the next 5 years.

RESULTS

Forty-four studies were included in the clinical evidence review. The overall diagnostic yield of genome-wide sequencing for people with unexplained development disability and multiple congenital anomalies was 37%, but we are very uncertain about this estimate (GRADE: Very Low). Compared with standard genetic testing of chromosomal microarray and targeted single-gene tests or gene panels, genome-wide sequencing could have a higher diagnostic yield (GRADE: Low). As well, for some who are tested, genome-wide sequencing prompts some changes to medications, treatments, and referrals to specialists (GRADE: Very Low).Whole exome sequencing after standard testing cost an additional $3,261 per patient but was more effective than standard testing alone. For every 1,000 persons tested, using whole exome sequencing after standard testing would lead to an additional 240 persons with a molecular diagnosis, 272 persons with any positive finding, and 46 persons with active treatment change (modifications to medications, procedures, or treatment). The resulting incremental cost-effectiveness ratios (ICERs) were $13,591 per additional molecular diagnosis. The use of genome-wide sequencing early in the diagnostic pathway (e.g., as a first- or second-tier test) can save on costs and improve diagnostic yields over those of standard testing. Results remained robust when parameters and assumptions were varied.Our budget impact analysis showed that, if whole exome sequencing after standard testing continues to be funded through Ontario's Out-of-Country Prior Approval Program, its budget impact would range from $4 to $5 million in years 1 to 5. If whole exome sequencing becomes publicly funded in Ontario (not through the Out-of-Country Prior Approval Program), the budget impact would be about $9 million yearly. We also found that using whole exome sequencing as a second-tier test would lead to cost savings ($3.4 million per 1,000 persons tested yearly).Participants demonstrated consistent motivations for and expectations of obtaining a diagnosis for unexplained developmental delay or congenital anomalies through genome-wide sequencing. Patients and families greatly value the support and information they receive through genetic counselling when considering genome-wide sequencing and learning of a diagnosis.

CONCLUSIONS

Genome-wide sequencing could have a higher diagnostic yield than standard testing for people with unexplained developmental disabilities or multiple congenital anomalies. Genome-wide sequencing can also prompt some changes to medications, treatments, and referrals to specialists for some people tested; however, we are very uncertain about this. Genome-wide sequencing could be a cost-effective strategy when used after standard testing to diagnose people with unexplained developmental disabilities or multiple congenital anomalies. It could also lead to cost savings when used earlier in the diagnostic pathway. Patients and families consistently noted a benefit from seeking a diagnosis through genetic testing.

Gene Expression Profiling Tests for Early-Stage Invasive Breast Cancer: A Health Technology Assessment

BACKGROUND

Breast cancer is a disease in which cells in the breast grow out of control. They often form a tumour that may be seen on an x-ray or felt as a lump.Gene expression profiling (GEP) tests are intended to help predict the risk of metastasis (spread of the cancer to other parts of the body) and to identify people who will most likely benefit from chemotherapy. We conducted a health technology assessment of four GEP tests (EndoPredict, MammaPrint, Oncotype DX, and Prosigna) for people with early-stage invasive breast cancer, which included an evaluation of effectiveness, safety, cost effectiveness, the budget impact of publicly funding GEP tests, and patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using either the Cochrane Risk of Bias tool, Prediction model Risk Of Bias ASsessment Tool (PROBAST), or Risk of Bias Assessment tool for Non-randomized Studies (RoBANS), depending on the type of study and outcome of interest, and the quality of the body of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We also performed a literature survey of the quantitative evidence of preferences and values of patients and providers for GEP tests.We performed an economic evidence review to identify published studies assessing the cost-effectiveness of each of the four GEP tests compared with usual care or with one another for people with early-stage invasive breast cancer. We adapted a decision-analytic model to compare the costs and outcomes of care that includes a GEP test with usual care without a GEP test over a lifetime horizon. We also estimated the budget impact of publicly funding GEP tests to be conducted in Ontario, compared with funding tests conducted through the out-of-country program and compared with no funding of tests in any location.To contextualize the potential value of GEP tests, we spoke with people who have been diagnosed with early-stage invasive breast cancer.

RESULTS

We included 68 studies in the clinical evidence review. Within the lymph-node-negative (LN-) population, GEP tests can prognosticate the risk of distant recurrence (GRADE: Moderate) and may predict chemotherapy benefit (GRADE: Low). The evidence for prognostic and predictive ability (ability to indicate the risk of an outcome and ability to predict who will benefit from chemotherapy, respectively) was lower for the lymph-node-positive (LN+) population (GRADE: Very Low to Low). GEP tests may also lead to changes in treatment (GRADE: Low) and generally may increase physician confidence in treatment recommendations (GRADE: Low).Our economic evidence review showed that GEP tests are generally cost-effective compared with usual care.Our primary economic evaluation showed that all GEP test strategies were more effective (led to more quality-adjusted life-years [QALYs]) than usual care and can be considered cost-effective below a willingness-to-pay of $20,000 per QALY gained. There was some uncertainty in our results. At a willingness-to-pay of $50,000 per QALY gained, the probability of each test being cost-effective compared to usual care was 63.0%, 89.2%, 89.2%, and 100% for EndoPredict, MammaPrint, Oncotype DX, and Prosigna, respectively.Sensitivity analyses showed our results were robust to variation in subgroups considered (i.e., LN+ and premenopausal), discount rates, age, and utilities. However, cost parameter assumptions did influence our results. Our scenario analysis comparing tests showed Oncotype DX was likely cost-effective compared with MammaPrint, and Prosigna was likely cost-effective compared with EndoPredict. When the GEP tests were compared with a clinical tool, the cost-effectiveness of the tests varied. Assuming a higher uptake of GEP tests, we estimated the budget impact to publicly fund GEP tests in Ontario would be between $1.29 million (Year 1) and $2.22 million (Year 5) compared to the current scenario of publicly funded GEP tests through the out-of-country program.Gene expression profiling tests are valued by patients and physicians for the additional information they provide for treatment decision-making. Patients are satisfied with what they learn from GEP tests and feel GEP tests can help reduce decisional uncertainty and anxiety.

CONCLUSIONS

Gene expression profiling tests can likely prognosticate the risk of distant recurrence and some tests may also predict chemotherapy benefit. In people with breast cancer that is ER+, LN-, and human epidermal growth factor receptor 2 (HER2)-negative, GEP tests are likely cost-effective compared with no testing. The GEP tests are also likely cost-effective in LN+ and premenopausal people. Compared with funding GEP tests through the out-of-country program, publicly funding GEP tests in Ontario would cost an additional $1 million to $2 million annually, assuming a higher uptake of tests. GEP tests are valued by both patients and physicians for chemotherapy treatment decision-making.

Cell-Free Circulating Tumour DNA Blood Testing to Detect EGFR T790M Mutation in People With Advanced Non-Small Cell Lung Cancer: A Health Technology Assessment

BACKGROUND

Cell-free circulating tumour DNA blood testing (also called liquid biopsy) can determine if a person with advanced non-small cell lung cancer (NSCLC) whose disease is progressing has developed the epidermal growth factor receptor (EGFR) T790M resistance mutation. Identifying this resistance mutation can help physicians choose appropriate treatment (i.e., osimertinib if positive and chemotherapy if negative). Tissue biopsy is typically used to look for the resistance mutation, but this is an invasive test that might not be feasible if the patient is too ill. We conducted a health technology assessment of liquid biopsy for people with advanced NSCLC, which included an evaluation of the diagnostic accuracy, clinical utility, safety, cost-effectiveness, and the budget impact of publicly funding liquid biopsy, as well as an evaluation of patient preferences and values.

METHODS

We performed a systematic literature search of the clinical evidence. We assessed the risk of bias of each included study using Risk of Bias in Systematic Reviews (ROBIS), Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2), Risk of Bias Among Non-randomized Studies (RoBANS), and the Cochrane risk of bias (ROB) tool and assessed quality of evidence according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group criteria. We performed a systematic economic literature search and conducted short-term and long-term cost-effectiveness and cost-utility analyses comparing liquid biopsy as a triage test, liquid biopsy alone, and tissue biopsy alone from a public payer perspective. We also analyzed the budget impact of publicly funding liquid biopsy for people in Ontario with advanced NSCLC. To assess the potential value of liquid biopsy, we spoke with people with lung cancer and people with an understanding of the process of liquid biopsy.

RESULTS

We included 19 studies (within a published systematic review) to examine diagnostic test accuracy and 12 studies to examine clinical utility. In patients with advanced NSCLC, liquid biopsy to detect the EGFR T790M resistance mutation demonstrated a positive and negative predictive value of 89% and 61%, respectively, a sensitivity of 68%, and specificity of 86%. No studies examined the clinical utility of liquid biopsy as a triage test. When NSCLC was treated appropriately, progression-free survival was similar in patients with and without the resistance mutation, as ascertained by liquid biopsy.We estimated that it costs about $700 to conduct a liquid biopsy and $2,500 to conduct a tissue biopsy. Our analyses showed that, when considering costs and effects directly related to testing, liquid biopsy (as a triage test, which means patients who test negative undergo a follow-up tissue biopsy, or alone, which means using only liquid biopsy) was less costly than tissue biopsy alone and led to fewer tissue biopsies. Using liquid biopsy as a triage test produced the most correct treatment decisions and greatest number of people who were given osimertinib.When considering long-term costs (i.e., treatment and care) and effects (i.e., life-years and quality-adjusted life-years [QALYs]), liquid biopsy as a triage test was the most effective and most costly strategy followed by liquid biopsy alone. Tissue biopsy alone was the least effective and least costly strategy. The incremental cost-effectiveness ratios (ICERs) of liquid biopsy as a triage test compared with liquid biopsy alone and of liquid biopsy alone compared with tissue biopsy alone were greater than $100,000 per QALY. However, this result was largely driven by the cost of osimertinib, which was used more often when liquid biopsy was used as a triage test.We estimated that the total annual budget impact of publicly funding liquid biopsy as a triage test in Ontario over the next 5 years would range from approximateily $60,000 in year 1 to $3 million in year 5.People with lung cancer with whom we spoke said that liquid biopsy would likely be an appropriate test for people with NSCLC given their frail condition and because it would avoid the pain and anxiety associated with tissue biopsy.

CONCLUSIONS

As a minimally invasive test, liquid biopsy identifies a high proportion of people with the EGFR T790M resistance mutation. This identification could better guide treatment for people with advanced NSCLC. However, its relatively low negative predictive value means it is best used as a triage test (i.e., followed by tissue biopsy if the liquid biopsy does not identify a resistance mutation). Liquid biopsy as a triage test is likely more effective than tissue biopsy alone. However, owing to the high cost of treatment, liquid biopsy may not be cost-effective. We estimated that publicly funding liquid biopsy as a triage test in Ontario would result in additional costs (related to more patients being treated) of between $0.06 million and $3 million over the next 5 years.

Integrated Care Search: development and validation of a PubMed search filter for retrieving the integrated care research evidence

Background

Integrated care is an increasingly important principle for organising healthcare. Integrated care models show promise in reducing resource wastage and service fragmentation whilst improving the accessibility, patient-centredness and quality of care for patients. Those needing reliable access to the growing research evidence base for integrated care can be frustrated by search challenges reflective of the topic’s complexity. The aim of this study is to report the empirical development and validation of two search filters for rapid and effective retrieval of integrated care evidence in PubMed. One filter is optimised for recall and the other for precision.

Methods

An Expert Advisory Group comprising international integrated care experts guided the study. A gold standard test set of citations was formed from screening Handbook Integrated Care chapter references for relevance. This set was divided into a Term Identification Set (20%) for determining candidate terms using frequency analysis; a Filter Development Set (40%) for testing performance of term combinations; and a Filter Validation Set (40%) reserved for confirming final filter performance. In developing the high recall filter, recall was steadily increased while maintaining precision at ≥50%. Similarly, the high precision filter sought to maximise precision while keeping recall ≥50%. For each term combination tested, an approximation of precision was obtained by reviewing the first 100 citations retrieved in Medline for relevance.

Results

The gold standard set comprised 534 citations. The search filter optimised for recall (‘Broad Integrated Care Search’) achieved 86.0–88.3% recall with corresponding low precision (47–53%). The search filter optimised for precise searching (‘Narrow Integrated Care Search’) demonstrated precision of 73–95% with recall reduced to between 55.9 and 59.8%. These filters are now available as one-click URL hyperlinks in the website of International Foundation for Integrated Care.

Conclusions

The Broad and Narrow Integrated Care Search filters provide potential users, such as policy makers and researchers, seamless, reliable and ongoing access to integrated care evidence for decision making. These filters were developed according to a rigorous and transparent methodology designed to circumvent the challenges of information retrieval posed by this complex, multifaceted topic.

Development and field testing of a tool to elicit women's preferences among cervical cancer screening modalities

OBJECTIVE

The objective of the present study is to describe the development and field testing of a preference-elicitation tool for cervical cancer screening, meeting International Patient Decision Aids Standards (IPDAS) quality criteria.

METHODS

We developed a tool designed to elicit women's preferences among cervical cancer screening modalities. The Ottawa Decision Support Framework and IPDAS systematic development process guided the design, and we followed IPDAS criteria for conducting a field test in a real-world setting. Using social media recruitment strategies, we identified a convenience sample of Ontario women who were currently eligible for cervical screening to test the tool. We evaluated the feasibility, acceptability, balance of information, and ability to elicit women's informed, values-based preferences using an online survey embedded in the tool.

RESULTS

Twenty-five women participated in the field test. Participants were aged 20 to 63 years , and identified as predominantly white (88%), living in Northern Ontario (68%), and most had university education (75%). Most participants (72%) considered the length of the website as "just right," and 100% indicated that they would find the tool useful for decision-making. Over two-thirds (68%) of participants perceived the information in the tool as "balanced." Almost all (92%) participants scored at least 4 out of 7 on the knowledge quiz, and most participants (84%) selected their preference in an informed, values-based way.

CONCLUSION

The results from our field test of this tool provide preliminary evidence of the tool's feasibility, acceptability, balance, and ability to elicit women's informed, values-based preferences among available cervical screening modalities. Further research should elicit the distribution of preferences of cervical screening modalities in other regions, using a sample who represents the screening population and a rigorous study design. It will be important for researchers and screening programmes to evaluate the tool's ability to elicit women's informed, values-based preferences compared with educational materials.

Patient Preferences for Disease-modifying Antirheumatic Drug Treatment in Rheumatoid Arthritis: A Systematic Review

Objective.

To summarize patients’ preferences for disease-modifying antirheumatic drug (DMARD) therapy in rheumatoid arthritis (RA).

Methods.

We conducted a systematic review to identify English-language studies of adult patients with RA that measured patients’ preferences for DMARD or health states and treatment outcomes relevant to DMARD decisions. Study quality was assessed using a published quality assessment tool. Data on the importance of treatment attributes and associations with patient characteristics were summarized across studies.

Results.

From 7951 abstracts, we included 36 studies from a variety of countries. Most studies were in patients with established RA and were rated as medium- (n = 19) or high-quality (n = 12). The methods to elicit preferences varied, with the most common being discrete choice experiment (DCE; n = 13). Despite the heterogeneity of attributes in DCE studies, treatment benefits (disease improvement) were usually more important than both non-serious (6 of 8 studies) and serious adverse events (5 of 8), and route of administration (7 of 9). Among the non-DCE studies, some found that patients placed high importance on treatment benefits, while others (in patients with established RA) found that patients were quite risk averse. Subcutaneous therapy was often but not always preferred over intravenous therapy. Patient preferences were variable and commonly associated with the sociodemographic characteristics.

Conclusion.

Overall, the results showed that many patients place a high value on treatment benefits over other treatment attributes, including serious or minor side effects, cost, or route of administration. The variability in patient preferences highlights the need to individualize treatment choices in RA.

Patient Values and Preferences Regarding Continuous Subcutaneous Insulin Infusion and Artificial Pancreas in Adults with Type 1 Diabetes: A Systematic Review of Quantitative and Qualitative Data

OBJECTIVE

We produced, through a systematic review of quantitative and qualitative evidence, a synthesis of the issues of importance (values and preferences) to adult patients with type 1 diabetes regarding treatment with automated insulin delivery systems.

METHODS

We searched MEDLINE, CINAHL, EMBASE, and PsycINFO from the inception of each database through September 2018. We included studies examining patient values and preferences for outcomes related to continuous subcutaneous insulin infusion or artificial pancreas treatment. We compiled structured summaries of the results and assessed the relative importance of each outcome. GRADE (Grading of Recommendations, Assessment Development, and Evaluation) and CERQual (Confidence in Evidence from Reviews of Qualitative research) approaches provided the structure for the evaluation of the quality of evidence and confidence in the findings. A mixed-methods result-based convergent design provided the structure for integration and presentation of results.

RESULTS

We reviewed 1665 unique citations; 19 studies (8 quantitative and 11 qualitative) proved eligible. Glycemic control is the key attribute that drives patients' preference. Reduction of glycemic variability and decreased incidence of hypoglycemia and chronic complications proved of intermediate importance and were ranked similarly to components of treatment burden, including the size and appearance of devices, cost, ease of use, and the embarrassment of public use.

CONCLUSIONS

Clinician guidance may play a crucial role in determining patient values and preferences (for instance, patients' priority in glucose control rather than avoiding diabetic complications). Our results provide guidance for clinicians in discussing preferred insulin delivery systems with patients with type 1 diabetes.

Topic search filters: a systematic scoping review

BACKGROUND

Searching for topics within large biomedical databases can be challenging, especially when topics are complex, diffuse, emerging or lack definitional clarity. Experimentally derived topic search filters offer a reliable solution to effective retrieval; however, their number and range of subject foci remain unknown.

OBJECTIVES

This systematic scoping review aims to identify and describe available experimentally developed topic search filters.

METHODS

Reports on topic search filter development (1990-) were sought using grey literature sources and 15 databases. Reports describing the conception and prospective development of a database-specific topic search and including an objectively measured estimate of its performance ('sensitivity') were included.

RESULTS

Fifty-four reports met inclusion criteria. Data were extracted and thematically synthesised to describe the characteristics of 58 topic search filters.

DISCUSSION

Topic search filters are proliferating and cover a wide range of subjects. Filter reports, however, often lack clear definitions of concepts and topic scope to guide users. Without standardised terminology, filters are challenging to find. Information specialists may benefit from a centralised topic filter repository and appraisal checklists to facilitate quality assessment.

CONCLUSION

Findings will help information specialists identify existing topic search filters and assist filter developers to build on current knowledge in the field.

WHICH DATABASES SHOULD BE USED TO IDENTIFY STUDIES FOR SYSTEMATIC REVIEWS OF ECONOMIC EVALUATIONS?

Objectives:

This study investigated which databases and which combinations of databases should be used to identify economic evaluations (EEs) to inform systematic reviews. It also investigated the characteristics of studies not identified in database searches and evaluated the success of MEDLINE search strategies used within typical reviews in retrieving EEs in MEDLINE.

Methods:

A quasi-gold standard (QGS) set of EEs was collected from reviews of EEs. The number of QGS records found in nine databases was calculated and the most efficient combination of databases was determined. The number and characteristics of QGS records not retrieved from the databases were collected. Reproducible MEDLINE strategies from the reviews were rerun to calculate the sensitivity and precision for each strategy in finding QGS records.

Results:

The QGS comprised 351 records. Across all databases, 337/351 (96 percent) QGS records were identified. Embase yielded the most records (314; 89 percent). Four databases were needed to retrieve all 337 references: Embase + Health Technology Assessment database + (MEDLINE or PubMed) + Scopus. Four percent (14/351) of records could not be found in any database. Twenty-nine of forty-one (71 percent) reviews reported a reproducible MEDLINE strategy. Ten of twenty-nine (34.5 percent) of the strategies missed at least one QGS record in MEDLINE. Across all twenty-nine MEDLINE searches, 25/143 records were missed (17.5 percent). Mean sensitivity was 89 percent and mean precision was 1.6 percent.

Conclusions:

Searching beyond key databases for published EEs may be inefficient, providing the search strategies in those key databases are adequately sensitive. Additional search approaches should be used to identify unpublished evidence (grey literature).

Values and preferences of men for undergoing prostate-specific antigen screening for prostate cancer: a systematic review

OBJECTIVES

To investigate men's values and preferences regarding prostate-specific antigen (PSA)-based screening for prostate cancer.

DESIGN

Systematic review.

DATA SOURCES

We searched MEDLINE, EMBASE, PsycINFO and grey literature up to 2 September 2017.

ELIGIBILITY CRITERIA

Primary studies of men's values and preferences regarding the benefits and harms of PSA screening.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers extracted data and assessed risk of bias with a modified version of a risk of bias tool for values and preferences studies, the International Patient Decision Aid Standards instrument V.3 and the Cochrane Collaboration risk of bias tool.

RESULTS

We identified 4172 unique citations, of which 11 studies proved eligible. Five studies investigated PSA screening using a direct choice study design, whereas six used decisions aids displaying patient-important outcomes. The direct choice studies used different methodologies and varied considerably in the reporting of outcomes. Two studies suggested that men were willing to forego screening with a small benefit in prostate cancer mortality if it would decrease the likelihood of unnecessary treatment or biopsies. In contrast, one study reported that men were willing to accept a substantial overdiagnosis to reduce their risk of prostate cancer mortality. Among the six studies involving decision aids, willingness to undergo screening varied substantially from 37% when displaying a hypothetical reduction in mortality of 10 per 1000 men, to 44% when displaying a reduction in mortality of 7 per 1000. We found no studies that specifically investigated whether values and preferences differed among men with family history, of African descent or with lower socioeconomic levels.

CONCLUSION

The variability of men's values and preferences reflect that the decision to screen is highly preference sensitive. Our review highlights the need for shared decision making in men considering prostate cancer screening.

TRIAL REGISTRATION NUMBER

CRD42018095585.

A systematic review of how patients value COPD outcomes

Our objective was to summarise systematically all research evidence related to how patients value outcomes in chronic obstructive pulmonary disease (COPD).We conducted a systematic review (systematic review registration number CRD42015015206) by searching PubMed, Embase, PsycInfo and CINAHL, and included reports that assessed the relative importance of outcomes from COPD patients' perspective. Two authors independently determined the eligibility of studies, abstracted the eligible studies and assessed risk of bias. We narratively summarised eligible studies, meta-analysed utilities for individual outcomes and assessed the certainty of evidence using the Grading of Recommendations, Assessment, Development and Evaluations approach.We included 217 quantitative studies. Investigators most commonly used utility measurements of outcomes (n=136), discrete choice exercises (n=13), probability trade-off (n=4) and forced choice techniques (n=46). Patients rated adverse events as important but on average, less so than symptom relief. Exacerbation and hospitalisation due to exacerbation are the outcomes that COPD patients rate as most important. This systematic review provides a comprehensive registry of related studies.

Continuous surveillance of a pregnancy clinical guideline: an early experience

BACKGROUND

To date there is no consensus about the optimal strategy for keeping clinical guidelines (CGs) up-to-date. The aims of this study were (1) to develop a continuous surveillance and updating strategy for CGs and (2) to test the strategy in a specific CG.

METHODS

The main steps were as follows: (1) recruiting members for the CG Updating Working Group, (2) mapping the CG, (3) identifying new evidence from the CG Updating Working Group, (4) designing and running restricted literature searches, (5) reviewing drugs and medical devices alerts, (6) screening and assessing the new evidence, (7) reviewing and, if necessary, modifying clinical questions and recommendations, and (8) updating the CG document.

RESULTS

The Pregnancy CG Updating Working Group consisted of 29 members, including clinicians, patients and caregivers, and clinical guideline methodology experts. We selected 69 clinical questions (123 recommendations) from the "Assistance during pregnancy" section. For the first update cycle (32-month duration), 9710 references were identified. Of these, 318 were pertinent, 289 were relevant, and 55 were classified as potential key references. For the second and third update cycles (6-month duration each), 2160 and 2010 references were retrieved, respectively. The continuous surveillance and updating strategy has not yet been completely implemented.

CONCLUSIONS

Further resources are needed in updating the CG field, both for implementing updating strategies and for developing methodological research.