A global, incremental development method for a web-based prostate cancer treatment decision aid and usability testing in a Dutch clinical setting

Effectiveness of computerised decision aids for patients with chronic diseases in shared decision-making: A systematic review and meta-analysis

AIMS

To synthesise the composition and effectiveness of computer-based patient decision aid (PDAs) in interventions for patients with chronic diseases.

DESIGN

A systematic review with meta-analysis.

METHODS

Five databases were searched, and only randomised controlled trials (RCTs)were included. This review was conducted with the PRISMA guidelines. The JBI Appraisal Tools for randomised trials were used to assess the risk of bias. We used the random-effects model to conduct meta-analyses. Evidence from RCTs was synthesised using standardised mean differences or mean differences. The GRADE system was employed to assess the certainty of evidence and recommendations. This study was registered on PROSPERO (number: CRD42022369340).

DATA SOURCES

PubMed, Embase, Web of Science, CINAHL and Cochrane Library were searched for studies published before October 2022.

RESULTS

The review included 22 studies, and most computer-based PDAs reported information on the disease, treatment options, pros and cons and risk comparison and value clarification. The use of computer-based PDAs showed a significant effect on decision conflict and knowledge, but not on decision regret, satisfaction, self-efficacy, anxiety and quality of life. The overall GRADE certainty of evidence was low.

CONCLUSION

Although the quality of evidence was low, however, using computer-based PDAs could reduce decision conflict and enhance knowledge when making medical decisions. More research is needed to support the contention above.

RELEVANCE TO CLINICAL PRACTICE

Computer-based PDAs could assist health-care providers and patients in the shared decision-making process and improving the quality of decision-making.

REPORTING METHOD

This study adhered to PRISMA guidelines. NO PATIENT OR PUBLIC CONTRIBUTION.

Prediction models of incontinence and sexual function one year after radical prostatectomy based on data from 20 164 prostate cancer patients

BACKGROUND

Incontinence and sexual dysfunction are long-lasting side effects after surgical treatment (radical prostatectomy, RP) of prostate cancer (PC). For an informed treatment decision, physicians and patients should discuss expected impairments. Therefore, this paper firstly aims to develop and validate prognostic models that predict incontinence and sexual function of PC patients one year after RP and secondly to provide an online decision making tool.

METHODS

Observational cohorts of PC patients treated between July 2016 and March 2021 in Germany were used. Models to predict functional outcomes one year after RP measured by the EPIC-26 questionnaire were developed using lasso regression, 80-20 splitting of the data set and 10-fold cross validation. To assess performance, R2, RMSE, analysis of residuals and calibration-in-the-large were applied. Final models were externally temporally validated. Additionally, percentages of functional impairment (pad use for incontinence and firmness of erection for sexual score) per score decile were calculated to be used together with the prediction models.

RESULTS

For model development and internal as well as external validation, samples of 11 355 and 8 809 patients were analysed. Results from the internal validation (incontinence: R2 = 0.12, RMSE = 25.40, sexual function: R2 = 0.23, RMSE = 21.44) were comparable with those of the external validation. Residual analysis and calibration-in-the-large showed good results. The prediction tool is freely accessible: https://nora-tabea.shinyapps.io/EPIC-26-Prediction/.

CONCLUSION

The final models showed appropriate predictive properties and can be used together with the calculated risks for specific functional impairments. Main strengths are the large study sample (> 20 000) and the inclusion of an external validation. The models incorporate meaningful and clinically available predictors ensuring an easy implementation. All predictions are displayed together with risks of frequent impairments such as pad use or erectile dysfunction such that the developed online tool provides a detailed and informative overview for clinicians as well as patients.

Methodologies for Evaluating the Usability of Rehabilitation Technologies Aimed at Supporting Shared Decision-Making: Scoping Review

BACKGROUND

The field of rehabilitation has seen a recent rise in technologies to support shared decision-making (SDM). Usability testing during the design process of SDM technologies is needed to optimize adoption and realize potential benefits. There is variability in how usability is defined and measured. Given the complexity of usability, a thorough examination of the methodologies used to measure usability to develop the SDM technologies used in rehabilitation care is needed.

OBJECTIVE

This scoping review aims to answer the following research questions: which methods and measures have been used to produce knowledge about the usability of rehabilitation technologies aimed at supporting SDM at the different phases of development and implementation? Which parameters of usability have been measured and reported?

METHODS

This review followed the Arksey and O'Malley framework. An electronic search was performed in the Ovid MEDLINE, Embase, CINAHL, and PsycINFO databases from January 2005 up to November 2020. In total, 2 independent reviewers screened all retrieved titles, abstracts, and full texts according to the inclusion criteria and extracted the data. The International Organization for Standardization framework was used to define the scope of usability (effectiveness, efficiency, and satisfaction). The characteristics of the studies were outlined in a descriptive summary. Findings were categorized based on usability parameters, technology interventions, and measures of usability.

RESULTS

A total of 38 articles were included. The most common SDM technologies were web-based aids (15/33, 46%). The usability of SDM technologies was assessed during development, preimplementation, or implementation, using 14 different methods. The most frequent methods were questionnaires (24/38, 63%) and semistructured interviews (16/38, 42%). Satisfaction (27/38, 71%) was the most common usability parameter mapped to types of SDM technologies and usability evaluation methods. User-centered design (9/15, 60%) was the most frequently used technology design framework.

CONCLUSIONS

The results from this scoping review highlight the importance and the complexity of usability evaluation. Although various methods and measures were shown to be used to evaluate the usability of technologies to support SDM in rehabilitation, very few evaluations used in the included studies were found to adequately span the selected usability domains. This review identified gaps in usability evaluation, as most studies (24/38, 63%) relied solely on questionnaires rather than multiple methods, and most questionnaires simply focused on the usability parameter of satisfaction. The consideration of end users (such as patients and clinicians) is of particular importance for the development of technologies to support SDM, as the process of SDM itself aims to improve patient-centered care and integrate both patient and clinician voices into their rehabilitation care.

Taking shared decision making for prostate cancer to the next level: Requirements for a Dutch treatment decision aid with personalized risks on side effects

BACKGROUND

Different curative treatment modalities need to be considered in case of localized prostate cancer, all comparable in terms of survival and recurrence though different in side effects. To better inform patients and support shared decision making, the development of a web-based patient decision aid including personalized risk information was proposed. This paper reports on requirements in terms of content of information, visualization of risk profiles, and use in practice.

METHODS

Based on a Dutch 10-step guide about the setup of a decision aid next to a practice guideline, an iterative and co-creative design process was followed. In collaboration with various groups of experts (health professionals, usability and linguistic experts, patients and the general public), research and development activities were continuously alternated.

RESULTS

Content requirements focused on presenting information only about conventional treatments and main side effects; based on risk group; and including clear explanations about personalized risks. Visual requirements involved presenting general and personalized risks separately; through bar charts or icon arrays; and along with numbers or words, and legends. Organizational requirements included integration into local clinical pathways; agreement about information input and output; and focus on patients' numeracy and graph literacy skills.

CONCLUSIONS

The iterative and co-creative development process was challenging, though extremely valuable. The translation of requirements resulted in a decision aid about four conventional treatment options, including general or personalized risks for erection, urinary and intestinal problems that are communicated with icon arrays and numbers. Future implementation and validation studies need to inform about use and value in practice.

Examining the effectiveness and implementation of patient treatment decision-aid tools for men with localised prostate cancer: A systematic review

OBJECTIVE

Men diagnosed with localised prostate cancer (LPC) often face a difficult process deciding on a treatment choice that suits their personal preferences. This systematic review examines the impact of patient treatment decision-aids (DAs) on decisional outcomes and treatment choice for men diagnosed with LPC. Our secondary aim was to examine how DAs have been implemented into routine clinical practice.

METHODS

A systematic search was conducted up to June 2022 using the following databases: Medline, Embase, PsycINFO, CINAHL, Cochrane, Scopus, and Web of Science. Articles were included if they evaluated the effectiveness of treatment DAs for LPC patients on various decisional outcomes and treatment choice. The Mixed-Method Appraisal Tool was used to assess methodological quality and risk of bias. Data on implementation outcomes were also extracted if reported.

RESULTS

Twenty-four articles were included for the analysis (seven non-randomised studies, 16 randomised control trials, and one qualitative study). Results showed DAs have the potential to improve patient knowledge but revealed no effects on decisional regret or preparedness in decision-making. Due to the variability in methodology among studies, results varied widely for treatment choice, decision-making involvement, decisional conflict, and treatment decision satisfaction. At least one implementation outcome was reported in 11 of the included studies, with the most commonly assessed outcomes being acceptability and appropriateness.

CONCLUSIONS

While DAs appear to improve knowledge, further qualitative evaluations and standardised assessments are needed to better understand men's experiences using DAs and to determine advantages and optimal ways to implement DAs into the treatment decision-making pathway.

eHealth Interventions for Dutch Cancer Care: Systematic Review Using the Triple Aim Lens

Background

Globally, the burden of cancer on population health is growing. Recent trends such as increasing survival rates have resulted in a need to adapt cancer care to ensure a good care experience and manageable expenditures. eHealth is a promising way to increase the quality of cancer care and support patients and survivors.

Objective

The aim of this systematic review was 2-fold. First, we aimed to provide an overview of eHealth interventions and their characteristics for Dutch patients with and survivors of cancer. Second, we aimed to provide an overview of the empirical evidence regarding the impact of eHealth interventions in cancer care on population health, quality of care, and per capita costs (the Triple Aim domains).

Methods

The electronic databases Web of Science, PubMed, Cochrane, and Ovid PsycINFO were searched using 3 key search themes: eHealth interventions, cancer care, and the Netherlands. The identified interventions were classified according to predetermined criteria describing the intervention characteristics (eg, type, function, and target population). Their impact was subsequently examined using the Triple Aim framework.

Results

A total of 38 interventions were identified. Most of these were web portals or web applications functioning to inform and self-manage, and target psychosocial factors or problems. Few interventions have been tailored to age, disease severity, or gender. The results of this study indicate that eHealth interventions could positively affect sleep quality, fatigue, and physical activity of patients with and survivors of cancer. Inconclusive results were found regarding daily functioning and quality of life, psychological complaints, and psychological adjustment to the disease.

Conclusions

eHealth can improve outcomes in the Triple Aim domains, particularly in the population health and quality of care domains. Cancer-related pain and common symptoms of active treatment were not targeted in the included interventions and should receive more attention. Further research is needed to fully understand the impact of eHealth interventions in cancer care on participation, accessibility, and costs. The latter can be examined in economic evaluations by comparing eHealth interventions with care as usual.

Development of a patient decision aid for patients with breast cancer who consider immediate breast reconstruction after mastectomy

Purpose

The aim of this study was to develop a patient decision aid (pDA) that could support patients with breast cancer (BC) in making an informed decision about breast reconstruction (BR) after mastectomy.

Methods

The development included four stages: (i) Establishment of a multidisciplinary team; (ii) Needs assessment consisting of semi‐structured interviews in patients and a survey among healthcare professionals (HCPs); (iii) Creation of content, design and technical system; and (iv) Acceptability and usability testing using a think‐aloud approach in patients and interviews among HCPs and representatives of the Dutch Breast Cancer Patient Organization.

Results

From the needs assessment, three themes were identified: Challenging period to make a decision, Diverse motivations for a personal decision and Information needed to make a decision about BR. HCPs valued the development of a pDA, especially to prepare patients for consultation. The pDA that was developed contained three parts: first, a consultation sheet for oncological breast surgeons to introduce the choice; second, an online tool including an overview of reconstructive options, the pros and cons of each option, information on the consequences of each option for daily life, exercises to clarify personal values and patient stories; and third, a summary sheet with patients’ values, preferences and questions to help inform and guide the discussion between the patient and her plastic surgeon. The pDA was perceived to be informative, helpful and easy to use by patients and HCPs.

Conclusion

Consistent with information needs, a pDA was developed to support patients with BC who consider immediate BR in making an informed decision together with their plastic surgeon.

Patient or Public Contribution

Patients participated in the needs assessment and in acceptability and usability testing.

Feature selection with ensemble learning for prostate cancer diagnosis from microarray gene expression

Cancer diagnosis using machine learning algorithms is one of the main topics of research in computer-based medical science. Prostate cancer is considered one of the reasons that are leading to deaths worldwide. Data analysis of gene expression from microarray using machine learning and soft computing algorithms is a useful tool for detecting prostate cancer in medical diagnosis. Even though traditional machine learning methods have been successfully applied for detecting prostate cancer, the large number of attributes with a small sample size of microarray data is still a challenge that limits their ability for effective medical diagnosis. Selecting a subset of relevant features from all features and choosing an appropriate machine learning method can exploit the information of microarray data to improve the accuracy rate of detection. In this paper, we propose to use a correlation feature selection (CFS) method with random committee (RC) ensemble learning to detect prostate cancer from microarray data of gene expression. A set of experiments are conducted on a public benchmark dataset using 10-fold cross-validation technique to evaluate the proposed approach. The experimental results revealed that the proposed approach attains 95.098% accuracy, which is higher than related work methods on the same dataset.

Differences in treatment choices between prostate cancer patients using a decision aid and patients receiving care as usual: results from a randomized controlled trial

Objective

To determine whether or not decision aid (DA) use influences treatment decisions in patients with low and intermediate risk prostate cancer (PC).

Patients and methods

In a cluster randomized controlled trial, patients were randomized to either DA use (DA group) or no DA use (control group). Between 2014 and 2016, newly diagnosed patients with low or intermediate risk PC were recruited in 18 hospitals in the Netherlands. DA users had access to a web-based DA that provided general PC information, PC-treatment information, and values clarification exercises to elicit personal preferences towards the treatment options. Control group patients received care as usual. Differences in treatment choice were analysed using multilevel logistic regressions. Differences in eligible treatment options between groups were compared using Pearson Chi-square tests.

Results

Informed consent was given by 382 patients (DA group N = 273, control group N = 109). Questionnaire response rate was 88% (N = 336). Active surveillance (AS) was an option for 38%, radical prostatectomy (RP) for 98%, external beam radiotherapy (EBRT) for 88%, and brachytherapy (BT) for 79% of patients. DA users received AS significantly more often than control group. Patients (29 vs 16%, p = 0.01), whereas the latter more often chose BT (29 vs 18%, p < 0.01). No differences were found between groups regarding RP and EBRT. DA users who were not eligible for AS, received surgery more often compared to the control group (53 vs 35%, p = 0.01). Patient and disease characteristics were evenly distributed between groups.

Conclusion

DA-using PC patients chose the AS treatment option more often than non-DA-using patients did.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00345-021-03782-7.

Decision Aids for Shared Decision-making in Uro-oncology: A Systematic Review

CONTEXT

Decision aids (DAs) aim to support patients in the process of shared decision-making for complex treatment decisions. To improve patient-centered care in uro-oncology, it is essential to evaluate the availability and quality of existing DAs.

OBJECTIVE

To assess the quality of existing DAs for patients across the most prevalent uro-oncological entities.

EVIDENCE ACQUISITION

This study was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) guidelines. A systematic literature search (MedLine, Cochrane Library, Web of Science Core Collection, and CCMed) was conducted to identify DAs for treatment decisions for patients with prostate, renal, or bladder cancer. All studies reporting on the development or evaluation of DAs were included. The DAs were examined based on the International Patient Decision Aid Standards (IPDAS) and the evaluation studies were compared in accordance with Standards for Universal reporting of a patient Decision Aid Evaluations (SUNDAE).

EVIDENCE SYNTHESIS

The literature search identified 1995 potentially relevant publications. Thirty-two studies reporting on 25 DAs met the inclusion criteria. Twenty-two DAs address prostate cancer, two renal tumor, and one bladder cancer. In the majority of DAs (n = 20), patients can enter individual data. A few (n = 6) DAs allow for personalization using a risk-adapted presentation of treatment options. The percentage of IPDAS criteria met in DAs ranged between 50% and 100% (median 87.5%), and the studies' adherence to the SUNDAE checklist was between 62% and 96% (median 86.6%). Evaluation studies suggest that interventions are likely efficacious. However, a preliminary meta-analysis revealed no significant difference between "DA" and "usual care" for decisional conflict or decisional regret.

CONCLUSIONS

This review highlights that a number of well-developed DAs exist in urology. However, there is a need for specific instruments targeting kidney and bladder cancer. Personalization of tools and adherence to international standards of DAs should be further improved.

PATIENT SUMMARY

The majority of uro-oncological decision aids target prostate cancer, whereas fewer address kidney or bladder cancer. The quality of the existing instruments is high, but can be increased further to better address specific needs of individual patients.

Introducing Decision Aids into Routine Prostate Cancer Care in The Netherlands: Implementation and Patient Evaluations from the Multi-regional JIPPA Initiative

Uptake of decision aids (DAs) in daily routine is low, resulting in limited knowledge about successful DA implementation at a large scale. We assessed implementation rates after multi-regional implementation of three different prostate cancer (PCa) treatment DAs and patient-perceived barriers and facilitators to use a DA. Thirty-three hospitals implemented one out of the three DAs in routine care. Implementation rates for each DA were calculated per hospital. After deciding about PCa treatment, patients (n = 1033) completed a survey on pre-formulated barriers and facilitators to use a DA. Overall DA implementation was 40%. For each DA alike, implementation within hospitals varied from incidental (< 10% of eligible patients receiving a DA) to high rates of implementation (> 80%). All three DAs were evaluated positively by patients, although concise and paper DAs yielded higher satisfaction scores compared with an elaborate online DA. Patients were most satisfied when they received the DA within a week after diagnosis. Pre-formulated barriers to DA usage were experienced by less than 10% of the patients, and most patients confirmed the facilitators. Many patients received a DA during treatment counseling, although a wide variation in uptake across hospitals was observed for each DA. Most patients were satisfied with the DA they received. Sustained implementation of DAs in clinical routine requires further encouragement and attention.

Development and usability testing of a multi-criteria value clarification methods for patients with localized prostate cancer

Current guidelines for the development of decision aids recommend that they have to include a process for helping patients clarify their personal values, for example, by using values clarification methods. In this article, we extensively described the development process of the web-based values clarification method for patients with localized low- to intermediate-risk prostate cancer based on the analytic hierarchy process. With analytic hierarchy process, the relative importance of different attributes of available treatments can be determined through series of pairwise comparisons of potential outcomes. Furthermore, analytic hierarchy process is able to use this information to present respondents with a quantitative overall treatment score and can therefore give actual treatment advice upon patients’ request. The addition of this values clarification method to an existing web-based treatment decision aid for patients with localized prostate cancer is thought to improve the support offered to patients in their decision-making process and their decision quality.

Longitudinal regret and information satisfaction after deciding on treatment for localized prostate cancer with or without a decision aid. Results at one-year follow-up in the PCPCC trial

OBJECTIVE

To investigate the effect of including an online decision aid (DA) during prostate cancer treatment counseling on decisional regret and information satisfaction in a one-year follow-up.

METHODS

Within a cluster RCT, 18 Dutch hospitals were randomized to DA counseling or care-as-usual, patients (n = 382) initially completed questionnaires directly after treatment decision making. Six and twelve months later regret (Decisional Regret Scale) and information satisfaction (SCIP-B) were assessed. Anxious and depressive symptoms (HADS) was included as possible covariate.

RESULTS

After 12 months, 43 participants (15%) regretted their treatment choice and 105 participants (36%) were dissatisfied with the information that was received at the time of decision-making, regardless of being exposed to the DA. Anxious and depressive symptoms at follow-up were associated with regret and information dissatisfaction.

CONCLUSION

No long-term benefical effects emerged from DA usage compared to patients who underwent standard counseling.

PRACTICE IMPLICATIONS

During PCa treatment counseling, healthcare providers should be aware of anxious and depressive symptoms.

Mind the gap: Physicians' assessment of patients' importance weights in localized prostate cancer

BACKGROUND

The management of localized prostate cancer is challenging because of the many therapeutic options available, none of which is generally acknowledged as superior to the others in every respect. The selection of the most appropriate treatment should therefore reflect patients' preferences.

OBJECTIVE

The purpose of the following study was to pilot a new approach for investigating whether urologists who had previously provided patients with therapeutic advice actually knew their patients' importance weights concerning the relevant aspects of the treatments at issue.

METHOD

Participants were patients recently diagnosed with localized prostate cancer (n = 20), urologists (n = 10), and non-medical professionals (architects, n = 10). These last served as a control group for the urologists and were matched to them for age and gender. Patients' importance weights were elicited by two standard methods (Direct Rating and Value Hierarchy). Each urologist was asked to estimate (with Direct Rating) his/her patient's importance weights. The same task was performed by a corresponding architect, who never met the patient and knew only the patient's age. Univariate and bivariate statistical analyses were performed to investigate the association between importance weights as elicited from patients and as estimated by urologists and architects, as well as to assess whether such agreement was attribute-dependent.

RESULTS

Participants found both elicitation methods easy to use. The correlation between patients' actual importance weights and urologists' estimates was poor and comparable to that obtained between patients and architects. This result did not depend on the attribute considered, with the sole exception of the attribute "Effectiveness in curing the cancer", which was evaluated as the most important attribute by the majority of participants.

CONCLUSION

These findings demonstrate the feasibility of the employed methodology and highlight the need to support preference-sensitive decisions in clinical practice by facilitating the elicitation of patients' importance weights, as well as their communication to physicians.

Uptake and usage of an online prostate cancer treatment decision aid in Dutch clinical practice: A quantitative analysis from the Prostate Cancer Patient Centered Care trial

Implementation of patient’s decision aids in routine clinical care is generally low. This study evaluated uptake and usage of a novel Dutch web-based prostate cancer treatment decision aid within the Prostate Cancer Patient Centered Care trial. From an estimated total patient sample of 1006 patients, 351 received a decision aid (35% implementation rate; hospital ranges 16%–84%). After receipt of the decision aid, most patients accessed the decision aid, utilized most functions, although not completely, and discussed the decision aid summary in a subsequent consultation with their care provider. Including nurses for dissemination of decision aids seemed to positively affect decision aid uptake. Once received, patients seemed able to use the decision aid and engage in shared decision-making as intended; however, decision aid uptake and complete usage of all decision aid components should be further improved. Prior to the diagnosis consultation, handing out of the decision aid should be prepared.

Impact of a web-based prostate cancer treatment decision aid on patient-reported decision process parameters: results from the Prostate Cancer Patient Centered Care trial

Purpose

To compare patients’ evaluation of the treatment decision-making process in localized prostate cancer between counseling that included an online decision aid (DA) and standard counseling.

Methods

Eighteen Dutch hospitals were randomized to DA counseling (n = 235) or the control group with standard counseling (n = 101) in a pragmatic, cluster randomized controlled trial. The DA was provided to patients at, or soon after diagnosis. Decisional conflict, involvement, knowledge, and satisfaction with information were assessed with a questionnaire after treatment decision-making. Anxiety and depression served as covariates.

Results

The levels of decision involvement and conflict were comparable between patients in both groups. Patients with a DA felt more knowledgeable but scored equally well on a knowledge test as patients without a DA. Small significant negative effects were found on satisfaction with information and preparation for decision-making. A preference for print over online and depression and anxiety symptoms was negatively associated with satisfaction and conflict scores in the DA group.

Discussion

The DA aimed to support shared decision-making, while outcomes for a majority of DA users were comparable to patients who received standard counseling. Patients, who are less comfortable with the online DA format or experience anxiety or depression symptoms, could require more guidance toward shared decision-making. To evaluate long-term DA effects, follow-up evaluation on treatment satisfaction and decisional regret will be done.