Toward a model for field-testing patient decision-support technologies: a qualitative field-testing study

Providing Balanced Information about Options in Patient Decision Aids: An Update from the International Patient Decision Aid Standards

BACKGROUND

The objective of this International Patient Decision Aids Standard (IPDAS) review is to update and synthesize theoretical and empirical evidence on how balanced information can be presented and measured in patient decision aids (PtDAs).

METHODS

A multidisciplinary team conducted a scoping review using 2 search strategies in multiple electronic databases evaluating the ways investigators defined and measured the balance of information provided about options in PtDAs. The first strategy combined a search informed by the Cochrane Review of the Effectiveness of Decision Aids with a search on balanced information. The second strategy repeated the search published in the 2013 IPDAS update on balanced presentation.

RESULTS

Of 2450 unique citations reviewed, the full text of 168 articles was screened for eligibility. Sixty-four articles were included in the review, of which 13 provided definitions of balanced presentation, 8 evaluated mechanisms that may introduce bias, and 42 quantitatively measured balanced with methods consistent with the IPDAS criteria in PtDAs. The revised definition of balanced information is, "Objective, complete, salient, transparent, evidence-informed, and unbiased presentation of text and visual information about the condition and all relevant options (with important elements including the features, benefits, harms and procedures of those options) in a way that does not favor one option over another and enables individuals to focus attention on important elements and process this information."

CONCLUSIONS

Developers can increase the balance of information in PtDAs by informing their structure and design elements using the IPDAS checklist. We suggest that new PtDA components pertaining to balance be evaluated for cognitive bias with experimental methods as well by objectively evaluating patients' and content experts' beliefs from multiple perspectives.

Adapting a Traumatic Brain Injury Goals-of-Care Decision Aid for Critically Ill Patients to Intracerebral Hemorrhage and Hemispheric Acute Ischemic Stroke

Supplemental Digital Content is available in the text.

Objectives:

Families in the neurologic ICU urgently request goals-of-care decision support and shared decision-making tools. We recently developed a goals-of-care decision aid for surrogates of critically ill traumatic brain injury patients using a systematic development process adherent to the International Patient Decision Aid Standards. To widen its applicability, we adapted this decision aid to critically ill patients with intracerebral hemorrhage and large hemispheric acute ischemic stroke.

Design:

Prospective observational study.

Setting:

Two academic neurologic ICUs.

Subjects:

Twenty family members of patients in the neurologic ICU were recruited from July 2018 to October 2018.

Interventions:

None.

Measurements and Main Results:

We reviewed the existing critically ill traumatic brain injury patients decision aid for content and changed: 1) the essential background information, 2) disease-specific terminology to “hemorrhagic stroke” and “ischemic stroke”, and 3) disease-specific prognosis tailored to individual patients. We conducted acceptability and usability testing using validated scales. All three decision aids contain information from validated, disease-specific outcome prediction models, as recommended by international decision aid standards, including careful emphasis on their uncertainty. We replaced the individualizable icon arrays graphically depicting probabilities of a traumatic brain injury patient’s prognosis with icon arrays visualizing intracerebral hemorrhage and hemispheric acute ischemic stroke prognostic probabilities using high-quality disease-specific data. We selected the Intracerebral Hemorrhage Score with validated 12-month outcomes, and for hemispheric acute ischemic stroke, the 12-month outcomes from landmark hemicraniectomy trials. Twenty family members participated in acceptability and usability testing (n = 11 for the intracerebral hemorrhage decision aid; n = 9 for the acute ischemic stroke decision aid). Median usage time was 22 minutes (interquartile range, 16–26 min). Usability was excellent (median System Usability Scale = 84/100 [interquartile range, 61–93; with > 68 indicating good usability]); 89% of participants graded the decision aid content as good or excellent, and greater than or equal to 90% rated it favorably for information amount, balance, and comprehensibility.

Conclusions:

We successfully adapted goals-of-care decision aids for use in surrogates of critically ill patients with intracerebral hemorrhage and hemispheric acute ischemic stroke and found excellent usability and acceptability. A feasibility trial using these decision aids is currently ongoing to further validate their acceptability and test their feasibility for use in busy neurologic ICUs.

Stakeholders perspectives and deployment strategies of health information exchange illustrated through an in-depth case study of Pakistan

Background: Ready access to reliable data is essential to support decision-making in patient care planning and delivery. Health information exchange (HIE), which is fundamental to achieve this, is currently limited in many low- and middle-income countries (LMICs), reflecting the lack of prioritization of this issue and the many barriers to its successful implementation.Objective: We sought to explore and understand stakeholders' perspectives on the context of and deployment strategies for HIE in Pakistan.Method: Data collection comprised interviews with purposefully selected groups of stakeholders across Pakistan, field notes, and a critical review of key national and international policy documents.Results: We identified reports of small pockets of effective HIE existing mainly in private hospitals, but in a patchy and fragmented form overall. Many problems were attributed to the absence of effective HIE, these ranging from 'delays in retrieving records' to contributing to 'the increase in antibiotic resistance'. The mindset of policymakers, poor infrastructure, lack of finance, training and data interoperability, and health-care providers' resistance to recording consultations due to poor documentation skills and concerns about liability considerations were highlighted as major barriers to HIE. Sharing regional health information with international organizations was perceived by some participants to increase the risk of regional espionage. A clear government policy directive for evidence-based decision-making, constant supply of electricity, training, widespread adoption of common data standards and public pressure to adopt mobile technology frameworks were identified as potential facilitators of HIE.Conclusion: HIE can be achieved with the support of the federal and provincial governments coupled with financial and technical backing from international donor organizations. The transition to HIE is likely to be very dependent on improving governance capabilities and bolstering the informatics skill-base in Pakistan and indeed many other LMICs.

Health Disparities and the Digital Divide: The Relationship between Communication Inequalities and Quality of Life among Women in a Nationwide Prospective Cohort Study in the United States

Background: Communication inequalities can affect health-seeking behaviors yet the relationship between Internet use and overall health is inconclusive. Communication-related inequalities vary by race/ethnicity and SES but existing research primarily includes middle-class Whites. We therefore examined the relationship between communication-related inequalities-measured by daily Internet use-and health-related quality of life (QOL) using a nationwide prospective cohort study in the United States that consists of primarily low income, minority women. Methods: We examined Internet use and QOL among participants in the Women's Interagency HIV Study. Data collection occurred from October 2014-September 2015 in Chicago, New York, Washington DC, San Francisco, Atlanta, Chapel Hill, Birmingham/Jackson and Miami. We used multi-variable analyses to examine the relationship between daily Internet use and QOL. Results: The sample of 1,915 women was 73% African American and 15% Hispanic; 53% reported an annual income of ≤$12,000. Women with daily Internet use reported a higher QOL at six months, as did women with at least a high school diploma, income >$12,000, and non-White race; older women and those with reported drug use, depressive symptoms and loneliness had lower QOL. Conclusions: Overcoming communication inequalities may be one pathway through which to improve overall QOL and address public health priorities. Reducing communication-related inequalities-e.g, by providing reliable Internet access-and thus improving access to health promoting information, may lead to improved health outcomes.

End-user involvement in developing and field testing an online contraceptive decision aid

OBJECTIVES

Decision aids in the field of healthcare contribute to informed decision making. To increase the usefulness and effectiveness of decision aids, it is important to involve end-users in the development of these tools. This article reports on the development of an online contraceptive decision aid.

METHODS

An exploratory, qualitative study was conducted in the Netherlands between 2014 and 2016. The development process of the decision aid consisted of six steps and included a needs assessment and field test. Interviews were conducted with 17 female students.

RESULTS

The needs assessment provided information on the preferred content and structure of a contraceptive decision aid and guided the development of the online contraceptive decision aid prototype. Participants had an overall positive impression of the decision aid prototype during the field test. Minor revisions were made based on participants' feedback. Participants expected that the decision aid would positively contribute to decision making by increasing knowledge and awareness regarding the available contraceptive methods and their features and attributes, and by opening up to other options than the known methods.

CONCLUSION

The developed contraceptive decision aid can contribute to better informed decision making and consultation preparation. Involving end-users in development seems valuable to adapt decision aids to specific needs and to identify in what way a decision aid influences decision making.

Developing a patient decision aid for the treatment of women with early stage breast cancer: the struggle between simplicity and complexity

Background

A patient decision aid (PtDA) can support shared decision making (SDM) in preference-sensitive care, with more than one clinically applicable treatment option. The development of a PtDA is a complex process, involving several steps, such as designing, developing and testing the draft with all the stakeholders, known as alpha testing. This is followed by testing in ‘real life’ situations, known as beta testing, and then finalising the definite version.

Our aim was developing and alpha testing a PtDA for primary treatment of early stage breast cancer, ensuring that the tool is considered relevant, valid and feasible by patients and professionals.

Methods

Our qualitative descriptive study applied various methods including face-to-face think-aloud interviews, a focus group and semi-structured telephone interviews. The study population consisted of breast cancer patients facing the choice between breast-conserving therapy with or without preceding neo-adjuvant chemotherapy and mastectomy, and professionals involved in breast cancer care in dedicated multidisciplinary breast cancer teams.

Results

A PtDA was developed in four iterative test rounds, taking nearly 2 years, involving 26 patients and 26 professionals. While the research group initially opted for simplicity for the sake of implementation, the clinicians objected that the complexity of the decision could not be ignored. Other topics of concern were the conflicting views of professionals and patients regarding side effects, the amount of information and how to present it.

Conclusion

The development was an extensive process, because the professionals rejected the simplifications proposed by the research group. This resulted in the development of a completely new draft PtDA, which took double the expected time and resources. The final version of the PtDA appeared to be well-appreciated by professionals and patients, although its acceptability will only be proven in actual practice (beta testing).

Trial registration

NTR TC 5721.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-017-0505-6) contains supplementary material, which is available to authorized users.

Decision support in addiction: The development of an e-health tool to assess and prevent risk of fatal overdose. The ORION Project

BACKGROUND AND OBJECTIVE

The application of e-health technology to the field of substance use disorders is at a relatively early stage, and methodological quality is still variable. Few have explored the extent of utilization of communication technology in exploring risk perception by patients enrolled in substance abuse services. The Overdose RIsk InfOrmatioN (ORION) project is a European Commission funded programme, aimed to develop and pilot an e-health psycho-educational tool to provide information to drug using individuals about the risks of suffering a drug overdose.

METHODS

In this article, we report on phase 1 (risk estimation), phase 2 (design), and phase 3 (feasibility) of the ORION project.

RESULTS

The development of ORION e-health tool underlined the importance of an evidence-based intervention aimed in obtaining reliable evaluation of risk. The ORION tool supported a decision making process aimed at influencing the substance users' self-efficacy and the degree to which the substance users' understand risk factors. Therefore, its innovative power consisted in translating risks combination into a clear estimation for the user who will then appear more likely to be interested in his/her risk perception.

CONCLUSION

Exploratory field testing and validation confirmed the next stage of evaluation, namely, collection of routine patient samples in study clinics. The associations between risk perception of overdose, engagement with the ORION tool and willingness to alter overdose risk factors, in a clinical setting across various EU member states will further confirm the ORION tool's generalisability and effectiveness.

Launching a virtual decision lab: development and field-testing of a web-based patient decision support research platform

BACKGROUND

Over 100 trials show that patient decision aids effectively improve patients' information comprehension and values-based decision making. However, gaps remain in our understanding of several fundamental and applied questions, particularly related to the design of interactive, personalized decision aids. This paper describes an interdisciplinary development process for, and early field testing of, a web-based patient decision support research platform, or virtual decision lab, to address these questions.

METHODS

An interdisciplinary stakeholder panel designed the web-based research platform with three components: a) an introduction to shared decision making, b) a web-based patient decision aid, and c) interactive data collection items. Iterative focus groups provided feedback on paper drafts and online prototypes. A field test assessed a) feasibility for using the research platform, in terms of recruitment, usage, and acceptability; and b) feasibility of using the web-based decision aid component, compared to performance of a videobooklet decision aid in clinical care.

RESULTS

This interdisciplinary, theory-based, patient-centered design approach produced a prototype for field-testing in six months. Participants (n = 126) reported that: the decision aid component was easy to use (98%), information was clear (90%), the length was appropriate (100%), it was appropriately detailed (90%), and it held their interest (97%). They spent a mean of 36 minutes using the decision aid and 100% preferred using their home/library computer. Participants scored a mean of 75% correct on the Decision Quality, Knowledge Subscale, and 74 out of 100 on the Preparation for Decision Making Scale. Completing the web-based decision aid reduced mean Decisional Conflict scores from 31.1 to 19.5 (p < 0.01).

CONCLUSIONS

Combining decision science and health informatics approaches facilitated rapid development of a web-based patient decision support research platform that was feasible for use in research studies in terms of recruitment, acceptability, and usage. Within this platform, the web-based decision aid component performed comparably with the videobooklet decision aid used in clinical practice. Future studies may use this interactive research platform to study patients' decision making processes in real-time, explore interdisciplinary approaches to designing web-based decision aids, and test strategies for tailoring decision support to meet patients' needs and preferences.

A systematic development process for patient decision aids

Background

The original version of the International Patient Decision Aid Standards (IPDAS) recommended that patient decision aids (PtDAs) should be carefully developed, user-tested and open to scrutiny, with a well-documented and systematically applied development process. We carried out a review to check the relevance and scope of this quality dimension and, if necessary, to update it.

Methods

Our review drew on three sources: a) published papers describing PtDAs evaluated in randomised controlled trials and included in the most recent Cochrane Collaboration review; b) linked papers cited in the trial reports that described how the PtDAs had been developed; and c) papers and web reports outlining the development process used by organisations experienced in developing multiple PtDAs. We then developed an extended model of the development process indicating the various steps on which documentation is required, as well as a checklist to assess the frequency with which each of the elements was publicly reported.

Results

Key features common to all patient decision aid (PtDA) development processes include: scoping and design; development of a prototype; ‘alpha’ testing with patients and clinicians in an iterative process; ‘beta’ testing in ‘real life’ conditions (field tests); and production of a final version for use and/or further evaluation. Only about half of the published reports on the development of PtDAs that we reviewed appear to have been field tested with patients, and even fewer had been reviewed or tested by clinicians not involved in the development process. Very few described a distribution strategy, and surprisingly few (17%) described a method for reviewing and synthesizing the clinical evidence. We describe a model development process that includes all the original elements of the original IPDAS criterion, expanded to include consideration of format and distribution plans as well as prototype development.

Conclusions

The case for including each of the elements outlined in our model development process is pragmatic rather than evidence-based. Optimal methods for ensuring that each stage of the process is carried out effectively require further development and testing.

Balancing the presentation of information and options in patient decision aids: an updated review

Background

Standards for patient decision aids require that information and options be presented in a balanced manner; this requirement is based on the argument that balanced presentation is essential to foster informed decision making. If information is presented in an incomplete/non-neutral manner, it can stimulate cognitive biases that can unduly affect individuals’ knowledge, perceptions of risks and benefits, and, ultimately, preferences. However, there is little clarity about what constitutes balance, and how it can be determined and enhanced. We conducted a literature review to examine the theoretical and empirical evidence related to balancing the presentation of information and options.

Methods

A literature search related to patient decision aids and balance was conducted on Medline, using MeSH terms and PubMed; this search supplemented the 2011 Cochrane Collaboration’s review of patient decision aids trials. Only English language articles relevant to patient decision making and addressing the balance of information and options were included. All members of the team independently screened clusters of articles; uncertainties were resolved by seeking review by another member. The team then worked in sub-groups to extract and synthesise data on theory, definitions, and evidence reported in these studies.

Results

A total of 40 articles met the inclusion criteria. Of these, six explained the rationale for balancing the presentation of information and options. Twelve defined “balance”; the definition of “balance” that emerged is as follows: “The complete and unbiased presentation of the relevant options and the information about those options—in content and in format—in a way that enables individuals to process this information without bias”. Ten of the 40 articles reported assessing the balance of the relevant decision aid. All 10 did so exclusively from the users’ or patients’ perspective, using a five-point Likert-type scale. Presenting information in a side-by-side display form was associated with more respondents (ranging from 70% to 96%) judging the information as “balanced”.

Conclusion

There is a need for comparative studies investigating different ways to improve and measure balance in the presentation of information and options in patient decision aids.

Do smoking cessation websites meet the needs of smokers with severe mental illnesses?

Many people learn about smoking cessation through information on the Internet. Whether people with severe mental illnesses, who have very high rates of smoking, are able to use currently available websites about smoking cessation is unknown. The study reported here assessed whether four smoking cessation websites met usability guidelines and whether they were usable by smokers with severe mental illnesses. Four websites that appeared first on a Google search and represented an array of sponsors were selected. First, five experts rated the websites on adequacy of content in six areas and usability in 20 areas. Second, 16 smokers with severe mental illnesses performed two search tasks on the websites with researchers observing their searches and interviewing them regarding usability. One of the websites was rated by experts as acceptable for content and usability, but most of the participants were unable to navigate this website. The only website that was navigable received poor content ratings by experts. Four easily accessible websites did not meet the needs of smokers with severe mental illnesses. Although the Internet is a promising strategy to provide education about treatments, website developers must attend to the needs and capacities of multiple user groups.

Theory-based design and field-testing of an intervention to support women choosing surgery for breast cancer: BresDex

OBJECTIVE

Design and undertake usability and field-testing evaluation of a theory-guided decision aid (BresDex) in supporting women choosing surgery for early breast cancer.

METHODS

An extended Theory of Planned Behavior (TPB) and the Common Sense Model of Illness Representations (CSM) guided the design of BresDex. BresDex was evaluated and refined across 3 cycles by interviewing 6 women without personal history of breast cancer, 8 women with personal history of breast cancer who had completed treatment and 11 women newly diagnosed with breast cancer. Participants were interviewed for views on content, presentation (usability) and perceived usefulness towards deciding on treatment (utility). Framework analysis was used, guided by the extended TPB and the CSM.

RESULTS

BresDex was positively received in content and presentation (usability). It appeared an effective support to decision-making and useful source for further information, particularly in clarifying attitudes, social norms and perceived behavioral control, and presenting consequences of decisions (utility).

CONCLUSION

This study illustrates the potential benefit of the extended TPB and CSM in designing a decision aid to support women choosing breast cancer surgery.

PRACTICE IMPLICATIONS

BresDex could provide decision-making support and serve as an additional source of information, to complement the care received from the clinical team.

Valuing Health for Clinical and Economic Decisions: Directions Relevant for Rheumatologists

The quality-adjusted life-year (QALY) is a construct that integrates the value or preference for a health state over the period of time in that health state. The main use of QALY is in cost-utility analysis, to help make resource allocation decisions when faced with choices. Although the concept of the QALY is appealing, there is ongoing debate regarding their usefulness and approaches to deriving QALY. In 2008, OMERACT engaged in an effort to agree on QALY approaches that can be used in rheumatology. Based on a Web questionnaire and a subsequent meeting, rheumatologists questioned whether it was relevant for OMERACT (1) to investigate use of a QALY that represents the patients’ perspective, (2) to explore the validity of the visual analog scale (VAS) to value health, and (3) to understand the validity of mapping health-specific instruments on existing preference instruments. This article discusses the pros and cons of these points in light of current insight from the point of view of health economics and decision-making theory. It also considers the further research agenda toward a QALY approach in rheumatology.

How to develop web-based decision support interventions for patients: a process map

OBJECTIVE

Significant advances have been made in the development of decision support interventions, also called decision aids, for patients facing difficult or uncertain decisions. However, challenges related to the definition, the theoretical underpinnings, the relative contribution of different components and how to migrate these tools to the Internet, remain unresolved. We propose a systematic process map for others to consider as they develop web-based, perhaps multimedia, decision support interventions and to examine the future challenges faced by developers.

METHODS

Based on our experiences of developing and evaluating web-based decision support interventions, we outline a process map to illustrate the general principles of content specification followed by creative design and tailoring to the target audience.

RESULTS

Content specification is fundamental and it should go beyond the traditional emphasis on scientific evidence in order to ensure patients' perspectives on the proposed options. The creative design phase aims to develop a medium to achieve three fundamental tasks: present information; achieve accurate affective forecasting; provide a basis for preference construction. This phase should be an open to experimentation and, where empirical work may be difficult or not yet available, guided by consultation with users, using an iterative method of trial and adaptation.

CONCLUSION

There is little empirical research on how best to achieve these tasks. The guiding principle needs to be one of customising the delivery, based on close consultation with the target users and an iterative development process until the intervention is deemed accessible and useful.

PRACTICE IMPLICATIONS

The process map provides a basis for further developments and outlines areas where remaining challenges need further investigation.

Design and usability of heuristic-based deliberation tools for women facing amniocentesis

BACKGROUND

Evidence suggests that in decision contexts characterized by uncertainty and time constraints (e.g. health-care decisions), fast and frugal decision-making strategies (heuristics) may perform better than complex rules of reasoning.

OBJECTIVE

To examine whether it is possible to design deliberation components in decision support interventions using simple models (fast and frugal heuristics).

DESIGN

The 'Take The Best' heuristic (i.e. selection of a 'most important reason') and 'The Tallying' integration algorithm (i.e. unitary weighing of pros and cons) were used to develop two deliberation components embedded in a Web-based decision support intervention for women facing amniocentesis testing. Ten researchers (recruited from 15), nine health-care providers (recruited from 28) and ten pregnant women (recruited from 14) who had recently been offered amniocentesis testing appraised evolving versions of 'your most important reason' (Take The Best) and 'weighing it up' (Tallying).

RESULTS

Most researchers found the tools useful in facilitating decision making although emphasized the need for simple instructions and clear layouts. Health-care providers however expressed concerns regarding the usability and clarity of the tools. By contrast, 7 out of 10 pregnant women found the tools useful in weighing up the pros and cons of each option, helpful in structuring and clarifying their thoughts and visualizing their decision efforts. Several pregnant women felt that 'weighing it up' and 'your most important reason' were not appropriate when facing such a difficult and emotional decision.

CONCLUSION

Theoretical approaches based on fast and frugal heuristics can be used to develop deliberation tools that provide helpful support to patients facing real-world decisions about amniocentesis.

Supporting informed decision making for prostate specific antigen (PSA) testing on the web: an online randomized controlled trial

Background

Men considering the prostate specific antigen (PSA) test for prostate cancer, an increasingly common male cancer, are encouraged to make informed decisions, as the test is limited in its accuracy and the natural history of the condition is poorly understood. The Web-based PSA decision aid, Prosdex, was developed as part of the UK Prostate Cancer Risk Management Programme in order to help men make such informed decisions.

Objectives

The aim of this study was to evaluate the effect of the Web-based PSA decision aid, Prosdex, on informed decision making.

Methods

A Web-based randomized controlled trial was conducted in South Wales, United Kingdom. Men aged 50 to 75 who had not previously had a PSA test were randomly allocated to two intervention and two control groups. Participants in the intervention groups either viewed Prosdex or were given a paper version of the text. The main outcome measures were the three components of informed decision making: (1) knowledge of prostate cancer and PSA, (2) attitude toward PSA testing, (3) behavior using a proxy measure, intention to undergo PSA testing. Decisional conflict and anxiety were also measured as was uptake of the PSA test. Outcomes were measured by means of an online questionnaire for the Prosdex group, the paper version group, and one of two control groups. Six months later, PSA test uptake was ascertained from general practitioners’ records, and the online questionnaire was repeated. Results are reported in terms of the Mann-Whitney U-statistic divided by the product of the two sample sizes (U/mm), line of no effect 0.50.

Results

Participants were 514 men. Compared with the control group that completed the initial online questionnaire, men in the Prosdex group had increased knowledge about the PSA test and prostate cancer (U/mn 0.70; 95% CI 0.62 - 0.76); less favourable attitudes to PSA testing (U/mn 0.39, 95% CI 0.31 - 0.47); were less likely to undergo PSA testing (U/mn 0.40, 95% CI 0.32 - 0.48); and had less decisional conflict (U/mn 0.32, 95% CI 0.25 - 0.40); while anxiety level did not differ (U/mn 0.50, 95% CI 0.42 - 0.58). For these outcomes there were no significant differences between men in the Prosdex group and the paper version group. However, in the Prosdex group, increased knowledge was associated with a less favourable attitude toward testing (Spearman rank correlation [ρ] = -0.49, P < .001) and lower intention to undergo testing (ρ = -0.27, P = .02). After six months, PSA test uptake was lower in the Prosdex group than in the paper version and the questionnaire control group (P = .014). Test uptake was also lower in the control group that did not complete a questionnaire than in the control group that did, suggesting a possible Hawthorne effect of the questionnaire in favour of PSA testing.

Conclusions

Exposure to Prosdex was associated with improved knowledge about the PSA test and prostate cancer. Men who had a high level of knowledge had a less favourable attitude toward and were less likely to undergo PSA testing. Prosdex appears to promote informed decision making regarding the PSA test.

Trial Registration

ISRCTN48473735; http://www.controlled-trials.com/ISRCTN48473735 (Archived by WebCite at http://www.webcitation.org/5r1TLQ5nK)

Supporting informed decision making online in 20 minutes: an observational web-log study of a PSA test decision aid

BACKGROUND

Web-based decision aids are known to have an effect on knowledge, attitude, and behavior; important components of informed decision making. We know what decision aids achieve in randomized controlled trials (RCTs), but we still know very little about how they are used and how this relates to the informed decision making outcome measures.

OBJECTIVE

To examine men's use of an online decision aid for prostate cancer screening using website transaction log files (web-logs), and to examine associations between usage and components of informed decision making.

METHODS

We conducted an observational web-log analysis of users of an online decision aid, Prosdex. Men between 50 and 75 years of age were recruited for an associated RCT from 26 general practices across South Wales, United Kingdom. Men allocated to one arm of the RCT were included in the current study. Time and usage data were derived from website log files. Components of informed decision making were measured by an online questionnaire.

RESULTS

Available for analysis were 82 web-logs. Overall, there was large variation in the use of Prosdex. The mean total time spent on the site was 20 minutes. The mean number of pages accessed was 32 (SD 21) out of a possible 60 pages. Significant associations were found between increased usage and increased knowledge (Spearman rank correlation [rho] = 0.69, P < .01), between increased usage and less favorable attitude towards PSA testing (rho = -0.52, P < .01), and between increased usage and reduced intention to undergo PSA testing (rho = -0.44, P < .01). A bimodal distribution identified two types of user: low access and high access users.

CONCLUSIONS

Increased usage of Prosdex leads to more informed decision making, the key aim of the UK Prostate Cancer Risk Management Programme. However, developers realistically have roughly 20 minutes to provide useful information that will support informed decision making when the patient uses a web-based interface. Future decision aids need to be developed with this limitation in mind. We recommend that web-log analysis should be an integral part of online decision aid development and analysis.

TRIAL REGISTRATION

ISRCTN48473735; http://www.controlled-trials.com/ISRCTN48473735 (Archived by WebCite at http://www.webcitation.org/5pqeF89tS).

Video decision support tool for advance care planning in dementia: randomised controlled trial

OBJECTIVE

To evaluate the effect of a video decision support tool on the preferences for future medical care in older people if they develop advanced dementia, and the stability of those preferences after six weeks.

DESIGN

Randomised controlled trial conducted between 1 September 2007 and 30 May 2008. Setting Four primary care clinics (two geriatric and two adult medicine) affiliated with three academic medical centres in Boston.

PARTICIPANTS

Convenience sample of 200 older people (>or=65 years) living in the community with previously scheduled appointments at one of the clinics. Mean age was 75 and 58% were women.

INTERVENTION

Verbal narrative alone (n=106) or with a video decision support tool (n=94).

MAIN OUTCOME MEASURES

Preferred goal of care: life prolonging care (cardiopulmonary resuscitation, mechanical ventilation), limited care (admission to hospital, antibiotics, but not cardiopulmonary resuscitation), or comfort care (treatment only to relieve symptoms). Preferences after six weeks. The principal category for analysis was the difference in proportions of participants in each group who preferred comfort care.

RESULTS

Among participants receiving the verbal narrative alone, 68 (64%) chose comfort care, 20 (19%) chose limited care, 15 (14%) chose life prolonging care, and three (3%) were uncertain. In the video group, 81 (86%) chose comfort care, eight (9%) chose limited care, four (4%) chose life prolonging care, and one (1%) was uncertain (chi(2)=13.0, df=3, P=0.003). Among all participants the factors associated with a greater likelihood of opting for comfort care were being a college graduate or higher, good or better health status, greater health literacy, white race, and randomisation to the video arm. In multivariable analysis, participants in the video group were more likely to prefer comfort care than those in the verbal group (adjusted odds ratio 3.9, 95% confidence interval 1.8 to 8.6). Participants were re-interviewed after six weeks. Among the 94/106 (89%) participants re-interviewed in the verbal group, 27 (29%) changed their preferences (kappa=0.35). Among the 84/94 (89%) participants re-interviewed in the video group, five (6%) changed their preferences (kappa=0.79) (P<0.001 for difference).

CONCLUSION

Older people who view a video depiction of a patient with advanced dementia after hearing a verbal description of the condition are more likely to opt for comfort as their goal of care compared with those who solely listen to a verbal description. They also have more stable preferences over time.

TRIAL REGISTRATION

Clinicaltrials.gov NCT00704886.

Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi)

OBJECTIVES

To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).

DESIGN

Scale development study, involving construct, item and scale development, validation and reliability testing.

SETTING

There has been increasing use of decision support technologies--adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.

METHODS

Scale development study, involving construct, item and scale development, validation and reliability testing.

PARTICIPANTS

Twenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi). In the fourth Stage (reliability study), eight raters assessed thirty randomly selected decision support technologies.

RESULTS

IPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100) for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30), enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68). Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items) was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92).

CONCLUSIONS

This work demonstrates that IPDASi has the ability to assess the quality of decision support technologies. The existing IPDASi provides an assessment of the quality of a DST's components and will be used as a tool to provide formative advice to DSTs developers and summative assessments for those who want to compare their tools against an existing benchmark.

Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice

BACKGROUND

Decision support technologies (DSTs, also known as decision aids) help patients and professionals take part in collaborative decision-making processes. Trials have shown favorable impacts on patient knowledge, satisfaction, decisional conflict and confidence. However, they have not become routinely embedded in health care settings. Few studies have approached this issue using a theoretical framework. We explained problems of implementing DSTs using the Normalization Process Model, a conceptual model that focuses attention on how complex interventions become routinely embedded in practice.

METHODS

The Normalization Process Model was used as the basis of conceptual analysis of the outcomes of previous primary research and reviews. Using a virtual working environment we applied the model and its main concepts to examine: the 'workability' of DSTs in professional-patient interactions; how DSTs affect knowledge relations between their users; how DSTs impact on users' skills and performance; and the impact of DSTs on the allocation of organizational resources.

RESULTS

A conceptual analysis using the Normalization Process Model provided insight on implementation problems for DSTs in routine settings. Current research focuses mainly on the interactional workability of these technologies, but factors related to divisions of labor and health care, and the organizational contexts in which DSTs are used, are poorly described and understood.

CONCLUSION

The model successfully provided a framework for helping to identify factors that promote and inhibit the implementation of DSTs in healthcare and gave us insights into factors influencing the introduction of new technologies into contexts where negotiations are characterized by asymmetries of power and knowledge. Future research and development on the deployment of DSTs needs to take a more holistic approach and give emphasis to the structural conditions and social norms in which these technologies are enacted.