Development and usability testing of a Web-based decision aid for families of patients receiving prolonged mechanical ventilation

Inter-disciplinary provider development of an online, interactive adolescent varicocele decision aid prototype

BACKGROUND

Decision-making regarding varicocele management can be a complex process for patients and families. However, to date, no studies have presented ways to mitigate the decisional conflict surrounding varicoceles.

OBJECTIVE

To facilitate a discussion among physicians in order to develop a framework of the decision-making process regarding adolescent varicocele management, which will inform the development of the first online, interactive decision aid.

MATERIALS AND METHODS

Semi-structured interviews with pediatric urologists and interventional radiologists were conducted to discuss their rationale for varicocele decision-making. Interviews were audio recorded, transcribed, and coded. Key themes were identified, grouped, and then qualitatively analyzed using thematic analysis. Utilizing the common themes identified and the Ottawa Decision Support Framework, a decision aid prototype was developed and transformed into a user-friendly website: varicoceledecisionaid.com.

RESULTS

Pediatric urologists (n = 10) and interventional radiologists (n = 2) were interviewed. Key themes identified included: (1) definition/epidemiology; (2) observation as an appropriate management choice; (3) reasons to recommend repair; (4) types of repair; (5) reasons to recommend one repair over another; (6) shared decision-making; and (7) appropriate counseling. With this insight, a varicocele decision aid prototype was developed that engages patients and parents in the decision-making process.

DISCUSSION AND CONCLUSIONS

This is the first interactive and easily accessible varicocele decision aid prototype developed by inter-disciplinary physicians for patients. This tool aids in decision-making surrounding varicocele surgery. It can be used before or after consultation to help families understand more about varicoceles and their repair, and why intervention may or may not be offered. It also considers a patient and family's personal values. Future studies will incorporate the patient and family perspective into the decision-making aid as well as implement and test the usability of this decision aid prototype in practice and in the wider urologic community.

Development and preliminary usability testing of an electronic conversation guide incorporating patient values and prognostic information in preparation for older people's decision-making near the end of life

Initiating end-of-life conversations can be daunting for clinicians and overwhelming for patients and families. This leads to delays in communicating prognosis and preparing for the inevitable in old age, often generating potentially harmful overtreatment and poor-quality deaths. We aimed to develop an electronic resource, called Communicating Health Alternatives Tool (CHAT) that was compatible with hospital medical records software to facilitate preparation for shared decision-making across health settings with older adults deemed to be in the last year of life. The project used mixed methods including: literature review, user-directed specifications, web-based interface development with authentication and authorization; clinician and consumer co-design, iterative consultation for user testing; and ongoing developer integration of user feedback. An internet-based conversation guide to facilitate clinician-led advance care planning was co-developed covering screening for short-term risk of death, patient values and preferences, and treatment choices for chronic kidney disease and dementia. Printed summary of such discussion could be used to begin the process in hospital or community health services. Clinicians, patients, and caregivers agreed with its ease of use and were generally accepting of its contents and format. CHAT is available to health services for implementation in effectiveness trials to determine whether the interaction and documentation leads to formal decision-making, goal-concordant care, and subsequent reduction of unwanted treatments at the end of life.

Decision Aids in the ICU: a scoping review

OBJECTIVE

The purpose of this scoping review was to synthesise the effectiveness and acceptability of decision aids for critically ill patients and family members in the intensive care unit (ICU).

METHODS

A systematic search of four electronic databases and grey literature was undertaken to identify relevant studies on the application of decision aids in the ICU, without publication date restriction, through March 2023. The methodological framework proposed by Arksey and O'Malley was used to guide the scoping review.

RESULTS

Fourteen papers were ultimately included in this review. However, only nine decision aids were available, and it is noteworthy that many of these studies focused on the iterative development and testing of individual decision aids. Among the included studies, 92% (n=13) were developed in North America, with a primary focus on goals of care and life-sustaining treatments. The summary of the effect of decision aid application revealed that the most common indicators were the level of knowledge and code status, and some promising signals disappeared in randomised trials.

CONCLUSIONS

The complexity of treatment decisions in the ICU exceeds the current capabilities of existing decision aids. There is a clear gap in decision aids that are tailored to different cultural contexts, highlighting the need to expand the scope of their application. In addition, rigorous quality control is very important for randomised controlled trial, and indicators for assessing the effectiveness of decision aids need to be further clarified.

Methodologies for Evaluating the Usability of Rehabilitation Technologies Aimed at Supporting Shared Decision-Making: Scoping Review

BACKGROUND

The field of rehabilitation has seen a recent rise in technologies to support shared decision-making (SDM). Usability testing during the design process of SDM technologies is needed to optimize adoption and realize potential benefits. There is variability in how usability is defined and measured. Given the complexity of usability, a thorough examination of the methodologies used to measure usability to develop the SDM technologies used in rehabilitation care is needed.

OBJECTIVE

This scoping review aims to answer the following research questions: which methods and measures have been used to produce knowledge about the usability of rehabilitation technologies aimed at supporting SDM at the different phases of development and implementation? Which parameters of usability have been measured and reported?

METHODS

This review followed the Arksey and O'Malley framework. An electronic search was performed in the Ovid MEDLINE, Embase, CINAHL, and PsycINFO databases from January 2005 up to November 2020. In total, 2 independent reviewers screened all retrieved titles, abstracts, and full texts according to the inclusion criteria and extracted the data. The International Organization for Standardization framework was used to define the scope of usability (effectiveness, efficiency, and satisfaction). The characteristics of the studies were outlined in a descriptive summary. Findings were categorized based on usability parameters, technology interventions, and measures of usability.

RESULTS

A total of 38 articles were included. The most common SDM technologies were web-based aids (15/33, 46%). The usability of SDM technologies was assessed during development, preimplementation, or implementation, using 14 different methods. The most frequent methods were questionnaires (24/38, 63%) and semistructured interviews (16/38, 42%). Satisfaction (27/38, 71%) was the most common usability parameter mapped to types of SDM technologies and usability evaluation methods. User-centered design (9/15, 60%) was the most frequently used technology design framework.

CONCLUSIONS

The results from this scoping review highlight the importance and the complexity of usability evaluation. Although various methods and measures were shown to be used to evaluate the usability of technologies to support SDM in rehabilitation, very few evaluations used in the included studies were found to adequately span the selected usability domains. This review identified gaps in usability evaluation, as most studies (24/38, 63%) relied solely on questionnaires rather than multiple methods, and most questionnaires simply focused on the usability parameter of satisfaction. The consideration of end users (such as patients and clinicians) is of particular importance for the development of technologies to support SDM, as the process of SDM itself aims to improve patient-centered care and integrate both patient and clinician voices into their rehabilitation care.

What's behind the Dashboard? Intervention Mapping of a Mobility Outcomes Monitoring System for Rehabilitation

Training and follow-up for older adults who received new assistive technology can improve device use adoption and function, but there is a lack of systematic and coordinated services. To address this gap, the Internet-based MOvIT+™ was designed to provide remote monitoring and support for assistive technology users and their caregivers. This paper presents the intervention mapping approach that was used. In step 1, we established a project governance structure and a logic model emerged from interviews with stakeholders and a systematic review of literature. In step 2, a modified TRIAGE consensus process led to the prioritization of thirty-six intervention components. In step 3, we created use cases for all intervention end users. In step 4, the intervention interface was created through iterative lab testing, and we gathered training resources. In step 5, a two-stage implementation plan was devised with the recruited rehabilitation sites. In step 6, we proposed an evaluation protocol. This detailed account of the development of MOvIT+™ demonstrates how the combined use of an intervention mapping approach and participatory processes with end users can help linking evidence-based, user-centered, and pragmatic reasoning. It makes visible the complexities behind the development of Internet-based interventions, while guiding future program developers.

Development and preliminary evaluation of EMPOWER for surrogate decision-makers of critically ill patients

OBJECTIVE

The objectives of this study were to develop and refine EMPOWER (Enhancing and Mobilizing the POtential for Wellness and Resilience), a brief manualized cognitive-behavioral, acceptance-based intervention for surrogate decision-makers of critically ill patients and to evaluate its preliminary feasibility, acceptability, and promise in improving surrogates' mental health and patient outcomes.

METHOD

Part 1 involved obtaining qualitative stakeholder feedback from 5 bereaved surrogates and 10 critical care and mental health clinicians. Stakeholders were provided with the manual and prompted for feedback on its content, format, and language. Feedback was organized and incorporated into the manual, which was then re-circulated until consensus. In Part 2, surrogates of critically ill patients admitted to an intensive care unit (ICU) reporting moderate anxiety or close attachment were enrolled in an open trial of EMPOWER. Surrogates completed six, 15-20 min modules, totaling 1.5-2 h. Surrogates were administered measures of peritraumatic distress, experiential avoidance, prolonged grief, distress tolerance, anxiety, and depression at pre-intervention, post-intervention, and at 1-month and 3-month follow-up assessments.

RESULTS

Part 1 resulted in changes to the EMPOWER manual, including reducing jargon, improving navigability, making EMPOWER applicable for a range of illness scenarios, rearranging the modules, and adding further instructions and psychoeducation. Part 2 findings suggested that EMPOWER is feasible, with 100% of participants completing all modules. The acceptability of EMPOWER appeared strong, with high ratings of effectiveness and helpfulness (M = 8/10). Results showed immediate post-intervention improvements in anxiety (d = -0.41), peritraumatic distress (d = -0.24), and experiential avoidance (d = -0.23). At the 3-month follow-up assessments, surrogates exhibited improvements in prolonged grief symptoms (d = -0.94), depression (d = -0.23), anxiety (d = -0.29), and experiential avoidance (d = -0.30).

SIGNIFICANCE OF RESULTS

Preliminary data suggest that EMPOWER is feasible, acceptable, and associated with notable improvements in psychological symptoms among surrogates. Future research should examine EMPOWER with a larger sample in a randomized controlled trial.

Facilitating communication for critically ill patients and their family members: Study protocol for two randomized trials implemented in the U.S. and France

BACKGROUND

Critically-ill patients and their families suffer a high burden of psychological symptoms due, in part, to many transitions among clinicians and settings during and after critical illness, resulting in fragmented care. Communication facilitators may help.

DESIGN AND INTERVENTION

We are conducting two cluster-randomized trials, one in the U.S. and one in France, with the goal of evaluating a nurse facilitator trained to support, model, and teach communication strategies enabling patients and families to secure care consistent with patients' goals, beginning in ICU and continuing for 3 months.

PARTICIPANTS

We will randomize 376 critically-ill patients in the US and 400 in France to intervention or usual care. Eligible patients have a risk of hospital mortality of greater than15% or a chronic illness with a median survival of approximately 2 years or less.

OUTCOMES

We assess effectiveness with patient- and family-centered outcomes, including symptoms of depression, anxiety, and post-traumatic stress, as well as assessments of goal-concordant care, at 1-, 3-, and 6-months post-randomization. The primary outcome is family symptoms of depression over 6 months. We also evaluate whether the intervention improves value by reducing utilization while improving outcomes. Finally, we use mixed methods to explore implementation factors associated with implementation outcomes (acceptability, fidelity, acceptability, penetration) to inform dissemination. Conducting the trial in U.S. and France will provide insights into differences and similarities between countries.

CONCLUSIONS

We describe the design of two randomized trials of a communication facilitator for improving outcomes for critically ill patients and their families in two countries.

Adapting a Traumatic Brain Injury Goals-of-Care Decision Aid for Critically Ill Patients to Intracerebral Hemorrhage and Hemispheric Acute Ischemic Stroke

Supplemental Digital Content is available in the text.

Objectives:

Families in the neurologic ICU urgently request goals-of-care decision support and shared decision-making tools. We recently developed a goals-of-care decision aid for surrogates of critically ill traumatic brain injury patients using a systematic development process adherent to the International Patient Decision Aid Standards. To widen its applicability, we adapted this decision aid to critically ill patients with intracerebral hemorrhage and large hemispheric acute ischemic stroke.

Design:

Prospective observational study.

Setting:

Two academic neurologic ICUs.

Subjects:

Twenty family members of patients in the neurologic ICU were recruited from July 2018 to October 2018.

Interventions:

None.

Measurements and Main Results:

We reviewed the existing critically ill traumatic brain injury patients decision aid for content and changed: 1) the essential background information, 2) disease-specific terminology to “hemorrhagic stroke” and “ischemic stroke”, and 3) disease-specific prognosis tailored to individual patients. We conducted acceptability and usability testing using validated scales. All three decision aids contain information from validated, disease-specific outcome prediction models, as recommended by international decision aid standards, including careful emphasis on their uncertainty. We replaced the individualizable icon arrays graphically depicting probabilities of a traumatic brain injury patient’s prognosis with icon arrays visualizing intracerebral hemorrhage and hemispheric acute ischemic stroke prognostic probabilities using high-quality disease-specific data. We selected the Intracerebral Hemorrhage Score with validated 12-month outcomes, and for hemispheric acute ischemic stroke, the 12-month outcomes from landmark hemicraniectomy trials. Twenty family members participated in acceptability and usability testing (n = 11 for the intracerebral hemorrhage decision aid; n = 9 for the acute ischemic stroke decision aid). Median usage time was 22 minutes (interquartile range, 16–26 min). Usability was excellent (median System Usability Scale = 84/100 [interquartile range, 61–93; with > 68 indicating good usability]); 89% of participants graded the decision aid content as good or excellent, and greater than or equal to 90% rated it favorably for information amount, balance, and comprehensibility.

Conclusions:

We successfully adapted goals-of-care decision aids for use in surrogates of critically ill patients with intracerebral hemorrhage and hemispheric acute ischemic stroke and found excellent usability and acceptability. A feasibility trial using these decision aids is currently ongoing to further validate their acceptability and test their feasibility for use in busy neurologic ICUs.

User testing of a hypospadias decision aid prototype at a pediatric medical conference

INTRODUCTION

Based on our previous qualitative work, we created a web-based decision aid (DA) prototype to facilitate shared decision-making regarding hypospadias.

OBJECTIVE

The objective of this study was to obtain rapid feedback on the prototype as part of an iterative, human-centered design process.

METHODS

We conducted this study at a statewide, pediatric educational conference in May 2019, recruiting attendees by verbal/written announcements. The DA consisted of: hypospadias overview and surgery "storyboard," frequently asked questions, parent testimonials, and a values clarification exercise. Participants viewed the DA on a tablet as they participated in semi-structured, qualitative interviews covering website acceptability, usability, and preference for surgical photographs versus illustrations. Three coders used qualitative content analysis to identify themes and resolved disagreements by consensus.

RESULTS

Of 295 conference attendees, all 50 who approached us agreed to participate. Responses from 49 participants were available for analysis: 67% female, ages 20-69, 65% Caucasian, 55% MDs. 96% of participants thought the website design matched its purpose; 59.1% preferred surgical illustrations, 8.2% preferred photos, 30.6% preferred both and 2.0% did not like either. Participants recommended improvements in: a) usability/accessibility (e.g. site navigation, visual layout, page length), b) content coverage (e.g. epidemiology, consequences of no/delayed surgery, lifelong risks), c) parent-centeredness (e.g. reading level/writing style) and d) implementation (provider tools, printable handouts). The Extended Summary Figure shows a revised image of the first step of a hypospadias repair based on feedback about participants' preferences for illustrations rather than photographs.

DISCUSSION

The main strength of our study was the valuable feedback we obtained to inform critical revisions of the DA prototype. We also demonstrated the feasibility and efficacy of a conducting a usability evaluation of a web-based DA in a medical conference setting. One limitation of this study is that the relatively small population sampled limits generalizability and our findings may not reflect the views of all providers who care for hypospadias patients.

CONCLUSIONS

The vast majority of providers thought that the design of the Hypospadias Homepage matched its purpose and most preferred surgical illustrations rather than photos to demonstrate the steps of hypospadias surgery. Based on their feedback, we plan to focus our efforts in the following areas: 1) improvement of navigation/menus, 2) reduction in the amount of text per page, 3) expansion of specific content coverage and 4) inclusion of "parent-friendly" visuals such as infographics to represent quantitative data and colorful illustrations to depict hypospadias and its surgical repair.

Development and usability testing of Understanding Stroke, a tailored life-sustaining treatment decision support tool for stroke surrogate decision makers

BACKGROUND

Surrogate decision makers of stroke patients are often unprepared to make critical decisions on life-sustaining treatments. We describe the development process and key features for the Understanding Stroke web-based decision support tool.

METHODS

We used multiple strategies to develop a patient-centered, tailored decision aid. We began by forming a Patient and Family Advisory Council to provide continuous input to our multidisciplinary team on the development of the tool. Additionally, focus groups consisting of nurses, therapists, social workers, physicians, stroke survivors, and family members reviewed key elements of the tool, including prognostic information, graphical displays, and values clarification exercise. To design the values clarification exercise, we asked focus groups to provide feedback on a list of important activities of daily living. An ordinal prognostic model was developed for ischemic stroke and intracerebral hemorrhage using data taken from the Virtual International Stroke Trials Archive Plus, and incorporated into the tool.

RESULTS

Focus group participants recommended making numeric prognostic information optional due to possible emotional distress. Pie charts were generally favored by participants for graphical presentation of prognostic information, though a horizontal stacked bar chart was also added due to its prevalence in stroke literature. Plain language descriptions of the modified Rankin Scale were created to accompany the prognostic information. A values clarification exercise was developed consisting of a list of 13 situations that may make an individual consider comfort measures only. The final version of the web based tool (which can be viewed on tablets) included the following sections: general introduction to stroke, outcomes (prognostic information and recovery), in-hospital and life-sustaining treatments, decision making and values clarification, post-hospital care, tips for talking to the health care team, and a summary report. Preliminary usability testing received generally favorable feedback.

CONCLUSION

We developed Understanding Stroke, a tailored decision support tool for surrogate decision makers of stroke patients. The tool was well received and will be formally pilot tested in a group of stroke surrogate decision makers.

TRIAL REGISTRATION

ClinicalTrials.gov ( NCT03427645 ).

Goals-of-care decision aid for critically ill patients with TBI: Development and feasibility testing

OBJECTIVE

To develop and demonstrate early feasibility of a goals-of-care decision aid for surrogates of patients who are critically ill with traumatic brain injury (ciTBI) that meets accepted international decision aid guidelines.

METHODS

We developed the decision aid in 4 stages: (1) qualitative study of goals-of-care communication and decision needs of 36 stakeholders of ciTBI (surrogates and physicians), which informed (2) development of paper-based decision aid with iterative revisions after feedback from 52 stakeholders; (3) acceptability and usability testing in 18 neurologic intensive care unit (neuroICU) family members recruited from 2 neuroICU waiting rooms using validated scales; and (4) open-label, randomized controlled feasibility trial in surrogates of ciTBI. We performed an interim analysis of 16 surrogates of 12 consecutive patients who are ciTBI to confirm early feasibility of the study protocol and report recruitment, participation, and retention rates to date.

RESULTS

The resultant goals-of-care decision aid achieved excellent usability (median System Usability Scale 87.5 [possible range 0-100]) and acceptability (97% graded the tool's content as "good" or "excellent"). Early feasibility of the decision aid and the feasibility trial protocol was demonstrated by high rates of recruitment (73% consented), participation (100%), and retention (100% both after the goals-of-care clinician-family meeting and at 3 months) and complete data for the measurements of all secondary decision-related and behavioral outcomes to date.

CONCLUSIONS

Our systematic development process resulted in a novel goals-of-care decision aid for surrogates of patients who are ciTBI with excellent usability, acceptability, and early feasibility in the neuroICU environment, and meets international decision aid standards. This methodology may be a development model for other decision aids in neurology to promote shared decision-making.

One-Year Outcomes Following Tracheostomy for Acute Respiratory Failure

OBJECTIVES

Tracheostomy utilization has dramatically increased recently. Large gaps exist between expected and actual outcomes resulting in significant decisional conflict and regret. We determined 1-year patient outcomes and healthcare utilization following tracheostomy to aid in decision-making and resource allocation.

DESIGN

Retrospective cohort study.

SETTING

All California hospital discharges from 2012 to 2013 with follow-up through 2014.

PATIENTS

Nonsurgical patients who received a tracheostomy for acute respiratory failure.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Our primary outcome was 30-day, 90-day, and 1-year mortality. We also determined hospitals readmissions rates and healthcare utilization in the first year following tracheostomy. We identified 8,343 tracheostomies during the study period. One-year mortality following tracheostomy was high, 46.5%. Older adults (≥ 65 yr) had significantly higher mortality compared with younger patients (< 65 yr) (54.7% vs 36.5%; p < 0.0001). Median survival for older adults was 175 days (95% CI, 150-202 d) compared with greater than 1 year for younger adults (adjusted hazard ratio, 1.25; 95% CI, 1.14-1.36). Within 1 year of tracheostomy, 60.3% of patients required hospital readmission. Older adults were more likely to be readmitted in the first year after tracheostomy compared with younger adults (66.1% vs 55.2%; adjusted hazard ratio, 1.19; 95% CI, 1.09-1.29). Total short-term acute care hospital costs (index and readmissions) in the first year after tracheostomy were high (mean, $215,369; SD, $160,874).

CONCLUSIONS

Long-term outcomes following tracheostomy are extremely poor with high mortality, morbidity, and healthcare resource utilization especially among older patients. Some subsets of younger patients may have better outcomes compared with the general tracheostomy population. Short-term acute care costs were extremely high in the first year following tracheostomy. If extended to the entire U.S. population, total short-term acute care hospital costs approach $11 billion dollars per year for tracheostomy-related to acute respiratory failure. These findings may aid families and surrogates in the decision-making process.

Survival, Outcomes, and Use of Acuity Scoring Systems Following Tracheotomy in Veteran Patients

OBJECTIVES

To determine whether established prognosis tools used in the general population of critically ill patients will accurately predict tracheotomy-related outcomes and survival outcomes in critically ill patients undergoing tracheotomy.

METHODS

Retrospective chart review of 94 consecutive critically ill patients undergoing isolated tracheotomy.

RESULTS

Logistic Organ Dysfunction System (LODS) and sepsis-related organ failure assessment (SOFA) scores, 2 validated measures of acuity in critically ill patients, were calculated for all patients. The only tracheotomy-related outcome of significance was the finding that patients with an LODS score ≤6 were more likely to become ventilator independent (P < .015). Higher LODS or SOFA scores were associated with in-house death (LODS, P = .001, SOFA, P = .008) and death within 90 days (LODS, P = .009, SOFA, P = .031), while death within 180 days was associated only with a higher LODS score (LODS, P = .018). When controlling for age, there was an association between both LODS (P = .015) and SOFA (P = .019) scores and death within 90 days of tracheotomy.

CONCLUSIONS

The survival outcome for critically ill patients undergoing tracheotomy seems accurately predicted based on scoring systems designed for use in the general population of critically ill patients. Logistic Organ Dysfunction System may also be useful to predict the likelihood of the tracheotomy-related outcome of ventilator independence. This suggests that LODS scores may be helpful to palliative care clinicians as part of a shared decision-making aid in critically ill, ventilated patients for whom tracheotomy is being considered.

Patient and Family Engagement During Treatment Decisions in an ICU: A Discourse Analysis of the Electronic Health Record

OBJECTIVES

Shared decision-making is recommended for critically ill adults who face major, preference-sensitive treatment decisions. Yet, little is known about when and how patients and families are engaged in treatment decision-making over the longitudinal course of a critical illness. We sought to characterize patterns of treatment decision-making by evaluating clinician discourse in the electronic health record of critically ill adults who develop chronic critical illness or die in an ICU.

DESIGN, SETTING, AND PATIENTS

We conducted qualitative content analysis of the electronic health record of 52 adult patients, admitted to a medical ICU in a tertiary medical center from January 1, 2016, to December 31, 2016. We included patients who met a consensus definition of chronic critical illness (26 patients) and a matched sample who died or transitioned to hospice care in the ICU before developing chronic critical illness (26 patients).

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Characterization of clinician decision-making discourse documented during the course of an ICU stay. Clinician decision-making discourse in the electronic health record followed a single, consistent pattern across both groups. Initial decisions about admission to the ICU focused on specific interventions that can only be provided in an ICU environment (intervention-focused decisions). Following admission, the documented rationale for additional treatments was guided by physiologic abnormalities (physiology-centered decisions). Clinician discourse transitioned to documented engagement of patients and families in decision-making when treatments failed to achieve specified physiologic goals. The phrase "goals of care" is common in the electronic health record and is used to indicate poor prognosis, to describe conflict with families, and to provide rationale for treatment limitations.

CONCLUSIONS

Clinician discourse in the electronic health record reveals that patient physiology strongly guides treatment decision-making throughout the longitudinal course of critical illness. Documentation of patient and family engagement in treatment decision-making is limited until available medical treatments fail to achieve physiologic goals.

Integrating Touchscreen-Based Geriatric Assessment and Frailty Screening for Adults With Multiple Myeloma to Drive Personalized Treatment Decisions

PURPOSE

Geriatric assessment (GA) results predict toxicity/survival in older adults, yet GA is not routinely used in care for patients with multiple myeloma (MM). We tested a tablet-based modified GA (mGA) providing real-time results to clinicians.

METHODS

One hundred sixty-five patients with MM aged ≥ 65 years facing a treatment decision from 4 sites completed a tablet-based mGA with Katz Activities of Daily Living (ADL), Lawton Instrumental ADL, Charlson Comorbidity Index, and variables from the Cancer and Aging Research Group's Chemotherapy Toxicity Calculator. Providers reviewed the assessment results at the treatment visit.

RESULTS

Patients were white (72%; n = 86), mean age was 72 years (range, 65-85 years), and averaged 7.71 minutes (range, 2-17 minutes) for survey completion. Providers averaged 3.2 minutes (range, 1-10 minutes) to review mGA results. Using International Myeloma Working Group frailty score, patients were fit (39%; n = 64), intermediate fit (33%; n = 55), or frail (28%; n = 46). Providers selected more aggressive treatments in 16.3% of patients and decreased treatment intensity in 34% of patients; treatment intensification was more common for fit patients and milder treatments for frail patients (χ² = 20.02; P < .0001). Transplant eligibility significantly correlated with fit status and transplant ineligibility with frail status (P = .004). Outcomes on 144 patients 3 months post study visit showed 19.4% (n = 28) had grade ≥ 3 hematologic toxicities, 38.9% (n = 56) had dose modifications, and 18% (n = 26) had early therapy cessation.

CONCLUSION

Limited patient time required for survey completion and provider time for results review show mGA can be easily incorporated into clinical workflow. Real-time mGA results indicating fit/frailty status influenced treatment decisions.

Effects of a Personalized Web-Based Decision Aid for Surrogate Decision Makers of Patients With Prolonged Mechanical Ventilation: A Randomized Clinical Trial

Background

Treatment decisions commonly have to be made in intensive care units (ICUs). These decisions are difficult for surrogate decision makers and often lead to decisional conflict, psychological distress, and treatments misaligned with patient preferences.

Objective

To determine whether a decision aid about prolonged mechanical ventilation improved prognostic concordance between surrogate decision makers and clinicians compared with a usual care control.

Design

Multicenter, parallel, randomized, clinical trial. (ClinicalTrials.gov: NCT01751061).

Setting

13 medical and surgical ICUs at 5 hospitals.

Participants

Adult patients receiving prolonged mechanical ventilation and their surrogates, ICU physicians, and ICU nurses.

Intervention

A Web-based decision aid provided personalized prognostic estimates, explained treatment options, and interactively clarified patient values to inform a family meeting. The control group received information according to usual care practices followed by a family meeting.

Measurements

The primary outcome was improved concordance on 1-year survival estimates, measured with the clinician-surrogate concordance scale (range, 0 to 100 percentage points; higher scores indicate more discordance). Secondary and additional outcomes assessed the experiences of surrogates (psychological distress, decisional conflict, and quality of communication) and patients (length of stay and 6-month mortality). Outcomes assessors were blinded to group allocation.

Results

The study enrolled 277 patients, 416 surrogates, and 427 clinicians. Concordance improvement did not differ between intervention and control groups (mean difference in score change from baseline, -1.7 percentage points [95% CI, -8.3 to 4.8 percentage points]; P = 0.60). Surrogates' postintervention estimates of patients' 1-year prognoses did not differ between intervention and control groups (median, 86.0% [interquartile range {IQR}, 50.0%] vs. 92.5% [IQR, 47.0%]; P = 0.23) and were substantially more optimistic than results of a validated prediction model (median, 56.0% [IQR, 43.0%]) and physician estimates (median, 50.0% [IQR, 55.5%]). Eighty-two intervention surrogates (43%) favored a treatment option that was more aggressive than their report of patient preferences. Although intervention surrogates had greater reduction in decisional conflict than control surrogates (mean difference in change from baseline, 0.4 points [CI, 0.0 to 0.7 points]; P = 0.041), other surrogate and patient outcomes did not differ.

Limitation

Contamination among clinicians could have biased results toward the null hypothesis.

Conclusion

A decision aid about prolonged mechanical ventilation did not improve prognostic concordance between clinicians and surrogates, reduce psychological distress among surrogates, or alter clinical outcomes. Decision support in acute care settings may require greater individualized attention for both the cognitive and affective challenges of decision making.

Primary Funding Source

National Institutes of Health.

Shared Decision Making in Neurocritical Care

Shared decision making is a collaborative decision-making process between health care providers and patients or their surrogates, taking into account the best scientific evidence available while considering the patient's values, goals, and preferences. Decision aids are tools enabling SDM. This article discusses shared decision making in general and in the intensive care unit in particular and facilitators and barriers for the creation and implementation of International Patient Decision Aids Standards Collaboration-compliant decision aids for the intensive care unit and neuro-intensive care unit.

Propensity score-matching analyses on the effectiveness of integrated prospective payment program for patients with prolonged mechanical ventilation

OBJECTIVES

An integrated delivery system with a prospective payment program (IPP) for prolonged mechanical ventilation (PMV) was launched by Taiwan's National Health Insurance (NHI) due to the costly and limited ICU resources. This study aimed to analyze the effectiveness of IPP and evaluate the factors associated with successful weaning and survival among patients with PMV.

METHODS

Taiwan's NHI Research Database was searched to obtain the data of patients aged ≥17 years who had PMV from 2006 to 2010 (N=50,570). A 1:1 propensity score matching approach was used to compare patients with and without IPP (N=30,576). Cox proportional hazards modeling was used to examine the factors related to successful weaning and survival.

RESULTS

The related factors of lower weaning rate in IPP participants (hazard ratio [HR]=0.84), were older age, higher income, catastrophic illness (HR=0.87), and higher comorbidity. The effectiveness of IPP intervention for the PMV patients showed longer days of hospitalization, longer ventilation days, higher survival rate, and higher medical costs (in respiratory care center, respiratory care ward). The 6-month mortality rate was lower (34.0% vs. 32.9%). The death risk of IPP patients compared to those non-IPP patients was lower (HR=0.91, P<0.001).

CONCLUSIONS

The policy of IPP for PMV patients showed higher survival rate although it was costly and related to lower weaning rate.

Shared Decision Making in Neurocritical Care

Shared decision making is a collaborative decision-making process between health care providers and patients or their surrogates, taking into account the best scientific evidence available while considering the patient's values, goals, and preferences. Decision aids are tools enabling SDM. This article discusses shared decision making in general and in the intensive care unit in particular and facilitators and barriers for the creation and implementation of International Patient Decision Aids Standards Collaboration-compliant decision aids for the intensive care unit and neuro-intensive care unit.

Should We Use the IMPACT-Model for the Outcome Prognostication of TBI Patients? A Qualitative Study Assessing Physicians' Perceptions

Introduction. Shared Decision-Making may facilitate information exchange, deliberation, and effective decision-making, but no decision aids currently exist for difficult decisions in neurocritical care patients. The International Patient Decision Aid Standards, a framework for the creation of high-quality decision aids (DA), recommends the presentation of numeric outcome and risk estimates. Efforts are underway to create a goals-of-care DA in critically-ill traumatic brain injury (ciTBI) patients. To inform its content, we examined physicians’ perceptions, and use of the IMPACT-model, the most widely validated ciTBI outcome model, and explored physicians’ preferences for communicating prognostic information towards families. Methods. We conducted a qualitative study using semi-structured interviews in 20 attending physicians (neurosurgery,neurocritical care,trauma,palliative care) at 7 U.S. academic medical centers. We used performed qualitative content analysis of transcribed interviews to identify major themes. Results. Only 12 physicians (60%) expressed awareness of the IMPACT-model; two stated that they “barely” knew the model. Seven physicians indicated using the model at least some of the time in clinical practice, although none used it exclusively to derive a patient’s prognosis. Four major themes emerged: the IMPACT-model is intended for research but should not be applied to individual patients; mistrust in the IMPACT-model derivation data; the IMPACT-model is helpful in reducing prognostic variability among physicians; concern that statistical models may mislead families about a patient’s prognosis. Discussion: Our study identified significant variability of the awareness, perception, and use of the IMPACT-model among physicians. While many physicians prefer to avoid conveying numeric prognostic estimates with families using the IMPACT-model, several physicians thought that they “ground” them and reduce prognostic variability among physicians. These findings may factor into the creation and implementation of future ciTBI-related DAs.

Clinical Momentum in the Intensive Care Unit. A Latent Contributor to Unwanted Care

Many older adults in the United States receive invasive medical care near the end of life, often in an intensive care unit (ICU). However, most older adults report preferences to avoid this type of medical care and to prioritize comfort and quality of life near death. We propose a novel term, "clinical momentum," to describe a system-level, latent, previously unrecognized property of clinical care that may contribute to the provision of unwanted care in the ICU. The example of chronic critical illness illustrates how clinical momentum is generated and propagated during the care of patients with prolonged illness. The ICU is an environment that is generally permissive of intervention, and clinical practice norms and patterns of usual care can promote the accumulation of multiple interventions over time. Existing models of medical decision-making in the ICU describe how individual signs, symptoms, or diagnoses automatically lead to intervention, bypassing opportunities to deliberate about the value of an intervention in the context of a patient's likely outcome or treatment preferences. We hypothesize that clinical momentum influences patients, families, and physicians to accept or tolerate ongoing interventions without consideration of likely outcomes, eventually leading to the delivery of unwanted care near the end of life. In the future, a mixed-methods research program could refine the conceptual model of clinical momentum, measure its impact on clinical practice, and interrupt its influence on unwanted care near the end of life.

Clinician Perspectives on an Electronic Portal to Improve Communication with Patients and Families in the Intensive Care Unit

RATIONALE

Communication in the intensive care unit (ICU) often falls short of patient and family needs, putting them at risk for significant physical and emotional harm. As electronic patient portals rapidly evolve, one designed specifically for the ICU might potentially enhance communication among patients, family members, and clinicians; however, the views of frontline ICU staff on such technology are unknown.

OBJECTIVES

To identify clinician perspectives on the current state of communication among patients, families, and clinicians in the ICU, and assess their views on whether and how an electronic portal may address existing communication deficits and improve care.

METHODS

Three focus groups comprised altogether of 26 clinicians from 6 ICUs, representing several disciplines in an academic medical center in Boston, Massachusetts. Transcripts were analyzed inductively for major themes using grounded theory.

MEASUREMENTS AND MAIN RESULTS

We identified seven themes reflecting clinician perspectives on communication challenges and desired portal functionality: (1) comprehension and literacy; (2) results and updates; (3) patient and family preferences; (4) interclinician communication; (5) family informational needs; (6) the ICU as an unfamiliar environment; and (7) enhancing humanism through technology. Each theme included current gaps in practice, potential benefits and concerns related to an ICU communication portal, and participant recommendations. Benefits included enhanced education, patient/family engagement, and clinician workflow. Challenges included the stress and uncertainty of ICU care, fear of technology replacing human connection, existing interclinician communication failures, and the tension between informing families without overwhelming them.

CONCLUSIONS

Overall, clinicians were cautiously supportive of an electronic portal to enhance communication in the ICU and made several specific recommendations for design and implementation. As new technologies expand opportunities for greater transparency and participation in care, clinician buy-in and positive impact will depend, in large part, on the extent to which the concerns of stakeholders are addressed. At the same time, clinicians anticipate several potential benefits that could help support provider workflow and engage patients and families through enhanced communication and humanism.

Validation of the Prognosis for Prolonged Ventilation (ProVent) score in patients receiving 14days of mechanical ventilation

PURPOSE

To evaluate the performance of the Prognosis for Prolonged Ventilation (ProVent) 14 score in patients requiring prolonged mechanical ventilation (PMV).

MATERIALS AND METHODS

Data were obtained from 366 patients receiving at least 14days of MV between January 2011 and December 2015 at a university-affiliated tertiary care hospital in Korea. ProVent 14 scores were assessed using the six standard variables. Model discrimination was assessed with the area under the receiver operating characteristic curve. Kaplan-Meier estimates were stratified according to the ProVent 14 score to predict 1-year survival.

RESULTS

The median age of the study group was 62years (range, 50-72years); 65% were male, and medical patients comprised 66% of the group. Overall mortality at 1year was 43%. For ProVent 14 scores ranging from 0 to ≥4, 1-year mortality rates were 7%, 22%, 41%, 52%, and 75%, respectively (log-rank test, P<0.001). The area under the receiver operating characteristic curve of the ProVent 14 score predicting 1-year mortality was 0.74 (95% confidence interval, 0.69-0.78).

CONCLUSIONS

The ProVent 14 score accurately identified patients receiving PMV with a high 1-year mortality risk. Further validation in a larger sample is required.

Hospital Variation in Early Tracheostomy in the United States: A Population-Based Study

OBJECTIVE

Controversy exists regarding perceived benefits of early tracheostomy to facilitate weaning among mechanically ventilated patients, potentially leading to significant practice-pattern variation with implications for outcomes and resource utilization. We sought to determine practice-pattern variation and outcomes associated with tracheostomy timing in the United States.

DESIGN

In a retrospective cohort study, we identified mechanically ventilated patients with the most common causes of respiratory failure leading to tracheostomy: pneumonia/sepsis and trauma. "Early tracheostomy" was performed within the first week of mechanical ventilation. We determined between-hospital variation in early tracheostomy utilization and the association of early tracheostomy with patient outcomes using hierarchical regression.

SETTING

2012 National Inpatient Sample.

PATIENTS

A total of 6,075 pneumonia/sepsis patients and 12,030 trauma patients with tracheostomy.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Trauma patients were twice as likely as pneumonia/sepsis patients to receive early tracheostomy (44.5% vs 21.7%; p < 0.001). Admission to hospitals with higher early tracheostomy-to-total-tracheostomy ratios was associated with increased risk for tracheostomy among mechanically ventilated trauma patients (adjusted odds ratio = 1.04; 95% CI, 1.01-1.07) but not pneumonia/sepsis (adjusted odds ratio =1.00; 95% CI, 0.98-1.02). We observed greater between-hospital variation in early tracheostomy rates among trauma patients (21.9-81.9%) compared with pneumonia/sepsis (14.9-38.3%; p < 0.0001). We found no evidence of improved hospital mortality. Pneumonia/sepsis patients with early tracheostomy had fewer feeding tube procedures and higher odds of discharge home.

CONCLUSION

Early tracheostomy is potentially overused among mechanically ventilated trauma patients, with nearly half of tracheostomies performed within the first week of mechanical ventilation and large unexplained hospital variation, without clear benefits. Future studies are needed to characterize potentially differential benefits for early tracheostomy between disease subgroups and to investigate factors driving hospital variation in tracheostomy timing.

Evaluation of a strategy for enrolling the families of critically ill patients in research using limited human resources

RATIONALE

Clinical trials of interventions aimed at the families of intensive care unit (ICU) patients have proliferated but recruitment for these trials can be challenging.

OBJECTIVES

To evaluate a strategy for recruiting families of patients currently being treated in an ICU using limited human resources and time-varying daily screening over 7 consecutive days.

METHODS

We screened the Johns Hopkins Hospital medical ICU census 7 days per week to identify eligible family members. We then made daily, in-person attempts to enroll eligible families during a time-varying 2-hour enrollment period until families declined participation, consented, or were no longer eligible.

MEASUREMENTS AND MAIN RESULTS

The primary outcome was the proportion of eligible patients for whom ≥1 family member was enrolled. Secondary outcomes included enrollment of legal healthcare proxies, the consent rate among families approached for enrollment, and success rates for recruiting at different times during the day and week. Among 284 eligible patients, 108 (38%, 95% CI 32%-44%) had ≥1 family member enrolled, and 75 (26%, 95% CI 21%-32%) had their legal healthcare proxy enrolled. Among 117 family members asked to participate, 108 (92%, 95% CI 86%-96%) were enrolled. Patients with versus without an enrolled proxy were more likely to be white (44% vs. 30%, P = .02), live in a zip code with a median income of ≥$100,000 (15% vs. 5%, P = .01), be mechanically ventilated (63% vs. 47%, P = .01), die in the ICU (19% vs. 9%, P = .03), and to have longer ICU stays (median 5.0 vs. 1.8 days, P<.001). Day of the week and time of day were not associated with family presence in the ICU or consent rate.

CONCLUSIONS

Family members were recruited for more than one third of eligible patients, and >90% of approached consented to participate. There are important demographic differences between patients with vs without an enrolled family member.

Towards Usable E-Health. A Systematic Review of Usability Questionnaires

BACKGROUND

The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen.

OBJECTIVES

To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality.

METHODS

We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table.

RESULTS

Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7).

CONCLUSIONS

Existing questionnaires provide a foundation for research on e-health usability. However, future research is needed to broaden the coverage of the usability attributes and psychometric properties of the available questionnaires.

Timing of Percutaneous Endoscopic Gastrostomy for Acute Ischemic Stroke

Background and Purpose—

Stroke guidelines recommend time-limited trials of nasogastric feeding prior to percutaneous endoscopic gastrostomy (PEG) tube placement. We sought to describe timing of PEG placement and identify factors associated with early PEG for acute ischemic stroke.

Methods—

We designed a retrospective observational study to examine time to PEG for ischemic stroke admissions in the Nationwide Inpatient Sample, 2001 to 2011. We defined early PEG placement as 1 to 7 days from admission. Using multivariable regression analysis, we identified the effects of patient and hospital characteristics on PEG timing.

Results—

We identified 34 623 admissions receiving a PEG from 2001 to 2011, 53% of which received the PEG 1 to 7 days from admission. Among hospitals placing ≥10 PEG tubes, median time to PEG for individual hospitals ranged from 3 days to over 3 weeks (interquartile range 6–8.5 days). Older adult age groups were associated with early PEG (≥85 years versus 18–54 years: adjusted odds ratio 1.68, 95% confidence interval 1.50–1.87). Those receiving a PEG and tracheostomy were more likely to receive the PEG beyond 7 days, and these patients were more often younger compared with PEG only recipients. Those admitted to high-volume hospitals were more likely to receive their PEG early (≥350 versus <150 hospitalizations; adjusted odds ratio 1.26, 95% confidence interval 1.17–1.35).

Conclusions—

More than half of the PEG recipients received their surgical feeding tube within 7 days of admission. The oldest old, who may benefit most from time-limited trials of nasogastric feeding for ≥2 to 3 weeks, were most likely to receive a PEG within 7 days.

The outcomes and prognostic factors of patients requiring prolonged mechanical ventilation

The aims of this study were to investigate the outcomes of patients requiring prolonged mechanical ventilation (PMV) and to identify risk factors associated with its mortality rate. All patients admitted to the respiratory care centre (RCC) who required PMV (the use of MV ≥21 days) between January 2006 and December 2014 were enrolled. A total of 1,821 patients were identified; their mean age was 69.8 ± 14.2 years, and 521 patients (28.6%) were aged >80 years. Upon RCC admission, the APACHE II scores were 16.5 ± 6.3, and 1,311 (72.0%) patients had at least one comorbidity. Pulmonary infection was the most common diagnosis (n = 770, 42.3%). A total of 320 patients died during hospitalization, and the in-hospital mortality rate was 17.6%. A multivariate stepwise logistic regression analysis indicated that patients were more likely to die if they who were >80 years of age, had lower albumin levels (<2 g/dl) and higher APACHE II scores (≥15), required haemodialysis, or had a comorbidity. In conclusion, the in-hospital mortality for patients requiring PMV in our study was 17%, and mortality was associated with disease severity, hypoalbuminaemia, haemodialysis, and an older age.

Development of a patient decision aid on inhaled corticosteroids use for adults with asthma

BACKGROUND

Patient decision aids (PDAs) are used in shared decision making to improve practitioner-patient communication and help patients decide about treatment options. To develop a PDA for adults with asthma considering inhaled corticosteroids, with or without long-acting beta2-agonists, to optimize asthma control.

METHODS

The PDA was developed based on the International Patient Decision Aid Standards. Step 1: PDA was drafted. Step 2: PDA acceptability was assessed among target users, certified asthma educators (CAEs) and adults with asthma, following an iterative process. a) Participants read the PDA, b) rated its presentation, length, balance, and perceived usefulness, indicated what they liked/disliked about it, and made suggestions for improvement. c) Based on results from (b), PDA was refined. This process was repeated with new participants until no suggestions were made. Step 3: The PDA was field tested with target users. Interviews with CAEs were conducted to identify areas of improvement. Step 4: Final PDA version was written.

RESULTS

A color-printed, 4-page, letter-sized PDA was drafted. Acceptability testing involved 11 CAEs (women, n = 10) and 20 adults with asthma (women, n = 13; age 22-61 years). Five successive refined versions were produced. Major changes were made to PDA terminology, instructions, paper size, and visual presentation. Two CAEs (women, n = 2) and 26 adults with asthma (women, n = 19; age 20-65 years) field tested PDA. Minor changes were made to language and instructions to ensure usability. The final version was a color-printed, 12-page, A3-sized booklet.

CONCLUSION

Our newly developed PDA was found acceptable and usable in target users.

Key stakeholders' perceptions of the acceptability and usefulness of a tablet-based tool to improve communication and shared decision making in ICUs

PURPOSE

Although barriers to shared decision making in intensive care units are well documented, there are currently no easily scaled interventions to overcome these problems. We sought to assess stakeholders' perceptions of the acceptability, usefulness, and design suggestions for a tablet-based tool to support communication and shared decision making in ICUs.

METHODS

We conducted in-depth semi-structured interviews with 58 key stakeholders (30 surrogates and 28 ICU care providers). Interviews explored stakeholders' perceptions about the acceptability of a tablet-based tool to support communication and shared decision making, including the usefulness of modules focused on orienting families to the ICU, educating them about the surrogate's role, completing a question prompt list, eliciting patient values, educating about treatment options, eliciting perceptions about prognosis, and providing psychosocial support resources. The interviewer also elicited stakeholders' design suggestions for such a tool. We used constant comparative methods to identify key themes that arose during the interviews.

RESULTS

Overall, 95% (55/58) of participants perceived the proposed tool to be acceptable, with 98% (57/58) of interviewees finding six or more of the seven content domains acceptable. Stakeholders identified several potential benefits of the tool including that it would help families prepare for the surrogate role and for family meetings as well as give surrogates time and a framework to think about the patient's values and treatment options. Key design suggestions included: conceptualize the tool as a supplement to rather than a substitute for surrogate-clinician communication; make the tool flexible with respect to how, where, and when surrogates can access the tool; incorporate interactive exercises; use video and narration to minimize the cognitive load of the intervention; and build an extremely simple user interface to maximize usefulness for individuals with low computer literacy.

CONCLUSION

There is broad support among stakeholders for the use of a tablet-based tool to improve communication and shared decision making in ICUs. Eliciting the perspectives of key stakeholders early in the design process yielded important insights to create a tool tailored to the needs of surrogates and care providers in ICUs.