Applying patient-reported outcome methodology to capture patient-reported health data: Report from an NIH Collaboratory roundtable

Patient-reported health data provide information for pragmatic clinical trials that may not be readily available from electronic health records or administrative claims data. In this report, we present key considerations for collecting patient-reported health information in pragmatic clinical trials, which are informed by best practices from patient-reported outcome research. We focus on question design and administration via electronic data collection platforms with respect to 3 types of patient-reported health data: medication use, utilization of health care services, and comorbid conditions. We summarize key scientific literature on the accuracy of these patient-reported data compared with electronic health record data. We discuss question design in detail, specifically defining the concept to be measured, patient understanding of the concept, recall periods of the question, and patient willingness to report. In addition, we discuss approaches for question administration and data collection platforms, which are key aspects of successful patient-reported data collection.

Viewing assessments of patient-reported heath status as conversations: Implications for developing and evaluating patient-reported outcome measures

Patient-reported outcome measures (PROMs) are frequently used in research to reflect the patient's perspective. In this commentary, I argue that further improvements can be made in how we develop and evaluate PROMs by viewing assessment as a type of conversation. Philosophically speaking, a PROM assessment can be conceptualized as a formal conversation that serves as a model of an informal, longer, and more nuanced conversation with a research participant about their health experience. Psychologically speaking, evidence from research in survey methodology and discursive psychology shows that respondents to self-report measures behave in ways consistent with the idea that they are doing their best to participate in a conversation, albeit an unusual one. Several suggestions are offered for creating a better conversational context through study materials and PROM instructions, and by improving the yield of cognitive interviews. It is hoped that this commentary can stimulate further discussions in our field regarding how to integrate insights about the conversational nature of assessment from survey research and discursive psychology to better reflect the patient's voice in research.

Public views regarding the responsibility of patients, clinicians, and institutions to participate in research in the United States

BACKGROUND

The need for more and better evidence to inform clinical decision making among all stakeholders has fueled calls for creating learning healthcare systems. The successful realization of a learning healthcare system seems to assume that various parties have a responsibility to participate in learning activities, including research. The objective of this study was to determine whether members of the general public perceive an ethical responsibility to participate in pragmatic clinical research that would be inherent to a learning health system.

METHODS

A total of 2994 English-speaking adults completed a nationally representative online survey.

RESULTS

About two-thirds of respondents were relatively neutral regarding a responsibility for themselves and others to participate in research; the remainder felt that they and others did not have a responsibility to participate in research.

CONCLUSIONS

Efforts to justify and develop a robust learning health system in an ethically acceptable fashion need to take these findings into account.

A new outcome measure for LUTS: Symptoms of Lower Urinary Tract Dysfunction Research Network Symptom Index-29 (LURN SI-29) questionnaire

AIMS

To develop a representative, self-report assessment of lower urinary tract symptoms (LUTS) for men and women, the symptoms of Lower Urinary Tract Dysfunction Research Network Symptom Index-29 (LURN SI-29).

METHODS

Women and men seeking treatment for LUTS at one of six academic medical centers in the US were assessed at baseline, 3-month and 12-month intervals. Twelve-month data on 78 LURN SI-29 items were analyzed among 353 women and 420 men using exploratory factor analysis (EFA), with factor structure confirmed using confirmatory factor analysis (CFA). Internal consistency, reliability, and validity of the five developed scales were evaluated by assessing correlations with the American Urological Association Symptom Index (AUA-SI), the genitourinary pain index (GUPI), and the Pelvic Floor Distress Inventory-20 (PFDI-20), and by examining expected sex differences in scores.

RESULTS

EFA results (n = 150 women; 150 men) produced an interpretable eight-factor solution, with three of the factors comprised of dichotomous items addressing LUTS-associated sensations. The remaining five factors, confirmed with CFA in an independent sample of 473 participants, produced five scales: incontinence, urgency, voiding difficulty, bladder pain, and nocturia. Subscales and total LURN SI-29 scores were correlated as expected with AUA-SI, GUPI, and PFDI-20. LURN SI-29 scores also performed as expected in differentiating men from women based upon clinically expected differences, with men reporting more voiding difficulties and nocturia, and women reporting more urgency and incontinence.

CONCLUSIONS

The LURN SI-29 questionnaire has the potential to improve research and clinical outcome measurement for both men and women with LUTS.

Exploring Understanding of "Understanding": The Paradigm Case of Biobank Consent Comprehension

Data documenting poor understanding among research participants and real-time efforts to assess comprehension in large-scale studies are focusing new attention on informed consent comprehension. Within the context of biobanking consent, we previously convened a multidisciplinary panel to reach consensus about what information must be understood for a prospective participant's consent to be considered valid. Subsequently, we presented them with data from another study showing that many U.S. adults would fail to comprehend the information the panel had deemed essential. When asked to evaluate the importance of the information again, panelists' opinions shifted dramatically in the direction of requiring that less information be understood. Follow-up interviews indicated significant uncertainty about defining a threshold of understanding and what should happen when prospective participants are unable to grasp key information. These findings have important implications for urgently needed discussion of whether consent comprehension is an ethical requirement or an ethical aspiration.

Preventive Misconception and Risk Behaviors in a Multinational HIV Prevention Trial

BACKGROUND

Some HIV prevention research participants may hold a "preventive misconception" (PM), an overestimate of the probability or level of personal protection afforded by trial participation. However, these reports typically rely upon small, retrospective qualitative assessments that did not use a standardized approach.

METHODS

We administered a measure of PM called PREMIS, during Microbicide Trials Network 020-A Study to Prevent Infection with a Ring for Extended Use, a large, multicenter, placebo-controlled, phase III trial evaluating the safety and efficacy of a dapivirine vaginal ring among women at risk for HIV infection in Malawi, South Africa, Uganda, and Zimbabwe. The maximum follow-up period was 2.6 years.

RESULTS

One thousand two hundred sixty-one respondents completed PREMIS at their month 3 visit (M3); 2085 at their month 12 visit (M12); and 1010 at both visits. Most participants expressed high expectations of personal benefit (EPB) and that at least one of the rings used in the trial would reduce the risk of getting HIV (expectation of maximum aggregate benefit or EMAB). There was a moderate positive correlation between EPB and EMAB at M3 (r = .43, 95% CI: .37, .47) and M12 (r = .44, 95% CI: .40, .48). However, there was variability among sites in the strength of the relationship. There was no relationship between either expectation variable and condom use, adherence, or HIV infection.

CONCLUSIONS

A majority of trial participants expressed some belief that their risk of HIV infection would be reduced by using a vaginal ring, which may signal PM. However, such beliefs were not associated with adherence, condom use, or subsequent HIV infection, and there was variability across sites. Further work is needed to understand these findings.

Emergency Consent: Patients' and Surrogates' Perspectives on Consent for Clinical Trials in Acute Stroke and Myocardial Infarction

Background

Emergent informed consent for clinical trials in acute myocardial infarction (AMI) and stroke is challenging. The role and value of consent are controversial, and insufficient data exist regarding patients’ and surrogates’ experiences.

Methods and Results

We conducted structured interviews with patients (or surrogates) enrolled in AMI or acute stroke trials at 6 sites between 2011 and 2016. Primary domains included trial recall, consent experiences, and preferences regarding involvement. Descriptive and test statistics were used to characterize responses and explore relationships between key domains and characteristics. Multivariable logistic regression was used to examine associations between key covariates and consent preferences. There were 176 (84 stroke, 92 AMI) completed interviews. Most stroke respondents (82%) were surrogates; all AMI respondents were patients. Average time from trial enrollment to interview was 1.9 years (stroke) and 2.8 years (AMI); 89% of stroke and 62% of AMI respondents remembered being in the trial, and among these respondents, 80% (stroke) and 44% (AMI) remembered reading some of the consent form. Over 90% reported not feeling pressure to enroll, being treated in a caring way, and being treated with dignity. A minority (16% stroke and 26% AMI) reported they would have preferred not to be asked for consent. Just over half (61% stroke and 53% AMI) recalled a postenrollment conversation about the study.

Conclusions

Most respondents felt they were treated respectfully and were glad they had been asked for consent. Trial recall was relatively low, and many respondents recalled little postenrollment discussion. Further development of context‐sensitive approaches to consent is important.

Symptom Based Clustering of Women in the LURN Observational Cohort Study

PURPOSE

Women with lower urinary tract symptoms are often diagnosed based on a predefined symptom complex or a predominant symptom. There are many limitations to this paradigm as often patients present with multiple urinary symptoms which do not perfectly fit the preestablished diagnoses. We used cluster analysis to identify novel, symptom based subtypes of women with lower urinary tract symptoms.

MATERIALS AND METHODS

We analyzed baseline urinary symptom questionnaire data obtained from 545 care seeking female participants enrolled in the LURN (Symptoms of Lower Urinary Tract Dysfunction Research Network) Observational Cohort Study. Symptoms were measured with the LUTS (lower urinary tract symptoms) Tool and the AUA SI (American Urological Association Symptom Index), and analyzed using a probability based consensus clustering algorithm.

RESULTS

Four clusters were identified. The 138 women in cluster F1 did not report incontinence but experienced post-void dribbling, frequency and voiding symptoms. The 80 women in cluster F2 reported urgency incontinence as well as urgency and frequency but minimal voiding symptoms or stress incontinence. Cluster F3 included 244 women who reported all types of incontinence, urgency, frequency and mild voiding symptoms. The 83 women in cluster F4 reported all lower urinary tract symptoms at uniformly high levels. All but 2 of 44 LUTS Tool and 8 AUA SI questions significantly differed between at least 2 clusters (p <0.05). All clusters contained at least 1 member from each conventional group, including continence, and stress, urgency, mixed and other incontinence.

CONCLUSIONS

Women seeking care for lower urinary tract symptoms cluster into 4 distinct symptom groups which differ from conventional clinical diagnostic groups. Further validation is needed to determine whether management improves using this new classification.

Correction to: Inflammatory Bowel Diseases Can Adversely Impact Domains of Sexual Function Such as Satisfaction with Sex Life

The original version of the article unfortunately contained an error in Results section of Abstract.

Prevalence and Characteristics of Urinary Incontinence in a Treatment Seeking Male Prospective Cohort: Results from the LURN Study

PURPOSE

Male urinary incontinence is thought to be infrequent. We sought to describe the prevalence of urinary incontinence in a male treatment seeking cohort enrolled in the LURN (Symptoms of Lower Urinary Tract Dysfunction Research Network).

MATERIALS AND METHODS

Study inclusion and exclusion criteria, including men with prostate cancer or neurogenic bladder, were previously reported. LURN participants prospectively completed questionnaires regarding lower urinary tract symptoms and other clinical variables. Men were grouped based on incontinence type, including 1) no urinary incontinence, 2) post-void dribbling only and 3) urinary incontinence. Comparisons were made using ANOVA and multivariable regression.

RESULTS

Of the 477 men 24% reported no urinary incontinence, 44% reported post-void dribbling only and 32% reported urinary incontinence. African American men and those with sleep apnea were more likely to be in the urinary incontinence group than in the no urinary incontinence group (OR 3.2, p = 0.02 and OR 2.73, p = 0.003, respectively). Urinary incontinence was associated with significantly higher bother compared to men without leakage (p <0.001). Compared to men without urinary incontinence and men with only post-void dribbling those with urinary incontinence were significantly more likely to report higher scores (more severe symptoms) on the PROMIS (Patient-Reported Outcomes Measurement Information System) questionnaires regarding bowel issues, depression and anxiety than men without urinary incontinence (p <0.01).

CONCLUSIONS

Urinary incontinence is common among treatment seeking men. This is concerning because the guideline recommended questionnaires to assess male lower urinary tract symptoms do not query for urinary incontinence. Thus, clinicians may be missing an opportunity to intervene and improve patient care. This provides a substantial rationale for a new or updated symptom questionnaire which provides a more comprehensive symptom assessment.

Design and rationale for the life after stopping tyrosine kinase inhibitors (LAST) study, a prospective, single-group longitudinal study in patients with chronic myeloid leukemia

BACKGROUND

Treatment of chronic myeloid leukemia with a tyrosine kinase inhibitor (TKI) offers significant improvements over previous treatments in terms of survival and toxicity yet nevertheless is associated with reduced health-related quality of life and very high cost. Several small studies from Europe and Australia suggested that discontinuing TKIs with regular monitoring was safe.

METHODS

The Life After Stopping TKIs (LAST) study is a large, U.S.-based study that aims to improve the evidence for clinical decision making regarding TKI discontinuation with monitoring in patients with chronic myeloid leukemia who have a deep molecular response to TKI therapy. The LAST study is a non-randomized, prospective, single-group longitudinal study of 173 patients. The co-primary objectives are to determine the proportion of patients who develop molecular recurrence (> 0.1% BCR-ABLIS) after discontinuing one of four TKIs (imatinib, dasatinib, nilotinib, or bosutinib) and to compare the patient-reported health status of patients before and after stopping TKIs. Outcomes are assessed at baseline and throughout the 36-month study follow-up period with a central laboratory used for blood samples. All samples with undetectable BCR-ABL are also examined using digital polymerase chain reaction, which is a more sensitive nanofluidic polymerase chain reaction system.

DISCUSSION

Because of their high cost and side effects, discontinuation of TKIs for patients with chronic myeloid leukemia who have a deep molecular response to TKI therapy is a promising approach to treatment. The LAST study is the largest U.S.-based TKI discontinuation study. It is the first to allow participation from patients on any of 4 first- and second-generation TKIs, includes a robust approach to measurement of clinical and patient-reported outcomes, and is using digital polymerase chain reaction to explore better prediction of safe discontinuation.

TRIAL REGISTRATION

This study was registered prospectively on October 21, 2014 and assigned trial number NCT02269267 .

Reasons for Seeking Clinical Care for Lower Urinary Tract Symptoms: A Mixed Methods Study

PURPOSE

The primary objective of this study was to evaluate reasons for seeking care among men and women with lower urinary tract symptoms.

MATERIALS AND METHODS

Participants were recruited from urology and urogynecology clinics, and the community. The sample was enriched with persons expected to have abnormal or diminished bladder sensations (eg participants with lower back surgery and participants 65 years old or older). Interviews were performed in person beginning with an open-ended assessment of urinary symptoms and associated bother followed by more directed questions, including reasons for seeking or not seeking treatment. We also examined the relationship between symptom frequency and bother using the LUTS (Lower Urinary Tract Symptoms) Tool.

RESULTS

A total of 88 participants, including 38 men and 50 women, with a mean ± SD age of 52.2 ± 14.3 years provided information about urinary symptoms, including a range of quality of life consequences and coping behaviors. They sought treatment mostly because of new, continuing or bothersome symptoms. Factors associated with not seeking treatment included low symptom severity and concerns about the costs vs the benefits of treatment (eg side effects of medication). Symptom frequency and bother were associated with each other across symptoms assessed by the LUTS Tool.

CONCLUSIONS

In this large qualitative study we obtained useful insights into the impact of lower urinary tract symptoms from the perspective of the person with the symptoms. Removing barriers and misconceptions about the treatment of lower urinary tract symptoms may increase the number of people who seek clinical care and improve the clinical course of men and women who experience lower urinary tract symptoms.

Abstract WP307: Patients’ and Surrogates’ Experiences and Views of Consent in Acute Stroke Trials

Introduction: Informed consent for clinical trials in acute stroke is challenging. Enrollment decisions must be made quickly, in stressful situations, and typically by a surrogate. Moreover, trials are complex and unfamiliar. Understanding patients’ and surrogates’ experiences may help maximize respect for them while facilitating important studies.

Methods: Telephone interviews were conducted with consented patients or surrogates for patients enrolled in acute stroke trials at 3 US sites between 2011 and 2016. Interviews assessed trial recall, experiences with consent, and preferences regarding consent. Questions were primarily closed-ended. Descriptive statistics were calculated, and bivariate analyses (Fisher’s exact) were conducted to examine predictors of consent preference.

Results: Eighty-four respondents (69 surrogates, 15 patients) across 3 sites and 10 trials were interviewed and included in final analysis. Nine did not recall enrollment, and only about half (53%) recalled that the trial involved an intervention. Of 75 respondents who remembered enrolling, 65 (87%) remembered signing a consent form, 52 (80%) of whom said they read at least some of it. Most respondents reported being treated respectfully during consent. Only 12 respondents (16%) wished they had been enrolled in the trial without prospective consent. Individuals with low health literacy were less likely to prefer enrollment without consent (p<0.0007) but more likely to wish they had not had to sign a consent form (p<0.0001). Forty-six (61%) recalled someone talking with them about the study after enrollment.

Conclusions: Patients and surrogates in stroke trials reported mostly positive consent experiences and generally appreciated having been asked for consent prior to enrollment. Recall of trial details, however, was low, and post-enrollment contact was recalled to be somewhat infrequent. Further work may help to identify the most context-appropriate strategies.

Reframing Consent for Clinical Research: A Function-Based Approach

Although informed consent is important in clinical research, questions persist regarding when it is necessary, what it requires, and how it should be obtained. The standard view in research ethics is that the function of informed consent is to respect individual autonomy. However, consent processes are multidimensional and serve other ethical functions as well. These functions deserve particular attention when barriers to consent exist. We argue that consent serves seven ethically important and conceptually distinct functions. The first four functions pertain principally to individual participants: (1) providing transparency; (2) allowing control and authorization; (3) promoting concordance with participants' values; and (4) protecting and promoting welfare interests. Three other functions are systemic or policy focused: (5) promoting trust; (6) satisfying regulatory requirements; and (7) promoting integrity in research. Reframing consent around these functions can guide approaches to consent that are context sensitive and that maximize achievable goals.

Patients' Conceptions of Terms Related to Sexual Interest, Desire, and Arousal

BACKGROUND

Measurement of sexual function typically uses self-report, which, to work as intended, must use language that is understood consistently by diverse respondents. Commonly used measures employ multiple terms, primarily (sexual) interest, desire, and arousal, that might not be understood in the same way by laypeople and professionals.

AIM

To inform self-reported measurement efforts for research and clinical settings by examining how US men and women recruited from a health care setting understand and interpret different terms.

METHODS

We conducted 10 focus groups in Durham, NC (N = 57). Discussions were audio-recorded and transcribed, and the content of the discussions was systematically analyzed in 2 phases of coding by the research team, facilitated by Nvivo qualitative analysis software (QSR International, Doncaster, VIC, Australia).

OUTCOMES

Patient focus group discussions about the meanings and connotations of multiple terms related to sexual function, especially interest, desire, and arousal.

RESULTS

5 groups included male participants and 5 included female participants. Participants characterized (sexual) interest as a cognitive phenomenon and a situational response to a specific person. Similarly, they characterized (sexual) desire as a situational person-specific experience with some support for it as a cognitive phenomenon but more support for it as a physical phenomenon. In contrast, participants characterized sexual arousal as a physical phenomenon occurring in response to physical or visual stimulation and not related to a specific person.

CLINICAL IMPLICATIONS

These results can help us understand how laypeople are using and responding to these terms when they are used in clinical and research settings.

STRENGTHS AND LIMITATIONS

Patient participants in these groups were diverse in age, gender, sexual orientation, and health, with the potential to voice diverse perspectives on sexual functioning; however, the sample was limited to a single city in the southeastern United States.

CONCLUSION

The meanings of interest, desire, and arousal were defined, compared, and contrasted in the context of patient focus groups. Qualitative coding showed that interest was considered the most "cognitive," arousal the most "physical," and desire somewhere in between. DeLamater JD, Weinfurt KP, Flynn KE. Patients' Conceptions of Terms Related to Sexual Interest, Desire, and Arousal. J Sex Med 2017;14:1327-1335.

Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory

BACKGROUND

The clinical research enterprise is not producing the evidence decision makers arguably need in a timely and cost effective manner; research currently involves the use of labor-intensive parallel systems that are separate from clinical care. The emergence of pragmatic clinical trials (PCTs) poses a possible solution: these large-scale trials are embedded within routine clinical care and often involve cluster randomization of hospitals, clinics, primary care providers, etc. Interventions can be implemented by health system personnel through usual communication channels and quality improvement infrastructure, and data collected as part of routine clinical care. However, experience with these trials is nascent and best practices regarding design operational, analytic, and reporting methodologies are undeveloped.

METHODS

To strengthen the national capacity to implement cost-effective, large-scale PCTs, the Common Fund of the National Institutes of Health created the Health Care Systems Research Collaboratory (Collaboratory) to support the design, execution, and dissemination of a series of demonstration projects using a pragmatic research design.

RESULTS

In this article, we will describe the Collaboratory, highlight some of the challenges encountered and solutions developed thus far, and discuss remaining barriers and opportunities for large-scale evidence generation using PCTs.

CONCLUSION

A planning phase is critical, and even with careful planning, new challenges arise during execution; comparisons between arms can be complicated by unanticipated changes. Early and ongoing engagement with both health care system leaders and front-line clinicians is critical for success. There is also marked uncertainty when applying existing ethical and regulatory frameworks to PCTS, and using existing electronic health records for data capture adds complexity.

Improving biobank consent comprehension: a national randomized survey to assess the effect of a simplified form and review/retest intervention

PURPOSE

To determine the individual and combined effects of a simplified form and a review/retest intervention on biobanking consent comprehension.

METHODS

We conducted a national online survey in which participants were randomized within four educational strata to review a simplified or traditional consent form. Participants then completed a comprehension quiz; for each item answered incorrectly, they reviewed the corresponding consent form section and answered another quiz item on that topic.

RESULTS

Consistent with our first hypothesis, comprehension among those who received the simplified form was not inferior to that among those who received the traditional form. Contrary to expectations, receipt of the simplified form did not result in significantly better comprehension compared with the traditional form among those in the lowest educational group. The review/retest procedure significantly improved quiz scores in every combination of consent form and education level. Although improved, comprehension remained a challenge in the lowest-education group. Higher quiz scores were significantly associated with willingness to participate.

CONCLUSION

Ensuring consent comprehension remains a challenge, but simplified forms have virtues independent of their impact on understanding. A review/retest intervention may have a significant effect, but assessing comprehension raises complex questions about setting thresholds for understanding and consequences of not meeting them.Genet Med advance online publication 13 October 2016.

Sexual function and satisfaction among heterosexual and sexual minority U.S. adults: A cross-sectional survey

Background

Despite known health disparities for sexual minorities, few studies have described sexual function by sexual orientation using a robust approach to measurement of sexual function. We compared recent sexual function and satisfaction by sexual orientation among English-speaking US adults.

Methods and findings

Cross-sectional surveys were administered by KnowledgePanel^® (GfK), an online panel that uses address-based probability sampling and is representative of the civilian, noninstitutionalized US population. Data were collected in 2013 from the general population (n = 3314, 35% response rate) and in 2014 from self-identified lesbian, gay, and bisexual adults (n = 1011, 50% response rate). Sexual function and satisfaction were measured using the Patient-Reported Outcomes Measurement Information System^® Sexual Function and Satisfaction measure version 2.0 (PROMIS SexFS v2). The PROMIS SexFS v2 is a comprehensive, customizable measurement system with evidence for validity in diverse populations. A score of 50 (SD 10) on each domain corresponds to the average for US adults sexually active in the past 30 days. We adjusted all statistics for the complex sample designs and report differences within each sex where the 95% CIs do not overlap, corresponding to p<0.01. Among US men who reported any sexual activity in the past 30 days, there were no differences in erectile function or orgasm-ability. Compared to heterosexual men, sexual minority men reported higher oral dryness and lower orgasm-pleasure and satisfaction. Compared to heterosexual men, gay men reported lower interest, higher anal discomfort and higher oral discomfort. Among sexually active women, there were no differences in the domains of vulvar discomfort-clitoral, orgasm-pleasure, or satisfaction. Compared to heterosexual women, sexual minority women reported higher oral dryness. Lesbian women reported lower vaginal discomfort than other women; lesbian women reported higher lubrication and orgasm-ability than heterosexual women. Bisexual women reported higher interest, higher vulvar discomfort-labial and higher anal discomfort than other women, as well as higher oral discomfort compared to heterosexual women.

Conclusions

Recent sexual function and satisfaction differed by sexual orientation among US adults. Sexual minority men and women had decrements in domains of sexual function that have not traditionally been included in multi-dimensional self-report measures. Clinicians should make themselves aware of their patients’ sexual concerns and recognize that sexual minority patients may be more vulnerable to certain sexual difficulties than heterosexual patients.