1
|
Florez MI, Botto E, Kim JY. Mapping Strategies for Reaching Socioeconomically Disadvantaged Populations in Clinical Trials. JAMA Netw Open 2024; 7:e2413962. [PMID: 38848069 PMCID: PMC11161842 DOI: 10.1001/jamanetworkopen.2024.13962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 03/14/2024] [Indexed: 06/10/2024] Open
Abstract
Importance Socioeconomically disadvantaged patients, such as persons with low income and those with low educational attainment, are less likely to participate in clinical trials than those with higher earnings and higher educational attainment, despite the former being more likely to have chronic medical conditions. Ways to improve the representation of socioeconomically disadvantaged patients in clinical trials deserve attention. Objective To examine whether current recruitment and enrollment strategies used by US clinical research sites appropriately include patients from socioeconomically disadvantaged backgrounds. Design, Setting, and Participants This survey study was conducted between April and July 2023. An online survey was distributed among US clinical research sites to explore their use of these strategies and the types of patient sociodemographic and socioeconomic data they collect. The survey was distributed by 13 pharmaceutical companies and 1 clinical research organization. Eight targeted strategies known to increase the recruitment and retention of socioeconomically disadvantaged participants as well as 6 general strategies to recruit and retain clinical trial participants were identified. Data analysis was performed between August and September 2023. Main Outcomes and Measures Proportions of for-profit vs nonprofit or governmental sites that use recruitment and retention strategies, proportions that have partnerships with community organizations that target socioeconomically disadvantaged groups, and the distribution of sociodemographic and socioeconomic data collected by sites about their patients. A χ2 test of independence was performed to assess the association between research site ownership type and levels of adoption of strategies. Results A total of 492 responses were collected from 381 clinical research sites in the US (219 for-profit sites [57.5%] and 162 nonprofit or governmental sites [42.5%]). Overall, compared with nonprofit or governmental sites, for-profit sites reported higher use of strategies shown to increase the recruitment and retention of socioeconomically disadvantaged populations, including always or often providing after-hours visits (84 of 173 for-profit sites [48.6%]; 22 of 123 nonprofit or governmental sites [17.9%]) and offering financial compensation (135 of 162 for-profit sites [83.3%]; 60 of 123 nonprofit or governmental sites [48.8%]). Additionally, there was an association between research site ownership type and levels of adoption of these strategies; for example, for-profit sites were more likely to provide after-hours visits (χ2 = 30.33; P < .001) and offer financial compensation (χ2 = 49.35; P < .001). Only 7.2% of for-profit sites (12 of 167) and 13.0% of nonprofit or governmental sites (16 of 123) collected information on the patient's annual income. Conclusions and Relevance In this survey study, we found an association between a clinical research site's ownership type (for-profit vs nonprofit or governmental) and how often it used strategies to engage socioeconomically diverse populations in clinical research. Regardless of ownership type, most clinical research sites did not collect socioeconomic information from patients. Adoption of strategies to engage socioeconomically diverse populations, particularly by nonprofit or governmental sites, may help minimize barriers to participation for socioeconomically disadvantaged patients.
Collapse
Affiliation(s)
- Maria I. Florez
- Tufts Center for the Study of Drug Development, Tufts University School of Medicine, Boston, Massachusetts
| | - Emily Botto
- Tufts Center for the Study of Drug Development, Tufts University School of Medicine, Boston, Massachusetts
| | - Jennifer Y. Kim
- Tufts Center for the Study of Drug Development, Tufts University School of Medicine, Boston, Massachusetts
| |
Collapse
|
2
|
Hudek N, Carroll K, Semchishen S, Vanderhout S, Presseau J, Grimshaw J, Fergusson DA, Gillies K, Graham ID, Taljaard M, Brehaut JC. Describing the content of trial recruitment interventions using the TIDieR reporting checklist: a systematic methodology review. BMC Med Res Methodol 2024; 24:85. [PMID: 38589803 PMCID: PMC11000410 DOI: 10.1186/s12874-024-02195-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 03/03/2024] [Indexed: 04/10/2024] Open
Abstract
BACKGROUND Recruiting participants to clinical trials is an ongoing challenge, and relatively little is known about what recruitment strategies lead to better recruitment. Recruitment interventions can be considered complex interventions, often involving multiple components, targeting a variety of groups, and tailoring to different groups. We used the Template for Intervention Description and Replication (TIDieR) reporting checklist (which comprises 12 items recommended for reporting complex interventions) to guide the assessment of how recruitment interventions are described. We aimed to (1) examine to what extent we could identify information about each TIDieR item within recruitment intervention studies, and (2) observe additional detail for each item to describe useful variation among these studies. METHODS We identified randomized, nested recruitment intervention studies providing recruitment or willingness to participate rates from two sources: a Cochrane review of trials evaluating strategies to improve recruitment to randomized trials, and the Online Resource for Research in Clinical triAls database. First, we assessed to what extent authors reported information about each TIDieR item. Second, we developed descriptive categorical variables for 7 TIDieR items and extracting relevant quotes for the other 5 items. RESULTS We assessed 122 recruitment intervention studies. We were able to extract information relevant to most TIDieR items (e.g., brief rationale, materials, procedure) with the exception of a few items that were only rarely reported (e.g., tailoring, modifications, planned/actual fidelity). The descriptive variables provided a useful overview of study characteristics, with most studies using various forms of informational interventions (55%) delivered at a single time point (90%), often by a member of the research team (59%) in a clinical care setting (41%). CONCLUSIONS Our TIDieR-based variables provide a useful description of the core elements of complex trial recruitment interventions. Recruitment intervention studies report core elements of complex interventions variably; some process elements (e.g., mode of delivery, location) are almost always described, while others (e.g., duration, fidelity) are reported infrequently, with little indication of a reason for their absence. Future research should explore whether these TIDieR-based variables can form the basis of an approach to better reporting of elements of successful recruitment interventions.
Collapse
Affiliation(s)
- Natasha Hudek
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Kelly Carroll
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Seana Semchishen
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Shelley Vanderhout
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Justin Presseau
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
| | - Jeremy Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Dean A Fergusson
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Katie Gillies
- Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, UK
| | - Ian D Graham
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Monica Taljaard
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Jamie C Brehaut
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada.
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada.
| |
Collapse
|
3
|
Baumeister A, Aldin A, Chakraverty D, Hübner C, Adams A, Monsef I, Skoetz N, Kalbe E, Woopen C. Interventions for improving health literacy in migrants. Cochrane Database Syst Rev 2023; 11:CD013303. [PMID: 37963101 PMCID: PMC10645402 DOI: 10.1002/14651858.cd013303.pub2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2023]
Abstract
BACKGROUND Health literacy (HL) is a determinant of health and important for autonomous decision-making. Migrants are at high risk for limited HL. Improving HL is important for equitable promotion of migrants' health. OBJECTIVES To assess the effectiveness of interventions for improving HL in migrants. To assess whether female or male migrants respond differently to the identified interventions. SEARCH METHODS We ran electronic searches to 2 February 2022 in CENTRAL, MEDLINE, Embase, PsycInfo and CINAHL. We also searched trial registries. We used a study filter for randomised controlled trials (RCTs) (RCT classifier). SELECTION CRITERIA We included RCTs and cluster-RCTs addressing HL either as a concept or its components (access, understand, appraise, apply health information). DATA COLLECTION AND ANALYSIS We used the methodological procedures recommended by Cochrane and followed the PRISMA-E guidelines. Outcome categories were: a) HL, b) quality of life (QoL), c) knowledge, d) health outcomes, e) health behaviour, f) self-efficacy, g) health service use and h) adverse events. We conducted meta-analysis where possible, and reported the remaining results as a narrative synthesis. MAIN RESULTS We included 28 RCTs and six cluster-RCTs (8249 participants), all conducted in high-income countries. Participants were migrants with a wide range of conditions. All interventions were adapted to culture, language and literacy. We did not find evidence that HL interventions cause harm, but only two studies assessed adverse events (e.g. anxiety). Many studies reported results for short-term assessments (less than six weeks after total programme completion), reported here. For several comparisons, there were also findings at later time points, which are presented in the review text. Compared with no HL intervention (standard care/no intervention) or an unrelated HL intervention (similar intervention but different information topic) Self-management programmes (SMP) probably improve self-efficacy slightly (standardised mean difference (SMD) 0.28, 95% confidence interval (CI) 0.06 to 0.50; 2 studies, 333 participants; moderate certainty). SMP may improve HIV-related HL (understanding (mean difference (MD) 4.25, 95% CI 1.32 to 7.18); recognition of HIV terms (MD 3.32, 95% CI 1.28 to 5.36)) (1 study, 69 participants). SMP may slightly improve health behaviours (3 studies, 514 participants), but may have little or no effect on knowledge (2 studies, 321 participants) or subjective health status (MD 0.38, 95% CI -0.13 to 0.89; 1 study, 69 participants) (low certainty). We are uncertain of the effects of SMP on QoL, health service use or adverse events due to a lack of evidence. HL skills building courses (HLSBC) may improve knowledge (MD 10.87, 95% CI 5.69 to 16.06; 2 studies, 111 participants) and any generic HL (SMD 0.48, 95% CI 0.20 to 0.75; 2 studies, 229 participants), but may have little or no effect on depression literacy (MD 0.17, 95% CI -1.28 to 1.62) or any health behaviour (2 studies, 229 participants) (low certainty). We are uncertain if HLSBC improve QoL, health outcomes, health service use, self-efficacy or adverse events, due to very low-certainty or a lack of evidence. Audio-/visual education without personal feedback (AVE) probably improves depression literacy (MD 8.62, 95% CI 7.51 to 9.73; 1 study, 202 participants) and health service use (MD -0.59, 95% CI -1.11 to -0.07; 1 study, 157 participants), but probably has little or no effect on health behaviour (risk ratio (RR) 1.07, 95% CI 0.91 to 1.25; 1 study, 135 participants) (moderate certainty). AVE may improve self-efficacy (MD 3.51, 95% CI 2.53 to 4.49; 1 study, 133 participants) and may slightly improve knowledge (MD 8.44, 95% CI -2.56 to 19.44; 2 studies, 293 participants) and intention to seek depression treatment (MD 1.8, 95% CI 0.43 to 3.17), with little or no effect on depression (SMD -0.15, 95% CI -0.40 to 0.10) (low certainty). No evidence was found for QoL and adverse events. Adapted medical instruction may improve understanding of health information (3 studies, 478 participants), with little or no effect on medication adherence (MD 0.5, 95% CI -0.1 to 1.1; 1 study, 200 participants) (low certainty). No evidence was found for QoL, health outcomes, knowledge, health service use, self-efficacy or adverse events. Compared with written information on the same topic SMP probably improves health numeracy slightly (MD 0.7, 95% CI 0.15 to 1.25) and probably improves print literacy (MD 9, 95% CI 2.9 to 15.1; 1 study, 209 participants) and self-efficacy (SMD 0.47, 95% CI 0.3 to 0.64; 4 studies, 552 participants) (moderate certainty). SMP may improve any disease-specific HL (SMD 0.67, 95% CI 0.27 to 1.07; 4 studies, 955 participants), knowledge (MD 11.45, 95% CI 4.75 to 18.15; 6 studies, 1101 participants) and some health behaviours (4 studies, 797 participants), with little or no effect on health information appraisal (MD 1.15, 95% CI -0.23 to 2.53; 1 study, 329 participants) (low certainty). We are uncertain whether SMP improves QoL, health outcomes, health service use or adverse events, due to a lack of evidence or low/very low-certainty evidence. AVE probably has little or no effect on diabetes HL (MD 2, 95% CI -0.15 to 4.15; 1 study, 240 participants), but probably improves information appraisal (MD -9.88, 95% CI -12.87 to -6.89) and application (RR 1.51, 95% CI 1.29 to 1.77) (1 study, 608 participants; moderate certainty). AVE may slightly improve knowledge (MD 8.35, 95% CI -0.32 to 17.02; low certainty). No short-term evidence was found for QoL, depression, health behaviour, self-efficacy, health service use or adverse events. AVE compared with another AVE We are uncertain whether narrative videos are superior to factual knowledge videos as the evidence is of very low certainty. Gender differences Female migrants' diabetes HL may improve slightly more than that of males, when receiving AVE (MD 5.00, 95% CI 0.62 to 9.38; 1 study, 118 participants), but we do not know whether female or male migrants benefit differently from other interventions due to very low-certainty or a lack of evidence. AUTHORS' CONCLUSIONS Adequately powered studies measuring long-term effects (more than six months) of HL interventions in female and male migrants are needed, using well-validated tools and representing various healthcare systems.
Collapse
Affiliation(s)
- Annika Baumeister
- Center for Life Ethics/Hertz Chair TRA 4, University of Bonn, Bonn, Germany
| | - Angela Aldin
- Cochrane Haematology, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Digo Chakraverty
- Medical Psychology, Neuropsychology and Gender Studies and Center for Neuropsychological Diagnostics and Intervention (CeNDI), University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Constanze Hübner
- Center for Life Ethics/Hertz Chair TRA 4, University of Bonn, Bonn, Germany
| | - Anne Adams
- Institute of Medical Statistics and Computational Biology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Ina Monsef
- Cochrane Haematology, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Nicole Skoetz
- Cochrane Haematology, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Elke Kalbe
- Medical Psychology, Neuropsychology and Gender Studies and Center for Neuropsychological Diagnostics and Intervention (CeNDI), University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Christiane Woopen
- Center for Life Ethics/Hertz Chair TRA 4, University of Bonn, Bonn, Germany
| |
Collapse
|
4
|
Riccardi M, Pettinicchio V, Di Pumpo M, Altamura G, Nurchis MC, Markovic R, Šagrić Č, Stojanović M, Rosi L, Damiani G. Community-based participatory research to engage disadvantaged communities: Levels of engagement reached and how to increase it. A systematic review. Health Policy 2023; 137:104905. [PMID: 37716190 DOI: 10.1016/j.healthpol.2023.104905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 05/12/2023] [Accepted: 09/02/2023] [Indexed: 09/18/2023]
Abstract
Community-based participatory research (CBPR) is one of the most used community engagement frameworks to promote health changes in vulnerable populations. The more a community is engaged, the more a program can impact the social determinants of health. The present study aims to measure the level of engagement reached in randomized controlled trials (RCTs) using CBPR in disadvantaged populations, and to find out the CBPR components that better correlate with a higher level of engagement. A systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Embase, Web of Science, MEDLINE, Cochrane and Scopus databases were queried. Engagement level was assessed using the revised version of IAP2 spectrum, ranging from "inform" to "shared leadership" . Fifty-one RCTs were included, belonging to 36 engagement programs. Fourteen CBPR reached the highest level of engagement. According to the multivariate logistic regression, a pre-existing community intervention was associated with a higher engagement level (OR = 10.08; p<0.05). The variable "institutional funding" was perfectly correlated with a higher level of engagement. No correlation was found with income status or type of preventive programs. A history of collaboration seems to influence the effectiveness in involving communities burdened with social inequities, so starting new partnerships remains a public health priority to invest on. A strong potentiality of CBPR was described in engaging disadvantaged communities, addressing social determinants of health. The key findings described above should be taken into account when planning a community engagement intervention, to build up an effective collaborative field between researchers and population.
Collapse
Affiliation(s)
- MariaTeresa Riccardi
- Department of Health Sciences and Public Health, Section of Hygiene, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | | | - Marcello Di Pumpo
- Department of Health Sciences and Public Health, Section of Hygiene, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Gerardo Altamura
- Department of Health Sciences and Public Health, Section of Hygiene, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Mario Cesare Nurchis
- Department of Woman and Child Health and Public Health, Fondazione Policlinico Universitario A. Gemelli IRCCS, Largo A. Gemelli 8, 00168 Rome, Italy
| | - Roberta Markovic
- University of Niš, Faculty of Medicine, Niš, Serbia; Public Health Institute Niš, Niš, Serbia
| | | | - Miodrag Stojanović
- University of Niš, Faculty of Medicine, Niš, Serbia; Public Health Institute Niš, Niš, Serbia
| | - Luca Rosi
- Department of Infectious Diseases, National Institute of Health (Istituto Superiore di Sanità, ISS), Rome, Italy
| | - Gianfranco Damiani
- Department of Health Sciences and Public Health, Section of Hygiene, Università Cattolica del Sacro Cuore, 00168 Rome, Italy; Department of Woman and Child Health and Public Health, Fondazione Policlinico Universitario A. Gemelli IRCCS, Largo A. Gemelli 8, 00168 Rome, Italy
| |
Collapse
|
5
|
Polfuss M, Mooney-Doyle K, Keller M, Gralton KS, Giambra B, Vance A. Developing a Family Resource: Considerations for Family Member Research Participation. JOURNAL OF FAMILY NURSING 2023; 29:202-222. [PMID: 36935575 DOI: 10.1177/10748407231157433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
When individuals participate in health care research, the choice often affects the entire family. Researchers are responsible for protecting participants and minimizing any burdens the research may place on them. Resources to educate potential study participants about these issues from a family perspective are lacking. A family-focused, evidence-based resource was created for individuals and families to prompt discussion prior to their consenting to enrollment in research. The resource includes key relevant questions to consider related to their study participation and was revised based on input from family nurse scientists and a hospital-based family advisory group. This resource raises awareness of the importance of employing a family lens when designing research and during the recruitment and enrollment of participants. Adopting a family lens in health care research will support the participant's ability to make an informed choice regarding participation and may ultimately enhance the experience of participants and their families and study outcomes.
Collapse
Affiliation(s)
- Michele Polfuss
- University of Wisconsin - Milwaukee, Milwaukee, WI, USA
- Children's Wisconsin, Milwaukee, WI, USA
| | | | | | | | - Barbara Giambra
- Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
- University of Cincinnati, Cincinnati, OH, USA
| | - Ashlee Vance
- Michigan State University, Detroit, USA
- Michigan State University, East Lansing, MI, USA
| |
Collapse
|
6
|
Sharma RK, Cowan A, Gill H, Miyagawa LA. Understanding the Role of Caseworker-Cultural Mediators in Addressing Healthcare Inequities for Patients with Limited-English Proficiency: a Qualitative Study. J Gen Intern Med 2023; 38:1190-1199. [PMID: 36192577 PMCID: PMC10110807 DOI: 10.1007/s11606-022-07816-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 09/14/2022] [Indexed: 11/07/2022]
Abstract
BACKGROUND Patients with limited-English proficiency (LEP) face multiple barriers to equitable healthcare. Interventions that go beyond interpretation, such as the use of bicultural-bilingual patient navigators, hold promise for addressing multi-level barriers. However, data about how to operationalize the tasks that are key to such interventions across diverse LEP communities are lacking. OBJECTIVE Using our health system's bicultural-bilingual caseworker-cultural mediator (CCM) program serving Amharic-, Cambodian/Khmer-, Somali-, Spanish-, and Vietnamese-speaking patients, we sought to understand the key tasks that comprise the CCMs' role and how these tasks enable them to address barriers to healthcare for patients with LEP. DESIGN Semi-structured interviews were conducted in 2019 with a purposive sample (n=23) of clinicians, CCMs, and patients with LEP or their family members from all language groups. PARTICIPANTS Patients or family members receiving CCM services, CCMs, and clinicians who referred patients to the program. APPROACH Content analysis consisting of a hybrid deductive-inductive qualitative approach. KEY RESULTS Seven CCM tasks were identified: advocacy, care coordination, navigation, interpretation, education, mediation, and emotional support. Additionally, four key impacts emerged that described the ways in which these tasks enabled the CCMs to facilitate equitable care: bridging the patient, family, community, clinical team, and healthcare system; impacting knowledge of cultural issues and of the healthcare system; troubleshooting cultural barriers and problem solving; and enhancing relationship building. CONCLUSIONS We identified several tasks and impacts that enabled CCMs to address multi-level barriers to care experienced by patients with LEP and their families across diverse cultural and linguistic groups. Findings suggest opportunities for the generalizability of programs such as ours for multiple LEP populations. Additionally, interventions having a greater scope than interpretation and including relationships with communities may be more successful in addressing barriers to equitable care at the individual, system, and community levels.
Collapse
Affiliation(s)
- Rashmi K Sharma
- Division of General Internal Medicine, University of Washington, Seattle, WA, USA.
| | - Anna Cowan
- Interpreter Services Department, Harborview Medical Center, Seattle, WA, USA
| | - Harsimrat Gill
- University of Washington School of Medicine, Seattle, WA, USA
| | - Lea Ann Miyagawa
- Interpreter Services Department, Harborview Medical Center, Seattle, WA, USA
| |
Collapse
|
7
|
Abudiab S, de Acosta D, Shafaq S, Yun K, Thomas C, Fredkove W, Garcia Y, Hoffman SJ, Karim S, Mann E, Yu K, Smith MK, Coker T, Dawson-Hahn E. "Beyond just the four walls of the clinic": The roles of health systems caring for refugee, immigrant and migrant communities in the United States. Front Public Health 2023; 11:1078980. [PMID: 37064664 PMCID: PMC10097984 DOI: 10.3389/fpubh.2023.1078980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 03/06/2023] [Indexed: 04/18/2023] Open
Abstract
This article is part of the Research Topic 'Health Systems Recovery in the Context of COVID-19 and Protracted Conflict'. Introduction Refugee, immigrant and migrant (hereafter referred to as "immigrant") communities have been inequitably affected by the COVID-19 pandemic. There is little data to help us understand the perspectives of health systems on their role, in collaboration with public health and community-based organizations, in addressing inequities for immigrant populations. This study will address that knowledge gap. Methods This qualitative study used semi-structured video interviews of 20 leaders and providers from health systems who cared for immigrant communities during the pandemic. Interviewees were from across the US with interviews conducted between November 2020-March 2021. Data was analyzed using thematic analysis methods. Results Twenty individuals representing health systems participated with 14 (70%) community health centers, three (15%) county hospitals and three (15%) academic systems represented. The majority [16 health systems (80%)] cared specifically for immigrant communities while 14 (70%) partnered with refugee communities, and two (10%) partnered with migrant farm workers. We identified six themes (with subthemes) that represent roles health systems performed with clinical and public health implications. Two foundational themes were the roles health systems had building and maintaining trust and establishing intentionality in working with communities. On the patient-facing side, health systems played a role in developing communication strategies and reducing barriers to care and support. On the organizational side, health systems collaborated with public health and community-based organizations, in optimizing pre-existing systems and adapting roles to evolving needs throughout the pandemic. Conclusion Health systems should focus on building trusting relationships, acting intentionally, and partnering with community-based organizations and public health to handle COVID-19 and future pandemics in effective and impactful ways that center disparately affected communities. These findings have implications to mitigate disparities in current and future infectious disease outbreaks for immigrant communities who remain an essential and growing population in the US.
Collapse
Affiliation(s)
- Seja Abudiab
- Department of Pediatrics, University of Washington, Seattle, WA, United States
| | | | - Sheeba Shafaq
- Community Leadership Board, National Resource Center for Refugees, Immigrants and Migrants, San Francisco, CA, United States
| | - Katherine Yun
- Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Christine Thomas
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States
| | - Windy Fredkove
- Center for Global Health and Social Responsibility, University of Minnesota, Minneapolis, MN, United States
| | - Yesenia Garcia
- Seattle Children's Research Institute, Seattle, WA, United States
| | - Sarah J. Hoffman
- School of Nursing, University of Minnesota, Minneapolis, MN, United States
| | - Sayyeda Karim
- Center for Global Health and Social Responsibility, University of Minnesota, Minneapolis, MN, United States
| | - Erin Mann
- Center for Global Health and Social Responsibility, University of Minnesota, Minneapolis, MN, United States
| | - Kimberly Yu
- Independent Consultant, Seattle, WA, United States
| | - M. Kumi Smith
- Division of Epidemiology and Community Health, School of Public Health, University of Minnesota, Minneapolis, MN, United States
| | - Tumaini Coker
- Department of Pediatrics, University of Washington, Seattle, WA, United States
| | | |
Collapse
|
8
|
Jimenez S, Matthews A, Darrah R, Schreiber A, Ricker C, Wolfe Schneider K. Perspectives on Spanish language concordant cancer genetic counseling sessions from the Spanish-speaking population. J Genet Couns 2023; 32:111-127. [PMID: 36117419 DOI: 10.1002/jgc4.1628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 07/22/2022] [Accepted: 07/30/2022] [Indexed: 11/07/2022]
Abstract
Genetic counselors (GCs) provide risk assessment, education, and counseling about the genetic contribution to disease. To do so, they must effectively communicate, build rapport, and help patients make the best decisions for themselves and their families. Language barriers add a complex layer to this patient-provider dynamic. While interpreters serve as a primary solution when a patient and GC speak different languages, issues have been documented with these sessions, such as misinterpreted genetic terminology (Gutierrez et al., 2017). Having a GC with concordant language skills may help address these barriers. The purpose of this study was to assess Spanish-speaking patients' perspectives on communication, decision-making, and the interpersonal relationship developed with a bilingual GC in language concordant cancer genetic counseling sessions. Spanish-speaking patients, ages 18 or older, seen by a Spanish-speaking GC at a California public, safety-net hospital were eligible to participate in this study. Nine participants were interviewed via telephone by the bilingual researcher using a semi-structured interview guide to assess three domains: communication, decision-making, and interpersonal relationship. Analyses of interview transcripts identified themes within these three areas of focus: (1) participants felt all explanations were clear and they were not afraid to ask questions in the session, (2) participants experienced preference-concordant decision making, and (3) participants felt empowered and supported by the GC. Participants suggested that GCs working with Spanish-speaking patients in the future should consider group counseling sessions, engaging in outreach efforts to educate the Spanish-speaking community about genetics, and increasing the number of GCs who speak Spanish. These results demonstrate the positive experiences of Spanish-speaking patients in language concordant cancer genetic counseling sessions and further support the need for recruitment of Spanish-speaking individuals into the profession. Future research should further assess the experience of Spanish-speaking patients in language concordant sessions and address the role of cultural concordance in sessions.
Collapse
Affiliation(s)
- Sharisse Jimenez
- Invitae Genetics, San Francisco, California, USA.,Department of Genetics and Genome Sciences, Case Western Reserve University, Cleveland, Ohio, USA
| | - Anne Matthews
- Department of Genetics and Genome Sciences, Case Western Reserve University, Cleveland, Ohio, USA
| | - Rebecca Darrah
- Department of Genetics and Genome Sciences, Case Western Reserve University, Cleveland, Ohio, USA
| | - Allison Schreiber
- Center for Personalized Genetic Healthcare, Cleveland Clinic, Cleveland, Ohio, USA
| | - Charité Ricker
- Division of Medical Oncology, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Kami Wolfe Schneider
- Hematology, Oncology, and Bone Marrow Transplantation, Department of Pediatrics, University of Colorado Anschutz, Aurora, Colorado, USA
| |
Collapse
|
9
|
Julian McFarlane S, Occa A, Peng W, Awonuga O, Morgan SE. Community-Based Participatory Research (CBPR) to Enhance Participation of Racial/Ethnic Minorities in Clinical Trials: A 10-Year Systematic Review. HEALTH COMMUNICATION 2022; 37:1075-1092. [PMID: 34420460 DOI: 10.1080/10410236.2021.1943978] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
There has not been a significant improvement in the rate of clinical trial accrual in more than 20 years. Worse, the challenge of inadequate representation among racial and ethnic minorities also persists, deepening disparities in health. Community-Based Participatory Research (CBPR) is a participatory communication method that centers on effective dialogue between researchers and community stakeholders with the goal of creating an equitable partnership for health and social change. The objective of the current study was to provide an update since a systematic review in 2012, on the current status of the empirical research, with a particular focus on the elements of CBPR methods used to improve the rate of accrual of members of racial and ethnic minority communities for clinical trials. Our systematic review found a large increase in the number of CBPR related studies and studies related to racial and ethnic representation in research. More than 85% of studies employing CBPR methods saw statistically positive outcomes. Specifically, the elements of CBPR that are associated with these positive outcomes include community partner participation in (1) a study advisory committee, (2) data collection, (3) the development of interventions, and (4) participant recruitment. However, the results of our study indicate that researchers need to be more transparent about the extent of community participation as well as more thoroughly and accurately describe the nature of the partnership with members of minority communities in order to build upon the scientific literature on community-engaged methods.
Collapse
Affiliation(s)
| | - Aurora Occa
- Department of Communication, University of Kentucky
| | - Wei Peng
- Murrow College of Communication, Washington State University
| | | | | |
Collapse
|
10
|
Eskander MF, Gil L, Beal EW, Li Y, Hamad A, Oppong B, Obeng-Gyasi S, Tsung A. Access Denied: Inequities in Clinical Trial Enrollment for Pancreatic Cancer. Ann Surg Oncol 2021; 29:1271-1277. [PMID: 34655352 DOI: 10.1245/s10434-021-10868-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Accepted: 09/11/2021] [Indexed: 11/18/2022]
Abstract
BACKGROUND The influence of social determinants of health (SDH) on participation in clinical trials for pancreatic cancer is not well understood. In this study, we describe trends and identify disparities in pancreatic cancer clinical trial enrollment. PATIENTS AND METHODS This is a retrospective study of stage I-IV pancreatic cancer patients in the 2004-2016 National Cancer Database. Cohort was stratified into those enrolled in clinical trials during first course of treatment versus not enrolled. Bivariate analysis and logistic regression were used to understand the relationship between SDH and clinical trial participation. RESULTS A total of 1127 patients (0.4%) enrolled in clinical trials versus 301,340 (99.6%) did not enroll. Enrollment increased over the study period (p < 0.001), but not for Black patients or patients on Medicaid. The majority enrolled had metastatic disease (65.8%). On multivariate analysis, in addition to year of diagnosis (p < 0.001), stage (p < 0.001), and Charlson score (p < 0.001), increasing age [odds ratio (OR) 0.96, 95% confidence interval (CI) 0.96-0.97], non-white race (OR 0.54, CI 0.44-0.66), living in the South (OR 0.42, CI 0.35-0.51), and Medicaid, lack of insurance, or unknown insurance (0.41, CI 0.31-0.53) were predictors of lack of participation. Conversely, treatment at an academic center (OR 6.36, CI 5.4-7.4) and higher neighborhood education predicted enrollment (OR 2.0, CI 1.55-2.67 for < 7% with no high school degree versus > 21%). DISCUSSION Age, race, insurance, and geography are barriers to clinical trial enrollment for pancreatic cancer patients. While overall enrollment increased, Black patients and patients on Medicaid remain underrepresented. After adjusting for cancer-specific factors, SDH are still associated with clinical trial enrollment, suggesting need for targeted interventions.
Collapse
Affiliation(s)
- Mariam F Eskander
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA.,Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, United States
| | - Lindsay Gil
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Eliza W Beal
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Yaming Li
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Ahmad Hamad
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Bridget Oppong
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Samilia Obeng-Gyasi
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA
| | - Allan Tsung
- Division of Surgical Oncology, The Arthur G. James Cancer Hospital and Solove Research Institute at the Ohio State University Wexner Medical Center, N924 Doan Hall, 410 W 10th Ave, Columbus, OH, USA.
| |
Collapse
|
11
|
Relationships between health literacy, having a cancer care coordinator, and long-term health-related quality of life among cancer survivors. Support Care Cancer 2021; 29:7913-7924. [PMID: 34191127 DOI: 10.1007/s00520-021-06356-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 06/09/2021] [Indexed: 10/21/2022]
Abstract
PURPOSE Care coordination is a strategy to reduce healthcare navigation challenges for cancer patients. The objectives of this study were to assess the association between having a cancer care coordinator (CCC) and long-term health-related quality of life (HRQoL), and to evaluate whether this association differed by level of health literacy. METHODS A population-based sample of survivors diagnosed with breast, prostate, or colorectal cancer in 2015 from the Iowa Cancer Registry participated in an online survey conducted in 2017-2018 (N = 368). Chi-squared tests and logistic regression were used to model the association between patient characteristics and having a cancer care coordinator. Linear regression was used to model the association between patient perception of having a cancer care coordinator and post-treatment physical or mental HRQoL by differing levels of health literacy while controlling for sociodemographic and clinical factors. RESULTS Most survivors (81%) reported having one healthcare professional who coordinated their cancer care. Overall, patient perception of having a coordinator was not significantly associated with physical HRQoL (p = 0.118). However, participants with low health literacy (21%) who had a coordinator had significantly higher physical HRQoL scores compared to those who did not (adjusted mean difference 5.2, p = 0.010), while not so for medium (29%) or high (51%) health literacy (p = 0.227, and p = 0.850, respectively; test for interaction p = 0.001). Mental HRQoL was not associated with having a coordinator in our analyses. CONCLUSION Findings suggest that care coordinators improved post-treatment physical HRQoL, particularly for participants with low health literacy. Care coordinators may be beneficial to the most vulnerable patients struggling to navigate the complex healthcare system during cancer treatment. Future research should focus on the mechanisms by which care coordination may affect post-treatment HRQoL.
Collapse
|
12
|
Dixit N, Rugo H, Burke NJ. Navigating a Path to Equity in Cancer Care: The Role of Patient Navigation. Am Soc Clin Oncol Educ Book 2021; 41:1-8. [PMID: 33830828 DOI: 10.1200/edbk_100026] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Notable barriers exist in the delivery of equitable care for all patients with cancers. Social determinants of health at distal, intermediate, and proximal levels impact cancer care. Patient navigation is a patient-centered intervention that functions across these overlapping determinants to increase access to cancer services throughout the cancer care continuum. There is a need to standardize patient navigation training while remaining responsive to local contexts of care and a need to implement patient navigation programs with a health equity lens to address cancer care inequities.
Collapse
Affiliation(s)
- Niharika Dixit
- University of California San Francisco/Zuckerberg San Francisco General Hospital, San Francisco, CA
| | - Hope Rugo
- The Helen Diller Family Comprehensive Cancer Center, University of California, San Francisco, CA
| | | |
Collapse
|
13
|
Spielman DB, Liebowitz A, Kelebeyev S, Smith TL, McKinney K, Woodard T, Safi C, Overdevest JB, Gudis DA. Race in Rhinology Clinical Trials: A Decade of Disparity. Laryngoscope 2021; 131:1722-1728. [PMID: 33493376 DOI: 10.1002/lary.29371] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 12/16/2020] [Accepted: 12/28/2020] [Indexed: 12/14/2022]
Abstract
OBJECTIVE/HYPOTHESIS The aim of this study is to assess the ethnic and racial demographics of patients enrolled in prospective chronic rhinosinusitis (CRS) studies relative to the corresponding geographic demographics of the United States (U.S.) census data. STUDY DESIGN Systematic Review and Population analysis. METHODS A systematic review was performed to identify CRS clinical trials, conducted in the U.S. and published between 2010 and 2020 in which patients were prospectively enrolled. Pooled racial and ethnicity data were compared to national and corresponding regional census data. RESULTS Eighty-three studies were included, comprising 12,027 patients. 50.4% were male and the average age was 49.2 years. 8,810 patients underwent a surgical procedure. Of the 12,027 patients, 81.67% were identified as White, 5.35% as Black, 1.27% as Asian, 0.02% as Pacific Islander, 0.12% as American Indian, and 11.57% were classified as Other. The racial and ethnic composition of the pooled study population differs significantly from the national U.S. census data with the underrepresentation of each minority population (P ≤ .0002). Regional sub-analyses yield variable results. In the Northeast and West, there was an underrepresentation of all minority populations. In the South and Midwest, Black enrollment was similar to the U.S. census data, while all other minorities were underrepresented. CONCLUSIONS The racial and ethnic composition of patients enrolled in prospective CRS clinical trials differs significantly from the demographics of the U.S. POPULATION The generalizability and external validity of findings derived from studies comprised of demographically mismatched populations has not been established. Future efforts to enroll more representative populations should be emphasized by the research community, funding bodies, and editorial boards. LEVEL OF EVIDENCE NA Laryngoscope, 131:1722-1728, 2021.
Collapse
Affiliation(s)
- Daniel B Spielman
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| | - Andi Liebowitz
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| | - Saveliy Kelebeyev
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| | - Timothy L Smith
- Department of Otolaryngology Head and Neck Surgery, Oregon Health & Science University, Portland, Oregon, U.S.A
| | - Kibwei McKinney
- Department of Otolaryngology Head and Neck Surgery, The University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, U.S.A
| | - Troy Woodard
- Department of Otolaryngology Head and Neck Surgery, Cleveland Clinic Foundation, Cleveland, Ohio, U.S.A
| | - Chetan Safi
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| | - Jonathan B Overdevest
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| | - David A Gudis
- Department of Otolaryngology Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, U.S.A
| |
Collapse
|
14
|
Casillas JN, Schwartz LF, Crespi CM, Ganz PA, Kahn KL, Stuber ML, Bastani R, Alquaddomi F, Estrin DL. The use of mobile technology and peer navigation to promote adolescent and young adult (AYA) cancer survivorship care: results of a randomized controlled trial. J Cancer Surviv 2019; 13:580-592. [PMID: 31350681 DOI: 10.1007/s11764-019-00777-7] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2019] [Accepted: 06/12/2019] [Indexed: 11/28/2022]
Abstract
PURPOSE Adolescent and young adult (AYA) cancer survivors experience unique barriers that compromise receipt of survivorship care; therefore, development of innovative educational interventions to improve rates of AYA survivorship care is needed. The efficacy of text-messaging and peer navigation interventions was compared to standard-of-care survivorship educational materials to increase AYAs' (1) late effects knowledge and (2) knowledge, attitudes, and self-efficacy towards seeking survivor-focused care. METHODS This was a three-armed, prospective, randomized controlled trial with one control group and two intervention groups. The control group received current standard-of-care educational materials. One intervention group participated in a text-messaging program, and the second participated in a peer navigator program. Participants completed pre- and post-intervention questionnaires. Study outcome variables were quantified using Fisher exact tests, two-sample t tests, exact McNemar tests, conditional logistic regression models, and analysis of covariance. RESULTS Seventy-one survivors completed the study (control n = 24; text-messaging n = 23; peer navigation n = 24). Late effects knowledge was high at baseline for all groups. The text-messaging group had increased survivorship care knowledge compared to the control group (p < 0.05); the peer navigation group had increased survivorship care self-efficacy compared to the control group; p < 0.05. Both intervention groups showed increased attitudes towards seeking survivor-focused care compared to the control group (text-messaging p < 0.05; peer navigation p < 0.05). CONCLUSIONS Each intervention demonstrated significant benefits compared to the control group. IMPLICATIONS FOR CANCER SURVIVORS Given the preliminary effectiveness of both interventions, each can potentially be used in the future by AYA cancer survivors to educate and empower them to obtain needed survivorship care.
Collapse
Affiliation(s)
- Jacqueline N Casillas
- Department of Pediatrics, Division of Hematology/Oncology, UCLA David Geffen School of Medicine, 10833 Le Conte Avenue, A2-410 MDCC, Los Angeles, CA, 90095-1752, USA. .,Center for Cancer Prevention and Control Research, UCLA Jonsson Comprehensive Cancer Center, Los Angeles, CA, USA.
| | - Lindsay F Schwartz
- Department of Pediatrics, Division of Hematology/Oncology, UCLA David Geffen School of Medicine, 10833 Le Conte Avenue, A2-410 MDCC, Los Angeles, CA, 90095-1752, USA
| | - Catherine M Crespi
- Department of Biostatistics, UCLA Fielding School of Public Health, Los Angeles, CA, USA
| | - Patricia A Ganz
- Center for Cancer Prevention and Control Research, UCLA Jonsson Comprehensive Cancer Center, Los Angeles, CA, USA.,Department of Medicine, Division of Hematology/Oncology, UCLA David Geffen School of Medicine, Los Angeles, CA, USA.,Department of Health Policy and Management, UCLA Fielding School of Public Health, Los Angeles, CA, USA
| | - Katherine L Kahn
- Department of Medicine, UCLA David Geffen School of Medicine, Los Angeles, CA, USA
| | - Margaret L Stuber
- Department of Psychiatry, Resnick Neuropsychiatric Hospital, UCLA David Geffen School of Medicine, Los Angeles, CA, USA
| | - Roshan Bastani
- Center for Cancer Prevention and Control Research, UCLA Jonsson Comprehensive Cancer Center, Los Angeles, CA, USA.,Department of Health Policy and Management, UCLA Fielding School of Public Health, Los Angeles, CA, USA
| | - Faisal Alquaddomi
- Department of Computer Science, Cornell University, New York, NY, USA
| | - Deborah L Estrin
- Department of Computer Science, Cornell University, New York, NY, USA
| |
Collapse
|