The use of an electronic audience response system for data collection

Translating new science into the community to promote opportunities for breast and cervical cancer prevention among African American women

BACKGROUND

New evidence has found breast and cervical cancer risk factors unique to African American women. Thus, there is a significant need to increase their knowledge and understanding of relevant risk factors and the potential protective benefits associated with breast-feeding and HPV vaccination. The National Witness Project is a robust, evidence- and community-based lay health advisor programme that uses group education, navigation and survivor narratives to increase cancer screening among diverse underserved women.

METHODS

A multi-phase, community-based participatory research study was conducted across three sites in Buffalo, NY, New York City and Arkansas between October 2016 and January 2017. Pre-/post-test surveys were administered during volunteer trainings and community programmes. An evaluation survey was also administered at the Annual Meeting for Education and Networking. Paired sample t tests were used to compare pre-/post-test survey scores.

RESULTS

Trainee survey results showed the overall mean per cent correct pre-/post-test scores were 47.7% (SD: 21.87) and 79.2% (SD: 16.14). Altogether, 31 educational programmes reached 332 community participants. Participants' breast and cervical cancer knowledge scores were significantly higher after the education programme (84.4%) than before (55.3%) with a mean change score of 29% (P ≤ .001).

CONCLUSION

This paper reveals the underlying complexities to update the educational curriculum content of a multi-site, community-based outreach organization. The new curriculum significantly improved African American women's knowledge about breast and cervical cancer by 10%-36%, clearly demonstrating that this information was new to them. The need for education programming in African American communities to disseminate cancer prevention and risk information remains high.

Audience Response Systems and Missingness Trends: Using Interactive Polling Systems to Gather Sensitive Health Information From Youth

BACKGROUND

The widespread availability and cost-effectiveness of new-wave software-based audience response systems (ARSs) have expanded the possibilities of collecting health data from hard-to-reach populations, including youth. However, with all survey methods, biases in the data may exist because of participant nonresponse.

OBJECTIVE

The aims of this study were to (1) examine the extent to which an ARS could be used to gather health information from youths within a large-group school setting and (2) examine individual- and survey-level response biases stemming from this Web-based data collection method.

METHODS

We used an ARS to deliver a mental health survey to 3418 youths in 4 high schools in the Midwestern United States. The survey contained demographic questions, depression, anxiety, and suicidality screeners, and questions about their use of offline resources (eg, parents, peers, and counselors) and Web-based resources (ie, telemental health technologies) when they faced stressful life situations. We then examined the response rates for each survey item, focusing on the individual- and survey-level characteristics that related to nonresponse.

RESULTS

Overall, 25.39% (868/3418) of youths answered all 38 survey questions; however, missingness analyses showed that there were some survey structure factors that led to higher rates of nonresponse (eg, questions at the end of survey, sensitive questions, and questions for which precise answers were difficult to provide). There were also some personal characteristics that were associated with nonresponse (eg, not identifying as either male or female, nonwhite ethnicity, and higher levels of depression). Specifically, a multivariate model showed that male students and students who reported their gender as other had significantly higher numbers of missed items compared with female students (B=.30 and B=.47, respectively, P<.001). Similarly, nonwhite race (B=.39, P<.001) and higher depression scores (B=.39, P<.001) were positively related to the number of missing survey responses.

CONCLUSIONS

Although our methodology-focused study showed that it is possible to gather sensitive mental health data from youths in large groups using ARSs, we also suggest that these nonresponse patterns need to be considered and controlled for when using ARSs for gathering population health data.

Lessons learned from using an audience response system in a community setting for research data collection

OBJECTIVES

A community-academic team implemented a study involving collection of quantitative data using a computer-based audience response system (ARS) whereby community partners led data collection efforts. The team participated in a reflection exercise after the data collection to evaluate and identify best practices and lessons learned about the community partner-led process.

DESIGN & SAMPLE

The methods involved a qualitative research consultant who facilitated the reflection exercise that consisted of two focus groups-one academic and one community research team members. The consultant then conducted content analysis. Nine members participated in the focus groups.

RESULTS

The reflection identified the following themes: the positive aspects of the ARS; challenges to overcome; and recommendations for the future.

CONCLUSION

The lessons learned here can help community-academic research partnerships identify the best circumstances in which to use ARS for data collection and practical steps to aid in its success.

Approach and Methods of the 2016 Alaska Native Research Forum

Southcentral Foundation, a tribal health organization serving Alaska Native and American Indian (AN/AI) people in southcentral Alaska, convened the Alaska Native Health Research Forum (Forum) for AN/AI people in May 2016. The purpose of the Forum was to obtain AN/AI community member feedback about sharing health research results. This article describes the funding mechanism that provided resources for the Forum and other factors that were considered when designing the Forum. This is followed by a description of how attendees were invited, the audience response system, and process used to collect quantitative data on participants and qualitative feedback from small group discussions with Forum attendees. Finally, we describe the quantitative and qualitative data analysis processes used to evaluate responses.

Approach and Methods of the 2016 Alaska Native Research Forum

Southcentral Foundation, a tribal health organization serving Alaska Native and American Indian (AN/AI) people in southcentral Alaska, convened the Alaska Native Health Research Forum (Forum) for AN/AI people in May 2016. The purpose of the Forum was to obtain AN/AI community member feedback about sharing health research results. This article describes the funding mechanism that provided resources for the Forum and other factors that were considered when designing the Forum. This is followed by a description of how attendees were invited, the audience response system, and process used to collect quantitative data on participants and qualitative feedback from small group discussions with Forum attendees. Finally, we describe the quantitative and qualitative data analysis processes used to evaluate responses.

Alaska Native Health Research Forum: Perspectives on disseminating research findings

In May 2016, Southcentral Foundation (SCF), a regional tribal health corporation based in Anchorage, Alaska convened a half-day health research forum for Alaska Native and American Indian community members to obtain feedback on communication of research findings. Thirty one individuals attended the Forum and 22 completed a pre and post survey. Respondents found the Forum to be a useful method to learn about research projects and their willingness to participate in health research reportedly increased because of the event. Forum attendees also endorsed use of direct mail, electronic mail, and messages via an electronic health record patient portal as communication methods for health researchers to inform potential participants about research studies occurring at SCF and for return of individual and community level results.

Validity and Reliability of Behavior and Theory-Based Psychosocial Determinants Measures, Using Audience Response System Technology in Urban Upper-Elementary Schoolchildren

OBJECTIVE

To examine the validity and reliability of a questionnaire administered with an audience response system (ARS).

DESIGN

Cross-sectional study.

SETTING

Two New York City public elementary schools.

PARTICIPANTS

Fourth- and fifth-grade students.

MAIN OUTCOME MEASURES

A Food, Health, and Choices questionnaire (FHC-Q) assessed energy balance-related behaviors (EBRBs) including intake of fruits and vegetables, sugar-sweetened beverages, processed packaged snacks, and fast food; physical activity; recreational screen time; and associated psychosocial determinants (≥ 3 questions/outcome scale). Previously validated reference instruments were used for relative validation. The ARS format was compared with a paper-and-pencil format. All measures were administered in a classroom setting.

ANALYSIS

Pearson correlation coefficients between the reference instruments and the FHC-Q were calculated. Internal consistency reliabilities were evaluated with Cronbach α. Spearman rank correlation, intra-class correlation, and percent agreement were used for test-retest reliability between paper-and-pencil and ARS, and between 2 ARS FHC-Q administrations.

RESULTS

Correlations for EBRBs with reference instruments ranged from 0.38 to 0.61 (P < .01). Cronbach α ranged from .77 to .92 for EBRBs and .74 to .90 for psychosocial determinants. Test-retest reliability correlations ranged from 0.36 to 0.87 (P < .001). Agreement for knowledge questions ranged from 69.8% to 84.8%.

CONCLUSIONS AND IMPLICATIONS

The ARS FHC-Q has acceptable validity and reliability for collecting data on EBRBs and associated psychosocial determinants for upper-elementary students.

Introducing Biospecimen Science to Communities: Tools from Two Cities

BACKGROUND

This article describes community-engaged processes employed by two Community Network Program Center (CNPC) sites located in Tampa, Florida, and Buffalo, New York, toward the development of Spanish/English educational products about biobanking and biospecimen research.

METHODS

Each CNPC carried out a community-based participatory research (CBPR) approach that underscored six essential components that moved concepts to a final educational product in a highly participatory fashion. The similar CBPR processes at the two locations focused on the same topic, resulted in different engagement approaches and tools for their respective communities: 1) DVD and brochure toolkit and 2) PowerPoint, group program with audience response system (ARS).

RESULTS

We detail a comparison of methods and applications for using these tools among diverse community groups to advance understandings about genetic and biomedical research technologies.

CONCLUSION

Ultimately, these tools and associated educational efforts emphasize the critical value of co-learning among academic and community members in biobanking and biospecimen research.

To what extent do community members' personal health beliefs and experiences impact what they consider to be important for their community-at-large?

BACKGROUND

Health assessments are used to prioritize community-level health concerns, but the role of individuals' health concerns and experiences is unknown. We sought to understand to what extent community health assessments reflect health concerns of the community-at-large versus a representation of the participants sampled.

METHODS

We conducted a health assessment survey in 30 rural African American churches (n = 412). Multivariable logistic regression produced odds ratios examining associations between personal health concern (this health concern is important to me), personal health experience (I have been diagnosed with this health issue) and community health priorities (this health concern is important to the community) for 20 health issues.

RESULTS

Respondents reported significant associations for 19/20 health conditions between personal health concern and the ranking of that concern as a community priority (all P < 0.05). Inconsistent associations were seen between personal health experience of a specific health condition and the ranking of that condition as a community priority.

CONCLUSIONS

Personal health concerns reported by individuals in a study sample may impact prioritization of community health initiatives. Further research should examine how personal health concerns are formed.

The Yo me cuido® Program: Addressing Breast Cancer Screening and Prevention Among Hispanic Women

Breast cancer is less likely to be diagnosed at the earliest stage in Hispanic/Latino (Hispanic) women compared to non-Hispanic White women, even after accounting for differences in age, socioeconomic status, and method of detection. Moffitt Cancer Center created a comprehensive health education program called Yo me cuido (®) (YMC) to address and reduce breast cancer disparities among Spanish- and English-speaking Hispanic women by providing breast cancer and healthy lifestyles awareness and education, and promoting breast cancer screenings, reminders, and referrals for women 40 years and older. The purpose of this paper is to showcase the innovative approaches and methods to cancer prevention and early detection of the YMC program, and to promote it as an effective tool for improving outcomes in community health education, outreach, and engagement activities with Hispanic populations. Key components of the program include educational workshops, mammogram referrals, and a multimedia campaign. The YMC program is unique because of its approaches in reaching the Hispanic population, such as delivering the program with compassionate services to empower participants to live a healthier lifestyle. Additionally, direct follow-up for mammography screenings is provided by program staff. From 2011 to 2013, YMC has educated 2,226 women and 165 men through 93 workshops. About 684 (52 %) women ages 40 and older have had a screening mammogram within their first year of participating in the program. The YMC program is an innovative cancer education and outreach program that has demonstrated a positive impact on the lives of the Hispanic community in the Tampa Bay region.

Engaging Immigrant and Refugee Women in Breast Health Education

This project assessed the impact of a community-based educational program on breast cancer knowledge and screening among Buffalo (NY) immigrant and refugee females. Program participants completed language-matched pre- and post-test assessments during a single session educational program; breast cancer screening information was obtained from the mobile mammography unit to which participants were referred. Pre- and post-test knowledge scores were compared to assess changes in responses to each of the six individual knowledge items, as well as overall. Mammogram records were reviewed to identify Breast Imaging Reporting and Data System (BI-RADS) scores. The proportion of correct responses to each of the six knowledge items increased significantly on the post-program assessments; 33 % of women >40 years old completed mammograms. The findings suggest that a health education program for immigrant and refugee women, delivered in community-based settings and involving interpreters, can enhance breast cancer knowledge and lead to improvements in mammography completion.

Introducing Biospecimen Science to Communities: Tools from Two Cities

BACKGROUND

This article describes community-engaged processes employed by two Community Network Program Center (CNPC) sites located in Tampa, Florida, and Buffalo, New York, toward the development of Spanish/English educational products about biobanking and biospecimen research.

METHODS

Each CNPC carried out a community-based participatory research (CBPR) approach that underscored six essential components that moved concepts to a final educational product in a highly participatory fashion. The similar CBPR processes at the two locations focused on the same topic, resulted in different engagement approaches and tools for their respective communities: 1) DVD and brochure toolkit and 2) PowerPoint, group program with audience response system (ARS).

RESULTS

We detail a comparison of methods and applications for using these tools among diverse community groups to advance understandings about genetic and biomedical research technologies.

CONCLUSION

Ultimately, these tools and associated educational efforts emphasize the critical value of co-learning among academic and community members in biobanking and biospecimen research.

Audience response systems as a data collection method in organizational research

Audience responses systems are electronic devices allowing audience interaction and they are increasingly being used in educational and business settings to enhance various pedagogical and practical processes. This paper discusses how ARS technology may be used as a method of collecting data for research purposes. Specifically, this paper demonstrates ARS technology's potential utility by duplicating findings from two organisational studies, it discusses how ARS technology may be used to address three prevalent data collection problems, and it suggests how ARS technology may provide scholars with increased access to certain organisational settings, as well as greater integration between research and service activities.

Awareness and interest in biospecimen donation for cancer research: views from gatekeepers and prospective participants in the Latino community

Latinos are one of the fastest-growing population groups in the USA, and are underrepresented in scientific research and even more so in genetic research. The disproportionately lower number of certain subpopulations participating in biomedical research has a significant impact on the representativeness of scientific outcomes. We established a collaboration with scientists at a designated National Cancer Institute comprehensive cancer center to test the feasibility of community-based approaches for engaging Latinos in biospecimen donation for cancer genomic research. A methods triangulation approach was applied to gain a deeper understanding from the community, that included key informant interviews with Latino community leaders (N = 6), four focus groups (N = 22) with members of the Latino community, and the use of an audience response system within the focus groups to capture quantitative data. Overall, the majority of participants had never participated in biospecimen donation; however, despite being unaware of the biobank, they expressed willingness to participate as a way to help advance research. Themes included: Confusion on what biospecimen donation process entails; Barriers to and incentives for participation; Strategies and locations for reaching the Latino community. Clear communication of the "public good" as it relates to biospecimen donation by healthy/non-patient participants is a less clearly conceptualized message; yet, the significance of delivering this message is important to gaining participation and increasing the diversity of samples available for cancer genomic studies from a broader community context.

Awareness and interest in biospecimen donation for cancer research: views from gatekeepers and prospective participants in the Latino community

Latinos are one of the fastest-growing population groups in the USA, and are underrepresented in scientific research and even more so in genetic research. The disproportionately lower number of certain subpopulations participating in biomedical research has a significant impact on the representativeness of scientific outcomes. We established a collaboration with scientists at a designated National Cancer Institute comprehensive cancer center to test the feasibility of community-based approaches for engaging Latinos in biospecimen donation for cancer genomic research. A methods triangulation approach was applied to gain a deeper understanding from the community, that included key informant interviews with Latino community leaders (N = 6), four focus groups (N = 22) with members of the Latino community, and the use of an audience response system within the focus groups to capture quantitative data. Overall, the majority of participants had never participated in biospecimen donation; however, despite being unaware of the biobank, they expressed willingness to participate as a way to help advance research. Themes included: Confusion on what biospecimen donation process entails; Barriers to and incentives for participation; Strategies and locations for reaching the Latino community. Clear communication of the "public good" as it relates to biospecimen donation by healthy/non-patient participants is a less clearly conceptualized message; yet, the significance of delivering this message is important to gaining participation and increasing the diversity of samples available for cancer genomic studies from a broader community context.

Community-based partnership to identify keys to biospecimen research participation

Reported barriers to participation in biospecimen banking include unwillingness to undergo blood-draw procedures and concerns about confidentiality breaches, privacy, and discrimination. The study identified key factors and influential perspectives to address these barriers and inform methods to improve recruitment and research participation among racially diverse community. A mixed-methods, community-based participatory research orientation was used to collect formative findings to develop a pilot intervention. Methods included nine key informant interviews, three focus groups (n = 26), and 64 community surveys. Findings showed: (1) increased concern of exploitation by pharmaceutical company sponsor; (2) varied perceptions about monetary compensation for research participation; and (3) willingness to participate in a biospecimen banking study by more than 30% of the people in the community survey. Research participation and biospecimen donation may be influenced by who is sponsoring a study. Monetary incentives for study participation may be more important for African American than White participants.

Esperanza y Vida: a culturally and linguistically customized breast and cervical education program for diverse Latinas at three different United States sites

Breast cancer is the most common cause of cancer and the leading cause of cancer death among Latinas in the United States. In addition, Latinas experience a disproportionate burden of cervical cancer incidence, morbidity, and mortality compared with non-Hispanic White women. Lower use of breast and cervical cancer screening services may contribute to these disparities. To address the underutilization of breast and cervical cancer screening among diverse subgroups of Latinas, a peer-led education program called Esperanza y Vida ("Hope and Life") was developed and administered at 3 sites (2 in New York and 1 in Arkansas). Immigrant Latina women and their partners were educated about the importance of breast and cervical cancer screening, with the goals of increasing their knowledge about these cancers and their screening behavior. An analysis of the intervention's findings at baseline among female participants demonstrated significant sociodemographic, interpersonal, cultural, health care system, and program variability in 3 distinct geographic regions in the United States. These data indicate the need for and feasibility of customizing cancer outreach and educational programs for diverse Latina subgroups living in various U.S. regions, with implications for informing the expansion and replication of the program in other regions of the country.

Community-based participatory development, implementation, and evaluation of a cancer screening educational intervention among American Indians in the Northern Plains

The study describes the creation and implementation of a culturally appropriate cancer education intervention, and assesses its efficacy among American Indians in a community with documented cancer-related disparities. Education workshops were developed and conducted on three western South Dakota reservations and in Rapid City by trained community representatives. Over 400 individuals participated in the 2-h workshops. Participants answered demographic questions, questions about previous cancer screening (to establish baseline screening rates), and completed a pre- and post-workshop quiz to assess learning. Participants demonstrated significant increases in cancer screening-related knowledge levels. Surveys reveal that participants found the information of high quality, great value and would recommend the program to friends. Pre-workshop data reveals cancer screening rates well below the national average. Workshop participants increased their knowledge about cancer etiology and screening. This intervention may represent an effective tool for increasing cancer screening utilization among American Indians.

Establishing a community partnership to optimize recruitment of African American pedigrees for a genetic epidemiology study

We developed a breast cancer genetic epidemiology study in collaboration with a community partnership to optimize recruitment and participation of African American women. We recognized that recruitment of relatives for a family-based study was a unique challenge in this minority group in the USA. Through an established partnership with The National Witness Project, we convened focus groups to identify potential recruitment challenges and issues related to decisions about study participation that may be unique to African Americans and family-based recruitment. Using the PEN-3 model, we analyzed qualitative data and applied the thematic findings to our recruitment protocol in order to mitigate potential recruitment challenges. The most relevant positive themes included a need for research and education and potential benefit to future generations. Negative themes included communication barriers in sharing disease status within a family and historical issues such as fatalistic attitudes and shamefulness of cancer. Collaboration with community partners allowed for development of culturally appropriate recruitment strategies for African American breast cancer survivors and their family members for a genetic epidemiology study. Understanding factors unique to family-based recruitment in the USA is a significant factor in enhancing participation of under-represented minorities in future genetic studies.

Training the public health workforce from Albany to Zambia: technology lessons learned along the way

This article describes lessons learned by the University at Albany Center for Public Health Preparedness (UA-CPHP) in using three technologies to deliver preparedness training for public health professionals in New York State. These three technologies are: 1. Audience response system (ARS, or the "clicker" system)--Purchased to improve engagement of all participants in heterogeneous training audiences, it also markedly reduces staff time while improving training evaluation (cost: $4,500). 2. Satellite broadcast programs--UA-CPHP produced more than 50 broadcasts, which remain available as videostreams and/or podcasts. Viewership of archived programs sometimes surpasses that of the live event (cost estimate: $23,000 to $39,000). 3. Interactive online courses--Seventeen courses have registered more than 44,000 learners worldwide. The Pandemic Influenza course alone has reached more than 16,000 registrants from all 50 U.S. states and at least 56 other countries (cost estimate: $30,000 to $65,000). UA-CPHP's experience as a preparedness training center has confirmed that contemporary technology can be employed to improve and increase the reach of these training efforts. An additional finding was that, quite unintentionally, the intensive use of distance-based educational modalities designed to reach public health practitioners in New York State has afforded UA-CPHP a substantial national and international audience as well, and at no additional cost.

Audience response systems as a data collection method in organizational research

Audience responses systems are electronic devices allowing audience interaction and they are increasingly being used in educational and business settings to enhance various pedagogical and practical processes. This paper discusses how ARS technology may be used as a method of collecting data for research purposes. Specifically, this paper demonstrates ARS technology's potential utility by duplicating findings from two organisational studies, it discusses how ARS technology may be used to address three prevalent data collection problems, and it suggests how ARS technology may provide scholars with increased access to certain organisational settings, as well as greater integration between research and service activities.