Computer-assisted self-interviews: a cost effectiveness analysis

MyCap: a flexible and configurable platform for mobilizing the participant voice

This paper provides a description of the MyCap data collection platform, utilization metrics, and vignettes associated with use from diverse research institutions. MyCap is a participant-facing mobile application for survey data collection and the automated administration of active tasks (activities performed by participants using mobile device sensors under semi-controlled conditions). Launched in 2018, MyCap is a no-code solution for research teams conducting longitudinal studies, integrates tightly with REDCap and is available at no cost to research teams at academic, nonprofit, or government organizations. MyCap has been deployed at multiple research institutions with application usage logged across 135 countries in 2021. Vignettes demonstrate that MyCap empowered research teams to explore and implement novel methods of information collection and use. MyCap’s integration with REDCap provides a comprehensive data collection ecosystem and is best suited for longitudinal studies with frequent requests for information from participants.

FOREST protocol: a qualitative study exploring health and sexuality of transmasculine individuals in France

INTRODUCTION

While current research on sexuality and health often explores sexual behaviours among heterosexual and gay cisgender individuals, little is known about the sexualities of transgender people, especially transmasculine people. When data are available, sexual health is often reduced to risk exposure, not considering in detail social context and determinants that could contribute to a more comprehensive approach, such as general health, class, race, exposure to violence or social representations. Recognising this gap, identified in both national (French) and international scientific literature, this study aims to explore the sexual health of transmasculine people, employing an intersectional approach and considering both positive and negative health determinants.

METHODS

This 2-year research based in the disciplinary field of social psychology, with a gender perspective, and will apply qualitative methods. We adopt a community-based research approach, integrating one university and one community-based organisation in the coordination of the study. In a triangulation perspective, two rounds of semistructured interviews will be performed with key informants (medical practitioners, community-based support services workers, etc) and with people self-identifying as transmasculine. Focus groups will complement data collection.

ETHICS AND DISSEMINATION

FOREST protocol was approved by the Comité d'Évaluation Éthique (CEEI) de l'Institut National de la Santé Et de la Recherche Médicale (CEEI/International Review Board 00003888). The research adopts the principles of open science, and findings will be published assuring participants' confidentiality. Informative flyers and videos will be elaborated to communicate study findings to participants, stakeholders and the transcommunities at large, and data will be stored in lasting archives.

Using the Think-Aloud Method to Assess the Feasibility and Acceptability of Network Canvas Among Black Men Who Have Sex With Men and Transgender Persons: Qualitative Analysis

BACKGROUND

Characteristics of an individual's social network have been important factors in understanding infectious disease transmission patterns. Social network data collection is generally time and resource intensive, yet it is crucial to our understanding of the complex epidemiologic landscape of human behaviors among stigmatized social groups.

OBJECTIVE

We sought to evaluate the feasibility and acceptability of a self-administered social network data collection tool, Network Canvas, among Black men who have sex with men (BMSM) and transgender persons using the think-aloud method, which is a robust and flexible research technique used to perform usability testing.

METHODS

We piloted a self-administered network interview within the Network Canvas Software Suite. Participants aged 18 years and older were recruited through a community-based organization in Atlanta, GA, and were included based upon their willingness to share information on sexual behaviors and drug use for themselves and their social networks. A semistructured interview guide was used to document cognitive decision-making processes while using the tool. Recorded interviews were transcribed verbatim, and thematic analyses were performed.

RESULTS

Among 7 BMSM and transgender participants, three main themes were identified from cognitive processes: (1) the utility, (2) navigation, and (3) intuitive design of Network Canvas. Overall, Network Canvas was described as "easy to use," with suggestions mainly directed toward improving navigation tools and implementing an initial tutorial on the program prior to use. Participants were willing to use Network Canvas to document their social networks and characteristics. In general, observed verbal responses from participants matched their behavior, although there were some discrepancies between verbal affirmations of use and understanding versus external observation.

CONCLUSIONS

We found Network Canvas to be a useful new tool to capture social network data. Self-administration allowed participants the opportunity to provide sensitive information about themselves and their social networks. Furthermore, automated name generation and visualization of an individuals' social network in the app has the potential to reduce cognitive burden during data collection. More efficient methods of social network data collection have the potential to provide epidemiologic information to guide prevention efforts for populations with stigmatized health conditions or behaviors.

Methylation of HPV 16 and EPB41L3 in oral gargles: Associations with oropharyngeal cancer detection and tumor characteristics

Oropharyngeal cancer (OPC) incidence is increasing significantly among men and often requires intensive therapy causing significant morbidity. Early detection of OPC is needed, when monotherapy can be safely delivered with less treatment-associated morbidity, while maintaining high cure rates. We conducted a study of 101 pretreatment male OPC cases matched 1:1 to 101 disease-free controls for age and smoking history. Oral gargles were collected from cases and controls with additional biopsies or aspirates from cases. The HPV SPF10 -LiPA25 PCR assay was utilized for HPV genotyping. Methylation of three CpG sites (438, 427 and 425) in the EPB41L3 gene and methylation status of the L1 (6,367, 6,389), L2 (4,257, 4,262, 4,266, 4,269, 4,275, 4,282) and E2 (3,412, 3,415, 3,417, 3,433, 3,436) CpG sites of HPV 16 positive specimens was assessed by pyrosequencing. Significant correlations were observed between tumor and oral specimens for all methylation biomarkers (p < 0.01). EPB41L3 and HPV 16 L1, L2 and E2 methylation were significantly (p < 0.0001) higher among cases than controls, regardless of early vs. late disease. When HPV 16 genes and EPB41L3 methylation status were combined in a logistic regression analysis, a sensitivity of 70.3% and a specificity of 90.9% were observed for the detection of OPC from an oral gargle. Our data suggest that methylation biomarkers measured in oral gargles may have utility in identifying OPC early. Future studies are needed to replicate these findings and to inform additional biomarkers that can maximize specificity and sensitivity for early OPC detection.

Human Papillomavirus Genotype Detection in Oral Gargle Samples Among Men With Newly Diagnosed Oropharyngeal Squamous Cell Carcinoma

Importance

The most common cause of oropharyngeal squamous cell carcinoma is human papillomavirus (HPV) infection, and currently the standard of care to determine the HPV infection status in this type of carcinoma is to use p16 immunohistochemistry as a surrogate marker of high-risk HPV infection. Although p16 immunohistochemistry is limited by the inability to determine the specific HPV genotypes, oral gargle samples may be a readily available source of HPV DNA for genotyping.

Objective

To determine the specific HPV genotypes present in both oral gargle samples and tumor specimens.

Design, Setting, and Participants

This prospective, biomarker cohort study conducted at a single specialized cancer hospital in Florida screened approximately 800 potentially eligible participants from May 2014 through October 2017. To be eligible for participation, patients had to meet all of the following criteria: 18 years of age or older, male sex, newly diagnosed as having stage I to IV cancer of the oropharynx, a squamous cell carcinoma diagnosis, treatment naive or at least 4 weeks after chemoradiation or surgical treatment of other diseases, fully understand the study procedures and risks involved, and voluntarily agree to participate by signing an informed consent statement.

Main Outcomes and Measures

Detection rate of HPV infection and HPV genotypes in oral gargle samples and tumor specimens.

Results

A cohort of 204 male participants with newly diagnosed oropharyngeal squamous cell carcinoma was assessed in this prospective collection of comprehensive clinical data and oral gargle samples. Most study participants (190 [93.1%]) were white and ever smokers (114, 55.9%), with a median age of 61 years (range, 35-87 years). The HPV infection status could be assessed in 203 of 204 participants (99.5%) using oral gargle samples: 35 samples (17.2%) were negative for HPV infection, whereas 168 samples (82.8%) were positive for HPV infection. The detection rate of HPV genotypes was 93.0% in tumor specimens (160 specimens) and 82.8% (168 samples) in oral gargle samples. The oral gargle samples frequently had low-risk HPV genotypes that were not detected in tumors, but these low-risk genotypes were always a coinfection with high-risk genotypes.

Conclusions and Relevance

Oral gargle samples can be used to detect the majority of clinically relevant HPV genotypes found in oropharyngeal squamous cell carcinoma, but the interpretation of HPV detected in these samples should be assessed with caution for general cancer risk assessment given that sensitive assays can concomitantly detect low-risk genotypes.

[Sex survey research in Germany and Europe : Liebesleben (LoveLives): A pilot study into the sexual experiences, attitudes and relationships of adults in Germany]

At the Hamburg Institute for Sex Research in Germany, a nationwide study is currently being carried out into the sexual experiences, attitudes and relationships of adults (18-75 years). The main focus of this pilot study is to test the comprehensibility and length of a data collecting instrument as well as the comparison of two data collecting methods with regard to reliability and representativeness of the results as well as of the refusal rate. To this end face-to-face interviews (n = 500) and questionnaires sent by post (n = 500) are to be compared with each other as methods. The data to be collected relates to sexuality, particularly the prevention of HIV and other sexually transmitted infections (STIs). The WHO definition of sexual health forms the basis for the study and thus connects up with the existing sex survey research in Europe and western industrial nations. Comparable surveys have been conducted over the past ten years in more than 30 European countries using a variety of methods. The focus of the study is placed upon the increase that has been observed for several years now in certain STIs. The article provides an overview of existing sex survey research in Europe. It becomes clear that the studies conducted so far are very heterogeneous with regard to chosen method, sampling techniques and the choice of content focus, so that no suitable data for cross-national comparability are currently available.

Gaps and opportunities: measuring the key population cascade through surveys and services to guide the HIV response

INTRODUCTION

The UNAIDS 90-90-90 targets to diagnose 90% of people living with HIV, put 90% of them on treatment, and for 90% of them to have suppressed viral load have focused the international HIV response on the goal of eliminating HIV by 2030. They are also a constructive tool for measuring progress toward reaching this goal but their utility is dependent upon data availability. Though more than 25% of new infections are among key populations (KP)- sex workers, men who have sex with men, transgender people, people who inject drugs, and prisoners- and their sex partners, there is a dearth of treatment cascade data for KP. We assess the availability of cascade data and review the opportunities offered by biobehavioral and programme data to inform the HIV response.

DISCUSSION

The emphasis on the collection of treatment cascade data among the general population in higher prevalence countries has not led to a similar increase in the availability of cascade data for KP. The limited data available for KP highlight large gaps in service uptake across the cascade, particularly in the first 90, awareness of HIV status. Biobehavioral surveys (BBS), with linked population size estimation, provide population-based data on the treatment cascade and should be conducted every two to three years in locations with services for KP. With the inclusion of viral load testing, these surveys are able to monitor the entire treatment cascade among KP regardless of whether these populations access HIV services targeting the general population or KP. BBS also reach people accessing services and those who do not, thereby providing a unique opportunity to learn about barriers to service uptake including stigma and discrimination. At the same time high-quality programme data can play a complementary role in identifying missed opportunities that can be addressed in real-time.

CONCLUSIONS

Data are more important than ever for guiding the HIV response toward reaching 90-90-90 targets and eliminating HIV, particularly in the face of decreased funding for HIV and specifically for KP. Timely high-quality BBS data can be triangulated with high-quality programme data to provide a comprehensive picture of the epidemic response for KP.

Bullying victimization and child sexual abuse among left-behind and non-left-behind children in China

Background

Bullying is one of the most important factors associated with child abuse. However, robust tests supporting the assumption that being bullied can contribute to child sexual abuse (CSA) among left-behind children (LBC) remain sparse. This study aims to investigate the association of bullying victimization with CSA among LBC in China.

Methods

A cross-sectional study was conducted in six middle schools of Sichuan and Anhui province in 2015. The bullying victimization was assessed by seven items from the Revised Olweus Bully/Victim Questionnaire. The experience of CSA was measured by ten items CSA scale with good consistency.

Results

A total of 1,030 children met the sampling criteria, including 284 LBC and 746 non-LBC. The prevalence of CSA was 22.89% in LBC and 20.19% in non-LBC (p > 0.05). Bullying victimization was related to CSA among both LBC (adjusted Odds Ratio [aOR] = 2.52, 95% CI [1.34–4.73]) and non-LBC (aOR = 2.35, 95% CI [1.58–3.53]). The association between bullying victimization and CSA was much higher among left-behind girls (left-behind girls: aOR = 7.36, 95% CI [2.16–24.99]; non-left-behind girls: aOR = 2.38, 95% CI [1.08–5.27]). Also, LBC of a young age (11–15), children with siblings, living in rural areas and non-traditional family structure who were bullied were more likely to suffer CSA than their non-LBC peers.

Conclusions

Bullying victimization is associated with a significant increase in CSA among both LBC and non-LBC. Anti-bullying programs should target vulnerable populations including female LBC and LBC with siblings to reduce the risk of CSA.

Focus on Methodology: Beyond paper and pencil: Conducting computer-assisted data collection with adolescents in group settings

Computer-assisted data collection offers advantages over traditional paper and pencil measures; however, little guidance is available regarding the logistics of conducting computer-assisted data collection with adolescents in group settings. To address this gap, we draw on our experiences conducting a multi-site longitudinal study of adolescent development. Structured questionnaires programmed on laptop computers using Audio Computer Assisted Self-Interviewing (ACASI) were administered to groups of adolescents in community-based and afterschool programs. Although implementing ACASI required additional work before entering the field, we benefited from reduced data processing time, high data quality, and high levels of youth motivation. Preliminary findings from an ethnically diverse sample of 265 youth indicate favorable perceptions of using ACASI. Using our experiences as a case study, we provide recommendations on selecting an appropriate data collection device (including hardware and software), preparing and testing the ACASI, conducting data collection in the field, and managing data.

Process and implementation of Audio Computer Assisted Self-Interviewing (ACASI) assessments in low resource settings: a case example from Zambia

BACKGROUND

Studies from low- and middle-income countries (LMIC) indicate that the use of audio computer-assisted self-interviewing (ACASI) is associated with more accurate reporting of sensitive behaviors (e.g. substance use and sexual risk behaviors) compared with interviewer-administered questionnaires. There is a lack of published information on the process of designing, developing, and implementing ACASI in LMIC. In this paper we describe our experience implementing an ACASI system for use with a population of orphans and vulnerable children in Zambia.

METHODS

A questionnaire of mental health, substance use, and HIV risk behaviors was converted into an ACASI system, tested in pilot and validity studies, and implemented for use in a randomized controlled trial. Successes, barriers, and challenges associated with each stage in the development and implementation of ACASI are described.

RESULTS

We were able to convert a lengthy and complex survey into an ACASI system that was feasible for use in Zambia. Lessons learned include the importance of: (1) piloting the written and electronic versions; (2) proper and extensive training for study assessors to use ACASI and for those doing voice recordings; and (3) attention to logistics such as appropriate space, internet, and power.

CONCLUSIONS

We found that ACASI was feasible and acceptable in Zambia with proper planning, training, and supervision. Given mounting evidence indicating that ACASI provides more accurate self-report data and immediate data download compared with interview-administered measures, it may be an effective and economical alternative for behavioral health research studies in LMIC.

Novel and emerging strategies for longitudinal data collection

PURPOSE

To describe novel and emerging strategies practiced globally in research to improve longitudinal data collection.

ORGANIZING CONSTRUCT

In research studies, numerous strategies such as telephone interviews, postal mailing, online questionnaires, and electronic mail are traditionally utilized in longitudinal data collection. However, due to technological advances, novel and emerging strategies have been applied to longitudinal data collection, such as two-way short message service, smartphone applications (or "apps"), retrieval capabilities applied to the electronic medical record, and an adapted cloud interface. In this review, traditional longitudinal data collection strategies are briefly described, emerging and novel strategies are detailed and explored, and information regarding the impact of novel methods on participant response rates, the timeliness of participant responses, and cost is provided. We further discuss how these novel and emerging strategies affect longitudinal data collection and advance research, specifically nursing research.

CONCLUSIONS

Evidence suggests that the novel and emerging longitudinal data collection strategies discussed in this review are valuable approaches to consider. These strategies facilitate collecting longitudinal research data to better understand a variety of health-related conditions. Future studies, including nursing research, should consider using novel and emerging strategies to advance longitudinal data collection.

CLINICAL RELEVANCE

A better understanding of novel and emerging longitudinal data collection strategies will ultimately improve longitudinal data collection as well as foster research efforts. Nurse researchers, along with all researchers, must be aware of and consider implementing novel and emerging strategies to ensure future healthcare research success.

Development of a culturally appropriate computer-delivered tailored Internet-based health literacy intervention for Spanish-dominant Hispanics living with HIV

BACKGROUND

Low health literacy is associated with poor medication adherence in persons with human immunodeficiency virus (HIV), which can lead to poor health outcomes. As linguistic minorities, Spanish-dominant Hispanics (SDH) face challenges such as difficulties in obtaining and understanding accurate information about HIV and its treatment. Traditional health educational methods (e.g., pamphlets, talking) may not be as effective as delivering through alternate venues. Technology-based health information interventions have the potential for being readily available on desktop computers or over the Internet. The purpose of this research was to adapt a theoretically-based computer application (initially developed for English-speaking HIV-positive persons) that will provide linguistically and culturally appropriate tailored health education to Spanish-dominant Hispanics with HIV (HIV + SDH).

METHODS

A mixed methods approach using quantitative and qualitative interviews with 25 HIV + SDH and 5 key informants guided by the Information-Motivation-Behavioral (IMB) Skills model was used to investigate cultural factors influencing medication adherence in HIV + SDH. We used a triangulation approach to identify major themes within cultural contexts relevant to understanding factors related to motivation to adhere to treatment. From this data we adapted an automated computer-based health literacy intervention to be delivered in Spanish.

RESULTS

Culture-specific motivational factors for treatment adherence in HIV + SDH persons that emerged from the data were stigma, familismo (family), mood, and social support. Using this data, we developed a culturally and linguistically adapted a tailored intervention that provides information about HIV infection, treatment, and medication related problem solving skills (proven effective in English-speaking populations) that can be delivered using touch-screen computers, tablets, and smartphones to be tested in a future study.

CONCLUSION

Using a theoretically-grounded Internet-based eHealth education intervention that builds on knowledge and also targets core cultural determinants of adherence may prove a highly effective approach to improve health literacy and medication decision-making in this group.

HIV prevention for adults with criminal justice involvement: a systematic review of HIV risk-reduction interventions in incarceration and community settings

We summarized and appraised evidence regarding HIV prevention interventions for adults with criminal justice involvement. We included randomized and quasi-randomized controlled trials that evaluated an HIV prevention intervention, enrolled participants with histories of criminal justice involvement, and reported biological or behavioral outcomes. We used Cochrane methods to screen 32,271 citations from 16 databases and gray literature. We included 37 trials enrolling n = 12,629 participants. Interventions were 27 psychosocial, 7 opioid substitution therapy, and 3 HIV-testing programs. Eleven programs significantly reduced sexual risk taking, 4 reduced injection drug risks, and 4 increased testing. Numerous interventions may reduce HIV-related risks among adults with criminal justice involvement. Future research should consider process evaluations, programs involving partners or families, and interventions integrating biomedical, psychosocial, and structural approaches.

Data processing costs for three posture assessment methods

Background

Data processing contributes a non-trivial proportion to total research costs, but documentation of these costs is rare. This paper employed a priori cost tracking for three posture assessment methods (self-report, observation of video, and inclinometry), developed a model describing the fixed and variable cost components, and simulated additional study scenarios to demonstrate the utility of the model.

Methods

Trunk and shoulder postures of aircraft baggage handlers were assessed for 80 working days using all three methods. A model was developed to estimate data processing phase costs, including fixed and variable components related to study planning and administration, custom software development, training of analysts, and processing time.

Results

Observation of video was the most costly data processing method with total cost of € 30,630, and was 1.2-fold more costly than inclinometry (€ 26,255), and 2.5-fold more costly than self-reported data (€ 12,491). Simulated scenarios showed altering design strategy could substantially impact processing costs. This was shown for both fixed parameters, such as software development and training costs, and variable parameters, such as the number of work-shift files processed, as well as the sampling frequency for video observation. When data collection and data processing costs were combined, the cost difference between video and inclinometer methods was reduced to 7%; simulated data showed this difference could be diminished and, even, reversed at larger study sample sizes. Self-report remained substantially less costly under all design strategies, but produced alternate exposure metrics.

Conclusions

These findings build on the previously published data collection phase cost model by reporting costs for post-collection data processing of the same data set. Together, these models permit empirically based study planning and identification of cost-efficient study designs.

Application of audio computer-assisted self-interviews to collect self-reported health data: an overview

For assessment of sensitive health behaviors (e.g., sexual behavior, violent behaviors, substance use), research is typically limited to an examination of self-reports of past behavior. Audio computer-assisted self-interviews (ACASI) may enhance the validity of self-report data in research and clinical settings by reducing measurement bias. This paper provides an introduction to ACASI for collection of self-reported health data. The potential benefits and cost-effectiveness of ACASI use in research and clinical settings are reviewed. We then review the theoretical underpinnings that may underlie differential reporting of health behaviors between assessment modalities. Next, we highlight studies that have investigated differences in self-reported health behaviors between assessment modalities. Lastly, we summarize potential applications of ACASI assessments within clinical settings.

Development of a computer-based survey instrument for organophosphate and N-methyl-carbamate exposure assessment among agricultural pesticide handlers

BACKGROUND

Assessment of occupational pesticide exposures based on self-reported information can be challenging, particularly with immigrant farm worker populations for whom specialized methods are needed to address language and cultural barriers and account for limited literacy. An audio computer-assisted self-interview (A-CASI) survey instrument was developed to collect information about organophosphate (OP) and N-methyl-carbamate (CB) exposures and other personal characteristics among male agricultural pesticide handlers for an ongoing cholinesterase biomonitoring study in Washington State.

OBJECTIVES

To assess the feasibility of collecting data using the A-CASI instrument and evaluate reliability for a subset of survey items.

METHODS

The survey consisted of 64 items administered in Spanish or English on a touch-screen tablet computer. Participants listened to digitally recorded questions on headphones and selected responses on the screen, most of which were displayed as images or icons to facilitate participation of low literacy respondents. From 2006-2008, a total of 195 participants completed the survey during the OP/CB application seasons on at least one occasion. Percent agreement and kappa coefficients were calculated to evaluate test-retest reliability for selected characteristics among 45 participants who completed the survey on two separate occasions within the same year.

RESULTS

Almost all participants self-identified as Hispanic or Latino (98%), and 97% completed the survey in Spanish. Most participants completed the survey in a half-hour or less, with minimal assistance from on-site research staff. Analyses of test-retest reliability showed substantial agreement for most demographic, work history, and health characteristics and at least moderate agreement for most variables related to personal protective equipment use during pesticide applications.

CONCLUSIONS

This A-CASI survey instrument is a novel method that has been used successfully to collect information about OP/CB exposures and other personal characteristics among Spanish-speaking agricultural pesticide handlers.

Test-retest reliability of a sexual behavior interview for men residing in Brazil, Mexico, and the United States: the HPV in Men (HIM) Study

Understanding the natural history of sexually transmitted infections requires the collection of data on sexual behavior. However, there is concern that self-reported information on sexual behavior may not be valid, especially if study participants are culturally and linguistically distinct. The authors completed a test-retest reliability study of 1,069 men recruited in Brazil, Mexico, and the United States in 2005 and 2006. All of the men completed the same computer-assisted self-interview approximately 3 weeks apart. Refusal rates, kappa coefficients, and intraclass correlation coefficients were calculated for the full sample and by country, age, and lifetime number of female sex partners. Reliability coefficients for each study site and the combined population were high for almost all questions. With few exceptions, the authors found high test-retest reliability with a computer-assisted self-interview on sexual behavior used in 3 culturally and linguistically distinct countries.

Test-retest reliability of self-reported HIV/STD-related measures among African-American adolescents in four U.S. cities

PURPOSE

To evaluate the test-retest reliability of self-reported sexuality-related data in a sample of African American adolescents residing in four U.S. cities.

METHODS

Using audio computer-assisted self-interviewing (ACASI), 156 African American teens (mean age = 15.5 years) provided data on lifetime and recent sexual behavior, HIV/sexually transmitted disease (STD) testing, and theoretical antecedents of sexual risk behavior on two occasions separated by 2 weeks.

RESULTS

Most self-reports of lifetime sexual behavior and STD/HIV testing were stable across the two assessment points. Test-retest agreement was substantial for dichotomous indices of lifetime sexual behaviors and STD testing (kappas ranging from .61-.87), and for 3-month recall of vaginal sex (kappa = .72) and number of sexual partners (intraclass correlation coefficient [ICC] = .68). Lower reliability estimates emerged for count data of unprotected vaginal sex occasions (ICC = .44). Test-retest reliability estimates for antecedents of sexual risk behavior were highest for a validated measure of HIV-related knowledge (r = .73), but somewhat lower for peer norms (r = .58) and condom use self-efficacy (r = .50).

CONCLUSIONS

Although variability in the stability of self-report data was observed, findings confirm that most sexual behavior, STD and HIV testing history, and psychosocial measures can be assessed reliably among adolescents. Research should continue to identify strategies to enhance the reliability of self-report sexual behavior data from youth at risk for HIV and other sexually transmitted infections.