Experimental validation of specialized questioning techniques in conservation

Conservation increasingly relies on social science tools to understand human behavior. Specialized questioning techniques (SQTs) are a suite of methods designed to reduce bias in social surveys and are widely used to collect data on sensitive topics, including compliance with conservation rules. Most SQTs have been developed in Western, industrialized, educated, rich, and democratic countries, meaning their suitability in other contexts may be limited. Whether these techniques perform better than conventional direct questioning is important for those considering their use. We designed an experiment to validate the performance of four SQTs (unmatched count technique, randomized response technique, crosswise model, and bean method) against direct questions when asking about a commonly researched sensitive behavior in conservation, wildlife hunting. We developed fictional characters, and for each method asked respondents to report the answers that each fictional character should give when asked if they hunt wildlife. We collected data from 609 individuals living close to protected areas in two different cultural and socioeconomic contexts (Indonesia and Tanzania) to quantify the extent to which respondents understood and followed SQT instructions and to explore the sociodemographic factors that influenced a correct response. Data were modeled using binomial general linear mixed models. Participants were more likely to refuse to answer questions asked using SQTs compared with direct questions. Model results suggested that SQTs were harder for participants to understand. Demographic factors (e.g., age and education level) significantly influenced response accuracy. When sensitive responses to sensitive questions were required, all SQTs (excluding the bean method) outperformed direct questions, demonstrating that SQTs can successfully reduce sensitivity bias. However, when reviewing each method, most respondents (59-89%) reported they would feel uncomfortable using them to provide information on their own hunting behavior, highlighting the considerable challenge of encouraging truthful reporting on sensitive topics. Our results demonstrate the importance of assessing the suitability of social science methods prior to their implementation in conservation contexts.

Functionality of the Crosswise Model for Assessing Sensitive or Transgressive Behavior: A Systematic Review and Meta-Analysis

Tools for reliable assessment of socially sensitive or transgressive behavior warrant constant development. Among them, the Crosswise Model (CM) has gained considerable attention. We systematically reviewed and meta-analyzed empirical applications of CM and addressed a gap for quality assessment of indirect estimation models. Guided by the PRISMA protocol, we identified 45 empirical studies from electronic database and reference searches. Thirty of these were comparative validation studies (CVS) comparing CM and direct question (DQ) estimates. Six prevalence studies exclusively used CM. One was a qualitative study. Behavior investigated were substance use and misuse (k = 13), academic misconduct (k = 8), and corruption, tax evasion, and theft (k = 7) among others. Majority of studies (k = 39) applied the "more is better" hypothesis. Thirty-five studies relied on birthday distribution and 22 of these used P = 0.25 for the non-sensitive item. Overall, 11 studies were assessed as high-, 31 as moderate-, and two as low quality (excluding the qualitative study). The effect of non-compliance was assessed in eight studies. From mixed CVS results, the meta-analysis indicates that CM outperforms DQ on the "more is better" validation criterion, and increasingly so with higher behavior sensitivity. However, little difference was observed between DQ and CM estimates for items with DQ prevalence estimate around 50%. Based on empirical evidence available to date, our study provides support for the superiority of CM to DQ in assessing sensitive/transgressive behavior. Despite some limitations, CM is a valuable and promising tool for population level investigation.

Estimating the prevalence of illicit drug use among students using the crosswise model

OBJECTIVE

The aim of our study is to compare the prevalence of illicit drug use estimated through a technique referred to as the "crosswise model" (CM) with the results from conventional direct questioning (DQ).

METHOD

About 1,500 students from Tehran University of Medical Sciences 2009-2010 were first interviewed by DQ and, then three months later, by the CM.

RESULT

The CM yielded significantly higher estimates than DQ for lifetime prevalence of use of any illicit drug (CM = 20.2%,DQ = 3.0%, p < .001) and for lifetime prevalence of use of opium or its residue (CM = 13.6%, DQ = 1.0%, p < .001). Also, for use of any illicit drug in the last month and use of opium or its residue in the last month, the CM yielded higher point estimates than DQ, although these differences were not significant (any drug: CM = 1.5%, DQ = 0.2%, p = .66; opium: CM = 3.8%, DQ = 0.0%, p = .21).

CONCLUSION

Our findings suggest that the CM is a fruitful data collection method for sensitive topics such as substance abuse.