Plausibility Judgments of Atypical Symptoms Across Cultures: an Explorative Study Among Western and Non-Western Experts

Symptom coaching and symptom validity tests: An analog study using the structured inventory of malingered symptomatology, Self-Report Symptom Inventory, and Inventory of Problems-29

In this pilot and exploratory study, we tested the robustness of three self-report symptom validity tests (SVTs) to symptom coaching for depression, with and without additional information available on the Internet. Specifically, we divided our sample (N = 193) so that each subject received either the Structured Inventory of Malingered Symptomatology (SIMS; n = 64), the Self-Report Symptom Inventory (SRSI; n = 66), or the Inventory of Problems-29 (IOP-29; n = 63). Within each of the three subgroups, approximately one third of participants were instructed to respond honestly (Genuine Condition, nSIMS = 21; nSRSI = 24; nIOP-29 = 26) and approximately two-thirds were instructed to feign depression. One half of the feigners were presented with a vignette to increase their compliance with instructions and were given information about symptoms of depression (Coached Feigning, nSIMS = 25; nSRSI = 18; nIOP-29 = 21), and the other half were given the same vignette and information about symptoms of depression, plus two Internet links to review before completing the test (Internet-Coached Feigning, nSIMS = 18; nSRSI = 24; nIOP-29 = 16). Overall, the results showed that the genuine conditions yielded the lowest total scores on all three measures, while the two feigning conditions did not significantly differ from each other. Looking at the detection rates for all feigning participants, all three measures showed satisfactory results, with IOP-29 performing slightly better than SIMS and SIMS performing slightly better than SRSI. Internet-Coached Feigners scored slightly lower on all three measures than feigners who were coached without the Internet links. Taken together, the results of this preliminary and exploratory study suggest that all three SVTs examined are sensitive to feigned depression even in the presence of symptom coaching, both with and without additional Internet-based information.

Cross-Cultural Performance Validity Testing: Managing False Positives in Examinees with Limited English Proficiency

Base rates of failure (BR_Fail) on performance validity tests (PVTs) were examined in university students with limited English proficiency (LEP). BR_Fail was calculated for several free-standing and embedded PVTs. All free-standing PVTs and certain embedded indicators were robust to LEP. However, LEP was associated with unacceptably high BR_Fail (20-50%) on several embedded PVTs with high levels of verbal mediation (even multivariate models of PVT could not contain BR_Fail). In conclusion, failing free-standing/dedicated PVTs cannot be attributed to LEP. However, the elevated BR_Fail on several embedded PVTs in university students suggest an unacceptably high overall risk of false positives associated with LEP.

How Plausible Is the Implausible? Students’ Plausibility and Prevalence Ratings of the Self-Report Symptom Inventory

Some self-report symptom validity tests, such as the Self-Report Symptom Inventory (SRSI), rely on a detection strategy that uses bizarre, extreme, or very rare symptoms. Thus, items are constructed to invite respondents with an invalid response style to affirm pseudosymptoms that are usually not experienced by genuine patients. However, these pseudosymptoms should not be easily recognizable, because otherwise sophisticated over-reporters could strategically avoid them and go undetected. Therefore, we tested how well future psychology professionals were able to differentiate between genuine complaints and pseudosymptoms in terms of their plausibility and prevalence.

Psychology students (N = 87) received the items of the SRSI online and were given the task to rate each item as to its plausibility and prevalence in the community.

Students evaluated genuine symptoms as significantly more plausible and more prevalent than pseudosymptoms. However, 56% of students rated pseudosymptoms as moderately plausible, whereas 17% rated them as moderately prevalent in the general public.

Overall, it appears that psychology students are successful in distinguishing bizarre, unusual, or rare symptoms from genuine complaints. Yet, the majority of students still attributed relatively high prima facie plausibility to pseudosymptoms. We contend that if such a trusting attitude is true for psychology students, it may also be the case for young psychology practitioners, which, consequently, may diminish the probability of employing self-report validity measures in psychological assessments.

The Self-Report Symptom Inventory as an Instrument for Detecting Symptom Over-Reporting

Abstract. The recently developed Self-Report Symptom Inventory (SRSI) intends to provide an alternative approach to the detection of symptom over-reporting. Unlike other measures, the SRSI includes both non-existent symptoms (i.e., pseudosymptoms) and genuine symptoms. Previous research using the German SRSI showed that people who exaggerate their complaints over-endorse both types of symptoms. In the current simulation experiment, we tested whether the Dutch and English SRSI are effective in identifying over-reporting by comparing SRSI scores of an honest group ( n = 51) with those of two experimental simulator groups (pain, n = 54; anxiety, n = 53). The pain and anxiety simulators endorsed significantly more genuine symptoms and pseudosymptoms than honest participants (ηp2 = .50 and ηp2 = .30, respectively). Furthermore, pain and anxiety over-reporters specifically over-endorsed symptoms corresponding to their simulation instructions (Cohen’s ds > 0.77). Using the recommended cut-off score, the SRSI detected 48% of pain over-reporters and 73% of anxiety over-reporters, with areas under the curve (AUC) ranging from .88 to .91. These results indicate that the SRSI is a promising tool for identifying over-reporting, but further research with clinical samples is needed.