1
|
Melis G, Ursino M, Scarpazza C, Zangrossi A, Sartori G. Detecting lies in investigative interviews through the analysis of response latencies and error rates to unexpected questions. Sci Rep 2024; 14:12268. [PMID: 38806588 PMCID: PMC11133341 DOI: 10.1038/s41598-024-63156-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 05/25/2024] [Indexed: 05/30/2024] Open
Abstract
In this study, we propose an approach to detect deception during investigative interviews by integrating response latency and error analysis with the unexpected question technique. Sixty participants were assigned to an honest (n = 30) or deceptive group (n = 30). The deceptive group was instructed to memorize the false biographical details of a fictitious identity. Throughout the interviews, participants were presented with a randomized sequence of control, expected, and unexpected open-ended questions about identity. Responses were audio recorded for detailed examination. Our findings indicate that deceptive participants showed markedly longer latencies and higher error rates when answering expected (requiring deception) and unexpected questions (for which premeditated deception was not possible). Longer response latencies were also observed in participants attempting deception when answering control questions (which necessitated truthful answers). Moreover, a within-subject analysis highlighted that responding to unexpected questions significantly impaired individuals' performance compared to answering control and expected questions. Leveraging machine-learning algorithms, our approach attained a classification accuracy of 98% in distinguishing deceptive and honest participants. Additionally, a classification analysis on single response levels was conducted. Our findings underscore the effectiveness of merging response latency metrics and error rates with unexpected questioning as a robust method for identity deception detection in investigative interviews. We also discuss significant implications for enhancing interview strategies.
Collapse
Affiliation(s)
- Giulia Melis
- Department of General Psychology, University of Padua, Padova, Italy.
- Human Inspired Technology Research Centre, University of Padua, Padova, Italy.
| | - Martina Ursino
- Department of General Psychology, University of Padua, Padova, Italy
| | - Cristina Scarpazza
- Department of General Psychology, University of Padua, Padova, Italy
- Translational Neuroimaging and Cognitive Lab, IRCCS San Camillo Hospital, Venice, Italy
| | - Andrea Zangrossi
- Department of General Psychology, University of Padua, Padova, Italy
- Padova Neuroscience Center (PNC), University of Padua, Padova, Italy
| | - Giuseppe Sartori
- Department of General Psychology, University of Padua, Padova, Italy
| |
Collapse
|
2
|
Orrù G, De Marchi B, Sartori G, Gemignani A, Scarpazza C, Monaro M, Mazza C, Roma P. Machine learning item selection for short scale construction: A proof-of-concept using the SIMS. Clin Neuropsychol 2023; 37:1371-1388. [PMID: 36017966 DOI: 10.1080/13854046.2022.2114548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 08/12/2022] [Indexed: 11/03/2022]
Abstract
ObjectiveThis proof-of-concept paper provides evidence to support machine learning (ML) as a valid alternative to traditional psychometric techniques in the development of short forms of longer parent psychological tests. ML comprises a variety of feature selection techniques that can be efficiently applied to identify the set of items that best replicates the characteristics of the original test. MethodsIn the present study, we integrated a dataset of 329 participants from published and unpublished datasets used in previous research on the Structured Inventory of Malingered Symptomatology (SIMS) to develop a short version of the scale. The SIMS is a multi-axial self-report questionnaire and a highly efficient psychometric measure of symptom validity, which is frequently applied in forensic settings. Results State-of-the-art ML item selection techniques achieved a 72% reduction in length while capturing 92% of the variance of the original SIMS. The new SIMS short form now consists of 21 items. ConclusionsThe results suggest that the proposed ML-based item selection technique represents a promising alternative to standard psychometric correlation-based methods (i.e. item selection, item response theory), especially when selection techniques (e.g. wrapper) are employed that evaluate global, rather than local, item value.
Collapse
Affiliation(s)
- Graziella Orrù
- Department of Surgical, Medical, Molecular & Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Barbara De Marchi
- Department of Neuroscience and Rehabilitation, University of Ferrara, Ferrara, Italy
| | - Giuseppe Sartori
- Department of General Psychology, University of Padua, Padua, Italy
| | - Angelo Gemignani
- Department of Surgical, Medical, Molecular & Critical Area Pathology, University of Pisa, Pisa, Italy
| | | | - Merylin Monaro
- Department of General Psychology, University of Padua, Padua, Italy
| | - Cristina Mazza
- Department of Neuroscience, Imaging and Clinical Sciences, G. d'Annunzio University of Chieti-Pescara, Chieti, Italy
| | - Paolo Roma
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| |
Collapse
|
3
|
Identifying Faked Responses in Questionnaires with Self-Attention-Based Autoencoders. INFORMATICS 2022. [DOI: 10.3390/informatics9010023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Deception, also known as faking, is a critical issue when collecting data using questionnaires. As shown by previous studies, people have the tendency to fake their answers whenever they gain an advantage from doing so, e.g., when taking a test for a job application. Current methods identify the general attitude of faking but fail to identify faking patterns and the exact responses affected. Moreover, these strategies often require extensive data collection of honest responses and faking patterns related to the specific questionnaire use case, e.g., the position that people are applying to. In this work, we propose a self-attention-based autoencoder (SABA) model that can spot faked responses in a questionnaire solely relying on a set of honest answers that are not necessarily related to its final use case. We collect data relative to a popular personality test (the 10-item Big Five test) in three different use cases, i.e., to obtain: (i) child custody in court, (ii) a position as a salesperson, and (iii) a role in a humanitarian organization. The proposed model outperforms by a sizeable margin in terms of F1 score three competitive baselines, i.e., an autoencoder based only on feedforward layers, a distribution model, and a k-nearest-neighbor-based model.
Collapse
|
4
|
Gui W, Wang L, Wu H, Jian X, Li D, Huang N. Multiple psychological characteristics predict housing mortgage loan behavior: A holistic model based on machine learning. Psych J 2022; 11:263-274. [PMID: 35166045 DOI: 10.1002/pchj.521] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 12/02/2021] [Accepted: 12/16/2021] [Indexed: 11/05/2022]
Abstract
The factors that influence consumers' house choice are debatable. Previous studies have examined the effects of demographic and socioeconomic attributes, physical and environmental features of the house, and isolated single psychological characteristics on housing behavior. However, these factors are still not sufficient to predict consumer housing behavior, particularly when they are measured separately. We construct a holistic model that integrates psychological characteristics including values, personality traits, motivation, decision-making style, and risk-seeking together with demographic and socioeconomic factors to jointly predict housing mortgage loan behavior. This study aims to use a newly developed statistical method, "machine learning," to examine the relationship between multiple psychological characteristics and consumer housing mortgage loan behavior. Data were collected through an online survey (N = 2,270). The results show that the holistic psychological model is effective for predicting consumer housing mortgage loan behavior in the life context. Moreover, by analyzing and comparing the relative impact of all predictors, we find that psychological characteristics made a more important contribution to predicting housing mortgage loan behavior than did traditional factors (demographic and socioeconomic factors). The results provide a new perspective for understanding the effects of how multiple psychological characteristics integrally predict consumers' housing mortgage loan behavior in the real estate market. Theoretical and practical implications for marketing and sales are discussed.
Collapse
Affiliation(s)
- Wenjing Gui
- School of Psychological and Cognitive Sciences and Beijing Key Lab for Behavior and Mental Health, Peking University, Beijing, China
| | - Lei Wang
- School of Psychological and Cognitive Sciences and Beijing Key Lab for Behavior and Mental Health, Peking University, Beijing, China
| | - Han Wu
- School of Psychological and Cognitive Sciences and Beijing Key Lab for Behavior and Mental Health, Peking University, Beijing, China
| | - Xiaoqian Jian
- Zhenghe Real Estate Consulting Corp., Ltd., Chengdu, China
| | - Dusha Li
- Zhenghe Real Estate Consulting Corp., Ltd., Chengdu, China
| | - Na Huang
- Zhenghe Real Estate Consulting Corp., Ltd., Chengdu, China
| |
Collapse
|
5
|
Monaro M, Bertomeu CB, Zecchinato F, Fietta V, Sartori G, De Rosario Martínez H. The detection of malingering in whiplash-related injuries: a targeted literature review of the available strategies. Int J Legal Med 2021; 135:2017-2032. [PMID: 33829284 PMCID: PMC8354940 DOI: 10.1007/s00414-021-02589-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Accepted: 03/26/2021] [Indexed: 11/29/2022]
Abstract
OBJECTIVE The present review is intended to provide an up-to-date overview of the strategies available to detect malingered symptoms following whiplash. Whiplash-associated disorders (WADs) represent the most common traffic injuries, having a major impact on economic and healthcare systems worldwide. Heterogeneous symptoms that may arise following whiplash injuries are difficult to objectify and are normally determined based on self-reported complaints. These elements, together with the litigation context, make fraudulent claims particularly likely. Crucially, at present, there is no clear evidence of the instruments available to detect malingered WADs. METHODS We conducted a targeted literature review of the methodologies adopted to detect malingered WADs. Relevant studies were identified via Medline (PubMed) and Scopus databases published up to September 2020. RESULTS Twenty-two methodologies are included in the review, grouped into biomechanical techniques, clinical tools applied to forensic settings, and cognitive-based lie detection techniques. Strengths and weaknesses of each methodology are presented, and future directions are discussed. CONCLUSIONS Despite the variety of techniques that have been developed to identify malingering in forensic contexts, the present work highlights the current lack of rigorous methodologies for the assessment of WADs that take into account both the heterogeneous nature of the syndrome and the possibility of malingering. We conclude that it is pivotal to promote awareness about the presence of malingering in whiplash cases and highlight the need for novel, high-quality research in this field, with the potential to contribute to the development of standardised procedures for the evaluation of WADs and the detection of malingering.
Collapse
Affiliation(s)
- Merylin Monaro
- Department of General Psychology, Università degli Studi di Padova, via Venezia 8, 35131, Padova, Italy.
| | - Chema Baydal Bertomeu
- Instituto de Biomecánica de Valencia, Universitat Politècnica de Valencia, Ed. 9C. Camino de Vera s/n, 46022, Valencia, Spain
| | - Francesca Zecchinato
- Department of General Psychology, Università degli Studi di Padova, via Venezia 8, 35131, Padova, Italy
| | - Valentina Fietta
- Department of General Psychology, Università degli Studi di Padova, via Venezia 8, 35131, Padova, Italy
| | - Giuseppe Sartori
- Department of General Psychology, Università degli Studi di Padova, via Venezia 8, 35131, Padova, Italy
| | - Helios De Rosario Martínez
- Instituto de Biomecánica de Valencia, Universitat Politècnica de Valencia, Ed. 9C. Camino de Vera s/n, 46022, Valencia, Spain
- CIBER de Bioingeniería, Biomateriales Y Nanomedicina (CIBER-BBN), Zaragoza, Spain
| |
Collapse
|
6
|
Orrù G, Mazza C, Monaro M, Ferracuti S, Sartori G, Roma P. The Development of a Short Version of the SIMS Using Machine Learning to Detect Feigning in Forensic Assessment. PSYCHOLOGICAL INJURY & LAW 2020. [DOI: 10.1007/s12207-020-09389-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractIn the present study, we applied machine learning techniques to evaluate whether the Structured Inventory of Malingered Symptomatology (SIMS) can be reduced in length yet maintain accurate discrimination between consistent participants (i.e., presumed truth tellers) and symptom producers. We applied machine learning item selection techniques on data from Mazza et al. (2019c) to identify the minimum number of original SIMS items that could accurately distinguish between consistent participants, symptom accentuators, and symptom producers in real personal injury cases. Subjects were personal injury claimants who had undergone forensic assessment, which is known to incentivize malingering and symptom accentuation. Item selection yielded short versions of the scale with as few as 8 items (to differentiate between consistent participants and symptom producers) and as many as 10 items (to differentiate between consistent and inconsistent participants). The scales had higher classification accuracy than the original SIMS and did not show the bias that was originally reported between false positives and false negatives.
Collapse
|
7
|
Use of mouse-tracking software to detect faking-good behavior on personality questionnaires: an explorative study. Sci Rep 2020; 10:4835. [PMID: 32179844 PMCID: PMC7075885 DOI: 10.1038/s41598-020-61636-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 02/28/2020] [Indexed: 11/25/2022] Open
Abstract
The aim of the present study was to explore whether kinematic indicators could improve the detection of subjects demonstrating faking-good behaviour when responding to personality questionnaires. One hundred and twenty volunteers were randomly assigned to one of four experimental groups (honest unspeeded, faking-good unspeeded, honest speeded, and faking-good speeded). Participants were asked to respond to the MMPI-2 underreporting scales (L, K, S) and the PPI-R Virtuous Responding (VR) scale using a computer mouse. The collected data included T-point scores on the L, K, S, and VR scales; response times on these scales; and several temporal and spatial mouse parameters. These data were used to investigate the presence of significant differences between the two manipulated variables (honest vs. faking-good; speeded vs. unspeeded). The results demonstrated that T-scores were significantly higher in the faking-good condition relative to the honest condition; however, faking-good and honest respondents showed no statistically significant differences between the speeded and unspeeded conditions. Concerning temporal and spatial kinematic parameters, we observed mixed results for different scales and further investigations are required. The most consistent finding, albeit with small observed effects, regards the L scale, in which faking-good respondents took longer to respond to stimuli and outlined wider mouse trajectories to arrive at the given response.
Collapse
|
8
|
Cartwright A, Donkin R. Knowledge of Depression and Malingering: An Exploratory Investigation. EUROPES JOURNAL OF PSYCHOLOGY 2020; 16:32-44. [PMID: 33680168 PMCID: PMC7913031 DOI: 10.5964/ejop.v16i1.1730] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2018] [Accepted: 06/12/2019] [Indexed: 11/20/2022]
Abstract
Malingering mental disorder for financial compensation can offer substantial rewards to those willing to do so. A recent review of UK medico-legal experts' practices for detecting claimants evidenced that they are not well equipped to detect those that do. This is not surprising, considering that very little is known regarding why individuals opt to malinger. A potential construct which may influence an individual's choice to malinger is their knowledge of the disorder, and when one considers the high levels of depression literacy within the UK, it is imperative that this hypothesis is investigated. A brief depression knowledge scale was devised and administered to undergraduate students (N = 155) alongside a series of questions exploring how likely participants were to malinger in both workplace stress and claiming for benefit vignettes. Depression knowledge did not affect the likelihood of engaging in any malingering strategy in either the workplace stress vignettes or the benefit claimant vignettes. Differences were found between the two vignettes providing evidence for the context-specific nature of malingering, and an individual's previous mental disorder was also influential.
Collapse
Affiliation(s)
- Ashley Cartwright
- Behavioural Sciences, School of Human and Health Sciences, University of Huddersfield, Huddersfield, United Kingdom
| | - Rebecca Donkin
- Department of Psychology, Leeds Trinity University, Leeds, United Kingdom
| |
Collapse
|
9
|
Mazza C, Orrù G, Burla F, Monaro M, Ferracuti S, Colasanti M, Roma P. Indicators to distinguish symptom accentuators from symptom producers in individuals with a diagnosed adjustment disorder: A pilot study on inconsistency subtypes using SIMS and MMPI-2-RF. PLoS One 2019; 14:e0227113. [PMID: 31887214 PMCID: PMC6936836 DOI: 10.1371/journal.pone.0227113] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Accepted: 12/11/2019] [Indexed: 11/17/2022] Open
Abstract
In the context of legal damage evaluations, evaluees may exaggerate or simulate symptoms in an attempt to obtain greater economic compensation. To date, practitioners and researchers have focused on detecting malingering behavior as an exclusively unitary construct. However, we argue that there are two types of inconsistent behavior that speak to possible malingering-accentuating (i.e., exaggerating symptoms that are actually experienced) and simulating (i.e., fabricating symptoms entirely)-each with its own unique attributes; thus, it is necessary to distinguish between them. The aim of the present study was to identify objective indicators to differentiate symptom accentuators from symptom producers and consistent participants. We analyzed the Structured Inventory of Malingered Symptomatology scales and the Minnesota Multiphasic Personality Inventory-2 Restructured Form validity scales of 132 individuals with a diagnosed adjustment disorder with mixed anxiety and depressed mood who had undergone assessment for psychiatric/psychological damage. The results indicated that the SIMS Total Score, Neurologic Impairment and Low Intelligence scales and the MMPI-2-RF Infrequent Responses (F-r) and Response Bias (RBS) scales successfully discriminated among symptom accentuators, symptom producers, and consistent participants. Machine learning analysis was used to identify the most efficient parameter for classifying these three groups, recognizing the SIMS Total Score as the best indicator.
Collapse
Affiliation(s)
- Cristina Mazza
- Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome, Rome, Italy
| | - Graziella Orrù
- Department of Surgical, Medical, Molecular & Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Franco Burla
- Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome, Rome, Italy
| | - Merylin Monaro
- Department of General Psychology, University of Padova, Padova, Italy
| | - Stefano Ferracuti
- Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome, Rome, Italy
| | - Marco Colasanti
- Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome, Rome, Italy
| | - Paolo Roma
- Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome, Rome, Italy
| |
Collapse
|
10
|
Pace G, Orrù G, Monaro M, Gnoato F, Vitaliani R, Boone KB, Gemignani A, Sartori G. Malingering Detection of Cognitive Impairment With the b Test Is Boosted Using Machine Learning. Front Psychol 2019; 10:1650. [PMID: 31396127 PMCID: PMC6664275 DOI: 10.3389/fpsyg.2019.01650] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Accepted: 07/01/2019] [Indexed: 11/28/2022] Open
Abstract
Objective: Here we report an investigation on the accuracy of the b Test, a measure to identify malingering of cognitive symptoms, in detecting malingerers of mild cognitive impairment. Method: Three groups of participants, patients with Mild Neurocognitive Disorder (n = 21), healthy elders (controls, n = 21), and healthy elders instructed to simulate mild cognitive disorder (malingerers, n = 21) were administered two background neuropsychological tests (MMSE, FAB) as well as the b Test. Results: Malingerers performed significantly worse on all error scores as compared to patients and controls, and performed poorly than controls, but comparably to patients, on the time score. Patients performed significantly worse than controls on all scores, but both groups showed the same pattern of more omission than commission errors. By contrast, malingerers exhibited the opposite pattern with more commission errors than omission errors. Machine learning models achieve an overall accuracy higher than 90% in distinguishing patients from malingerers on the basis of b Test results alone. Conclusions: Our findings suggest that b Test error scores accurately distinguish patients with Mild Neurocognitive Disorder from malingerers and may complement other validated procedures such as the Medical Symptom Validity Test.
Collapse
Affiliation(s)
- Giorgia Pace
- Department of Psychology, University of Padova, Padova, Italy
| | - Graziella Orrù
- Department of Surgical, Medical, Molecular and Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Merylin Monaro
- Department of Psychology, University of Padova, Padova, Italy
| | | | | | - Kyle B Boone
- Department of Psychiatry and Biobehavioral Sciences, UCLA School of Medicine, California School of Forensic Studies, Alliant International University, Alhambra, CA, United States
| | - Angelo Gemignani
- Department of Surgical, Medical, Molecular and Critical Area Pathology, University of Pisa, Pisa, Italy
| | | |
Collapse
|
11
|
Zago S, Piacquadio E, Monaro M, Orrù G, Sampaolo E, Difonzo T, Toncini A, Heinzl E. The Detection of Malingered Amnesia: An Approach Involving Multiple Strategies in a Mock Crime. Front Psychiatry 2019; 10:424. [PMID: 31263432 PMCID: PMC6589901 DOI: 10.3389/fpsyt.2019.00424] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Accepted: 05/29/2019] [Indexed: 12/23/2022] Open
Abstract
The nature of amnesia in the context of crime has been the subject of a prolonged debate. It is not uncommon that after committing a violent crime, the offender either does not have any memory of the event or recalls it with some gaps in its recollection. A number of studies have been conducted in order to differentiate between simulated and genuine amnesia. The recognition of probable malingering requires several inferential methods. For instance, it typically involves the defendant's medical records, self-reports, the observed behavior, and the results of a comprehensive neuropsychological examination. In addition, a variety of procedures that may detect very specific malingered amnesia in crime have been developed. In this paper, we investigated the efficacy of three techniques, facial thermography, kinematic analysis, and symptom validity testing in detecting malingering of amnesia in crime. Participants were randomly assigned to two different experimental conditions: a group was instructed to simulate amnesia after a mock homicide, and a second group was simply asked to behave honestly after committing the mock homicide. The outcomes show that kinematic analysis and symptom validity testing achieve significant accuracy in detecting feigned amnesia, while thermal imaging does not provide converging evidence. Results are encouraging and may provide a first step towards the application of these procedures in a multimethod approach on crime-specific cases of amnesia.
Collapse
Affiliation(s)
- Stefano Zago
- U.O.C. Neurologia, IRCSS Fondazione Ospedale Maggiore Policlinico di Milano, Milano, Italy
| | - Emanuela Piacquadio
- U.O.C. Neurologia, IRCSS Fondazione Ospedale Maggiore Policlinico di Milano, Milano, Italy
| | - Merylin Monaro
- Department of General Psychology, University of Padova, Padova, Italy
| | - Graziella Orrù
- Department of Surgical, Medical, Molecular & Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Erika Sampaolo
- U.O.C. Neurologia, IRCSS Fondazione Ospedale Maggiore Policlinico di Milano, Milano, Italy
- IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Teresa Difonzo
- U.O.C. Neurologia, IRCSS Fondazione Ospedale Maggiore Policlinico di Milano, Milano, Italy
| | - Andrea Toncini
- Department of General Psychology, University of Padova, Padova, Italy
| | - Eugenio Heinzl
- Dipartimento di Medicina Veterinaria, Università degli Studi di Milano, Milano, Italy
| |
Collapse
|
12
|
Mazza C, Monaro M, Orrù G, Burla F, Colasanti M, Ferracuti S, Roma P. Introducing Machine Learning to Detect Personality Faking-Good in a Male Sample: A New Model Based on Minnesota Multiphasic Personality Inventory-2 Restructured Form Scales and Reaction Times. Front Psychiatry 2019; 10:389. [PMID: 31275176 PMCID: PMC6593269 DOI: 10.3389/fpsyt.2019.00389] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Accepted: 05/16/2019] [Indexed: 11/13/2022] Open
Abstract
Background and Purpose. The use of machine learning (ML) models in the detection of malingering has yielded encouraging results, showing promising accuracy levels. We investigated the possible application of this methodology when trained on behavioral features, such as response time (RT) and time pressure, to identify faking behavior in self-report personality questionnaires. To do so, we reintroduced the article of Roma et al. (2018), which highlighted that RTs and time pressure are useful variables in the detection of faking; we then extended the number of participants and applied an ML analysis. Materials and Methods. The sample was composed of 175 subjects, of whom all were graduates (having completed at least 17 years of instruction), male, and Caucasian. Subjects were randomly assigned to four groups: honest speeded, faking-good speeded, honest unspeeded, and faking-good unspeeded. A software version of the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) was administered. Results. Results indicated that ML algorithms reached very high accuracies (around 95%) in detecting malingerers when subjects are instructed to respond under time pressure. The classifiers' performance was lower when the subjects responded with no time restriction to the MMPI-2-RF items, with accuracies ranging from 75% to 85%. Further analysis demonstrated that T-scores of validity scales are ineffective to detect fakers when participants were not under temporal pressure (accuracies 55-65%), whereas temporal features resulted to be more useful (accuracies 70-75%). By contrast, temporal features and T-scores of validity scales are equally effective in detecting fakers when subjects are under time pressure (accuracies higher than 90%). Discussion. To conclude, results demonstrated that ML techniques are extremely valuable and reach high performance in detecting fakers in self-report personality questionnaires over more the traditional psychometric techniques. Validity scales MMPI-2-RF manual criteria are very poor in identifying under-reported profiles. Moreover, temporal measures are useful tools in distinguishing honest from dishonest responders, especially in a no time pressure condition. Indeed, time pressure brings out malingerers in clearer way than does no time pressure condition.
Collapse
Affiliation(s)
- Cristina Mazza
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Merylin Monaro
- Department of General Psychology, University of Padua, Padua, Italy
| | - Graziella Orrù
- Department of Surgical, Medical, Molecular & Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Franco Burla
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Marco Colasanti
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Stefano Ferracuti
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Paolo Roma
- Department of Human Neuroscience, Sapienza University of Rome, Rome, Italy
| |
Collapse
|
13
|
Walczyk JJ, Sewell N, DiBenedetto MB. A Review of Approaches to Detecting Malingering in Forensic Contexts and Promising Cognitive Load-Inducing Lie Detection Techniques. Front Psychiatry 2018; 9:700. [PMID: 30622488 PMCID: PMC6308182 DOI: 10.3389/fpsyt.2018.00700] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2018] [Accepted: 12/03/2018] [Indexed: 12/04/2022] Open
Abstract
Malingering, the feigning of psychological or physical ailment for gain, imposes high costs on society, especially on the criminal-justice system. In this article, we review some of the costs of malingering in forensic contexts. Then the most common methods of malingering detection are reviewed, including those for feigned psychiatric and cognitive impairments. The shortcomings of each are considered. The article continues with a discussion of commonly used means for detecting deception. Although not traditionally used to uncover malingering, new, innovative methods are emphasized that attempt to induce greater cognitive load on liars than truth tellers, some informed by theoretical accounts of deception. As a type of deception, we argue that such cognitive approaches and theoretical understanding can be adapted to the detection of malingering to supplement existing methods.
Collapse
Affiliation(s)
- Jeffrey J. Walczyk
- Psychology and Behavioral Sciences, Louisiana Tech University, Ruston, LA, United States
| | | | | |
Collapse
|
14
|
Monaro M, Toncini A, Ferracuti S, Tessari G, Vaccaro MG, De Fazio P, Pigato G, Meneghel T, Scarpazza C, Sartori G. The Detection of Malingering: A New Tool to Identify Made-Up Depression. Front Psychiatry 2018; 9:249. [PMID: 29937740 PMCID: PMC6002526 DOI: 10.3389/fpsyt.2018.00249] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2018] [Accepted: 05/23/2018] [Indexed: 11/17/2022] Open
Abstract
Major depression is a high-prevalence mental disease with major socio-economic impact, for both the direct and the indirect costs. Major depression symptoms can be faked or exaggerated in order to obtain economic compensation from insurance companies. Critically, depression is potentially easily malingered, as the symptoms that characterize this psychiatric disorder are not difficult to emulate. Although some tools to assess malingering of psychiatric conditions are already available, they are principally based on self-reporting and are thus easily faked. In this paper, we propose a new method to automatically detect the simulation of depression, which is based on the analysis of mouse movements while the patient is engaged in a double-choice computerized task, responding to simple and complex questions about depressive symptoms. This tool clearly has a key advantage over the other tools: the kinematic movement is not consciously controllable by the subjects, and thus it is almost impossible to deceive. Two groups of subjects were recruited for the study. The first one, which was used to train different machine-learning algorithms, comprises 60 subjects (20 depressed patients and 40 healthy volunteers); the second one, which was used to test the machine-learning models, comprises 27 subjects (9 depressed patients and 18 healthy volunteers). In both groups, the healthy volunteers were randomly assigned to the liars and truth-tellers group. Machine-learning models were trained on mouse dynamics features, which were collected during the subject response, and on the number of symptoms reported by participants. Statistical results demonstrated that individuals that malingered depression reported a higher number of depressive and non-depressive symptoms than depressed participants, whereas individuals suffering from depression took more time to perform the mouse-based tasks compared to both truth-tellers and liars. Machine-learning models reached a classification accuracy up to 96% in distinguishing liars from depressed patients and truth-tellers. Despite this, the data are not conclusive, as the accuracy of the algorithm has not been compared with the accuracy of the clinicians; this study presents a possible useful method that is worth further investigation.
Collapse
Affiliation(s)
- Merylin Monaro
- Department of General Psychology, University of Padova, Padova, Italy
| | - Andrea Toncini
- Department of General Psychology, University of Padova, Padova, Italy
| | - Stefano Ferracuti
- Department of Human Neurosciences, University of Roma "La Sapienza", Rome, Italy
| | - Gianmarco Tessari
- Department of Human Neurosciences, University of Roma "La Sapienza", Rome, Italy
| | - Maria G Vaccaro
- Neuroscience Center, Department of Medical and Surgical Science, University "Magna Graecia", Catanzaro, Italy
| | - Pasquale De Fazio
- Department of Psychiatry, University "Magna Graecia", Catanzaro, Italy
| | - Giorgio Pigato
- Psychiatry Unit, Azienda Ospedaliera di Padova, Padova Hospital, Padova, Italy
| | - Tiziano Meneghel
- Dipartimento di Salute Mentale, Azienda Unità Locale Socio Sanitaria 9, Treviso, Italy
| | | | - Giuseppe Sartori
- Department of General Psychology, University of Padova, Padova, Italy
| |
Collapse
|