Vahey NA, Nicholson E, Barnes-Holmes D. A meta-analysis of criterion effects for the Implicit Relational Assessment Procedure (IRAP) in the clinical domain.
J Behav Ther Exp Psychiatry 2015;
48:59-65. [PMID:
25727521 DOI:
10.1016/j.jbtep.2015.01.004]
[Citation(s) in RCA: 66] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2014] [Revised: 12/12/2014] [Accepted: 01/14/2015] [Indexed: 10/24/2022]
Abstract
BACKGROUND AND OBJECTIVES
The Implicit Relational Assessment Procedure (IRAP) is a technique that is attracting a substantial body of research literature, particularly within the clinical domain.
METHOD
In response, the present paper outlines a meta-analysis of clinically-focused IRAP effects (N = 494) to provide the first estimate of how well such effects validate against their respective criterion variables in general.
RESULTS
The meta-analysis incorporated clinically-focused IRAP effects from 15 studies yielding a large effect size, r¯ = .45, with a desirably narrow 95% credibility interval (.23, .67). The funnel plot and subsequent sensitivity analyses indicated that this meta-effect was not subject to publication bias.
LIMITATIONS
The present meta-effect is an estimate based upon an IRAP literature that is still evolving rapidly in the clinical domain, and so as per its accompanying credibility interval, all conclusions that follow are necessarily provisional even if bounded. Apart from the fact that the current meta-effect might be subject to inadvertent under- and/or over-estimations of the current literature, the present meta-effect might strengthen with further refinements of the IRAP.
CONCLUSIONS
The current meta-effect provides the means to calculate what sample size would be required to achieve a statistical power of .80 when testing the criterion validity of clinically-focused IRAP effects using a given parametric statistic. For example, first-order Pearson correlations would hypothetically require an N of 29-37 for such purposes depending upon how conservatively over-estimation of the present meta-effect is controlled for. Overall, the IRAP compares favourably with alternative implicit measures in clinical psychology.
Collapse