Psychometric Testing of the Personal Internet Gaming Disorder Evaluation-9: A New Measure Designed to Assess Internet Gaming Disorder

Psychometric validity and the appropriateness of tolerance as a criterion for internet gaming disorder: A systematic review

Tolerance is a controversial but still an omnipresent criterion in measuring problematic gaming and Internet Gaming Disorder (IGD). Despite criticisms, a systematic review of its suitability has not been conducted until now. The aim of this study was to assess the evidence of psychometric validity and the appropriateness of tolerance as a criterion for IGD. A total of 61 articles were included in the review, 47 quantitative, 7 qualitative studies,plus 7 studies that introduce potential item wordings for operationalizing tolerance. Results showed that the tolerance item tends to have acceptable to high factor loadings on the single IGD factor. While tolerance sometimes did not adequately differentiate the engaged gamers from those with a probable disorder, it was endorsed at medium to high levels of IGD severity and had a good performance in the interviews. It, however, showed weak relations with distress and well-being. In qualitative studies, tolerance as currently defined by DSM-5 and measured by questionnaires (i.e., increasing amounts of time spent on gaming) was almost unequivocally rejected by gamers. The solid performance of tolerance in psychometric studies was probably due to deficiencies of the IGD construct, which also contains other disputed criteria. Tolerance lacks relevance in measuring IGD and care should be taken when using and interpreting IGD measures with this criterion.

Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) based on the clinical diagnosis of IGD in Japan

BACKGROUND AND AIMS

Although the Ten-Item Internet Gaming Disorder Test (IGDT-10) has been translated into Japanese and widely used, the Japanese version has not previously been validated. We used the clinical diagnosis of IGD as a gold standard for validating the test.

METHODS

The Japanese version was validated using 244 gamers drawn from the general young population in Japan. Expert interviews using the Japanese version of the Structured Clinical Interview for Internet Gaming Disorder evaluated diagnoses of Internet gaming disorder (IGD). This resulted in a diagnosis of IGD for eight individuals, categorized as the gold standard group. The screening performance of the two Japanese versions with different scoring conditions was examined: the scoring method proposed by the original study (original version) and a less stringent scoring method where responses of either "often" or "sometimes" were regarded as affirmative (modified version).

RESULTS

The results of the sensitivity and specificity analyses, the Cronbach's alpha and the receiver operating characteristics analysis revealed a higher screening performance for the modified versus the original version. The optimum cutoff for the modified version was 5 or more - the sensitivity, specificity, and Youden's index were 87.5, 85.2, and 72.7%, respectively. The rate of probable IGD using the original and modified versions were 1.8% and 11.3%, respectively.

DISCUSSION AND CONCLUSION

A less stringent scoring method for the Japanese version of IGDT-10 showed a higher screening performance than the original scoring method. Future studies comprising different ethnic groups and gaming cultures should further examine the suggested scoring method.

Development and Validation of a Risk Assessment Tool for Gaming Disorder in China: The Gaming Hazard Assessment Scale

Despite the growing research interest in gaming disorder, risk screening tools developed specifically for the Chinese population are still lacking. This study aimed to construct a screening tool to evaluate the risk of gaming disorder (GD) development, by assessing the severity of GD symptoms among Chinese gamers, based on clinical expert interviews, structured interviews with GD patients, a background literature review, and IGD/GD criteria proposed by the DSM-5 and ICD-11. It introduced the Gaming Hazard Assessment Scale—a multidimensional GD risk screening tool—and evaluated the dimension structure, reliability, and validity of the scale among 959 Chinese gamers. A three-level structure, consisting of 18 items scored from 0 to 54, ultimately indicated satisfactory reliability, good validity, and acceptable model fit. The scale will help large-scale initial screening and early identification of patients with a high risk of GD. Further evaluation of the Gaming Hazard Assessment Scale in clinical settings is highly recommended.

Development and validation of a nine-item short screening test for ICD-11 gaming disorder (GAMES test) and estimation of the prevalence in the general young population

BACKGROUND AND AIMS

A definition of gaming disorder (GD) was introduced in ICD-11. The purpose of this study was to develop a short screening test for GD, utilizing a reference GD group. It also sought to estimate the prevalence of GD among individuals, representative of the general young population in Japan.

METHODS

Two hundred eighty one men and women selected from the general population, aged between 10 and 29 years, and 44 treatment seekers at our center completed a self-reported questionnaire comprising candidate questions for the screening test. The reference group with ICD-11 GD was established, based on face-to-face interviews with behavioral addiction experts, using a diagnostic interview instrument. The questions in the screening test were selected to best differentiate those who had GD from those who did not, and the cutoff value was determined using the Youden index.

RESULTS

A nine-item screening test (GAMES test) was developed. The sensitivity and specificity of the test were both 98% and the positive predictive value in the study sample was 91%. The GAMES test comprised two factors, showed high internal consistency and was highly reproducible. The estimated prevalence of GD among the general young population was 7.6% (95% confidence interval; 6.6-8.7%) for males and 2.5% (1.9-3.2%) for females, with a combined prevalence of 5.1% (4.5-5.8%).

DISCUSSION AND CONCLUSION

The GAMES test shows high validity and reliability for screening of ICD-11 GD. The estimated prevalence of 5.1% among the general young population was comparable to the pooled estimates of young people globally.

Psychometric Properties of the Nine-Item Korean Internet Gaming Disorder Scale: Short Form

The main objective of this study was to examine the psychometric properties of the Korean version of the Internet Gaming Disorder Scale-Short Form (K-IGDS9-SF), a brief self-report instrument developed to assess Internet gaming disorder (IGD) in accordance with the Diagnostic and Statistical Manual of Mental Disorders-5th edition criteria. A total of 594 Korean game users (average age = 23.5 years, 70.37 percent male) participated and completed questionnaires containing the K-IGDS9-SF and other measures for its validation. The K-IGDS9-SF showed good reliability (Cronbach's α = 0.86, composite reliability coefficient = 0.87). Consistent with previous studies, the K-IGDS9-SF demonstrated a single-factor structure in a confirmatory factor analysis. Moreover, the K-IGDS9-SF had significant associations with related variables (IGD, game playing variables, self-esteem, impulsivity, and loneliness) in the expected direction, supporting its concurrent, criterion, and convergent validity. Taken together, these results indicated that the K-IGDS9-SF has satisfactory psychometric properties, suggesting its utility as a unified robust instrument for studying IGD worldwide.

Face validity evaluation of screening tools for gaming disorder: Scope, language, and overpathologizing issues

AIM

Critics of gaming disorder (GD; i.e., Internet gaming disorder in the DSM-5; Gaming disorder in the ICD-11) have expressed concerns about the potential risks of misclassification (e.g., false positives). An important consideration of relevance to this discussion is the extent to which commonly used screening instruments contain appropriate, sensible, and relevant items. The aim of this review was to evaluate the face validity of items within current tools for GD.

METHODS

A systematic review of databases identified 29 instruments. An item bank (n = 417 items) was independently evaluated by three professional raters (i.e., a senior academic in clinical psychology, a senior psychometrician, and an academic/clinical psychologist) according to guidelines for defining and measuring addiction and gaming disorder.

FINDINGS

Evaluation of the item bank identified issues related to: scope (i.e., "scope creep" or items of questionable relevance); language (i.e., confusing language, unusual wording or syntax); and overpathologizing (i.e., pathologizing typical and/or beneficial aspects or consequences of gaming). A total of 71 items across 23 tools had at least one face validity issue.

CONCLUSIONS

Most items (83%) demonstrated satisfactory face validity and were consistent with either the DSM-5 or ICD-11 GD classification. However, many tests contain at least one item that may pathologize normal gaming behaviors. Such items refer to basic changes in mood when gaming, a desire to play or continue playing games, and experiencing immersion when gaming. This analysis highlights the challenges of screening for problematic behaviors that are thought to arise within the context of normal recreational activities.

Screening and assessment tools for gaming disorder: A comprehensive systematic review

The inclusion of gaming disorder (GD) as an official diagnosis in the ICD-11 was a significant milestone for the field. However, the optimal measurement approaches for GD are currently unclear. This comprehensive systematic review aimed to identify and evaluate all available English-language GD tools and their corresponding evidence. A search of PsychINFO, PsychArticles, ScienceDirect, Scopus, Web of Science, and Google Scholar identified 32 tools employed in 320 studies (N = 462,249 participants). The evaluation framework examined tools in relation to: (1) conceptual and practical considerations; (2) alignment with DSM-5 and ICD-11 criteria; (3) type and quantity of studies and samples; and (4) psychometric properties. The evaluation showed that GD instrumentation has proliferated, with 2.5 tools, on average, published annually since 2013. Coverage of DSM-5 and ICD-11 criteria was inconsistent, especially for the criterion of continued use despite harm. Tools converge on the importance of screening for impaired control over gaming and functional impairment. Overall, no single tool was found to be clearly superior, but the AICA-Sgaming, GAS-7, IGDT-10, IGDS9-SF, and Lemmens IGD-9 scales had greater evidential support for their psychometric properties. The GD field would benefit from a standard international tool to identify gaming-related harms across the spectrum of maladaptive gaming behaviors.

Psychometric Evaluation and Comparison of Two Gaming Disorder Measures Derived From the DSM-5 and ICD-11 Frameworks

Gaming disorder was listed as a condition for further study in the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) in 2013, and measures of the disorder have mushroomed in the years since. The Gaming Disorder Test (GDT) was developed after gaming disorder was officially included in the 11th Revision of the International Classification of Diseases (ICD-11) in 2018. However, it remains unknown whether the GDT, which is based on the ICD-11 framework, is psychometrically similar to or different from the popular nine-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF) based on the DSM-5 framework. To address this important but unexplored issue, the present study evaluated and compared the psychometric properties of the GDT and IGDS9-SF in a sample of 544 adult gamers (56.2% men; mean age = 28.8, SD = 8.55). The results revealed both measures to have good reliability, structural validity, and criterion validity, with the exception of one IGDS9-SF item with a low factor loading. Moreover, the IGDS9-SF exhibited scalar measurement invariance for gender and age but only partial metric invariance for employment status, whereas the GDT exhibited scalar measurement invariance for all three demographic characteristics. Finally, the GDT displayed incremental validity over the IGDS9-SF in explaining gaming time, but not social anxiety and depressive symptoms. This study thus contributes to the literature by comparing measures derived from distinct gaming disorder diagnostic frameworks empirically. Recommendations for the selection of gaming disorder measures by researchers and practitioners are discussed.

Psychometric properties of the Internet Gaming Disorder Test (IGDT-10) and problematic gaming behavior among Finnish vocational school students

This study was conducted to investigate the psychometric properties of the Finnish version of the Internet Gaming Disorder Test (IGDT-10), identify the proportion displaying problematic gaming behavior (PGB) among Finnish vocational school students, and characterize the relationships between sociodemographic factors and gaming characteristics predicting PGB in this population. This cross-sectional study involving 773 students (mean age 17.5 years). Socio-demographic and gaming behavior characteristics were established using a web-based survey. A confirmatory factor analysis (CFA) showed that the IGDT-10 test has appropriate psychometric properties. The proportion of students exhibiting PGB based on the DSM-5 cut-off threshold was 1.3%. Regression analysis showed that male gender, preference for gaming on a personal computer, gaming time, poor self-perceived health status, and a preference for the solo and multiplayer online battle arenas (MOBA) game genres related positively to PGB scores. These findings demonstrate the appropriateness of the IGDT-10 test for the assessment of problematic gaming among adults, and support further research on PGB in Finland.

Internet and Video Game Addictions: Diagnosis, Epidemiology, and Neurobiology

In the past 2 decades, there has been substantial increase in availability and use of digital technologies, including the Internet, computer games, smart phones, and social media. Behavioral addiction to use of technologies spawned a body of related research. The recent inclusion of Internet gaming disorder as a condition for further study in the DSM-V invigorated a new wave of researchers, thereby expanding our understanding of these conditions. This article reviews current research, theory, and practice regarding the diagnosis, epidemiology, and neurobiology of Internet and video game addictions.