1
|
Wang A, Duan Y, Norton PG, Leiter MP, Estabrooks CA. Validation of the Maslach Burnout Inventory-General Survey 9-item short version: psychometric properties and measurement invariance across age, gender, and continent. Front Psychol 2024; 15:1439470. [PMID: 39081375 PMCID: PMC11286593 DOI: 10.3389/fpsyg.2024.1439470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Accepted: 07/04/2024] [Indexed: 08/02/2024] Open
Abstract
Background The Maslach Burnout Inventory-General Survey (MBI-GS) stands as the preeminent tool for assessing burnout across various professions. Although the MBI-GS9 emerged as a derivative of the MBI-GS and has seen extensive use over several years, a comprehensive examination of its psychometric properties has yet to be undertaken. Methods This study followed the Standards for Educational and Psychological Testing guidelines to validate the MBI-GS9. Employing a combined approach of classical test theory and item response theory, particularly Rasch analysis, within an integrated framework, the study analyzed data from 16,132 participants gathered between 2005 and 2015 by the Centre for Organizational Research at Acadia University. Results The findings revealed that the MBI-GS9 exhibited satisfactory reliability and validity akin to its predecessor, the MBI-GS. Across its three dimensions, Cronbach's α and omega coefficients ranged from 0.84 to 0.91. Notably, the MBI-GS9 displayed no floor/ceiling effects and demonstrated good item fit, ordered threshold, acceptable person and item separation and reliability, clear item difficulty hierarchy, and a well-distributed item threshold. However, the results suggested a recommended minimum sample size of 350 to mitigate potential information loss when employing the MBI-GS9. Beyond this threshold, the observed mean difference between the MBI-GS and MBI-GS9 held minimal practical significance. Furthermore, measurement equivalence tests indicated that the MBI-GS9 maintained an equivalent three-factor structure and factor loadings across various gender, age, and continent groups, albeit with inequivalent latent values across continents. Conclusion In sum, the MBI-GS9 emerges as a reliable and valid alternative to the MBI-GS, particularly when utilized within large, diverse samples across different age and gender demographics. However, to address potential information loss, a substantial sample size is recommended when employing the MBI-GS9. In addition, for cross-cultural comparisons, it is imperative to initially assess equivalence across different language versions at both the item and scale levels.
Collapse
Affiliation(s)
- Anni Wang
- School of Nursing, Fudan University, Shanghai, China
| | - Yinfei Duan
- Faculty of Nursing, University of Alberta, Edmonton, AB, Canada
| | - Peter G. Norton
- Department of Family Medicine, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | | | | |
Collapse
|
2
|
Hagan G, Okut H, Badgett RG. A Systematic Review of the Single-Item Burnout Question: Its Reliability Depends on Your Purpose. J Gen Intern Med 2024; 39:818-828. [PMID: 38424346 PMCID: PMC11043289 DOI: 10.1007/s11606-024-08685-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 02/14/2024] [Indexed: 03/02/2024]
Abstract
BACKGROUND Surveillance of burnout by the gold-standard Maslach Burnout Inventory (MBI) is hindered by cost and length. The validity and benchmarking of the commonly recommended and used single-item burnout question (SIBOQ) are unknown. We sought to (1) derive an equation for predicting the gold standard MBI from the SIBOQ and (2) measure the correlation of the SIBOQ with the full MBI and its subscales. METHODS We sought studies in PubMed along with citations by and to included studies. We included studies that either correlated the SIBOQ and the MBI or reported the rates of burnout measured by both instruments. Two reviewers extracted data and CLARITY risk of bias. We used generalized linear mixed regression to separately quantify the predictive (benchmarking) and explanatory (hot-spotting) capabilities of the SIBOQ. We created a regression equation for converting SIBOQ scores to MBI scores. We meta-analyzed correlation coefficients (r) for the SIBOQ and MBI subscales. For all analyses, we considered an r of 0.7 as acceptable reliability for group-level comparisons. RESULTS We included 17 studies reporting 6788 respondents. All studies had a high risk of bias, as no study had a response rate over 75% and no study was able to examine non-responders. The correlations (r) of the SIBOQ with the overall MBI were explanatory r = 0.82 and predictive r = 0.56. Regarding MBI subscales, the correlations of the SIBOQ with emotional exhaustion were adequate with r = 0.71 (95% CI 0.67-0.74; I2 = 89%), and depersonalization was r = 0.44 (95% CI 0.34-0.52; I2 = 90%). However, in 8 of 15 comparisons, the r was less than 0.70. DISCUSSION The SIBOQ's usually adequate explanatory abilities allow "hot-spotting" to identify subgroups with high or low burnout within a single, homogenous survey fielding. However, the predictive ability of the SIBOQ indicates insufficient reliability in comparing local results to external benchmarks.
Collapse
Affiliation(s)
- Grace Hagan
- Department of Internal Medicine, Mayo Clinic College of Medicine & Science, Rochester, MN, USA
| | - Hayrettin Okut
- Office of Research, University of Kansas School of Medicine-Wichita, Wichita, KS, USA
| | - Robert G Badgett
- Department of Internal Medicine, University of Kansas School of Medicine-Wichita, Wichita, KS, USA.
| |
Collapse
|
3
|
Nagasaki K, Nishizaki Y, Shinozaki T, Shimizu T, Yamamoto Y, Shikino K, Fukui S, Nishiguchi S, Kurihara M, Katayama K, Kobayashi H, Tokuda Y. Association between prolonged weekly duty hours and self-study time among residents: a cross-sectional study. Postgrad Med J 2023; 99:1080-1087. [PMID: 37265446 DOI: 10.1093/postmj/qgad044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 04/26/2023] [Accepted: 05/06/2023] [Indexed: 06/03/2023]
Abstract
PURPOSE In 2024, the Japanese government will enforce a maximum 80-hour weekly duty hours (DHs) regulation for medical residents. Although this reduction in weekly DHs could increase the self-study time (SST) of these residents, the relationship between these two variables remains unclear. The aim of the study was to investigate the relationship between the SST and DHs of residents in Japan. METHODS In this nationwide cross-sectional study, the subjects were candidates of the General Medicine In-Training Examination in the 2020 academic year. We administered questionnaires and categorically asked questions regarding daily SST and weekly DHs during the training period. To account for hospital variability, proportional odds regression models with generalized estimating equations were used to analyse the association between SST and DHs. RESULTS Of the surveyed 6117 residents, 32.0% were female, 49.1% were postgraduate year-1 residents, 83.8% were affiliated with community hospitals, and 19.9% worked for ≥80 hours/week. Multivariable analysis revealed that residents working ≥80 hours/week spent more time on self-study than those working 60-70 hours/week. Conversely, residents who worked <50 hours/week spent less time on self-study than those who worked 60-70 hours/week. The factors associated with longer SST were sex, postgraduate year, career aspiration for internal medicine, affiliation with community hospitals, academic involvement, and well-being. CONCLUSION Residents with long DHs had longer SSTs than residents with short DHs. Future DH restrictions may not increase but rather decrease resident SST. Effective measures to encourage self-study are required, as DH restrictions may shorten SST.
Collapse
Affiliation(s)
- Kazuya Nagasaki
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, Ibaraki 310-0015, Japan
| | - Yuji Nishizaki
- Division of Medical Education, Juntendo University School of Medicine, Tokyo, 113-8421, Japan
| | - Tomohiro Shinozaki
- Department of Information and Computer Technology, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan
| | - Taro Shimizu
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University Hospital, Tochigi, Japan
| | - Yu Yamamoto
- Division of General Medicine, Center for Community Medicine, Jichi Medical University, Tochigi, Japan
| | - Kiyoshi Shikino
- Department of General Medicine, Chiba University Hospital, Chiba, Japan
| | - Sho Fukui
- Department of Emergency and General Medicine, Kyorin University, Tokyo, Japan
| | - Sho Nishiguchi
- Department of General Internal Medicine, Shonan Kamakura General Hospital, Kamakura, Japan
| | - Masaru Kurihara
- Department of Patient Safety, Nagoya University Hospital, Nagoya, Japan
| | - Kohta Katayama
- Department of General Internal Medicine, St. Marianna University School of Medicine, Tokyo, Japan
- Department of Clinical Epidemiology, Graduate School of Medicine, Fukushima Medical University, Fukushima, Japan
| | - Hiroyuki Kobayashi
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, Ibaraki 310-0015, Japan
| | - Yasuharu Tokuda
- Muribushi Okinawa Center for Teaching Hospitals, Okinawa, Japan
- Tokyo Foundation for Policy Research, Tokyo, Japan
| |
Collapse
|
4
|
Nishizaki Y, Nagasaki K, Shikino K, Kurihara M, Shinozaki T, Kataoka K, Shimizu T, Yamamoto Y, Fukui S, Nishiguchi S, Katayama K, Kobayashi H, Tokuda Y. Relationship between COVID-19 care and burnout among postgraduate clinical residents in Japan: a nationwide cross-sectional study. BMJ Open 2023; 13:e066348. [PMID: 36639218 PMCID: PMC9842597 DOI: 10.1136/bmjopen-2022-066348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
OBJECTIVE The relationship between the care of patients with COVID-19 and mental health among resident physicians in Japan is imperative for ensuring appropriate care of patients with COVID-19 and should be clarified. We herein assessed the relationship between the care of patients with COVID-19 and mental health among postgraduate year 1 (PGY-1) and PGY-2 resident physicians and factors associated with mental health. DESIGN This nationwide cross-sectional study analysed data obtained using the clinical training environment self-reported questionnaire. SETTING An observational study across Japan among resident physicians (PGY-1 and PGY-2) from 583 teaching hospitals. PARTICIPANTS Examinees who took the general medicine in-training examination of academic year 2020. PRIMARY AND SECONDARY OUTCOME MEASURES The Patient Health Questionnaire and Mini-Z 2.0 were used to assess mental health, and experience of caring for patients with COVID-19 was divided into three groups (none, 1-10 and ≥11). The prevalence of mental conditions in the three groups was compared using the 'modified' Poisson generalised estimating equations by adjusting for prefecture-level, hospital-level and resident-level variables. RESULTS Of the 5976 participants analysed, 50.9% were PGY-1. The prevalence of burnout was 21.4%. Moreover, 47.0% of all resident physicians had no experience in the care of patients with COVID-19. The well-experienced group accounted for only 7.9% of the total participants. A positive association was found between the number of caring patients with COVID-19 and burnout (prevalence ratio 1.25; 95% CI 1.02 to 1.53). Moreover, the shortage of personal protective equipment was identified as a major contributor to burnout (prevalence ratio 1.60; 95% CI 1.36 to 1.88). CONCLUSIONS Resident physicians who experienced more care of patients with COVID-19 had slightly greater burnout prevalence than those who did not. Approximately half of resident physicians did not participate in the care of patients with COVID-19, which posed a challenge from an educational perspective.
Collapse
Affiliation(s)
- Yuji Nishizaki
- Division of Medical Education, Juntendo University School of Medicine, Tokyo, Japan
| | - Kazuya Nagasaki
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, Ibaraki, Japan
| | - Kiyoshi Shikino
- Department of General Medicine, Chiba University Hospital, Chiba, Japan
| | - Masaru Kurihara
- Department of Patient Safety, Nagoya University Hospital, Aichi, Japan
| | - Tomohiro Shinozaki
- Department of Information and Computer Technology, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan
| | - Koshi Kataoka
- Division of Medical Education, Juntendo University School of Medicine, Tokyo, Japan
| | - Taro Shimizu
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University Hospital, Tochigi, Japan
| | - Yu Yamamoto
- Division of General Medicine, Center for Community Medicine, Jichi Medical University, Tochigi, Japan
| | - Sho Fukui
- Department of Emergency and General Medicine, Kyorin University, Tokyo, Japan
| | - Sho Nishiguchi
- Department of General Internal Medicine, Shonan Kamakura General Hospital, Kanagawa, Japan
| | - Kohta Katayama
- Division of General Internal Medicine, Department of Internal Medicine, St. Marianna University School of Medicine, Kanagawa, Japan
| | - Hiroyuki Kobayashi
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, Ibaraki, Japan
| | - Yasuharu Tokuda
- Muribushi Okinawa Center for Teaching Hospitals, Okinawa, Japan
- Tokyo Foundation for Policy Research, Tokyo, Japan
| |
Collapse
|
5
|
Nagasaki K, Nishizaki Y, Shinozaki T, Shimizu T, Yamamoto Y, Shikino K, Fukui S, Nishiguchi S, Kurihara M, Kataoka K, Tokuda Y, Kobayashi H. Association between mental health and duty hours of postgraduate residents in Japan: a nationwide cross-sectional study. Sci Rep 2022; 12:10626. [PMID: 35739229 PMCID: PMC9218701 DOI: 10.1038/s41598-022-14952-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 06/15/2022] [Indexed: 11/11/2022] Open
Abstract
The new duty hour (DH) limit for doctors in Japan will begin in 2024, setting the maximum DHs for postgraduate residents at approximately 80 h weekly. To set appropriate limits, understanding the association between DHs and psychological health is necessary. Thus, we assessed the relationship between residents' psychological health and DHs. We conducted a cross-sectional study involving examinees of the General Medicine In-training Examination 2020. Mental health outcomes were measured dichotomously using the Patient Health Questionnaire-2 for depression and Mini-Z 2.0, for burnout, stress, and satisfaction. Weekly DHs were measured in seven categories at 10-h intervals. The prevalence ratios (PRs) between the DH categories were estimated for each outcome. Of the 6045 residents who provided data on DHs and psychological outcomes, 37.3% showed signs of depression, 21.6% experienced burn out, and 39.2% were highly stressed. In contrast, 62.3% were highly satisfied with their training. Proportions of burnout were higher among residents in Category 6 (≥ 90 and < 100 h; PR 1.36; 95% CI 1.11-1.66) and Category 7 (≥ 100 h; PR 1.36; 95% CI 1.10-1.68) compared with residents in Category 3 (≥ 60 and < 70 h; reference). The results partially support the weekly 80-h DH limit in terms of resident well-being.
Collapse
Affiliation(s)
- Kazuya Nagasaki
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, 3-2-7, Miyamachi, Mito, Ibaraki, 310-0015, Japan
| | - Yuji Nishizaki
- Division of Medical Education, Juntendo University School of Medicine, Tokyo, Japan
| | - Tomohiro Shinozaki
- Department of Information and Computer Technology, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan
| | - Taro Shimizu
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University Hospital, Tochigi, Japan
| | - Yu Yamamoto
- Division of General Medicine, Center for Community Medicine, Jichi Medical University, Tochigi, Japan
| | - Kiyoshi Shikino
- Department of General Medicine, Chiba University Hospital, Chiba, Japan
| | - Sho Fukui
- Immuno-Rheumatology Center, St. Luke's International Hospital, Tokyo, Japan
| | - Sho Nishiguchi
- Department of General Internal Medicine, Shonan Kamakura General Hospital, Kamakura, Japan
| | - Masaru Kurihara
- Department of Patient Safety, Nagoya University Hospital, Aichi, Japan
| | - Koshi Kataoka
- Division of Medical Education, Juntendo University School of Medicine, Tokyo, Japan
| | | | - Hiroyuki Kobayashi
- Department of Internal Medicine, Mito Kyodo General Hospital, University of Tsukuba, 3-2-7, Miyamachi, Mito, Ibaraki, 310-0015, Japan.
| |
Collapse
|