Is the "burnout epidemic" an academic fiction? A Systematic Review of Tools for Estimating the Prevalence and Assessment of Burnout and Introduction of New Instruments

Abstract :

Despite the time that has passed since the introduction and conceptualization of burnout syndrome and the vast amount of research conducted, its definition and measurement remain controversial. Therefore, the aim of this study was to examine and compare the psychometric properties of ten burnout assessment tools. A systematic search was conducted across databases including PsycINFO, ScienceDirect, Scopus, Medline, PubMed, Embase, Cochrane, Google Scholar, Web of Science, and Ovid to identify studies aimed at developing and publishing a burnout questionnaire. The search strategies resulted in 1,202 potentially eligible studies. The titles and abstracts of these studies were screened, leading to the identification of 11 potential studies for inclusion. The various forms of validity and reliability of each tool, as presented in the original version developed by the authors, were then evaluated. The sensitivity or cutoff point for distinguishing between clinical and non-clinical cases, as well as the consistency between the conceptualization and measurement of burnout in each tool, were examined. The study found that the Burnout Assessment Tool (BAT) has the most robust psychometric properties, with AVEM and the Copenhagen Burnout Inventory (CBI) following. The BAT is consistent in its conceptualization and measurement of burnout and includes a cutoff point for diagnosis. In contrast, the Maslach Burnout Inventory (MBI) lacks a cutoff point, has inadequate psychometric properties, and significant flaws. The study recommends that future researchers use more reliable tools for assessing and studying burnout to achieve accurate and practical outcomes.

References:

پری‌زاده, س., و بشلیده, د. ک. (1398). رابطة توانمندسازی ساختاری و رفتار شهروندی سازمانی: با نقش میانجی فرسودگی شغلی. روانشناسی, 92(23), 407-423.
داوری‌آشتیانی, ر., کامیان, ش., و خادمی, م. (1402). بررسی فرسودگی شغلی در پزشکان بیمارستان امام حسین (ع) در دوران پاندمی کووید19. روانشناسی, 108(27), 441-450.
سپهوند, د. ر., عارف‌نژاد, د. م., فتحی‌چگنی, ف., و سپهوند, م. (1399). رابطه قلدری در محل کار و رفتارهای انحرافی در محل کار با میانجیگری فرسودگی هیجانی. روانشناسی, 96(24), 417-434.
Ackerley, G. D., Burnell, J., Holder, D. C., & Kurdek, L. A. (1988). Burnout among licensed psychologists. Professional psychology: Research and practice, 19(6), 624.
Adriaenssens, J., De Gucht, V., & Maes, S. (2015). Determinants and prevalence of burnout in emergency nurses: a systematic review of 25 years of research. International journal of nursing studies, 52(2), 649-661.
Agha, R. A., Fowler, A. J., Limb, C., Whitehurst, K., Coe, R., Sagoo, H., Jafree, D. J., Chandrakumar, C., & Gundogan, B. (2016). Impact of the mandatory implementation of reporting guidelines on reporting quality in a surgical journal: a before and after study. International journal of surgery, 30, 169-172.
Ahola, K., Hakanen, J., Perhoniemi, R., & Mutanen, P. (2014). Relationship between burnout and depressive symptoms: A study using the person-centred approach. Burnout Research, 1(1), 29-37.
Ahola, K., Toppinen-Tanner, S., & Seppänen, J. (2017). Interventions to alleviate burnout symptoms and to support return to work among employees with burnout: Systematic review and meta-analysis. Burnout research, 4, 1-11.
Alkhamees, A. A., Aljohani, M. S., Kalani, S., Ali, A. M., Almatham, F., Alwabili, A., Alsughier, N. A., & Rutledge, T. (2023). Physician’s Burnout during the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health, 20(5), 4598.
Angelini, G., Buonomo, I., Benevene, P., Consiglio, P., Romano, L., & Fiorilli, C. (2021). The Burnout Assessment Tool (BAT): A Contribution to Italian Validation with Teachers’. Sustainability, 13(16), 9065.
Asghar, M. S., Yasmin, F., Alvi, H., Shah, S. M. I., Malhotra, K., Farhan, S. A., Naqvi, S. A. A., Yaseen, R., Anwar, S., & Rasheed, U. (2021). Assessing the mental impact and burnout among physicians during the COVID-19 pandemic: a developing country single-center experience. The American journal of tropical medicine and hygiene, 104(6), 2185.
Aumayr-Pintar, C., Cerf, C., & Parent-Thirion, A. (2018). Burnout in the Workplace: A Review of the Data and Policy Responses in the EU.
Bayes, A., Tavella, G., & Parker, G. (2021). The biology of burnout: Causes and consequences. The World Journal of Biological Psychiatry, 22(9), 686-698.
Bianchi, R. (2017). Is the “burnout epidemic” an academic fiction? BMJ, 358, j4389.
Bianchi, R., & Schonfeld, I. S. (2020). The Occupational Depression Inventory: A new tool for clinicians and epidemiologists. Journal of Psychosomatic Research, 138, 110249.
Bianchi, R., & Sowden, J. F. (2022). A paradigm shift from burnout to occupational depression. Journal of Affective Disorders, 303, 230-232.
Bouza, E., Gil-Monte, P. R., & Palomo, E. (2020). Work-related burnout syndrome in physicians in Spain. Rev Clin Esp (Barc), 220(6), 359-363. https://doi.org/10.1016/j.rce.2020.02.002 (Síndrome de quemarse por el trabajo (burnout) en los médicos de España.)
Bryan, C., Goodman, T., Chappelle, W., Thompson, W., & Prince, L. (2018). Occupational stressors, burnout, and predictors of suicide ideation among US Air Force remote warriors. Military Behavioral Health, 6(1), 3-12.
Cáceres-Mejía, B., Roca-Quicano, R., Torres, M. F., Pavic-Espinoza, I., Mezones-Holguín, E., & Fiestas, F. (2013). Factor analysis of the «Questionnaire for the evaluation of occupational burnout syndrome» in Peruvian medical students. Revista Psiquiatría Salud Mental, 209(1), 1-7.
Chalhub, R. Á., Menezes, M. S., Aguiar, C. V. N., Santos-Lins, L. S., Martins Netto, E., Brites, C., & Lins-Kusterer, L. (2021). Anxiety, health-related quality of life, and symptoms of burnout in frontline physicians during the COVID-19 pandemic. Brazilian Journal of Infectious Diseases, 25, 101618.
Consiglio, C., Mazzetti, G., & Schaufeli, W. B. (2021). Psychometric properties of the Italian version of the burnout assessment tool (BAT). International journal of environmental research and public health, 18(18), 9469.
de Beer, L. T., & Bianchi, R. (2019). Confirmatory Factor Analysis of the Maslach Burnout Inventory. European Journal of Psychological Assessment, 35(2), 217-224.
de Beer, L. T., Schaufeli, W. B., De Witte, H., Hakanen, J. J., Shimazu, A., Glaser, J., Seubert, C., Bosak, J., Sinval, J., & Rudnev, M. (2020). Measurement Invariance of the Burnout Assessment Tool (BAT) Across Seven Cross-National Representative Samples. International Journal of Environmental Research and Public Health, 17(15), 5604.
de la Fuente, E. I., Lozano, L. M., García-Cueto, E., San Luis, C., Vargas, C., Cañadas, G. R., Cañadas-De la Fuente, G. A., & Hambleton, R. K. (2013). Development and validation of the Granada Burnout Questionnaire in Spanish police. International Journal of Clinical and Health Psychology, 13(3), 216-225.
Deligkaris, P., Panagopoulou, E., Montgomery, A. J., & Masoura, E. (2014). Job burnout and cognitive functioning: A systematic review. Work & Stress, 28(2), 107-123.
Demerouti, E. (1999). Oldenburg burnout inventory. APA PsychTests.
Demerouti, E., Bakker, A. B., Vardakou, I., & Kantas, A. (2003). The convergent validity of two burnout instruments: A multitrait-multimethod analysis. European Journal of Psychological Assessment, 19(1), 12-23.
Doulougeri, K., Georganta, K., & Montgomery, A. (2016). “Diagnosing” burnout among healthcare professionals: can we find consensus? Cogent Medicine, 3(1), 1.
Edú-Valsania, S., Laguía, A., & Moriano, J. A. (2022). Burnout: A review of theory and measurement. International journal of environmental research and public health, 19(3), 1780.
Fleming, P. S., Seehra, J., Polychronopoulou, A., Fedorowicz, Z., & Pandis, N. (2012). A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. The Angle Orthodontist, 83(1), 158-163.
Freudenberger, H. J. (1975). The staff burn-out syndrome in alternative institutions. Psychotherapy: Theory, Research & Practice, 12(1), 73.
Friedman, I. (1999). Teacher burnout: The concept and its measurement. Henrietta Szold Institute: Jerusalem, Israel. Gil-Monte, P. (2008). Evaluación psicométrica del síndrome de quemarse por el trabajo (burnout): el cuestionario “CESQT”. J. Garrido (Comp.),¡ Maldito trabajo, 269-291.
Gil-Monte, P. R. (2011). CESQT Cuestionario para la Evaluación del Síndrome de Quemarse por el Trabajo. Madrid, España, TEA Ediciones.
González-Romá, V., Schaufeli, W. B., Bakker, A. B., & Lloret, S. (2006). Burnout and work engagement: Independent factors or opposite poles? Journal of Vocational Behavior, 68(1), 165-174.
Haddaway, N. R., Page, M. J., Pritchard, C. C., & McGuinness, L. A. (2022). PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis. Campbell Systematic Reviews, 18(2), e1230.
Han, S. J., Bonn, M. A., & Cho, M. (2016). The relationship between customer incivility, restaurant frontline service employee burnout and turnover intention. International Journal of Hospitality Management, 52, 97-106.
Hiver, C., Villa, A., Bellagamba, G., & Lehucher-Michel, M.-P. (2022). Burnout prevalence among European physicians: a systematic review and meta-analysis. International Archives of Occupational and Environmental Health, 95(1), 259-273. Humborstad, S. I., Humborstad, B., & Whitfield, R. (2007). Burnout and service employees' willingness to deliver quality service. Journal of Human Resources in Hospitality & Tourism, 7(1), 45-64.
Jokstad, A. (2018). Patient-reported outcomes (PROs) versus patient-reported outcome measures (PROMs)-Is there a difference? Clin Exp Dent Res, 4(3), 61-62.
Kalani, S., Esfahani, M. D., & Khanlari, P. (2024). A Persian validation of the burnout assessment tool. BMC Public Health, 24(1), 1849.
Kieschke, U., & Schaarschmidt, U. (2008). Professional commitment and health among teachers in Germany: A typological approach. Learning and Instruction, 18(5), 429-437.
Kristensen, T. S., Borritz, M., Villadsen, E., & Christensen, K. B. (2005). The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work & Stress, 19(3), 192-207.
Laurent, E., Schonfeld, I. S., Bianchi, R., Hawryluck, L., & Brindley, P. G. (2018). On the “bubble” of burnout’s prevalence estimates. Intensive Care Medicine, 44(4), 544-545.
Leclercq, V., Beaudart, C., Ajamieh, S., Rabenda, V., Tirelli, E., & Bruyere, O. (2019). Meta-analyses indexed in PsycINFO had a better completeness of reporting when they mention PRISMA. Journal of clinical epidemiology, 115, 46-54.
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Annals of internal medicine, 151,(4) W-65-W-94.
Malakh-Pines, A., Aronson, E., & Kafry, D. (1981). Burnout : from tedium to personal growth. Free Press. http://books.google.com/books?id=9_NGAAAAMAAJ
Maslach, C. (2006). nderstanding job burnout. In Stress and Quality of Working Life: Current Perspectives in Occupational Health; Rossi, A.M., Perrewé, P.L., Sauter, S.L., Eds.; Information Age Publishing: Charlotte, NC, USA (pp. 37-51).
Maslach, C., & Jackson, S. E. (1981). The measurement of experienced burnout. Journal of Organizational Behavior, 2(2), 99-113.
Maslach, C., & Jackson, S. E. (1997). Maslach Burnout Inventory. Manual; . Consulting Psychologists Press.
Maslach, C., Jackson, S. E., & Leiter, M. P. (1997). Maslach Burnout Inventory: Third edition. In Evaluating stress: A book of resources. (pp. 191-218). Scarecrow Education.
Maslach, C., Jackson, S. E., & Leiter, M. P. (2016). Maslach burnout inventory, 4th ed. Consulting Psychologists Press. Montero-Marín, J. (2016). El síndrome de burnout y sus diferentes manifestaciones clínicas: una propuesta para la intervención. Anestesia Analgesia Reanimación, 29(1), 4-4.
Moreno-Jimenez, B., Barbaranelli, C., Galvez Herrer, M., & Garrosa Hernandez, E. (2012). The Physician Burnout Questionnaire: A new definition and measure. TPM: Testing, Psychometrics, Methodology in Applied Psychology, 19.(4). Näätänen, P., Aro, A., Matthiesen, S., & Salmela-Aro, K. (2003). Bergen Burnout Indicator-15.
Oprea, B., Iliescu, D., & De Witte, H. (2021). Romanian short version of the Burnout Assessment Tool: Psychometric properties. Evaluation & the Health Professions, 44(4), 406-415.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., & Brennan, S. E. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International journal of surgery, 88, 105906.
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catala-Lopez, F., Li, L., Reid, E. K., & Sarkis-Onofre, R. (2016). Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS medicine, 13(5), e1002028.
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013). Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. Plos one, 8(12), e83138.
Penz, M., Stalder, T., Miller, R., Ludwig, V. M., Kanthak, M. K., & Kirschbaum, C. (2018). Hair cortisol as a biological marker for burnout symptomatology. Psychoneuroendocrinology, 87, 218-221.
Pérez-Fuentes, M. d. C., Molero Jurado, M. d. M., Martos Martínez, Á., & Gázquez Linares, J. J. (2018). New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing. International Journal of Environmental Research and Public Health, 15(12), 2718.
Raedeke, T. D., & Smith, A. L. (2001). Development and Preliminary Validation of an Athlete Burnout Measure. Journal of Sport and Exercise Psychology, 23(4), 281-306. https://doi.org/10.1123/jsep.23.4.281
Rössler, W. (2012). Stress, burnout, and job dissatisfaction in mental health workers. European archives of psychiatry and clinical neuroscience, 262, 65-69.
Rotenstein, L. S., Torre, M., Ramos, M. A., Rosales, R. C., Guille, C., Sen, S., & Mata, D. A. (2018). Prevalence of Burnout Among Physicians: A Systematic Review. Jama, 320(11), 1131-1150.
Salmela-Aro, K., Nurmi, J.-E., & Näätänen, P. (2004). Personal projects and burnout intervention: two longitudinal interventions. Work and Stress.
Salmela-Aro, K., Rantanen, J., Hyvönen, K., Tilleman, K., & Feldt, T. (2011). Bergen Burnout Inventory: reliability and validity among Finnish and Estonian managers. International Archives of Occupational and Environmental Health, 84(6), 635-645.
Salvagioni, D. A. J., Melanda, F. N., Mesas, A. E., González, A. D., Gabani, F. L., & Andrade, S. M. d. (2017). Physical, psychological and occupational consequences of job burnout: A systematic review of prospective studies. PloS one, 12(10), e0185781.
Schaarschmidt, U., & Fischer, A. (1996). Arbeitsbezogenes Verhaltens-und Erlebensmuster. Swets Test Services.
Schaarschmidt, U., & Fischer, A. (1996). AVEM: arbeitsbezogene Verhaltens-und Erlebnismuster. Swets Test Services.
Schaarschmidt, U., & Fischer, A. W. (2003). Arbeitsbezogenes Verhaltens-und Erlebensmuster:(AVEM).
Schabracq, M., Winnubst, J. A., & Cooper, C. L. (2003). The handbook of work and health psychology. Wiley Online Library.
Schaufeli, W., & Enzmann, D. (2020). The burnout companion to study and practice: A critical analysis. CRC press.
Schaufeli, W. B., Desart, S., & De Witte, H. (2020). Burnout Assessment Tool (BAT)—Development, Validity, and Reliability. International Journal of Environmental Research and Public Health, 17(24), 9495.
Schaufeli, W. B., Leiter, M. P., & Maslach, C. (2009). Burnout: 35 years of research and practice. Career development international, 14(3), 204-220.
Schaufeli, W. B., & Taris, T. W. (2005). The conceptualization and measurement of burnout: Common ground and worlds apart The views expressed in Work & Stress Commentaries are those of the author(s), and do not necessarily represent those of any other person or organization, or of the journal. Work & Stress, 19(3), 256-262. https://doi.org/10.1080/02678370500385913
Schonfeld, I. S., Laurent, E., & Bianchi, R. (2018). Burnout Research: Eyes Wide Shut. Crit Care Med, 46(2), e179-e180. Shirom, A. (2003). Job-related burnout: A review. In Handbook of occupational health psychology. (pp. 245-264). American Psychological Association. https://doi.org/10.1037/10474-012
Shirom, A., Quick, J., & Tertick, L. (2003). Handbook of occupational health psychology. American Psychological Association. Shoman, Y., Marca, S. C., Bianchi, R., Godderis, L., van der Molen, H. F., & Guseva Canu, I. (2021). Psychometric properties of burnout measures: a systematic review. Epidemiology and Psychiatric Sciences, 30, e8, Article e8.
Sinval, J., Vazquez, A. C. S., Hutz, C. S., Schaufeli, W. B., & Silva, S. (2022). Burnout Assessment Tool (BAT): Validity Evidence from Brazil and Portugal. International Journal of Environmental Research and Public Health, 19(3), 1344.
Surawicz, C. M. (2014). J. Edward Berk distinguished lecture: avoiding burnout: finding balance between work and everything else. Official journal of the American College of Gastroenterology| ACG, 109(4), 511-514.
Treluyer, L., & Tourneux, P. (2021). Burnout among paediatric residents during the COVID-19 outbreak in France. European journal of pediatrics, 180, 627-633.
Ugwu, L. I., Enwereuzor, I. K., Fimber, U. S., & Ugwu, D. I. (2017). Nurses’ burnout and counterproductive work behavior in a Nigerian sample: The moderating role of emotional intelligence. International journal of Africa nursing sciences, 7, 106-113. Van der Heiden, C., & Hoogduin, C. (2002). Burn-out: diagnostiek en behandeling. TBV–Tijdschrift voor Bedrijfs-en Verzekeringsgeneeskunde, 10, 48-53.
Vinueza-Solórzano, A. M., Portalanza-Chavarría, C. A., de Freitas, C. P. P., Schaufeli, W. B., De Witte, H., Hutz, C. S., & Souza Vazquez, A. C. (2021). The Ecuadorian Version of the Burnout Assessment Tool (BAT): Adaptation and Validation. International Journal of Environmental Research and Public Health, 18(13), 7121.
Wheeler, D. L., Vassar, M., Worley, J. A., & Barnes, L. L. (2011). A reliability generalization meta-analysis of coefficient alpha for the Maslach Burnout Inventory. Educational and Psychological measurement, 71(1), 231-244.
Williamson, K., Lank, P. M., Cheema, N., Hartman, N., Lovell, E. O., & Alliance, E. M. E. R. (2018). Comparing the Maslach burnout inventory to other well-being instruments in emergency medicine residents. Journal of graduate medical education, 10(5), 532-536.